CN109587185A - Object processing method in cloud storage system and cloud storage system - Google Patents

Object processing method in cloud storage system and cloud storage system Download PDF

Info

Publication number
CN109587185A
CN109587185A CN201710896038.5A CN201710896038A CN109587185A CN 109587185 A CN109587185 A CN 109587185A CN 201710896038 A CN201710896038 A CN 201710896038A CN 109587185 A CN109587185 A CN 109587185A
Authority
CN
China
Prior art keywords
server
information
sent
barrel
ktcpvs
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710896038.5A
Other languages
Chinese (zh)
Other versions
CN109587185B (en
Inventor
吕金泉
付旭东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201710896038.5A priority Critical patent/CN109587185B/en
Priority to CN202011127481.4A priority patent/CN112422630A/en
Publication of CN109587185A publication Critical patent/CN109587185A/en
Application granted granted Critical
Publication of CN109587185B publication Critical patent/CN109587185B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/543User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

This application provides the object processing methods in a kind of cloud storage system and the cloud storage system.The object processing method includes: that first server receives the first write command that client is sent, and the first object is written in first barrel for requesting for the first write command;First server the first object is written in first barrel of the first memory node set according to the first write command, and the first object is sent to second server;Second server receives the second write command that client is sent, and the second object is written in first barrel for requesting for the second write command;Second server the second object is written in first barrel of the second memory node set according to the second write command, and sends the second object to first server.Object processing method in cloud storage system provided by the present application and the cloud storage system helps to save resource.

Description

Object processing method in cloud storage system and cloud storage system
Technical field
This application involves cloud storage fields, and more particularly, to the object in cloud storage system and cloud storage system Processing method.
Background technique
In public cloud field of storage, storage can be provided the user with using active and standby (active-passive, AP) mode Service.
In existing ap mode, a region is divided into two and provides the region (access zone, AZ) of service, and one is known as Main AZ, another is known as standby AZ.It is deployed with cluster (cluster) in main AZ, is also deployed with cluster in standby AZ.Cluster in main AZ A cluster group (cluster group, CG) is formed with the cluster in standby AZ.The duplication direction of object (object) is from main AZ In cluster copy to the cluster in standby AZ.The request of object is written all by the cluster in main AZ in user in the region Reason.
Specifically, when client will write cluster that object requests are sent in main AZ, this is right for cluster-based storage in main AZ As, and the cluster into standby AZ replicates the object;It is standby when client just likes that writes the cluster that object requests are sent in standby AZ Cluster in AZ needs that object is first sent to the cluster in main AZ, the collection after the cluster-based storage object in main AZ, in main AZ Object is copied to the cluster in standby AZ by group again.
This processing method in existing ap mode, it is big to will lead to data forwarding amount, consumes more resource.
Summary of the invention
This application provides the object processing method in a kind of cloud storage system and the cloud storage system, help to save money Source.
In a first aspect, this application provides the object processing methods in a kind of cloud storage system.Include in cloud storage system First server, the first memory node set, second server and the second memory node set, first server and the first storage Node set is located in the first service region of cloud storage system, and second server and the second memory node are located at cloud storage system Second service region in, in the first memory node set and the second memory node set include first barrel.
The object processing method includes:
First server receives the first write command that client is sent, and the first object is written for requesting for the first write command In first barrel;
First server the first object is written in first barrel of the first memory node set according to the first write command, and First object is sent to second server, in order to which the first object is written the of the second memory node set by second server In one barrel;
Second server receives the second write command that client is sent, and the second object is written for requesting for the second write command In first barrel;
Second server the second object is written in first barrel of the second memory node set according to the second write command, and The second object is sent to first server, in order to which the second object is written the first of the first memory node set by first server In bucket.
In the object processing method, first server and second server are received when requesting to write the write command of object, It oneself can store, and replicate object to other side.Compared in the prior art, reduce the forwarding process of object, so as to Save resource.
With reference to first aspect, in the first possible implementation, cloud storage system further includes the first KTCPVS.
In this case, first server receives the first write command that client is sent, comprising:
First KTCPVS receives the first write command that client is sent, and is determined according to the first write command and sends out the first write command First server is given, and sends the first write command to first server;
First server receives the first write command that the first KTCPVS is sent.
Second server receives the second write command that client is sent, comprising:
First KTCPVS receives the second write command that client is sent, and is determined according to the second write command and sends out the second write command Second server is given, and sends the second write command to second server;
Second server receives second write command that the first KTCPVS is sent.
In conjunction with the first possible implementation, in the second possible implementation, object processing method further include:
First KTCPVS receives the first reading instruction that client is sent, and the first reading instruction is read in first barrel for requesting First object determines to first server according to the first reading instruction and sends the first reading instruction, and sends first to first server Reading instruction;
First server receives the first reading instruction that the first KTCPVS is sent, and reads the first storage according to the first reading instruction The first object in first barrel of node set;
First KTCPVS receives the second reading instruction that client is sent, and the second reading instruction is read in first barrel for requesting Second object determines to second server according to the second reading instruction and sends the second reading instruction, and sends second to second server Reading instruction;
Second server receives the second reading instruction that the first KTCPVS is sent, and reads the second storage according to the second reading instruction The second object in first barrel of node set.
In the implementation, the first write command is sent to first server by the first KTCPVS, by first server conduct After primary server stores the first object, and the first reading instruction is sent to first server, is stored by first server from first The first object is read in node set, so as to keep the strong consistency of the first object.
Similarly, the strong consistency of the second object can be kept.
In conjunction with second of possible implementation, in the third possible implementation, have first on the first KTCPVS Information, the first information include: first barrel and are corresponding in turn to first server and second server.
In this case, the first KTCPVS is determined according to the first write command is sent to first server for the first write command, Include: the first KTCPVS according to the first write command, calculates Kazakhstan of first object relative to number of servers corresponding to first barrel Uncommon value, obtains the first cryptographic Hash;According to the first information with the first cryptographic Hash, determine to first barrel of first corresponding first service Device sends the first write command.
First KTCPVS is determined according to the second write command is sent to second server for the second write command, comprising: first KTCPVS calculates cryptographic Hash of second object relative to number of servers corresponding to first barrel, obtains according to the second write command Second cryptographic Hash;According to the first information with the second cryptographic Hash, determines to first barrel second corresponding second server and send the Two write commands.
First KTCPVS is determined according to the first reading instruction is sent to first server for the first reading instruction, comprising: first KTCPVS calculates cryptographic Hash of first object relative to number of servers corresponding to first barrel, obtains according to the first reading instruction First Hash meeting;According to the first information with the first cryptographic Hash, determines to first barrel first corresponding first server and send the One reading instruction.
First KTCPVS is determined according to the second reading instruction is sent to second server for the second reading instruction, comprising: first KTCPVS calculates cryptographic Hash of second object relative to number of servers corresponding to first barrel, obtains according to the second reading instruction Second cryptographic Hash;According to the first information with the second cryptographic Hash, determines to first barrel second corresponding second server and send the Two reading instructions.
In conjunction with the third possible implementation, in the fourth possible implementation, the first information includes the first son Information, the second sub-information and third sub-information, the first sub-information are as follows: first barrel successively includes the first sub- bucket and the second sub- bucket, and the Two sub-informations are as follows: the corresponding primary server of the first sub- bucket is first server, third sub-information are as follows: the corresponding main clothes of the second sub- bucket Business device is second server.
In this case, the first KTCPVS is determined according to the first information with the first cryptographic Hash to first barrel of first correspondence First server send the first write command, comprising: the first KTCPVS is determined the according to the first sub-information and the first cryptographic Hash An object is written in first barrel first corresponding first sub- bucket;According to the second sub-information and the first sub- bucket, determine to the first clothes Business device sends the first write command.
First KTCPVS with the second cryptographic Hash, is determined to first barrel of second corresponding second server according to the first information Send the second write command, comprising: the first KTCPVS is determined the second object write-in the according to the first sub-information and the second cryptographic Hash In one barrel second corresponding second sub- bucket;According to third sub-information and the second sub- bucket, determines to second server and send second Write command.
First KTCPVS with the first cryptographic Hash, is determined to first barrel of first corresponding first server according to the first information Send the first reading instruction, comprising: the first KTCPVS is determined according to the first sub-information and the first cryptographic Hash and read first barrel first The first object in corresponding first sub- bucket;According to the second sub-information and the first sub- bucket, determines to first server and send first Reading instruction.
First KTCPVS with the second cryptographic Hash, is determined to first barrel of second corresponding second server according to the first information Send the second reading instruction, comprising: the first KTCPVS is determined according to the first sub-information and the second cryptographic Hash and read first barrel second The second object in corresponding second sub- bucket;According to third sub-information and the second sub- bucket, determines to second server and send second Reading instruction.
In conjunction with the third or the 4th kind of possible implementation, in a fifth possible implementation, cloud storage system Further include location server, is configured with the first information on location server.
In this case, object processing method further include: the first KTCPVS obtains the first information from location server.
It is also configured on location server in a sixth possible implementation in conjunction with the 5th kind of possible implementation There is the second information, the second information includes stating first barrel of corresponding KTCPVS as the first KTCPVS, and cloud storage system further includes domain Name system equipment.
In this case, the first KTCPVS receives the first write command that client is sent, comprising:
Domain name system equipment receives the first uniform resource locator that client is sent, and wraps in the first uniform resource locator Include the first write command;First barrel of information is sent to location server according to the first uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information, the first information is used to indicate the first KTCPVS;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send the first write command;
First KTCPVS receives the first write command that client is sent according to the first instruction information.
First KTCPVS receives the second write command that client is sent, comprising:
Domain name system equipment receives the second uniform resource locator that client is sent, and wraps in the second uniform resource locator Include the second write command;First barrel of information is sent to location server according to the second uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send the second write command;
First KTCPVS receives the second write command that client is sent according to the first instruction information.
First KTCPVS receives the first reading instruction that client is sent, comprising:
Domain name system equipment receives the third uniform resource locator that client is sent, and wraps in third uniform resource locator Include the first reading instruction;First barrel of information is sent to location server according to third uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send the first reading instruction;
First KTCPVS receives the first reading instruction that client is sent according to the first instruction information.
First KTCPVS receives the second reading instruction that client is sent, comprising:
Domain name system equipment receives the 4th uniform resource locator that client is sent, and wraps in the 4th uniform resource locator Include the second reading instruction;First barrel of information is sent to location server according to the 4th uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send second reading instruction;
First KTCPVS receives the second reading instruction that client is sent according to the first instruction information.
In the implementation, client can be corresponding from first barrel of location server acquisition by domain name system equipment The instruction information of KTCPVS, so that the cloud storage system can arrange multiple KTCPVS, so as to balanced KTCPVS's Load pressure.
Second aspect includes for realizing first party in the cloud storage system this application provides a kind of cloud storage system The first server of object processing method in the possible implementation of any one in face or first aspect, the first memory node Set, second server, the second memory node set, the first KTCPVS, location server and domain name system equipment.
The third aspect, this application provides a kind of computer program products comprising instruction.When the computer program product When being run in cloud storage system, so that cloud storage system executes any one possible realization in first aspect or first aspect Object processing method in mode.
Fourth aspect, this application provides a kind of computer readable storage mediums.It is deposited in the computer readable storage medium The program code that storage is executed for cloud storage system.The program code includes any in first aspect or first aspect for executing A kind of instruction of object processing method in possible implementation.
Detailed description of the invention
Fig. 1 is the schematic architectural diagram of the application scenarios of the application one embodiment;
Fig. 2 is the schematic flow chart of the object processing method 200 of the application one embodiment;
Fig. 3 is the detailed maps of the S210 and S230 in object processing method 200;
Fig. 4 is the schematic architectural diagram of the application scenarios of the application another embodiment;
Fig. 5 is the schematic flow chart that can also include the steps that in object processing method 200;
Fig. 6 is the schematic architectural diagram of the application scenarios of the application another embodiment;
Fig. 7 is the schematic architectural diagram of the application scenarios of the application another embodiment;
Fig. 8 is the schematic flow chart of the application scenarios of the application another embodiment;
Fig. 9 is the schematic flow chart of the cloud storage system of the application another embodiment.
Specific embodiment
Below in conjunction with attached drawing, the technical solution in the application is described.
Fig. 1 is the schematic diagram of the cloud storage system of the application one embodiment.It should be understood that the embodiment of the present application It can also include more or less device in cloud storage system.In addition, the device in Fig. 1 can be hardware, it is also possible to The software that functionally divides or more than both combination.
Cloud storage system shown in FIG. 1 includes the first cluster and the second cluster.First cluster can be referred to as cluster 1, the Two clusters can be referred to as cluster 2.
It include physical server and N number of memory node in cluster 1.Memory node can be located in physical server, can also To be communicated independently of physical server and with physical server.Physical server runs virtual machine, such as Linux virtual server (linux virtual server, LVS).Wherein, N number of memory node include node 1 to node N, N be the integer not less than 2. First server can be in communication with each other with N number of memory node.
It include physical server and M memory node in cluster 2.Memory node can be located in physical server, can also To be communicated independently of physical server and with physical server.Physical server runs virtual machine, such as second server.Its In, M is positive integer, and M memory node includes node 1 to node M, and M is the integer not less than 2.Second server can be with M Memory node is in communication with each other.
Memory node in the embodiment of the present application can be hard disk, such as mechanical hard disk, solid state hard disk etc., or external Equipment is stored, such as storage array, Direct Attached Storage (direct access storage, DAS) etc., the embodiment of the present application pair This is not construed as limiting.
It should be understood that the LVS in the embodiment of the present application is a kind of example, it is also possible to other types virtual server.
Physical server in cluster 1 is properly termed as first server, and the physical server in cluster 2 is properly termed as second Server, N number of memory node in cluster 1 are properly termed as the first memory node set, and M memory node in cluster 2 can be with Referred to as the second memory node set,
It can be in communication with each other between first server and second server.First server and second server and client Between can communicate.It should be understood that described herein be in communication with each other both includes direct communication, it also include passing through other equipment or device Communication.
The region of cloud storage system service shown in FIG. 1 is known as region (region) 1.Region 1 is divided into AZ1 and AZ2.Collection Group 1 is located in AZ1, and cluster 2 is located in AZ2.
Cluster 1 and cluster 2 may be constructed two cluster groups, and one is properly termed as the first cluster group, referred to as CG1;It is another It is a to be properly termed as the second cluster group, referred to as CG2.
In first cluster group, the replication relation of object is from the first cluster to the second cluster.In second cluster group, object Replication relation is from the second cluster to the first cluster.
The replication relation of object refers to from the first cluster to the second cluster, the first clothes when object is written, in the first cluster Business device stores object into the first memory node set of the first cluster, and object is sent to the second clothes in the second cluster Business device, in order to which second server stores object in the second memory node set into the second cluster;When reading object, by The first server of first cluster reading object from the first memory node set of the first cluster.That is, belonging to the first cluster AZ1 is main AZ, and AZ2 belonging to the second cluster is standby AZ.
The replication relation of object refers to from the second cluster to the first cluster, the second clothes when object is written, in the second cluster Business device stores object in the second memory node set into the second cluster, and object is sent to first in the first cluster Server, in order to which first server stores object in the first memory node set into the first cluster;When reading object, By the second server of the second cluster from the second memory node set of the second cluster reading object.That is, belonging to the second cluster AZ2 be main AZ, AZ1 belonging to the first cluster is standby AZ.
One schematic flow chart of the object processing method 200 in cloud storage system shown in FIG. 1 as shown in Fig. 2,
It should be understood that the step of Fig. 2 shows object processing method 200 or operation, but these steps or operation are only examples, The deformation of other operations or each operation in Fig. 2 can also be performed in the embodiment of the present application.In addition, each step in Fig. 2 It can be executed according to the different sequences presented from Fig. 2, and it is possible to not really want to execute all operationss in Fig. 2.
Object processing method 200 may include to include S210, S220, S230 and S240.
S210, first server receive the first write command that client is sent, and the first write command is for requesting first pair As in first barrel of write-in.
The step can be accomplished in several ways, and possible implementation will be described in detail in subsequent content.
S220, first server are written first barrel of the first memory node set according to the first write command, by the first object In, and the first object is sent to second server, in order to which the second memory node collection is written in the first object by second server In first barrel closed.
Further, after second server receives the first object that first server is sent, the first object can be stored Into first barrel of the second memory node set.
S230, second server receive the second write command that client is sent, and the second write command is for requesting second pair As in first barrel of write-in.
The step can be accomplished in several ways, and possible implementation will be described in detail in subsequent content.
Second object and the first object are different objects.For example, the title of the title of the first object and the second object It is different.
S240, second server are written first barrel of the second memory node set according to the second write command, by the second object In, and the second object is sent to first server, in order to which the first memory node set is written in the second object by first server First barrel in.
Further, after first server receives the second object, the second object is stored to the first memory node set In first barrel.
In the object processing method, first server and second server are received when requesting to write the write command of object, It oneself can store, and replicate object to other side.Compared in the prior art, reduce the forwarding process of object, so as to Save resource.
In addition, after first server and second server receive write command, can direct storage object, can to work as Any one cluster in first server and second server cannot provide service, and when not carrying out the operation such as active-standby switch, Another server still can provide service, influence so as to reduce.
From the perspective of from another angle, first server stores the first object and replicates the first object to second server, quite In the cluster that first server and the first memory node collection are combined into be main cluster, second server and the second memory node set The cluster of composition is standby cluster;Second server stores the second object and simultaneously replicates the second object to first server, is equivalent to the The cluster that two servers and the second memory node collection are combined into is main cluster, and first server and the first memory node collection are combined into Cluster be standby cluster.
A kind of possible implementation of S210 and S220 is introduced below with reference to Fig. 3.In the case where using the implementation, As shown in figure 4, further including kernel transmission control protocol virtual server (kernel in cloud storage system system Transmission control protocol virtual server, KTCPVS).In order to which subsequent descriptions are convenient, by this KTCPVS is known as the first LTCPVS.
As shown in figure 3, S210 may include S211 and S212, S230 may include S231 and S232.
S211, the first KTCPVS receive the first write command that client is sent, and are determined according to the first write command and are write first Instruction is sent to first server, and sends the first write command to first server.
S212, first server receive the first write command that the first KTCPVS is sent.
That is, client sends the first write command to first server by the first KTCPVS.Correspondingly, the first clothes Device reception client of being engaged in passes through the first write command that the first KTCPVS is sent.
S231, the first KTCPVS receive the second write command that client is sent, and are determined according to the second write command and are write second Instruction is sent to second server, and sends the second write command to second server.
S232, second server receive second write command that the first KTCPVS is sent.
That is, second server, which receives client, passes through the second write command that the first KTCPVS is sent.Correspondingly, Two servers receive client and pass through the second write command that the first KTCPVS is sent.
Optionally, object processing method 200 can also include Fig. 5 in shown in S250, S260, S270 and S280.
S250, the first KTCPVS receive the first reading instruction that client is sent, and the first reading instruction reads first for requesting The first object in bucket determines to first server according to the first reading instruction and sends the first reading instruction, and sends out to first server Send the first reading instruction.
S260, first server receives the first reading instruction that the first KTCPVS is sent, and reads the according to the first reading instruction The first object in first barrel of one memory node set.
S270, the first KTCPVS receive the second reading instruction that client is sent, and the second reading instruction reads first for requesting The second object in bucket determines to second server according to the second reading instruction and sends the second reading instruction, and sends out to second server Send the second reading instruction.
S280, second server receives the second reading instruction that the first KTCPVS is sent, and reads the according to the second reading instruction The second object in first barrel of two memory node set.
In S260 and S270, the first reading instruction is sent to first server by the first KTCPVS, so as to keep reading The first object strong consistency.
In S260 and S270, the second reading instruction is sent to second server by the first KTCPVS, so as to keep reading The second object strong consistency.
In object processing method 200, the first information can store on the first KTCPVS, the first information includes: first barrel It is corresponding in turn to first server and second server.
First barrel is corresponding in turn to first server and second server refers to, first barrel of corresponding first server is the One server, first barrel of corresponding second server are second server.
In this case, in S250, one kind that the first reading instruction is sent to first server is determined according to the first reading instruction Possible implementation may include:
First KTCPVS calculates the first object relative to number of servers corresponding to first barrel according to the first write command Cryptographic Hash obtains the first cryptographic Hash;
According to the first information with the first cryptographic Hash, determine that sending first to first barrel first corresponding first server writes Instruction.
For example, after the title of the first object in the first KTCPVS the first write command of acquisition, it can be by the name of the first object Claim numeralization.Due to first barrel of corresponding first server and second server the two servers, the first KTCPVS can be with Obtained numerical value after the title numeralization of the first object is calculated relative to 2 cryptographic Hash.
For example, the numerical value obtained after the title numeralization of the first object is 143, then 143 pair of 2 modulus can be breathed out Uncommon value 1.
Then the first KTCPVS, which can be determined to first barrel of corresponding first server (first server), sends first Write command.
In S260, the first KTCPVS determines one kind that the second write command is sent to second server according to the second write command Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second write command Cryptographic Hash obtains the second cryptographic Hash;
According to the first information with the second cryptographic Hash, determine that sending second to first barrel second corresponding second server writes Instruction.
For example, after the title of the second object in the first KTCPVS the second write command of acquisition, it can be by the name of the second object Claim numeralization.Due to first barrel of corresponding first server and second server the two servers, the first KTCPVS can be with Obtained numerical value after the title numeralization of the second object is calculated relative to 2 cryptographic Hash.
For example, the numerical value obtained after the title numeralization of the second object is 158, then 158 pair of 2 modulus can be breathed out Uncommon value 2.
In S270, the first KTCPVS determines one kind that the first reading instruction is sent to first server according to the first reading instruction Possible implementation may include:
First KTCPVS calculates the first object relative to number of servers corresponding to first barrel according to the first reading instruction Cryptographic Hash obtains the first cryptographic Hash;
According to the first information with the first cryptographic Hash, determine that sending first to first barrel first corresponding first server reads Instruction.
Specific embodiment is similar with the related content of the first write command of front, and for brief introduction, details are not described herein again.
In S280, the first KTCPVS determines one kind that the second reading instruction is sent to second server according to the second reading instruction Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second reading instruction Cryptographic Hash obtains the second cryptographic Hash;
According to the first information with the second cryptographic Hash, determine that sending second to first barrel second corresponding second server reads Instruction.
Specific embodiment is similar with the related content of the first write command of front, and for brief introduction, details are not described herein again.
Optionally, the first information stored on the first KTCPVS may include the first sub-information, the second sub-information and third Sub-information.
First sub-information are as follows: first barrel successively includes the first sub- bucket and the second sub- bucket;Second sub-information are as follows: the first sub- bucket is right The primary server answered is first server;Third sub-information are as follows: the corresponding primary server of the second sub- bucket is second server.
Correspondingly, first barrel in the first memory node set includes the first sub- bucket and the second sub- bucket, the second memory node First barrel in set also includes the first sub- bucket and the second sub- bucket.
The first information is it is to be understood that therefore first barrel is divided into the first sub- bucket and the second sub- bucket;First sub- bucket is corresponding Object replication relation is from the first cluster to the second cluster, i.e. the first cluster and the second cluster form CG1;Second sub- bucket is corresponding Replication relation is from the second cluster to the first cluster, i.e. the first cluster and the second cluster form CG2.
First barrel is indicated with bucket1, bucket1_1 indicates that the first sub- bucket, bucket1_2 indicate the second sub- bucket, Cluster1 indicates that the first cluster, cluster2 indicate the second cluster, then the first information can indicate are as follows: bucket1 { bucket1_1, bucket1_2 }, bucket1_1 { CG1:cluster1- > cluster2 }, bucket1_2 CG2: cluster2->cluster1}。
In this case, in S250, one kind that the first write command is sent to first server is determined according to the first write command Possible implementation may include:
First KTCPVS calculates Kazakhstan of first object relative to sub- barrelage amount corresponding to first barrel according to the first write command Uncommon value, obtains the first cryptographic Hash;According to the first sub-information and the first cryptographic Hash, determines and the first object is written first barrel first In corresponding first sub- bucket;According to the second sub-information and the first sub- bucket, determines to first server and send the first write command.
At this point, first server the first object is written in the first sub- bucket of the first memory node set.Second server After receiving the first object that first server is sent, the first object is written in the first sub- bucket of the second memory node set.
In S260, the first KTCPVS determines one kind that the second write command is sent to second server according to the second write command Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second write command Cryptographic Hash obtains the second cryptographic Hash;First KTCPVS is determined and the second object is written according to the first sub-information and the second cryptographic Hash In first barrel second corresponding second sub- bucket;According to third sub-information and the second sub- bucket, determines to second server and send the Two write commands.
At this point, second server the second object is written in the second sub- bucket of the second memory node set.First server After receiving the second object that second server is sent, the second object is written in the second sub- bucket of the first memory node set.
In S270, the first KTCPVS determines one kind that the first reading instruction is sent to first server according to the first reading instruction Possible implementation may include:
First KTCPVS calculates the first object relative to number of servers corresponding to first barrel according to the first reading instruction Cryptographic Hash obtains the first cryptographic Hash;According to the first sub-information and the first cryptographic Hash, determines and read first barrel first corresponding the The first object in one sub- bucket;According to the second sub-information and the first sub- bucket, determines to first server and send the first reading instruction.
At this point, first server reads the first object in the first sub- bucket of the first memory node set.
In S280, the first KTCPVS determines one kind that the second reading instruction is sent to second server according to the second reading instruction Possible implementation may include:
First KTCPVS calculates the second object relative to number of servers corresponding to first barrel according to the second reading instruction Cryptographic Hash obtains the second cryptographic Hash;According to the first sub-information and the second cryptographic Hash, determines and read first barrel second corresponding the The second object in two sub- buckets;According to third sub-information and the second sub- bucket, determines to second server and send the second reading instruction.
At this point, first server reads the first object in the first sub- bucket of the first memory node set.
Optionally, as shown in fig. 6, in cloud storage system can also include location server (location server, LS).The first information is configured on location server.
In this case, the first information that stores on the first KTCPVS can be to be obtained from location server.
It in other words, may include: first before the first KTCPVS is using the first information in object processing method 200 KTCPVS obtains the first information from location server.
Optionally, as shown in fig. 7, cloud storage system can also include domain name system (domain name system, DNS) Equipment.In this case, it can be configured with the second information on location server, the second information is corresponding including stating first barrel KTCPVS is the first KTCPVS.
Correspondingly, the first KTCPVS receives the first write command that client is sent, and may include:
Domain name system equipment receives the first uniform resource locator (uniform resource that client is sent Locator, URL), it include the first write command in the first uniform resource locator;According to the first uniform resource locator to position Server sends first barrel of information;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information, the first information is used to indicate the first KTCPVS;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send the first write command;
First KTCPVS receives the first write command that client is sent according to the first instruction information.
First KTCPVS receives the second write command that client is sent, and may include:
Domain name system equipment receives the second uniform resource locator that client is sent, and wraps in the second uniform resource locator Include the second write command;First barrel of information is sent to location server according to the second uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send the second write command
First KTCPVS receives the second write command that client is sent according to the first instruction information.
First KTCPVS receives the first reading instruction that client is sent, and may include:
Domain name system equipment receives the third uniform resource locator that client is sent, and wraps in third uniform resource locator Include the first reading instruction;First barrel of information is sent to location server according to third uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send the first reading instruction
First KTCPVS receives the first reading instruction that client is sent according to the first instruction information.
First KTCPVS receives the second reading instruction that client is sent, and may include:
Domain name system equipment receives the 4th uniform resource locator that client is sent, and wraps in the 4th uniform resource locator Include the second reading instruction;First barrel of information is sent to location server according to the 4th uniform resource locator;
Location server receives first barrel of the information that domain name system equipment is sent;According to the second information and first barrel of letter It ceases to domain name system and sends the first instruction information;
Domain name system receives the first instruction information that location server is sent;The first instruction information is sent to client;
Client receives the first instruction information that domain name system equipment is sent, and indicates information to the first KTCPVS according to first Send second reading instruction;
First KTCPVS receives the second reading instruction that client is sent according to the first instruction information.
In the implementation, client can be corresponding from first barrel of location server acquisition by domain name system equipment The instruction information of KTCPVS, so that the cloud storage system can arrange multiple KTCPVS, so as to balanced KTCPVS's Load pressure.
In the cloud storage system of the embodiment of the present application, optionally, more clusters can be disposed in each AZ, these clusters More cluster groups can be formed, the bucket in these clusters can be divided into more sub- buckets, this little bucket and these cluster groups It is corresponding.
For example, cloud storage system as shown in Figure 8, wherein there are two clusters, respectively cluster 1 and cluster for deployment in AZ1 3;There are two clusters, respectively cluster 2 and cluster 4 for deployment in AZ2.
Include physical server and S memory node in cluster 3, includes physical server and T storage section in cluster 4 Point.S and T is positive integer.
Physical server in cluster 3 is properly termed as third physical server, and S memory node is properly termed as third storage Node set;Physical server in cluster 4 is properly termed as the 4th physical server, and T memory node is properly termed as the 4th and deposits Store up node set.
Bucket in cloud storage system can be divided into 4 sub- buckets, respectively sub- bucket 1, sub- bucket 2, sub- bucket 3 and sub- bucket 4.Cluster 1, cluster 2, cluster 3 and cluster 4 can be divided into 4 logical set groups, respectively cluster group 1, cluster group 2,3 sum aggregate of cluster group Group 4.
It include cluster 1 and cluster 2 in cluster group 1, the replication relation of object is from cluster 1 to cluster 2;It is wrapped in cluster group 2 Cluster 2 and cluster 1 are included, the replication relation of object is from cluster 2 to cluster 1;It include cluster 3 and cluster 4, object in cluster group 3 Replication relation be from cluster 3 to cluster 4;It include cluster 4 and cluster 3 in cluster group 4, the replication relation of object is from cluster 4 To cluster 3.
Sub- bucket 1 maps to cluster group 1, and sub- bucket 2 maps to cluster group 2, and sub- bucket 3 maps to cluster group 3, and sub- bucket 4 maps to Cluster group 4.
First barrel is indicated with bucket1, bucket1_1 indicates that the first sub- bucket, bucket1_2 indicate the second sub- bucket, Bucket1_3 indicates that third bucket, bucket1_4 indicate that the 4th sub- bucket, cluster1 indicate that the first cluster, cluster2 indicate Second cluster, cluster1 indicate that third cluster, cluster2 indicate that the 4th cluster, CG3 indicate cluster group 3, and CG4 indicates cluster Group 4, then the first information can indicate are as follows:
Bucket1 { bucket1_1, bucket1_2, bucket1_3, bucket1_4 }, bucket1_1 CG1: Cluster1- > cluster2 }, bucket1_2 { CG2:cluster2- > cluster1 }, bucket1_3 { CG3:cluster3- > cluster4 }, bucket1_4 { CG4:cluster4- > cluster3 }.
If LS is that the target cluster group that object determines is cluster group 1, cluster 1 handles object, and processing is tied Fruit copies to cluster 2;If LS is that the target cluster group that object determines is cluster group 2, cluster 2 handles object, and will Processing result copies to cluster 1;If LS is that the target cluster group that object determines is cluster group 3,3 object of cluster is handled, And processing result is copied into cluster 4;If LS is that the target cluster group that object determines is cluster group 4, cluster 4 carries out object Processing, and processing result is copied into cluster 3.
It should be understood that the quantity of the quantity of above-mentioned sub- bucket, the quantity of cluster and cluster group is example, the embodiment of the present application It can also include more clusters in cloud storage system, more clusters can divide more cluster groups, and bucket can also divide For more sub- buckets.
Cluster in cloud storage system is more, and the cluster group that can be divided is also more, can be with the cluster of carry load It is more.This can enable load pressures that can for greater flexibility on balanced each cluster.In addition, if there is cluster failure, When service cannot be normally provided, impacted number of users can be reduced.
In the case where including more cluster groups in cloud storage system, the method read or write of object can be referring to figs. 1 to Object processing method shown in Fig. 8, for sake of simplicity, details are not described herein again.
The schematic architectural diagram of the cloud storage system 900 of the application one embodiment is as shown in Figure 9.It should be understood that Fig. 9 is shown Cloud storage system 900 be only example, the cloud storage system of the embodiment of the present application may also include other modules or unit, or packet Intimate equipment with each equipment in Fig. 9 is included, or does not really want to include all devices in Fig. 9.
It is deposited in the cloud storage system 900 including first server, the first memory node set, second server and second Node set is stored up, the first server and the first memory node set are located at the first service area of the cloud storage system In domain, the second server and second memory node are located in the second service region of the cloud storage system, described It include first barrel in first memory node set and the second memory node set.
Wherein, the first server is used for: receiving the first write command that client is sent, first write command is used for Request will be in described first barrel of the first object write-in;According to the first write command, by first object write-in, first storage In described first barrel of node set, and first object is sent to the second server, in order to second clothes First object is written in described first barrel of the second memory node set business device.
The second server is used for: receiving the second write command that the client is sent, second write command is used for Second object, according to second write command, is written described second in described first barrel of the second object write-in by request In described first barrel of memory node set, and second object is sent to the first server, in order to described first Second object is written in described first barrel of the first memory node set server.
Optionally, the cloud storage system 900 can also include the first KTCPVS.
First KTCPVS is used for: receiving first write command that the client is sent;It is write according to described first Instruction, which is determined, is sent to the first server for first write command;Described first, which is sent, to the first server writes finger It enables;Receive second write command that the client is sent;It is determined according to second write command by second write command It is sent to the second server;Second write command is sent to the second server.
The first server is specifically used for: receiving the client and passes through the first KTCPVS is sent described first Write command.
The second server is specifically used for: receiving the client and passes through the first KTCPVS is sent described second Write command.
Optionally, the first KTCPVS is also used to: receiving the first reading instruction that the client is sent, described first reads Instruction reads first object in described first barrel for requesting;It is determined according to first reading instruction and is taken described first Business device sends first reading instruction;First reading instruction is sent to the first server;The client is received to send The second reading instruction, second reading instruction is used to request reading second object in first barrel;It is read according to second Instruction, which is determined to the second server, sends second reading instruction;Described second is sent to the second server to read to refer to It enables.
The first server is also used to: receiving first reading instruction that the first KTCPVS is sent;According to described First reading instruction reads first object in described first barrel of the first memory node set.
The second server is also used to: receiving second reading instruction that the first KTCPVS is sent;According to described Second reading instruction reads second object in described first barrel of the second memory node set.
Optionally, have the first information on the first KTCPVS, the first information: described first barrel be corresponding in turn to it is described First server and the second server.
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described The cryptographic Hash of first barrel of mapped number of servers obtains the first cryptographic Hash;According to the first information and the first cryptographic Hash, It determines to the described first barrel first corresponding first server and sends first write command.
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described The cryptographic Hash of first barrel of mapped number of servers obtains the second cryptographic Hash;According to the first information and the second cryptographic Hash, It determines to the described first barrel second corresponding second server and sends second write command.
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described The cryptographic Hash of first barrel of mapped number of servers obtains the first cryptographic Hash;According to the first information and the first cryptographic Hash, It determines to the described first barrel first corresponding first server and sends first reading instruction.
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described The cryptographic Hash of first barrel of mapped number of servers obtains the second cryptographic Hash;According to the first information and the second cryptographic Hash, It determines to the described first barrel second corresponding second server and sends second reading instruction.
Optionally, the first information includes the first sub-information, the second sub-information and third sub-information, the first son letter Breath are as follows: described first barrel successively includes the first sub- bucket and the second sub- bucket, second sub-information are as follows: the first sub- bucket is corresponding Primary server is the first server, the third sub-information are as follows: the corresponding primary server of the second sub- bucket is described the Two servers.
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the first cryptographic Hash;According to first sub-information and the first cryptographic Hash, really Surely first object is written in the first barrel first corresponding first sub- bucket;According to second sub-information and The first sub- bucket determines to the first server and sends first write command.
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the second cryptographic Hash;It is true according to first sub-information and the second cryptographic Hash Surely second object is written in the first barrel second corresponding second sub- bucket;According to the third sub-information and The second sub- bucket determines to the second server and sends second write command.
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the first cryptographic Hash;According to first sub-information and the first cryptographic Hash, really Surely first object in the described first barrel first corresponding first sub- bucket is read;According to second sub-information and The first sub- bucket determines to the first server and sends first reading instruction.
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described The cryptographic Hash of first barrel of corresponding sub- barrelage amount, obtains the second cryptographic Hash;It is true according to first sub-information and the second cryptographic Hash Surely second object in the described first barrel second corresponding second sub- bucket is read;According to the third sub-information and The second sub- bucket determines to the second server and sends second reading instruction.
Optionally, cloud storage system 900 can also include location server, configured with described the on the location server One information.
Correspondingly, the first KTCPVS is also used to: obtaining the first information from the location server.
Optionally, 900 domain name system equipment of cloud storage system is correspondingly also configured with second on the location server Information, second information include: that first barrel of corresponding KTCPVS is the first KTCPVS.
Domain name system equipment is used for: receive the first uniform resource locator that the client is sent, described first It include first write command in uniform resource locator;According to first uniform resource locator to the location server Send first barrel of the information;Receive the second uniform resource locator that the client is sent, second unified resource It include second write command in finger URL;According to second uniform resource locator to described in location server transmission First barrel of information;The third uniform resource locator that the client is sent is received, in the third uniform resource locator Including first reading instruction;Described first barrel is sent to the location server according to the third uniform resource locator Information;The 4th uniform resource locator that the client is sent is received, includes described in the 4th uniform resource locator Second reading instruction;First barrel of the information is sent to the location server according to the 4th uniform resource locator.
The location server is used for: receiving first barrel of the information that domain name system equipment is sent;According to institute It states the second information and first barrel of the information and sends the first instruction information to domain name system, the first information is for referring to Show the first KTCPVS.
Domain name system is also used to: receiving the first instruction information that the location server is sent;To the visitor Family end sends the first instruction information, in order to which the client is sent according to the first instruction information to the client First write command, in order to which the client sends described the to the first KTCPVS according to the first instruction information Two write commands are read to refer in order to which the client sends described first to the first KTCPVS according to the first instruction information It enables, in order to which the client sends second reading instruction to the first KTCPVS according to the first instruction information.
Each equipment in cloud storage system shown in Fig. 9 can be used for executing object processing method 200 shown in Fig. 2, Details are not described herein again.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (read-only memory, ROM), arbitrary access are deposited The various media that can store program code such as reservoir (random access memory, RAM), magnetic or disk.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain Lid is within the scope of protection of this application.Therefore, the protection scope of the application should be based on the protection scope of the described claims.

Claims (14)

1. the object processing method in a kind of cloud storage system, which is characterized in that include first service in the cloud storage system Device, the first memory node set, second server and the second memory node set, the first server and first storage Node set is located in the first service region of the cloud storage system, the second server and second memory node position In in the second service region of the cloud storage system, in the first memory node set and the second memory node set It include first barrel;
The object processing method includes:
The first server receives the first write command that client is sent, and first write command is for requesting the first object It is written in described first barrel;
First object is written described in the first memory node set according to the first write command for the first server In first barrel, and first object is sent to the second server, in order to which the second server is by described first Object is written in described first barrel of the second memory node set;
The second server receives the second write command that the client is sent, and second write command is for requesting second In described first barrel of object write-in;
The second memory node set is written according to second write command, by second object in the second server In described first barrel, and second object is sent to the first server, in order to which the first server is by described the Two objects are written in described first barrel of the first memory node set.
2. object processing method according to claim 1, which is characterized in that the cloud storage system further includes the first kernel Transmission control protocol virtual server KTCPVS;
The first server receives the first write command that client is sent, comprising:
First KTCPVS receives first write command that the client is sent, and being determined according to first write command will First write command is sent to the first server, and sends first write command to the first server;
The first server receives first write command that the first KTCPVS is sent;
The second server receives the second write command that the client is sent, comprising:
First KTCPVS receives second write command that the client is sent, and being determined according to second write command will Second write command is sent to the second server, and sends second write command to the second server;
The second server receives second write command that the first KTCPVS is sent.
3. object processing method according to claim 2, which is characterized in that the object processing method further include:
First KTCPVS receives the first reading instruction that the client is sent, and first reading instruction reads institute for requesting First object in first barrel is stated, determines that sending described first to the first server reads according to first reading instruction Instruction, and first reading instruction is sent to the first server;
The first server receives first reading instruction that the first KTCPVS is sent, and according to first reading instruction Read first object in described first barrel of the first memory node set;
First KTCPVS receives the second reading instruction that the client is sent, and second reading instruction reads institute for requesting Second object in first barrel is stated, determines that sending described second to the second server reads to refer to according to the second reading instruction It enables, and sends second reading instruction to the second server;
The second server receives second reading instruction that the first KTCPVS is sent, and according to second reading instruction Read second object in described first barrel of the second memory node set.
4. object processing method according to claim 3, which is characterized in that there is the first information on the first KTCPVS, The first information includes: described first barrel and is corresponding in turn to the first server and the second server;
First KTCPVS is determined according to first write command is sent to the first server for first write command, Include:
First KTCPVS calculates first object relative to corresponding to described first barrel according to first write command First cryptographic Hash of number of servers;According to the first information and first cryptographic Hash, determine to described first barrel first A corresponding first server sends first write command;
First KTCPVS is determined according to second write command is sent to the second server for second write command, Include:
First KTCPVS calculates second object relative to corresponding to described first barrel according to second write command Second cryptographic Hash of number of servers;According to the first information and second cryptographic Hash, determine to described first barrel second A corresponding second server sends second write command;
First KTCPVS is determined according to first reading instruction is sent to the first server for first reading instruction, Include:
First KTCPVS calculates first object relative to corresponding to described first barrel according to first reading instruction First cryptographic Hash of number of servers;According to the first information and first cryptographic Hash, determine to described first barrel First corresponding first server sends first reading instruction;
First KTCPVS is determined according to second reading instruction is sent to the second server for second reading instruction, Include:
First KTCPVS calculates second object relative to corresponding to described first barrel according to second reading instruction Second cryptographic Hash of number of servers;According to the first information and second cryptographic Hash, determine to described first barrel Second corresponding second server sends second reading instruction.
5. object processing method according to claim 4, which is characterized in that the first information includes the first sub-information, Second sub-information and third sub-information, first sub-information are as follows: described first barrel successively include the first sub- bucket and the second sub- bucket, Second sub-information are as follows: the corresponding primary server of the first sub- bucket is the first server, the third sub-information are as follows: The corresponding primary server of the second sub- bucket is the second server;
First KTCPVS is determined according to the first information and first cryptographic Hash to described first barrel of first correspondence The first server send first write command, comprising:
First KTCPVS is determined first object institute is written according to first sub-information and first cryptographic Hash It states in the first barrel first corresponding first sub- bucket;According to second sub-information and the first sub- bucket, determine to institute It states first server and sends first write command;
First KTCPVS is determined according to the first information and second cryptographic Hash to described first barrel of second correspondence The second server send second write command, comprising:
First KTCPVS is determined second object institute is written according to first sub-information and second cryptographic Hash It states in the first barrel second corresponding second sub- bucket;According to the third sub-information and the second sub- bucket, determine to institute It states second server and sends second write command;
First KTCPVS is determined according to the first information and first cryptographic Hash to described first barrel of first correspondence The first server send first reading instruction, comprising:
First KTCPVS is determined according to first sub-information and first cryptographic Hash and is read described first barrel first First object in the corresponding first sub- bucket;According to second sub-information and the first sub- bucket, determine to institute It states first server and sends first reading instruction;
First KTCPVS is determined according to the first information and second cryptographic Hash to described first barrel of second correspondence The second server send second reading instruction, comprising:
First KTCPVS is determined according to first sub-information and second cryptographic Hash and is read described first barrel second Second object in the corresponding second sub- bucket;According to the third sub-information and the second sub- bucket, determine to institute It states second server and sends second reading instruction.
6. object processing method according to claim 4 or 5, which is characterized in that the cloud storage system further includes position Server is configured with the first information on the location server;
The object processing method further include:
First KTCPVS obtains the first information from the location server.
7. object processing method according to claim 6, which is characterized in that be also configured with second on the location server Information, second information include: that first barrel of corresponding KTCPVS is the first KTCPVS;The cloud storage system is also Including domain name system equipment;
First KTCPVS receives the first write command that the client is sent, comprising:
Domain name system equipment receives the first uniform resource locator that the client is sent, and first unified resource is fixed It include first write command in the symbol of position;Described the is sent to the location server according to first uniform resource locator One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information The first instruction information is sent to domain name system with first barrel of the information, the first information is used to indicate described first KTCPVS;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information First write command is sent to the first KTCPVS;
First KTCPVS receives first write command that the client is sent according to the first instruction information;
First KTCPVS receives the second write command that the client is sent, comprising:
Domain name system equipment receives the second uniform resource locator that the client is sent, and second unified resource is fixed It include second write command in the symbol of position;Described the is sent to the location server according to second uniform resource locator One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information The first instruction information is sent to domain name system with first barrel of the information;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information Second write command is sent to the first KTCPVS;
First KTCPVS receives second write command that the client is sent according to the first instruction information;
First KTCPVS receives the first reading instruction that the client is sent, comprising:
Domain name system equipment receives the third uniform resource locator that the client is sent, and the third unified resource is fixed It include first reading instruction in the symbol of position;Described the is sent to the location server according to the third uniform resource locator One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information The first instruction information is sent to domain name system with first barrel of the information;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information First reading instruction is sent to the first KTCPVS;
First KTCPVS receives first reading instruction that the client is sent according to the first instruction information;
First KTCPVS receives the second reading instruction that the client is sent, comprising:
Domain name system equipment receives the 4th uniform resource locator that the client is sent, and the 4th unified resource is fixed It include second reading instruction in the symbol of position;Described the is sent to the location server according to the 4th uniform resource locator One barrel of information;
The location server receives first barrel of the information that domain name system equipment is sent;According to second information The first instruction information is sent to domain name system with first barrel of the information;
Domain name system receives the first instruction information that the location server is sent;To described in client transmission First instruction information;
The client receives the first instruction information that domain name system equipment is sent, according to the first instruction information Second reading instruction is sent to the first KTCPVS;
First KTCPVS receives second reading instruction that the client is sent according to the first instruction information.
8. a kind of cloud storage system, which is characterized in that include first server, the first memory node collection in the cloud storage system It closes, second server and the second memory node set, the first server and the first memory node set are positioned at described In the first service region of cloud storage system, the second server and second memory node are located at the cloud storage system Second service region in, in the first memory node set and the second memory node set include first barrel;
The first server is used for: receiving the first write command that client is sent, first write command is for requesting the In described first barrel of an object write-in;According to the first write command, the first memory node set is written into first object Described first barrel in, and first object is sent to the second server, in order to which the second server is by institute The first object is stated to be written in described first barrel of the second memory node set;
The second server is used for: receiving the second write command that the client is sent, second write command is for requesting By in described first barrel of the second object write-in, according to second write command, second object write-in described second is stored In described first barrel of node set, and second object is sent to the first server, in order to the first service Second object is written in described first barrel of the first memory node set device.
9. cloud storage system according to claim 8, which is characterized in that the cloud storage system further includes that the first kernel passes Transport control protocol discusses virtual server KTCPVS;
First KTCPVS is used for: receiving first write command that the client is sent;According to first write command It determines and first write command is sent to the first server;First write command is sent to the first server; Receive second write command that the client is sent;It is determined according to second write command and sends second write command To the second server;Second write command is sent to the second server;
The first server is specifically used for: receiving the client by what the first KTCPVS was sent and described first writes finger It enables;
The second server is specifically used for: receiving the client by what the first KTCPVS was sent and described second writes finger It enables.
10. cloud storage system according to claim 9, which is characterized in that the first KTCPVS is also used to: described in reception The first reading instruction that client is sent, first reading instruction are used to request to read first object in described first barrel; It is determined according to first reading instruction and the first server is sent into first reading instruction;It is sent to the first server First reading instruction;The second reading instruction that the client is sent is received, second reading instruction is for requesting described in reading Second object in first barrel;It is determined according to the second reading instruction to the second server and sends second reading instruction; Second reading instruction is sent to the second server;
The first server is also used to: receiving first reading instruction that the first KTCPVS is sent;According to described first Reading instruction reads first object in described first barrel of the first memory node set;
The second server is also used to: receiving second reading instruction that the first KTCPVS is sent;According to described second Reading instruction reads second object in described first barrel of the second memory node set.
11. cloud storage system according to claim 10, which is characterized in that there is the first information on the first KTCPVS, The first information: described first barrel is corresponding in turn to the first server and the second server;
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described first First cryptographic Hash of bucket mapped number of servers;According to the first information and first cryptographic Hash, determine to described The first barrel first corresponding first server sends first write command;
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described first Second cryptographic Hash of bucket mapped number of servers;According to the first information and second cryptographic Hash, determine to described The first barrel second corresponding second server sends second write command;
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described first First cryptographic Hash of bucket mapped number of servers;According to the first information and first cryptographic Hash, determine to The first barrel first corresponding first server sends first reading instruction;
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described first Second cryptographic Hash of bucket mapped number of servers;According to the first information and second cryptographic Hash, determine to The first barrel second corresponding second server sends second reading instruction.
12. cloud storage system according to claim 11, which is characterized in that the first information includes the first sub-information, Second sub-information and third sub-information, first sub-information are as follows: described first barrel successively include the first sub- bucket and the second sub- bucket, Second sub-information are as follows: the corresponding primary server of the first sub- bucket is the first server, the third sub-information are as follows: The corresponding primary server of the second sub- bucket is the second server;
First KTCPVS is specifically used for: according to first write command, calculating first object relative to described first First cryptographic Hash of the corresponding sub- barrelage amount of bucket;According to first sub-information and first cryptographic Hash, determine institute The first object is stated to be written in the first barrel first corresponding first sub- bucket;According to second sub-information and described One sub- bucket determines to the first server and sends first write command;
First KTCPVS is specifically used for: according to second write command, calculating second object relative to described first Second cryptographic Hash of the corresponding sub- barrelage amount of bucket;It will be described according to first sub-information and the second cryptographic Hash determination Second object is written in the first barrel second corresponding second sub- bucket;According to the third sub-information and described second Sub- bucket determines to the second server and sends second write command;
First KTCPVS is specifically used for: according to first reading instruction, calculating first object relative to described first First cryptographic Hash of the corresponding sub- barrelage amount of bucket;According to first sub-information and first cryptographic Hash, determines and read First object in the first barrel first corresponding first sub- bucket;According to second sub-information and described One sub- bucket determines to the first server and sends first reading instruction;
First KTCPVS is specifically used for: according to second reading instruction, calculating second object relative to described first Second cryptographic Hash of the corresponding sub- barrelage amount of bucket;It is determined according to first sub-information and second cryptographic Hash and reads institute State second object in the first barrel second corresponding second sub- bucket;According to the third sub-information and described second Sub- bucket determines to the second server and sends second reading instruction.
13. cloud storage system according to claim 11 or 12, which is characterized in that the cloud storage service device further includes position Server is set, is configured with the first information on the location server;
First KTCPVS is also used to: obtaining the first information from the location server.
14. cloud storage system according to claim 13, which is characterized in that be also configured with second on the location server Information, second information include: that first barrel of corresponding KTCPVS is the first KTCPVS;The cloud storage system is also Including domain name system equipment;
Domain name system equipment is used for: receiving the first uniform resource locator that the client is sent, first unification It include first write command in Resource Locator;It is sent according to first uniform resource locator to the location server First barrel of the information;Receive the second uniform resource locator that the client is sent, the second unified resource positioning It include second write command in symbol;Described first is sent to the location server according to second uniform resource locator The information of bucket;The third uniform resource locator that the client is sent is received, includes in the third uniform resource locator First reading instruction;First barrel of the letter is sent to the location server according to the third uniform resource locator Breath;The 4th uniform resource locator that the client is sent is received, includes described the in the 4th uniform resource locator Two reading instructions;First barrel of the information is sent to the location server according to the 4th uniform resource locator;
The location server is used for: receiving first barrel of the information that domain name system equipment is sent;According to described Two information and first barrel of the information send first to domain name system and indicate information, and the first information is used to indicate institute State the first KTCPVS;
Domain name system is also used to: receiving the first instruction information that the location server is sent;To the client The first instruction information is sent, in order to which the client indicates information to described in client transmission according to described first First write command is write in order to which the client sends described second to the first KTCPVS according to the first instruction information Instruction, in order to which the client sends first reading instruction to the first KTCPVS according to the first instruction information, In order to which the client sends second reading instruction to the first KTCPVS according to the first instruction information.
CN201710896038.5A 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system Active CN109587185B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710896038.5A CN109587185B (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system
CN202011127481.4A CN112422630A (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710896038.5A CN109587185B (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202011127481.4A Division CN112422630A (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system

Publications (2)

Publication Number Publication Date
CN109587185A true CN109587185A (en) 2019-04-05
CN109587185B CN109587185B (en) 2020-11-03

Family

ID=65912961

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202011127481.4A Pending CN112422630A (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system
CN201710896038.5A Active CN109587185B (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202011127481.4A Pending CN112422630A (en) 2017-09-28 2017-09-28 Cloud storage system and object processing method in cloud storage system

Country Status (1)

Country Link
CN (2) CN112422630A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111309522A (en) * 2020-02-14 2020-06-19 星辰天合(北京)数据科技有限公司 Object storage data protection method and device based on snapshot technology
WO2022073458A1 (en) * 2020-10-10 2022-04-14 华为云计算技术有限公司 Data modification method for object storage service, service node, client and device
CN114448781A (en) * 2021-12-22 2022-05-06 天翼云科技有限公司 Data processing system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120150930A1 (en) * 2010-12-10 2012-06-14 Electronics And Telecommunications Research Institute Cloud storage and method for managing the same
CN102880715A (en) * 2012-10-09 2013-01-16 南京市测绘勘察研究院有限公司 Data pool management method and data pool management system on basis of cloud storage
CN103067525A (en) * 2013-01-18 2013-04-24 广东工业大学 Cloud storage data backup method based on characteristic codes
CN103226483A (en) * 2013-03-25 2013-07-31 成都瑞科电气有限公司 DHBS (dual hot-backup system) and method thereof based on SOA (service-oriented architecture) and cloud storage
CN103763383A (en) * 2014-01-27 2014-04-30 西安雷迪维护系统设备有限公司 Integrated cloud storage system and storage method thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104202375B (en) * 2014-08-22 2017-10-24 广州华多网络科技有限公司 The method and system of synchrodata

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120150930A1 (en) * 2010-12-10 2012-06-14 Electronics And Telecommunications Research Institute Cloud storage and method for managing the same
CN102880715A (en) * 2012-10-09 2013-01-16 南京市测绘勘察研究院有限公司 Data pool management method and data pool management system on basis of cloud storage
CN103067525A (en) * 2013-01-18 2013-04-24 广东工业大学 Cloud storage data backup method based on characteristic codes
CN103226483A (en) * 2013-03-25 2013-07-31 成都瑞科电气有限公司 DHBS (dual hot-backup system) and method thereof based on SOA (service-oriented architecture) and cloud storage
CN103763383A (en) * 2014-01-27 2014-04-30 西安雷迪维护系统设备有限公司 Integrated cloud storage system and storage method thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111309522A (en) * 2020-02-14 2020-06-19 星辰天合(北京)数据科技有限公司 Object storage data protection method and device based on snapshot technology
WO2022073458A1 (en) * 2020-10-10 2022-04-14 华为云计算技术有限公司 Data modification method for object storage service, service node, client and device
CN114448781A (en) * 2021-12-22 2022-05-06 天翼云科技有限公司 Data processing system
CN114448781B (en) * 2021-12-22 2024-06-07 天翼云科技有限公司 Data processing system

Also Published As

Publication number Publication date
CN109587185B (en) 2020-11-03
CN112422630A (en) 2021-02-26

Similar Documents

Publication Publication Date Title
US10754575B2 (en) Storage system with replication process utilizing simulated target responses
US10866760B2 (en) Storage system with efficient detection and clean-up of stale data for sparsely-allocated storage in replication
US11550819B2 (en) Synchronization cache seeding
US20200364106A1 (en) Storage system with coordinated recovery across multiple input-output journals of different types
US11308223B2 (en) Blockchain-based file handling
US11880280B2 (en) Variable number and size of put operations for storage backup
CN110351363A (en) Data back up method, equipment and computer readable storage medium
CN101924693A (en) Be used for method and system in migrating processes between virtual machines
CN108076090A (en) Data processing method and storage management system
CN109587185A (en) Object processing method in cloud storage system and cloud storage system
CN105740469B (en) Storage server and metadata access method
CN108023953A (en) The high availability implementation method and device of FTP service
CN110069346A (en) Resource share method, device, electronic equipment between multi-process
CN106776146A (en) A kind of data verification method, apparatus and system
CN107038092B (en) Data copying method and device
US11099767B2 (en) Storage system with throughput-based timing of synchronous replication recovery
CN109873839A (en) Method, server and the distributed system of data access
CN108830093A (en) Management method, server and the terminal device of terminal device operating right
CN109691065B (en) Distributed storage system and data read-write method thereof, storage terminal and storage medium
CN109597903A (en) Image file processing apparatus and method, document storage system and storage medium
CN108200211A (en) Method, node and the inquiry server that image file is downloaded in cluster
KR20130045159A (en) Apparatus and method for client's participating in data storage of distributed file system
US20170063972A1 (en) System and method for avoiding proxy connection latency
CN106210162B (en) Communication control method and device
CN107967165A (en) The offline moving method of virtual machine based on LVM

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant