CN102035865A - Data storing and addressing methods, systems and equipment - Google Patents
Data storing and addressing methods, systems and equipment Download PDFInfo
- Publication number
- CN102035865A CN102035865A CN2009101799260A CN200910179926A CN102035865A CN 102035865 A CN102035865 A CN 102035865A CN 2009101799260 A CN2009101799260 A CN 2009101799260A CN 200910179926 A CN200910179926 A CN 200910179926A CN 102035865 A CN102035865 A CN 102035865A
- Authority
- CN
- China
- Prior art keywords
- data
- group
- token
- request
- read
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses data storing and addressing methods, data storing and addressing systems and data storing and addressing equipment, which are used for solving the problems of low safety, low reliability and low data reading efficiency of the conventional system. A storage cluster consisting of a plurality of store proxies (SP) is partitioned into at least two SP groups, wherein each SP group comprises at least two SPs; and each SP in each SP group is provided with a group identifier and an intra-group identifier of the SP group to which the SP belongs. The data storing method comprises the following steps that: a write proxy (WP) receives a data write request sent by a client, wherein the data write request carries data to be stored; the WP selects an SP serving as a target SP from the storage cluster according to the received data write request and forwards the data write request to the target SP; and the target SP generates a unique data identifier for the data to be stored carried in the received data write request, stores the generated data identifier and corresponding data to the stored and returning the generated data identifier to the client, wherein the data identifier comprises the group identifier and the intra-group identifier of the target SP.
Description
Technical field
The application relates to database technical field, relates in particular to a kind of storage and data addressing method, system and equipment.
Background technology
When realizing the memory function that Web uses, adopt the mode of database usually.Database is the set with the structural data of certain organizational form storage, and to inserting new data in the database, inquiry, modification legacy data all can carry out according to public and controllable mode.In and database less, under the less situation of data quantity stored, use a storage server (SP, Store proxy) to satisfy the demands to the visit capacity of database; Along with the demand that the visit capacity to database increases and stores mass data, the general memory cluster of forming by many SP that adopts.In data storage procedure, be the unique Data Identification of data allocations to be stored by management server, and from the memory cluster, select purpose SP that purpose SP is responsible for writing this Data Identification and corresponding data to be stored.In order to guarantee the safe and reliable of storage, need to adopt the mode of back-up storage, the data that are same Data Identification are stored in respectively on many SP, and are responsible for safeguarding a central allocation table by management server, the Data Identification of each data of record and corresponding many SP that write in the central allocation table.Based on above-mentioned data storage method, in the data addressing process, at first by management server according to central allocation table, determine to store many SP of data to be read, from many SP that determine, choose SP again and carry out data read operation.
In the prior art, storage and data addressing need management server to carry out unified scheduling of resource and distribution, and be very high to the software and hardware requirement of management server, in case management server breaks down, to make and the whole system paralysis cause the security reliability of system lower; And twice addressing of data addressing process need makes that the reading efficiency of data is lower.
Summary of the invention
The application provides a kind of storage and data addressing method, system and equipment, and is lower in order to the security reliability that solves existing system, and the lower problem of the reading efficiency of data.
The application provides a kind of date storage method, the memory cluster of being made up of many storage server SP is divided at least two SP groups, each SP group comprises at least two SP, and every SP in each SP group disposes the group id and the interior sign of group of place SP group, and described method comprises:
The data of writing the transmission of acting server WP reception client write request, wherein carry data to be stored;
Described WP writes request according to the data that receive, and selects a SP as purpose SP from the memory cluster, and described data are write request is forwarded on the described purpose SP;
Described purpose SP is that the data that receive write the unique Data Identification of data generation to be stored that carries in the request, preserve the Data Identification and the corresponding data to be stored that generate, and the Data Identification that generates returned to client by described WP, wherein said Data Identification comprises sign in the group id of purpose SP place SP group and the group.
The application provides a kind of data-storage system, comprise the memory cluster of forming by many storage server SP and write acting server WP, described memory cluster is divided at least two SP groups, each SP group comprises at least two SP, every SP in each SP group disposes the group id and the interior sign of group of place SP group, wherein:
The described acting server WP that writes, be used to receive the data that client sends and write request, wherein carry data to be stored, write request according to the data that receive, from the memory cluster, select a SP as purpose, and described data are write request be forwarded on the described purpose SP;
Described purpose SP, the data to be stored that are used to the data that receive to write to carry in the request generate unique Data Identification, preserve the Data Identification and the corresponding data to be stored that generate, and the Data Identification that generates returned to client by described WP, wherein said Data Identification comprises sign in the group id of purpose SP place SP group and the group.
The application provides a kind of storage server, comprising:
First memory cell is used to store the group id of pre-configured place storage server SP group and organizes interior sign;
Receiving element is used to receive data and writes request, wherein carries data to be stored;
Generation unit, the data to be stored that are used to the data that receive to write to carry in the request generate unique Data Identification, and wherein said Data Identification comprises sign in the group id of this SP place SP group and the group;
Processing unit is used to preserve the Data Identification and the corresponding data to be stored of generation, and returns the Data Identification of generation.
The application provides a kind of data addressing method based on above-mentioned date storage method, comprising:
Read acting server RP and receive the data read request that client sends, wherein carry the Data Identification of data to be read;
Described RP determines the target SP of the described data to be read of storage according to sign in group id that comprises in the described Data Identification and the group, and described data read request is forwarded on the described target SP;
Described target SP reads corresponding data according to the Data Identification that carries in the data read request, and the data that read out are returned to client by described RP.
The application provides a kind of data addressing system based on above-mentioned data-storage system, and comprise described memory cluster and read acting server RP, wherein:
The described acting server RP that reads is used to receive the data read request that client sends, and wherein carries the Data Identification of data to be read; According to sign in group id that comprises in the described Data Identification and the group, determine the target storage server SP of the described data to be read of storage, and described data read request is forwarded on the described target SP;
Described target SP is used for reading corresponding data according to the Data Identification that the data read request that receives is carried, and the data that read out is returned to client by described RP.
The application provides a kind of acting server, comprising:
Receiving element is used to receive the data read request that client sends, and wherein carries the Data Identification of data to be read;
Determining unit is used for the group id that comprises according to described Data Identification and organizes interior sign, determines the target storage server SP of the described data to be read of storage;
Retransmission unit is used for described data read request is forwarded to described target SP.
Date storage method that the application provides and data addressing method are applied in the memory cluster, and it is the distributed storage system of unit that the memory cluster constitutes with the SP group, and each SP group comprises at least two SP, disposes sign in group id and the group on the SP.In data storage procedure, the data that client sent by WP write request and are forwarded on the purpose SP, generate the Data Identification line data storage of going forward side by side by purpose SP according to sign in the group id of configuration and the group, need not to rely on special management server distribute data sign and safeguard central allocation table; In the data addressing process, directly orient target SP by the Data Identification that carries in the data read request of RP according to the client transmission, need not to rely on special management server to carry out twice addressing according to central allocation table.The application need not to rely on special management server to carry out unified scheduling of resource and distribution, has promoted the security reliability of system; The data addressing process need not the secondary addressing, has promoted the reading efficiency of data.
Description of drawings
Fig. 1 is a data-storage system configuration diagram in the embodiment of the present application;
Fig. 2 is a date storage method flow chart in the embodiment of the present application;
Fig. 3 is the structural representation of SP in the embodiment of the present application;
Fig. 4 is a data addressing system architecture schematic diagram in the embodiment of the present application;
Fig. 5 is a data addressing method flow diagram in the embodiment of the present application;
Fig. 6 is the structural representation of RP in the embodiment of the present application.
Embodiment
The embodiment of the present application is at the problem that exists in available data storage and the data addressing scheme, a kind of institutional framework of improved memory cluster has at first been proposed, the memory cluster of being made up of many SP is divided at least two SP groups, each SP group comprises at least two SP, every SP in each SP group disposes the group id and the interior sign of group of place SP group, the group id of distributing to each SP group need guarantee its uniqueness, and need to guarantee to distribute to sign in the group of every SP can with sign difference mutually in the group of other SP in this SP group.
Comprise even number platform SP in the memory cluster in order to realize simply, can to set, and per two SP are divided into a SP group.Illustrate:
Suppose to comprise in the memory cluster 40 SP, the memory cluster is divided into 20 SP groups, each SP group comprises two SP.At the group of each SP in the memory cluster, group id can be assigned as 01,02 successively, 03...20.At two SP in SP group, can be for wherein being designated odd number in a SP assign group, for example 1,3,5, can be called the odd numbers machine in the embodiment of the present application; Be designated even number in another SP assign group, for example 2,4,8, can be called the even numbers machine in the embodiment of the present application.On this basis, for the group id and the interior sign of group of every SP configuration place SP group in the memory cluster, for example be the odd numbers machine configuration 011 in the SP group 01, be SP organizes the even numbers machine configuration 122 in 12.
At the situation that comprises odd number platform SP in the memory cluster, three SP wherein can be divided into a SP group, per two SP among all the other SP are divided into a SP group.Illustrate:
Suppose to comprise in the memory cluster 25 SP, the memory cluster can be divided into 12 SP groups, one of them SP group comprises three SP, and all the other each SP groups comprise two SP.At the group of each SP in the memory cluster, group id can be assigned as 01,02 successively, 03...12.At the SP group that comprises three SP, can be designated 3,6,9 for being designated to be designated in 1,4,7, the second SP assign group in 2,5,8, the three SP assign group in SP assign group wherein.
Need to prove, can divide into groups flexibly according to the scale of memory cluster in the concrete enforcement that the SP quantity that each SP group comprises can be different, be no less than two as long as guarantee to be no less than the SP that two SP organize and each SP group comprises.Can as long as guarantee to distinguish, for example organize the situation that comprise many SP according to sign in grouping situation flexible allocation group id and the group in concrete the enforcement at a SP, can for be designated 1,2,3 in each SP assign group successively, 4.......
On the basis of above-mentioned memory cluster, the embodiment of the present application provides a kind of data-storage system, as shown in Figure 1, comprise the memory cluster and WP (the Write Proxy that form by many SP 101, write acting server) 102, in the actual system architecture, WP can comprise many equally, forms the WP cluster.Wherein:
WP 102, are used to receive the data that client sends and write request, wherein carry data to be stored, write request according to the data that receive, and select a SP as purpose SP from the memory cluster, and these data are write request are forwarded on the purpose SP;
In specifically implementing, wrap at the jar that the client exploitation is used for linking to each other with the WP cluster, when the user need store data,, data are write on the WP who asks to send in the WP cluster by client call jar bag based on the Java technology.WP can be based on load-balancing algorithm, selects a SP who has stored the data volume minimum as purpose SP from the memory cluster, and data are write request is transmitted to this purpose SP.
In concrete the enforcement, also comprise numbering in table sign and the table in the Data Identification that generates, for the ease of addressing, the memory space of SP generally is separated into a plurality of tables according to setting rule, many data of storage in each table, the Data Identification that each bar data is corresponding unique, for example 1009030000000011, wherein preceding 2 " 10 " represent that the group id of the SP group at this data place is 10, the 3rd to the 6th " 0903 " the table sign of representing the table at this data place, last 1 " 1 " represents the interior sign of group of the SP at this data place, remaining " 000000001 " is represented to number in the table of these data in table, indication specifically is which the bar data in the table, thereby accurately locatees data.The structure of Data Identification can be set flexibly, follows unified structure in the system and gets final product.Preferable, for the ease of management, the table that is used to store data among the purpose SP can be separated by the time, for example general's storage weekly is on a table, table is designated the data in 09 year the 3rd week of storage in the table of " 0903 ", table is designated the data in 09 year the 4th week of storage in the table of " 0904 ", or the like.Can limit the time cycle of separating according to system's needs loaded service demand in concrete the enforcement, the figure place that takies by change table sign satisfies the miscellaneous service demand.Table among the purpose SP also can monthly be cut apart, cuts apart quarterly even cut apart per year.
In order to guarantee the safe and reliable of storage, adopt the mode of active and standby storage, after purpose SP successfully preserves the Data Identification that generates and corresponding data to be stored, can generate replication log or generate replication log by WP by purpose SP generation replication log or by special log server, be responsible for these data are copied on the backup SP of purpose SP corresponding at least one the backup SP of SP.In the embodiment of the present application, can adopt mutually redundant mode between each SP in the same SP group.Concrete, organize the situation that comprises two SP at a SP, the odd numbers machine is the backup of even numbers machine, the even numbers machine is the backup of odd numbers machine; Comprise the situation of many SP at SP group, backup mode can compare flexibly, below the explanation of branch situation.If a SP group comprises even number platform SP, is example to comprise four SP, can backup each other in twos, for example a machine is No. two machine backups, and No. two machines are a machine backup, and No. three machines are No. four machine backups, and No. four machines are No. three machine backups; Also can back up by winding, for example a machine is No. two machines backups, and No. two machines are No. three machines backups, and No. three machines are No. four machines backups, and No. four machines are a machine backup; Can also be other each SP backup in the group by each interior SP of SP group.If a SP group comprises odd number platform SP, can back up by winding, also can be interior other each SP backup of group by each interior SP of SP group.But in the data addressing process, general direct reading of data from the main frame and reading of data from the backup machine not.
Because data write operation is the consumption data base resource relatively, in order to limit the data write operation concurrency of separate unit SP, guarantee that separate unit SP can not receive excessive data and write request in certain time period, be each the SP configuration token bucket in the memory cluster, dispose the token update cycle simultaneously, in the zero hour of each token update cycle, in the token bucket of self, pack into the token of fixed qty of each SP.At each SP, if it receives data and writes request promptly as purpose SP, writing for the data that receive before the data to be stored of carrying in the request generate unique Data Identification, need to carry out following operation: when data write request arrival, judge whether operable token is arranged in the token bucket, if, then from token bucket, delete a token, if not, then before the zero hour of next token update cycle, reject new data and write request.
Wherein, a kind of possibility structure of SP as shown in Figure 2, comprising:
Receiving element 202 is used to receive data and writes request, wherein carries data to be stored;
Preferable, this SP also comprises:
Second memory cell 205 is used to store pre-configured token bucket;
Updating block 206 was used in the zero hour of each token update cycle, the token of the fixed qty of packing in token bucket;
Based on the framework of data-storage system, the embodiment of the present application provides a kind of date storage method, as shown in Figure 3, comprising:
The data that S301, WP receive the client transmission write request, wherein carry data to be stored;
S302, WP write request according to the data that receive, select a SP as purpose SP from the memory cluster, and these data are write request are forwarded on the purpose SP;
Preferable, WP selects a SP who has stored the data volume minimum as purpose SP from the memory cluster;
When S303, purpose SP write request arrival in data, judge whether operable token is arranged in the token bucket, if, then carry out S304, if not, then carry out S305;
S304, purpose SP delete a token from token bucket, and turn to execution S306;
S305, purpose SP rejected new data and write request before the zero hour of next token update cycle;
S306, purpose SP are that the data that receive write the unique Data Identification of data generation to be stored that carries in the request, comprise the group id and the interior sign of group of purpose SP place SP group in this Data Identification;
S307, purpose SP preserve Data Identification and the corresponding data to be stored that generate, and the Data Identification that generates is returned to client by WP.
Need to prove that if each SP in the memory cluster does not dispose token bucket, then step S303～S305 need not to carry out, after S302 is complete, directly turns to and carry out S306.
Based on above-mentioned data-storage system, the embodiment of the present application correspondence provides a kind of data addressing system, as shown in Figure 4, comprise the memory cluster and the RP (Read Proxy reads acting server) 103 that form by many SP 101, in the actual system architecture, RP can comprise many equally, form the RP cluster, and RP and WP can merge setting, that is to say that the acting server of a physics can possess the function of RP and WP simultaneously.Wherein:
RP 103, are used to receive the data read request that client sends, and wherein carry the Data Identification of data to be read; According to sign in group id that comprises in this Data Identification and the group, determine the target SP of storage data to be read, and data read request is forwarded on the target SP;
In concrete the enforcement, be used for the jar bag that links to each other with the RP cluster in the client exploitation, when the user needs reading of data, wrap, data read request is sent on the RP in the RP cluster by client call jar based on the Java technology.
Owing to also comprise numbering in table sign and the table in the Data Identification, so target SP 101 directly orients these data according to this Data Identification.
Wherein, a kind of possibility structure of RP as shown in Figure 5, comprising:
Receiving element 501 is used to receive the data read request that client sends, and wherein carries the Data Identification of data to be read;
Determining unit 502 is used for the group id that comprises according to this Data Identification and organizes interior sign, determines the target SP of these data to be read of storage;
Based on above-mentioned date storage method, the embodiment of the present application correspondence provides a kind of data addressing method, as shown in Figure 6, comprising:
S601, RP receive the data read request that client sends, and wherein carry the Data Identification of data to be read;
S602, RP determine the target SP of these data to be read of storage according to sign in group id that comprises in the described Data Identification and the group, and this data read request is forwarded on the target SP;
S603, target SP read corresponding data according to the Data Identification that carries in the data read request, and the data that read out are returned to client by this RP.
Date storage method that the application provides and data addressing method are applied in the memory cluster, and it is the distributed storage system of unit that the memory cluster constitutes with the SP group, and each SP group comprises at least two SP, disposes sign in group id and the group on the SP.In data storage procedure, the data that client sent by WP write request and are forwarded on the purpose SP, generate the Data Identification line data storage of going forward side by side by purpose SP according to sign in the group id of configuration and the group, need not to rely on special management server distribute data sign and safeguard central allocation table; In the data addressing process, directly orient target SP by the Data Identification that carries in the data read request of RP according to the client transmission, need not to rely on special management server to carry out twice addressing according to central allocation table.The application need not to rely on special management server to carry out unified scheduling of resource and distribution, has promoted the security reliability of system; The data addressing process need not the secondary addressing, has promoted the reading efficiency of data.
The embodiment that it will be understood by those skilled in the art that the application can be provided as method, system, equipment or computer program.Therefore, the application can adopt complete hardware embodiment, complete software implementation example or in conjunction with the form of the embodiment of software and hardware aspect.And the application can adopt the form that goes up the computer program of implementing in one or more computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) that wherein include computer usable program code.
The application is that reference is described according to the flow chart and/or the block diagram of method, equipment (system) and the computer program of the embodiment of the present application.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or the block diagram and/or square frame and flow chart and/or the block diagram and/or the combination of square frame.Can provide these computer program instructions to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce a machine, make the instruction of carrying out by the processor of computer or other programmable data processing device produce to be used for the device of the function that is implemented in flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame appointments.
These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, make the instruction that is stored in this computer-readable memory produce the manufacture that comprises command device, this command device is implemented in the function of appointment in flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame.
These computer program instructions also can be loaded on computer or other programmable data processing device, make on computer or other programmable devices and to carry out the sequence of operations step producing computer implemented processing, thereby the instruction of carrying out on computer or other programmable devices is provided for being implemented in the step of the function of appointment in flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame.
Although described the application's preferred embodiment, in a single day those skilled in the art get the basic creative notion of cicada, then can make other change and modification to these embodiment.So claims are intended to all changes and the modification that are interpreted as comprising preferred embodiment and fall into the application's scope.
Obviously, those skilled in the art can carry out various changes and modification and the spirit and scope that do not break away from the application to the application.Like this, if these of the application are revised and modification belongs within the scope of the application's claim and equivalent technologies thereof, then the application also is intended to comprise these changes and modification interior.
Claims (13)
1. date storage method, it is characterized in that the memory cluster of being made up of many storage server SP is divided at least two SP groups, each SP group comprises at least two SP, every SP in each SP group disposes the group id and the interior sign of group of place SP group, and described method comprises:
The data of writing the transmission of acting server WP reception client write request, wherein carry data to be stored;
Described WP writes request according to the data that receive, and selects a SP as purpose SP from the memory cluster, and described data are write request is forwarded on the described purpose SP;
Described purpose SP is that the data that receive write the unique Data Identification of data generation to be stored that carries in the request, preserve the Data Identification and the corresponding data to be stored that generate, and the Data Identification that generates returned to client by described WP, wherein said Data Identification comprises sign in the group id of purpose SP place SP group and the group.
2. the method for claim 1 is characterized in that, each SP in the described memory cluster disposes token bucket, in the zero hour of each token update cycle, and in the token bucket of self, pack into the token of fixed qty of each SP; And
At described purpose SP is that data write before the data to be stored of carrying in the request generate unique Data Identification, also comprises:
When described purpose SP writes request arrival in described data, judge whether operable token is arranged in the token bucket, if, then from token bucket, delete a token, if not, then before the zero hour of next token update cycle, reject new data and write request.
3. method as claimed in claim 1 or 2 is characterized in that, described WP selects a SP who has stored the data volume minimum as purpose SP from the memory cluster.
4. the method for claim 1 is characterized in that, the table that is used to store data among the described purpose SP was separated by the time, also comprises numbering in table sign and the table in the Data Identification of generation.
5. as the arbitrary described method of claim 1 to 4, it is characterized in that, backup each other between each SP in the same SP group.
6. data-storage system, it is characterized in that, comprise the memory cluster of forming by many storage server SP and write acting server WP, described memory cluster is divided at least two SP groups, each SP group comprises at least two SP, every SP in each SP group disposes the group id and the interior sign of group of place SP group, wherein:
The described acting server WP that writes, be used to receive the data that client sends and write request, wherein carry data to be stored, write request according to the data that receive, from the memory cluster, select a SP as purpose, and described data are write request be forwarded on the described purpose SP;
Described purpose SP, the data to be stored that are used to the data that receive to write to carry in the request generate unique Data Identification, preserve the Data Identification and the corresponding data to be stored that generate, and the Data Identification that generates returned to client by described WP, wherein said Data Identification comprises sign in the group id of purpose SP place SP group and the group.
7. system as claimed in claim 6 is characterized in that, each SP in the described memory cluster disposes token bucket, in the zero hour of each token update cycle, and in the token bucket of self, pack into the token of fixed qty of each SP; And
Described purpose SP also is used for judging whether operable token is arranged in the token bucket when described data write request arrival, if then from token bucket, delete a token, if not, then before the zero hour of next token update cycle, reject new data and write request.
8. a storage server is characterized in that, comprising:
First memory cell is used to store the group id of pre-configured place storage server SP group and organizes interior sign;
Receiving element is used to receive data and writes request, wherein carries data to be stored;
Generation unit, the data to be stored that are used to the data that receive to write to carry in the request generate unique Data Identification, and wherein said Data Identification comprises sign in the group id of this SP place SP group and the group;
Processing unit is used to preserve the Data Identification and the corresponding data to be stored of generation, and returns the Data Identification of generation.
9. storage server as claimed in claim 8 is characterized in that,
Second memory cell is used to store pre-configured token bucket;
Updating block was used in the zero hour of each token update cycle, the token of the fixed qty of packing in described token bucket;
Judging unit is used for judging whether operable token is arranged in the token bucket when described data write request arrival, if then delete a token from token bucket, and trigger described generation unit; If not, then controlled described receiving element before the zero hour of next token update cycle, reject new data and write request, and trigger described generation unit.
10. the data addressing method based on the described date storage method of claim 1 is characterized in that, comprising:
Read acting server RP and receive the data read request that client sends, wherein carry the Data Identification of data to be read;
Described RP determines the target SP of the described data to be read of storage according to sign in group id that comprises in the described Data Identification and the group, and described data read request is forwarded on the described target SP;
Described target SP reads corresponding data according to the Data Identification that carries in the data read request, and the data that read out are returned to client by described RP.
11. the data addressing system based on the described data-storage system of claim 6 is characterized in that, comprises described memory cluster and reads acting server RP, wherein:
The described acting server RP that reads is used to receive the data read request that client sends, and wherein carries the Data Identification of data to be read; According to sign in group id that comprises in the described Data Identification and the group, determine the target storage server SP of the described data to be read of storage, and described data read request is forwarded on the described target SP;
Described target SP is used for reading corresponding data according to the Data Identification that the data read request that receives is carried, and the data that read out is returned to client by described RP.
12. system as claimed in claim 11 is characterized in that, described write acting server WP and read acting server RP merge to be provided with.
13. an acting server is characterized in that, comprising:
Receiving element is used to receive the data read request that client sends, and wherein carries the Data Identification of data to be read;
Determining unit is used for the group id that comprises according to described Data Identification and organizes interior sign, determines the target storage server SP of the described data to be read of storage;
Retransmission unit is used for described data read request is forwarded to described target SP.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200910179926 CN102035865B (en) | 2009-09-30 | 2009-09-30 | Data storing and addressing methods, systems and equipment |
| HK11108667.2A HK1154718A1 (en) | 2009-09-30 | 2011-08-16 | Data storage and data addressing method, system and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200910179926 CN102035865B (en) | 2009-09-30 | 2009-09-30 | Data storing and addressing methods, systems and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102035865A true CN102035865A (en) | 2011-04-27 |
| CN102035865B CN102035865B (en) | 2013-04-17 |
Family
ID=43888186
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200910179926 Active CN102035865B (en) | 2009-09-30 | 2009-09-30 | Data storing and addressing methods, systems and equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102035865B (en) |
| HK (1) | HK1154718A1 (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102724301A (en) * | 2012-05-29 | 2012-10-10 | 中国联合网络通信集团有限公司 | Cloud database system and method and equipment for reading and writing cloud data |
| CN104202375A (en) * | 2014-08-22 | 2014-12-10 | 广州华多网络科技有限公司 | Method and system for synchronous data |
| CN105144161A (en) * | 2013-03-13 | 2015-12-09 | 亚马逊科技公司 | Token-based admission control for replicated writes |
| CN105610971A (en) * | 2016-01-29 | 2016-05-25 | 北京京东尚科信息技术有限公司 | Load balancing method and apparatus |
| CN106897335A (en) * | 2016-06-28 | 2017-06-27 | 阿里巴巴集团控股有限公司 | A kind of storage method of business datum, the generation method of record identifier and device |
| CN106993022A (en) * | 2016-12-30 | 2017-07-28 | 中国银联股份有限公司 | For the mark management method of cluster, identification server and corresponding system |
| WO2017140131A1 (en) * | 2016-02-17 | 2017-08-24 | 杭州海康威视数字技术股份有限公司 | Data writing and reading method and apparatus, and cloud storage system |
| WO2017162056A1 (en) * | 2016-03-24 | 2017-09-28 | 阿里巴巴集团控股有限公司 | Service processing method, device, and system |
| CN109597567A (en) * | 2017-09-30 | 2019-04-09 | 网宿科技股份有限公司 | A kind of data processing method and device |
| CN109726212A (en) * | 2018-12-29 | 2019-05-07 | 杭州宏杉科技股份有限公司 | Data-storage system and method |
| CN112000641A (en) * | 2020-07-31 | 2020-11-27 | 新华三大数据技术有限公司 | Data storage method, device and system |
| CN112099728A (en) * | 2019-06-18 | 2020-12-18 | 华为技术有限公司 | Method and device for executing write operation and read operation |
| CN113783916A (en) * | 2020-10-16 | 2021-12-10 | 北京沃东天骏信息技术有限公司 | Information synchronization method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1140500A (en) * | 1994-02-08 | 1997-01-15 | 艾利森电话股份有限公司 | Distributed data base system |
| CN1437728A (en) * | 1999-12-27 | 2003-08-20 | 格里高里·V·朱德诺夫斯基 | Multi-bank, fault-tolerant, high-performance memory addressing system and method |
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safety storage method for data |
| CN101299211A (en) * | 2007-04-30 | 2008-11-05 | 王霞 | Distributed enquiring method of wireless radio frequency recognition data |
-
2009
- 2009-09-30 CN CN 200910179926 patent/CN102035865B/en active Active
-
2011
- 2011-08-16 HK HK11108667.2A patent/HK1154718A1/en unknown
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1140500A (en) * | 1994-02-08 | 1997-01-15 | 艾利森电话股份有限公司 | Distributed data base system |
| CN1437728A (en) * | 1999-12-27 | 2003-08-20 | 格里高里·V·朱德诺夫斯基 | Multi-bank, fault-tolerant, high-performance memory addressing system and method |
| CN101299211A (en) * | 2007-04-30 | 2008-11-05 | 王霞 | Distributed enquiring method of wireless radio frequency recognition data |
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safety storage method for data |
Non-Patent Citations (1)
| Title |
|---|
| 张建勋等: "高可靠可扩展PC集群存储系统的设计", 《华南理工大学学报（自然科学版）》 * |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102724301A (en) * | 2012-05-29 | 2012-10-10 | 中国联合网络通信集团有限公司 | Cloud database system and method and equipment for reading and writing cloud data |
| CN105144161A (en) * | 2013-03-13 | 2015-12-09 | 亚马逊科技公司 | Token-based admission control for replicated writes |
| CN105144161B (en) * | 2013-03-13 | 2019-05-10 | 亚马逊科技公司 | For the admission control based on token of duplication write-in |
| CN104202375A (en) * | 2014-08-22 | 2014-12-10 | 广州华多网络科技有限公司 | Method and system for synchronous data |
| CN104202375B (en) * | 2014-08-22 | 2017-10-24 | 广州华多网络科技有限公司 | The method and system of synchrodata |
| CN105610971A (en) * | 2016-01-29 | 2016-05-25 | 北京京东尚科信息技术有限公司 | Load balancing method and apparatus |
| CN105610971B (en) * | 2016-01-29 | 2019-07-02 | 北京京东尚科信息技术有限公司 | A kind of load-balancing method and device |
| US11586673B2 (en) | 2016-02-17 | 2023-02-21 | Hangzhou Hikvision Digital Technology Co., Ltd. | Data writing and reading method and apparatus, and cloud storage system |
| CN107092437B (en) * | 2016-02-17 | 2019-11-22 | 杭州海康威视数字技术股份有限公司 | Data write-in, read method and device, cloud storage system |
| WO2017140131A1 (en) * | 2016-02-17 | 2017-08-24 | 杭州海康威视数字技术股份有限公司 | Data writing and reading method and apparatus, and cloud storage system |
| CN107092437A (en) * | 2016-02-17 | 2017-08-25 | 杭州海康威视数字技术股份有限公司 | Data write-in, read method and device, cloud storage system |
| CN107229455B (en) * | 2016-03-24 | 2019-09-17 | 阿里巴巴集团控股有限公司 | A kind of method for processing business, apparatus and system |
| CN107229455A (en) * | 2016-03-24 | 2017-10-03 | 阿里巴巴集团控股有限公司 | A kind of method for processing business, apparatus and system |
| WO2017162056A1 (en) * | 2016-03-24 | 2017-09-28 | 阿里巴巴集团控股有限公司 | Service processing method, device, and system |
| US11445030B2 (en) | 2016-03-24 | 2022-09-13 | Advanced New Technologies Co., Ltd. | Service processing method, device, and system |
| CN106897335A (en) * | 2016-06-28 | 2017-06-27 | 阿里巴巴集团控股有限公司 | A kind of storage method of business datum, the generation method of record identifier and device |
| CN106897335B (en) * | 2016-06-28 | 2020-11-27 | 创新先进技术有限公司 | Service data storage method, record identifier generation method and device |
| CN106993022A (en) * | 2016-12-30 | 2017-07-28 | 中国银联股份有限公司 | For the mark management method of cluster, identification server and corresponding system |
| CN106993022B (en) * | 2016-12-30 | 2020-03-31 | 中国银联股份有限公司 | Identification management method for cluster, identification server and corresponding system |
| CN109597567A (en) * | 2017-09-30 | 2019-04-09 | 网宿科技股份有限公司 | A kind of data processing method and device |
| CN109597567B (en) * | 2017-09-30 | 2022-03-08 | 网宿科技股份有限公司 | Data processing method and device |
| CN109726212A (en) * | 2018-12-29 | 2019-05-07 | 杭州宏杉科技股份有限公司 | Data-storage system and method |
| CN112099728A (en) * | 2019-06-18 | 2020-12-18 | 华为技术有限公司 | Method and device for executing write operation and read operation |
| CN112000641B (en) * | 2020-07-31 | 2022-08-30 | 新华三大数据技术有限公司 | Data storage method, device and system |
| CN112000641A (en) * | 2020-07-31 | 2020-11-27 | 新华三大数据技术有限公司 | Data storage method, device and system |
| CN113783916A (en) * | 2020-10-16 | 2021-12-10 | 北京沃东天骏信息技术有限公司 | Information synchronization method and device |
| CN113783916B (en) * | 2020-10-16 | 2022-12-27 | 北京沃东天骏信息技术有限公司 | Information synchronization method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| HK1154718A1 (en) | 2012-04-27 |
| CN102035865B (en) | 2013-04-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102035865B (en) | Data storing and addressing methods, systems and equipment | |
| JP7090744B2 (en) | Distributed database cluster system and data synchronization method | |
| CN105447075B (en) | The computer implemented method divided for dynamic | |
| CN102662992B (en) | Method and device for storing and accessing massive small files | |
| CN102945278B (en) | A kind of method and apparatus of data-base recording redo log | |
| EP3258396A1 (en) | Data synchronization method, device and system | |
| CN112559637B (en) | Data processing method, device, equipment and medium based on distributed storage | |
| CN103186554A (en) | Distributed data mirroring method and data storage node | |
| CN104462370A (en) | Distributed task scheduling system and method | |
| WO1986001018A1 (en) | Database backup method | |
| EP2419845A2 (en) | Policy-based storage structure distribution | |
| CN102843403A (en) | File processing method based on distributed file system, system, and client | |
| CN102158540A (en) | System and method for realizing distributed database | |
| CN102033889A (en) | Distributed database parallel processing system | |
| CN103544285A (en) | Data loading method and device | |
| CN106570113B (en) | Mass vector slice data cloud storage method and system | |
| CN110597835B (en) | Transaction data deleting method and device based on blockchain | |
| CN110134338A (en) | A kind of distributed memory system and its data redundancy protection method and relevant device | |
| CN111638995A (en) | Metadata backup method, device and equipment and storage medium | |
| CN110532123A (en) | The failover method and device of HBase system | |
| CN113760513A (en) | Distributed task scheduling method, device, equipment and medium | |
| CN103365740B (en) | A kind of data cold standby method and device | |
| CN104182295A (en) | Data backup method and data backup device | |
| CN103164262A (en) | Task management method and device | |
| CN116303789A (en) | Parallel synchronization method and device for multi-fragment multi-copy database and readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1154718 Country of ref document: HK |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: GR Ref document number: 1154718 Country of ref document: HK |