CN102571968A - Directional data forwarding method in cloud backup system - Google Patents
Directional data forwarding method in cloud backup system Download PDFInfo
- Publication number
- CN102571968A CN102571968A CN2012100164197A CN201210016419A CN102571968A CN 102571968 A CN102571968 A CN 102571968A CN 2012100164197 A CN2012100164197 A CN 2012100164197A CN 201210016419 A CN201210016419 A CN 201210016419A CN 102571968 A CN102571968 A CN 102571968A
- Authority
- CN
- China
- Prior art keywords
- client
- data
- transfer
- candidate
- side list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a directional data forwarding method in a cloud backup system. The directional data forwarding method comprises the following steps that: all clients in the cloud backup system regularly upload own information to a storage space; all the clients in the cloud backup system regularly construct own transferring client lists; and the clients with data to be sent forward the data according to the transferring client lists. According to the directional data forwarding method, the efficiency for backing up the data by the backup clients is improved, the total backup data amount of a source host machine is not increased when copies are injected into a peer-to-peer (p2p) space of the cloud backup system, and a phenomenon that the bandwidth is wasted because of the copies is avoided; and furthermore, idling host machine resources in a network are used during data storage and forwarding, so that extra arrangement cost of the system is avoided.
Description
Technical field
The present invention relates to a kind of data forwarding method, be specifically related to the data-directed retransmission method in a kind of cloud standby system.
Background technology
Digitized life makes people accumulate a large amount of significant datas, and People more and more need be carried out network backup with these significant datas.Data mode in the existing network standby system generally is divided into two types: direct send mode, and in this mode, client host is general direct to send data to storage node (data center or p2p main frame), and data are transmitted without other subscription client; Use the load mode of buffer memory equipment: the data transmission efficiency when improving user ID; Some users possibly dispose buffer memory equipment in the position (such as in the machine room of enterprise oneself) near client host; User data at first is sent to buffer memory equipment, is forwarded to long-range cloud data center after having collected data by buffer memory equipment again.
Yet there is following problem in existing data mode: (1) in direct send mode, user rs host maybe be because of away from the storage node, and can't obtain the actual bandwidth of high speed, has reduced user ID speed and efficient; (2) in the standby system based on p2p, a plurality of copies that often need Backup Data have increased the backed up data amount to different main frames, reduce backup efficient more and will waste a large amount of network bandwidths; (3) can improve backup efficient although dispose buffer memory equipment, the deployment of buffer memory equipment needs certain purchase and maintenance cost, has improved the cost of cloud backup services, is not suitable for having use under a large amount of personal users' the wide area cloud environment.
Summary of the invention
The object of the present invention is to provide the data-directed retransmission method in a kind of cloud standby system; Comprise data center's (or storage server) and p2p node in this cloud standby system; This method has improved the efficient of backup client Backup Data; When in the p2p space of cloud standby system, injecting copy, do not increase the Backup Data total amount of source host, and not because of placement copy waste bandwidth, and in the process of storage forwarding data; Use the idle host resource in the network, the lower deployment cost of not extra increase system.
The present invention realizes through following technical scheme:
Data-directed retransmission method in a kind of cloud standby system may further comprise the steps:
(1) all clients in the cloud standby system are periodically uploaded self information to memory space:
(1-1) each client is periodically used and is detected the data transfer path that the software probe client arrives target storage server, and the Loop Round Trip Time RTT of each data transfer equipment of client to the data transfer path;
(1-2) the client feedback information of data query forwarding unit according to the order of sequence arrives the delay=RTT/2 of data transfer equipment with the computing client end;
(1-3) whether client judge postpones less than threshold value, if less than then changing step (1-4) over to, otherwise changes step (1-5) over to;
(1-4) the IP address with data transfer equipment is a keyword, with client on average to upload bandwidth, average download bandwidth, residue memory capacity, postpone be key assignments, keyword and key assignments are sent on the memory space;
(1-5) whether the judgment data forwarding unit is last data transfer equipment on the data transfer path, and in this way, then step (1) finishes, otherwise gets into step (1-6);
(1-6) change next data transfer equipment on the data transfer path over to, and return step (1-2);
(2) all clients in the cloud standby system are periodically constructed the transfer client side list of oneself:
(2-1) the IP address of all data transfer equipments on the data transfer path of each client traversal oneself; And with these IP addresses be keyword periodically on memory space inquiry arrive the candidate transfer client of other little client of the retardation ratio client of data transfer equipment as this client; And according to candidate's transfer client side list of candidate's transfer client structure oneself, each list item of candidate's transfer client side list comprises the key assignments of candidate's transfer client;
(2-2) delete the candidate's transfer client that does not have enough memory capacity and available bandwidth in candidate's transfer client side list, to accomplish the renewal of candidate's transfer client side list;
(2-3) in the candidate's transfer client side list after calculate upgrading candidate's transfer client and client to the delay of same data transfer equipment and; And upload bandwidth according to client actual and from candidate's transfer client side list, select candidate's transfer client a plurality of delays and minimum to form the transfer client side list, the selected candidate's transfer client in the transfer this moment client side list is the transfer client;
(3) client that has data to be sent is transmitted data according to the transfer client side list:
The client that (3-1) has data to be sent is selected a transfer client in the transfer client side list of himself, and sends data to the transfer client;
The transfer client that (3-2) receives data judges whether the data that longer-term storage receives on the external equipment of this main frame according to application need; And whether the delay of judging himself and target storage server is less than threshold value; If less than; Then change step (3-4) over to, change step (3-3) over to otherwise return;
The transfer client that (3-3) receives data becomes a new client that has data to be sent, and changes step (3-1) over to;
The transfer client that (3-4) receives data arrives target storage server with transfer of data.Data transfer equipment is router and switch.
The scope of threshold value is 5 to 30 milliseconds.
Advantage of the present invention and technique effect comprise:
(1) if the backup source main frame away from cloud data center, Backup Data will at first be sent to other nearer subscriber's main station of range data source host so, transmit through these main frame relays again, finally be forwarded to data center, therefore improve backup efficient;
(2) in the p2p space of cloud standby system, inject copy if desired, then in repeating process, the main frame of transmitting data is preserved data on the spot after having transmitted data, do not increase the Backup Data total amount of source host, does not also expend extra bandwidth because of placing copy;
(3) this method is transmitted in the process of data in storage, uses computer resource idle in the network, like memory space, bandwidth etc., and the lower deployment cost of not extra increase system.
Description of drawings
Fig. 1 is the flow chart of the data-directed retransmission method in the cloud standby system of the present invention.
Fig. 2 is the refinement flow chart of step (1) in the data-directed retransmission method of the present invention.
Fig. 3 is the refinement flow chart of step (2) in the data-directed retransmission method of the present invention.
Fig. 4 is the refinement flow chart of step (3) in the data-directed retransmission method of the present invention.
Fig. 5 is the course of work sketch map of data-directed retransmission method of the present invention.
Embodiment
Below at first technical term of the present invention is made an explanation and explains:
Data transfer equipment; Middle finger router of the present invention, switch, gateway etc. are responsible for storage and are transmitted in network, and the network equipment with Network layer function.
Jump: English is hop, and in the present invention, each jumping is a data forwarding unit.
Loop Round Trip Time: English is Round-Trip Time, is abbreviated as RTT, also is referred to as round-trip delay.It is important performance index in computer network, and expression is sent data from transmitting terminal and begun, and receives the affirmation (receiving terminal just sends affirmation after receiving data immediately) from receiving terminal, the time delay of experience altogether to transmitting terminal.
Data transfer path: in the Internet, the transmission of information is from the end arrival other end through many sections transmission medium and equipment (router, switch, server, gateway or the like) in the net.Each equipment that is connected on the Internet all can have an independent IP address generally speaking.Order the IP and the Loop Round Trip Time of the network equipment that main frame experienced of the other end of acquired information successively through Traceroute or Tracert, claim among the present invention that the Device IP and the Loop Round Trip Time of this string descriptor information repeating process is data transfer path from certain computer to the Internet.In the unix system, using Traceroute, is Tracert among the MS Windows.
As shown in Figure 1, the data-directed retransmission method in the cloud standby system of the present invention may further comprise the steps:
(1) all clients in the cloud standby system are periodically uploaded self information to memory space, particularly, comprise following substep:
(1-1) each client is periodically used and is detected the data transfer path that this client of software probe arrives target storage server, and the Loop Round Trip Time RTT of each data transfer equipment of client to the data transfer path.
(1-2) the client feedback information of data query forwarding unit according to the order of sequence arrives the delay=RTT/2 of data transfer equipment with the computing client end;
(1-3) whether client judge postpones less than threshold value, if less than then changing step (1-4) over to, otherwise changes step (1-5) over to, and in this execution mode, the scope of threshold value is 5 to 30 milliseconds.
(1-4) the IP address with data transfer equipment is a keyword, is key assignments with on average the upload bandwidth, average download bandwidth, residue memory capacity, client of client to the delay of data transfer equipment, and keyword and key assignments are sent on the memory space;
(1-5) whether the judgment data forwarding unit is last data transfer equipment on the data transfer path, and in this way, then step (1) finishes, otherwise gets into step (1-6);
(1-6) change next data transfer equipment on the data transfer path over to, and return step (1-2);
(2) all clients in the cloud standby system are periodically constructed the transfer client side list of oneself, specifically comprise following substep:
(2-1) the IP address of all data transfer equipments on the data transfer path of each client traversal oneself; And with these IP addresses be keyword periodically on memory space inquiry arrive the candidate transfer client of other little client of this client of retardation ratio of data transfer equipment as this client; And according to candidate's transfer client side list of candidate's transfer client structure oneself, each list item of candidate's transfer client side list comprises the key assignments of candidate's transfer client;
(2-2) delete the candidate's transfer client that does not have enough memory capacity and available bandwidth in candidate's transfer client side list, to accomplish the renewal of candidate's transfer client side list;
(2-3) in the candidate's transfer client side list after calculate upgrading candidate's transfer client and client to the delay of same data transfer equipment and; And upload bandwidth according to client actual and from candidate's transfer client side list, select candidate's transfer client a plurality of delays and minimum to form the transfer client side list, the selected candidate's transfer client in the transfer this moment client side list is the transfer client;
(3) client that has data to be sent is transmitted data according to the transfer client side list:
The client that (3-1) has data to be sent is selected a transfer client in the transfer client side list of himself, and sends data to the transfer client;
The transfer client that (3-2) receives data judges whether the data that longer-term storage receives on the external equipment of this main frame according to application need; And whether the distance of judging himself and target storage server is less than threshold value; If less than; Then change step (3-4) over to, change step (3-3) over to otherwise return;
The transfer client that (3-3) receives data becomes a new client that has data to be sent, and changes step (3-1) over to;
The transfer client that (3-4) receives data sends to target storage server with data.
As shown in Figure 5, the course of work of the present invention is following, wherein with the delay that postpones between (node i, node j) expression node i and two main frames of node j.
At first, the client of node 1 uses the data forwarding paths of traceroute detection arrival target storage server to be IP
Router five-＞IP
Router one-＞IP
Router two-＞IP
Router three-＞IP
Router four-＞IP
Storage server, concrete data are as shown in table 1.The concrete data in the IP path of backup source client, node 2 and node 3 are shown in table 2, table 3, table 4.Get threshold value=15, postpone (node 1, router five), postpone (node 1, router one) all less than threshold value, then the client of node 1 is with IP
Router fiveAnd IP
Router oneBeing keyword, is key assignments with the upstream and downstream bandwidth, memory space of self with to the delay of router, will<keyword, Jian Zhi>To storing on the memory space; The client of the client of backup source client, node 2, node 3 is also done the processing of same steps as.Then, the backup source client is successively with IP
Router one, IP
Router two, IP
Router three, IP
Router fourBe keyword search candidate transfer client, because postpone (node 1, router one)=14 milliseconds greater than postponing (backup source end, router one)=1 millisecond, so node 1 can not become candidate's transfer client of backup source client; Again because postpone (node 2, router two)=1 millisecond less than postponing (backup source end, router two)=13 milliseconds, so the client of node 2 can become candidate's transfer client of backup source end.Similarly, node 3 also becomes candidate's transfer client of backup source end.Only comprise a transfer client in the hypothesis transfer client side list in this example; And because postpone (backup source end, node 2)=delay (backup source end, router two)+delay (node 2; Millisecond router two)=13+1 millisecond=14 milliseconds; Less than postponing (backup source end, node 3)=39 milliseconds, so the client of node 2 becomes the transfer client of backup source client.
Similarly, the client of node 3 becomes the transfer client of node 2.Because less than threshold value, the two is enough approaching, so need not to transmit once more behind the data arrives node 3 to the delay (node 3, storage server) of storage server=13 milliseconds for node 3.Then the data transfer path of certain data block be the backup source end-＞node 2-＞node 3-＞storage server.
The data transfer path of table 1 node 1
The data transfer path of table 2 backup source client
The data transfer path of table 3 node 2
The data transfer path of table 4 node 3
Claims (3)
1. the data-directed retransmission method in the cloud standby system is characterized in that, may further comprise the steps:
(1) all clients in the cloud standby system are periodically uploaded self information to memory space:
(1-1) each said client is periodically used and is detected the data transfer path that the said client of software probe arrives target storage server, and the Loop Round Trip Time RTT of each data transfer equipment of said client to the said data transfer path;
(1-2) said client is inquired about the feedback information of said data transfer equipment according to the order of sequence, to calculate delay=RTT/2 that said client arrives said data transfer equipment;
(1-3) whether said client judges said delay less than threshold value, if less than then changing step (1-4) over to, otherwise changes step (1-5) over to;
(1-4) the IP address with said data transfer equipment is a keyword, is key assignments with on average the upload bandwidth, average download bandwidth, residue memory capacity, said delay of said client, and said keyword and said key assignments are sent on the said memory space;
(1-5) judge whether said data transfer equipment is last data transfer equipment on the said data transfer path, in this way, then step (1) finishes, otherwise gets into step (1-6);
(1-6) change next data transfer equipment on the said data transfer path over to, and return said step (1-2);
(2) all clients in the said cloud standby system are periodically constructed the transfer client side list of oneself:
(2-1) the IP address of all data transfer equipments on the said data transfer path of each said client traversal oneself; And with these IP addresses be keyword periodically on said memory space inquiry arrive the candidate transfer client of other little client of the said client of retardation ratio of said data transfer equipment as this client; And according to candidate's transfer client side list of said candidate's transfer client structure oneself, each list item of said candidate's transfer client side list comprises the key assignments of said candidate's transfer client;
(2-2) delete the candidate's transfer client that does not have enough memory capacity and available bandwidth in said candidate's transfer client side list, to accomplish the renewal of said candidate's transfer client side list;
(2-3) candidate's transfer client described in the said candidate's transfer client side list after calculate upgrading and said client to the delay of same data transfer equipment and; And upload bandwidth according to said client actual and from said candidate's transfer client side list, select candidate's transfer client a plurality of delays and minimum to form the transfer client side list, the selected candidate's transfer client in this moment said transfer client side list is the transfer client;
(3) client that has data to be sent is transmitted data according to said transfer client side list:
(3-1) the said client that has data to be sent is selected a transfer client in the said transfer client side list of himself, and sends data to said transfer client;
The said transfer client that (3-2) receives data judges whether the data that longer-term storage receives on the external equipment of this main frame according to application need; And whether the delay of judging himself and said target storage server is less than said threshold value; If less than; Then change step (3-4) over to, change step (3-3) over to otherwise return;
(3-3) the said transfer client that receives data becomes a new client that has data to be sent, and changes step (3-1) over to;
The said transfer client that (3-4) receives data arrives said target storage server with said transfer of data.
2. data-directed retransmission method according to claim 1 is characterized in that, said data transfer equipment is router and switch.
3. data-directed retransmission method according to claim 1 is characterized in that, the scope of said threshold value is 5 to 30 milliseconds.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210016419.7A CN102571968B (en) | 2012-01-17 | 2012-01-17 | Directional data forwarding method in cloud backup system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210016419.7A CN102571968B (en) | 2012-01-17 | 2012-01-17 | Directional data forwarding method in cloud backup system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102571968A true CN102571968A (en) | 2012-07-11 |
| CN102571968B CN102571968B (en) | 2014-09-24 |
Family
ID=46416428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210016419.7A Active CN102571968B (en) | 2012-01-17 | 2012-01-17 | Directional data forwarding method in cloud backup system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102571968B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051521A (en) * | 2013-01-09 | 2013-04-17 | 浪潮电子信息产业股份有限公司 | Retransmitting method of message in cloud environment |
| CN103353856A (en) * | 2013-07-02 | 2013-10-16 | 华为技术有限公司 | Hard disk and method for forwarding and obtaining hard disk data |
| CN103873501A (en) * | 2012-12-12 | 2014-06-18 | 华中科技大学 | Cloud backup system and data backup method thereof |
| WO2014100978A1 (en) * | 2012-12-25 | 2014-07-03 | 华为技术有限公司 | Data backup method, device, and system |
| CN104408063A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Distributed file management method and device |
| CN104765661A (en) * | 2014-12-30 | 2015-07-08 | 深圳市安云信息科技有限公司 | Multiple-node hot standby method of metadata service nodes in cloud storage service |
| WO2019075773A1 (en) * | 2017-10-16 | 2019-04-25 | 平安科技（深圳）有限公司 | Data processing method and apparatus, computer device and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN102307221A (en) * | 2011-03-25 | 2012-01-04 | 国云科技股份有限公司 | Cloud storage system and implementation method thereof |
-
2012
- 2012-01-17 CN CN201210016419.7A patent/CN102571968B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN102307221A (en) * | 2011-03-25 | 2012-01-04 | 国云科技股份有限公司 | Cloud storage system and implementation method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 周可等: "云存储技术及其应用", 《中兴通讯技术》, vol. 16, no. 4, 31 August 2010 (2010-08-31), pages 24 - 27 * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873501A (en) * | 2012-12-12 | 2014-06-18 | 华中科技大学 | Cloud backup system and data backup method thereof |
| WO2014100978A1 (en) * | 2012-12-25 | 2014-07-03 | 华为技术有限公司 | Data backup method, device, and system |
| CN104137512A (en) * | 2012-12-25 | 2014-11-05 | 华为技术有限公司 | Data backup method, device, and system |
| CN104137512B (en) * | 2012-12-25 | 2017-06-20 | 华为技术有限公司 | A kind of data back up method, device and system |
| CN107247638A (en) * | 2012-12-25 | 2017-10-13 | 华为技术有限公司 | A kind of data back up method, device and system |
| CN107247638B (en) * | 2012-12-25 | 2020-12-15 | 华为技术有限公司 | Data backup method, device and system |
| CN103051521A (en) * | 2013-01-09 | 2013-04-17 | 浪潮电子信息产业股份有限公司 | Retransmitting method of message in cloud environment |
| CN103353856A (en) * | 2013-07-02 | 2013-10-16 | 华为技术有限公司 | Hard disk and method for forwarding and obtaining hard disk data |
| CN104408063B (en) * | 2014-10-29 | 2019-04-02 | 中国建设银行股份有限公司 | A kind of distributed file management method and device |
| CN104408063A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Distributed file management method and device |
| CN104765661A (en) * | 2014-12-30 | 2015-07-08 | 深圳市安云信息科技有限公司 | Multiple-node hot standby method of metadata service nodes in cloud storage service |
| CN104765661B (en) * | 2014-12-30 | 2018-04-13 | 深圳市安云信息科技有限公司 | The multinode hot spare method of Metadata Service node in a kind of cloud storage service |
| WO2019075773A1 (en) * | 2017-10-16 | 2019-04-25 | 平安科技（深圳）有限公司 | Data processing method and apparatus, computer device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102571968B (en) | 2014-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102571968B (en) | Directional data forwarding method in cloud backup system | |
| EP3391628B1 (en) | Use of virtual endpoints to improve data transmission rates | |
| US10348639B2 (en) | Use of virtual endpoints to improve data transmission rates | |
| US20170180217A1 (en) | Use of virtual endpoints to improve data tranmission rates | |
| US9143452B2 (en) | Data processing | |
| EP1723763A1 (en) | Cache server network and method of scheduling the distribution of content files | |
| CA2748688A1 (en) | Multi-source transmission system and method of instant messaging file | |
| WO2015096149A1 (en) | Tcp link configuration method, apparatus and device | |
| WO2013091343A1 (en) | Content acquisition method, device and network system | |
| Fesehaye et al. | A Scalable Distributed File System for Cloud Computing | |
| CN102497402B (en) | Content injection method and system thereof, and content delivery method and system thereof | |
| CN104601707A (en) | Network disk data processing method and device | |
| CN101494664A (en) | P2P push type network storage method based on JXTA | |
| Tagami et al. | GreenICN Project: Architecture and applications of green information centric networking | |
| CN101662494A (en) | Method, system and device for realizing content supply | |
| WO2017105816A1 (en) | Adaptive fabric multicast schemes | |
| Ioannou et al. | Exploring content popularity in information-centric networks | |
| Shah et al. | An improved simbet routing algorithm for human mobility based dtn | |
| Pavarangkoon et al. | Performance evaluation of high-performance and flexible protocol on data mover challenge | |
| Lien | Performance issues of P2P file sharing over asymmetric and wireless networks | |
| US20120102225A1 (en) | Method and apparatus for routing requests for service using bgp community attributes | |
| Moon et al. | A point-based inventive system to prevent free-riding on p2p network environments | |
| US20170251045A1 (en) | Efficient file routing system | |
| ALMELU et al. | I-ECMR: Improved Erasure Coding Based Multicast Routing in Delay Tolerant Network | |
| Lee et al. | TSR: Topology reduction from tree to star data grids |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |