CN102571968B - Directional data forwarding method in cloud backup system - Google Patents
Directional data forwarding method in cloud backup system Download PDFInfo
- Publication number
- CN102571968B CN102571968B CN201210016419.7A CN201210016419A CN102571968B CN 102571968 B CN102571968 B CN 102571968B CN 201210016419 A CN201210016419 A CN 201210016419A CN 102571968 B CN102571968 B CN 102571968B
- Authority
- CN
- China
- Prior art keywords
- client
- data
- transfer
- candidate
- side list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a directional data forwarding method in a cloud backup system. The directional data forwarding method comprises the following steps that: all clients in the cloud backup system regularly upload own information to a storage space; all the clients in the cloud backup system regularly construct own transferring client lists; and the clients with data to be sent forward the data according to the transferring client lists. According to the directional data forwarding method, the efficiency for backing up the data by the backup clients is improved, the total backup data amount of a source host machine is not increased when copies are injected into a peer-to-peer (p2p) space of the cloud backup system, and a phenomenon that the bandwidth is wasted because of the copies is avoided; and furthermore, idling host machine resources in a network are used during data storage and forwarding, so that extra arrangement cost of the system is avoided.
Description
Technical field
The present invention relates to a kind of data forwarding method, be specifically related to the directional data forwarding method in a kind of cloud standby system.
Background technology
Digitized life makes people accumulate a large amount of significant datas, and people more and more need these significant datas to carry out network backup.Data mode in existing network standby system is generally divided into two classes: direct send mode, in this mode, client host is general direct sends data to storage node (data center or p2p main frame), and data forward without other subscription client; Use the load mode of buffer memory device: the data transmission efficiency when improving user ID, some users may dispose buffer memory device in the position (in the machine room in enterprise oneself) near client host, first user data is sent to buffer memory device, then is forwarded to long-range cloud data center after collecting data by buffer memory device.
Yet there is following problem in existing data mode: (1), in direct send mode, user rs host may be because of away from data storage node, and cannot obtain the actual bandwidth of high speed, has reduced user ID speed and efficiency; (2) in the standby system based on p2p, often need a plurality of copies of Backup Data to different main frames, increased the data volume of backup, more reduce backup efficiency and will waste a large amount of network bandwidths; (3) although dispose buffer memory device, can improve backup efficiency, the deployment of buffer memory device needs certain purchase and maintenance cost, has improved the cost of cloud backup services, is not suitable for using having under a large amount of personal users' wide area cloud environment.
Summary of the invention
The object of the present invention is to provide the directional data forwarding method in a kind of cloud standby system, in this cloud standby system, comprise data center's (or storage server) and p2p node, the method has improved the efficiency of backup client Backup Data, while injecting copy in the p2p space to cloud standby system, do not increase the Backup Data total amount of source host, and not because placing copy waste bandwidth, and in the process of storage forwarding data, use the idle host resource in network, additionally do not increase the lower deployment cost of system.
The present invention is achieved by the following technical solutions:
A directional data forwarding method in cloud standby system, comprises the following steps:
(1) all clients in cloud standby system are periodically uploaded self information to memory space:
(1-1) each client is periodically used and is detected the data transfer path that software probe client arrives target storage server, and client is to the Loop Round Trip Time RTT of each data transfer equipment on data transfer path;
(1-2) the client feedback information of data query forwarding unit according to the order of sequence, arrives the delay=RTT/2 of data transfer equipment with computing client end;
(1-3) client judgement postpones whether be less than threshold value, proceeds to step (1-4), otherwise proceed to step (1-5) if be less than;
(1-4) take the IP address of data transfer equipment is keyword, take the average uploading bandwidth of client, average download bandwidth, residue memory capacity, to postpone be key assignments, keyword and key assignments are sent on memory space;
(1-5) judge whether data transfer equipment is last data transfer equipment on data transfer path, in this way, step (1) finishes, otherwise enters step (1-6);
(1-6) proceed to the next data transfer equipment on data transfer path, and return to step (1-2);
(2) all clients in cloud standby system are periodically constructed the transfer client side list of oneself:
(2-1) the IP address of all data transfer equipments on the data transfer path of each client traversal oneself, and using these IP addresses as the candidate transfer client of keyword other client that periodically the retardation ratio client of inquiry arrival data transfer equipment is little on memory space as this client, and according to candidate's transfer client side list of candidate's transfer client structure oneself, the key assignments that each list item of candidate's transfer client side list comprises candidate's transfer client;
(2-2) delete the candidate's transfer client that there is no enough memory capacity and available bandwidth in candidate's transfer client side list, to complete the renewal of candidate's transfer client side list;
(2-3) in the candidate's transfer client side list after calculate upgrading candidate's transfer client and client to the delay of same data transfer equipment with, and according to the actual uploading bandwidth of client, from candidate's transfer client side list, select candidate's transfer client a plurality of delays and minimum to form transfer client side list, the selected candidate's transfer client in now transfer client side list is transfer client;
(3) client that has data to be sent is according to transfer client side list forwarding data:
(3-1) client that has data to be sent is selected a transfer client in the transfer client side list of himself, and sends data to transfer client;
(3-2) the transfer client that receives data need to judge whether according to application the data that longer-term storage receives on the external equipment of this main frame, and whether the delay that judges himself and target storage server is less than threshold value, if be less than, proceed to step (3-4), otherwise return, proceed to step (3-3);
(3-3) the transfer client that receives data becomes a new client that has data to be sent, and proceeds to step (3-1);
(3-4) the transfer client that receives data transfers data to target storage server.Data transfer equipment is router and switch.
The scope of threshold value is 5 to 30 milliseconds.
Advantage of the present invention and technique effect comprise:
(1) if backup source main frame away from cloud data center, first Backup Data will be sent to other nearer subscriber's main station of range data source host so, then forwards through these main frame relays, is finally forwarded to data center, has therefore improved backup efficiency;
(2) if need to inject copy in the p2p space of cloud standby system, in repeating process, the main frame of forwarding data after having forwarded data, save data on the spot, do not increase the Backup Data total amount of source host, because placing copy, do not expend extra bandwidth yet;
(3) the method, in the process of storage forwarding data, is used computer resource idle in network, as memory space, bandwidth etc., does not additionally increase the lower deployment cost of system.
Accompanying drawing explanation
Fig. 1 is the flow chart of the directional data forwarding method in cloud standby system of the present invention.
Fig. 2 is the refinement flow chart of step in directional data forwarding method of the present invention (1).
Fig. 3 is the refinement flow chart of step in directional data forwarding method of the present invention (2).
Fig. 4 is the refinement flow chart of step in directional data forwarding method of the present invention (3).
Fig. 5 is the course of work schematic diagram of directional data forwarding method of the present invention.
Embodiment
Below first technical term of the present invention is explained and illustrated:
Data transfer equipment; Middle finger router of the present invention, switch, gateways etc. are responsible for data storage forwarding in network, and have the network equipment of Network layer function.
Jump: English is hop, and in the present invention, each jumping is a data transfer equipment.
Loop Round Trip Time: English is Round-Trip Time, is abbreviated as RTT, is also referred to as round-trip delay.In computer network, it is important performance index, represents from transmitting terminal sends data, to transmitting terminal, receives the confirmation (receiving terminal just sends and confirms immediately after receiving data) from receiving terminal, the altogether time delay of experience.
Data transfer path: in the Internet, the transmission of information is to arrive the other end from one end by the transmission medium of many sections and equipment (router, switch, server, gateway etc.) in net.Each equipment being connected on Internet generally can have an independently IP address.IP and Loop Round Trip Time by Traceroute or the Tracert order network equipment that the main frame of the other end of acquired information from certain computer to the Internet experiences successively, claim in the present invention that the device IP of this string descriptor information repeating process and Loop Round Trip Time are data transfer path.In unix system, using Traceroute, is Tracert in MS Windows.
As shown in Figure 1, the directional data forwarding method in cloud standby system of the present invention, comprises the following steps:
(1) all clients in cloud standby system are periodically uploaded self information to memory space, particularly, comprise following sub-step:
(1-1) each client is periodically used and is detected the data transfer path that this client of software probe arrives target storage server, and client is to the Loop Round Trip Time RTT of each data transfer equipment on data transfer path.
(1-2) the client feedback information of data query forwarding unit according to the order of sequence, arrives the delay=RTT/2 of data transfer equipment with computing client end;
(1-3) client judgement postpones whether be less than threshold value, proceeds to step (1-4), otherwise proceed to step (1-5) if be less than, and in the present embodiment, the scope of threshold value is 5 to 30 milliseconds.
(1-4) take the IP address of data transfer equipment is keyword, and take the average uploading bandwidth of client, average download bandwidth, residue memory capacity, client is key assignments to the delay of data transfer equipment, and keyword and key assignments are sent on memory space;
(1-5) judge whether data transfer equipment is last data transfer equipment on data transfer path, in this way, step (1) finishes, otherwise enters step (1-6);
(1-6) proceed to the next data transfer equipment on data transfer path, and return to step (1-2);
(2) all clients in cloud standby system are periodically constructed the transfer client side list of oneself, specifically comprise following sub-step:
(2-1) the IP address of all data transfer equipments on the data transfer path of each client traversal oneself, and using these IP addresses as the candidate transfer client of keyword other client that periodically this client of retardation ratio of inquiry arrival data transfer equipment is little on memory space as this client, and according to candidate's transfer client side list of candidate's transfer client structure oneself, the key assignments that each list item of candidate's transfer client side list comprises candidate's transfer client;
(2-2) delete the candidate's transfer client that there is no enough memory capacity and available bandwidth in candidate's transfer client side list, to complete the renewal of candidate's transfer client side list;
(2-3) in the candidate's transfer client side list after calculate upgrading candidate's transfer client and client to the delay of same data transfer equipment with, and according to the actual uploading bandwidth of client, from candidate's transfer client side list, select candidate's transfer client a plurality of delays and minimum to form transfer client side list, the selected candidate's transfer client in now transfer client side list is transfer client;
(3) client that has data to be sent is according to transfer client side list forwarding data:
(3-1) client that has data to be sent is selected a transfer client in the transfer client side list of himself, and sends data to transfer client;
(3-2) the transfer client that receives data need to judge whether according to application the data that longer-term storage receives on the external equipment of this main frame, and whether the distance that judges himself and target storage server is less than threshold value, if be less than, proceed to step (3-4), otherwise return, proceed to step (3-3);
(3-3) the transfer client that receives data becomes a new client that has data to be sent, and proceeds to step (3-1);
(3-4) the transfer client that receives data sends to target storage server by data.
As shown in Figure 5, the course of work of the present invention is as follows, wherein with postponing (node i, node j), represents the delay between node i and two main frames of node j.
First, the data forwarding paths that the client of node 1 is used traceroute to survey arrival target storage server is IP
router five-> IP
router one-> IP
router two-> IP
router three-> IP
router four-> IP
storage server, concrete data are as shown in table 1.The concrete data in the IP path of backup source client, node 2 and node 3 are as shown in table 2, table 3, table 4.Get threshold value=15, postpone (node 1, router five), postpone (node 1, router one) and be all less than threshold value, the client of node 1 is with IP
router fiveand IP
router onefor keyword, take the upstream and downstream bandwidth, memory space of self and be key assignments to the delay of router, by < keyword, key assignments > is to storing on memory space; The client of the client of backup source client, node 2, node 3 is also done the processing of same steps.Then, backup source client is successively with IP
router one, IP
router two, IP
router three, IP
router fourfor keyword search candidate transfer client, because postpone (node 1, router one)=14 milliseconds, be greater than delays (backing up source, router one)=1 millisecond, so node 1 can not become candidate's transfer client of backup source client; Because postpone (node 2, router two)=1 millisecond, be less than delays (backup source, router two)=13 milliseconds again, so the client of node 2 can become the candidate's transfer client that backs up source.Similarly, node 3 also becomes candidate's transfer client of backup source.In this example, suppose only to comprise in transfer client side list a transfer client, and because postpone (backup source, node 2)=postpone (to back up source, router two)+delay (node 2, router two)=13 milliseconds+1 millisecond=14 milliseconds, be less than delay (backup source, node 3)=39 milliseconds, so the client of node 2 becomes the transfer client of backup source client.
Similarly, the client of node 3 becomes the transfer client of node 2.Because node 3 is less than threshold value to the delay (node 3, storage server) of storage server=13 milliseconds, the two enough approaches, so data arrive after node 3 without again forwarding.The data transfer path of certain data block is backup source-> node 2-> node 3-> storage server.
The data transfer path of table 1 node 1
The data transfer path of table 2 backup source client
The data transfer path of table 3 node 2
The data transfer path of table 4 node 3
Claims (3)
1. the directional data forwarding method in cloud standby system, is characterized in that, comprises the following steps:
(1) all clients in cloud standby system are periodically uploaded self information to memory space:
(1-1) described in each, client is periodically used and is detected the data transfer path that client described in software probe arrives target storage server, and described client is to the Loop Round Trip Time RTT of each data transfer equipment on described data transfer path;
(1-2) described client is inquired about the feedback information of described data transfer equipment according to the order of sequence, arrives the delay=RTT/2 of described data transfer equipment to calculate described client;
(1-3) described client judges whether described delay is less than threshold value, proceeds to step (1-4) if be less than, otherwise proceeds to step (1-5);
(1-4) take the IP address of described data transfer equipment is keyword, and take the average uploading bandwidth of described client, average download bandwidth, residue memory capacity, described delay is key assignments, and described keyword and described key assignments are sent on described memory space;
(1-5) judge whether described data transfer equipment is last data transfer equipment on described data transfer path, in this way, step (1) finishes, otherwise enters step (1-6);
(1-6) proceed to the next data transfer equipment on described data transfer path, and return to described step (1-2);
(2) all clients in described cloud standby system are periodically constructed the transfer client side list of oneself:
(2-1) the IP address of all data transfer equipments on the described data transfer path of client traversal oneself described in each, and using these IP addresses as the candidate transfer client of keyword other client that periodically described in the retardation ratio of the described data transfer equipment of inquiry arrival, client is little on described memory space as this client, and according to candidate's transfer client side list of described candidate's transfer client structure oneself, the key assignments that each list item of described candidate's transfer client side list comprises described candidate's transfer client;
(2-2) delete the candidate's transfer client that there is no enough memory capacity and available bandwidth in described candidate's transfer client side list, to complete the renewal of described candidate's transfer client side list;
(2-3) candidate's transfer client described in the described candidate's transfer client side list after calculate upgrading and described client to the delay of same data transfer equipment with, and from described candidate's transfer client side list, select successively candidate's transfer client a plurality of delays and minimum to form transfer client side list according to the actual uploading bandwidth of described client, now the selected candidate's transfer client in described transfer client side list is transfer client;
(3) client that has data to be sent is according to described transfer client side list forwarding data:
(3-1) client that has data to be sent described in is selected a transfer client in the described transfer client side list of himself, and sends data to described transfer client;
(3-2) the described transfer client that receives data need to judge whether according to application the data that longer-term storage receives on the external equipment of this main frame, and judge whether himself is less than described threshold value to the delay of described target storage server, if be less than, proceed to step (3-4), otherwise return, proceed to step (3-3);
(3-3) the transfer client that receives data described in becomes a new client that has data to be sent, and proceeds to step (3-1);
(3-4) the described transfer client that receives data arrives described target storage server by described transfer of data.
2. directional data forwarding method according to claim 1, is characterized in that, described data transfer equipment is router and switch.
3. directional data forwarding method according to claim 1, is characterized in that, the scope of described threshold value is 5 to 30 milliseconds.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210016419.7A CN102571968B (en) | 2012-01-17 | 2012-01-17 | Directional data forwarding method in cloud backup system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210016419.7A CN102571968B (en) | 2012-01-17 | 2012-01-17 | Directional data forwarding method in cloud backup system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102571968A CN102571968A (en) | 2012-07-11 |
| CN102571968B true CN102571968B (en) | 2014-09-24 |
Family
ID=46416428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210016419.7A Active CN102571968B (en) | 2012-01-17 | 2012-01-17 | Directional data forwarding method in cloud backup system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102571968B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873501B (en) * | 2012-12-12 | 2017-07-18 | 华中科技大学 | A kind of cloud standby system and its data back up method |
| WO2014100978A1 (en) * | 2012-12-25 | 2014-07-03 | 华为技术有限公司 | Data backup method, device, and system |
| CN103051521A (en) * | 2013-01-09 | 2013-04-17 | 浪潮电子信息产业股份有限公司 | Retransmitting method of message in cloud environment |
| CN103353856A (en) * | 2013-07-02 | 2013-10-16 | 华为技术有限公司 | Hard disk and method for forwarding and obtaining hard disk data |
| CN104408063B (en) * | 2014-10-29 | 2019-04-02 | 中国建设银行股份有限公司 | A kind of distributed file management method and device |
| CN104765661B (en) * | 2014-12-30 | 2018-04-13 | 深圳市安云信息科技有限公司 | The multinode hot spare method of Metadata Service node in a kind of cloud storage service |
| CN107819891B (en) * | 2017-10-16 | 2020-01-24 | 平安科技（深圳）有限公司 | Data processing method, data processing device, computer equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN102307221A (en) * | 2011-03-25 | 2012-01-04 | 国云科技股份有限公司 | Cloud storage system and implementation method thereof |
-
2012
- 2012-01-17 CN CN201210016419.7A patent/CN102571968B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN102307221A (en) * | 2011-03-25 | 2012-01-04 | 国云科技股份有限公司 | Cloud storage system and implementation method thereof |
Non-Patent Citations (2)
| Title |
|---|
| 云存储技术及其应用;周可等;《中兴通讯技术》;20100831;第16卷(第4期);24-27 * |
| 周可等.云存储技术及其应用.《中兴通讯技术》.2010,第16卷(第4期),24-27. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102571968A (en) | 2012-07-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102571968B (en) | Directional data forwarding method in cloud backup system | |
| Mascolo et al. | SCAR: context-aware adaptive routing in delay tolerant mobile sensor networks | |
| CN105302676B (en) | Active and standby the mechanism data transmission method and device of a kind of distributed file system | |
| CN105912422A (en) | Data backup method, backup client and data backup system | |
| Jahanian et al. | Graph-based namespaces and load sharing for efficient information dissemination in disasters | |
| Pitkanen et al. | Searching for content in mobile DTNs | |
| CN101651620B (en) | Method for reconstructing Overlay multicast tree, multicast tree node and multicast tree system | |
| Luo et al. | Exploiting intercontact time for routing in delay tolerant networks | |
| WO2013091343A1 (en) | Content acquisition method, device and network system | |
| CN103166860A (en) | Method and device for peer-to-peer (P2P) overlay network data migration | |
| Bozdog et al. | Selectcast: a scalable and self-repairing multicast overlay routing facility | |
| Fesehaye et al. | A Scalable Distributed File System for Cloud Computing | |
| Ripeanu et al. | In search of simplicity: a self‐organizing group communication overlay | |
| CN102497402B (en) | Content injection method and system thereof, and content delivery method and system thereof | |
| Tagami et al. | GreenICN Project: Architecture and applications of green information centric networking | |
| Chilipirea et al. | Social-based routing algorithm for energy preservation in mobile opportunistic networks | |
| Abada et al. | A novel path selection and recovery mechanism for MANETs P2P file sharing applications | |
| CN104506432A (en) | Content request rate aggregation method and cache placement method | |
| CN110650194A (en) | Task execution method based on edge calculation in computer network | |
| Tomimori et al. | A utility based contents sharing method in hybrid peer-to-peer networks with cloud storages | |
| Pavarangkoon et al. | Performance evaluation of high-performance and flexible protocol on data mover challenge | |
| Suganthe et al. | Emergency Health Information and Medical Services in Disaster Areas: A Delay Tolerant Network Approach | |
| Alekseev et al. | Evaluation of a topological distance algorithm for construction of a P2P multicast hybrid overlay tree | |
| Parikh et al. | A survey on peer-to-peer file sharing using network coding in delay tolerant networks | |
| ALMELU et al. | I-ECMR: Improved Erasure Coding Based Multicast Routing in Delay Tolerant Network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |