CN106550016A - A kind of method of the remote copy of gradient distribution transfer rate - Google Patents
A kind of method of the remote copy of gradient distribution transfer rate Download PDFInfo
- Publication number
- CN106550016A CN106550016A CN201610894464.0A CN201610894464A CN106550016A CN 106550016 A CN106550016 A CN 106550016A CN 201610894464 A CN201610894464 A CN 201610894464A CN 106550016 A CN106550016 A CN 106550016A
- Authority
- CN
- China
- Prior art keywords
- data
- remote
- master
- remote copy
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L5/00—Arrangements affording multiple use of the transmission path
- H04L5/003—Arrangements for allocating sub-channels of the transmission path
- H04L5/0058—Allocation criteria
- H04L5/0064—Rate requirement of the data, e.g. scalable bandwidth, data priority
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/61—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources taking into account QoS or priority requirements
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of method of the remote copy of gradient distribution transfer rate, including：The remote copy system of initialization master；Set up by communication protocol with the synchronization system of remote disk and be connected；User configured resource file is read, and different block devices is read based on the different rates corresponding to demand；According to the corresponding obstructed speed of the block device to the block device distribution bandwidth, and transmit data to remote disk；The remote disk receives the data of the master transmission.Realize the division for having gradient is being carried out based on speed to different equipment, so as to just back up in realtime faster than larger data to important data or data volume, the impact caused so as to more can effectively prevent breaking-up master, the transmission of the different rates for different block devices is realized simultaneously, so that important data are backed up in realtime faster, overall efficiency of transmission is improved.
Description
Technical field
The present invention relates to the information communications field, particularly relates to a kind of method of the remote copy of gradient distribution transfer rate.
Background technology
Remote copy is to realize backing up in realtime for block device data, and which is achieved in that and will recover or work for calamitous
Remote disk for backup is matched with master (or logical volume).In the copy procedure of data, until the master that write is given
And remote disk, main frame just receives completing for write operation.Therefore the speed of data transfer is to realize a big bottle of data real time backup
Neck.Reason is to be currently in use main frame and will to be experienced send information to remote site from home site and receive returning for the information
Multiple the spent time is used as the extra write operation time.The data for causing some important can not be backed up in real time.
So for the backup of data brings many inconvenience,
Remote copy is a distributed memory system in Perabytes independent research version kernel accumulation layers, can be with
Block device, shared-file system and data are shared between two Linux servers, remote copy is transported in TCP/IP networks
OK.Remote copy can realize block device, file system and data are shared between two Linux servers.Realizing the present invention
During technical scheme, inventor also has found, remote copy does not have the division of gradient to the transfer rate of data, simply one
Total transfer rate, easily causes obstruction to requiring the big data of transmitted data amount.
The content of the invention
In view of this, it is an object of the invention to propose a kind of method of the remote copy of gradient distribution transfer rate.
A kind of method of the remote copy of gradient distribution transfer rate is provided based on the above-mentioned purpose present invention, including：
The remote copy system of initialization master；
Set up by communication protocol with the synchronization system of remote disk and be connected；
User configured resource file is read, and different block devices is read based on the different rates corresponding to demand；
According to the corresponding obstructed speed of the block device to the block device distribution bandwidth, and transmit data to remote disk；
The remote disk receives the data of the master transmission.
In certain embodiments, the process of the remote copy system of the initialization master includes：
Set up kernel thread, load-on module equipment.
In certain embodiments, also include, the remote disk by communication protocol with opposite end during transmission data is protected
Hold real-time synchronization.
In certain embodiments, the process of the data of the remote disk reception master transmission includes：
The remote copy system of initialization remote disk；
Set up by communication protocol with the master and be connected, and receive the data of the master transmission.
From the above it can be seen that the method that a kind of gradient that the present invention is provided distributes the remote copy of transfer rate,
Including：The remote copy system of initialization master；Set up by communication protocol with the synchronization system of remote disk and be connected；Read user
The resource file of configuration, reads different block devices based on the different rates corresponding to demand；It is corresponding according to the block device
Obstructed speed is to the block device distribution bandwidth, and transmits data to remote disk；The remote disk receives the master transmission
Data.Realize the division for having gradient is being carried out based on speed to different equipment, so as to important data or number
Just can be backed up in realtime faster than larger data according to amount, the shadow caused so as to more can effectively prevent breaking-up master
Ring, while realizing the transmission of the different rates for different block devices so that important data are backed up in realtime faster, improve whole
The efficiency of transmission of body.
Description of the drawings
Flow charts of the Fig. 1 for remote copy is realized in prior art；
Fig. 2 is the schematic diagram of one embodiment of the method for the remote copy of gradient distribution transfer rate of the present invention；
Fig. 3 is the schematic diagram of a preferred embodiment of the method for the remote copy of gradient distribution transfer rate of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention become more apparent, below in conjunction with specific embodiment, and reference
Accompanying drawing, the present invention is described in more detail.
The present invention provides a kind of method of the remote copy of gradient distribution transfer rate, including：
The remote copy system of initialization master；
Set up by communication protocol with the synchronization system of remote disk and be connected；
User configured resource file is read, and different block devices is read based on the different rates corresponding to demand；
According to the corresponding obstructed speed of the block device to the block device distribution bandwidth, and transmit data to remote disk；
The remote disk receives the data of the master transmission.
The method of the remote copy of the gradient distribution transfer rate of the present invention, realizes to different equipment based on speed reality
Row has the division of gradient, so as to just can faster carry out reality than larger data to important data or data volume
When back up, so as to more can effectively prevent from damaging master and the impact that causes, while realizing not synchronized for different block devices
The transmission of rate so that important data are backed up in realtime faster, improves overall efficiency of transmission.
As shown in figure 1, the flow chart for remote copy is realized in prior art.What Service was represented is local service
Equipment, such as pc, disk array etc., what arrow was represented is the transmission direction of data, and the block of the no initializtion that original device is represented sets
Standby, ICP/IP protocol refers to that both-end sets up the network transmission protocol of connection.
From figure 1 it appears that remote copy is by building TCP/IP, connection between both-end server, is set up, so as to
Realize that the mode of data syn-chronization works.Original data transfer mode is only to allow an end equipment to receive write data.Work as number
During according to reaching remote copy module, the transmission of data is transmitted synchronously as two paths：The first passes through I/O scheduler programs, block
Device drives write data into local disk, realize the persistence of data；Its two be by the data to be write for receiving send out
On the trawl performance for sending a portioning local, and passed in the remote copy of an other main frame by ICP/IP protocol, Ling Yitai
Corresponding disk drive on main frame is deposited into the data for receiving in the middle of the disk of oneself again, so as to realize the real-time of data
It is synchronous.And it is exactly the division that remote copy this layer is transmitted speed that the present invention needs to do, so as to realize different blocks
Equipment carries out backing up in realtime for data based on different transfer rates, so as to improve the whole efficiency of remote copy, more can be real-time
Protection data.
As shown in Fig. 2 distributing the signal of one embodiment of the method for the remote copy of transfer rate for gradient of the present invention
Figure.It can be seen that the method for the remote copy of the gradient distribution transfer rate of the present embodiment is comprised the following steps：
Step 201：When master receives write data, the data through file system, and in the master high speed
Remote copy module is entered after caching, the remote copy system of master now, is initialized.
Step 202：Set up by communication protocol with the thorough fare system of remote disk and be connected.
Step 203：User configured resource file is read, and different block devices is read based on not synchronized corresponding to demand
Rate.
Step 204：According to the corresponding obstructed speed of the block device to the block device distribution bandwidth, and transmit data to
Remote disk.
Step 205：The remote disk receives the data of the master transmission.
The method of the remote copy of the gradient distribution transfer rate of the present invention, realizes to different equipment based on speed reality
Row has the division of gradient, so as to just can faster carry out reality than larger data to important data or data volume
When back up, so as to more can effectively prevent from damaging master and the impact that causes, while realizing not synchronized for different block devices
The transmission of rate so that important data are backed up in realtime faster, improves overall efficiency of transmission.
Used as an alternative embodiment of the present invention, the process of the remote copy system of the initialization master includes：
Set up kernel thread, load-on module equipment.
As another alternative embodiment of the invention, also include, during transmission data by communication protocol with
The remote disk of opposite end keeps real-time synchronization.
Again in some other embodiments of the invention, the remote disk receives the process bag of the data of the master transmission
Include：
The remote copy system of initialization remote disk；
Set up by communication protocol with the master and be connected, and receive the data of the master transmission.
As shown in figure 3, distribute a preferred embodiment of the method for the remote copy of transfer rate for gradient of the present invention
Schematic diagram.It can be seen that the method for the remote copy of the gradient distribution transfer rate of the present embodiment is comprised the following steps：
Step 301：When master receives write data, the data through file system, and in the master high speed
Remote copy module is entered after caching, the remote copy system of master now, is initialized.The remote copy of the initialization master
System includes setting up kernel thread and load-on module equipment.
Step 302：Set up by communication protocol with the thorough fare system of remote disk and be connected.Being generally basede on ICP/IP protocol is carried out
Connection.
Step 303：Remote disk initializes remote copy system, and load-on module drives.
Step 304：Remote disk is set up with master by communication protocol and is connected, and this step is corresponding with step 302.
Step 305：User configured resource file is read, and different block devices is read based on not synchronized corresponding to demand
Rate.Different block devices is different to the demand of bandwidth.
Step 306：According to the corresponding obstructed speed of the block device to the block device distribution bandwidth, and transmit data to
Remote disk.Different block devices is different to the demand of bandwidth, big for data volume, require the high block device distribution ratio of transfer rate
Larger bandwidth.The less bandwidth of block device distribution ratio little to data volume, that transfer rate is not required.
Step 307：Master sends the data to remote disk.
Step 308：Remote disk receives the data that master sends.
In the process, remote disk of the master by ICP/IP protocol with opposite end keeps real-time synchronization, until data transfer
Finish.
The method of the remote copy of the gradient distribution transfer rate of the present invention, realizes to different equipment based on speed reality
Row has the division of gradient, so as to just can faster carry out reality than larger data to important data or data volume
When back up, so as to more can effectively prevent from damaging master and the impact that causes, while realizing not synchronized for different block devices
The transmission of rate so that important data are backed up in realtime faster, improves overall efficiency of transmission.
It should be noted that the statement of all uses " first " and " second " is for differentiation two in the embodiment of the present invention
The parameter of the entity or non-equal of individual same names non-equal, it is seen that the convenience of " first " " second " only for statement, should not
The restriction to the embodiment of the present invention is interpreted as, subsequent embodiment is no longer illustrated one by one to this.
Those of ordinary skill in the art should be understood：The discussion of any of the above embodiment is exemplary only, not
It is intended to imply that the scope of the present disclosure (including claim) is limited to these examples；Under the thinking of the present invention, above example
Or can also be combined between the technical characteristic in different embodiments, step can be realized with random order, and is existed such as
Many other changes of the different aspect of the upper described present invention, for simple and clear their no offers in details.
In addition, to simplify explanation and discussing, and in order to obscure the invention, can in the accompanying drawing for being provided
To illustrate or can not illustrate that the known power ground with integrated circuit (IC) chip and other parts is connected.Furthermore, it is possible to
Device is shown in block diagram form, to avoid obscuring the invention, and this have also contemplated that following facts, i.e., with regard to this
The details of the embodiment of a little block diagram arrangements be depend highly on the platform that will implement the present invention (that is, these details should
It is completely in the range of the understanding of those skilled in the art).Elaborating detail (for example, circuit) to describe the present invention's
In the case of exemplary embodiment, it will be apparent to those skilled in the art that these details can not there is no
In the case of or implement the present invention in the case that these details are changed.Therefore, these descriptions are considered as explanation
It is property rather than restricted.
Although invention has been described to have been incorporated with specific embodiment of the invention, according to retouching above
State, many replacements of these embodiments, modification and modification will be apparent for those of ordinary skills.Example
Such as, other memory architectures (for example, dynamic ram (DRAM)) can use discussed embodiment.
Embodiments of the invention be intended to fall within the broad range of claims it is all such replace,
Modification and modification.Therefore, all any omissions within the spirit and principles in the present invention, made, modification, equivalent, improvement
Deng should be included within the scope of the present invention.
Claims (4)
1. a kind of method that gradient distributes the remote copy of transfer rate, it is characterised in that include：
The remote copy system of initialization master；
Set up by communication protocol with the synchronization system of remote disk and be connected；
User configured resource file is read, and different block devices is read based on the different rates corresponding to demand；
According to the corresponding obstructed speed of the block device to the block device distribution bandwidth, and transmit data to remote disk；
The remote disk receives the data of the master transmission.
2. method according to claim 1, it is characterised in that the process bag of the remote copy system of the initialization master
Include：
Set up kernel thread, load-on module equipment.
3. method according to claim 1, it is characterised in that also include, passes through communication protocols during transmission data
View keeps real-time synchronization with the remote disk of opposite end.
4. method according to claim 3, it is characterised in that the remote disk receives the mistake of the data of the master transmission
Journey includes：
The remote copy system of initialization remote disk；
Set up by communication protocol with the master and be connected, and receive the data of the master transmission.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610894464.0A CN106550016A (en) | 2016-10-13 | 2016-10-13 | A kind of method of the remote copy of gradient distribution transfer rate |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610894464.0A CN106550016A (en) | 2016-10-13 | 2016-10-13 | A kind of method of the remote copy of gradient distribution transfer rate |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106550016A true CN106550016A (en) | 2017-03-29 |
Family
ID=58368582
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610894464.0A Pending CN106550016A (en) | 2016-10-13 | 2016-10-13 | A kind of method of the remote copy of gradient distribution transfer rate |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106550016A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113282437A (en) * | 2021-05-27 | 2021-08-20 | 济南浪潮数据技术有限公司 | Dynamic adjustment method, system and device for virtual machine backup speed limit |
| CN114726781A (en) * | 2022-06-01 | 2022-07-08 | 广东睿江云计算股份有限公司 | Two-place high-availability dual-computer method and device, computer equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101414915A (en) * | 2007-10-19 | 2009-04-22 | 英业达股份有限公司 | System and method for processing remote copied send request |
| CN105550073A (en) * | 2016-03-10 | 2016-05-04 | 世纪龙信息网络有限责任公司 | Database backup method and system thereof |
| US20160124655A1 (en) * | 2012-07-16 | 2016-05-05 | International Business Machines Corporation | Automatically Preventing Large Block Writes From Starving Small Block Writes In a Storage Device |
-
2016
- 2016-10-13 CN CN201610894464.0A patent/CN106550016A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101414915A (en) * | 2007-10-19 | 2009-04-22 | 英业达股份有限公司 | System and method for processing remote copied send request |
| US20160124655A1 (en) * | 2012-07-16 | 2016-05-05 | International Business Machines Corporation | Automatically Preventing Large Block Writes From Starving Small Block Writes In a Storage Device |
| CN105550073A (en) * | 2016-03-10 | 2016-05-04 | 世纪龙信息网络有限责任公司 | Database backup method and system thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113282437A (en) * | 2021-05-27 | 2021-08-20 | 济南浪潮数据技术有限公司 | Dynamic adjustment method, system and device for virtual machine backup speed limit |
| CN114726781A (en) * | 2022-06-01 | 2022-07-08 | 广东睿江云计算股份有限公司 | Two-place high-availability dual-computer method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2546624C (en) | Apparatus and method for improved fibre channel oversubscription over transport | |
| US20090010159A1 (en) | End-to-end flow control in a network | |
| CN106487721B (en) | The network equipment and for the message forwarding method in the network equipment | |
| CN102412990B (en) | Remote sensing satellite raw data recording system with centralized management and real-time transmission functions | |
| CN107579791B (en) | Satellite on-orbit remote measurement data real-time monitoring system suitable for unidirectional communication network | |
| CN104991880B (en) | A kind of FC AE ASM Communication Cards based on PCI E interfaces | |
| CN109547456B (en) | Network isolation system with controllable interaction capability based on information unidirectional transmission technology | |
| CN105487990A (en) | Method and device for transmitting information messages between CPU and chip | |
| CN102185833A (en) | Fiber channel (FC) input/output (I/O) parallel processing method based on field programmable gate array (FPGA) | |
| CN106550016A (en) | A kind of method of the remote copy of gradient distribution transfer rate | |
| CN1996993B (en) | A method and system for improving the utilization ratio of back board service bus | |
| CN101478462B (en) | Apparatus and method for storage data reading and writing, solid hard disk | |
| CN104765570A (en) | Storage unit based on PCI-E multi-master share | |
| CN105357260B (en) | Realize system, VDI data cache method and the VDI buffer memory device of virtual desktop | |
| CN109582479A (en) | A kind of OpenDDS distributed communication method based on reflective memory card | |
| CN102917212A (en) | 3G (The 3rd Generation Telecommunication) wireless video monitoring implementation method and 3G wireless video monitoring system based on RTP (Real Time Protocol) and RTSP (Real Time Streaming Protocol) | |
| CN103885910B (en) | The method that many equipment carry out IIC communications under holotype | |
| CN105490818B (en) | A kind of double-unit traction controller network interface card and MVB communication system | |
| CN108011795B (en) | A kind of method and system for realizing more boards and multiple data channel management in communication equipment | |
| CN103248679A (en) | Network message passing method | |
| CN104967482B (en) | Multichannel IO synchronous control systems and method based on fiber optic communication | |
| US20220291976A1 (en) | Message communication between integrated computing devices | |
| CN103369016A (en) | Method for realizing network storage protocol stack based on iSCSI | |
| KR102043658B1 (en) | Apparatus and method for transferring data only in one direction | |
| CN206498417U (en) | Power information Transmission system and its communications router |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170329 |
|
| RJ01 | Rejection of invention patent application after publication |