CN105610734B - A kind of flow control methods and device - Google Patents
A kind of flow control methods and device Download PDFInfo
- Publication number
- CN105610734B CN105610734B CN201511006226.3A CN201511006226A CN105610734B CN 105610734 B CN105610734 B CN 105610734B CN 201511006226 A CN201511006226 A CN 201511006226A CN 105610734 B CN105610734 B CN 105610734B
- Authority
- CN
- China
- Prior art keywords
- backup
- lun
- quota
- controlled
- total
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/52—Queue scheduling by attributing bandwidth to queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present invention provides a kind of flow control methods and device, applied to storage equipment, the described method includes: in storage equipment, there are when the LUN of backup tasks, statistics has front end primary service flow amount data on the LUN of backup tasks respectively, and it is periodically executed according to preset period of time: calculates the total quota of backup IO according to preset rules, and the total quota of IO will be backed up and be divided into the total quota of controlled LUN backup IO and the total quota of uncontrolled LUN backup IO；It is to there is the LUN of backup tasks to divide backup IO quota according to the total quota of controlled LUN backup IO and the total quota of uncontrolled LUN backup IO；The corresponding LUN for being issued to backup tasks of IO quota will be backed up, so as to there is the LUN of backup tasks to carry out data backup according to the backup IO quota of acquisition.Therefore the present invention can make backup traffic carry out data backup in the case where not influencing main business, thus the case where avoiding backup traffic and main business contention system resource and network bandwidth.
Description
Technical field
The present invention relates to data communication technology field more particularly to a kind of flow control methods and device.
Background technique
Social now, information system has become the important support of social production ability and enterprise's normal operation, and data are then
It is the foundation stone of information system.Due to information system in use often can face various potential threats, such as natural calamity (including
Fire, earthquake, typhoon, tsunami etc.), man-made disaster (such as maloperation, hacker attack etc.) and hardware and software failure, power supply therefore
Barrier etc., therefore the data backup of information system has become the most important thing, the technologies such as mirror image, duplication are all common data backup sides
Method is referred to as backup traffic in the description of the present invention.When disposing backup traffic, will necessarily face backup traffic with forward
The main business contention system resource and network bandwidth of application are held, thus the data transmission bauds of main business is produced bigger effect
Problem.
A kind of common flow control scheme is to realize flow control by backup IO number of concurrent, that is, limitation synchronization allows concurrent
The backup IO maximum number of transmission has sent after the backup IO number not returned reaches the value and has stopped sending new backup IO, directly
Into the backup IO sent, any one return just allows to send next backup IO.In principle, backup IO number of concurrent is higher,
Backup performance is better, and the system resource and network bandwidth of occupancy are more, conversely, backup IO number of concurrent is lower, backup performance is poorer,
The system resource and network bandwidth of occupancy are fewer, therefore, the LUN big for front end main business flow, and simultaneously by limitation backup IO
The case where hair number can alleviate backup traffic and main business contention system resource and network bandwidth to a certain extent.
However, above-mentioned technical proposal is under big specification environment, there are disadvantages:
When front-end business bouncing busy hour, system resource (including CPU, RAID, disk etc.) heavier loads exist standby at this time
Part task and network condition between the production center and Disaster Preparation Center is more satisfactory, backup IO can be returned quickly, and it is concurrent to meet IO
The restrictive condition of degree continues to generate next backup IO, can aggravate the competition of system resource, to be unable to reach expected effect
Fruit.
In addition, backup tasks do not do flow control on the LUN small for front end main business flow, backup tasks occupancy may cause
A large amount of bandwidth resources, so that IO and backup IO competition bandwidth on the big LUN of front-end business flow, to influence front end main business
Flow.
Summary of the invention
In view of this, the present invention provides a kind of flow control methods and device to solve backup traffic competition main business system
The problem of resource and flow bandwidth.
The present invention provides a kind of flow control methods, and the method is applied to storage equipment, which comprises
When storing in equipment there are when the LUN of backup tasks, there is front end master on the LUN of backup tasks described in statistics respectively
Service traffics data, and be periodically executed according to preset period of time:
The total quota of backup IO is calculated according to preset rules, and the total quota of backup IO is divided into controlled LUN backup IO
Total quota and the total quota of uncontrolled LUN backup IO；
It is described to have backup tasks according to the total quota of the controlled LUN backup IO and the total quota of uncontrolled LUN backup IO
LUN divides backup IO quota；
The LUN for there are backup tasks is issued to by the backup IO quota is corresponding, so that described there are backup tasks
LUN carries out data backup according to the backup IO quota of acquisition.
Further, described to calculate the total quota of backup IO according to preset rules, and the total quota of backup IO is divided into
The method of the controlled total quota of LUN backup IO and the total quota of uncontrolled LUN backup IO includes:
It is retrieved as the preconfigured total flow quota of all backup tasks；
According to preset rules judge described in there is the LUN of backup tasks to be controlled LUN or uncontrolled in current time period
LUN；
If controlled LUN is not present in current time period, the total quota of backup IO is equal to total flow quota；It is described
The total quota of uncontrolled LUN backup IO is equal to the total quota of backup IO；
If the total quota of backup IO is equal to total flow quota multiplied by pre- there are controlled LUN in current time period
The backup global traffic percentage first configured；The total quota of the controlled LUN backup IO is equal to the total quota of backup IO multiplied by pre-
The controlled LUN flow percentage first configured；The total quota of the uncontrolled LUN backup IO is equal to the total quota of backup IO and subtracts institute
State the total quota of controlled LUN backup IO.
Further, it is described according to preset rules judge described in have the LUN of backup tasks be in current time period by
Control LUN or uncontrolled LUN method include:
It is retrieved as the preconfigured service traffics threshold value of LUN of backup tasks；
There are primary service flow amount data in front end on the LUN of backup tasks described in acquisition；
Compare that described there are the LUN of backup tasks on front end primary service flow amount data whether be more than or equal to described to there is backup times
The preconfigured service traffics threshold value of the LUN of business, if it is, the LUN is controlled LUN；If it is not, then the LUN is uncontrolled
LUN。
Further, it is described for have the preconfigured service traffics threshold value of the LUN of backup tasks include: bandwidth and/or
IOPS。
Further, described according to the controlled total quota of LUN backup IO and the total quota of uncontrolled LUN backup IO is described
Have backup tasks LUN divide backup IO quota method include:
If controlled LUN is not present in current time period, the backup IO quota of the uncontrolled LUN is equal to described
The total quota of uncontrolled LUN backup IO is divided by the uncontrolled LUN sum；
If there are controlled LUN in current time period, the backup IO quota of the controlled LUN is equal to described controlled
The total quota of LUN backup IO is divided by the controlled LUN sum；The backup IO quota of the uncontrolled LUN is equal to described uncontrolled
The total quota of LUN backup IO is divided by the uncontrolled LUN sum.
Further, the method that the LUN for having backup tasks carries out data backup according to the backup IO quota of acquisition
Include:
The LUN for having backup tasks is according to the backup IO sent on the backup IO quota control of the distribution LUN
Number, when the backup IO number sent in this time cycle reaches the backup IO quota, which stops sending backup
IO, until next measurement period recalculates the backup IO quota.
Based on identical design, the present invention also provides a kind of volume control device, described device is applied to storage equipment, institute
Stating device includes:
Traffic statistics unit has primary service flow amount data in front end on the LUN of backup tasks for counting；
Quota computing unit, for calculating the total quota of backup IO, the total quota of controlled LUN backup IO and non-according to preset rules
The total quota of controlled LUN backup IO；
Quota division unit, for being according to the controlled total quota of LUN backup IO and the total quota of uncontrolled LUN backup IO
The LUN for having backup tasks divides backup IO quota；
Quota issuance unit is issued to the LUN for having backup tasks for corresponding to the multiple backup IO quota；
Standby control unit, for carrying out data backup according to the backup IO quota of acquisition.
Further, the quota computing unit, comprising:
Quota obtains subelement, for being retrieved as the preconfigured total flow quota of all backup tasks；
Controlled judgment sub-unit, for according to preset rules judge described in have the LUN of backup tasks in current time period
It is inside controlled LUN or uncontrolled LUN；
First computation subunit, when for controlled LUN to be not present in current time period, described total quota of backup IO etc.
In total flow quota；The total quota of the uncontrolled LUN backup IO is equal to the total quota of backup IO；
Second computation subunit, for, there are when controlled LUN, the total quota of backup IO to be equal in current time period
Total flow quota is multiplied by preconfigured backup global traffic percentage；The total quota of the controlled LUN backup IO is equal to described standby
Part total quota of IO is multiplied by preconfigured controlled LUN flow percentage；The total quota of the uncontrolled LUN backup IO is equal to described standby
Part total quota of IO subtracts the total quota of the controlled LUN backup IO.
Further, the controlled judgment sub-unit, the preconfigured industry of LUN specifically for being retrieved as backup tasks
Business flow threshold；There are primary service flow amount data in front end on the LUN of backup tasks described in acquisition；There are backup tasks described in comparing
It is to have the preconfigured service traffics threshold of the LUN of backup tasks that whether the upper front end primary service flow amount data of LUN, which are more than or equal to described,
Value, if it is, the LUN is controlled LUN；If it is not, then the LUN is uncontrolled LUN.
Further, it is described for have the preconfigured service traffics threshold value of the LUN of backup tasks include: bandwidth and/or
IOPS。
Further, the quota division unit, when being specifically used for that controlled LUN is not present in current time period, institute
The backup IO quota for stating uncontrolled LUN is equal to the total quota of the uncontrolled LUN backup IO divided by the uncontrolled LUN sum；
There are when controlled LUN in current time period, the backup IO quota of the controlled LUN is equal to the controlled LUN backup IO
Total quota is divided by the controlled LUN sum；The backup IO quota of the uncontrolled LUN is equal to the uncontrolled LUN backup IO
Total quota is divided by the uncontrolled LUN sum.
Further, the Standby control unit, specifically for described in the backup IO quota control according to distribution
The backup IO number for thering is the LUN of backup tasks to send, when the backup IO number sent in this time cycle reaches the backup
When IO quota, there is the LUN of backup tasks to stop sending backup IO described in control, until next measurement period recalculates institute
State backup IO quota.
It can be seen that the present invention has a front end main business data on flows on the LUN of backup tasks by statistics, and according to when
Between the period judge whether there is controlled LUN, when there are controlled LUN, the backup of all LUN for having backup tasks will be lowered in time
The total quota of IO, more network bandwidth is occupied to avoid backup IO；Meanwhile the backup IO quota of controlled LUN is lowered in time, with
Backup IO occupying system resources on controlled LUN are avoided, primary service flow amount in front end on controlled LUN is influenced；On this basis, backup control
Unit processed controls the backup IO number of transmission according to the time cycle, after quickly returning to avoid backup IO, continues to send next
A backup IO, the case where causing backup IO excessive, occupy a large amount of system resources and network bandwidth.Meanwhile it being followed by the time cycle
Ring processing, can adjust stream interface driver according to current front end main business traffic conditions, so that the effect of stream interface driver reaches in real time
To best.By the invention it is possible to make backup traffic carry out data backup in the case where not influencing main business, to avoid standby
The case where part business and main business contention system resource and flow bandwidth.
Detailed description of the invention
Fig. 1 is the information system structure figure in the embodiment of the present invention；
Fig. 2 is a kind of process flow diagram of flow control methods in the embodiment of the present invention；
Fig. 3 is the process flow diagram of another flow control methods in the embodiment of the present invention；
Fig. 4 is the structural schematic diagram of the storage equipment in the embodiment of the present invention where volume control device；
Fig. 5 is a kind of structural schematic diagram of volume control device in the embodiment of the present invention.
Specific embodiment
Referring to Figure 1, it is information system structure figure in the embodiment of the present invention, includes wherein for giving birth in the information system
Produce main equipment, the alternate device for backup production data, multiple storage equipment for storing data of data.Each storage
It may include multiple logical resource LUN that may be performed simultaneously main business and backup traffic in equipment, wherein main business refers to master
Equipment obtains the business that data are supplied to the application server of front end from storage equipment；Backup traffic refers to that alternate device can be with
By modes such as mirror image or duplications, the data in main business are backuped to the business of storage facilities.In traditional information system, by
Limited data transfer bandwidth in storage equipment, therefore when storage equipment executes main business and backup traffic at the same time, meeting
There is the case where backup traffic seizes the system resource and flow bandwidth of main business, to influence the normal operation of main business.
It in order to solve the problems in the existing technology, can be with the present invention provides a kind of flow control methods and device
By counting the front end main business data on flows having on the LUN of backup tasks, and judge whether there is according to the time cycle controlled
LUN will lower in time the total quota of backup IO of all LUN for having backup tasks, to avoid backup IO when there are controlled LUN
Occupy more network bandwidth；Meanwhile the backup IO quota of controlled LUN is lowered in time, it is accounted for avoid backup IO on controlled LUN
With system resource, primary service flow amount in front end on controlled LUN is influenced；On this basis, Standby control unit comes according to the time cycle
The backup IO number sent is controlled, after quickly being returned to avoid backup IO, continues to send next backup IO, leads to backup IO mistake
It is more, the case where occupying a large amount of system resources and network bandwidth.It, can be according to current meanwhile by time cycle circular treatment
Front end main business traffic conditions adjust stream interface driver in real time, so that the effect of stream interface driver reaches best.By the invention it is possible to
Backup traffic is set to carry out data backup in the case where not influencing main business, to avoid backup traffic and main business contention system
The case where resource and flow bandwidth.
Fig. 2 is referred to, is the process flow diagram of one of embodiment of the present invention flow control methods, this method can answer
For storing equipment, this method comprises:
When, there are when the LUN of backup tasks, which can count described respectively has backup to appoint in storage equipment
Front end main business data on flows on the LUN of business, and following steps are periodically executed according to preset period of time:
Step 201 calculates the total quota of backup IO according to preset rules, and the total quota of backup IO is divided into controlled
The total quota of LUN backup IO and the total quota of uncontrolled LUN backup IO；
In the present embodiment, by taking current time period as an example, storage equipment can calculate the backup in storage equipment first
Then the total quota of backup IO is divided into the total quota of controlled LUN backup IO and uncontrolled LUN backup IO always matches by the total quota of IO
Volume.
In optional embodiment of the present invention, storing in equipment storage equipment available first is that all backup tasks are pre-
The total flow quota first configured, that is, the maximum quota of backup IO.Then according to preset rules judge described in have backup tasks
LUN be controlled LUN or uncontrolled LUN in current time period.
For example, storage equipment is available to there is the preconfigured service traffics threshold value of the LUN of backup tasks, and
Primary service flow amount data in front end on the LUN for having backup tasks；Then relatively more described to have front end main business on the LUN of backup tasks
It is to have the preconfigured service traffics threshold value of the LUN of backup tasks that whether business data on flows, which is more than or equal to described,；If described have
It is to have the preconfigured business of the LUN of backup tasks that primary service flow amount data in front end, which are more than or equal to described, on the LUN of backup tasks
Flow threshold, it may be considered that the LUN for having backup tasks is controlled LUN；If front end on the LUN for having backup tasks
It is to have the preconfigured service traffics threshold value of the LUN of backup tasks that main business data on flows, which is not more than and is equal to described, then can recognize
It is uncontrolled LUN for the LUN for having backup tasks.It should be noted that the storage equipment usually can by bandwidth and/or
IOPS (Input/Output Operations Per Second, the number per second for being written and read I/O operation) is in advance described
There is the service traffics threshold value of the LUN configuration of backup tasks.
When judgement complete all LUN for having backup tasks be in current time period controlled LUN or uncontrolled LUN it
Afterwards, the total quota of backup IO further can be divided by the total quota of controlled LUN backup IO and uncontrolled according to judging result
The total quota of LUN backup IO.
In optional embodiment of the present invention, if controlled LUN is not present in current time period, the backup IO is total
Quota is equal to total flow quota；The total quota of the uncontrolled LUN backup IO is equal to the total quota of backup IO；If current time
Cycle memory is in controlled LUN, then the total quota of backup IO is equal to total flow quota multiplied by preconfigured backup global traffic
Percentage, wherein the backup global traffic percentage can guarantee to reduce backup IO maximum quota there are when controlled LUN；Then
The total quota of the controlled LUN backup IO is equal to the total quota of backup IO multiplied by preconfigured controlled LUN flow percentage,
Described in controlled LUN flow percentage can guarantee that there are the total quotas of backup IO for when controlled LUN, controlling controlled LUN；It is described non-
The total quota of controlled LUN backup IO is equal to the total quota of backup IO and subtracts the total quota of the controlled LUN backup IO.Therefore the present invention
The total quota of backup IO that when there are controlled LUN, can lower all LUN for having backup tasks in time, accounts for avoid backup IO
With more network bandwidth, and the total quota of backup IO of uncontrolled LUN be equivalent to storage equipment execute it is remaining other than main business
The total quota of backup IO, therefore can guarantee to store the bandwidth that will not influence main business when equipment executes backup traffic.
Step 202, according to the total quota of the controlled LUN backup IO and the total quota of uncontrolled LUN backup IO be it is described have it is standby
The LUN of part task divides backup IO quota；
In the present embodiment, storage equipment can be further according to the controlled total quota of LUN backup IO and uncontrolled LUN
The total quota of backup IO is that the LUN for having backup tasks divides backup IO quota.
For example, if controlled LUN is not present in current time period, backup IO of the uncontrolled LUN matches
Volume is equal to the total quota of the uncontrolled LUN backup IO divided by the uncontrolled LUN sum；If exist in current time period by
LUN is controlled, then it is total divided by the controlled LUN to be equal to the total quota of the controlled LUN backup IO for the backup IO quota of the controlled LUN
Number；The backup IO quota of the uncontrolled LUN is equal to the total quota of the uncontrolled LUN backup IO divided by the uncontrolled LUN
Sum.Therefore when there are controlled LUN, the backup IO quota of controlled LUN is lowered, in time to avoid IO is backed up on controlled LUN
Occupying system resources influence primary service flow amount in front end on controlled LUN.
Step 203 is issued to the LUN for having backup tasks for the backup IO quota is corresponding so that it is described have it is standby
The LUN of part task carries out data backup according to the backup IO quota of acquisition.
In the present embodiment, corresponding be issued to of the backup IO quota described can be had backup to appoint by the storage equipment
In the LUN of business.The LUN for having backup tasks can have backup tasks according to the backup IO quota control of distribution
The backup IO number sent on LUN.And match when the backup IO number sent in this time cycle reaches backup IO
When volume, control has the LUN of backup tasks to stop sending backup IO, until next measurement period recalculates backup IO
Quota.
It can be seen that the present invention has a front end main business data on flows on the LUN of backup tasks by statistics, and according to when
Between the period judge whether there is controlled LUN, when there are controlled LUN, the backup of all LUN for having backup tasks will be lowered in time
The total quota of IO, more network bandwidth is occupied to avoid backup IO；Meanwhile the backup IO quota of controlled LUN is lowered in time, with
Backup IO occupying system resources on controlled LUN are avoided, primary service flow amount in front end on controlled LUN is influenced；On this basis, backup control
Unit processed controls the backup IO number of transmission according to the time cycle, after quickly returning to avoid backup IO, continues to send next
A backup IO, the case where causing backup IO excessive, occupy a large amount of system resources and network bandwidth.Meanwhile it being followed by the time cycle
Ring processing, can adjust stream interface driver according to current front end main business traffic conditions, so that the effect of stream interface driver reaches in real time
To best.By the invention it is possible to make backup traffic carry out data backup in the case where not influencing main business, to avoid standby
The case where part business and main business contention system resource and flow bandwidth.
With reference to the accompanying drawing, the specific embodiment of flow control methods provided by the invention is described in detail.
In the application scenarios of Fig. 1, it is assumed that the LUN for having backup tasks in storage equipment is respectively LUN1, LUN2, LUN3,
The storage equipment carries out the process of background traffic control as shown in figure 3, its treatment process includes:
Step 301 is retrieved as the preconfigured total flow quota of all backup tasks；
Step 302, to have the LUN of backup tasks be controlled LUN or uncontrolled LUN in current time period for judgement；
In the present embodiment, storage equipment relatively more described one by one can have primary service flow amount in front end on the LUN of backup tasks
It is to have the preconfigured service traffics threshold value of the LUN of backup tasks that whether data, which are more than or equal to described,.Assuming that storage equipment is to have
The preconfigured service traffics threshold value of the LUN of backup tasks is 10, the upper front end LUN1, LUN2, LUN3 for having backup tasks
Main business data on flows is respectively 4,6,12；Then by comparing, it is known that the front end main business data on flows of LUN1, LUN2 are less than industry
Therefore the front end main business data on flows of business flow threshold, LUN3 is greater than service traffics threshold value, LUN1, LUN2 are uncontrolled LUN,
LUN3 is controlled LUN.
Step 303 calculates the total quota of backup IO, and the total quota of backup IO is divided into controlled LUN backup IO and is always matched
Volume and the total quota of uncontrolled LUN backup IO；
Since there are controlled LUN in current time period, then the total quota of backup IO is equal to total flow quota multiplied by pre-
The backup global traffic percentage first configured；The total quota of the controlled LUN backup IO is equal to the total quota of backup IO multiplied by pre-
The controlled LUN flow percentage first configured；The total quota of the uncontrolled LUN backup IO is equal to the total quota of backup IO and subtracts institute
State the total quota of controlled LUN backup IO.
Assuming that total flow quota is 100, backup global traffic percentage is 80%, and controlled LUN flow percentage is 20%,
It then backs up IO and always configures and be equal to total flow quota 100 multiplied by preconfigured backup global traffic percentage 80%, i.e. 100*
80%=80.The total quota of the controlled LUN backup IO is equal to the total quota 80 of the backup IO and flows multiplied by preconfigured controlled LUN
Measure percentage 20%, i.e. 80*20%=16.The total quota of the uncontrolled LUN backup IO is equal to the total quota 80 of the backup IO and subtracts
Remove the controlled total quota 16 of LUN backup IO, i.e. 80-16=64.
Step 304 divides backup IO quota for the LUN for having backup tasks；
Since LUN1, LUN2 are uncontrolled LUN, LUN3 is controlled LUN, and the total quota of controlled LUN backup IO is 16, uncontrolled
Total quota is 64, therefore the backup IO quota of uncontrolled LUN is 64/2=32, i.e. the backup IO quota of LUN1, LUN2 are equal
It is 32；The backup IO quota of controlled LUN is 16, i.e. the backup IO quota of LUN3 is 16.
Step 305 is issued to the LUN for having backup tasks for the backup IO quota is corresponding so that it is described have it is standby
The LUN of part task carries out data backup according to the backup IO quota of acquisition.
Storage equipment will back up that IO quota is corresponding to be issued on LUN1, LUN2 and LUN3 so that LUN1, LUN2 and
LUN3 is according to the backup IO number sent on the backup IO quota control of the distribution LUN, when having sent out in this time cycle
When the backup IO number sent reaches the backup IO quota, which stops sending backup IO, until next measurement period weight
Newly calculate the backup IO quota.
Based on identical design, the present invention also provides a kind of volume control device, described device is applied to control equipment, institute
Stating device can also be realized by software realization by way of hardware or software and hardware combining.Taking software implementation as an example,
Volume control device of the invention as the device on a logical meaning, is deposited by the CPU reading of storage equipment where it
It is run after corresponding computer program instructions in reservoir.
Fig. 4 and Fig. 5 is please referred to, a kind of volume control device 500 provided in the embodiment of the present invention, described device is applied to
Equipment is stored, basic running environment includes CPU, memory and other hardware, from logic level, described device
500 include:
Traffic statistics unit 501 has primary service flow amount data in front end on the LUN of backup tasks for counting；
Quota computing unit 502, for calculating the total quota of backup IO, the total quota of controlled LUN backup IO according to preset rules
With the total quota of uncontrolled LUN backup IO；
Quota division unit 503, for always being matched according to the controlled total quota of LUN backup IO and uncontrolled LUN backup IO
Volume preset strategy is that the LUN for having backup tasks divides backup IO quota；
Quota issuance unit 504, for corresponding be issued to of the multiple backup IO quota described to be had backup tasks
LUN；
Standby control unit 505, for carrying out data backup according to the backup IO quota of acquisition.
Optionally, the quota computing unit 502, comprising:
Quota obtains subelement 5021, for being retrieved as the preconfigured total flow quota of all backup tasks；
Controlled judgment sub-unit 5022, for according to preset rules judge described in have the LUN of backup tasks in current time
It is controlled LUN or uncontrolled LUN in period；
First computation subunit 5023, when for controlled LUN to be not present in current time period, the backup IO always matches
Volume is equal to total flow quota；The total quota of the uncontrolled LUN backup IO is equal to the total quota of backup IO；
Second computation subunit 5024, in current time period there are when controlled LUN, the total quota of backup IO
Equal to total flow quota multiplied by preconfigured backup global traffic percentage；The total quota of the controlled LUN backup IO is equal to institute
The total quota of backup IO is stated multiplied by preconfigured controlled LUN flow percentage；The total quota of the uncontrolled LUN backup IO is equal to institute
It states the total quota of backup IO and subtracts the total quota of the controlled LUN backup IO.
Optionally, the controlled judgment sub-unit 5022, it is preconfigured specifically for the LUN that is retrieved as backup tasks
Service traffics threshold value；There are primary service flow amount data in front end on the LUN of backup tasks described in acquisition；There are backup tasks described in comparing
It is to have the preconfigured service traffics threshold of the LUN of backup tasks that whether the upper front end primary service flow amount data of LUN, which are more than or equal to described,
Value, if it is, the LUN is controlled LUN；If it is not, then the LUN is uncontrolled LUN.
Optionally, described for have the preconfigured service traffics threshold value of the LUN of backup tasks include: bandwidth and/or IOPS.
Optionally, the quota division unit 503, when being specifically used for that controlled LUN is not present in current time period, institute
The backup IO quota for stating uncontrolled LUN is equal to the total quota of the uncontrolled LUN backup IO divided by the uncontrolled LUN sum；
There are when controlled LUN in current time period, the backup IO quota of the controlled LUN is equal to the controlled LUN backup IO
Total quota is divided by the controlled LUN sum；The backup IO quota of the uncontrolled LUN is equal to the uncontrolled LUN backup IO
Total quota is divided by the uncontrolled LUN sum.
Optionally, the Standby control unit 505, specifically for described in the backup IO quota control according to distribution
The backup IO number for thering is the LUN of backup tasks to send, when the backup IO number sent in this time cycle reaches the backup
When IO quota, there is the LUN of backup tasks to stop sending backup IO described in control, until next measurement period recalculates institute
State backup IO quota.
It can be seen that the present invention has a front end main business data on flows on the LUN of backup tasks by statistics, and according to when
Between the period judge whether there is controlled LUN, when there are controlled LUN, the backup of all LUN for having backup tasks will be lowered in time
The total quota of IO, more network bandwidth is occupied to avoid backup IO；Meanwhile the backup IO quota of controlled LUN is lowered in time, with
Backup IO occupying system resources on controlled LUN are avoided, primary service flow amount in front end on controlled LUN is influenced；On this basis, backup control
Unit processed controls the backup IO number of transmission according to the time cycle, after quickly returning to avoid backup IO, continues to send next
A backup IO, the case where causing backup IO excessive, occupy a large amount of system resources and network bandwidth.Meanwhile it being followed by the time cycle
Ring processing, can adjust stream interface driver according to current front end main business traffic conditions, so that the effect of stream interface driver reaches in real time
To best.By the invention it is possible to make backup traffic carry out data backup in the case where not influencing main business, to avoid standby
The case where part business and main business contention system resource and flow bandwidth.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.
Claims (8)
1. a kind of flow control methods, which is characterized in that the method is applied to storage equipment, which comprises
When storing in equipment there are when the LUN of backup tasks, there is front end main business on the LUN of backup tasks described in statistics respectively
Data on flows, and be periodically executed according to preset period of time:
The total quota of backup IO is calculated according to preset rules, and the total quota of backup IO is divided into controlled LUN backup IO and is always matched
Volume and the total quota of uncontrolled LUN backup IO；
It is that the LUN for having backup tasks is drawn according to the total quota of the controlled LUN backup IO and the total quota of uncontrolled LUN backup IO
Divide backup IO quota；
The LUN for having backup tasks is issued to by the backup IO quota is corresponding so that the LUN for having backup tasks by
Data backup is carried out according to the backup IO quota of acquisition；
It is described to calculate the total quota of backup IO according to preset rules, and the total quota of backup IO is divided into controlled LUN backup IO
Always the method for quota and the total quota of uncontrolled LUN backup IO includes:
It is retrieved as the preconfigured total flow quota of all backup tasks；
According to preset rules judge described in there is the LUN of backup tasks to be controlled LUN or uncontrolled LUN in current time period；
If controlled LUN is not present in current time period, the total quota of backup IO is equal to total flow quota；It is described it is non-by
It controls the total quota of LUN backup IO and is equal to the total quota of backup IO；
If the total quota of backup IO is equal to total flow quota multiplied by matching in advance there are controlled LUN in current time period
The backup global traffic percentage set；The total quota of the controlled LUN backup IO is equal to the total quota of backup IO multiplied by matching in advance
The controlled LUN flow percentage set；The total quota of the uncontrolled LUN backup IO be equal to the total quota of backup IO subtract described in by
Control the total quota of LUN backup IO；
It is described according to preset rules judge described in there is the LUN of backup tasks to be controlled LUN or uncontrolled in current time period
The method of LUN includes:
It is retrieved as the preconfigured service traffics threshold value of LUN of backup tasks；
There are primary service flow amount data in front end on the LUN of backup tasks described in acquisition；
Compare that described to have the LUN of backup tasks on whether front end primary service flow amount data are more than or equal to described be there are backup tasks
The preconfigured service traffics threshold value of LUN, if it is, the LUN is controlled LUN；If it is not, then the LUN is uncontrolled LUN.
2. the method as described in claim 1, which is characterized in that
It is described for have the preconfigured service traffics threshold value of the LUN of backup tasks include: bandwidth and/or IOPS.
3. the method as described in claim 1, which is characterized in that it is described according to the total quota of the controlled LUN backup IO and it is non-by
The control total quota of LUN backup IO is that the method that the LUN for having backup tasks divides backup IO quota includes:
If controlled LUN is not present in current time period, the backup IO quota of the uncontrolled LUN be equal to it is described it is non-by
The total quota of LUN backup IO is controlled divided by the uncontrolled LUN sum；
If there are controlled LUN in current time period, the backup IO quota of the controlled LUN is equal to the controlled LUN
The total quota of backup IO is divided by the controlled LUN sum；The backup IO quota of the uncontrolled LUN is equal to the uncontrolled LUN
The total quota of backup IO is divided by the uncontrolled LUN sum.
4. the method as described in claim 1, which is characterized in that the LUN for having backup tasks according to acquisition backup IO
Quota carry out data backup method include:
The LUN for having backup tasks according to the backup IO number sent on the backup IO quota control of the distribution LUN,
When the backup IO number sent in this time cycle reaches the backup IO quota, which stops sending backup IO, directly
The backup IO quota is recalculated to next measurement period.
5. a kind of volume control device, which is characterized in that described device is applied to storage equipment, and described device includes:
Traffic statistics unit has primary service flow amount data in front end on the LUN of backup tasks for counting；
Quota computing unit, for calculating the total quota of backup IO, the total quota of controlled LUN backup IO and uncontrolled according to preset rules
The total quota of LUN backup IO；
Quota division unit, for being described according to the controlled total quota of LUN backup IO and the total quota of uncontrolled LUN backup IO
There is the LUN of backup tasks to divide backup IO quota；
Quota issuance unit is issued to the LUN for having backup tasks for corresponding to the multiple backup IO quota；
Standby control unit, for carrying out data backup according to the backup IO quota of acquisition；
The quota computing unit, comprising:
Quota obtains subelement, for being retrieved as the preconfigured total flow quota of all backup tasks；
Controlled judgment sub-unit, for according to preset rules judge described in there is the LUN of backup tasks to be in current time period
Controlled LUN or uncontrolled LUN；
First computation subunit, when for controlled LUN to be not present in current time period, the total quota of backup IO is equal to total
Flow quota；The total quota of the uncontrolled LUN backup IO is equal to the total quota of backup IO；
Second computation subunit, for, there are when controlled LUN, the total quota of backup IO to be equal to total stream in current time period
Quota is measured multiplied by preconfigured backup global traffic percentage；The total quota of the controlled LUN backup IO is equal to the backup IO
Total quota is multiplied by preconfigured controlled LUN flow percentage；The total quota of the uncontrolled LUN backup IO is equal to the backup IO
Total quota subtracts the total quota of the controlled LUN backup IO；
The controlled judgment sub-unit, the preconfigured service traffics threshold value of LUN specifically for being retrieved as backup tasks；It obtains
There are primary service flow amount data in front end on the LUN of backup tasks described in taking；There is front end main business on the LUN of backup tasks described in comparing
It is described to there is the preconfigured service traffics threshold value of the LUN of backup tasks whether data on flows is more than or equal to, if it is, should
LUN is controlled LUN；If it is not, then the LUN is uncontrolled LUN.
6. device as claimed in claim 5, which is characterized in that
It is described for have the preconfigured service traffics threshold value of the LUN of backup tasks include: bandwidth and/or IOPS.
7. device as claimed in claim 5, which is characterized in that
The quota division unit, when being specifically used for that controlled LUN is not present in current time period, the uncontrolled LUN's
Backup IO quota is equal to the total quota of the uncontrolled LUN backup IO divided by the uncontrolled LUN sum；In current time period
When inside there is controlled LUN, the backup IO quota of the controlled LUN is equal to the total quota of the controlled LUN backup IO divided by described
Controlled LUN sum；The backup IO quota of the uncontrolled LUN is equal to the total quota of the uncontrolled LUN backup IO divided by described
Uncontrolled LUN sum.
8. device as claimed in claim 5, which is characterized in that the Standby control unit, specifically for the institute according to distribution
The backup IO number for having the LUN of backup tasks to send described in backup IO quota control is stated, when what is sent in this time cycle
When backup IO number reaches the backup IO quota, there is the LUN of backup tasks to stop sending backup IO described in control, under
One measurement period recalculates the backup IO quota.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511006226.3A CN105610734B (en) | 2015-12-28 | 2015-12-28 | A kind of flow control methods and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511006226.3A CN105610734B (en) | 2015-12-28 | 2015-12-28 | A kind of flow control methods and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105610734A CN105610734A (en) | 2016-05-25 |
| CN105610734B true CN105610734B (en) | 2018-12-25 |
Family
ID=55990276
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511006226.3A Active CN105610734B (en) | 2015-12-28 | 2015-12-28 | A kind of flow control methods and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105610734B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101217561A (en) * | 2008-01-15 | 2008-07-09 | 杭州华三通信技术有限公司 | A method to enhance the storage reliability of the network and a network device |
| WO2010068377A2 (en) * | 2008-11-17 | 2010-06-17 | Unisys Corporation | Simultaneous state-based cryptographic splitting in a secure storage appliance |
| CN103647723A (en) * | 2013-12-26 | 2014-03-19 | 深圳市迪菲特科技股份有限公司 | Method and system for monitoring flow |
| CN103744808A (en) * | 2013-12-31 | 2014-04-23 | 百度在线网络技术（北京）有限公司 | Method and device used for controlling I/O (Input/Output) request |
-
2015
- 2015-12-28 CN CN201511006226.3A patent/CN105610734B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101217561A (en) * | 2008-01-15 | 2008-07-09 | 杭州华三通信技术有限公司 | A method to enhance the storage reliability of the network and a network device |
| WO2010068377A2 (en) * | 2008-11-17 | 2010-06-17 | Unisys Corporation | Simultaneous state-based cryptographic splitting in a secure storage appliance |
| CN103647723A (en) * | 2013-12-26 | 2014-03-19 | 深圳市迪菲特科技股份有限公司 | Method and system for monitoring flow |
| CN103744808A (en) * | 2013-12-31 | 2014-04-23 | 百度在线网络技术（北京）有限公司 | Method and device used for controlling I/O (Input/Output) request |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105610734A (en) | 2016-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200364608A1 (en) | Communicating in a federated learning environment | |
| US9027028B2 (en) | Controlling the use of computing resources in a database as a service | |
| US8996647B2 (en) | Optimizing storage between mobile devices and cloud storage providers | |
| KR101826969B1 (en) | Burst mode control | |
| CN108170768A (en) | database synchronization method, device and readable medium | |
| US9596189B1 (en) | Virtual machine management | |
| CN108023967B (en) | Data balancing method and device and management equipment in distributed storage system | |
| US10884667B2 (en) | Storage controller and IO request processing method | |
| CN106233269A (en) | Fine granulation bandwidth supply in Memory Controller | |
| WO2018082302A1 (en) | Writing request response method and apparatus | |
| US9984139B1 (en) | Publish session framework for datastore operation records | |
| US10148531B1 (en) | Partitioned performance: adaptive predicted impact | |
| US10142195B1 (en) | Partitioned performance tracking core resource consumption independently | |
| WO2017107812A1 (en) | User log storage method and device | |
| WO2016008338A1 (en) | I/o request processing method and storage system | |
| CN105357042A (en) | High-availability cluster system, master node and slave node | |
| CN106970841A (en) | A kind of resource constraint and dynamic adjusting method based on cloud computing | |
| CN113553179A (en) | Distributed key value storage load balancing method and system | |
| CN105915626B (en) | A kind of data copy initial placement method towards cloud storage | |
| US10033620B1 (en) | Partitioned performance adaptive policies and leases | |
| CN105610734B (en) | A kind of flow control methods and device | |
| CN105591964A (en) | Device and method for overload protection for Internet system | |
| CN105867848B (en) | A kind of information processing method and hard disk mould group | |
| CN104679589A (en) | System resource balance adjustment method and device | |
| US20160274793A1 (en) | Storage apparatus, storage control method, and computer-readable recording medium for recording storage control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Hangzhou City, Zhejiang Province, Binjiang District West Street 310053 Qianmo Road No. 482 building eleventh layer to the twelfth layer A Applicant after: Hangzhou Sequoia Polytron Technologies Inc Address before: Hangzhou City, Zhejiang Province, Binjiang District West Street 310053 Qianmo Road No. 482 building eleventh layer to the twelfth layer A Applicant before: Hangzhou MacroSAN Technologies Co., Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |