CN104580518A - Load balance control method used for storage system - Google Patents

Load balance control method used for storage system Download PDF

Info

Publication number
CN104580518A
CN104580518A CN201510045039.XA CN201510045039A CN104580518A CN 104580518 A CN104580518 A CN 104580518A CN 201510045039 A CN201510045039 A CN 201510045039A CN 104580518 A CN104580518 A CN 104580518A
Authority
CN
China
Prior art keywords
disk
node
population
load
sigma
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510045039.XA
Other languages
Chinese (zh)
Inventor
武德安
白铖
吴磊
陈鹏
刘杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHENGDU GKHB INFORMATION TECHNOLOGY Co Ltd
University of Electronic Science and Technology of China
Original Assignee
CHENGDU GKHB INFORMATION TECHNOLOGY Co Ltd
University of Electronic Science and Technology of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CHENGDU GKHB INFORMATION TECHNOLOGY Co Ltd, University of Electronic Science and Technology of China filed Critical CHENGDU GKHB INFORMATION TECHNOLOGY Co Ltd
Priority to CN201510045039.XA priority Critical patent/CN104580518A/en
Publication of CN104580518A publication Critical patent/CN104580518A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a load balance control method used for a storage system. The load balance control method includes steps of (1) encoding by a multi-branch tree structure; (2) randomly generating an initial population comprising a plurality of individuals; (3) determining whether iteration end conditions are met or not, if not, entering a step (4), and if yes, outputting results; (4) calculating adaptability of each individual; (5) selecting the individual of the next step according to a roulette selecting method; (6) subjecting the selected individual to crossover operation; (7) subjecting gene positions of the population to heteromorphosis; (8) removing the individuals with the minimum adaptability in the population, guaranteeing the scale of the population, generating a new population and returning to the step (3). By applying tree code rules to the mapping relation of physical nodes and virtual nodes and redesigning crossover operators and heteromorphosis operators in genetic algorithm, a mapping scheme meeting load balance is obtained, system output, disk utilization efficiency and user access service quality are remarkably improved.

Description

A kind of control method for equalizing load for storage system
Technical field
The present invention relates to a kind of control method for equalizing load for storage system
Background technology
Along with increasing smart machine accessing Internet, cause the data volume on network increasing.Up to the present, on line, data are also with the mode rapid growth of Moore's Law, therefore must bring great challenge for the store and management of data.Distributed storage technology is solution popular at present, by merging the functions such as Clustering, distributed computing technology and file system, realizes the collaborative work between numerous memory device, and externally access distinct device provides unified access module.Distributed memory system is generally made up of physical storage layer, basic platform management level, application-interface layer and user's access layer, and wherein basic management layer is the part storing core.The functions such as basic management layer primary responsibility data storing, redundancy backup, data consistency, load balancing, High Availabitity, the load of its interior joint is a very important module.So-called load imbalance refers to that Data distribution8 between each memory node is uneven, the load imbalance between node will inevitably affect the throughput of system of whole storage system and response time.
Solving load balancing between Mass storage node is efficiently a more difficult problem, and the dynamic data that current mainstream technology comprises based on distributed computing technology is deposited and data tape technology.Such as: document " Ganger G R et al.Disk Subsystem Load Balancing:Disk striping vs Conventionaldata placement [C] .Proceedings of the 26th Hawaii International Conference onSystem Sciences, LosAlamitos:IEEE CS Press, 1993:40-49 " think that traditional dynamic data strategy easily causes disk size to tilt, because it requires to be forced to accept atomic data under quick change access module, thus cause load imbalance, disk tape is finally adopted to be turned to supplementary means, document " R.J.Honicky, E.L.Miller.Replication Under Scalable Hashing:A Family ofAlgorithms for Scalable Decentralized Data Distribution.the18th InternationalParallel and Distributed Processing Symposium (IPDPS2004), Santa Fe, NM, April2004 " propose RUSH race algorithm, based on the Data distribution8 of decentralization, the situation of load imbalance is there is mainly for file system system when increasing or delete data, different RUSH algorithm mutation has different features, respectively with solving different situations, document " Ni Yunzhu, Lv Guanghong, Huang Yanhui. solve based on the disk problem of load balancing [J] of disk-striping strategy by genetic algorithm. Chinese journal of computers " propose and adopt genetic algorithm to solve disk Dynamic Load-Balancing Strategy based on tape technology, mainly have employed tape technology to divide file and the file allocation algorithm for realizing load balancing, and the temperature of disk is analyzed, finally obtains best solution according to genetic algorithm, document " Dong Huanqing, Li Zhanhuai. based on the method [J] of disk load balancing in the RAID disk array of genetic algorithm. computer engineering and application " the IO feature of the logic magnetic disc of RAID disk array is analyzed, analyze according to the mapping between logic magnetic disc and physical disk and loading condition again on this basis, finally carry out load balance process from the inside of memory node, propose one memory node internal data migration fast scheme.
The method that above-mentioned document adopts can realize certain effect, but the high-efficient carrier being all difficult to realize memory node is balanced, is particularly difficult to the load reducing frequent access node.
Summary of the invention
Object of the present invention is just to provide a kind of control method for equalizing load for storage system that can reduce frequent access node load to solve the problem.
The present invention is achieved through the following technical solutions above-mentioned purpose:
For a control method for equalizing load for storage system, comprise the following steps:
(1) according to the mapping feature of system model physical node and dummy node, employing Multiway Tree Structure is encoded, the corresponding one tree of whole system structure, nodes all on the corresponding root node to leaf node path of gene position, root node and level 0 are defined as system, and ground floor represents physical node, and the second layer represents disk, the corresponding disk piecemeal of third layer, the 4th layer of corresponding dummy node;
(2) stochastic generation contains the initial population of several individualities;
(3) determine whether to meet iteration termination condition, if do not met, enter step (4), if met, Output rusults;
(4) according to the fitness of each individuality of following formulae discovery:
F ( s ) = 1 M + N . f ( s )
Wherein, F (s) fitness function, M, N are constant, and f (s) is determined by following formula:
f ( s ) = d ( s ) = 1 MN Σ i = 1 MN ( G ij - AGL ‾ ) 2 = 1 MN Σ i = 1 MN ( G ij - S MN ) 2
Wherein, G ijrepresent the overall load of any one piece of disk in any one physical node, represent the average load of any one piece of disk, S represents total use amount of whole system;
(5) according to next step individuality of roulette selection method choice;
(6) crossing operation is carried out to the individuality selected;
(7) variation process is carried out to the gene position of population;
(8) remove the individuality that in population, fitness is minimum, guarantee the scale of population, produce new population, and return step (3).
Above-mentioned steps (1)-(8) come from genetic algorithm but are different from genetic algorithm, genetic algorithm is that Artificial smart field is for solving a kind of efficient, parallel search heuritic approach of optimization problem, use for reference the natural selection of living nature and natural genetic mechanism, there is the ability of the fast search overall situation.Genetic algorithm simulating nature select and occur in natural genetic process breeding, intersection and gene mutation phenomenon, all retain one group of candidate solution in each iteration, and it is preferably individual from treating to choose selected population by certain index, genetic operator (selection, crossover and mutation) is utilized to combine these individualities, produce the candidate solution group of a new generation, repeat this process, until meet certain convergence index.The present invention utilizes genetic algorithm to produce the solution meeting mapping condition, thus makes the load relative equilibrium of whole storage system.Classical genetic algorithm adopts binary coding, adopts character set 0,1 to form chromosome, to gene direct modeling, but there is mapping error.According to the feature of the corresponding relation of physical node, disk and dummy node, the present invention adopts Multiway Tree Structure to encode.
As preferably, in described step (5), described roulette selection method comprises the following steps:
1. select probability is calculated as follows:
p i = F ( x , i ) Σ j = 1 N F ( x , j )
Wherein, p ithe probability being genetic to colony of future generation for individual i is selected, F (x, i) is the fitness function of individual i;
2. according to select probability, be divided into by disk N number of fan-shaped, each fan-shaped central angle is 2 π p i, in a disk border random selecting reference point, rotary disk, corresponding fan-shaped of final reference point is exactly the individual x be selected i;
3. cumulative x ithe number of times be selected;
2. and 3. N time 4. constantly repeat above-mentioned steps, can individuality be selected.
In described step (6), described crossing operation comprises the following steps:
A, from population, select two intersect individual, be expressed as S 1and S 2;
B, for S iany one physical node, be denoted as namely a vector of physical node, disk and this three of dummy node is represented;
C, P iall mappings are arranged in order according to virtual label order, are expressed as T i;
D, re-establish physical node, relation between disk and dummy node, T ielement be iteratively corresponding in turn to physical node P iall disks in.
In described step (7), described variation refers to that some genic value in individual UVR exposure string is replaced with other genic value by foundation mutation probability, thus the individuality that formation one is new, described variation process comprises the following steps:
A, according to random selection two physical nodes of mutation probability;
B, when ensureing that dummy node mapping position is different, from these two physical nodes, selecting a disk respectively, these two disks are exchanged.
The determination of above-mentioned control method for equalizing load gets based on following analysis:
First, redundant data distribution rule is analyzed:
In present distributed storage system, usually adopt cheap PC to build bottom memory node, node failure is considered as normality, and in supposing the system, M physical node is expressed as P={P 1, P 2,, P m, P i(i≤M) represents i-th physical node, N number of disk on each physical node, P ion disk be expressed as D i={ D i1, D i2..., D iN, D ij(j≤N) represents P ion a jth disk, the storage capacity of each disk is identical, represents with Q.M ithe N of individual physical node ithe use size of block disk is U ij(i≤M, j≤N), each dummy node corresponding L block disk, V i(l < Y), lays respectively at different physical nodes, and every block dish can corresponding multiple dummy node.A lot of storage system, in order to redundancy backup, being selected each data block to keep three parts, in order to reduce the complexity of algorithm, being got L=3.
According to foregoing description, be made up of the disk be positioned on different physical node as long as meet a dummy node, such as, dummy node V iby laying respectively at P 1on D 1N, P 2on D 23and P mon D mnblock disk is formed.Node which disk is made up of actually and decides according to the rule of default and load.
Secondly, physical node disk load analysis:
Consider the size fixation of C that dummy node takies in each disk, so each disk can a corresponding Q/C dummy node.At any one physical node P iany one piece of disk D ija corresponding bitmap T ij, the dummy node that minute book local disk is corresponding, so disk D ijuse size be:
U ij = C &Sigma; k = 0 v k , v k &Element; T ij
The use size of single physical node is the use size sum of each disk, uses PU irepresent:
P U i = &Sigma; j = 0 N U ij = C &Sigma; j = 0 N &Sigma; k = 0 v k
In order to calculate any one disk D ijoverall load, total use amount of whole system must be calculated s:
S = &Sigma; i = 1 M PU i = &Sigma; i = 1 M &Sigma; j = 1 N PU ij = C &Sigma; i = 1 M &Sigma; j = 1 N &Sigma; k = 1 v k
So can calculate the overall load G of any one piece of disk in any one physical node ij:
G ij = U ij S = C &Sigma; k = 0 v k C &Sigma; i = 1 M &Sigma; j = 1 N &Sigma; k = 1 v k = &Sigma; k = 0 v k &Sigma; i = 1 M &Sigma; j = 1 N &Sigma; k = 1 v k
To the average load of any one piece of disk be so
According to above analysis, can determine a kind of standard whether load of the disk of whole storage system is balanced that judges, the mean square deviation of disk is expressed as:
d ( s ) = 1 MN &Sigma; i = 1 MN ( G ij - AGL &OverBar; ) 2 = 1 MN &Sigma; i = 1 MN ( G ij - S MN ) 2
If a kind of mapping scheme can be found, make d (s) minimum, so just can ensure load balancing between node.
To sum up, innovation of the present invention is just to find more reasonably mapping scheme, makes d (s) minimum.
Beneficial effect of the present invention is:
The present invention is by the research and analysis to main flow storage system framework, tree-like coding rule is applied in the mapping relations of physical node and dummy node, redesign the crossover operator in genetic algorithm and mutation operator, finally set up mapping model and Load Balancing Model that a kind of new storage system and genetic algorithm combine, draw a kind of mapping scheme meeting load balancing, and then carry out Data Migration, significantly improve the throughput of system, disk utilization and user's access services quality, solve the problem of load imbalance between storage node in distributed system, save industrial cost.After storage system is used control method for equalizing load of the present invention, the load of memory node can be at equilibrium by optimization, and the access load of all disks changes thereupon, and the load of the node of the frequent access of part reduces greatly.
Accompanying drawing explanation
Fig. 1 is physical node of the present invention, mapping relations schematic diagram between disk and dummy node;
Fig. 2 is the overall memory load schematic diagram of disk in embodiment;
Fig. 3 is iterations contrast schematic diagram in embodiment;
The memory load schematic diagram of disk after innovatory algorithm is introduced when Fig. 4 is β=0.3 in embodiment;
The memory load schematic diagram of disk after innovatory algorithm is introduced when Fig. 5 is β=0.4 in embodiment;
Fig. 6 is the access load schematic diagram of each disk in embodiment;
Fig. 7 is the contrast schematic diagram after the access load before optimization of disk in embodiment.
Embodiment
Below in conjunction with drawings and Examples, the invention will be further described:
The determination of control method for equalizing load of the present invention gets based on following analysis:
First, redundant data distribution rule is analyzed:
As shown in Figure 1, Fig. 1 illustrates physical node, mapping relations between disk and dummy node.In present distributed storage system, usually adopt cheap PC to build bottom memory node, node failure is considered as normality, and in supposing the system, M physical node is expressed as P={P 1, P 2,, P m, P i(i≤M) represents i-th physical node, N number of disk on each physical node, P ion disk be expressed as D i={ D i1, D i2..., D iN, D ij(j≤N) represents P ion a jth disk, the storage capacity of each disk is identical, represents with Q.M ithe N of individual physical node ithe use size of block disk is U ij(i≤M, j≤N), each dummy node corresponding L block disk, V i(l < Y), lays respectively at different physical nodes, and every block dish can corresponding multiple dummy node.A lot of storage system, in order to redundancy backup, being selected each data block to keep three parts, in order to reduce the complexity of algorithm, being got L=3.
According to foregoing description, be made up of the disk be positioned on different physical node as long as meet a dummy node, such as, dummy node V iby laying respectively at P 1on D 1N, P 2on D 23and P mon D mnblock disk is formed.Node which disk is made up of actually and decides according to the rule of default and load.
Secondly, physical node disk load analysis:
Consider the size fixation of C that dummy node takies in each disk, so each disk can a corresponding Q/C dummy node.At any one physical node P iany one piece of disk D ija corresponding bitmap T ij, the dummy node that minute book local disk is corresponding, so disk D ijuse size be:
U ij = C &Sigma; k = 0 v k , v k &Element; T ij
The use size of single physical node is the use size sum of each disk, uses PU irepresent:
P U i = &Sigma; j = 0 N U ij = C &Sigma; j = 0 N &Sigma; k = 0 v k
In order to calculate any one disk D ijoverall load, total use amount S of whole system must be calculated:
S = &Sigma; i = 1 M PU i = &Sigma; i = 1 M &Sigma; j = 1 N PU ij = C &Sigma; i = 1 M &Sigma; j = 1 N &Sigma; k = 1 v k
So can calculate the overall load G of any one piece of disk in any one physical node ij:
G ij = U ij S = C &Sigma; k = 0 v k C &Sigma; i = 1 M &Sigma; j = 1 N &Sigma; k = 1 v k = &Sigma; k = 0 v k &Sigma; i = 1 M &Sigma; j = 1 N &Sigma; k = 1 v k
To the average load of any one piece of disk be so
According to above analysis, can determine a kind of standard whether load of the disk of whole storage system is balanced that judges, the mean square deviation of disk is expressed as:
d ( s ) = 1 MN &Sigma; i = 1 MN ( G ij - AGL &OverBar; ) 2 = 1 MN &Sigma; i = 1 MN ( G ij - S MN ) 2
If a kind of mapping scheme can be found, make d (s) minimum, so just can ensure load balancing between node.
Control method for equalizing load for storage system of the present invention, comprises the following steps:
(1) according to the mapping feature of system model physical node and dummy node, employing Multiway Tree Structure is encoded, the corresponding one tree of whole system structure, nodes all on the corresponding root node to leaf node path of gene position, root node and level 0 are defined as system, and ground floor represents physical node, and the second layer represents disk, the corresponding disk piecemeal of third layer, the 4th layer of corresponding dummy node;
(2) stochastic generation contains the initial population of several individualities;
(3) determine whether to meet iteration termination condition, if do not met, enter step (4), if met, Output rusults;
(4) according to the fitness of each individuality of following formulae discovery:
F ( s ) = 1 M + N . f ( s )
Wherein, F (s) fitness function, M, N are constant, and f (s) is determined by following formula:
f ( s ) = d ( s ) = 1 MN &Sigma; i = 1 MN ( G ij - AGL &OverBar; ) 2 = 1 MN &Sigma; i = 1 MN ( G ij - S MN ) 2
Wherein, G ijrepresent the overall load of any one piece of disk in any one physical node, represent the average load of any one piece of disk, S represents total use amount of whole system;
(5) according to next step individuality of roulette selection method choice, described roulette selection method comprises the following steps:
1. select probability is calculated as follows:
p i = F ( x , i ) &Sigma; j = 1 N F ( x , j )
Wherein, p ithe probability being genetic to colony of future generation for individual i is selected, F (x, i) is the fitness function of individual i;
2. according to select probability, be divided into by disk N number of fan-shaped, each fan-shaped central angle is 2 π p i, in a disk border random selecting reference point, rotary disk, corresponding fan-shaped of final reference point is exactly the individual x be selected i;
3. cumulative x ithe number of times be selected;
2. and 3. N time 4. constantly repeat above-mentioned steps, can individuality be selected;
(6) carry out crossing operation to the individuality selected, described crossing operation comprises the following steps:
A, from population, select two intersect individual, be expressed as S 1and S 2;
B, for S iany one physical node, be denoted as namely a vector of physical node, disk and this three of dummy node is represented;
C, P iall mappings are arranged in order according to virtual label order, are expressed as T i;
D, re-establish physical node, relation between disk and dummy node, T ielement be iteratively corresponding in turn to physical node P iall disks in.
(7) carry out variation process to the gene position of population, described variation refers to that some genic value in individual UVR exposure string is replaced with other genic value by foundation mutation probability, thus the individuality that formation one is new, described variation process comprises the following steps:
A, according to random selection two physical nodes of mutation probability;
B, when ensureing that dummy node mapping position is different, from these two physical nodes, selecting a disk respectively, these two disks are exchanged.
(8) remove the individuality that in population, fitness is minimum, guarantee the scale of population, produce new population, and return step (3).
In order to verify correctness and the validity of control method for equalizing load of the present invention, we carry out applying and testing for the distributed file system of enterprise, and detailed process is as follows:
First set up a distributed storage system, one of them is as host node as hot standby metadata node to adopt two in this system, and four physical nodes are as data memory node, and each node three pieces of hard disks, each hard disk divides the block of size 64MB in logic.Client passes through the back end position and the file storage location that obtain data with host node alternately, then obtains data with back end direct interaction.Every number, according to there being three parts of copies, lays respectively at different physical node.All nodes run Red Hat Enterprise Linux X64 operating system, every platform machine 4G internal memory, every platform machine three pieces of 20G hard disks, Intel I5-2430 2.4GHz CPU.In experiment, add up the loading condition of all disks, as shown in Figure 2.After the load of certain disk reaches threshold values, system processes according to above-mentioned Load Balancing Model automatically, in order to be make above-mentioned algorithm have good convergence, relevant parameter is arranged as follows, in fitness function F (s), M is 1, probability of crossover and mutation probability α, β, from existing knowledge, when α ∈ [0,1], β ∈ (0,1), and the genetic algorithm of adoption rate selection algorithm can obtain globally optimal solution.Algorithm shows different performances when α, β value is different.When α=0.6, when 0.7, the performance of algorithm iteration number of times is as Fig. 3, and by observation experiment result, when β=0.3, when 0.4, iterations is minimum.When β=0.3, α is in value 0.7, and 0.8 uses this algorithm to carry out load balance optimization to system, Supported Comparison after process is as Fig. 4, and when β=0.4, α is in value 0.7,0.8 uses this algorithm to carry out load balance optimization to system, and the Supported Comparison after process is as Fig. 5.By comparison diagram 4 and Fig. 5, when α=0.8, when β=0.3, whole process iterates least number of times, and to the load optimized the best of system storage.Under above-mentioned value scheme, the access load between each disk also can effectively be improved, and Fig. 6 shows the access load of each disk, and Fig. 7 shows each disk access Supported Comparison adopting the method for the invention to optimize front and back.
As from the foregoing, after storage system uses such scheme, the load of memory node can be at equilibrium by optimization, and the access load of all disks changes thereupon, and the load of the node of the frequent access of part reduces greatly.Thus demonstrate correctness and the validity of algorithm herein.
Above-described embodiment is preferred embodiment of the present invention; it is not the restriction to technical solution of the present invention; as long as without the technical scheme that creative work can realize on the basis of above-described embodiment, all should be considered as falling within the scope of the rights protection of patent of the present invention.

Claims (4)

1. for a control method for equalizing load for storage system, it is characterized in that: comprise the following steps:
(1) according to the mapping feature of system model physical node and dummy node, employing Multiway Tree Structure is encoded, the corresponding one tree of whole system structure, nodes all on the corresponding root node to leaf node path of gene position, root node and level 0 are defined as system, and ground floor represents physical node, and the second layer represents disk, the corresponding disk piecemeal of third layer, the 4th layer of corresponding dummy node;
(2) stochastic generation contains the initial population of several individualities;
(3) determine whether to meet iteration termination condition, if do not met, enter step (4), if met, Output rusults;
(4) according to the fitness of each individuality of following formulae discovery:
F ( s ) = 1 M + N . f ( s )
Wherein, F (s) fitness function, M, N are constant, and f (s) is determined by following formula:
f ( s ) = d ( s ) = 1 MN &Sigma; i = 1 MN ( G ij - AGL &OverBar; ) 2 = 1 MN &Sigma; i = 1 MN ( G ij - S MN ) 2
Wherein, G ijrepresent the overall load of any one piece of disk in any one physical node, represent the average load of any one piece of disk, S represents total use amount of whole system;
(5) according to next step individuality of roulette selection method choice;
(6) crossing operation is carried out to the individuality selected;
(7) variation process is carried out to the gene position of population;
(8) remove the individuality that in population, fitness is minimum, guarantee the scale of population, produce new population, and return step (3).
2. the control method for equalizing load for storage system according to claim 1, is characterized in that: in described step (5), and described roulette selection method comprises the following steps:
1. select probability is calculated as follows:
p i = F ( x , i ) &Sigma; j = 1 N F ( x , j )
Wherein, p ithe probability being genetic to colony of future generation for individual i is selected, F (x, i) is the fitness function of individual i;
2. according to select probability, be divided into by disk N number of fan-shaped, each fan-shaped central angle is 2 π p i, in a disk border random selecting reference point, rotary disk, corresponding fan-shaped of final reference point is exactly the individual x be selected i;
3. cumulative x ithe number of times be selected;
2. and 3. N time 4. constantly repeat above-mentioned steps, can individuality be selected.
3. the control method for equalizing load for storage system according to claim 1, is characterized in that: in described step (6), described crossing operation comprises the following steps:
A, from population, select two intersect individual, be expressed as S 1and S 2;
B, for S iany one physical node, be denoted as namely a vector of physical node, disk and this three of dummy node is represented;
C, P iall mappings are arranged in order according to virtual label order, are expressed as T i;
D, re-establish physical node, relation between disk and dummy node, T ielement be iteratively corresponding in turn to physical node P iall disks in.
4. the control method for equalizing load for storage system according to claim 1, it is characterized in that: in described step (7), described variation refers to that some genic value in individual UVR exposure string is replaced with other genic value by foundation mutation probability, thus the individuality that formation one is new, described variation process comprises the following steps:
A, according to random selection two physical nodes of mutation probability;
B, when ensureing that dummy node mapping position is different, from these two physical nodes, selecting a disk respectively, these two disks are exchanged.
CN201510045039.XA 2015-01-29 2015-01-29 Load balance control method used for storage system Pending CN104580518A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510045039.XA CN104580518A (en) 2015-01-29 2015-01-29 Load balance control method used for storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510045039.XA CN104580518A (en) 2015-01-29 2015-01-29 Load balance control method used for storage system

Publications (1)

Publication Number Publication Date
CN104580518A true CN104580518A (en) 2015-04-29

Family

ID=53095675

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510045039.XA Pending CN104580518A (en) 2015-01-29 2015-01-29 Load balance control method used for storage system

Country Status (1)

Country Link
CN (1) CN104580518A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107450855A (en) * 2017-08-08 2017-12-08 山东浪潮云服务信息科技有限公司 A kind of model for distributed storage variable data distribution method and system
CN108243150A (en) * 2016-12-23 2018-07-03 航天星图科技(北京)有限公司 A kind of difunctional processor
CN108632158A (en) * 2017-03-16 2018-10-09 哈尔滨英赛克信息技术有限公司 A kind of multi-controller load-equalizing switch moving method of SDN network
CN113505922A (en) * 2021-07-07 2021-10-15 福州大学 Truss assembly sequence planning method based on parallel tree search
CN115629717A (en) * 2022-12-08 2023-01-20 四川汉唐云分布式存储技术有限公司 Load balancing method based on distributed storage and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102063339A (en) * 2010-12-21 2011-05-18 北京高森明晨信息科技有限公司 Resource load balancing method and equipment based on cloud computing system
CN103118136A (en) * 2013-02-28 2013-05-22 杭州电子科技大学 Load balancing optimizing method based on block level cloud storage
CN103345657A (en) * 2013-04-02 2013-10-09 江苏大学 Task scheduling method based on heredity and ant colony in cloud computing environment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102063339A (en) * 2010-12-21 2011-05-18 北京高森明晨信息科技有限公司 Resource load balancing method and equipment based on cloud computing system
CN103118136A (en) * 2013-02-28 2013-05-22 杭州电子科技大学 Load balancing optimizing method based on block level cloud storage
CN103345657A (en) * 2013-04-02 2013-10-09 江苏大学 Task scheduling method based on heredity and ant colony in cloud computing environment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
余燕芳; 陆军: "基于改进遗传算法的服务器端负载均衡算法", 《微电子学与计算机》 *
倪云竹: "用遗传算法解决基于分条技术的磁盘负载均衡问题", 《中国优秀博硕士学位论文全文数据库 (硕士) 信息科技辑》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108243150A (en) * 2016-12-23 2018-07-03 航天星图科技(北京)有限公司 A kind of difunctional processor
CN108243150B (en) * 2016-12-23 2022-03-18 中科星图股份有限公司 Dual-function processor
CN108632158A (en) * 2017-03-16 2018-10-09 哈尔滨英赛克信息技术有限公司 A kind of multi-controller load-equalizing switch moving method of SDN network
CN107450855A (en) * 2017-08-08 2017-12-08 山东浪潮云服务信息科技有限公司 A kind of model for distributed storage variable data distribution method and system
CN107450855B (en) * 2017-08-08 2020-06-19 浪潮云信息技术有限公司 Model-variable data distribution method and system for distributed storage
CN113505922A (en) * 2021-07-07 2021-10-15 福州大学 Truss assembly sequence planning method based on parallel tree search
CN113505922B (en) * 2021-07-07 2023-08-01 福州大学 Truss assembly sequence planning method based on parallel tree search
CN115629717A (en) * 2022-12-08 2023-01-20 四川汉唐云分布式存储技术有限公司 Load balancing method based on distributed storage and storage medium

Similar Documents

Publication Publication Date Title
CN103699606B (en) A kind of large-scale graphical partition method assembled with community based on summit cutting
CN102063339B (en) Resource load balancing method and equipment based on cloud computing system
CN104580518A (en) Load balance control method used for storage system
Neelakandan et al. Large scale optimization to minimize network traffic using MapReduce in big data applications
CN109447264B (en) Virtual machine placement genetic optimization method based on VHAM-R model in cloud computing environment
Mizrahi et al. Blockchain state sharding with space-aware representations
Moosavian et al. Nondominated sorting differential evolution algorithms for multiobjective optimization of water distribution systems
Guo et al. A data placement strategy based on genetic algorithm in cloud computing platform
Wang et al. Energy-efficient task scheduling model based on MapReduce for cloud computing using genetic algorithm.
Yuxin et al. Overlapping community detection in complex networks using multi-objective evolutionary algorithm
Lin et al. A K-means clustering with optimized initial center based on Hadoop platform
CN110019017B (en) High-energy physical file storage method based on access characteristics
CN106547854A (en) Distributed file system storage optimization power-economizing method based on greedy glowworm swarm algorithm
Xiong et al. SLDP: A novel data placement strategy for large-scale heterogeneous Hadoop cluster
CN110189230B (en) Construction method of analytic model of dynamic partition
Li et al. MR-BIRCH: A scalable MapReduce-based BIRCH clustering algorithm
CN106575296A (en) Dynamic N-dimensional cubes for hosted analytics
Hamedi et al. Developing a method to generate semi-distributed layouts by genetic algorithm
Zhou et al. MDTUpdate: A multi-block double tree update technique in heterogeneous erasure-coded clusters
CN108256694A (en) Based on Fuzzy time sequence forecasting system, the method and device for repeating genetic algorithm
Li [Retracted] Multiparty Coordinated Logistics Distribution Route Optimization Based on Data Analysis and Intelligent Algorithm
CN101378406A (en) Method for selecting data grid copy
CN109343933B (en) Virtual machine initial placement strategy method based on improved genetic algorithm
Chen et al. A non-binary hierarchical tree overlapping community detection based on multi-dimensional similarity
Guan et al. Topological effects on the performance of island model of parallel genetic algorithm

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150429

RJ01 Rejection of invention patent application after publication