CN106326252A - Data processing method and apparatus for database - Google Patents
Data processing method and apparatus for database Download PDFInfo
- Publication number
- CN106326252A CN106326252A CN201510355202.2A CN201510355202A CN106326252A CN 106326252 A CN106326252 A CN 106326252A CN 201510355202 A CN201510355202 A CN 201510355202A CN 106326252 A CN106326252 A CN 106326252A
- Authority
- CN
- China
- Prior art keywords
- data
- data block
- temperature parameter
- server
- block server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method for a database. The method comprises the steps of obtaining a first data block server with maximum data flow and a second data block server with minimum data flow in data block servers; obtaining a first data block with maximum data flow in data blocks corresponding to the first data block server, and a second data block with minimum data flow in data blocks corresponding to the second data block server; and interchanging a data request in the first data block and a data processing request in the second data block. The invention furthermore discloses a data processing apparatus for the database. According to the method and the apparatus, the data flow between the data block servers in the database is more balanced, and the performance and working efficiency of the database are improved.
Description
Technical field
The present invention relates to technical field of data storage, particularly relate to a kind of data base data processing method and
Device.
Background technology
Along with social networking application platform and the continuous appearance of ecommerce class internet, applications, indicate that people are
Through stepping into the life epoch of higher level.In the case of this mass data, height concurrently access, data base
Be provided that stable, reliable performance it is critical that.But traditional data base can not meet this
The problem of big data, under this technical background, distributed data base arises at the historic moment.HBase is point
A NoSQL (Not only Structured Query in cloth system infrastructure Hadoop
Language, non-relation object data base) realization, be also distributed, opening towards row simultaneously
Source database.It provide powerful extensibility and data manipulation performance.In HBase, along with table
Record data are continuously increased and gradually split into and be ultimately formed into data block, and different data blocks can quilt
Host assignment is managed to corresponding data block server data block server.
But, in actual application, usually can be because of the load imbalance of data block server or every
Service number of requests in individual data block server is unbalanced, and a large amount of reading and writing request concentrates on a few number
According in a few data blocks of block server so that HBase cannot carry out Business Processing, Jin Erying in time
Ring the performance of HBase, cause the inefficiency of HBase；Even, concentrate in a large amount of reading and writing request
When a few data block servers, it is likely to result in data block server and delays machine, now, HBase meeting
Reading and writing request is transferred to other data block server, and then other data block service may be caused
The machine of delaying continuously of device, the business ultimately resulting in reading and writing request corresponding is interrupted completely.
Summary of the invention
The present invention provides data processing method and the device of a kind of data base, it is intended to solve in HBase a large amount of
Reading and writing request concentrates on and causes the HBase cannot in a few data blocks of a few data block servers
Carry out the technical problem of Business Processing in time.
For achieving the above object, the data processing method of a kind of data base that the present invention provides, described data
The data processing method in storehouse comprises the following steps:
Obtain the first data block server and data stream that in each data block server, data traffic is maximum
The second data block server that amount is minimum；
Obtain the first data that the data traffic in each data block that the first data block server is corresponding is maximum
The second number that in block, and each data block corresponding to described second data block server, data traffic is minimum
According to block；
Request of data in described first data block is exchanged with the data processing request in the second data block.
Preferably, the first data block service that in each data block server of described acquisition, data traffic is maximum
The step of the second data block server of device and data traffic minimum includes:
The flow parameter of data block in acquisition Preset Time, wherein, described flow parameter includes the number of write
According to flow and/or the data traffic of reading；
Obtain the history temperature parameter of locality parameter corresponding to the flow parameter of described data block, data block
And the distributed constant of data block server；
Calculate based on described flow parameter, locality parameter, history temperature parameter and distributed constant and obtain institute
State the temperature parameter of data block server；
Using data block server maximum for temperature parameter as the first data block server, and by temperature parameter
Minimum data block server is as the second data block server.
Preferably, the data traffic in each data block that described acquisition the first data block server is corresponding
Data stream in the first maximum data block, and each data block corresponding to described second data block server
Before the step of the second data block that amount is minimum, described method also includes:
Obtain the first temperature parameter and the second of the second data block server of described first data block server
Temperature parameter；
Determine that whether the described first temperature parameter the first difference with described second temperature parameter is more than presetting threshold
Value；
When the first difference of described first temperature parameter with described second temperature parameter is more than predetermined threshold value,
Perform that data traffic in each data block that described acquisition the first data block server is corresponding is maximum first
That in data block, and each data block corresponding to described second data block server, data traffic is minimum
The step of two data blocks.
Preferably, the first temperature parameter and the second data block clothes of described first data block server are being obtained
Second temperature parameter of business device determines the of described first temperature parameter and described second temperature parameter with described
Between whether one difference is more than the step of predetermined threshold value, described method also includes:
Determine that whether the first temperature parameter of described first data block server is more than preset heat；
Described first data block server the first temperature parameter more than preset heat time, perform described really
Whether the first difference of fixed described first temperature parameter and described second temperature parameter is more than the step of predetermined threshold value
Suddenly.
Data traffic in each data block that the most described acquisition the first data block server is corresponding is maximum
The first data block, and in each data block corresponding to described second data block server data traffic is
The step of the second little data block with described by the request of data in described first data block and the second data block
In data processing request exchange step between, described method also includes:
Plan for adjustment is generated, wherein, in plan for adjustment based on described first data block and the second data block
The configuration parameter of described data base is by the request of data in described first data block and the second data block
The temperature parameter of each data block server after data processing request exchange and the data block of correspondence thereof are corresponding
Flow parameter；
Obtain temperature parameter is maximum in plan for adjustment the 3rd data block server and temperature parameter is minimum
4th data block server, and obtain the 3rd temperature parameter and the 4th number of described 3rd data block server
The 4th temperature parameter according to block server；
Determine that whether described 3rd temperature parameter and the second difference of described 4th temperature parameter are more than described pre-
If threshold value；
When described second difference is more than described predetermined threshold value, obtain corresponding each of the 3rd data block server
The 3rd data block that data traffic in individual data block is maximum, and described 4th data block server is corresponding
Each data block in minimum the 4th data block of data traffic；
Described by the data processing request in the request of data in described first data block and the second data block
After the step exchanged, described method also includes:
The data processing request of the request of data of described 3rd data block with the 4th data block is exchanged.
Additionally, for achieving the above object, the present invention also provides for the data processing equipment of a kind of data base, institute
The data processing equipment stating data base includes:
First acquisition module, for obtaining the first data that in each data block server, data traffic is maximum
Block server and the second data block server of data traffic minimum；
Second acquisition module, for obtaining the data in each data block that the first data block server is corresponding
Number in first data block of maximum flow, and each data block corresponding to described second data block server
According to the second data block that flow is minimum；
First Switching Module, for by the request of data in described first data block and the second data block
Data processing request is exchanged.
Preferably, the first acquisition module includes:
First acquiring unit, the flow parameter of data block in obtaining Preset Time, wherein, described stream
Amount parameter includes data traffic and/or the data traffic of reading of write；
Second acquisition unit, for obtaining locality parameter corresponding to the flow parameter of described data block, number
History temperature parameter and the distributed constant of data block server according to block；
Computing unit, for based on described flow parameter, locality parameter, history temperature parameter and distribution
Parameter calculates the temperature parameter obtaining described data block server；
Unit is set, for the data block server that temperature parameter is maximum as the first data block server,
And using data block server minimum for temperature parameter as the second data block server.
Preferably, the data processing equipment of described data base also includes:
3rd acquisition module, for obtaining the first temperature parameter and second of described first data block server
Second temperature parameter of data block server；
First determines module, for determining the first of described first temperature parameter and described second temperature parameter
Whether difference is more than predetermined threshold value；
Described second acquisition module is additionally operable in the of described first temperature parameter and described second temperature parameter
When one difference is more than predetermined threshold value, obtain the data in each data block that the first data block server is corresponding
Number in first data block of maximum flow, and each data block corresponding to described second data block server
According to the second data block that flow is minimum.
Preferably, the data processing equipment of described data base also includes:
Second determines module, for determining that the first temperature parameter of described first data block server is the biggest
In preset heat；
Described first determines module to be additionally operable in the first temperature parameter of described first data block server is more than
During preset heat, determine that described first temperature parameter is the biggest with the first difference of described second temperature parameter
In predetermined threshold value.
Preferably, the data processing equipment of described data base also includes:
Generation module, is used for based on described first data block and the second data block generation plan for adjustment, wherein,
The configuration parameter of the described data base in plan for adjustment is by the request of data in described first data block and the
The temperature parameter of each data block server after data processing request exchange in two data blocks and correspondence thereof
Flow parameter corresponding to data block；
4th acquisition module, for obtaining the 3rd data block server that in plan for adjustment, temperature parameter is maximum
And the 4th data block server that temperature parameter is minimum, and obtain the of described 3rd data block server
Three temperature parameters and the 4th temperature parameter of the 4th data block server；
3rd determines module, for determining the second of described 3rd temperature parameter and described 4th temperature parameter
Whether difference is more than described predetermined threshold value；
5th acquisition module, for when described second difference is more than described predetermined threshold value, obtains the 3rd number
According to the 3rd data block that the data traffic in each data block that block server is corresponding is maximum, and described the
The 4th data block that in each data block that four data block servers are corresponding, data traffic is minimum；
Second Switching Module, for the data by the request of data of described 3rd data block with the 4th data block
The request of process is exchanged.
In the present invention, the data traffic in first data block server maximum by obtaining data traffic is
That in the first big data block and minimum the second data block server of data traffic, data traffic is minimum
Two data blocks, then exchange the request of data in the first data block and the request of data in the second data block；
Achieve the exchange of the request of data of the first data block and the data processing request of the second data block so that the
Data traffic between one data block server and the second data block server more equalizes, and then makes data
Storehouse can process the business that the request of data of the first data block is corresponding in time, efficiently avoid data base
Exist the flow parameter of data block excessive time cause data block server to delay machine, improve the performance of data base
And work efficiency.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the data processing method first embodiment of data base of the present invention；
Fig. 2 is the refinement that the present invention obtains the step of the first data block server and the second data block server
Schematic flow sheet；
Fig. 3 is the schematic flow sheet of data processing method second embodiment of data base of the present invention；
Fig. 4 is the schematic flow sheet of data processing method the 3rd embodiment of data base of the present invention；
Fig. 5 is the high-level schematic functional block diagram of the data processing equipment first embodiment of data base of the present invention；
Fig. 6 is the refinement high-level schematic functional block diagram of computing module in Fig. 5；
Fig. 7 is the high-level schematic functional block diagram of data processing equipment second embodiment of data base of the present invention；
Fig. 8 is the high-level schematic functional block diagram of data processing equipment the 3rd embodiment of data base of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, do referring to the drawings further
Explanation.
Detailed description of the invention
Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not used to limit
Determine the present invention.
The present invention provides the data processing method of a kind of data base.
Schematic flow sheet with reference to the data processing method first embodiment that Fig. 1, Fig. 1 are data base of the present invention.
In the present embodiment, the data processing method of this data base includes:
Step S10, obtain the first maximum data block server of data traffic in each data block server with
And the second data block server that data traffic is minimum；
In the present embodiment, each data block server of data base increases a set of read-write pressure acquisition clothes
The data traffic of each data block server in business, periodically collection Preset Time, during it is then determined that preset
First data block server of interior data traffic maximum and the second data block service of data traffic minimum
Device；A set of read-write pressure acquisition can also be increased in the data block of each data block server of data base
In service, periodically collection Preset Time, the data traffic of each data block, then calculates data block service
The data traffic of device, then determine the first data block server and number that data traffic is maximum in Preset Time
According to the second data block server that flow is minimum.
Step S20, obtains data traffic in each data block that the first data block server is corresponding maximum
In first data block, and each data block corresponding to described second data block server, data traffic is minimum
The second data block；
The first data block i.e. got is the data block that in the first data block server, data traffic is maximum,
The second data block got is the data block that in the second data block server, data traffic is minimum；Easily reason
Solve, when obtaining the first data block and the second data block, if the first data block server exists two
Data block that data traffic is identical and maximum or the second data block server exist two data traffic phases
Same and minimum data block, then determine the first data block or the second data block according to the line unit of data block.
Certainly, if the first data block belongs to unit's meta table or name space nameSpace table, then terminate
The follow-up flow process of the present embodiment, i.e. need not when the first data block belongs to meta table or nameSpace table
Carry out the exchange of request of data with the second data block, because the read-write of meta table or nameSpace table is visited
Ask comparatively small, i.e. meta table or the data traffic of nameSpace table write and/or the data traffic of reading,
The most mobile the two internal system table in the case of read-write portfolio is less can be effectively prevented from.
Step S30, the request of data in described first data block being processed with the data in the second data block please
Ask exchange.
Wherein, the write that in the request of data in the first data block is Preset Time, the first data block reception arrives
The process request of data and/or reading data, in the data processing request in the second data block is Preset Time
Write data and/or the process of reading data that second data block reception arrives are asked；Number by the first data block
It is arranged in the second data block according to request, the data processing request of the second data block is arranged on the first data
On block so that the data traffic of the first data block write and/or the data traffic of reading are write with the second data block
The data traffic entered and/or the exchange of the data traffic of reading, and then reduce the first data block server
Temperature parameter, improve the temperature parameter of the second data block server so that the data block service of data base
The data traffic of device more equalizes.
In the present embodiment, hand over the request of data of the second data block in the request of data of the first data block
After alternatively, based on the database information in the update data of database storehouse after adjusting, including more new data block
The data traffic of write and/or the data traffic information of reading, and the friendship of request of data between data block
Change information etc..
In the present embodiment, data base is HBase, and data block server is in HBase
RegionServe, data block is the Region in RegionServe.
In the present embodiment, the data traffic in first data block server maximum by obtaining data traffic
Data traffic minimum in second data block server of the first maximum data block and data traffic minimum
Second data block, then exchanges the request of data in the first data block and the request of data in the second data block；
Achieve the exchange of the request of data of the first data block and the data processing request of the second data block so that the
Data traffic between one data block server and the second data block server more equalizes, and then makes data
Storehouse can process the business that the request of data of the first data block is corresponding in time, efficiently avoid data base
Exist the flow parameter of data block excessive time cause data block server to delay machine, improve the performance of data base
And work efficiency.
It is that the present invention obtains the first data block server and the step of the second data block server with reference to Fig. 2, Fig. 2
Rapid refinement schematic flow sheet.
The refinement flow embodiment of step S10 of the present invention is proposed based on first embodiment, in the present embodiment,
Step S10 includes:
Step S11, the flow parameter of data block in acquisition Preset Time, wherein, described flow parameter includes
The data traffic of write and/or the data traffic of reading；
The data traffic of write refers to the data package size summation that all of write request of data block is corresponding, number
According to the size summation of packet corresponding to all of read requests of block, therefore, data in Preset Time are obtained
The flow parameter of block specifically refer to obtain data package size summation corresponding to all of write request of data block and/
Or the size summation of packet corresponding to all of read requests of data block.Certainly, data in Preset Time
The flow parameter of block can periodically obtain, it is also possible to obtains according to prefixed time interval.The present embodiment
In, the data block at each data block server data block server of data base increases a set of read-write pressure
Gather service, periodically the flow of the reading and writing of each data block in collection Preset Time.
Step S12, obtains locality parameter corresponding to the flow parameter of described data block, the history of data block
Temperature parameter and the distributed constant of data block server；
Wherein, locality parameter LocalPercent that the flow parameter of described data block is corresponding refers to data block
The data of write and/or the locality ratio weight of the data of reading, the data of data block write and/or reading
Data in the ratio data that occupies of data block server belonging to this data block, its span is [0,1].
History temperature parameter HistoryPercent of data block refers to the history temperature trend power of this data block
Weight, its span is [0,1], (by parameter configuration, gives tacit consent to 3 according to X nearest in this data block
Individual) slope of curve trend of history cycle access request is calculated, and wherein, the biggest explanation of slope accesses please
Ask and present the trend that forward increases always.
The distributed constant TablePercent of data block server refers to the equiblibrium mass distribution rate of table Table, several
Equiblibrium mass distribution rate according to Table corresponding to the data block of block server.
Step S13, based on described flow parameter, locality parameter, history temperature parameter and distributed constant meter
Calculate the temperature parameter obtaining described data block server；
The computing formula of the temperature parameter of data block server is:
HotScorer=∑ [(1-α) × LastQualityScorer+ α × CurQualityScorer] × (1/LocalPerc
ent)×(1+HistorySlope)×(1+TablePerCent)
In formula, LastQualityScorer is data block data traffic in last Preset Time and/or reading
Data traffic, CurQualityScorer is the flow parameter of data block in the current preset time；α represents
The temperature weighted value of the data block of this data block server last, its span is [0,1], as arranged
Becoming 0 is exactly that the temperature not considering the last time accesses, and generally, the value of α is 0.5, represents simultaneously
Take into account the temperature in this data block and last data block temperature.
Step S14, using data block server maximum for temperature parameter as the first data block server, and will
The data block server of temperature parameter minimum is as the second data block server.
Temperature parameter according to data block server is by data block server maximum for temperature parameter in data base
It is set to the first data block server, the data block server that temperature parameter in data base is minimum is set to
Two data block servers.Certainly, described first data block server and the second data block server are being obtained
During, if data base exists two temperature parameters the hottest identical data block servers or two
The coldest data block server that temperature parameter is identical, then according to the machine name canonical ordering of data block server
It is preceding as the first data block server or the second data block server that order carries out selecting sequence.
In the present embodiment, according to the flow parameter got, locality parameter, history temperature parameter and point
Cloth parameter calculates the temperature parameter obtaining data block server, then by data block clothes maximum for temperature parameter
Business device is as the first data block server, and is counted as second by data block server minimum for temperature parameter
According to block server, and then ensure that the first data block server and the second data block server are respectively number
According to the hottest data block server and the coldest data block server in storehouse, and then improve the first data block
With the accuracy of the second data block, further increase performance and the work efficiency of data base.
Schematic flow sheet with reference to data processing method the second embodiment that Fig. 3, Fig. 3 are data base of the present invention.
Second embodiment of the data processing method of data base of the present invention, this reality are proposed based on the second embodiment
Executing in example, before step S20, the data processing method of data base also includes:
Step S40, obtains the first temperature parameter and the second data block service of described first data block server
Second temperature parameter of device；
The temperature parameter of data block server obtains the first data block server the first temperature parameter and
Second temperature parameter of the second data block server.
Step S50, determines that described first temperature parameter is the biggest with the first difference of described second temperature parameter
In predetermined threshold value；
From above-described embodiment, the first temperature parameter be more than the second temperature parameter, the first temperature parameter with
The first difference that is first temperature parameter of the second temperature parameter deducts the difference of the second temperature parameter and is more than zero,
Predetermined threshold value is temperature ginseng between data block server the hottest in data base and the coldest data block server
The maximum of number, the first difference in the first temperature parameter with described second temperature parameter is more than predetermined threshold value
Time, need the data block of data block and the coldest data block server balancing the hottest data block server.
When the first difference of described first temperature parameter with described second temperature parameter is more than predetermined threshold value,
Perform that data traffic in each data block that described acquisition the first data block server is corresponding is maximum first
That in data block, and each data block corresponding to described second data block server, data traffic is minimum
The step of two data blocks.
I.e. step S20 replaces with: poor with the first of described second temperature parameter in described first temperature parameter
When value is more than predetermined threshold value, obtain the data traffic in each data block that the first data block server is corresponding
Data stream in the first maximum data block, and each data block corresponding to described second data block server
The second data block that amount is minimum.
In the present embodiment, preset by being more than in the first difference of the first temperature parameter with the second temperature parameter
During threshold value, perform to obtain the of the first data block of the first data block server and the second data block server
The step of two data blocks, it is to avoid the first temperature parameter and the second temperature parameter the first difference not less than
Carry out the request of data of the first data block and the request of data of the second data block during predetermined threshold value, and then avoid
The data traffic of data block server in unnecessary balance database, further increases the property of data base
Energy and work efficiency.
Schematic flow sheet with reference to data processing method the 3rd embodiment that Fig. 4, Fig. 4 are data base of the present invention.
3rd embodiment of the data processing method of data base of the present invention, this reality are proposed based on the 3rd embodiment
Executing in example, between step S40 and step S50, the data processing method of this data base also includes:
Step S60, determines that whether the first temperature parameter of described first data block server is more than presetting heat
Degree；
In the present embodiment, can be that the data block server in data base arranges corresponding preset heat, tool
Body, when the temperature parameter of data block server is not less than preset heat, represent this data block server
Data block in the ability to bear processed not less than himself data, i.e. this data block server need not into
Row balanced adjustment, it is readily appreciated that, determining that the first temperature parameter of the first data block server is more than presetting
During temperature, represent that the data-handling capacity of the first data block server has exceeded the ability to bear of himself,
Need to be carried out with the data block in other data block servers by the data block in the first data block server
Adjust, with the data traffic of data block server in balance database.At the first data block server
When one temperature parameter is not less than preset heat, now the first data block server not less than himself data at
The ability to bear of reason, therefore, it can terminate the flow process of the present embodiment.
Described first data block server the first temperature parameter more than preset heat time, perform described really
Whether the first difference of fixed described first temperature parameter and described second temperature parameter is more than the step of predetermined threshold value
Suddenly.
I.e. step S50 replaces with, and the first temperature parameter at described first data block server is more than to be preset
During temperature, determine that whether described first temperature parameter and the first difference of described second temperature parameter are more than pre-
If threshold value.
In the present embodiment, whether it is determined by the first temperature parameter of the first data block server more than presetting
Temperature, then the first temperature parameter more than preset heat time, perform determine described first temperature parameter with
First difference of the second temperature parameter is more than the step of predetermined threshold value, and then determines the first data block server
It is adjusted with the data block in other data block servers the need of by its data block, keeps away further
Exempt from the data traffic of data block server in unnecessary balanced adjustment data base, improve the effect of data base
Rate.
4th embodiment of the data processing method of data base of the present invention, this reality are proposed based on above-described embodiment
Executing in example, between step S20 and step S30, the data processing method of this data base also includes:
Plan for adjustment is generated, wherein, in plan for adjustment based on described first data block and the second data block
The configuration parameter of described data base is by the request of data in described first data block and the second data block
The temperature parameter of each data block server after data processing request exchange and the data block of correspondence thereof are corresponding
Flow parameter；
I.e. assume that the request of data in the first data block has been exchanged with the request of data in the second data block,
The data traffic of the first data block of the i.e. first data block server counts with the second of the second data block server
Exchange according to the data traffic of block, generated according to the configuration parameter of the data base after having exchanged and adjust meter
Draw, certainly, the first data block server and the temperature parameter of the second data block server in plan for adjustment
For the temperature parameter after recalculating, to avoid the first data block server and the second data block server
During for obtaining temperature parameter is maximum or minimum in data base data block server after exchange, mistake occurs.
Obtain temperature parameter is maximum in plan for adjustment the 3rd data block server and temperature parameter is minimum
4th data block server, and obtain the 3rd temperature parameter and the 4th number of described 3rd data block server
The 4th temperature parameter according to block server；
Determine that whether described 3rd temperature parameter and the second difference of described 4th temperature parameter are more than described pre-
If threshold value；
Certainly, the 3rd temperature parameter of described 3rd data block server and described 4th data block are being determined
Second difference of the 4th temperature parameter of server is more than before predetermined threshold value, it is also possible to first determine described the
The temperature parameter of three data block servers is more than preset heat, to avoid in unnecessary balance database
Data traffic between data block server.
When described second difference is more than described predetermined threshold value, obtain corresponding each of the 3rd data block server
The 3rd data block that data traffic in individual data block is maximum, and described 4th data block server is corresponding
Each data block in minimum the 4th data block of data traffic；
Described by the data processing request in the request of data in described first data block and the second data block
After the step exchanged, described method also includes:
The described request of data of the 3rd data block is swapped with the data processing request of the 4th data block.
The request of data of the 3rd data block is arranged in the 4th data block, at the data of the 4th data block
Reason request is arranged in the 3rd data block so that the data traffic of the 3rd data block write and/or the number of reading
The data traffic write according to flow and the 4th data block and/or the exchange of the data traffic of reading.
It is of course also possible in the request of data by the request of data of described 3rd data block Yu the 4th data block
Update balancing programme based on the 3rd data block and the 4th data block before the step swapped, continue cycling through
Judge the absolute value that whether there is the difference of two temperature parameters in the data base data block clothes more than predetermined threshold value
Business device, continues above-mentioned steps, until the absolute value of the difference that there are not two temperature parameters in data base is more than
The data block server of predetermined threshold value, then according to balancing programme carries out the link exchange of data block successively,
The data traffic between each data block server of data base is made more to equalize.Easy to understand, due to number
The business that there is second level according to storehouse when the link carrying out data block exchanges is suspended, and therefore, carries out link every time
The data block of exchange can not be too many, affects Consumer's Experience to avoid long business to suspend.
In the present embodiment, by determining, based on plan for adjustment, the 3rd data block server that temperature parameter is maximum
And the 4th data block server that temperature parameter is minimum, then determining that the second difference is preset more than described
During threshold value, determine the 3rd data block and the 4th data that in the 3rd data block server, data traffic is maximum
The 4th data block that in block server, data traffic is minimum, finally exchanges the 3rd data after step S30
The request of data of block and the data processing request of the 4th data block；Achieve the data of the 3rd data block write
The data traffic of flow and/or reading with the 4th data block write data traffic and/or the data stream of reading
The exchange of amount, and then the temperature reducing the 3rd data block server improves the 4th data block service simultaneously
The temperature of device so that the data traffic between the 3rd data block server and the 4th data block server is more
Equilibrium, enables data base to process the business that the request of data of the 3rd data block is corresponding in time, effectively keeps away
Exempt to cause the 3rd data block server to delay when the flow parameter that data base exists the 3rd data block is excessive
Machine, further increases performance and the work efficiency of data base.
Certainly, the data processing method of data base is also based on table and carries out load balance, and its flow process includes:
Obtain data traffic and/or the data traffic of reading that the table in data base writes, data based on table write
The data traffic of flow and/or reading calculates and obtains the hottest table and the coldest table；Judge writing of the hottest table
Whether the data traffic entered and/or the data traffic of reading exceed the load heat degree threshold of this table；The hottest
When the data traffic of the write of table and/or the data traffic of reading exceed load heat degree threshold, obtain in this table
The hottest data block and the coldest table in the coldest data block, then by the number of the hottest data block
The link corresponding with the request of data of the coldest data block according to the link that request is corresponding swaps.Certainly,
The flow process carrying out load balance based on table table can also be circulated execution according to the mode of above-described embodiment,
Realize the parallel migration of data block in multiple tables, compare the data block migration in data block server, this
Kind of load balancing manner based on table is few at " hotlist ", " cold table " a lot of in the case of be relatively suitable for,
Hotlist refers to that the data traffic of this table exceedes the load temperature threshold values of this table.
The present invention further provides the data processing equipment of a kind of data base.
Functional module with reference to the data processing equipment first embodiment that Fig. 5, Fig. 5 are data base of the present invention is shown
It is intended to.
In the present embodiment, the data processing equipment of this data base includes:
First acquisition module 10, for obtaining the first number that data traffic in each data block server is maximum
According to the second data block server that block server and data traffic are minimum；
In the present embodiment, each data block server of data base increases a set of read-write pressure acquisition clothes
The data traffic of each data block server in business, periodically collection Preset Time, during it is then determined that preset
First data block server of interior data traffic maximum and the second data block service of data traffic minimum
Device；A set of read-write pressure acquisition can also be increased in the data block of each data block server of data base
In service, periodically collection Preset Time, the data traffic of each data block, then calculates data block service
The data traffic of device, then determine the first data block server and number that data traffic is maximum in Preset Time
According to the second data block server that flow is minimum.
Second acquisition module 20, for obtaining the number in each data block that the first data block server is corresponding
According to the first data block of maximum flow, and in each data block corresponding to described second data block server
The second data block that data traffic is minimum；
The first data block that second acquisition module 20 gets is that in the first data block server data traffic is
Big data block, the second data block got is the number that in the second data block server, data traffic is minimum
According to block；Easy to understand, when obtaining the first data block and the second data block, if the first data block service
Device exists in two identical and maximum data blocks of data traffic or the second data block server and have two
The data block that individual data traffic is identical and minimum, then determine the first number according to the line unit rowkey of data block
According to block or the second data block.
First Switching Module 30, for by the request of data in described first data block and the second data block
Data processing request exchange.
Request of data is data block reception arrives in Preset Time write data and/or the request reading data,
The request of data of the first data block is arranged in the second data block by the first Switching Module 30, by the second data
The data processing request of block is arranged in the first data block so that first data block write data traffic and/
Or the data traffic of the data traffic that writes with the second data block of data traffic that reads and/or reading is mutual
Change, and then reduce the temperature parameter of the first data block server, improve the second data block server
Temperature parameter so that the data traffic of the data block server of data base more equalizes.
In the present embodiment, obtain, by the second acquisition module 20, the first data block service that data traffic is maximum
In first data block of the data traffic maximum in device and the second data block server of data traffic minimum
The second data block that data traffic is minimum, then the first Switching Module 30 exchanges the data in the first data block
Request and the data processing request in the second data block；Achieve the request of data and second of the first data block
The exchange of the data processing request of data block so that the first data block server and the second data block server
Between data traffic more equalize, and then enable data base process in time the first data block data please
Seek corresponding business, efficiently avoid and cause number when the flow parameter that data base exists data block is excessive
Delay machine according to block server, improve performance and the work efficiency of data base.
With reference to the refinement high-level schematic functional block diagram that Fig. 6, Fig. 6 are computing module in Fig. 5.
The refinement functional module embodiment of computing module 20 of the present invention, this enforcement are proposed based on first embodiment
In example, the first acquisition module 10 includes:
First acquiring unit 11, in obtaining Preset Time, the flow parameter of data block, wherein, described
Flow parameter includes data traffic and/or the data traffic of reading of write；
The data traffic of write refers to the data package size summation that all of write request of data block is corresponding, number
According to the size summation of packet corresponding to all of read requests of block, therefore, data in Preset Time are obtained
The flow parameter of block specifically refer to obtain data package size summation corresponding to all of write request of data block and/
Or the size summation of packet corresponding to all of read requests of data block.Certainly, data in Preset Time
The flow parameter of block can periodically obtain, it is also possible to obtains according to prefixed time interval.The present embodiment
In, the data block at each data block server data block server of data base increases a set of read-write pressure
Gather service, periodically the flow of the reading and writing of each data block in collection Preset Time.
Second acquisition unit 12, for obtain locality parameter corresponding to the flow parameter of described data block,
The history temperature parameter of data block and the distributed constant of data block server；
Wherein, locality parameter LocalPercent that the flow parameter of described data block is corresponding refers to data block
The data of write and/or the locality ratio weight of the data of reading, the data of data block write and/or reading
Data in the ratio data that occupies of data block server belonging to this data block, its span is [0,1].
History temperature parameter HistoryPercent of data block refers to the history temperature trend power of this data block
Weight, its span is [0,1], (by parameter configuration, gives tacit consent to 3 according to X nearest in this data block
Individual) slope of curve trend of history cycle access request is calculated, and wherein, the biggest explanation of slope accesses please
Ask and present the trend that forward increases always.
The distributed constant TablePercent of data block server refers to the equiblibrium mass distribution rate of table Table, several
Equiblibrium mass distribution rate according to table Table corresponding to the data block of block server.
Computing unit 13, is used for based on described flow parameter, locality parameter, history temperature parameter and divides
Cloth parameter calculates the temperature parameter obtaining described data block server；
The computing formula of the temperature parameter of data block server is:
HotScorer=∑ [(1-α) × LastQualityScorer+ α × CurQualityScorer] × (1/LocalPerc
ent)×(1+HistorySlope)×(1+TablePerCent)
In formula, LastQualityScorer is data block data traffic in last Preset Time and/or reading
Data traffic, CurQualityScorer is the flow parameter of data block in the current preset time；α represents
The temperature weighted value of the data block of this data block server last, its span is [0,1], as arranged
Becoming 0 is exactly that the temperature not considering the last time accesses, and generally, the value of α is 0.5, represents simultaneously
Take into account the temperature in this data block and last data block temperature.
Unit 14 is set, for the data block server that temperature parameter is maximum as the first data block service
Device, and using data block server minimum for temperature parameter as the second data block server.
In the present embodiment, by computing unit 13 according to the flow parameter got, locality parameter,
History temperature parameter and distributed constant calculate the temperature parameter obtaining data block server, then arrange unit
14 using data block server maximum for temperature parameter as the first data block server, and by temperature parameter
Little data block server is as the second data block server, and then ensure that the first data block server
And second data block server be respectively the hottest data block server of data base and take with the coldest data block
Business device, and then improve the accuracy of the first data block and the second data block, further increase data base
Performance and work efficiency.
Functional module with reference to data processing equipment the second embodiment that Fig. 7, Fig. 7 are data base of the present invention is shown
It is intended to.
Second embodiment of the data processing equipment of data base of the present invention, this reality are proposed based on the second embodiment
Executing in example, the data processing equipment of data base also includes:
3rd acquisition module 40, for obtaining the first temperature parameter and the of described first data block server
Second temperature parameter of two data block servers；
First determines module 50, for determining the of described first temperature parameter and described second temperature parameter
Whether one difference is more than predetermined threshold value；
Second acquisition module 20 is additionally operable in described first temperature parameter and the first of described second temperature parameter
When difference is more than predetermined threshold value, obtain the data stream in each data block that the first data block server is corresponding
Data in the first data block that amount is maximum, and each data block corresponding to described second data block server
The second data block that flow is minimum.
In the present embodiment, the first temperature being obtained the first data block server by the 3rd acquisition module 40 is joined
Number and the second temperature parameter of the second data block server, then the second acquisition module 20 is described first true
Cover half block 50 determines that the first temperature parameter the first difference with described second temperature parameter is more than predetermined threshold value
Time, obtain the first data block of described first data block server and the of described second data block server
Two data blocks；Avoid the first difference in the first temperature parameter and the second temperature parameter not less than default threshold
Carry out the request of data of the first data block and the request of data of the second data block during value, so avoid unnecessary
Balance database in the data traffic of data block server, further increase performance and the work of data base
Make efficiency.
Functional module with reference to data processing equipment the 3rd embodiment that Fig. 8, Fig. 8 are data base of the present invention is shown
It is intended to.
3rd embodiment of the data processing equipment of data base of the present invention, this reality are proposed based on the 3rd embodiment
Executing in example, the data processing equipment of data base also includes:
Second determines module 60, for whether determining the first temperature parameter of described first data block server
More than preset heat；
Described first determines module to be additionally operable in the first temperature parameter of described first data block server is more than
During preset heat, determine that described first temperature parameter is the biggest with the first difference of described second temperature parameter
In predetermined threshold value.
In the present embodiment, determine that module 60 determines the first heat of described first data block server by second
Degree parameter is more than preset heat, and then first determines that module 60 is at the first of described first data block server
When temperature parameter is more than preset heat, determine the of described first temperature parameter and described second temperature parameter
One difference is more than predetermined threshold value；And then determine the first data block server the need of by its data block with
Data block in other data block servers is adjusted, and avoids unnecessary balanced adjustment data further
The data traffic of data block server in storehouse, improves the efficiency of data base.
4th embodiment of the data processing equipment of data base of the present invention, this reality are proposed based on above-described embodiment
Executing in example, the data processing equipment of this data base also includes:
Generation module, is used for based on described first data block and the second data block generation plan for adjustment, wherein,
The configuration parameter of the described data base in plan for adjustment is by the request of data in described first data block and the
The temperature parameter of each data block server after request of data exchange in two data blocks and the number of correspondence thereof
According to the flow parameter that block is corresponding；
Assume that the request of data in the first data block has been exchanged with the request of data in the second data block, i.e.
The data traffic of the first data block of the first data block server and the second data of the second data block server
The data traffic of block has been exchanged, and generates plan for adjustment according to the configuration parameter of the data base after having exchanged,
Certainly, in plan for adjustment, the temperature parameter of the first data block server and the second data block server is attached most importance to
Temperature parameter after new calculating, to avoid the first data block server and the second data block server for handing over
When obtaining the data block server that in data base, temperature parameter is maximum or minimum after changing, mistake occurs.
4th acquisition module, for obtaining the 3rd data block server that in plan for adjustment, temperature parameter is maximum
And the 4th data block server that temperature parameter is minimum, and obtain the of described 3rd data block server
Three temperature parameters and the 4th temperature parameter of the 4th data block server；
3rd determines module, for determining the second of described 3rd temperature parameter and described 4th temperature parameter
Whether difference is more than described predetermined threshold value；
Certainly, determine that module determines the 3rd temperature parameter and the institute of described 3rd data block server the 3rd
State second difference of the 4th temperature parameter of the 4th data block server more than before predetermined threshold value, it is also possible to
First determine that the temperature parameter of described 3rd data block server is more than preset heat, to avoid unnecessary putting down
The data traffic between data block server in weighing apparatus data base.
5th acquisition module, for when described second difference is more than described predetermined threshold value, obtains the 3rd number
According to the 3rd data block that the data traffic in each data block that block server is corresponding is maximum, and described the
The 4th data block that in each data block that four data block servers are corresponding, data traffic is minimum；
Second Switching Module, for the data by the request of data of described 3rd data block with the 4th data block
The request of process is exchanged.
The request of data of the 3rd data block is arranged in the 4th data block by the second Switching Module, by the 4th number
It is arranged in the 3rd data block according to the data processing request of block so that the data traffic of the 3rd data block write
And/or the data traffic of the data traffic of reading and the data traffic of the 4th data block write and/or reading
Exchange.
In the present embodiment, determined the 3rd of temperature parameter maximum based on plan for adjustment by the 4th acquisition module
Data block server and the 4th data block server of temperature parameter minimum, then determine module the 3rd
When determining the second difference more than described predetermined threshold value, the 5th acquisition module determines in the 3rd data block server
The 4th number that in 3rd data block of data traffic maximum and the 4th data block server, data traffic is minimum
According to block, the second last Switching Module exchanges at the request of data of the 3rd data block and the data of the 4th data block
Reason request；Achieve data traffic and/or data traffic and the 4th data of reading of the 3rd data block write
The data traffic of block write and/or the exchange of the data traffic of reading, and then reduce the 3rd data block service
The temperature of device improves the temperature of the 4th data block server simultaneously so that the 3rd data block server and
Data traffic between four data block servers more equalizes, and enables data base to process the 3rd data in time
The business that the request of data of block is corresponding, efficiently avoid the flow ginseng that there is the 3rd data block data base
Number causes the 3rd data block server to delay machine time excessive, further increases performance and the work effect of data base
Rate.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every
Utilize equivalent structure or equivalence flow process conversion that description of the invention and accompanying drawing content made, or directly or
Connect and be used in other relevant technical fields, be the most in like manner included in the scope of patent protection of the present invention.
Claims (10)
1. the data processing method of a data base, it is characterised in that the data process side of described data base
Method comprises the following steps:
Obtain the first data block server and data stream that in each data block server, data traffic is maximum
The second data block server that amount is minimum；
Obtain the first data that the data traffic in each data block that the first data block server is corresponding is maximum
The second number that in block, and each data block corresponding to described second data block server, data traffic is minimum
According to block；
Request of data in described first data block is exchanged with the data processing request in the second data block.
2. the data processing method of data base as claimed in claim 1, it is characterised in that described acquisition
The first data block server that in each data block server, data traffic is maximum and data traffic are minimum
The step of the second data block server includes:
The flow parameter of data block in acquisition Preset Time, wherein, described flow parameter includes the number of write
According to flow and/or the data traffic of reading；
Obtain the history temperature parameter of locality parameter corresponding to the flow parameter of described data block, data block
And the distributed constant of data block server；
Calculate based on described flow parameter, locality parameter, history temperature parameter and distributed constant and obtain institute
State the temperature parameter of data block server；
Using data block server maximum for temperature parameter as the first data block server, and by temperature parameter
Minimum data block server is as the second data block server.
3. the data processing method of data base as claimed in claim 2, it is characterised in that obtain described
Take the first data block that the data traffic in each data block that the first data block server is corresponding is maximum, with
And the second data block that in each data block corresponding to described second data block server, data traffic is minimum
Before step, described method also includes:
Obtain the first temperature parameter and the second of the second data block server of described first data block server
Temperature parameter；
Determine that whether the described first temperature parameter the first difference with described second temperature parameter is more than presetting threshold
Value；
When the first difference of described first temperature parameter with described second temperature parameter is more than predetermined threshold value,
Perform that data traffic in each data block that described acquisition the first data block server is corresponding is maximum first
That in data block, and each data block corresponding to described second data block server, data traffic is minimum
The step of two data blocks.
4. the data processing method of data base as claimed in claim 3, it is characterised in that obtaining institute
State the second temperature parameter of the first temperature parameter of the first data block server and the second data block server with
Whether described the first difference determining described first temperature parameter and described second temperature parameter is more than is preset threshold
Between the step of value, described method also includes:
Determine that whether the first temperature parameter of described first data block server is more than preset heat；
Described first data block server the first temperature parameter more than preset heat time, perform described really
Whether the first difference of fixed described first temperature parameter and described second temperature parameter is more than the step of predetermined threshold value
Suddenly.
5. the data processing method of the data base as described in claim 3 or 4, it is characterised in that in institute
State the first data that the data traffic obtained in each data block that the first data block server is corresponding is maximum
The second number that in block, and each data block corresponding to described second data block server, data traffic is minimum
According to the step of block with described by the data in the request of data in described first data block and the second data block
Between the step that reason request is exchanged, described method also includes:
Plan for adjustment is generated, wherein, in plan for adjustment based on described first data block and the second data block
The configuration parameter of described data base is by the request of data in described first data block and the second data block
The temperature parameter of each data block server after data processing request exchange and the data block of correspondence thereof are corresponding
Flow parameter；
Obtain temperature parameter is maximum in plan for adjustment the 3rd data block server and temperature parameter is minimum
4th data block server, and obtain the 3rd temperature parameter and the 4th number of described 3rd data block server
The 4th temperature parameter according to block server；
Determine that whether described 3rd temperature parameter and the second difference of described 4th temperature parameter are more than described pre-
If threshold value；
When described second difference is more than described predetermined threshold value, obtain corresponding each of the 3rd data block server
The 3rd data block that data traffic in individual data block is maximum, and described 4th data block server is corresponding
Each data block in minimum the 4th data block of data traffic；
Described by the data processing request in the request of data in described first data block and the second data block
After the step exchanged, described method also includes:
The data processing request of the request of data of described 3rd data block with the 4th data block is exchanged.
6. the data processing equipment of a data base, it is characterised in that the data of described data base process dress
Put and include:
First acquisition module, for obtaining the first data that in each data block server, data traffic is maximum
Block server and the second data block server of data traffic minimum；
Second acquisition module, for obtaining the data in each data block that the first data block server is corresponding
Number in first data block of maximum flow, and each data block corresponding to described second data block server
According to the second data block that flow is minimum；
First Switching Module, for by the request of data in described first data block and the second data block
Data processing request is exchanged.
7. the data processing equipment of data base as claimed in claim 6, it is characterised in that described first
Acquisition module includes:
First acquiring unit, the flow parameter of data block in obtaining Preset Time, wherein, described stream
Amount parameter includes data traffic and/or the data traffic of reading of write；
Second acquisition unit, for obtaining locality parameter corresponding to the flow parameter of described data block, number
History temperature parameter and the distributed constant of data block server according to block；
Computing unit, for based on described flow parameter, locality parameter, history temperature parameter and distribution
Parameter calculates the temperature parameter obtaining described data block server；
Unit is set, for the data block server that temperature parameter is maximum as the first data block server,
And using data block server minimum for temperature parameter as the second data block server.
8. the data processing equipment of data base as claimed in claim 7, it is characterised in that described data
The data processing equipment in storehouse also includes:
3rd acquisition module, for obtaining the first temperature parameter and second of described first data block server
Second temperature parameter of data block server；
First determines module, for determining the first of described first temperature parameter and described second temperature parameter
Whether difference is more than predetermined threshold value；
Described second acquisition module is additionally operable in the of described first temperature parameter and described second temperature parameter
When one difference is more than predetermined threshold value, obtain the data in each data block that the first data block server is corresponding
Number in first data block of maximum flow, and each data block corresponding to described second data block server
According to the second data block that flow is minimum.
9. the data processing equipment of data base as claimed in claim 8, it is characterised in that described data
The data processing equipment in storehouse also includes:
Second determines module, for determining that the first temperature parameter of described first data block server is the biggest
In preset heat；
Described first determines module to be additionally operable in the first temperature parameter of described first data block server is more than
During preset heat, determine that described first temperature parameter is the biggest with the first difference of described second temperature parameter
In predetermined threshold value.
10. the data processing equipment of data base as claimed in claim 8 or 9, it is characterised in that institute
The data processing equipment stating data base also includes:
Generation module, is used for based on described first data block and the second data block generation plan for adjustment, wherein,
The configuration parameter of the described data base in plan for adjustment is by the request of data in described first data block and the
The temperature parameter of each data block server after data processing request exchange in two data blocks and correspondence thereof
Flow parameter corresponding to data block；
4th acquisition module, for obtaining the 3rd data block server that in plan for adjustment, temperature parameter is maximum
And the 4th data block server that temperature parameter is minimum, and obtain the of described 3rd data block server
Three temperature parameters and the 4th temperature parameter of the 4th data block server；
3rd determines module, for determining the second of described 3rd temperature parameter and described 4th temperature parameter
Whether difference is more than described predetermined threshold value；
5th acquisition module, for when described second difference is more than described predetermined threshold value, obtains the 3rd number
According to the 3rd data block that the data traffic in each data block that block server is corresponding is maximum, and described the
The 4th data block that in each data block that four data block servers are corresponding, data traffic is minimum；
Second Switching Module, for the data by the request of data of described 3rd data block with the 4th data block
The request of process is exchanged.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510355202.2A CN106326252B (en) | 2015-06-24 | 2015-06-24 | Data processing method and device for database |
| PCT/CN2015/089383 WO2016206192A1 (en) | 2015-06-24 | 2015-09-10 | Data processing method and device for database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510355202.2A CN106326252B (en) | 2015-06-24 | 2015-06-24 | Data processing method and device for database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106326252A true CN106326252A (en) | 2017-01-11 |
| CN106326252B CN106326252B (en) | 2020-05-22 |
Family
ID=57584359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510355202.2A Active CN106326252B (en) | 2015-06-24 | 2015-06-24 | Data processing method and device for database |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106326252B (en) |
| WO (1) | WO2016206192A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107748649A (en) * | 2017-09-18 | 2018-03-02 | 北京京东尚科信息技术有限公司 | A kind of data cached method and apparatus |
| CN110324403A (en) * | 2019-05-23 | 2019-10-11 | 平安科技（深圳）有限公司 | Dynamic divides library method for routing, device, server and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107562542B (en) * | 2017-09-06 | 2020-04-07 | 腾讯科技（深圳）有限公司 | Data partitioning method and device for distributed data processing system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146114A (en) * | 2007-10-12 | 2008-03-19 | 中兴通讯股份有限公司 | A load share method and system of stream media server |
| CN101594371A (en) * | 2008-05-28 | 2009-12-02 | 山东省标准化研究院 | The load balance optimization method of food safety trace back database |
| CN102110014A (en) * | 2011-03-15 | 2011-06-29 | 合肥华云通信技术有限公司 | Method for balancing loads of virtual machine (VM) |
| CN102316045A (en) * | 2011-10-19 | 2012-01-11 | 杭州华三通信技术有限公司 | Method for realizing flow rate balance in multi-service transport platform (MSTP) networking and network equipment |
| CN102916896A (en) * | 2011-08-01 | 2013-02-06 | 赛尔网络有限公司 | Method and device for distributing multi-channel port mirroring mixed data stream |
| CN103220354A (en) * | 2013-04-18 | 2013-07-24 | 广东宜通世纪科技股份有限公司 | Method for achieving load balancing of server cluster |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873504A (en) * | 2012-12-12 | 2014-06-18 | 鸿富锦精密工业（深圳）有限公司 | System enabling data blocks to be stored in distributed server and method thereof |
| CN103312825B (en) * | 2013-07-10 | 2016-08-10 | 中国人民解放军国防科学技术大学 | A kind of distributed data storage method and apparatus |
| CN104580268A (en) * | 2013-10-09 | 2015-04-29 | 南京中兴新软件有限责任公司 | Method and device for transmitting file data |
| CN104158902B (en) * | 2014-08-27 | 2017-09-19 | 浙江宇视科技有限公司 | A kind of Hbase data blocks distribution method and device based on number of request |
-
2015
- 2015-06-24 CN CN201510355202.2A patent/CN106326252B/en active Active
- 2015-09-10 WO PCT/CN2015/089383 patent/WO2016206192A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146114A (en) * | 2007-10-12 | 2008-03-19 | 中兴通讯股份有限公司 | A load share method and system of stream media server |
| CN101594371A (en) * | 2008-05-28 | 2009-12-02 | 山东省标准化研究院 | The load balance optimization method of food safety trace back database |
| CN102110014A (en) * | 2011-03-15 | 2011-06-29 | 合肥华云通信技术有限公司 | Method for balancing loads of virtual machine (VM) |
| CN102916896A (en) * | 2011-08-01 | 2013-02-06 | 赛尔网络有限公司 | Method and device for distributing multi-channel port mirroring mixed data stream |
| CN102316045A (en) * | 2011-10-19 | 2012-01-11 | 杭州华三通信技术有限公司 | Method for realizing flow rate balance in multi-service transport platform (MSTP) networking and network equipment |
| CN103220354A (en) * | 2013-04-18 | 2013-07-24 | 广东宜通世纪科技股份有限公司 | Method for achieving load balancing of server cluster |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107748649A (en) * | 2017-09-18 | 2018-03-02 | 北京京东尚科信息技术有限公司 | A kind of data cached method and apparatus |
| CN110324403A (en) * | 2019-05-23 | 2019-10-11 | 平安科技（深圳）有限公司 | Dynamic divides library method for routing, device, server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2016206192A1 (en) | 2016-12-29 |
| CN106326252B (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104065568B (en) | Web server cluster routing method | |
| CN105391797B (en) | Cloud Server load-balancing method and device based on SDN | |
| CN104780210B (en) | Load-balancing method and device | |
| CN104954401B (en) | traffic scheduling method and device | |
| CN105320702B (en) | A kind of analysis method of user behavior data, device and smart television | |
| CN106326252A (en) | Data processing method and apparatus for database | |
| CN103281367A (en) | Load balance method and device | |
| US10783203B2 (en) | Data processing method and apparatus | |
| CN102045396A (en) | Load balancing method of server document | |
| WO2013101024A1 (en) | Imaging task pipeline acceleration | |
| CN109309596A (en) | A kind of method for testing pressure, device and server | |
| CN104683408A (en) | Method and system for OpenStack cloud computing management platform to build virtual machine instance | |
| CN107872825A (en) | A kind of load-balancing method and device, base station | |
| Tian et al. | User preference-based hierarchical offloading for collaborative cloud-edge computing | |
| CN105635124B (en) | Flow control methods and device | |
| CN109587072A (en) | Distributed system overall situation speed limiting system and method | |
| CN104158732B (en) | A kind of intelligent cloud service dynamic routing strategy | |
| CN103607731B (en) | A kind of processing method and processing device of measurement report | |
| CN106888238A (en) | A kind of method of data synchronization and device | |
| CN105095315B (en) | The methods, devices and systems of dynamic regulation Hash link points | |
| CN106201711B (en) | A kind of task processing method and server | |
| CN108124021A (en) | Internet protocol IP address obtains, the method, apparatus and system of website visiting | |
| Sarvabhatla et al. | A network aware energy efficient offloading algorithm for mobile cloud computing over 5g network | |
| CN106909472B (en) | Input/output load adjusting method and device of distributed file system | |
| CN103747488B (en) | carrier balancing method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |