CN104850634A - Data storage node adjustment method and system - Google Patents
Data storage node adjustment method and system Download PDFInfo
- Publication number
- CN104850634A CN104850634A CN201510268582.6A CN201510268582A CN104850634A CN 104850634 A CN104850634 A CN 104850634A CN 201510268582 A CN201510268582 A CN 201510268582A CN 104850634 A CN104850634 A CN 104850634A
- Authority
- CN
- China
- Prior art keywords
- data memory
- memory node
- load information
- current
- resource
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/217—Database tuning
Abstract
The invention discloses a data storage node adjustment method and system, and relates to the technical field of database management, so as to dynamically increase or decrease the number of data storage nodes to dynamically adjust resources in a database. According to embodiments of the invention, a system load collection module collects current load information of each data storage node and the current number of data storage nodes; a policy inquiring and recording module calculates current comprehensive load information according to the current load information of each data storage node and the current number of data storage nodes; the policy inquiring and recording module acquires a resource adjustment policy according to the current comprehensive load information; and a policy executing module adjusts the number of data storage nodes according to the acquired resource adjustment policy, and performs a service operation by using resources provided by all data storage nodes after adjustment. The scheme provided by the embodiments of the invention is suitable to be used when resources in a database need dynamic adjustment.
Description
Technical field
The present invention relates to database management technology field, particularly relate to a kind of data memory node method of adjustment and system.
Background technology
Along with constantly popularizing of IT technology, the various software systems based on database obtain and apply widely in all trades and professions at present.And the application of software systems is deepened continuously along with business organization, software systems scale is also towards more and more huger and complicated future development.Database is all one of core of these systems usually, and a large amount of operations in system all depend on database.
But, in prior art, various large-scale business operation always can engulf a large amount of computational resources of database server, after large-scale business operation is initiated, the load of data memory node increases rapidly, and the quantity of data memory node is fixing in database, data memory node provides resource for data bank service operation, causes the available resources in database to be fixed.Because provided database resource is relative to resource requirement wretched insufficiency, software systems can unexpectedly become slowly with blunt; Otherwise, when carrying out small businesses operation, there will be the situation that load is lower or partial data memory node is idle of all data memory nodes, causing the waste of resource.
Summary of the invention
Embodiments of the invention provide a kind of data memory node method of adjustment and system, can increase dynamically or reduce the quantity of data storage node according to the load information gathered, and then the resource in dynamic adjusting data storehouse.
For achieving the above object, embodiments of the invention adopt following technical scheme:
A method for data memory node adjustment, be applied to a data memory node adjustment System, described system comprises system load acquisition module, policy lookup and logging modle and policy enforcement module, and described method comprises:
System load acquisition module gathers the quantity of the current load information of each data memory node and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle, described data memory node is used for providing resource for business operation;
Policy lookup and logging modle calculate current integrated load information according to the quantity of the current load information of each data memory node and current data memory node;
The resource adjusting strategies of acquisition according to current integrated load acquisition of information resource adjusting strategies, and is sent to policy enforcement module by policy lookup and logging modle;
Policy enforcement module, according to the resource adjusting strategies obtained, adjusts the quantity of data memory node, and carries out business operation with the resource that all data memory nodes after adjustment provide.
A kind of data memory node adjustment System, described system comprises system load acquisition module, policy lookup and logging modle, policy enforcement module, data memory node and proxy module;
Described system load acquisition module, proxy module for control data memory node inside gathers the quantity of the current load information of each data memory node and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle;
Described policy lookup and logging modle, for calculating current integrated load information according to the quantity of the current load information of each data memory node and current data memory node, according to current integrated load acquisition of information resource adjusting strategies, and the resource adjusting strategies of acquisition is sent to policy enforcement module; ;
Described policy enforcement module, for according to the resource adjusting strategies obtained, adjusts the quantity of data memory node, and carries out business operation with the resource that all data memory nodes after adjustment provide;
Described data memory node, for providing resource for business operation;
Described proxy module, is arranged at described data memory node inner, for gathering the current load information of each data memory node according to the control of system load acquisition module.
The data memory node method of adjustment that the embodiment of the present invention provides and system, by making system load acquisition module gather the current load information of each data memory node, and send to policy lookup and logging modle by the load information of collection; Policy lookup and logging modle calculate current integrated load information according to the quantity of the current load information of each data memory node and current data memory node; Policy lookup and logging modle are according to current integrated load acquisition of information resource adjusting strategies; Policy enforcement module is according to the resource adjusting strategies obtained, the quantity of adjustment data memory node, and carry out business operation with the resource that all data memory nodes after adjustment provide, thus realize the dynamic quantity increasing or reduce data storage node, and carry out business operation with the resource that all data memory nodes after adjustment provide, improve arithmetic speed and the resource utilization of software systems during large-scale business operation.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
A kind of data memory node method of adjustment process flow diagram that Fig. 1 provides for the embodiment of the present invention;
The another kind of data memory node method of adjustment process flow diagram that Fig. 2 provides for the embodiment of the present invention;
A kind of implementation method process flow diagram of step 103 in the data memory node method of adjustment that Fig. 3 provides for the embodiment of the present invention;
The another kind of data memory node method of adjustment process flow diagram that Fig. 4 provides for the embodiment of the present invention;
A kind of data memory node adjustment System structural drawing that Fig. 5 provides for the embodiment of the present invention;
The another kind of data memory node adjustment System structural drawing that Fig. 6 provides for the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Embodiments provide a kind of data memory node method of adjustment, the present embodiment is applied to a data memory node adjustment System, and described system comprises system load acquisition module, policy lookup and logging modle, policy enforcement module and data memory node.As shown in Figure 1, described method comprises:
101, system load acquisition module gathers the quantity of the current load information of each data memory node and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle, described data memory node is used for providing resource for business operation.
Described step 101 can be implemented as in embodiments of the present invention, the load information that proxy module acquired data storage node in system load acquisition module control data memory node is current, described data memory node is used for providing resource for business operation, and the load information of collection comprises the cpu busy percentage C of each data memory node
i, memory usage M
iwith hard disk I/O utilization factor D
i, the load information of each data memory node collected is reported policy lookup and logging modle by system load acquisition module.
102, policy lookup and logging modle calculate current integrated load information according to the quantity of the current load information of each data memory node and current data memory node.
Described step 102 can be implemented as in embodiments of the present invention, calculates current integrated load information by policy lookup and logging modle, and integrated load information comprises comprehensive cpu busy percentage C, comprehensive memory usage M and integrated hdd I/O utilization factor D; Wherein, the computing formula of comprehensive cpu busy percentage C, comprehensive memory usage M and integrated hdd I/O utilization factor D is respectively (supposing there is k at present according to node):
Comprehensive cpu busy percentage C:
Comprehensive memory usage M:
Integrated hdd I/O utilization factor D:
Wherein a
ifor the calculating weight of every integrated load information of data storage node i, wherein,
103, policy lookup and logging modle are according to current integrated load acquisition of information resource adjusting strategies, and the resource adjusting strategies of acquisition is sent to policy enforcement module;
Described step 103 can be implemented as in embodiments of the present invention, policy lookup and logging modle with current integrated load information for inputting, when to KnowledgeBase-query current composite load information, the resource adjusting strategies of mating the most, policy lookup and logging modle by from KnowledgeBase-query to the resource adjusting strategies of mating most be handed down to policy enforcement module.
104, policy enforcement module is according to the resource adjusting strategies obtained, the quantity of adjustment data memory node, and carries out business operation with the resource that all data memory nodes after adjustment provide.
Described step 104 can be implemented as in embodiments of the present invention, policy enforcement module according to resource adjusting strategies, the quantity of expansion/contraction/maintenance data memory node.
In the another kind of implementation of the embodiment of the present invention, along with the operation of system, in order to the resource adjustment accuracy of data memory node adjustment System can be promoted, when reducing or avoid various large-scale business operation, Database Systems can unexpectedly become slow and blunt situation, described data memory node adjustment System also comprises knowledge base, as shown in Figure 2, also comprises before step 101:
201, knowledge base establishing resource adjustment form, described resource adjustment form comprises the corresponding relation between described integrated load Information and Resource adjustable strategies;
Described step 103 specifically comprises:
Policy lookup and logging modle are according to current integrated load information Gains resources adjustable strategies from resource adjustment form.
Described step 201 can be implemented as in embodiments of the present invention, store the corresponding relation between described integrated load Information and Resource adjustable strategies in described resource adjustment form in knowledge base, described integrated load information comprises cpu busy percentage, memory usage and hard disk I/O utilization factor; Described resource adjusting strategies comprises expansion data memory node, shrink the quantity of a data memory node and data memory node remains unchanged policy lookup and logging modle with current integrated load information for inputting, when inquiring about current composite load information to the resource adjustment form in knowledge base, the resource adjusting strategies of mating the most.
In the another kind of implementation of the embodiment of the present invention, as shown in Figure 3, described step 103 is specially:
301, policy lookup and logging modle travel through each integrated load information in resource adjustment form.
302, policy lookup and logging modle calculate matching value respectively according to current integrated load information and each integrated load information of getting.
Described step 302 can be implemented as in embodiments of the present invention, suppose in resource adjustment form, the integrated load information cpu busy percentage having one to record is C', memory usage is M', hard disk IO utilization factor is D', and policy lookup and logging modle calculate the every variance sum S of each integrated load information in the resource adjustment form of current integrated load information and acquisition:
S＝|C-C'|
2+|M-M'|
2+|D-D'|
2；
Wherein, C is comprehensive cpu busy percentage, and M is comprehensive memory usage, and D is integrated hdd I/O utilization factor.
303, policy lookup and logging modle are according to the resource adjusting strategies selecting in all matching value resource adjustment forms calculated to mate most.
Described step 303 can be implemented as in embodiments of the present invention, and policy lookup and logging modle are selected to select immediate resource adjusting strategies as the resource adjusting strategies of mating most in minimum in an all S values resource adjustment form being recorded in knowledge base.
In the another kind of implementation of the embodiment of the present invention, in order to avoid repeating to select resource adjusting strategies to matching the integrated load information of resource adjusting strategies, promote the resource adjustment accuracy of data memory node adjustment System, when reducing or avoid various large-scale business operation, Database Systems can unexpectedly become slow and blunt situation, as shown in Figure 4, also comprise after described step 104:
401, the load information that each data memory node of system load acquisition module Resurvey is current, policy lookup and logging modle calculate current integrated load information again according to the quantity of the current load information of each data memory node and current data memory node.
Described step 401 can be implemented as in embodiments of the present invention, after strategy execution, system load acquisition module, again gathers the current load information of each data memory node by the proxy module in data memory node, and reports policy lookup and logging modle;
The load information of each data memory node reported according to load acquisition module by policy lookup and logging modle is again according to described comprehensive cpu busy percentage C, the computing formula of comprehensive memory usage M and integrated hdd I/O utilization factor D calculates the integrated load information of data memory node, obtain the CPU comprehensive utilization ratio C after implementing adjustable strategies ", internal memory comprehensive utilization ratio M " and hard disk IO utilization factor D ".
If the integrated load information that 402 policy lookups and logging modle calculate is in predetermined threshold range, the resource adjusting strategies selected before then this is adjusted the quantity of data memory node by policy lookup and logging modle and this adjust the quantity of data memory node before the integrated load information updating that calculates enter resource adjustment form, otherwise, not more new resources adjustment form, and re-execute step 401, until the integrated load information that policy lookup and logging modle calculate is in predetermined threshold range.
Described step 402 can be implemented as in embodiments of the present invention, if policy lookup and logging modle calculate the CPU comprehensive utilization ratio C after implementing adjustable strategies ", internal memory comprehensive utilization ratio M " and hard disk IO utilization factor D " meet C simultaneously " ∈ (C
min, C
max), M " ∈ (M
min, M
max), D " ∈ (D
min, D
max), so think that the enforcement of adjustment produces a desired effect, integrated load information before strategy execution is write into knowledge base with logging modle by policy lookup together with the strategy of execution, if do not arrive Expected Results, policy lookup and logging modle will not do renewal rewards theory to knowledge base.
Special instruction, C
minand C
maxhigher limit and the lower limit of the good traffic coverage of node cpu performance that preset in advance is good, M
minand M
maxhigher limit and the lower limit of the good traffic coverage of node internal memory performance that preset in advance is good, D
minand D
maxhigher limit and the lower limit of the good traffic coverage of node internal memory performance that preset in advance is good.
Along with the operation of system, integrated load Information and Resource adjustable strategies record each time successfully corresponding to resource adjustment is entered resource adjustment form by system, resource adjustment form is constantly enriched, along with the successful resource adjustment information recorded in resource adjustment form increases, the resource adjustment accuracy of data memory node adjustment System can progressively improve, when reducing or avoid various large-scale business operation, Database Systems can unexpectedly become slowly and blunt.
In the another kind of implementation of the embodiment of the present invention, the invention provides a kind of data memory node adjustment System, as shown in Figure 5, described data memory node adjustment System comprises system load acquisition module 501, policy lookup and logging modle 502, policy enforcement module 503, data memory node 504 and proxy module 505;
Described system load acquisition module 501, for gathering the quantity of the current load information of each data memory node 504 and current data memory node, and sends to policy lookup and logging modle by the quantity of the load information of collection and current data memory node;
Described policy lookup and logging modle 502, for calculating current integrated load information, according to current integrated load acquisition of information resource adjusting strategies according to the quantity of the current load information of each data memory node 504 and current data memory node 504;
Described policy enforcement module 503, for according to the resource adjusting strategies obtained, adjusts the quantity of data memory node 504, and carries out business operation with the resource that all data memory nodes after adjustment provide;
Described data memory node 504, for providing resource for business operation;
Described proxy module 505, is arranged at described data memory node 504 inner, for gathering the current load information of each data memory node according to the control of system load acquisition module.
Described data memory node adjustment System can be implemented as in embodiments of the present invention, the load information that proxy module 505 acquired data storage node in system load acquisition module 501 control data memory node 504 is current, described data memory node 504 is for providing resource for business operation, and the load information of collection comprises the cpu busy percentage C of each data memory node 504
i, memory usage M
iwith hard disk I/O utilization factor D
i.
The load information of each data memory node 504 collected is reported policy lookup and logging modle 502 by system load acquisition module 501, current integrated load information is calculated by policy lookup and logging modle 502, integrated load information comprises comprehensive cpu busy percentage C, comprehensive memory usage M and integrated hdd I/O utilization factor D; Wherein, the computing formula of comprehensive cpu busy percentage C, comprehensive memory usage M and integrated hdd I/O utilization factor D is respectively (supposing there is k at present according to node):
Comprehensive cpu busy percentage C:
Comprehensive memory usage M:
Integrated hdd I/O utilization factor D:
Wherein a
ifor the calculating weight of every integrated load information of data storage node i, wherein,
Policy lookup and logging modle 502 with current integrated load information for inputting, when inquiring about current composite load information to knowledge base 601, the resource adjusting strategies of mating the most, the resource adjusting strategies of mating most inquired from knowledge base 601 is handed down to policy enforcement module with logging modle 502 by policy lookup.
Policy enforcement module 503 according to resource adjusting strategies, the quantity of expansion/contraction/maintenance data memory node 504.
In the another kind of implementation of the embodiment of the present invention, along with the operation of system, in order to the resource adjustment accuracy of data memory node adjustment System can be promoted, when reducing or avoid various large-scale business operation, Database Systems can unexpectedly become slow and blunt situation, as shown in Figure 6, described data memory node adjustment System also comprises knowledge base 601;
Described knowledge base 601, for storage resources adjustment form, described resource adjustment form comprises the corresponding relation between described integrated load Information and Resource adjustable strategies;
Described policy lookup and logging modle are also for according to current integrated load information Gains resources adjustable strategies from the resource adjustment form that knowledge base creates.
Described data memory node adjustment System can be implemented as in embodiments of the present invention, described resource adjustment form is stored in knowledge base 601, the corresponding relation between described integrated load Information and Resource adjustable strategies is stored in described resource adjustment form, described integrated load information comprises cpu busy percentage, memory usage and hard disk I/O utilization factor, described resource adjusting strategies comprises expansion data memory node 504, the quantity of shrinking a data memory node 504 and data memory node 504 remains unchanged, policy lookup and logging modle 502 with current integrated load information for inputting, when inquiring about current composite load information to the resource adjustment form in knowledge base 601, the resource adjusting strategies of mating the most.
In the another kind of implementation of the embodiment of the present invention, policy lookup in described data memory node adjustment System and logging modle also for: travel through each integrated load information in resource adjustment form, calculate matching value respectively according to current integrated load information and each integrated load information of getting, select the resource adjusting strategies of mating most according to all matching values calculated;
Described data memory node adjustment System can be implemented as in embodiments of the present invention, each integrated load information in traversal resource adjustment form, suppose in resource adjustment form, the integrated load information cpu busy percentage having one to record is C', memory usage is M', hard disk IO utilization factor is D', and policy lookup and logging modle calculate the every variance sum S of each integrated load information in the resource adjustment form of current integrated load information and acquisition:
S＝|C-C'|
2+|M-M'|
2+|D-D'|
2；
Wherein, C is comprehensive cpu busy percentage, and M is comprehensive memory usage, and D is integrated hdd I/O utilization factor.
Policy lookup and logging modle 502 are selected to select immediate resource adjusting strategies as the resource adjusting strategies of mating most in minimum in an all S values resource adjustment form being recorded in knowledge base 601.
In the another kind of implementation of the embodiment of the present invention, in order to avoid repeating to select resource adjusting strategies to matching the integrated load information of resource adjusting strategies, promote the resource adjustment accuracy of data memory node adjustment System, when reducing or avoid various large-scale business operation, Database Systems can unexpectedly become slow and blunt situation, described system load acquisition module 501 also for:
The load information that each data memory node of Resurvey is current;
Described policy lookup and logging modle 502, also for again calculating current integrated load information according to the quantity of the current load information of each data memory node 504 and current data memory node 504; If the integrated load information calculated is in predetermined threshold range, the integrated load information updating calculated before then the resource adjusting strategies selected before the quantity of this adjustment data memory node 504 and this being adjusted the quantity of data memory node 504 enters resource adjustment form, otherwise, not more new resources adjustment form, again current integrated load information is again calculated, until the integrated load information that policy lookup and logging modle calculate is in predetermined threshold range according to the quantity of the current load information of each data memory node and current data memory node;
Described data memory node adjustment System can be implemented as in embodiments of the present invention, after strategy execution, system load acquisition module 501, again gather the current load information of each data memory node 504 by the proxy module 505 in data memory node 504, and report policy lookup and logging modle 502;
The load information of each data memory node 504 reported according to load acquisition module 501 by policy lookup and logging modle 502 is again according to described comprehensive cpu busy percentage C, the computing formula of comprehensive memory usage M and integrated hdd I/O utilization factor D calculates the integrated load information of data memory node 504, obtain the CPU comprehensive utilization ratio C after implementing adjustable strategies ", internal memory comprehensive utilization ratio M " and hard disk IO utilization factor D ".
The CPU comprehensive utilization ratio C after if policy lookup and logging modle 502 calculate and implement adjustable strategies ", internal memory comprehensive utilization ratio M " and hard disk IO utilization factor D " meet C simultaneously " ∈ (C
min, C
max), M " ∈ (M
min, M
max), D " ∈ (D
min, D
max), so think that the enforcement of adjustment produces a desired effect, integrated load information before strategy execution is write into knowledge base 601 with logging modle 502 by policy lookup together with the strategy of execution, if do not arrive Expected Results, policy lookup and logging modle 103 will not do renewal rewards theory to knowledge base 601.
Special instruction, C
minand C
maxhigher limit and the lower limit of the good traffic coverage of node cpu performance that preset in advance is good, M
minand M
maxhigher limit and the lower limit of the good traffic coverage of node internal memory performance that preset in advance is good, D
minand D
maxhigher limit and the lower limit of the good traffic coverage of node internal memory performance that preset in advance is good.
Along with the operation of system, integrated load Information and Resource adjustable strategies record each time successfully corresponding to resource adjustment is entered resource adjustment form by system, resource adjustment form is constantly enriched, along with the successful resource adjustment information recorded in resource adjustment form increases, the resource adjustment accuracy of data memory node adjustment System can progressively improve, when reducing or avoid various large-scale business operation, Database Systems can unexpectedly become slowly and blunt.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add required common hardware by software and realize, and can certainly pass through hardware, but in a lot of situation, the former is better embodiment.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in the storage medium that can read, as the floppy disk of computing machine, hard disk or CD etc., comprise some instructions and perform method described in each embodiment of the present invention in order to make a computer equipment (can be personal computer, server, or the network equipment etc.).
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.
Claims (10)
1. a data memory node method of adjustment, be applied to a data memory node adjustment System, described system comprises system load acquisition module, policy lookup and logging modle, policy enforcement module and data memory node, it is characterized in that, described method comprises:
System load acquisition module gathers the quantity of the current load information of each data memory node and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle, described data memory node is used for providing resource for business operation;
Policy lookup and logging modle calculate current integrated load information according to the quantity of the current load information of each data memory node and current data memory node;
The resource adjusting strategies of acquisition according to current integrated load acquisition of information resource adjusting strategies, and is sent to policy enforcement module by policy lookup and logging modle;
Policy enforcement module, according to the resource adjusting strategies obtained, adjusts the quantity of data memory node, and carries out business operation with the resource that all data memory nodes after adjustment provide.
2. data memory node method of adjustment according to claim 1, described data memory node adjustment System also comprises knowledge base, it is characterized in that, also comprises before described system load acquisition module gathers the current load information of each data memory node:
Knowledge base establishing resource adjustment form, described resource adjustment form comprises the corresponding relation between described integrated load Information and Resource adjustable strategies;
Described policy lookup and logging modle, according to current integrated load acquisition of information resource adjusting strategies, specifically comprise:
Policy lookup and logging modle are according to current integrated load information Gains resources adjustable strategies from the resource adjustment form that knowledge base creates.
3. data memory node method of adjustment according to claim 2, is characterized in that, described policy lookup and logging modle are specially according to current integrated load acquisition of information resource adjusting strategies:
Policy lookup and logging modle travel through each integrated load information in resource adjustment form;
Policy lookup and logging modle calculate matching value respectively according to current integrated load information and each integrated load information of getting;
Policy lookup and logging modle select the resource adjusting strategies of mating most in resource adjustment form according to all matching values calculated.
4. data memory node method of adjustment according to claim 2, is characterized in that, in described policy enforcement module according to the resource adjusting strategies obtained, also comprises after the quantity of adjustment data memory node:
The quantity of the load information that each data memory node of system load acquisition module Resurvey is current and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle, policy lookup and logging modle calculate current integrated load information again according to the quantity of the current load information of each data memory node and current data memory node;
If the integrated load information that policy lookup and logging modle calculate is in predetermined threshold range, the resource adjusting strategies selected before then this is adjusted the quantity of data memory node by policy lookup and logging modle and this adjust the quantity of data memory node before the integrated load information updating that calculates enter resource adjustment form, otherwise, not more new resources adjustment form, the load information that each data memory node of system load acquisition module Resurvey is current, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle, policy lookup and logging modle calculate current integrated load information again according to the quantity of the current load information of each data memory node and current data memory node, until the integrated load information that policy lookup and logging modle calculate is in predetermined threshold range.
5. according to the arbitrary described data memory node method of adjustment of Claims 1-4, it is characterized in that, described integrated load information comprises the cpu busy percentage of data memory node, memory usage and/or hard disk I/O utilization factor.
6. a data memory node adjustment System, is characterized in that, described system comprises system load acquisition module, policy lookup and logging modle, policy enforcement module, data memory node and proxy module;
Described system load acquisition module, proxy module for control data memory node inside gathers the quantity of the current load information of each data memory node and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle;
Described policy lookup and logging modle, for calculating current integrated load information according to the quantity of the current load information of each data memory node and current data memory node, according to current integrated load acquisition of information resource adjusting strategies, and the resource adjusting strategies of acquisition is sent to policy enforcement module;
Described policy enforcement module, for according to the resource adjusting strategies obtained, adjusts the quantity of data memory node, and carries out business operation with the resource that all data memory nodes after adjustment provide;
Described data memory node, for providing resource for business operation;
Described proxy module, is arranged at described data memory node inner, for gathering the current load information of each data memory node according to the control of system load acquisition module.
7. data memory node adjustment System according to claim 6, is characterized in that, described data memory node adjustment System also comprises knowledge base;
Described knowledge base, for establishing resource adjustment form, described resource adjustment form comprises the corresponding relation between described integrated load Information and Resource adjustable strategies;
Described policy lookup and logging modle are also for according to current integrated load information Gains resources adjustable strategies from the resource adjustment form that knowledge base creates.
8. data memory node adjustment System according to claim 7, is characterized in that, described policy lookup and logging modle also for:
Each integrated load information in traversal resource adjustment form, calculates matching value respectively according to current integrated load information and each integrated load information of getting, selects the resource adjusting strategies of mating most according to all matching values calculated.
9. data memory node adjustment System according to claim 6, is characterized in that, described system load acquisition module also for:
The quantity of the load information that each data memory node of Resurvey is current and current data memory node, and the quantity of the load information of collection and current data memory node is sent to policy lookup and logging modle;
Described policy lookup and logging modle, also for again calculating current integrated load information according to the quantity of the current load information of each data memory node and current data memory node; If the integrated load information calculated is in predetermined threshold range, the integrated load information updating calculated before then the resource adjusting strategies selected before the quantity of this adjustment data memory node and this being adjusted the quantity of data memory node enters resource adjustment form, otherwise, not more new resources adjustment form, again current integrated load information is again calculated, until the integrated load information that policy lookup and logging modle calculate is in predetermined threshold range according to the quantity of the current load information of each data memory node and current data memory node.
10. according to the arbitrary described data memory node adjustment System of claim 6 to 9, it is characterized in that, described integrated load information comprises the cpu busy percentage of data memory node, memory usage and/or hard disk I/O utilization factor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510268582.6A CN104850634A (en) | 2015-05-22 | 2015-05-22 | Data storage node adjustment method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510268582.6A CN104850634A (en) | 2015-05-22 | 2015-05-22 | Data storage node adjustment method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104850634A true CN104850634A (en) | 2015-08-19 |
Family
ID=53850278
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510268582.6A Pending CN104850634A (en) | 2015-05-22 | 2015-05-22 | Data storage node adjustment method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104850634A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657066A (en) * | 2016-03-23 | 2016-06-08 | 天津书生云科技有限公司 | Load rebalance method and device used for storage system |
| CN107920129A (en) * | 2017-12-07 | 2018-04-17 | 郑州云海信息技术有限公司 | A kind of method, apparatus, equipment and the cloud storage system of data storage |
| US11258877B2 (en) | 2018-07-26 | 2022-02-22 | Netapp, Inc. | Methods for managing workloads in a storage system and devices thereof |
| CN115859394A (en) * | 2022-12-15 | 2023-03-28 | 深圳市数存科技有限公司 | Data security storage system and method based on edge calculation |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651613A (en) * | 2009-09-04 | 2010-02-17 | 西安电子科技大学 | Admission control system supporting strategy space dynamic expansion and control method thereof |
| CN102111438A (en) * | 2010-12-24 | 2011-06-29 | 华为技术有限公司 | Method and device for parameter adjustment and distributed computation platform system |
| CN102244685A (en) * | 2011-08-11 | 2011-11-16 | 中国科学院软件研究所 | Distributed type dynamic cache expanding method and system supporting load balancing |
| CN103023969A (en) * | 2012-11-15 | 2013-04-03 | 北京搜狐新媒体信息技术有限公司 | Cloud platform scheduling method and system |
| US8458433B2 (en) * | 2007-10-29 | 2013-06-04 | International Business Machines Corporation | Management of persistent memory in a multi-node computer system |
| CN103929365A (en) * | 2014-03-25 | 2014-07-16 | 上海格尔软件股份有限公司 | Load balancing system and method suitable for a plurality of UDP services |
-
2015
- 2015-05-22 CN CN201510268582.6A patent/CN104850634A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8458433B2 (en) * | 2007-10-29 | 2013-06-04 | International Business Machines Corporation | Management of persistent memory in a multi-node computer system |
| CN101651613A (en) * | 2009-09-04 | 2010-02-17 | 西安电子科技大学 | Admission control system supporting strategy space dynamic expansion and control method thereof |
| CN102111438A (en) * | 2010-12-24 | 2011-06-29 | 华为技术有限公司 | Method and device for parameter adjustment and distributed computation platform system |
| CN102244685A (en) * | 2011-08-11 | 2011-11-16 | 中国科学院软件研究所 | Distributed type dynamic cache expanding method and system supporting load balancing |
| CN103023969A (en) * | 2012-11-15 | 2013-04-03 | 北京搜狐新媒体信息技术有限公司 | Cloud platform scheduling method and system |
| CN103929365A (en) * | 2014-03-25 | 2014-07-16 | 上海格尔软件股份有限公司 | Load balancing system and method suitable for a plurality of UDP services |
Non-Patent Citations (1)
| Title |
|---|
| 田文洪 等: "《云计算——资源调度管理》", 31 July 2011, 国防工业出版社 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657066A (en) * | 2016-03-23 | 2016-06-08 | 天津书生云科技有限公司 | Load rebalance method and device used for storage system |
| CN105657066B (en) * | 2016-03-23 | 2019-06-14 | 天津书生云科技有限公司 | Load for storage system equalization methods and device again |
| CN107920129A (en) * | 2017-12-07 | 2018-04-17 | 郑州云海信息技术有限公司 | A kind of method, apparatus, equipment and the cloud storage system of data storage |
| US11258877B2 (en) | 2018-07-26 | 2022-02-22 | Netapp, Inc. | Methods for managing workloads in a storage system and devices thereof |
| CN115859394A (en) * | 2022-12-15 | 2023-03-28 | 深圳市数存科技有限公司 | Data security storage system and method based on edge calculation |
| CN115859394B (en) * | 2022-12-15 | 2023-11-21 | 深圳市数存科技有限公司 | Data security storage system and method based on edge calculation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104850634A (en) | Data storage node adjustment method and system | |
| CN103077082A (en) | Method and system for distributing data center load and saving energy during virtual machine migration | |
| CN110795029B (en) | Cloud hard disk management method, device, server and medium | |
| US20100076933A1 (en) | Techniques for resource location and migration across data centers | |
| CN113220457A (en) | Model deployment method, model deployment device, terminal device and readable storage medium | |
| DE112010004062T5 (en) | OPTIMIZING AN ARCHIVE MANAGEMENT PLANNING | |
| US8688681B1 (en) | Identifying internet protocol addresses for internet hosting entities | |
| Li et al. | Utility maximisation for resource allocation of migrating enterprise applications into the cloud | |
| Al Ridhawi et al. | Data caching and selection in 5G networks using F2F communication | |
| CN106339475A (en) | Distributed storage system for mass data | |
| CN103631894A (en) | Dynamic copy management method based on HDFS | |
| CN103414657A (en) | Cross-data-center resource scheduling method, super scheduling center and system | |
| US9934325B2 (en) | Method and apparatus for distributing graph data in distributed computing environment | |
| CN103218416A (en) | Method, device and system for loading database | |
| Wu et al. | Towards collaborative storage scheduling using alternating direction method of multipliers for mobile edge cloud | |
| CN114048006A (en) | Virtual machine dynamic migration method and device and storage medium | |
| CN106326005B (en) | Parameter automatic tuning method for iterative MapReduce operation | |
| EP2838023A2 (en) | Centralised information reporting in a large scale information processing system | |
| CN105069074A (en) | Strategy configuration file processing method, device and system | |
| He et al. | Research on multifeature data routing strategy in deduplication | |
| Nayak et al. | A research paper of existing live VM migration and a hybrid VM migration approach in cloud computing | |
| US10089151B2 (en) | Apparatus, method, and program medium for parallel-processing parameter determination | |
| Jalali et al. | OPWUMP: an architecture for online predicting in WUM-based personalization system | |
| JP2019121333A (en) | Data dynamic migration method and data dynamic migration device | |
| Liu et al. | A survey of speculative execution strategy in MapReduce |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150819 |