CN102902825B - A kind of database optimizing method and device - Google Patents
A kind of database optimizing method and device Download PDFInfo
- Publication number
- CN102902825B CN102902825B CN201210442020.5A CN201210442020A CN102902825B CN 102902825 B CN102902825 B CN 102902825B CN 201210442020 A CN201210442020 A CN 201210442020A CN 102902825 B CN102902825 B CN 102902825B
- Authority
- CN
- China
- Prior art keywords
- traffic load
- load information
- real time
- time traffic
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The embodiment of the invention discloses a kind of database optimizing method and device, for the real time traffic load data according to acquisition, the service database node in dynamic conditioning service queue, the optimization of fulfillment database service feature, improves data base optimization efficiency.Embodiment of the present invention method comprises: the real time traffic load information regularly obtaining distributed data base node, real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted, according to comparing result, adjust the service database node in described distributed data base node.
Description
Technical field
The present invention relates to communication technical field, particularly relate to a kind of database optimizing method and device.
Background technology
Even to this day, the arriving in " Bigdata " (large data) epoch undoubtedly, especially in the industry such as telecommunications, finance, has almost arrived the stage of " data are exactly business itself ".Large data comprise the multi-class datas such as structuring, semi-structured and destructuring, and wherein massive structured data is stored in distributed data base system.But at large data age, distributed data base system is deployed on insecure computing machine of a large amount of expensive storage, intrasystem node hydraulic performance decline or to break down be normality.
In prior art, the method for distributed data base performance optimization mainly realizes the target of distributed data base performance optimization for individual data storehouse node or fixing performance test program.
But in the above prior art, there is following defect: data base optimization efficiency is low, optimization efficiency for individual data storehouse node is low, the needs that a large amount of distributed data base node of large data environment is optimized cannot be met, and true environment distributed data base system loading condition cannot be reacted due to fixing performance test program, the change of database loads in true environment, and cause data base optimization poor effect.
Summary of the invention
Embodiments provide a kind of database optimizing method and device, in order to promote the effect of optimization of data bank service performance.
The database optimizing method that the embodiment of the present invention provides, comprising: the real time traffic load information regularly obtaining distributed data base node; Real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted; According to comparing result, adjust the service database node in described distributed data base node.
The data base optimization device that the embodiment of the present invention provides, comprising: acquiring unit, for regularly obtaining the real time traffic load information of distributed data base node; Contrast unit, contrasts for the real-time performance parameter in the described real time traffic load information that obtained by described acquiring unit and the Evaluating Models preset; Adjustment unit, for the comparing result according to described contrast unit, adjusts the service database node in described distributed data base node.
As can be seen from the above technical solutions, the embodiment of the present invention has the following advantages: distributed data base middleware server regularly obtains the real time traffic load information with its distributed data base node be connected by network, the real-time performance parameter of each distributed data base node wherein comprised and the Evaluating Models preset are contrasted, this Evaluating Models preset can upgrade along with the renewal of real time traffic load information, according to comparing result, adjust the service database node in described distributed data base node, because distributed data base middleware server regularly globally adjusts service database node according to real time traffic load information, can optimization data storehouse node scope large, improve the efficiency of data base optimization, and Evaluating Models can upgrade according to real time traffic load information, strengthen data base optimization effect.
Accompanying drawing explanation
Fig. 1 is Distributed Database Architceture schematic diagram in the embodiment of the present invention;
Fig. 2 is an embodiment schematic diagram of database optimizing method in the embodiment of the present invention;
Fig. 3 is another embodiment schematic diagram of database optimizing method in the embodiment of the present invention;
Fig. 4 is an embodiment schematic diagram of data base optimization device in the embodiment of the present invention;
Fig. 5 is another embodiment schematic diagram of data base optimization device in the embodiment of the present invention.
Embodiment
Embodiments provide a kind of database optimizing method and device, for the real time traffic load data according to acquisition, the service database node in dynamic conditioning service queue, the optimization of fulfillment database service feature, improves data base optimization efficiency.
Refer to Fig. 1, in the embodiment of the present invention, distributed data base middleware server cluster 101 is connected with distributed data base node cluster 103 by network 102, wherein, distributed data base middleware server cluster 101 is made up of each distributed data base middleware server 104, and distributed data base node cluster 103 is made up of each distributed data base node 105.
In the embodiment of the present invention, the mode of being recurred by database obtains the load information of database in working environment, and then in test environment, reduce the test data of working environment of this database, database is recurred and is referred to catch all load informations in the database of working environment, and can it be sent in test environment, in test environment, recur the working environment of database, make load and the ruuning situation of being reproduced database in true environment by test environment.Recur for making database, complete whole test process, the data bank service load information of acquisition is changed into benchmark test script by distributed data base middleware server, at backstage periodic operation benchmark test script, obtains the real-time performance information of distributed data base each point in real time.
Refer to Fig. 2, an embodiment of the database optimizing method in the embodiment of the present invention comprises:
101, the real time traffic load information of distributed data base node is regularly obtained;
Distributed data base middleware server runs middleware, the real time traffic load information of the distributed data base node that regular acquisition is connected by network with it, what described real time traffic load information comprised business datum enters library information, Query Information, statistical information, analytical information etc., the information of the real-time performance parameter of each distributed data base node is comprised in this real time traffic load information, this real-time performance parameter comprises: the storage of business datum, the index time, renewal speed, deletion speed, with Structured Query Language (SQL) (SQL, the inquiry response speed of the basic load StructuredQueryLanguage) represented, the parameters such as performance weights.
Wherein, middleware is the computer software that a class connects component software and application, and it comprises one group of service, so that the multiple softwares operated on one or more machine are undertaken by network alternately.Middleware is generally used for supporting distributed application program and simplifying its complexity, and it comprises web server, transaction monitor and message queue software.
102, the real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted;
The parameter such as inquiry response speed, performance weights of the basic load that in the present embodiment, the performance evaluation parameter in the Evaluating Models preset can comprise the storage of business datum, index time, renewal speed, deletion speed, SQL represent.This Evaluating Models preset can be when system starts, according to the real time traffic load information of the distributed data base node that first time obtains, set up initial Evaluating Models, also can be the Evaluating Models set up according to the common working condition of system, this Evaluating Models preset can upgrade along with the renewal of real time traffic load information.
Real-time performance parameter in the real time traffic load information obtained, should be all or part of identical with institute's containing parameter in the Evaluating Models preset, be convenient to contrast.
103, according to comparing result, the service database node in described distributed data base node is adjusted.
According to the comparing result of the real-time performance parameter in described real time traffic load information with the Evaluating Models preset, adjust the service database node in described distributed data base node, wherein, service database node refers to the distributed data base node providing business datum to store.
In the embodiment of the present invention, distributed data base middleware server regularly obtains the real time traffic load information with its distributed data base node be connected by network, the real-time performance parameter of each distributed data base node wherein comprised and the Evaluating Models preset are contrasted, this Evaluating Models preset can upgrade along with the renewal of real time traffic load information, according to comparing result, adjust the service database node in described distributed data base node, because distributed data base middleware server regularly globally adjusts service database node according to real time traffic load information, can optimization data storehouse node scope large, improve the efficiency of data base optimization, and Evaluating Models can upgrade according to real time traffic load information, strengthen data base optimization effect.
For ease of understanding, introduce the database optimizing method in the embodiment of the present invention below in detail, refer to Fig. 3, in the embodiment of the present invention, another embodiment of database optimizing method comprises:
201, the real time traffic load information of distributed data base node is regularly obtained;
Distributed data base middleware server regularly obtains the real time traffic load information with its distributed data base node be connected by network, comprises the information of the real-time performance parameter of each distributed data base node in this real time traffic load information.
202, according to described real time traffic load information, judge whether to upgrade described default Evaluating Models;
The real time traffic load information of regular acquisition distributed data base node, this real time traffic load information may change along with the change of network condition, for making the adjustment of service database node more tally with the actual situation, prevent the wrong choice of service database node.Such as, when starting to occur Query Information in the real time load information obtained in preset one section of duration, and statistical information no longer occurs, then upgrade default capabilities evaluation model, add the statement of process about Query Information wherein, delete processing, about the statement of statistical information, makes the performance evaluation parameter in Evaluating Models can be corresponding with the real-time performance parameter in real time traffic load information, is convenient to contrast.
If so, then step 203 is performed; If not, then step 204 is performed.
203, described default Evaluating Models is upgraded;
After upgrading described default Evaluating Models, regularly obtain the real time traffic load information of distributed data base node, carry out subsequent operation.
Particularly, upgrade the relevant information statement in this Evaluating Models, such as, when starting to occur Query Information in the real time load information obtained in preset one section of duration, and statistical information no longer occurs, then add the statement of process about Query Information, delete processing is about the statement of statistical information, intelligible, relative to the real time traffic load information of the distributed data base node that other obtain, the mode also by upgrading the relevant information statement in Evaluating Models upgrades this Evaluating Models.
204, the real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted;
If the performance that the performance of the real-time performance parameter reflection in 205 described real time traffic load information reflects lower than described default Evaluating Models, then, in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding;
If the performance that the performance of the real-time performance parameter reflection in described real time traffic load information reflects lower than described default Evaluating Models, then show the database nodes poor-performing that described real time traffic load information is corresponding, access data speed is slower, temporarily be not suitable for the service providing business datum to access, then in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding.
206, Operational Visit database is switched to the backup database node that the database nodes of described deletion is corresponding.
In the queue of service database node, after deleting database nodes corresponding to described real time traffic load information, for avoid this deleted database nodes on the disappearance of business datum, then Operational Visit database is switched to the backup database node that the database nodes of described deletion is corresponding, provides data access service by this backup database node.
In the present embodiment, distributed data base middleware server regularly obtains the real time traffic load information of the database nodes of described deletion, real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted, if the performance of the real-time performance parameter reflection in the real time traffic load information of the database nodes of described deletion, higher than the performance of described default Evaluating Models reflection, show the database nodes better performances that described real time traffic load information is corresponding, access data speed, then database nodes corresponding for traffic load information time described is added in the queue of service database node, like this, the problem that the overall access performance of the database that large-scale distributed database can be avoided to cause because individual nodes performance is unreliable declines.
In the embodiment of the present invention, distributed data base middleware server regularly obtains the real time traffic load information of distributed data base node, according to described real time traffic load information, judge whether to upgrade described default Evaluating Models, the adjustment of service database node is more tallied with the actual situation, real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted, if the performance that the performance of the real-time performance parameter reflection in described real time traffic load information reflects lower than described default Evaluating Models, then in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding, if the performance of the real-time performance parameter reflection in the real time traffic load information of the database nodes of described deletion, higher than the performance of described default Evaluating Models reflection, then database nodes corresponding for described real time traffic load information is added in the queue of service database node, the real time load information according to distributed data base is realized with this, to the dynamic conditioning of service database node, alleviate the workload for database performance maintenance management, improve the efficiency of data base optimization, strengthen data base optimization effect.
Introduce the data base optimization device in the embodiment of the present invention below, refer to Fig. 4, an embodiment of the data base optimization device in the embodiment of the present invention comprises:
Acquiring unit 301, for regularly obtaining the real time traffic load information of distributed data base node;
Contrast unit 302, contrasts for the real-time performance parameter in the described real time traffic load information that obtained by described acquiring unit 301 and the Evaluating Models preset;
Adjustment unit 303, for the comparing result according to described contrast unit 302, adjusts the service database node in described distributed data base node.
Each unit of the data base optimization device in the embodiment of the present invention realizes the detailed process of respective function, refer to aforementioned embodiment illustrated in fig. 2 in description, repeat no more herein.
In the embodiment of the present invention, acquiring unit 301 regularly obtains the real time traffic load information of distributed data base node, the performance that performance and the Evaluating Models preset of the real-time performance parameter reflection in the real time traffic load information that acquiring unit 301 obtains by contrast unit 302 reflect contrasts, adjustment unit 303 is according to the comparing result of contrast unit 302, service database node in adjustment distributed data base node, because distributed data base middleware server regularly globally adjusts service database node according to real time traffic load information, can optimization data storehouse node scope large, improve the efficiency of data base optimization, and Evaluating Models can upgrade according to real time traffic load information, strengthen data base optimization effect.
For ease of understanding, introduce the data base optimization device in the embodiment of the present invention below in detail, refer to Fig. 5, another embodiment of the data base optimization device in the embodiment of the present invention comprises:
Acquiring unit 401, for regularly obtaining the real time traffic load information of distributed data base node;
Contrast unit 402, contrasts for the real-time performance parameter in the described real time traffic load information that obtained by described acquiring unit 401 and the Evaluating Models preset;
Adjustment unit 403, for the comparing result according to described contrast unit 402, adjusts the service database node in described distributed data base node.
Wherein, adjustment unit 403 can further include:
Delete cells 4031, if for the performance that the performance of the real-time performance parameter reflection in described real time traffic load information reflects lower than described default Evaluating Models, then in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding;
Adding device 4032, if for the performance of the real-time performance parameter reflection in the real time traffic load information of the database nodes of described deletion, higher than the performance of described default Evaluating Models reflection, then database nodes corresponding for described real time traffic load information is added in the queue of service database node.
It should be noted that, the data base optimization device in the embodiment of the present invention can further include:
Switch unit 404, the backup database node that the database nodes for Operational Visit database being switched to described deletion is corresponding;
Judging unit 405, for according to described real time traffic load information, judges whether to upgrade described default Evaluating Models;
Updating block 406, for upgrading described default Evaluating Models.
Each unit of the data base optimization device in the embodiment of the present invention realizes the detailed process of respective function, refer to earlier figures 2 and embodiment illustrated in fig. 3 in description, repeat no more herein.
In the embodiment of the present invention, acquiring unit 401 regularly obtains the real time traffic load information of distributed data base node, according to described real time traffic load information, judging unit 405 judges whether to upgrade described default Evaluating Models, the adjustment of service database node is more tallied with the actual situation, real-time performance parameter in described real time traffic load information and the Evaluating Models preset contrast by contrast unit 402, if the performance that the performance of the real-time performance parameter reflection in described real time traffic load information reflects lower than described default Evaluating Models, then delete cells 4031 is in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding, if the real-time performance parameter in the real time traffic load information of the database nodes of described deletion, higher than described default Evaluating Models, database nodes corresponding for described real time traffic load information adds in the queue of service database node by adding device 4032, the real time load information according to distributed data base is realized with this, to the dynamic conditioning of service database node, alleviate the workload for database performance maintenance management, improve the efficiency of data base optimization, strengthen data base optimization effect.
It will be appreciated by those skilled in the art that all or part of step realized in above-described embodiment method is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be ROM (read-only memory), disk or CD etc.
Above a kind of database optimizing method provided by the present invention and device are described in detail, for those skilled in the art, according to the thought of the embodiment of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (6)
1. a database optimizing method, is characterized in that, comprising:
The real time traffic load information of regular acquisition distributed data base node;
Real-time performance parameter in described real time traffic load information and the Evaluating Models preset are contrasted;
According to comparing result, adjust the service database node in described distributed data base node, comprising:
If the performance that the performance of the real-time performance parameter reflection in described real time traffic load information reflects lower than described default Evaluating Models, then, in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding;
Comprise after the real time traffic load information of described regular acquisition distributed data base node:
According to described real time traffic load information, judge whether to upgrade described default Evaluating Models;
If so, then upgrade described default Evaluating Models, if not, then perform described step of the real-time performance parameter in described real time traffic load information and the Evaluating Models preset being carried out contrast.
2. method according to claim 1, is characterized in that, described in the queue of service database node, comprises after deleting database nodes corresponding to described real time traffic load information:
Operational Visit database is switched to the backup database node that the database nodes of described deletion is corresponding.
3. method according to claim 1 and 2, is characterized in that, described method also comprises:
If the performance of the real-time performance parameter reflection in the real time traffic load information of the database nodes of described deletion, higher than the performance of described default Evaluating Models reflection, then database nodes corresponding for described real time traffic load information is added in the queue of service database node.
4. a data base optimization device, is characterized in that, comprising:
Acquiring unit, for regularly obtaining the real time traffic load information of distributed data base node;
Contrast unit, contrasts for the real-time performance parameter in the described real time traffic load information that obtained by described acquiring unit and the Evaluating Models preset;
Adjustment unit, for the comparing result according to described contrast unit, adjust the service database node in described distributed data base node, described adjustment unit comprises:
Delete cells, if for the performance that the performance of the real-time performance parameter reflection in described real time traffic load information reflects lower than described default Evaluating Models, then in the queue of service database node, delete the database nodes that described real time traffic load information is corresponding;
Judging unit, for according to described real time traffic load information, judges whether to upgrade described default Evaluating Models;
Updating block, for upgrading described default Evaluating Models.
5. device according to claim 4, is characterized in that, described device also comprises:
Switch unit, the backup database node that the database nodes for Operational Visit database being switched to described deletion is corresponding.
6. device according to claim 4, is characterized in that, described adjustment unit also comprises:
Adding device, if for the performance of the real-time performance parameter reflection in the real time traffic load information of the database nodes of described deletion, higher than the performance of described default Evaluating Models reflection, then database nodes corresponding for described real time traffic load information is added in the queue of service database node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210442020.5A CN102902825B (en) | 2012-11-06 | 2012-11-06 | A kind of database optimizing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210442020.5A CN102902825B (en) | 2012-11-06 | 2012-11-06 | A kind of database optimizing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102902825A CN102902825A (en) | 2013-01-30 |
| CN102902825B true CN102902825B (en) | 2015-11-18 |
Family
ID=47575056
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210442020.5A Active CN102902825B (en) | 2012-11-06 | 2012-11-06 | A kind of database optimizing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102902825B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109690429A (en) * | 2017-06-26 | 2019-04-26 | 深圳配天智能技术研究院有限公司 | Control equipment and its control method, the robot system of robot manipulator |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102222090A (en) * | 2011-06-02 | 2011-10-19 | 清华大学 | Mass data resource management frame under cloud environment |
| CN102693324A (en) * | 2012-01-09 | 2012-09-26 | 西安电子科技大学 | Distributed database synchronization system, synchronization method and node management method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7089260B2 (en) * | 2002-02-14 | 2006-08-08 | International Business Machines Corporation | Database optimization apparatus and method |
-
2012
- 2012-11-06 CN CN201210442020.5A patent/CN102902825B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102222090A (en) * | 2011-06-02 | 2011-10-19 | 清华大学 | Mass data resource management frame under cloud environment |
| CN102693324A (en) * | 2012-01-09 | 2012-09-26 | 西安电子科技大学 | Distributed database synchronization system, synchronization method and node management method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102902825A (en) | 2013-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11882054B2 (en) | Terminating data server nodes | |
| CN100571281C (en) | Great magnitude of data hierarchical storage method | |
| EP1872215B1 (en) | Implementing data-compatibility-based version scheme | |
| CN106021445B (en) | It is a kind of to load data cached method and device | |
| CN107818112B (en) | Big data analysis operating system and task submitting method | |
| CN101621405A (en) | Distributed type management monitoring system, monitoring method and establishing method thereof | |
| CN102142024A (en) | Logical data backup and rollback using incremental capture in a distributed database | |
| CN105577475A (en) | Automatic performance test system and method | |
| CN104113576A (en) | Method and device for updating client | |
| CN111752637B (en) | Multi-service inspection management method and device, computer equipment and storage medium | |
| CN103064670A (en) | Method and system for innovation platform data management based on place net | |
| KR102607808B1 (en) | Dynamic reallocating resources for optimized job performance in distributed heterogeneous computer system | |
| WO2012044214A1 (en) | Method and arrangement for processing data | |
| CN110309123A (en) | Processing method, device, computer equipment and the storage medium of database manipulation | |
| US20190179565A1 (en) | Global occupancy aggregator for global garbage collection scheduling | |
| CN106021566A (en) | Method, device and system for improving concurrent processing capacity of single database | |
| CN102236707A (en) | Method, device and system for obtaining update data of database | |
| CN101673217B (en) | Method for realizing remote program call and system thereof | |
| CN101937335A (en) | Method for generating Widget icon, method for generating Widget summary document and Widget engine | |
| CN112764874B (en) | Virtual machine server information acquisition method based on CMDB configuration management system | |
| CN110968569B (en) | Database management method, database management device, and storage medium | |
| CN102902825B (en) | A kind of database optimizing method and device | |
| CN111159142B (en) | Data processing method and device | |
| US9059992B2 (en) | Distributed mobile enterprise application platform | |
| CN113326052A (en) | Method and device for upgrading service component, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20130130 Assignee: Yangzhou Wanfang Electronic Technology Co., Ltd. Assignor: Jiangnan Computing Technology Inst., Wuxi Contract record no.: 2017320000002 Denomination of invention: Database optimization data and method Granted publication date: 20151118 License type: Exclusive License Record date: 20170116 |
|
| LICC | Enforcement, change and cancellation of record of contracts on the licence for exploitation of a patent or utility model |