CN108647123A - A method of improving database monitoring software data acquisition performance - Google Patents
A method of improving database monitoring software data acquisition performance Download PDFInfo
- Publication number
- CN108647123A CN108647123A CN201810271082.1A CN201810271082A CN108647123A CN 108647123 A CN108647123 A CN 108647123A CN 201810271082 A CN201810271082 A CN 201810271082A CN 108647123 A CN108647123 A CN 108647123A
- Authority
- CN
- China
- Prior art keywords
- connection
- monitoring
- connection pool
- machine
- monitored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
Landscapes
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of methods improving database monitoring software data acquisition performance, include the following steps：One, start to monitor, the data information of collection monitoring machine, and create monitoring equipment database connection pool；Two, the monitored machine of cyclic access, collects the data information for the machine of being monitored, and creates one-to-one connection pool, is put into full public library；Three, start specific submonitor, determine monitored machine database information；Four, the connection pool for the machine of being monitored is obtained from global public library；Five, different blocks are divided into according to module, with the connection in the monitored machine connection pool of acquisition, start specific data collection task parallel；Each block completes the data acquisition of oneself, gives back monitored machine connection pool connection；Six, monitoring equipment connection pool is obtained, data storage is carried out with the connection pool connection of acquisition；Monitoring equipment connection is given back after the completion of storage, be finished a monitoring work, starts the monitoring of next round.
Description
Technical field
The present invention relates to database field, specifically a kind of method for improving database monitoring software data acquisition performance.
Background technology
Traditional monitoring means are monitored the distribution of task, every database by following database server by chaptrel
Server has dozens of monitor control index, this little monitor control index is executed collection, write-in monitoring library one by one, the primary process that monitors needs
The time for undergoing dozens of minutes causes the monitoring granularity monitored to service library thicker, is unfavorable for the observation of performance trend.Simultaneously
When to the monitoring of separate unit database, frequent connection and terminal connection request are will produce, leads to the resource consumption mistake of monitored machine
Greatly.For the database monitoring work of the more company of database server, if necessary to install agent or deployment script,
Monitoring deployment flow is cumbersome, and has higher requirements to the performance of monitoring software.
Invention content
It is more for monitored machine number of servers, performance data collection not in time the case where, the present invention provides a set of excellent
The method of change allows enterprise that can obtain performance data in time, and Potential performance problem is found before database delay machine and is handled,
Enterprise is reduced because of direct losses caused by database problem.Specific technical solution is as follows：
A method of database monitoring software data acquisition performance is improved, is included the following steps：
One, start to monitor, the data information of collection monitoring machine, and create monitoring equipment database connection pool；
Two, the monitored machine of cyclic access, collects the data information for the machine of being monitored, and creates one-to-one connection pool, is put into complete
In office's public library；
Three, start specific submonitor, determine monitored machine database information；
Four, the connection pool for the machine of being monitored is obtained from global public library；
Five, different blocks are divided into according to module, it is parallel to start specific number with the connection in the monitored machine connection pool of acquisition
According to collecting work；Each block completes the data acquisition of oneself, gives back monitored machine connection pool connection；
Six, monitoring equipment connection pool is obtained, data storage is carried out with the connection pool connection of acquisition；Monitoring equipment company is given back after the completion of storage
It connects, be finished a monitoring work, starts the monitoring of next round.
Further, by self-detection mechanism, not available connection pool is abandoned, will be lacked in acquisition process for step 4
Connection pool create and be put into public library.
Further, this method is suitable for the databases such as MySQL, Oracle, Redis, MongoDB.
Further, step 3 includes：
a）Obtain the connection of monitoring equipment database connection pool；
b）According to different monitored machine servers, enable different shell scripts and carry out data acquisition, and with monitoring equipment data
Library carries out data storage；
c）Data acquisition and data storage, give back connection, start next round monitoring work.
After the invention, dozens of monitor control index can be divided into more batches of instructions, synchronize and be acquired, simultaneously
The monitoring instruction of each batch is shared with a collection of network connection, is avoided monitoring equipment and is frequently shaken hands with monitored machine and connect, this
Sample, while improving picking rate, there is no the resource consumptions for increasing the machine that is monitored, and have reached a kind of ideal optimization
Purpose.
Description of the drawings
Fig. 1-Fig. 4 is the flow chart of the method for the raising database monitoring software data acquisition performance of the present invention.
Specific implementation mode
The invention will be further described below in conjunction with the accompanying drawings.
As shown in Figs 1-4, the method for raising database monitoring software data acquisition performance of the invention, can be adapted for MySQL,
The monitoring of the databases such as Oracle, Redis, MongoDB.
The database connection pool library of monitoring equipment and monitored machine is predominantly pre-established, carries out the process of data acquisition every time
In, the connection pool in library is only called, data information interaction is carried out.Also, in data acquisition, enable capture program according to mould
Block and monitor control index are divided into different blocks, and connection is called as unit of block, carry out data collection task.
Specific data acquisition：
1. starting to monitor, the data information of collection monitoring machine, and create monitoring equipment database connection pool.
The machine 2. cyclic access is monitored, collects the data information for the machine of being monitored, and creates one-to-one connection pool, is put into
In global public library.
3. start some specific submonitor, the submonitor can be used for MySQL, Oracle, Redis,
The databases such as MongoDB.
4. the connection pool for obtaining the machine of being monitored from public library can be by self-detection mechanism in acquisition process, will be unavailable
Connection pool abandon, the connection pool lacked is created and is put into public library.
5. different blocks are divided into according to module, it is parallel to start specifically with the connection in the monitored machine connection pool of acquisition
Data collection task.It is acquired when a block completes the data of oneself, gives back monitored machine connection pool connection.
6. obtaining monitoring equipment connection pool, data storage is carried out with the connection pool connection of acquisition.Monitoring is given back after the completion of storage
Machine connects, and be finished a monitoring work, starts the monitoring of next round.
Embodiment
By taking the data monitoring of oracle database as an example：
Details are monitored in Web displaying end main presentations, the information of MySQL and monitored machine can be configured, service can be restarted, and
And the frequency of setting monitoring.
Monitoring script reruns according to monitoring frequency：
1. monitoring equipment is MySQL, MySQL data are obtained, MySQL database connection pool is established.
2. monitored machine is Oracle, the machine of being monitored data are obtained, connection pool library, every oracle server pair are established
Answer a connection pool.
3. promoter monitors.
A) connection of MySQL connection pools is obtained.
B) according to different oracle servers, different shell scripts are enabled and carry out data acquisition, and with MySQL numbers
Data storage is carried out according to library.
C) data acquisition and data storage, give back connection, start next round monitoring work.
4. starting Oracle monitoring.
A) connection pool of a certain oracle server is obtained, if connection exists, test connection is unavailable, abandons, can
With then asking to connect.If connection is not present, the connection pool of the server is established.
B) according to module difference, it is divided into different blocks, such as：Internal memory monitoring, ASM monitoring, activity monitoring, they adopt parallel
Collect data.In each block, the connection pool of same oracle server is shared, connecting progress data to connection pool application adopts
Collection, gives back connection after the completion.
C) connection pool of MySQL is obtained, application connection stores collected data to MySQL database.Storage is completed
After give back connection, executed Oracle monitoring, started next round monitoring work.
Claims (4)
1. a kind of method improving database monitoring software data acquisition performance, includes the following steps：
One, start to monitor, the data information of collection monitoring machine, and create monitoring equipment database connection pool；
Two, the monitored machine of cyclic access, collects the data information for the machine of being monitored, and creates one-to-one connection pool, is put into complete
In office's public library；
Three, start specific submonitor, determine monitored machine database information；
Four, the connection pool for the machine of being monitored is obtained from global public library；
Five, different blocks are divided into according to module, it is parallel to start specific number with the connection in the monitored machine connection pool of acquisition
According to collecting work；Each block completes the data acquisition of oneself, gives back monitored machine connection pool connection；
Six, monitoring equipment connection pool is obtained, data storage is carried out with the connection pool connection of acquisition；Monitoring equipment company is given back after the completion of storage
It connects, be finished a monitoring work, starts the monitoring of next round.
2. the method for improving database monitoring software data acquisition performance as described in claim 1, it is characterised in that：
Step 4, by self-detection mechanism, not available connection pool is abandoned in acquisition process, and the connection pool lacked is created
And it is put into public library.
3. the method for improving database monitoring software data acquisition performance as claimed in claim 1 or 2, it is characterised in that：It should
Method is suitable for the databases such as MySQL, Oracle, Redis, MongoDB.
4. the method for improving database monitoring software data acquisition performance as claimed in claim 1 or 2, it is characterised in that：Step
Rapid three include：
a）Obtain the connection of monitoring equipment database connection pool；
b）According to different monitored machine servers, enable different shell scripts and carry out data acquisition, and with monitoring equipment data
Library carries out data storage；
c）Data acquisition and data storage, give back connection, start next round monitoring work.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810271082.1A CN108647123A (en) | 2018-03-29 | 2018-03-29 | A method of improving database monitoring software data acquisition performance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810271082.1A CN108647123A (en) | 2018-03-29 | 2018-03-29 | A method of improving database monitoring software data acquisition performance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108647123A true CN108647123A (en) | 2018-10-12 |
Family
ID=63744790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810271082.1A Pending CN108647123A (en) | 2018-03-29 | 2018-03-29 | A method of improving database monitoring software data acquisition performance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108647123A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2790320A1 (en) * | 1999-02-25 | 2000-09-01 | Direct Video | System for monitoring the correct operation of a database and for starting the latter after a fault |
| US20100094988A1 (en) * | 2008-10-09 | 2010-04-15 | International Business Machines Corporation | automatic discovery framework for integrated monitoring of database performance |
| CN103188103A (en) * | 2011-12-31 | 2013-07-03 | 成都勤智数码科技股份有限公司 | Self-monitoring method of network management system |
| CN104503894A (en) * | 2014-12-31 | 2015-04-08 | 中国石油天然气股份有限公司 | System and method for monitoring state of distributed server in real time |
| US20160092547A1 (en) * | 2014-09-26 | 2016-03-31 | Oracle International Corporation | System and method for efficient connection management in a massively parallel or distributed database environment |
| CN107423198A (en) * | 2017-07-10 | 2017-12-01 | 中核核电运行管理有限公司 | A kind of EAM platform monitorings management method and system |
-
2018
- 2018-03-29 CN CN201810271082.1A patent/CN108647123A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2790320A1 (en) * | 1999-02-25 | 2000-09-01 | Direct Video | System for monitoring the correct operation of a database and for starting the latter after a fault |
| US20100094988A1 (en) * | 2008-10-09 | 2010-04-15 | International Business Machines Corporation | automatic discovery framework for integrated monitoring of database performance |
| CN103188103A (en) * | 2011-12-31 | 2013-07-03 | 成都勤智数码科技股份有限公司 | Self-monitoring method of network management system |
| US20160092547A1 (en) * | 2014-09-26 | 2016-03-31 | Oracle International Corporation | System and method for efficient connection management in a massively parallel or distributed database environment |
| CN104503894A (en) * | 2014-12-31 | 2015-04-08 | 中国石油天然气股份有限公司 | System and method for monitoring state of distributed server in real time |
| CN107423198A (en) * | 2017-07-10 | 2017-12-01 | 中核核电运行管理有限公司 | A kind of EAM platform monitorings management method and system |
Non-Patent Citations (1)
| Title |
|---|
| 兰阅: "电信网络管理系统网络监控子系统的设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111078488B (en) | Data acquisition method, device, storage medium and system | |
| US8683268B2 (en) | Key based cluster log coalescing | |
| CN104182288A (en) | Method for automatically testing power consumption of server cluster system | |
| CN108369550B (en) | Real-time alteration of data from different sources | |
| CN110245145A (en) | Structure synchronization method and apparatus of the relevant database to Hadoop database | |
| CN112434043B (en) | Data synchronization method, device, electronic equipment and medium | |
| CN106776165A (en) | Server performance method of testing and system | |
| CN108140035B (en) | Database replication method and device for distributed system | |
| CN109597764A (en) | A kind of test method and relevant apparatus of catalogue quota | |
| CN110659138B (en) | Data synchronization method, device, terminal and storage medium based on timing task | |
| CN113032281B (en) | Method and device for acquiring code coverage rate in real time | |
| CN108647123A (en) | A method of improving database monitoring software data acquisition performance | |
| CN113704077B (en) | Test case generation method and device | |
| CN103412776A (en) | Method for debugging blade server in parallel | |
| CN111901405B (en) | Multi-node monitoring method and device, electronic equipment and storage medium | |
| CN106445812B (en) | Regression test system and regression testing method | |
| CN108052574A (en) | Slave ftp server based on Kafka technologies imports the ETL system and implementation method of mass data | |
| CN114070707A (en) | Internet performance monitoring method and system | |
| CN111143177B (en) | Method, system, device and storage medium for collecting RMF III data of IBM host | |
| CN115438056A (en) | Data acquisition method, device, equipment and storage medium | |
| CN112527497B (en) | Serialized multithreaded data processing system | |
| CN112800140A (en) | High-reliability data acquisition method based on block chain prediction machine | |
| CN109828983B (en) | PG database processing method, device, electronic equipment and storage medium | |
| CN108874527B (en) | Method for splitting and collecting IAAS index and PAAS index | |
| CN109901963A (en) | Test method, the system, terminal of optimization hard disk performance test under a kind of linux |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181012 |
|
| RJ01 | Rejection of invention patent application after publication |