CN108241566A - A kind of data-base performance monitoring method based on configuration - Google Patents
A kind of data-base performance monitoring method based on configuration Download PDFInfo
- Publication number
- CN108241566A CN108241566A CN201810145587.3A CN201810145587A CN108241566A CN 108241566 A CN108241566 A CN 108241566A CN 201810145587 A CN201810145587 A CN 201810145587A CN 108241566 A CN108241566 A CN 108241566A
- Authority
- CN
- China
- Prior art keywords
- acquisition
- data
- masterplate
- database
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3452—Performance evaluation by statistical analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Computer Hardware Design (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of data-base performance monitoring methods based on configuration, include the following steps：S1 acquisition masterplate, the acquisition index and alarm regulation of setting acquisition masterplate) are created；S2 grab type, acquisition mode, acquisition script and acquisition condition) is configured；S3 acquisition index) is configured；The step S1 is first according to the type of the database acquisition masterplate different with edition protection, for the acquisition masterplate of the same version of same type, continue to be divided by business scenario, every equipment selects an acquisition masterplate, and an acquisition masterplate can configure multiple grab types and multiple alarm regulations.The data-base performance monitoring method based on configuration of the present invention, user passes through the acquisition mode of configuration database performance indicator, grab type, acquisition script and acquisition condition, and the index of same type either same version, it is integrated into a masterplate, when database monitoring is accessed, carry masterplate is only needed to can reach the purpose of " primary configuration, permanent to monitor ".
Description
Technical field
The present invention relates to a kind of data-base performance monitoring method more particularly to a kind of data-base performance monitorings based on configuration
Method.
Background technology
Current most of enterprise monitors the performance data of database and manually goes to complete by DBA, including to database
The monitoring of the performance indicators such as slow SQL query, active session, performance evaluation and database parameter modification.These performance indicators are obtained,
Purpose equipment is logged on to every time, inputs corresponding querying command, and process is cumbersome, and human cost can also be with monitored
Quantity database increases and increases.
Existing general processing method is as follows：1st, it is manually entered order inquiry；2nd, manually or using timing operation foot is performed
This simultaneously exports result；3rd, it is needed for different monitoring projects individually operated.
Existing processing method has the disadvantage that：1st, every time obtain database performance data will logging device it is defeated order look into
It askes.2nd, primary configuration can not be realized, it is permanent to monitor.3rd, it without monitoring collection masterplate, needs manually to select item by item.
It is therefore desirable to provide a comprehensive configuration visual angle, user configuration database performance acquisition index is allowed, once match
It puts, it is permanent to monitor.This can not only improve monitoring precision, moreover it is possible to reduce O＆M cost.
Invention content
The technical problems to be solved by the invention are to provide a kind of data-base performance monitoring method based on configuration, can solve
The problem of certainly obtaining the performance data of database every time logging device and will can not realize primary configuration, permanent monitoring.
The present invention is to solve above-mentioned technical problem and the technical solution adopted is that provide a kind of database based on configuration
Energy monitoring method, includes the following steps：S1 acquisition masterplate, the acquisition index and alarm regulation of setting acquisition masterplate) are created；S2)
Grab type, acquisition mode, acquisition script and acquisition condition is configured；S3 acquisition index) is configured.
The above-mentioned data-base performance monitoring method based on configuration, wherein, the step S1 is first according to the type of database
The acquisition masterplate different with edition protection for the acquisition masterplate of the same version of same type, continues to be drawn by business scenario
Point, every equipment selects an acquisition masterplate, and an acquisition masterplate can configure multiple grab types and multiple alarm regulations.
The above-mentioned data-base performance monitoring method based on configuration, wherein, the type point of the database in the step S1
For Oracle, Mysql, Db2 and sql server four major types, the masterplate of the same version of same type is divided by business scenario
Ogg monitors masterplate and non-ogg monitoring masterplates.
The above-mentioned data-base performance monitoring method based on configuration, wherein, grab type separate service is adopted in the step S2
Collection and non-traffic acquisition；When grab type is acquired for business, a kind of grab type is often configured, can all create a horizontal table to deposit
Gathered data is stored up, when grab type is non-traffic acquisition, gathered data is uniformly stored in multiple perpendicular tables；The step S3 sieves
It selects single field or the value of single record, each field corresponds to an index, so as to what grab type acquisition was returned
Data, in the form of index in storage to horizontal table or perpendicular table.
The above-mentioned data-base performance monitoring method based on configuration, wherein, multiple described perpendicular tables are to different data classifying type
Storage with the perpendicular table that unit ends up, stores integer data；With the perpendicular table that str ends up, word string string data is stored；It is ended up with text
Perpendicular table, store big text data；The perpendicular table storing daily record data to be ended up with log；With double endings, floating point type is stored
Data.
The above-mentioned data-base performance monitoring method based on configuration, wherein, acquisition mode is divided into JDBC in the step S2
Acquisition and SSH acquisitions；When acquisition mode is JDBC, acquisition target is database, and corresponding acquisition script is SQL；Work as acquisition
When mode is SSH, acquisition target is the host where database, and corresponding script format is shell scripts；If SQL
Shell scripts are carried into ginseng, then are configured in acquisition condition.
The above-mentioned data-base performance monitoring method based on configuration, wherein, when acquisition mode is JDBC, by acquiring mould
Version obtains the IP ports of database, database account number cipher, and target database is linked to by JDBC modes, performs corresponding
SQL scripts obtain result and return, and be persisted to local data base.
The above-mentioned data-base performance monitoring method based on configuration, wherein, when acquisition mode is SSH, by acquiring mould
The IP ports of host, account number cipher information where version obtains database by the connection mode of SSH, log on to database place
Host, perform corresponding shell scripts, obtain result and return, and in persistence local data base.
The present invention comparison prior art has following advantageous effect：Database performance prison provided by the invention based on configuration
Prosecutor method, user pass through the acquisition mode of configuration database performance indicator, grab type, acquisition script and acquisition condition, and handle
The index of same type either same version, is integrated into a masterplate, when database monitoring is accessed, only needs carry mould
Version can reach the purpose of " primary configuration, permanent to monitor ".
Description of the drawings
Fig. 1 is the data-base performance monitoring flow diagram the present invention is based on configuration.
Specific embodiment
The invention will be further described with reference to the accompanying drawings and examples.
Fig. 1 is the data-base performance monitoring flow diagram the present invention is based on configuration.
Fig. 1 is referred to, the data-base performance monitoring method provided by the invention based on configuration includes the following steps：
S1 acquisition masterplate, the acquisition index and alarm regulation of setting acquisition masterplate) are created；
S2 grab type, acquisition mode, acquisition script and acquisition condition) is configured；
S3 acquisition index) is configured.
Data-base performance monitoring method provided by the invention based on configuration is matched including the configuration of acquisition masterplate and database
It puts, the crucial configuration in acquisition index type.
1. acquire masterplate configuration：Database performance acquisition index, including acquisition mode, grab type, acquisition script, adopt
Collection condition is configured to masterplate, and an equipment corresponds to a masterplate, and a masterplate is applicable to multiple devices, when access monitoring data
When library, the corresponding masterplate of carry, you can reach primary configuration, the effect permanently monitored.
2. database is configured：User can be by accessing the database to be monitored, the credential information in pre-stored data library, and hangs
Corresponding template information is carried, user can need not log on to corresponding equipment, just can get the performance data of database.
The configuration information of the database of the present invention, the account number cipher and database of IP ports, database including database
IP ports, account number cipher information and the database of place host acquire the configuration information of masterplate, such as acquisition mode, acquisition class
Type, acquisition script, acquisition condition etc. can be all persisted in database.When acquisition tasks are generated, background program is just
The corresponding information of data can be obtained according to acquisition mode, such as：If the acquisition mode of JDBC, the IP ends of database will be obtained
Mouth, database account number cipher, are linked to target database, and perform corresponding SQL scripts by way of JDBC on-link mode (OLM)s,
Result is obtained to return, and be persisted to local data base；If the connection mode of SSH, host where database will be obtained
IP ports, account number cipher information, by the connection mode of SSH, log on to the host where database, perform corresponding
Shell scripts obtain result and return, and in persistence local data base.
The specific implementation step of the present invention is given below：
1st, acquisition masterplate is created
Acquisition masterplate is created, acquisition index and alarm regulation including setting masterplate；It acquires masterplate and mainly gives acquisition class
Type is classified.The standard of classification is divided essentially according to the type and version of database, is divided according to type of database, can
It is divided into Oracle, Mysql, Db2, sql server four major types；Divided according to database version, as oracle10g,
Oracle11g etc..For certain specific scenes, the masterplate of the same version of same type can also be divided by business scenario,
As ogg monitors masterplate and non-ogg monitoring masterplates.One equipment can only select an acquisition masterplate, and an acquisition masterplate can configure
Multiple grab types and multiple alarm regulations.By the division of masterplate, monitoring product is in implementation phase, with regard to that can quickly access monitoring
Database is saved and is implemented and the O＆M time.
2nd, acquisition index type is configured
It is configured where core of the acquisition index type for the present invention, configuration acquisition index is mainly configured grab type, adopts
Mode set, acquisition script and acquisition condition.
Grab type is mainly separate service acquisition and non-traffic acquisition.Grab type is business acquisition, and often configuration is a kind of
Type can all create a horizontal table to store gathered data.Grab type is non-traffic acquisition, and gathered data is uniformly stored in
In multiple perpendicular tables.Perpendicular table is mainly the storage organization of key-value pair, and different perpendicular tables stores different data.With unit endings
Perpendicular table, stores integer data；With the perpendicular table that str ends up, word string string data is stored；With the perpendicular table that text ends up, big text is stored
Data；The perpendicular table storing daily record data to be ended up with log；With double endings, the data of floating point type are stored.Classifying type is deposited
Storage, can not only maximally utilise memory space, moreover it is possible to the quick of data be facilitated to calculate and handle.
Acquisition mode is broadly divided into JDBC acquisitions and SSH acquisitions.Acquisition mode is JDBC, and acquisition target is database；It adopts
Mode set is SSH's, and acquisition target is the host where database.Therefore, it while being configured with acquisition mode, also defines and adopts
Collect the form of script.Acquisition mode is JDBC's, and acquisition script can only be SQL, and acquisition mode is SSH, and script format can only
It is shell scripts；If SQL shell scripts need into ginseng, can be configured in acquisition condition, acquisition condition can be one often
Amount, or the value in other acquisition indexes.
3. acquisition index is configured
Acquisition index is the least unit of gathered data, is acquired with SQL or order returning as a result, may
There are a plurality of record or multiple fields, the value of single field either single record how can be filtered out, this just refers to
Target defines, and a field just corresponds to an index, and when being configured with index, the data of grab type acquisition back just can be with finger
In target form storage to the either perpendicular table of horizontal table；When data type is integer, storage to the perpendicular table of unit endings；Work as number
During according to type for character string, storage to the perpendicular table of str endings；When data type is text, storage to the perpendicular table of text endings；
When data type is daily record, storage to the perpendicular table of log endings；When data type is floating point type, storage to double is tied
The perpendicular table of tail.
In conclusion the data-base performance monitoring method provided by the invention based on configuration, by database carry masterplate,
Masterplate level of control type；Monitoring data library property is gone by the acquisition mode of configuration database performance, grab type, acquisition script
Energy.When grab type is acquired for business, some horizontal tables of meeting dynamic generation go to receive gathered data；When grab type is non-
When business acquires, in gathered data meeting divided data type storage to different perpendicular tables.Specific advantage is as follows：1. database
It can monitoring realization configurationization programming.DBA does not need to repeat logon to target device, inputs order acquisition database performance data,
Service logic only need to be paid close attention in itself.It is set by database performance pointer type, you can reach database performance data monitoring.2.
By the way that the performance data of acquisition back is configured, exploitation can quickly expand each business and compatible various businesses reschedualing, such as
Trend trend of performance data etc., so as to greatly reduce development cost and O＆M implementation cost.
Although the present invention is disclosed as above with preferred embodiment, however, it is not to limit the invention, any this field skill
Art personnel, without departing from the spirit and scope of the present invention, when can make a little modification and it is perfect, therefore the present invention protection model
It encloses to work as and is subject to what claims were defined.
Claims (8)
1. a kind of data-base performance monitoring method based on configuration, which is characterized in that include the following steps：
S1 acquisition masterplate, the acquisition index and alarm regulation of setting acquisition masterplate) are created；
S2 grab type, acquisition mode, acquisition script and acquisition condition) is configured；
S3 acquisition index) is configured.
2. the data-base performance monitoring method based on configuration as described in claim 1, which is characterized in that the step S1 is first pressed
According to the type of the database acquisition masterplate different with edition protection, for the acquisition masterplate of the same version of same type, continue by
Business scenario is divided, and every equipment selects an acquisition masterplate, and an acquisition masterplate can configure multiple grab types and more
A alarm regulation.
3. the data-base performance monitoring method based on configuration as claimed in claim 2, which is characterized in that in the step S1
The type of database is divided into Oracle, Mysql, Db2 and sql server four major types, and the masterplate of the same version of same type is pressed
Business scenario is divided into ogg monitoring masterplates and non-ogg monitoring masterplates.
4. the data-base performance monitoring method based on configuration as described in claim 1, which is characterized in that adopted in the step S2
Collect the acquisition of type separate service and non-traffic acquisition；When grab type is acquired for business, a kind of grab type is often configured, can all create
A horizontal table is built to store gathered data, when grab type is non-traffic acquisition, gathered data is uniformly stored in multiple perpendicular tables
In；The step S3 filters out single field or the value of single record, each field correspond to an index, so as to acquire
The data of type acquisition back, in the form of index in storage to horizontal table or perpendicular table.
5. the data-base performance monitoring method based on configuration as claimed in claim 4, which is characterized in that multiple described perpendicular tables pair
Different data classifying type stores, and with the perpendicular table that unit ends up, stores integer data；With the perpendicular table that str ends up, word string string number is stored
According to；With the perpendicular table that text ends up, big text data is stored；The perpendicular table storing daily record data to be ended up with log；It is ended up with double
, store the data of floating point type.
6. the data-base performance monitoring method based on configuration as described in claim 1, which is characterized in that adopted in the step S2
Mode set is divided into JDBC acquisitions and SSH acquisitions；When acquisition mode is JDBC, acquisition target is database, corresponding acquisition foot
This is SQL；When acquisition mode is SSH, acquisition target is the host where database, and corresponding script format is shell feet
This；If SQL shell scripts carry into ginseng, be configured in acquisition condition.
7. the data-base performance monitoring method based on configuration as claimed in claim 6, which is characterized in that when acquisition mode is
During JDBC, the IP ports of database, database account number cipher are obtained by acquiring masterplate, number of targets is linked to by JDBC modes
According to library, corresponding SQL scripts are performed, result is obtained and returns, and be persisted to local data base.
8. the data-base performance monitoring method based on configuration as claimed in claim 6, which is characterized in that when acquisition mode is
During SSH, the IP ports of host, account number cipher information where obtaining database by acquiring masterplate, by the connection mode of SSH,
Log on to the host where database, perform corresponding shell scripts, obtain result and return, and in persistence local data base.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810145587.3A CN108241566A (en) | 2018-02-12 | 2018-02-12 | A kind of data-base performance monitoring method based on configuration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810145587.3A CN108241566A (en) | 2018-02-12 | 2018-02-12 | A kind of data-base performance monitoring method based on configuration |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108241566A true CN108241566A (en) | 2018-07-03 |
Family
ID=62699920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810145587.3A Pending CN108241566A (en) | 2018-02-12 | 2018-02-12 | A kind of data-base performance monitoring method based on configuration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108241566A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109451041A (en) * | 2018-12-10 | 2019-03-08 | 浪潮(北京)电子信息产业有限公司 | A kind of SSH link connection method, device, equipment and storage medium |
| WO2020015116A1 (en) * | 2018-07-18 | 2020-01-23 | 平安科技（深圳）有限公司 | Database monitoring method and terminal device |
| CN110908976A (en) * | 2019-10-29 | 2020-03-24 | 中国建设银行股份有限公司 | Accumulation fund data acquisition method and system |
| CN111274085A (en) * | 2020-01-14 | 2020-06-12 | 中科驭数（北京）科技有限公司 | Database monitoring system and method |
| CN112988875A (en) * | 2021-04-08 | 2021-06-18 | 北京澎思科技有限公司 | Multi-dimensional data acquisition device, system and method |
-
2018
- 2018-02-12 CN CN201810145587.3A patent/CN108241566A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020015116A1 (en) * | 2018-07-18 | 2020-01-23 | 平安科技（深圳）有限公司 | Database monitoring method and terminal device |
| CN109451041A (en) * | 2018-12-10 | 2019-03-08 | 浪潮(北京)电子信息产业有限公司 | A kind of SSH link connection method, device, equipment and storage medium |
| CN110908976A (en) * | 2019-10-29 | 2020-03-24 | 中国建设银行股份有限公司 | Accumulation fund data acquisition method and system |
| CN111274085A (en) * | 2020-01-14 | 2020-06-12 | 中科驭数（北京）科技有限公司 | Database monitoring system and method |
| CN112988875A (en) * | 2021-04-08 | 2021-06-18 | 北京澎思科技有限公司 | Multi-dimensional data acquisition device, system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108241566A (en) | A kind of data-base performance monitoring method based on configuration | |
| CN108038222B (en) | System of entity-attribute framework for information system modeling and data access | |
| US11269476B2 (en) | Concurrent display of search results from differing time-based search queries executed across event data | |
| CN106294887B (en) | The description method to object existing for objective world and event based on space-time | |
| US10872162B2 (en) | Role-based security policy for an object-oriented database system | |
| CN105683956B (en) | The dimension data being intensively grouped | |
| US9824127B2 (en) | Systems and methods for interest-driven data visualization systems utilized in interest-driven business intelligence systems | |
| CN110019396A (en) | A kind of data analysis system and method based on distributed multidimensional analysis | |
| EP1585036A2 (en) | Management of parameterized database queries | |
| CN106682097A (en) | Method and device for processing log data | |
| CN107133362A (en) | Commodity Information Search method, system, computer program and electronic equipment | |
| CN103020158A (en) | Report form creation method, device and system | |
| CN110442620B (en) | Big data exploration and cognition method, device, equipment and computer storage medium | |
| CN109254901B (en) | A kind of Monitoring Indexes method and system | |
| CN109740129B (en) | Report generation method, device and equipment based on blockchain and readable storage medium | |
| CN109313640A (en) | Method and system for data base optimization | |
| CN105302697B (en) | A kind of running state monitoring method and system of density data model database | |
| CN111414410B (en) | Data processing method, device, equipment and storage medium | |
| CN108776678A (en) | Index creation method and device based on mobile terminal NoSQL databases | |
| CN106682099A (en) | Data storage method and device | |
| CN108182204A (en) | The processing method and processing device of data query based on house prosperity transaction multi-dimensional data | |
| CN109033157B (en) | Complex data retrieval method and system based on user-defined search condition tree | |
| CN109359205A (en) | A kind of remote sensing image cutting method and equipment based on geographical grid | |
| EP4052138A1 (en) | Single view presentation of multiple queries in a data visualization application | |
| CN112800016A (en) | Log data classification and sorting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180703 |