CN108829557A - A kind of server performance monitor data analysing method and system based on OpenTSDB database - Google Patents
A kind of server performance monitor data analysing method and system based on OpenTSDB database Download PDFInfo
- Publication number
- CN108829557A CN108829557A CN201810442084.2A CN201810442084A CN108829557A CN 108829557 A CN108829557 A CN 108829557A CN 201810442084 A CN201810442084 A CN 201810442084A CN 108829557 A CN108829557 A CN 108829557A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- opentsdb
- api interface
- http request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The present invention provides a kind of server performance monitor data analysing methods based on OpenTSDB database, including issue Http request；The Http request is received, and the request condition based on the Http request received starts multiple threads, wherein the per thread in the multiple thread configures different period parameters；The multiple thread calls the api interface of OpenTSDB database simultaneously；By the returned data storage of the api interface of the OpenTSDB database to MySQL database；The returned data of the storage into the MySQL database is analyzed and generates analysis result.The present invention can be improved the search efficiency of the performance monitoring data in OpenTSDB database, so that more complicated monitoring data be supported to analyze, improve the working efficiency of operation maintenance personnel.The invention also discloses a kind of server performance monitor data analysis systems based on OpenTSDB database.
Description
Technical field
The present invention relates to data monitoring technical field more particularly to a kind of server performances based on OpenTSDB database
Monitoring data analysis method and system.
Background technique
OpenFalcon system is current existing a O&M monitoring system, using the data filing strategy of rrdtool,
Second grade returns to 1 year historical data of a monitored item up to a hundred and data tendency chart.But it does not support the monitoring of up to ten thousand servers
Data aggregate.The Flexible Query for not being able to satisfy monitoring data and data statistics distribution are configured since its Working level is other, so greatly
Part company needs to carry out secondary development to the system when application system.OpenTSDB database at present carries
One simple Web query page, can only query monitor item according to the time be sequence monitoring value.If query time span
Greatly, and once the data of up to ten thousand servers are requested, inquiry and display data can be very slow, and do not support multiple queries condition
Query composition.
Although existing OpenTSDB database has many good qualities in terms of storing data, and provides the letter of basic query
Single Web page, but it is directed to advanced inquiry, it is big to expose two in monitoring system data query and analysis for flexibility ratio shortcoming
Disadvantage：First, existing OpenTSDB database appoints the monitoring data polymerization of fine-grained up to ten thousand servers for a long time
Business, query time is too long, or even exceeds the response time, seriously affected operation maintenance personnel to the statistics and analysis of alert data when
Between require；Second, the data of OpenTSDB database, every data has the timestamp of oneself, and query result is with time sequencing
It returns, can also be with time aggregation data, but serious shortcoming is to the ranking function branch of the other conditions other than timestamp
It holds.
Therefore, the search efficiency of performance monitoring data in OpenTSDB database how is improved, to support more complicated
Monitoring data analysis, the working efficiency for improving operation maintenance personnel are a problem to be solved.
Summary of the invention
In view of this, the present invention provides a kind of server performance monitor data analysis side based on OpenTSDB database
Method and system, this hair can it is bright improve OpenTSDB database in performance monitoring data search efficiency, thus support it is more multiple
Miscellaneous monitoring data analysis, improves the working efficiency of operation maintenance personnel.
The present invention provides a kind of server performance monitor data analysing method based on OpenTSDB database, the sides
Method includes：
Issue Http request；
The Http request is received, and the request condition based on the Http request received starts multiple threads,
In, the per thread in the multiple thread configures different period parameters；
The multiple thread calls the api interface of OpenTSDB database simultaneously；
By the returned data storage of the api interface of the OpenTSDB database to MySQL database；
The returned data of the storage into the MySQL database is analyzed and generates analysis result.
Preferably, the method also includes：
By the Request required parameter of api interface described in average value aggregation configuration.
Preferably, the method also includes：
The analysis result is shown.
Preferably, the method also includes：
Demand is shown according to front end, and the analysis result is optimized and handled, and front end is returned to Json format.
Preferably, the returned data storage of the api interface by the OpenTSDB database has to MySQL database
Body includes：
The returned data of the api interface of the OpenTSDB database is stored sequentially in time to MySQL database.
A kind of server performance monitor data analysis system based on OpenTSDB database, the system comprises：
Data demand module：For issuing Http request；
Data processing module：For receiving the Http request, and the request item based on the Http request received
Part starts multiple threads, wherein the per thread in the multiple thread configures different period parameters；
Data call module：Call the api interface of OpenTSDB database simultaneously for the multiple thread；
Data memory module：For storing the returned data of the api interface of the OpenTSDB database to MySQL number
According to library；
Data analysis module：For the returned data of the storage into the MySQL database to be analyzed and is given birth to
At analysis result.
Preferably, the system also includes：
Parameter configuration module：For the Request required parameter by api interface described in average value aggregation configuration.
Preferably, the system also includes：
Data display module：For being shown to the analysis result.
Preferably, the system also includes：
Data-optimized module：For according to front end displaying demand, the analysis result being optimized and being handled, and with
Json format returns to front end.
Preferably, the data memory module is specifically used for：
The returned data of the api interface of the OpenTSDB database is stored sequentially in time to MySQL database.
It can be seen from the above technical proposal that the present invention provides a kind of server performances based on OpenTSDB database
Monitoring data analysis method, including issue Http request；The Http request is received, and based on the Http request received
Request condition start multiple threads, wherein the per thread in the multiple thread configures different period parameters；It is described
Multiple threads call the api interface of OpenTSDB database simultaneously；By the return number of the api interface of the OpenTSDB database
MySQL database is arrived according to storage；The returned data of the storage into the MySQL database is analyzed and generates analysis
As a result.The present invention can be improved the search efficiency of the performance monitoring data in OpenTSDB database, to support more complicated
Monitoring data analysis, improves the working efficiency of operation maintenance personnel.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is that a kind of server performance monitor data analysing method based on OpenTSDB database disclosed by the invention is real
Apply the method flow diagram of example 1；
Fig. 2 is that a kind of server performance monitor data analysing method based on OpenTSDB database disclosed by the invention is real
Apply the method flow diagram of example 2；
Fig. 3 is that a kind of server performance monitor data analysis system based on OpenTSDB database disclosed by the invention is real
Apply the structural schematic diagram of example 1；
Fig. 4 is that a kind of server performance monitor data analysis system based on OpenTSDB database disclosed by the invention is real
Apply the structural schematic diagram of example 2.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
As shown in Figure 1, for a kind of server performance monitor data based on OpenTSDB database point disclosed by the invention
The method flow diagram for analysing embodiment of the method 1, the method includes：
S101, Http request is issued；
When needing query service device performance monitoring information, HTTP request is issued by monitoring system front end first.
S102, Http request is received, and the request condition based on the Http request received starts multiple threads, wherein
Per thread in multiple threads configures different period parameters；
Rear end receives Http request, after receiving Http request, starts multiple threads according to request condition, matches to per thread
Different period parameters is set, so that per thread be made to inquire monitoring data in different time periods.
S103, multiple threads call the api interface of OpenTSDB database simultaneously；
After starting multiple threads and having configured different period parameters for per thread, per thread needs parallel simultaneously
The API data query interface for calling OpenTSDB database to provide.
S104, the returned data of the api interface of OpenTSDB database is stored to MySQL database；
When the API data query interface provided by multiple thread dispatching OpenTSDB databases, corresponding API can be obtained
Interface returned data is needed the returned data storage of the api interface of these OpenTSDB databases to MySQL database.
S105, returned data of the storage into MySQL database is analyzed and generates analysis result.
After the returned data storage to MySQL database of the api interface of OpenTSDB database, need to be inquired according to front end
Demand analyzes the returned data of api interface, at the same generate analysis as a result, and will analysis result return to monitoring system before
End.
In conclusion in the above-described embodiments, when needing query service device performance monitoring information, sending Http first is asked
It asks；Then Http request is received, and the request condition based on the Http request received starts multiple threads, wherein multiple lines
Per thread in journey configures different period parameters；Multiple threads call the api interface of OpenTSDB database simultaneously；It connects
By the returned data of the api interface of OpenTSDB database storage to MySQL database；MySQL data finally are arrived to storage
Returned data in library is analyzed and generates analysis result.Various time conditions, multiple servers may be implemented in the present invention
The query composition of monitoring data, and realize the display and analysis of monitoring data, span when solving OpenTSDB data base querying
The problem of inquiry that occurs when spending the task of the performance monitoring data of up to ten thousand servers of big fine size is slow and query timeout.
The present invention carries out data tune based on the performance monitoring data of OpenTSDB database purchase, using multithreading, time segment
With, caching, allow operation maintenance personnel that can quickly see the performance data of up to ten thousand monitored servers.In combination with other services
Device management system is realized every monitor control index of the server of monitoring and the hardware information of server itself while being shown, may be used also
To support operation maintenance personnel according to essential informations such as server ip, the affiliated service lines of server, each of corresponding server is inquired
Item monitoring information.The present invention can be improved the search efficiency of the performance monitoring data in OpenTSDB database, to support more
Complicated monitoring data analysis, improves the working efficiency of operation maintenance personnel.
Specifically, in the above-described embodiments, the Http request that monitoring system front end issues includes being issued according to querying condition
Capability request and performance utilization rate distribution map needed for request of data etc..
Specifically, in the above-described embodiments, the api interface of the OpenTSDB database into MySQL database is stored
Returned data includes the title of monitored item, timestamp, and monitored item presses the monitoring value after smaller time length aggregate, and all storage is arrived
Mysql database.It for the monitoring value in data, is stored by Double data format, keeps the high degree of accuracy of monitoring value.
Specifically, in the above-described embodiments, the performance monitoring information of server may include server cpu busy percentage,
The data of 10 machine before the TOP such as memory usage, hard disk utilization, energy utilization rate.
As shown in Fig. 2, for a kind of server performance monitor data based on OpenTSDB database point disclosed by the invention
The method flow diagram for analysing embodiment of the method 2, the method includes：
S201, Http request is issued；
When needing query service device performance monitoring information, HTTP request is issued by monitoring system front end first.
S202, Http request is received, and the request condition based on the Http request received starts multiple threads, wherein
Per thread in multiple threads configures different period parameters；
Rear end receives Http request, after receiving Http request, starts multiple threads according to request condition, matches to per thread
Different period parameters is set, so that per thread be made to inquire monitoring data in different time periods.
S203, multiple threads call the api interface of OpenTSDB database simultaneously；
After starting multiple threads and having configured different period parameters for per thread, per thread needs parallel simultaneously
The API data query interface for calling OpenTSDB database to provide.
S204, by the Request required parameter of average value aggregation configuration api interface；
When multiple threads call the api interface of OpenTSDB database simultaneously, by average value aggregation configuration api interface
The returned data of the api interface of OpenTSDB database is polymerize by Request required parameter by average value
Data.
S205, the returned data of the api interface of OpenTSDB database is stored sequentially in time to MySQL data
Library；
When the API data query interface provided by multiple thread dispatching OpenTSDB databases, corresponding API can be obtained
Interface returned data needs to pass through the returned data of the api interface of these OpenTSDB databases carrying out data by average value
Aggregated data after polymerization is stored sequentially in time to MySQL database.
S206, returned data of the storage into MySQL database is analyzed and generates analysis result；
After the returned data storage to MySQL database of the api interface of OpenTSDB database, need to be inquired according to front end
Demand analyzes the returned data of api interface, while generating analysis result.
S207, demand is shown according to front end, analysis result is optimized and handled, and before being returned to Json format
End；
Analysis for generation as a result, according to front end displaying demand needs that analysis result is optimized and handled, and with
Json format returns to front end.
S208, analysis result is shown.
For analyzing as a result, it is desirable to be shown accordingly according to demand.
In conclusion in the above-described embodiments, when needing query service device performance monitoring information, sending Http first is asked
It asks；Then Http request is received, and the request condition based on the Http request received starts multiple threads, wherein multiple lines
Per thread in journey configures different period parameters；Multiple threads call the api interface of OpenTSDB database simultaneously；It connects
By average value aggregation configuration api interface Request required parameter；By the return number of the api interface of OpenTSDB database
MySQL database is arrived according to storage sequentially in time；Finally returned data of the storage into MySQL database is analyzed simultaneously
Generate analysis result；Demand is shown according to front end, and analysis result is optimized and handled, and before being returned to Json format
End；Analysis result is shown.The data group that the present invention divides multiple periods polymerize, and is handled simultaneously using multithreading
Multiple data groups accelerate data processing speed, and ensure that the accuracy of data simultaneously.The data cached using MySQL,
It can support the functions such as the sequence of data.The group of the monitoring data of various time conditions, multiple servers may be implemented in the present invention
Inquiry is closed, and realizes the display and analysis of monitoring data, solves the big fine size of OpenTSDB data base querying time span
The problem of inquiry that occurs when the task of the performance monitoring data of up to ten thousand servers is slow and query timeout.The present invention with
Based on the performance monitoring data of OpenTSDB database purchase, data call, caching are carried out using multithreading, time segment,
Allow operation maintenance personnel that can quickly see the performance data of up to ten thousand monitored servers.In combination with other server admin systems
System, realizes every monitor control index of the server of monitoring and the hardware information of server itself while showing, can also support to transport
Dimension personnel inquire every monitoring letter of corresponding server according to essential informations such as server ip, the affiliated service lines of server
Breath.Because MySQL database supports the rule searchings abundant such as various field sequences, the combination of a variety of querying conditions, after polymerization
Data buffer storage can be realized the advanced inquiry of monitoring system to Mysql database and flexibly show the distribution of various monitoring datas.
Invention increases the flexibilities that data are shown, improve the search efficiency of the performance monitoring data in OpenTSDB database,
The working efficiency for increasing operation maintenance personnel enhances the intuitive of monitoring data statistics and distribution.
Specifically, in the above-described embodiments, the Http request that monitoring system front end issues includes being issued according to querying condition
Capability request and performance utilization rate distribution map needed for request of data etc..
Specifically, in the above-described embodiments, the api interface of the OpenTSDB database into MySQL database is stored
Returned data includes the title of monitored item, timestamp, and monitored item presses the monitoring value after smaller time length aggregate, and all storage is arrived
Mysql database.It for the monitoring value in data, is stored by Double data format, keeps the high degree of accuracy of monitoring value.
Specifically, in the above-described embodiments, for not seek the data of real-time display, annual energy consumption, Ke Yigai are utilized
For daily timed task, buffered in advance data just call real time data when checking without user.
Specifically, in the above-described embodiments, the performance monitoring information of server may include server cpu busy percentage,
The data of 10 machine before the TOP such as memory usage, hard disk utilization, energy utilization rate.For data after polymerization, can pass through
The modes such as chest figure, instrument board, Top10 resource utilization are analyzed and are shown.
As shown in figure 3, for a kind of server performance monitor data based on OpenTSDB database point disclosed by the invention
The structural schematic diagram of analysis system embodiment 1, the system comprises：
Data demand module 301：For issuing Http request；
When needing query service device performance monitoring information, HTTP request is issued by monitoring system front end first.
Data processing module 302：For receiving Http request, and the request condition starting based on the Http request received
Multiple threads, wherein the per thread in multiple threads configures different period parameters；
Rear end receives Http request, after receiving Http request, starts multiple threads according to request condition, matches to per thread
Different period parameters is set, so that per thread be made to inquire monitoring data in different time periods.
Data call module 303：Call the api interface of OpenTSDB database simultaneously for multiple threads；
After starting multiple threads and having configured different period parameters for per thread, per thread needs parallel simultaneously
The API data query interface for calling OpenTSDB database to provide.
Data memory module 304：For storing the returned data of the api interface of OpenTSDB database to MySQL number
According to library；
When the API data query interface provided by multiple thread dispatching OpenTSDB databases, corresponding API can be obtained
Interface returned data is needed the returned data storage of the api interface of these OpenTSDB databases to MySQL database.
Data analysis module 305：For being analyzed returned data of the storage into MySQL database and generating analysis
As a result.
After the returned data storage to MySQL database of the api interface of OpenTSDB database, need to be inquired according to front end
Demand analyzes the returned data of api interface, at the same generate analysis as a result, and will analysis result return to monitoring system before
End.
In conclusion in the above-described embodiments, when needing query service device performance monitoring information, sending Http first is asked
It asks；Then Http request is received, and the request condition based on the Http request received starts multiple threads, wherein multiple lines
Per thread in journey configures different period parameters；Multiple threads call the api interface of OpenTSDB database simultaneously；It connects
By the returned data of the api interface of OpenTSDB database storage to MySQL database；MySQL data finally are arrived to storage
Returned data in library is analyzed and generates analysis result.Various time conditions, multiple servers may be implemented in the present invention
The query composition of monitoring data, and realize the display and analysis of monitoring data, span when solving OpenTSDB data base querying
The problem of inquiry that occurs when spending the task of the performance monitoring data of up to ten thousand servers of big fine size is slow and query timeout.
The present invention carries out data tune based on the performance monitoring data of OpenTSDB database purchase, using multithreading, time segment
With, caching, allow operation maintenance personnel that can quickly see the performance data of up to ten thousand monitored servers.In combination with other services
Device management system is realized every monitor control index of the server of monitoring and the hardware information of server itself while being shown, may be used also
To support operation maintenance personnel according to essential informations such as server ip, the affiliated service lines of server, each of corresponding server is inquired
Item monitoring information.The present invention can be improved the search efficiency of the performance monitoring data in OpenTSDB database, to support more
Complicated monitoring data analysis, improves the working efficiency of operation maintenance personnel.
Specifically, in the above-described embodiments, the Http request that monitoring system front end issues includes being issued according to querying condition
Capability request and performance utilization rate distribution map needed for request of data etc..
Specifically, in the above-described embodiments, the api interface of the OpenTSDB database into MySQL database is stored
Returned data includes the title of monitored item, timestamp, and monitored item presses the monitoring value after smaller time length aggregate, and all storage is arrived
Mysql database.It for the monitoring value in data, is stored by Double data format, keeps the high degree of accuracy of monitoring value.
Specifically, in the above-described embodiments, the performance monitoring information of server may include server cpu busy percentage,
The data of 10 machine before the TOP such as memory usage, hard disk utilization, energy utilization rate.
As shown in figure 4, for a kind of server performance monitor data based on OpenTSDB database point disclosed by the invention
The structural schematic diagram of analysis system embodiment 2, the system comprises：
Data demand module 401：For issuing Http request；
When needing query service device performance monitoring information, HTTP request is issued by monitoring system front end first.
Data processing module 402：For receiving Http request, and the request condition starting based on the Http request received
Multiple threads, wherein the per thread in multiple threads configures different period parameters；
Rear end receives Http request, after receiving Http request, starts multiple threads according to request condition, matches to per thread
Different period parameters is set, so that per thread be made to inquire monitoring data in different time periods.
Data call module 403：Call the api interface of OpenTSDB database simultaneously for multiple threads；
After starting multiple threads and having configured different period parameters for per thread, per thread needs parallel simultaneously
The API data query interface for calling OpenTSDB database to provide.
Parameter configuration module 404：For pressing the Request required parameter of average value aggregation configuration api interface；
When multiple threads call the api interface of OpenTSDB database simultaneously, by average value aggregation configuration api interface
The returned data of the api interface of OpenTSDB database is polymerize by Request required parameter by average value
Data.
Data memory module 405：For the returned data of the api interface of OpenTSDB database to be deposited sequentially in time
Store up MySQL database；
When the API data query interface provided by multiple thread dispatching OpenTSDB databases, corresponding API can be obtained
Interface returned data needs to pass through the returned data of the api interface of these OpenTSDB databases carrying out data by average value
Aggregated data after polymerization is stored sequentially in time to MySQL database.
Data analysis module 406：For being analyzed returned data of the storage into MySQL database and generating analysis
As a result；
After the returned data storage to MySQL database of the api interface of OpenTSDB database, need to be inquired according to front end
Demand analyzes the returned data of api interface, while generating analysis result.
Data-optimized module 407：For showing demand according to front end, analysis result is optimized and handled, and with
Json format returns to front end；
Analysis for generation as a result, according to front end displaying demand needs that analysis result is optimized and handled, and with
Json format returns to front end.
Data display module 408：For being shown to analysis result.
For analyzing as a result, it is desirable to be shown accordingly according to demand.
In conclusion in the above-described embodiments, when needing query service device performance monitoring information, sending Http first is asked
It asks；Then Http request is received, and the request condition based on the Http request received starts multiple threads, wherein multiple lines
Per thread in journey configures different period parameters；Multiple threads call the api interface of OpenTSDB database simultaneously；It connects
By average value aggregation configuration api interface Request required parameter；By the return number of the api interface of OpenTSDB database
MySQL database is arrived according to storage sequentially in time；Finally returned data of the storage into MySQL database is analyzed simultaneously
Generate analysis result；Demand is shown according to front end, and analysis result is optimized and handled, and before being returned to Json format
End；Analysis result is shown.The data group that the present invention divides multiple periods polymerize, and is handled simultaneously using multithreading
Multiple data groups accelerate data processing speed, and ensure that the accuracy of data simultaneously.The data cached using MySQL,
It can support the functions such as the sequence of data.The group of the monitoring data of various time conditions, multiple servers may be implemented in the present invention
Inquiry is closed, and realizes the display and analysis of monitoring data, solves the big fine size of OpenTSDB data base querying time span
The problem of inquiry that occurs when the task of the performance monitoring data of up to ten thousand servers is slow and query timeout.The present invention with
Based on the performance monitoring data of OpenTSDB database purchase, data call, caching are carried out using multithreading, time segment,
Allow operation maintenance personnel that can quickly see the performance data of up to ten thousand monitored servers.In combination with other server admin systems
System, realizes every monitor control index of the server of monitoring and the hardware information of server itself while showing, can also support to transport
Dimension personnel inquire every monitoring letter of corresponding server according to essential informations such as server ip, the affiliated service lines of server
Breath.Because MySQL database supports the rule searchings abundant such as various field sequences, the combination of a variety of querying conditions, after polymerization
Data buffer storage can be realized the advanced inquiry of monitoring system to Mysql database and flexibly show the distribution of various monitoring datas.
Invention increases the flexibilities that data are shown, improve the search efficiency of the performance monitoring data in OpenTSDB database,
The working efficiency for increasing operation maintenance personnel enhances the intuitive of monitoring data statistics and distribution.
Specifically, in the above-described embodiments, the Http request that monitoring system front end issues includes being issued according to querying condition
Capability request and performance utilization rate distribution map needed for request of data etc..
Specifically, in the above-described embodiments, the api interface of the OpenTSDB database into MySQL database is stored
Returned data includes the title of monitored item, timestamp, and monitored item presses the monitoring value after smaller time length aggregate, and all storage is arrived
Mysql database.It for the monitoring value in data, is stored by Double data format, keeps the high degree of accuracy of monitoring value.
Specifically, in the above-described embodiments, for not seek the data of real-time display, annual energy consumption, Ke Yigai are utilized
For daily timed task, buffered in advance data just call real time data when checking without user.
Specifically, in the above-described embodiments, the performance monitoring information of server may include server cpu busy percentage,
The data of 10 machine before the TOP such as memory usage, hard disk utilization, energy utilization rate.For data after polymerization, can pass through
The modes such as chest figure, instrument board, Top10 resource utilization are analyzed and are shown.
Each embodiment in this specification is described in a progressive manner, the highlights of each of the examples are with other
The difference of embodiment, the same or similar parts in each embodiment may refer to each other.For device disclosed in embodiment
For, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, related place is said referring to method part
It is bright.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (10)
1. a kind of server performance monitor data analysing method based on OpenTSDB database, which is characterized in that including：
Issue Http request；
The Http request is received, and the request condition based on the Http request received starts multiple threads, wherein institute
It states the per thread in multiple threads and configures different period parameters；
The multiple thread calls the api interface of OpenTSDB database simultaneously；
By the returned data storage of the api interface of the OpenTSDB database to MySQL database；
The returned data of the storage into the MySQL database is analyzed and generates analysis result.
2. the method according to claim 1, wherein further including：
By the Request required parameter of api interface described in average value aggregation configuration.
3. method according to claim 1 or 2, which is characterized in that further include：
The analysis result is shown.
4. according to the method described in claim 3, it is characterized in that, further including：
Demand is shown according to front end, and the analysis result is optimized and handled, and front end is returned to Json format.
5. the method according to claim 1, wherein the api interface by the OpenTSDB database
Returned data storage is specifically included to MySQL database：
The returned data of the api interface of the OpenTSDB database is stored sequentially in time to MySQL database.
6. a kind of server performance monitor data analysis system based on OpenTSDB database, which is characterized in that including：
Data demand module：For issuing Http request；
Data processing module：For receiving the Http request, and the request condition based on the Http request received opens
Move multiple threads, wherein the per thread in the multiple thread configures different period parameters；
Data call module：Call the api interface of OpenTSDB database simultaneously for the multiple thread；
Data memory module：For storing the returned data of the api interface of the OpenTSDB database to MySQL data
Library；
Data analysis module：For being analyzed the returned data of the storage into the MySQL database and being generated point
Analyse result.
7. system according to claim 6, which is characterized in that further include：
Parameter configuration module：For the Request required parameter by api interface described in average value aggregation configuration.
8. system according to claim 6 or 7, which is characterized in that further include：
Data display module：For being shown to the analysis result.
9. system according to claim 8, which is characterized in that further include：
Data-optimized module：For showing demand according to front end, the analysis result is optimized and handled, and with Json lattice
Formula returns to front end.
10. system according to claim 6, which is characterized in that the data memory module is specifically used for：
The returned data of the api interface of the OpenTSDB database is stored sequentially in time to MySQL database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810442084.2A CN108829557A (en) | 2018-05-10 | 2018-05-10 | A kind of server performance monitor data analysing method and system based on OpenTSDB database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810442084.2A CN108829557A (en) | 2018-05-10 | 2018-05-10 | A kind of server performance monitor data analysing method and system based on OpenTSDB database |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108829557A true CN108829557A (en) | 2018-11-16 |
Family
ID=64147630
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810442084.2A Pending CN108829557A (en) | 2018-05-10 | 2018-05-10 | A kind of server performance monitor data analysing method and system based on OpenTSDB database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829557A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110413498A (en) * | 2019-07-30 | 2019-11-05 | 四川虹魔方网络科技有限公司 | A kind of method and system of server O&M large-size screen monitors monitoring |
| CN111369033A (en) * | 2020-01-02 | 2020-07-03 | 东软集团股份有限公司 | Prediction method and device for value distribution of operation and maintenance indexes |
| CN112527620A (en) * | 2020-12-24 | 2021-03-19 | 北京百度网讯科技有限公司 | Database performance analysis method and device, electronic equipment, medium and product |
| CN114328083A (en) * | 2021-11-30 | 2022-04-12 | 苏州浪潮智能科技有限公司 | WDT monitoring method, device and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605664A (en) * | 2013-10-22 | 2014-02-26 | 芜湖大学科技园发展有限公司 | Massive dynamic data fast query method meeting different time granularity requirements |
| CN105930380A (en) * | 2016-04-14 | 2016-09-07 | 北京思特奇信息技术股份有限公司 | Chart monitor method and device based on HADOOP |
| CN106100908A (en) * | 2016-08-16 | 2016-11-09 | 南京航空航天大学 | A kind of stable universal data actuality collection is held concurrently and is remotely monitored multifunction system |
| CN107370625A (en) * | 2017-07-24 | 2017-11-21 | 北京哈工大计算机网络与信息安全技术研究中心 | A kind of cloud platform running state monitoring method and monitor supervision platform |
-
2018
- 2018-05-10 CN CN201810442084.2A patent/CN108829557A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605664A (en) * | 2013-10-22 | 2014-02-26 | 芜湖大学科技园发展有限公司 | Massive dynamic data fast query method meeting different time granularity requirements |
| CN105930380A (en) * | 2016-04-14 | 2016-09-07 | 北京思特奇信息技术股份有限公司 | Chart monitor method and device based on HADOOP |
| CN106100908A (en) * | 2016-08-16 | 2016-11-09 | 南京航空航天大学 | A kind of stable universal data actuality collection is held concurrently and is remotely monitored multifunction system |
| CN107370625A (en) * | 2017-07-24 | 2017-11-21 | 北京哈工大计算机网络与信息安全技术研究中心 | A kind of cloud platform running state monitoring method and monitor supervision platform |
Non-Patent Citations (1)
| Title |
|---|
| 宇毅: "OpenTSDB查询示例", 《CSDN，HTTPS://BLOG.CSDN.NET/XSDXS/ARTICLE/DETAILS/67012914》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110413498A (en) * | 2019-07-30 | 2019-11-05 | 四川虹魔方网络科技有限公司 | A kind of method and system of server O&M large-size screen monitors monitoring |
| CN111369033A (en) * | 2020-01-02 | 2020-07-03 | 东软集团股份有限公司 | Prediction method and device for value distribution of operation and maintenance indexes |
| CN111369033B (en) * | 2020-01-02 | 2024-03-26 | 东软集团股份有限公司 | Method and device for predicting value distribution of operation and maintenance indexes |
| CN112527620A (en) * | 2020-12-24 | 2021-03-19 | 北京百度网讯科技有限公司 | Database performance analysis method and device, electronic equipment, medium and product |
| CN114328083A (en) * | 2021-11-30 | 2022-04-12 | 苏州浪潮智能科技有限公司 | WDT monitoring method, device and medium |
| CN114328083B (en) * | 2021-11-30 | 2023-11-14 | 苏州浪潮智能科技有限公司 | WDT monitoring method, device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829557A (en) | A kind of server performance monitor data analysing method and system based on OpenTSDB database | |
| CN109726074A (en) | Log processing method, device, computer equipment and storage medium | |
| CN110008257A (en) | Data processing method, device, system, computer equipment and storage medium | |
| US7325234B2 (en) | System and method for monitoring computer application and resource utilization | |
| CN106020715B (en) | Storage pool capacity management | |
| Ren et al. | Workload characterization on a production hadoop cluster: A case study on taobao | |
| CN106649670A (en) | Streaming computing-based data monitoring method and apparatus | |
| US20060277206A1 (en) | Automated reporting of computer system metrics | |
| CN106201355B (en) | Data processing method and device and storage system | |
| CN103067297B (en) | A kind of dynamic load balancing method based on resource consumption prediction and device | |
| CN109146381A (en) | Logistics data monitoring method, device, electronic equipment and computer storage medium | |
| CN107515784B (en) | Method and equipment for calculating resources in distributed system | |
| CN104536965B (en) | A kind of data query display systems under the conditions of big data and method | |
| CN106407244A (en) | Multi-database-based data query method, system and apparatus | |
| CN105094981B (en) | A kind of method and device of data processing | |
| CN105550270B (en) | Data base query method and device | |
| CN108304454B (en) | Invoice data real-time aggregation device based on big data | |
| CN107590181A (en) | A kind of intelligent analysis system of big data | |
| CN109669915A (en) | A kind of computer task management method, device and relevant device | |
| CN109241096A (en) | Data processing method, device and system | |
| CN104021088B (en) | log storing method and device | |
| CN109033153A (en) | A method of dynamically distributing sole electron Air Way Bill No. | |
| CN113051060A (en) | GPU dynamic scheduling method and device based on real-time load and electronic equipment | |
| CN109165137A (en) | data analysis and alarm method and system | |
| JPWO2010047170A1 (en) | Calculation device, system management device, calculation method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |