CN107404417A - A kind of processing method of monitoring data, processing unit and processing system - Google Patents
A kind of processing method of monitoring data, processing unit and processing system Download PDFInfo
- Publication number
- CN107404417A CN107404417A CN201710615101.3A CN201710615101A CN107404417A CN 107404417 A CN107404417 A CN 107404417A CN 201710615101 A CN201710615101 A CN 201710615101A CN 107404417 A CN107404417 A CN 107404417A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring data
- acquisition
- sent
- time series
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of processing method of monitoring data, processing unit and processing system, including receive the monitoring data that data presentation device is sent and obtain request；Target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database；Wherein, it is stored with the monitoring data from data acquisition device in distributed time series database；Target monitoring data are sent to data presentation device, so that data presentation device display target monitoring data.From technical scheme provided by the invention, because the acquisition of monitoring data, storage and displaying are completed by three devices respectively, so as to dramatically reduce the strong coupling of data handling procedure, when therefore being gone wrong in certain part to influence this partial function, the normal realization of other parts function is not interfered with yet.
Description
Technical field
The present invention relates to data processing field, the espespecially a kind of processing method of monitoring data, processing unit and processing system.
Background technology
Cloud computing management platform is the calculating of integrating based on virtualization architecture, the platform of management function, and it is logical
Cross various complementary services realize data center's infrastructure service (Infrastructure as a Service,
IaaS) the central management control of cloud computing environment, and physics all in data center is realized with succinct administration interface
The unified management of resource and virtual resource, therefore improve Information technology (Information Technology, IT) personnel's
Managerial ability, the daily round is simplified, also reduce the complexity and management cost of IT environment.
But the service of cloud computing management platform in a practical situation, can be usually caused mistake occur due to various
By mistake, so as to influence the overall operation of cloud computing management platform, therefore, at any time according to monitoring data to obtain cloud computing management platform
Running situation be ensure cloud computing normal operation basis.
The acquisition of monitoring data, monitoring are generally comprised to obtain the running situation of cloud computing management platform according to monitoring data
Three parts of the storage of data and the displaying of monitoring data, in correlation technique, generally use runs certain monitoring software, such as
Nagios, zabbix an integral monitoring device obtain the monitoring data of cloud computing management platform to store, and needed in user
Want to be shown monitoring data during checking monitoring data, but due to the acquisition of data, the storage of data and the displaying of data
All completed by the device of one global procedures of operation, there is strong coupling, therefore when certain subprogram goes wrong with influence
During certain partial function, the function of other parts may also be affected can not normally realize.
The content of the invention
In order to solve the above-mentioned technical problem, the invention provides a kind of processing method of monitoring data, processing unit and place
Reason system, can high degree reduce data handling procedure in the acquisition of data, the storage of data and the displaying of data three
Partial is strong coupling.
In order to reach the object of the invention, the invention provides a kind of processing method of monitoring data, including：
Receive the monitoring data that data presentation device is sent and obtain request；
Target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database；Its
In, it is stored with the monitoring data from data acquisition device in the distributed time series database；
The target monitoring data are sent to the data presentation device, so that described in the data presentation device shows
Target monitoring data.
Before the data display request for receiving data presentation device and sending, in addition to：
Receive the monitoring data that data acquisition device is sent；
By the supervising data storage received in distributed time series database.
It is described by the supervising data storage received before distributed time series database, in addition to：
Integration processing is compressed to the monitoring data received using presetting method；
Accordingly, it is described by the supervising data storage received in distributed time series database, including：
The monitoring data for being compressed integration processing is stored in the distributed sequential in a manner of partitioned storage
Database.
Present invention also offers a kind of processing method of monitoring data, including：
Acquisition monitoring data；
The form of the monitoring data collected sequential in a distributed manner is sent to data storage device.
Present invention also offers a kind of processing method of monitoring data, including：
The monitoring data received is obtained into request to send to data storage device；
Receive the target monitoring data that the data storage device is sent；
Page configuration information is obtained from presetting database；
The chart form of expression in itself class libraries is called according to the page configuration information of acquisition；
The target monitoring data are shown with the chart form of expression of calling.
Present invention also offers a kind of data storage device, including：
First receiving module, the monitoring data for receiving data presentation device transmission obtain request；
First acquisition module, it is corresponding with monitoring data acquisition request for being obtained from distributed time series database
Target monitoring data；Wherein, it is stored with the monitoring data from data acquisition device in the distributed time series database；
First sending module, for the target monitoring data to be sent to the data presentation device, so that the number
The target monitoring data are shown according to display device.
Also include：
Second receiving module, for receiving the monitoring data of data acquisition device transmission；
Memory module, for by the supervising data storage received in distributed time series database.
Present invention also offers a kind of data acquisition device, including：
Acquisition module, for acquisition monitoring data；
Second sending module, for the form of sequential to send to data and deposited in a distributed manner by the monitoring data collected
Storage device.
Present invention also offers a kind of data presentation device, including：
3rd sending module, sent for the monitoring data received to be obtained into request to data storage device；
3rd receiving module, the target monitoring data sent for receiving the data storage device；
Second acquisition module, for obtaining page configuration information from presetting database；
Calling module, for calling the chart form of expression in itself class libraries according to the page configuration information of acquisition；
Display module, for showing the target monitoring data with the chart form of expression of calling.
Present invention also offers a kind of processing system of monitoring data, including：
Data acquisition device as described above, data storage device as described above, and data as described above are shown
Device.
Compared with prior art, the present invention, which comprises at least, receives the monitoring data acquisition request that data presentation device is sent；
Target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database；Wherein, described point
The monitoring data from data acquisition device is stored with cloth time series database；The target monitoring data are sent to described
Data presentation device, so that the data presentation device shows the target monitoring data.From technical scheme provided by the invention
It can be seen that because the acquisition of monitoring data is completed by data acquisition facility, the storage of monitoring data is completed by data storage device, and
And the displaying of monitoring data is completed by data presentation device, so that the acquisition of monitoring data, storage and displaying can be distinguished
Independently undertaken by different devices, dramatically reduce data acquisition in data handling procedure, storage and displaying three
Partial is strong coupling, therefore when being gone wrong in certain part to influence this partial function, does not also interfere with other parts work(
The normal realization of energy.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing further understanding technical solution of the present invention, and a part for constitution instruction, with this
The embodiment of application is used to explain technical scheme together, does not form the limitation to technical solution of the present invention.
Fig. 1 is a kind of schematic flow sheet of the processing method of monitoring data provided in an embodiment of the present invention；
Fig. 2 is the schematic flow sheet of the processing method of another monitoring data provided in an embodiment of the present invention；
Fig. 3 is the schematic flow sheet of the processing method of another monitoring data provided in an embodiment of the present invention；
Fig. 4 is the schematic flow sheet of the processing method of another monitoring data provided in an embodiment of the present invention；
Fig. 5 is a kind of structural representation of data storage device provided in an embodiment of the present invention；
Fig. 6 is the structural representation of another data storage device provided in an embodiment of the present invention；
Fig. 7 is a kind of structural representation of data acquisition device provided in an embodiment of the present invention；
Fig. 8 is a kind of structural representation of data presentation device provided in an embodiment of the present invention；
Fig. 9 is a kind of structural representation of the processing system of monitoring data provided in an embodiment of the present invention；
Figure 10 is the structural representation of the processing system of another monitoring data provided in an embodiment of the present invention.
Embodiment
For the object, technical solutions and advantages of the present invention are more clearly understood, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case where not conflicting, in the embodiment and embodiment in the application
Feature can mutually be combined.
The embodiment of the present invention provides a kind of processing method of monitoring data, as shown in figure 1, this method includes：
Step 101, acquisition monitoring data.
Specifically, in cloud computing management platform, monitoring data can monitor device to be monitored by monitor to produce
's.
Step 102, the form of the monitoring data collected sequential in a distributed manner sent to data storage device.
It should be noted that the monitoring data collected is sent to database storage arrangement, so as to obtain data storage dress
Put when receiving the data display request of data presentation device transmission, can be obtained in the distributed time series database of itself
Target monitoring data corresponding to data display request, and data presentation device is sent to be shown.
It should be noted that because the acquisition of monitoring data, storage and display are completed by different device, therefore,
Any part of functions of this three parts function can be carried out more adapting to have on the premise of other two parts functions are not influenceed
The adjustment of body requirement.
The processing method of monitoring data provided by the invention, acquisition monitoring data；By the monitoring data collected to be distributed
The form of formula sequential is sent to data storage device, so that data storage device is receiving data presentation device transmission
During data display request, target monitoring number corresponding to data display request can be obtained in the distributed time series database of itself
According to, and data presentation device is sent to be shown.From technical scheme provided by the invention, due to obtaining for monitoring data
Take and completed by data acquisition facility, the storage of monitoring data is completed by data storage device, and the displaying of monitoring data is by counting
Completed according to display device, so that the acquisition of monitoring data, storage and displaying can independently be undertaken by different devices respectively,
Dramatically reduce data acquisition in data handling procedure, three parts of storage and displaying it is strong coupling, therefore
When certain part goes wrong to influence this partial function, the normal realization of other parts function is not interfered with yet.
The embodiment of the present invention provides the processing method of another monitoring data, as shown in Fig. 2 this method includes：
Step 201, receive the monitoring data acquisition request that data presentation device is sent.
Step 202, target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database.
Wherein, it is stored with the monitoring data from data acquisition device in distributed time series database.
Specifically, distributed time series database (influx Date Base, influxDB) is to be used to store time series data
Database, it be one write with quick compiler language Go, independent of outside database, support the quick of time series data
The basic functions such as write-in, persistence, multidimensional aggregate query.
Step 203, target monitoring data are sent to data presentation device, so that data presentation device display target monitors
Data.
The processing method of monitoring data provided by the invention, receive the monitoring data acquisition that data presentation device is sent and ask
Ask；Target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database；Wherein, when distributed
The monitoring data from data acquisition device is stored with sequence database；Target monitoring data are sent to data presentation device,
So that data presentation device display target monitoring data.From technical scheme provided by the invention, due to obtaining for monitoring data
Take and completed by data acquisition facility, the storage of monitoring data is completed by data storage device, and the displaying of monitoring data is by counting
Completed according to display device, so that the acquisition of monitoring data, storage and displaying can independently be undertaken by different devices respectively,
Dramatically reduce data acquisition in data handling procedure, three parts of storage and displaying it is strong coupling, therefore
When certain part goes wrong to influence this partial function, the normal realization of other parts function is not interfered with yet.
The embodiment of the present invention provides the processing method of another monitoring data, as shown in figure 3, this method includes：
Step 301, the monitoring data received is obtained and asks to send to data storage device.
Step 302, receive the target monitoring data that data storage device is sent.
Step 303, page configuration information is obtained from presetting database.
Specifically, presetting database can be database Mysql, page configuration information is stored in Mysql, when click phase
When closing the page, page configuration information is read from Mysql.
Step 304, call according to the page configuration information of acquisition the chart form of expression in itself class libraries.
Specifically, the chart form of expression includes page layout and chart data etc..
Step 305, the chart form of expression display target monitoring data with calling.
The processing method of monitoring data provided by the invention, receive the monitoring data that user sends and obtain request；It will receive
The monitoring data arrived obtains request and sent to data storage device, so that distributed sequential of the data storage device from itself
Monitoring data is obtained in database and obtains target monitoring data corresponding to request；Receive the target monitoring that data storage device is sent
Data；Page configuration information is obtained from presetting database；The figure in itself class libraries is called according to the page configuration information of acquisition
The table form of expression；With the chart form of expression display target monitoring data of calling.From technical scheme provided by the invention, by
Completed in the acquisition of monitoring data by data acquisition facility, the storage of monitoring data is completed by data storage device, and is monitored
The displaying of data is completed by data presentation device, so that monitoring data acquisition, storage and displaying can be respectively by different
Device independently undertakes, dramatically reduce data acquisition in data handling procedure, three parts of storage and displaying it is strong
Coupling, therefore when being gone wrong in certain part to influence this partial function, do not interfere with the normal of other parts function yet
Realize.
The embodiment of the present invention provides the processing method of another monitoring data, as shown in figure 4, this method includes：
Step 401, data acquisition device acquisition monitoring data.
Specifically, data acquisition device can realize monitoring data by installing monitoring data collection program Telegraf
Collection.Telegraf is an Agent write with quick compiler language Go, and the program collects system and service
Statistics, there is the characteristics of EMS memory occupation is small, and developer can easily add the extension for supporting other services.
The form of sequential sends to data and deposited in a distributed manner by the monitoring data collected for step 402, data acquisition device
Storage device.
Specifically, if data acquisition device is the collection that monitoring data is realized by installation procedure Telegraf, and
The data collected will be stored in InfluxDB, therefore the data of cloud computing management platform are developed in Telegraf
Gather plug-in unit, application programming interface (the Application Programming that the data collected are passed through into InfluxDB
Interface, API) in a distributed manner the form of sequential send to data storage device to be stored in InfluxDB.
Step 403, data storage device receive the monitoring data that data acquisition device is sent.
Step 404, data storage device are by the supervising data storage received in distributed time series database.
Specifically, also include before step 404：
Integration processing is compressed to the monitoring data received using presetting method.
Accordingly, step 404 includes：
The monitoring data for being compressed integration processing is stored in distributed time series database in a manner of partitioned storage.
Specifically, presetting method can be distinctive a kind of inquiry mode-continuous-query (Continuous in InfluxDB
Query) data processing method, it can realize that the compression to monitoring data is integrated using this processing method, to receive
Monitoring data can be stored with smaller memory space.
Specifically, the mode of partitioned storage is referred in the way of time partitioned storage, the mode of partitioned storage can be with
Data management, such as the deletion to monitoring data are more easily carried out in subsequent process, if monitoring data is with subregion
What the mode of storage stored, that can be directly deleted the data of a certain subregion according to the date.
The monitoring data received is obtained request and sent to data storage device by step 405, data presentation device.
It should be noted that it can be inputted by user that monitoring data, which obtains request,.
Specifically, data presentation device can be the device for installing visualization tool Grafana, Grafana has function
Complete measurement instrument board and graphic editor and flexibly abundant graphical option, therefore a variety of styles can be mixed, and
And multiple data sources are also supported, in addition, it is also equipped with alarm function, by setting alarm conditions just can voluntarily obtain prison
Data are controlled to judge whether to reach alarm conditions to be alerted.
If specifically, data presentation device installation visualization tool Grafana device, then data presentation device is actual
On be that monitoring data is obtained into request by Grafana plug-in units to send to data storage device.
Step 406, data storage device receive the monitoring data that data presentation device is sent and obtain request.
Step 407, data storage device obtain corresponding with monitoring data acquisition request from distributed time series database
Target monitoring data.
Step 408, data storage device send target monitoring data to data presentation device.
Step 409, data presentation device receive the target monitoring data that data storage device is sent.
Step 410, data presentation device obtain page configuration information from presetting database.
Step 411, data presentation device call the chart in itself class libraries to show shape according to the page configuration information of acquisition
Formula.
The chart form of expression display target monitoring data of step 412, data presentation device to call.
The processing method of monitoring data provided by the invention, receive the monitoring data acquisition that data presentation device is sent and ask
Ask；Target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database；Wherein, when distributed
The monitoring data from data acquisition device is stored with sequence database；Target monitoring data are sent to data presentation device,
So that data presentation device display target monitoring data.From technical scheme provided by the invention, due to obtaining for monitoring data
Take and completed by data acquisition facility, the storage of monitoring data is completed by data storage device, and the displaying of monitoring data is by counting
Completed according to display device, so that the acquisition of monitoring data, storage and displaying can independently be undertaken by different devices respectively,
Dramatically reduce data acquisition in data handling procedure, three parts of storage and displaying it is strong coupling, therefore
When certain part goes wrong to influence this partial function, the normal realization of other parts function is not interfered with yet.
If data acquisition device is the device for installing monitoring data collection program Telegraf, Telegraf system information
As central processing unit (Central Processing Unit, CPU), internal memory, hard disk etc. use system to carry the configuration of plug-in unit such as
Under：
[[inputs.cpu]]
[[inputs.disk]]
Ignore_fs=[" tmpfs ", " devtmpfs "]
[[inputs.diskio]]
[[inputs.mem]]
[[inputs.processes]]
[[inputs.swap]]
[[inputs.system]]
[[inputs.net]]
Telegraf information on services uses check_api.sh scripts, configures as follows：
[[inputs.exec]]
Commands=[" sh/var/lib/kolla/config_files/monitor/script/check_api.s h
$ip″]
Timeout=" 10s "
Data_format=" infflux "
Check_api.sh uses influx forms, and sample is as follows：
Exec_mycollector a=0.5, b_c=0.1, b_d=5 1452815002357578567
Whether Telegraf other information, such as the server according to where Telegraf enable this service and pass through automation
Operation and maintenance tools ansible automatic configurations, by taking search server ElasticSearch as an example, configuration is as follows：
{ %if inventory_hostname in groups [' elasticsearch '] and enable_
Elasticsearch | bool% }
[[inputs.elasticsearch]]
Servers=[" { { elasticsearch_proto } }：//{{api_interface_address}}：
{{elasticsearch_port}}″]
{ %endif% }
Telegraf gathered datas default storage is in Telegraf storehouses, in influxDB, will can be stored in one
Data regards virtual field key field value (field value) corresponding with its as, and form is as follows：
Cpu_usage, host=server01, region=group1 value=0.67
1434023462000000000
Virtual field key includes following components：Field database, field retention policy, field
Measurement, field tag sets, field field name, field timestamp.Field database and field
Do not embodied in the superincumbent data of retention policy, generally when inserting data in HTTP
Specified in the respective field of (HyperText Transfer Protocol, HTTP) request.
Field database：Database name, can create multiple databases in InfluxDB, the number in disparate databases
It is that isolation is deposited according to file, the different directories being stored on disk.
Field retention policy：Storage strategy, for the time for setting data to retain.
Field measurement：Measurement index name, such as cpu_usage represent cpu utilization rate.
Field tag sets：Tags can sort in InfluxDB according to lexcographical order.
Field field name：Such as the value in data is exactly fieldName above.
Field timestamp：It is required for specifying a timestamp per a data.
The configuration of storage strategy is as follows：
Grafana need to configure the access approach that source data is influxdb and influxdb, and configuration is as follows：
influxdb：{
type：' influxdb ',
url：″http：//xxx.xxx.xxx.xxx：8086/db/collectd ",
username：' root ',
password：′root′
}
Add instrument board dashboard：Option Add is selected in main interface Home, then selection addition dashboad,
Graphic configuration data is added under each dashboad.
Grafana alarm rules can use existing chart control panel to set, and threshold value can pass through dilatory the right
Line traffic control, the change of alarm condition are shown by customized mode.
The embodiment of the present invention provides a kind of data storage device, as shown in figure 5, the data storage device 5 includes：
First receiving module 51, the monitoring data for receiving data presentation device transmission obtain request.
First acquisition module 52, the corresponding mesh of request is obtained with monitoring data for being obtained from distributed time series database
Mark monitoring data；Wherein, it is stored with the monitoring data from data acquisition device in distributed time series database.
First sending module 53, for target monitoring data to be sent to data presentation device, so that data presentation device
Display target monitoring data.
Further, on the basis of embodiment corresponding to Fig. 5, the embodiment of the present invention provides another data storage device,
As shown in fig. 6, the data storage device 5 also includes：
Second receiving module 54, for receiving the monitoring data of data acquisition device transmission.
Memory module 55, for by the supervising data storage received in distributed time series database.
Processing module 56, for being compressed integration processing to the monitoring data received using presetting method.
Further, memory module 55 is specifically used for being compressed the monitoring data for integrating processing in a manner of partitioned storage
It is stored in distributed time series database.
Data storage device provided by the invention, receive the monitoring data that data presentation device is sent and obtain request；From point
Target monitoring data corresponding with monitoring data acquisition request are obtained in cloth time series database；Wherein, distributed time series data
The monitoring data from data acquisition device is stored with storehouse；Target monitoring data are sent to data presentation device, so that number
According to display device display target monitoring data.From technical scheme provided by the invention, because the acquisition of monitoring data is by counting
Completed according to acquisition device, the storage of monitoring data is completed by data storage device, and the displaying of monitoring data is shown by data
Device is completed, so that the acquisition of monitoring data, storage and displaying can independently be undertaken by different devices respectively, very big journey
Degree ground reduces data acquisition in data handling procedure, storage and shows the strong coupling of three parts, therefore in a certain portion
When point going wrong to influence this partial function, the normal realization of other parts function is not interfered with yet.
In actual applications, first receiving module 51, the first acquisition module 52, the first sending module 53, second connect
Receiving module 54, memory module 55 and processing module 56 can be by the CPU in data storage device, microprocessor (Micro
Processor Unit, MPU), digital signal processor (Digital Signal Processor, DSP) or field-programmable
Gate array (Field Programmable Gate Array, FPGA) etc. is realized.
The embodiment of the present invention provides a kind of data acquisition device, as shown in fig. 7, the data acquisition device 6 includes：
Acquisition module 61, for acquisition monitoring data.
Second sending module 62, for the form of the monitoring data collected sequential in a distributed manner to be sent to data storage
Device.
Data acquisition device provided by the invention, acquisition monitoring data；By the monitoring data collected sequential in a distributed manner
Form send to data storage device so that data storage device receive data presentation device transmission data show
When showing request, target monitoring data corresponding to data display request can be obtained in the distributed time series database of itself, and
Data presentation device is sent to be shown.From technical scheme provided by the invention, due to monitoring data acquisition by
Data acquisition facility is completed, and the storage of monitoring data is completed by data storage device, and the displaying of monitoring data is shown by data
Showing device is completed, so that the acquisition of monitoring data, storage and displaying can independently be undertaken by different devices respectively, greatly
Reduce to degree data acquisition in data handling procedure, three parts of storage and displaying it is strong coupling, therefore a certain
When part goes wrong to influence this partial function, the normal realization of other parts function is not interfered with yet.
In actual applications, the sending module 62 of acquisition module 61 and second can be by data acquisition device
CPU, MPU, DSP or FPGA etc. are realized.
The embodiment of the present invention provides a kind of data presentation device, as shown in figure 8, the data presentation device 7 includes：
3rd sending module 71, sent for the monitoring data received to be obtained into request to data storage device.
3rd receiving module 72, for receiving the target monitoring data of data storage device transmission.
Second acquisition module 73, for obtaining page configuration information from presetting database.
Calling module 74, for calling the chart form of expression in itself class libraries according to the page configuration information of acquisition.
Display module 75, for the chart form of expression display target monitoring data of calling.
Data presentation device provided by the invention, receive the monitoring data that user sends and obtain request；The prison that will be received
Control data acquisition request is sent to data storage device, so that distributed time series database of the data storage device from itself
Middle acquisition monitoring data obtains target monitoring data corresponding to request；Receive the target monitoring data that data storage device is sent；
Page configuration information is obtained from presetting database；The chart in itself class libraries is called to show according to the page configuration information of acquisition
Form；With the chart form of expression display target monitoring data of calling.From technical scheme provided by the invention, due to monitoring
The acquisition of data is completed by data acquisition facility, and the storage of monitoring data is completed by data storage device, and monitoring data
Displaying is completed by data presentation device, so that the acquisition of monitoring data, storage and displaying can be respectively by different devices
Independently undertake, dramatically reduce data acquisition in data handling procedure, storage and the close coupling for showing three parts
Property, therefore when being gone wrong in certain part to influence this partial function, do not interfere with the normal realization of other parts function yet.
In actual applications, the 3rd sending module 71, the 3rd receiving module 72, the second acquisition module 73, calling mould
Block 74 and display module 75 can be realized by CPU, MPU, DSP or FPGA in data presentation device etc..
The embodiment of the present invention provides a kind of processing system of monitoring data, as shown in figure 9, the processing system 8 includes：
Data storage device 81 that embodiment corresponding to above-mentioned Fig. 5 or Fig. 6 provides, embodiment corresponding to above-mentioned Fig. 7 provide
Data acquisition device 82 and above-mentioned Fig. 8 corresponding to embodiment provide data presentation device 83.
The embodiment of the present invention also provides the processing system of another monitoring data, because cloud computing management platform is to realize meter
Calculate and the platform of management, device in platform can be represented with calculate node and management node, therefore data acquisition device
Institute's acquisition monitoring data can be divided into calculate node monitoring data and the monitoring data of management node (wherein, monitoring data is again
System data, service data and performance data three parts can be divided into), as shown in Figure 10, the processing system includes data acquisition
Device, data storage device and data presentation device, the operation method embodiment corresponding with Fig. 4 of the processing system is consistent,
This is repeated no more.
Although disclosed herein embodiment as above, described content be only readily appreciate the present invention and use
Embodiment, it is not limited to the present invention.Technical staff in any art of the present invention, taken off not departing from the present invention
On the premise of the spirit and scope of dew, any modification and change, but the present invention can be carried out in the form and details of implementation
Scope of patent protection, still should be subject to the scope of the claims as defined in the appended claims.
Claims (10)
- A kind of 1. processing method of monitoring data, it is characterised in that including：Receive the monitoring data that data presentation device is sent and obtain request；Target monitoring data corresponding with monitoring data acquisition request are obtained from distributed time series database；Wherein, institute State and the monitoring data from data acquisition device is stored with distributed time series database；The target monitoring data are sent to the data presentation device, so that the data presentation device shows the target Monitoring data.
- 2. processing method according to claim 1, it is characterised in that the data for receiving data presentation device transmission show Before showing request, in addition to：Receive the monitoring data that data acquisition device is sent；By the supervising data storage received in distributed time series database.
- 3. processing method according to claim 2, it is characterised in that described to be distributed the supervising data storage received Before formula time series database, in addition to：Integration processing is compressed to the monitoring data received using presetting method；Accordingly, it is described by the supervising data storage received in distributed time series database, including：The monitoring data for being compressed integration processing is stored in the distributed time series data in a manner of partitioned storage Storehouse.
- A kind of 4. processing method of monitoring data, it is characterised in that including：Acquisition monitoring data；The form of the monitoring data collected sequential in a distributed manner is sent to data storage device.
- A kind of 5. processing method of monitoring data, it is characterised in that including：The monitoring data received is obtained into request to send to data storage device；Receive the target monitoring data that the data storage device is sent；Page configuration information is obtained from presetting database；The chart form of expression in itself class libraries is called according to the page configuration information of acquisition；The target monitoring data are shown with the chart form of expression of calling.
- A kind of 6. data storage device, it is characterised in that including：First receiving module, the monitoring data for receiving data presentation device transmission obtain request；First acquisition module, the corresponding target of request is obtained with the monitoring data for being obtained from distributed time series database Monitoring data；Wherein, it is stored with the monitoring data from data acquisition device in the distributed time series database；First sending module, for the target monitoring data to be sent to the data presentation device, so that the data show Showing device shows the target monitoring data.
- 7. data storage device according to claim 6, it is characterised in that also include：Second receiving module, for receiving the monitoring data of data acquisition device transmission；Memory module, for by the supervising data storage received in distributed time series database.
- A kind of 8. data acquisition device, it is characterised in that including：Acquisition module, for acquisition monitoring data；Second sending module, filled for the form of the monitoring data collected sequential in a distributed manner to be sent to data storage Put.
- A kind of 9. data presentation device, it is characterised in that including：3rd sending module, sent for the monitoring data received to be obtained into request to data storage device；3rd receiving module, the target monitoring data sent for receiving the data storage device；Second acquisition module, for obtaining page configuration information from presetting database；Calling module, for calling the chart form of expression in itself class libraries according to the page configuration information of acquisition；Display module, for showing the target monitoring data with the chart form of expression of calling.
- A kind of 10. processing system of monitoring data, it is characterised in that including：Data acquisition device as claimed in claim 6, Data storage device as claimed in claim 7 or 8, and data presentation device as claimed in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710615101.3A CN107404417A (en) | 2017-07-25 | 2017-07-25 | A kind of processing method of monitoring data, processing unit and processing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710615101.3A CN107404417A (en) | 2017-07-25 | 2017-07-25 | A kind of processing method of monitoring data, processing unit and processing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107404417A true CN107404417A (en) | 2017-11-28 |
Family
ID=60401424
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710615101.3A Pending CN107404417A (en) | 2017-07-25 | 2017-07-25 | A kind of processing method of monitoring data, processing unit and processing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107404417A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108512719A (en) * | 2018-03-02 | 2018-09-07 | 南京易捷思达软件科技有限公司 | A kind of Integrative resource monitoring system based on cloud platform of increasing income |
| CN108897796A (en) * | 2018-06-12 | 2018-11-27 | 平安科技（深圳）有限公司 | A kind of operation system calls method, storage medium and the server of influxdb database |
| CN109144838A (en) * | 2018-09-28 | 2019-01-04 | 平安科技（深圳）有限公司 | Method for monitoring application program and device, computer installation and computer storage medium |
| CN109639472A (en) * | 2018-12-04 | 2019-04-16 | 科大国创软件股份有限公司 | The integrated alarm control method and system of container cloud platform based on Grafana |
| CN110247801A (en) * | 2019-06-19 | 2019-09-17 | 苏州浪潮智能科技有限公司 | A kind of monitoring system and method for pair of cluster host |
| CN110502424A (en) * | 2019-06-28 | 2019-11-26 | 浙江吉利控股集团有限公司 | A kind of performance data processing method of application software, device, system and terminal |
| CN110727564A (en) * | 2019-10-22 | 2020-01-24 | 上海游族信息技术有限公司 | Real-time monitoring method for test data of server performance pressure test |
| CN111914013A (en) * | 2020-08-13 | 2020-11-10 | 傲普(上海)新能源有限公司 | Data management method, system, terminal and medium based on pandas database and InfluxDB database |
| CN112965782A (en) * | 2019-12-13 | 2021-06-15 | 天翼电子商务有限公司 | Intelligent monitoring method and device for Docker container, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1480845A (en) * | 2003-07-15 | 2004-03-10 | 联想(北京)有限公司 | Method of realizing multimode interface for monitoring cluster for cluster monitoring system and its devices |
| CN101453743A (en) * | 2008-10-31 | 2009-06-10 | 中国移动通信集团北京有限公司 | Real-time monitoring system, apparatus and method |
| CN105208098A (en) * | 2015-08-24 | 2015-12-30 | 用友网络科技股份有限公司 | Cloud monitoring system realization device and method |
| CN105930380A (en) * | 2016-04-14 | 2016-09-07 | 北京思特奇信息技术股份有限公司 | Chart monitor method and device based on HADOOP |
-
2017
- 2017-07-25 CN CN201710615101.3A patent/CN107404417A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1480845A (en) * | 2003-07-15 | 2004-03-10 | 联想(北京)有限公司 | Method of realizing multimode interface for monitoring cluster for cluster monitoring system and its devices |
| CN101453743A (en) * | 2008-10-31 | 2009-06-10 | 中国移动通信集团北京有限公司 | Real-time monitoring system, apparatus and method |
| CN105208098A (en) * | 2015-08-24 | 2015-12-30 | 用友网络科技股份有限公司 | Cloud monitoring system realization device and method |
| CN105930380A (en) * | 2016-04-14 | 2016-09-07 | 北京思特奇信息技术股份有限公司 | Chart monitor method and device based on HADOOP |
Non-Patent Citations (2)
| Title |
|---|
| 李晟译: "TRIZ推动创新的技术", 《TRIZ推动创新的技术》 * |
| 王继成和李竹林: "大数据时代高校信息化战略与实践", 《大数据时代高校信息化战略与实践》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108512719A (en) * | 2018-03-02 | 2018-09-07 | 南京易捷思达软件科技有限公司 | A kind of Integrative resource monitoring system based on cloud platform of increasing income |
| CN108512719B (en) * | 2018-03-02 | 2021-06-08 | 南京易捷思达软件科技有限公司 | Integrated resource monitoring system based on open-source cloud platform |
| CN108897796A (en) * | 2018-06-12 | 2018-11-27 | 平安科技（深圳）有限公司 | A kind of operation system calls method, storage medium and the server of influxdb database |
| WO2019237533A1 (en) * | 2018-06-12 | 2019-12-19 | 平安科技（深圳）有限公司 | Method for calling influxdb database by service system, and storage medium, terminal device and apparatus |
| CN109144838A (en) * | 2018-09-28 | 2019-01-04 | 平安科技（深圳）有限公司 | Method for monitoring application program and device, computer installation and computer storage medium |
| CN109639472A (en) * | 2018-12-04 | 2019-04-16 | 科大国创软件股份有限公司 | The integrated alarm control method and system of container cloud platform based on Grafana |
| CN110247801A (en) * | 2019-06-19 | 2019-09-17 | 苏州浪潮智能科技有限公司 | A kind of monitoring system and method for pair of cluster host |
| CN110502424A (en) * | 2019-06-28 | 2019-11-26 | 浙江吉利控股集团有限公司 | A kind of performance data processing method of application software, device, system and terminal |
| CN110727564A (en) * | 2019-10-22 | 2020-01-24 | 上海游族信息技术有限公司 | Real-time monitoring method for test data of server performance pressure test |
| CN112965782A (en) * | 2019-12-13 | 2021-06-15 | 天翼电子商务有限公司 | Intelligent monitoring method and device for Docker container, storage medium and electronic equipment |
| CN111914013A (en) * | 2020-08-13 | 2020-11-10 | 傲普(上海)新能源有限公司 | Data management method, system, terminal and medium based on pandas database and InfluxDB database |
| CN111914013B (en) * | 2020-08-13 | 2023-02-28 | 傲普(上海)新能源有限公司 | Data management method, system, terminal and medium based on pandas database and InfluxDB database |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107404417A (en) | A kind of processing method of monitoring data, processing unit and processing system | |
| US11768811B1 (en) | Managing user data in a multitenant deployment | |
| US7982603B2 (en) | Sensor net system, sensor net system data managing method, and sensor net system data managing program | |
| CN106489251B (en) | The methods, devices and systems of applied topology relationship discovery | |
| US20120117226A1 (en) | Monitoring system of computer and monitoring method | |
| CN102298365B (en) | Method for automatically identifying and managing spaceflight measurement and control earth station device change | |
| CN104468274A (en) | Cluster monitor and management method and system | |
| CN113028603B (en) | Equipment monitoring system applied to central air-conditioning system | |
| US11681707B1 (en) | Analytics query response transmission | |
| CN109117341A (en) | A kind of monitoring method of virtual machine, device, equipment and medium | |
| US11699268B1 (en) | Techniques for placement of extended reality objects relative to physical objects in an extended reality environment | |
| CN101196901B (en) | Computer system and method for database query | |
| CN111563018A (en) | Resource management and monitoring method of man-machine-object fusion cloud computing platform | |
| CN114791846A (en) | Method for realizing observability aiming at cloud native chaos engineering experiment | |
| CN115883407A (en) | Data acquisition method, system, equipment and storage medium | |
| CN114745295A (en) | Data acquisition method, device, equipment and readable storage medium | |
| US10671470B2 (en) | Application performance management system with dynamic discovery and extension | |
| CN110708209B (en) | Virtual machine flow acquisition method and device, electronic equipment and storage medium | |
| US20160366021A1 (en) | User interface for an application performance management system | |
| CN107894942B (en) | Method and device for monitoring data table access amount | |
| CN112068953B (en) | Cloud resource fine management traceability system and method | |
| CN114816914A (en) | Data processing method, equipment and medium based on Kubernetes | |
| CN115374109A (en) | Data access method, device, computing equipment and system | |
| CN113824801A (en) | Intelligent integration terminal unified access management component system | |
| CN113810475A (en) | Wifi probe equipment management and control system based on big data architecture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171128 |
|
| RJ01 | Rejection of invention patent application after publication |