CN105930370A - Data monitoring method and device - Google Patents
Data monitoring method and device Download PDFInfo
- Publication number
- CN105930370A CN105930370A CN201610227558.2A CN201610227558A CN105930370A CN 105930370 A CN105930370 A CN 105930370A CN 201610227558 A CN201610227558 A CN 201610227558A CN 105930370 A CN105930370 A CN 105930370A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- distributed intelligence
- capacity
- temperature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/34—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
Abstract
The invention provides a data monitoring method and device. The data monitoring method includes: monitoring and acquiring hot rank information, distribution information, and flow direction information of data; and displaying the hot rank information, the distribution information, and the flow direction information in a graph manner. The acquired hot rank information, the acquired distribution information, and the acquired flow direction information of the data are displayed in the graph manner, and then the law of the data can be displayed visually, and data analysis becomes more efficient and accurate.
Description
Technical field
The present invention relates to data monitoring field, it particularly relates to the monitoring method and device of a kind of data.
Background technology
Currently along with integrated of the data that magnanimity increases and big data technique is more and more ripe, the most of data
Come and be used.Increasing data center data platform the most gradually starts to build with perfect.And data
Be worth represents, and increasingly tends to universalness and specialization.Analysis for different business data is shown current
Having the technology of comparative maturity, be applied to different business scenarios, ripe analysis exhibition method is the most a large amount of
Emerge in large numbers.
Existing data analysis is applied to the business tine of data more and is worth, and seldom has for data itself and dabbles
Content, and business scenario this for data center is paid close attention to may not be the information of data content, more
Many is the rule of of the data of each application system extraction storage itself on the contrary.
For the problem in correlation technique, effective solution is the most not yet proposed.
Summary of the invention
For the problem in correlation technique, the present invention proposes the monitoring method and device of a kind of data, it is possible to.
The technical scheme is that and be achieved in that:
According to an aspect of the invention, it is provided a kind of monitoring method of data.
This monitoring method includes:
Monitor and obtain temperature information, the distributed intelligence of data and flow to information；
Temperature information, distributed intelligence, the information of flow direction are carried out figure displaying.
In a preferred embodiment, temperature information includes at least one of:
The exterior heat degree information of data, application system data message, platform data temperature information.
In a preferred embodiment, distributed intelligence includes at least one of:
The table capacity information of data, application system capacity information, platform data capacity information.
In a preferred embodiment, obtain temperature information, the distributed intelligence of data and flow to information bag
Include:
Access times and/or visit capacity to data are added up, and obtain temperature information according to statistics；
Capacity information and/or record number to data are added up, and obtain distributed intelligence according to statistics；
The visitor information of data is added up, obtains according to statistics and flow to information.
In a preferred embodiment, the mode that figure is shown includes at least one of:
Bar chart, pie chart, broken line graph, data flow figure.
According to a further aspect in the invention, it is provided that the supervising device of a kind of data.
This supervising device includes:
Acquisition module, for monitoring and obtain temperature information, the distributed intelligence of data and flowing to information；
Display module, for carrying out figure displaying by temperature information, distributed intelligence, the information of flow direction.
In a preferred embodiment, temperature information includes at least one of:
The exterior heat degree information of data, application system data message, platform data temperature information.
In a preferred embodiment, distributed intelligence includes at least one of:
The table capacity information of data, application system capacity information, platform data capacity information.
In a preferred embodiment, acquisition module includes:
Temperature data obtaining module, for access times and/or the visit capacity of data are added up, according to
Statistics obtains temperature information；
Distributed intelligence acquisition module, for the capacity information of data and/or record number are added up, according to
Statistics obtains distributed intelligence；
Flow to data obtaining module, for the visitor information of data is added up, obtain according to statistics
Take the information of flow direction.
In a preferred embodiment, the mode that figure is shown includes at least one of:
Bar chart, pie chart, broken line graph, data flow figure.
The present invention is by temperature information, distributed intelligence and the flow direction of data that graphically will get
Information is shown such that it is able to the self-law of display data more intuitively, makes data analysis become more
It is efficient, accurate to add.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to enforcement
In example, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only
Some embodiments of the present invention, for those of ordinary skill in the art, are not paying creative work
Under premise, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the figure displaying figure of the monitoring method of data according to embodiments of the present invention；
Fig. 2 is the figure displaying figure of the monitoring method of data according to embodiments of the present invention；
Fig. 3 is the figure displaying figure of the monitoring method of data according to embodiments of the present invention；
Fig. 4 is the figure displaying figure of the monitoring method of data according to embodiments of the present invention；
Fig. 5 is the flow chart of the monitoring method of data according to embodiments of the present invention；
Fig. 6 is the block diagram of the supervising device of data according to embodiments of the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, be fully described by, it is clear that described embodiment be only a part of embodiment of the present invention rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art obtained all its
His embodiment, broadly falls into the scope of protection of the invention.
Data worth analysis to data center, the most non-is the consideration of three aspects, the respectively heat of data
Degree, data distribution and the data flow direction in each system, the valency three aspect analyses will shown below
Value is carried out and implementation is specifically described:
1. data temperature
Data value: data temperature reflects the data situation that is utilized in data center, a certain degree of shadow
Ring data value height.Quick by reflecting that the liveness of data can help data center to analyze personnel
Location corpse data and hot spot data, the data performance index in conjunction with other can give severing, lives as increased
Jump digital independent performance, migration corpse data etc..
Implementation method: the monitoring of data activity degree realizes, mainly does the monitoring unit of minimum with table, and fixed
Time the access information (access times, visit capacity) of table is added up, finally according to application system data, flat
Number of units evidence is done and is filed, and calculates exterior heat degree, application system data temperature and platform data temperature.Use statistical chart
The mode of table exhibition platform respectively, system, particular data table data by the access heat of other each application system
Degree and historical variations.
Information gathering process: the table data temperature collection for structured database Oracle Rac must be to the greatest extent
Amount does not affect the access times of record sheet the most truly in the case of performance.In view of this consideration, Oracle
Rac liveness statistics abandons employing the Oracle Rac audit log function bigger to performance impact, selects
A kind of mode that can substantially reflect table access number of times, sql is delayed by its main implementation for timing
Deposit the data in district to carry out extracting and being stored in analytical database, by contingency table in sql statement and affect record
Number add up each table access times during this period of time and access record number.
Table liveness statistics for unstructured data storehouse IBMP takes calling of extraction retrieval module
The mode of log information.By client retrieval service record information being decomposed the access of the table obtaining inquiry
Information and retrieval set information.
Exhibition method: data temperature ways of presentation is mainly by bar chart and broken line graph, wherein bar chart exhibition
Show current temperature state, it is possible to the condition of filtration specifically include that access application system, accessed application system,
Accessed table, accessed platform, statistical indicator (record number, number of times).Broken line graph to be shown for data
The historical variations of temperature, it is possible to the condition of filtration specifically include that access application system, accessed application system,
Accessed table, accessed platform, statistical indicator (record number, number of times) and time interval.
2. data distribution
Data value: data distribution index reflects each application system in the storage state of data center and data
Constitute, analyze personnel by this information data center and can quickly understand the data storage rule of each application system
And the capacity information of each layer memory cell.
Implementation method: the monitoring of data distribution realizes main by timing acquiring each application system Mapping Platform use
The capacity information (record number, capacity) of the affiliated table at family, and periodically acquisition and recording is held according to application system
Amount, table capacity, platform capacity do and file.Displaying aspect is represented by scatter diagram, pie chart, bar chart
System, table, the capacity status of platform and historical variations.
Information gathering process: structured database Oracle Rac, does not affect performance principle do not make for observing
The mode being the use of each table information that periodic refreshing system attempts by the mode of directly inquiry obtains each table
Capacity and record number.
The distributed intelligence of unstructured data storehouse IBMP obtains and have employed acquisition data file capacity and unit's number
The mode it is estimated obtains each table capacity and record number.
Exhibition method: data distribution mainly employs the displaying as data of scatter diagram, pie chart and bar chart.
Wherein data distribution scatter diagram (as shown in Figure 1) (are filled out with different types of in FIG by the color of point
Fill line and represent different colors) represent that application system, a point represent a table or file, a point
Size represent the capacity information of data, need the condition filtered to include: index (capacity, record number),
Platform.In a preferred embodiment, exhibition method can be pie chart, as shown in Figure 2.Pie chart is shown
The composition information of system, a kind of color in figure (represents difference with different types of filling line in fig. 2
Color) represent a file, table can be directly obtained from pie chart or the file heart in storage takies
Ratio, in another embodiment, a kind of color in figure can represent a table, and filter condition includes:
Index (capacity, record number), platform, application system.In another preferred embodiment, displaying side
Formula can also be bar chart, as shown in Figure 3.Bar chart illustrates the capacity comparison of each application system, at bar
In shape figure, a bar shaped represents a table or file, and the system that this table is applied, and bar chart is shown
The capacity of the memory cell of this table heart in storage, filter condition includes: index (capacity, record number),
Platform, application system.
3. data flow:
Data value: illustrate the feelings of each application system data interaction in data center by data flow index
Condition, it is possible to assist Platform Analysis teacher to understand the relation between each application system, be generally described out the producer and disappear
The data life period of the person of expense.
Implementation method: the monitoring realization of data flow is shown similar with data temperature, all uses the access of table to believe
Breath data, be different from is the information needing statistical information to also need to respectively to record different access person, in order to
Can understand data access person and owner, and show each data flow relation by flowing to statistical chart.
Information gathering: obtain mode with hot spot data similar, gathers cache information and the IBMP of Oracle
Retrieval log analysis go out the record of each application system user (asu) access table.
Exhibition method: data flow is shown by flow graph, different points is different application system,
The liveness that radiance size is system of the flicker of point, the line between system and system is access information, arrow
Data set provider is filled to data consumer in head direction, and the thickness of line represents the sudden strain of a muscle of the size of data volume, line
Bright speed representation interaction times.As shown in Figure 4, in the diagram, a circle represents one and answers statistical chart form
By system, and these application systems all run in storage center, wherein, and the line generation between each circle
Data between table application system use relation.
According to embodiments of the invention, it is provided that a kind of monitoring method of data.
As it is shown in figure 5, monitoring method according to embodiments of the present invention, including:
Step S501, monitors and obtains temperature information, the distributed intelligence of data and flow to information.?
In one preferred embodiment, data can be the data in structured database.Preferred at another
Embodiment in, data can be the data in unstructured data storehouse.
Step S503, carries out figure displaying by temperature information, distributed intelligence, the information of flow direction.Concrete,
In a preferred embodiment, the method that figure is shown includes but not limited at least one of: bar
Shape figure, broken line graph, pie chart, data flow figure.
According to a further aspect in the invention, it is provided that the supervising device of a kind of data.
As shown in Figure 6, supervising device according to embodiments of the present invention, including:
Acquisition module 61, for monitoring and obtain the temperature information of data, distributed intelligence and flowing to letter
Breath；
Display module 62, for carrying out figure displaying by temperature information, distributed intelligence, the information of flow direction.
In a preferred embodiment, temperature information includes at least one of:
The exterior heat degree information of data, application system data message, platform data temperature information.
In a preferred embodiment, distributed intelligence includes at least one of:
The table capacity information of data, application system capacity information, platform data capacity information.
In a preferred embodiment, acquisition module includes:
Temperature data obtaining module (not shown), this module is used for the access times to data and/or visit
The amount of asking is added up, and obtains temperature information according to statistics；
Distributed intelligence acquisition module (not shown), this module is used for the capacity information to data and/or note
Record number is added up, and obtains distributed intelligence according to statistics；
Flowing to data obtaining module (not shown), this module is for carrying out the visitor information of data
Statistics, obtains according to statistics and flows to information.
In a preferred embodiment, the mode that figure is shown includes at least one of:
Bar chart, pie chart, broken line graph.
In sum, by means of the technique scheme of the present invention, by the temperature information of data, distribution
Information and the information that flows to are monitored and show such that it is able to show the access temperature of data more intuitively
And historical variations, storage state and data are constituted and the interaction scenario of data, and then reflect data
Self-law, makes data analysis become more efficiently, accurately.
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all at this
Within bright spirit and principle, any modification, equivalent substitution and improvement etc. made, should be included in this
Within bright protection domain.
Claims (10)
1. the monitoring method of data, it is characterised in that including:
Monitor and obtain temperature information, the distributed intelligence of data and flow to information；
Described temperature information, described distributed intelligence, the described information that flows to are carried out figure displaying.
Monitoring method the most according to claim 1, it is characterised in that described temperature information includes
At least one of:
The exterior heat degree information of described data, application system data message, platform data temperature information.
Monitoring method the most according to claim 1, it is characterised in that described distributed intelligence includes
At least one of:
The table capacity information of described data, application system capacity information, platform data capacity information.
Monitoring method the most according to claim 1, it is characterised in that obtain the temperature letter of data
Breath, distributed intelligence and the information that flows to include:
Access times and/or visit capacity to described data are added up, and obtain described according to statistics
Temperature information；
Capacity information and/or record number to described data are added up, and obtain described according to statistics
Distributed intelligence；
The visitor information of described data is added up, flows to information according to statistics acquisition is described.
Monitoring method the most according to claim 1, it is characterised in that the side that described figure is shown
Formula includes at least one of:
Bar chart, pie chart, broken line graph, data flow figure.
6. the supervising device of data, it is characterised in that including:
Acquisition module, for monitoring and obtain temperature information, the distributed intelligence of data and flowing to information；
Display module, for carrying out described temperature information, described distributed intelligence, the described information that flows to
Figure is shown.
Supervising device the most according to claim 6, it is characterised in that described temperature information includes
At least one of:
The exterior heat degree information of described data, application system data message, platform data temperature information.
Supervising device the most according to claim 6, it is characterised in that described distributed intelligence includes
At least one of:
The table capacity information of described data, application system capacity information, platform data capacity information.
Supervising device the most according to claim 6, it is characterised in that acquisition module includes:
Temperature data obtaining module, for uniting to access times and/or the visit capacity of described data
Meter, obtains described temperature information according to statistics；
Distributed intelligence acquisition module, for uniting to the capacity information of described data and/or record number
Meter, obtains described distributed intelligence according to statistics；
Flow to data obtaining module, for adding up, the visitor information of described data according to system
Meter result acquisition is described flows to information.
Supervising device the most according to claim 6, it is characterised in that described figure is shown
Mode includes at least one of:
Bar chart, pie chart, broken line graph, data flow figure.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610227558.2A CN105930370A (en) | 2016-04-13 | 2016-04-13 | Data monitoring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610227558.2A CN105930370A (en) | 2016-04-13 | 2016-04-13 | Data monitoring method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105930370A true CN105930370A (en) | 2016-09-07 |
Family
ID=56839017
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610227558.2A Pending CN105930370A (en) | 2016-04-13 | 2016-04-13 | Data monitoring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105930370A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018133552A1 (en) * | 2017-01-19 | 2018-07-26 | 上海掌门科技有限公司 | Method and device for obtaining popularity of information stream |
| CN108595714A (en) * | 2018-05-14 | 2018-09-28 | 深圳市华傲数据技术有限公司 | A kind of date storage method, medium and equipment based on data base querying |
| CN108985817A (en) * | 2016-12-02 | 2018-12-11 | 口碑(上海)信息技术有限公司 | Associated services processing method and processing device, shop recommended method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103092867A (en) * | 2011-11-03 | 2013-05-08 | 中国移动通信集团甘肃有限公司 | Method and system for managing data, and data analyzing device |
| CN103729414A (en) * | 2013-12-12 | 2014-04-16 | 福建榕基软件股份有限公司 | Method and device for counting information interaction frequency |
| CN104781810A (en) * | 2012-09-28 | 2015-07-15 | 甲骨文国际公司 | Tracking row and object database activity into block level heatmaps |
| CN104915793A (en) * | 2015-06-30 | 2015-09-16 | 北京西塔网络科技股份有限公司 | Public information intelligent analysis platform based on big data analysis and mining |
| US20150278304A1 (en) * | 2014-03-26 | 2015-10-01 | International Business Machines Corporation | Autonomic regulation of a volatile database table attribute |
-
2016
- 2016-04-13 CN CN201610227558.2A patent/CN105930370A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103092867A (en) * | 2011-11-03 | 2013-05-08 | 中国移动通信集团甘肃有限公司 | Method and system for managing data, and data analyzing device |
| CN104781810A (en) * | 2012-09-28 | 2015-07-15 | 甲骨文国际公司 | Tracking row and object database activity into block level heatmaps |
| CN103729414A (en) * | 2013-12-12 | 2014-04-16 | 福建榕基软件股份有限公司 | Method and device for counting information interaction frequency |
| US20150278304A1 (en) * | 2014-03-26 | 2015-10-01 | International Business Machines Corporation | Autonomic regulation of a volatile database table attribute |
| CN104915793A (en) * | 2015-06-30 | 2015-09-16 | 北京西塔网络科技股份有限公司 | Public information intelligent analysis platform based on big data analysis and mining |
Non-Patent Citations (2)
| Title |
|---|
| 吕成哲: "Oracle数据库监控系统的设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
| 张乾尊等: "大型数据中心数据库表容量管理工具实现", 《中国金融电脑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108985817A (en) * | 2016-12-02 | 2018-12-11 | 口碑(上海)信息技术有限公司 | Associated services processing method and processing device, shop recommended method and device |
| CN108985817B (en) * | 2016-12-02 | 2021-03-23 | 口碑(上海)信息技术有限公司 | Associated business processing method and device and shop recommendation method and device |
| WO2018133552A1 (en) * | 2017-01-19 | 2018-07-26 | 上海掌门科技有限公司 | Method and device for obtaining popularity of information stream |
| US11159850B2 (en) | 2017-01-19 | 2021-10-26 | Shanghai Zhangmen Science And Technology Co., Ltd. | Method and device for obtaining popularity of information stream |
| CN108595714A (en) * | 2018-05-14 | 2018-09-28 | 深圳市华傲数据技术有限公司 | A kind of date storage method, medium and equipment based on data base querying |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Ratcliffe et al. | The crime reduction effects of public CCTV cameras: a multi‐method spatial approach | |
| CN105246033B (en) | A kind of crowd state monitoring method and monitoring device based on terminal positioning | |
| CN102065283B (en) | Storage management method and device of video monitoring data | |
| CN111291076B (en) | Abnormal water use monitoring alarm system based on big data and construction method thereof | |
| CN104183027B (en) | A kind of User Status determines method and device | |
| CA2605974A1 (en) | Automated reporting of computer system metrics | |
| Sun et al. | Real time anomalous trajectory detection and analysis | |
| CN105302697B (en) | A kind of running state monitoring method and system of density data model database | |
| CN105224821A (en) | The sick and wounded information monitoring early warning system of a kind of military personnel based on GIS and method | |
| US8656224B2 (en) | Network fault management in busy periods | |
| CN105930370A (en) | Data monitoring method and device | |
| US20070218834A1 (en) | Method and apparatus for continuous sampling of respondents | |
| CN107820214A (en) | A kind of user trajectory analysis system based on time suboptimal control | |
| CN113722383A (en) | Investigation device and method based on time sequence information | |
| CN111966293A (en) | Cold and hot data analysis method and system | |
| CN107093092B (en) | Data analysis method and device | |
| Grogan et al. | Estimating the probability that historical populations of fish species are extirpated | |
| CN109857824A (en) | Display methods, device and the readable storage medium storing program for executing of user's map | |
| CN112541047A (en) | Mass data aggregation method suitable for multistage gridding management system | |
| CN106843656A (en) | A kind of data display and the method for interaction | |
| CN108288228A (en) | Social network information acquisition methods and device | |
| Mullins et al. | Temperature, climate change, and mental health: Evidence from the spectrum of mental health outcomes | |
| CN111813922B (en) | High-temperature event detection method and system based on microblog text data | |
| Scammell | The implications of nurse shortages | |
| CN114418322A (en) | Enterprise index management method and device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160907 |