CN105279226A - Data monitoring method and equipment based on big data - Google Patents

Data monitoring method and equipment based on big data Download PDF

Info

Publication number
CN105279226A
CN105279226A CN201510572121.8A CN201510572121A CN105279226A CN 105279226 A CN105279226 A CN 105279226A CN 201510572121 A CN201510572121 A CN 201510572121A CN 105279226 A CN105279226 A CN 105279226A
Authority
CN
China
Prior art keywords
data
monitoring
time interval
corresponding relation
monitor data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510572121.8A
Other languages
Chinese (zh)
Inventor
张国磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Beijing Electronic Information Industry Co Ltd
Original Assignee
Inspur Beijing Electronic Information Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Beijing Electronic Information Industry Co Ltd filed Critical Inspur Beijing Electronic Information Industry Co Ltd
Priority to CN201510572121.8A priority Critical patent/CN105279226A/en
Publication of CN105279226A publication Critical patent/CN105279226A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses a data monitoring method and equipment based on big data. The method comprises the following steps: when an acquisition time is reached, acquiring monitoring data of a monitoring object; establishing a corresponding relationship of the acquisition time, identification information of the monitoring target and the monitoring data, and writing the established corresponding relationship into data processing equipment, so that data monitoring can be realized and the system resources can be saved.

Description

A kind of data monitoring method based on large data and equipment
Technical field
The present invention relates to data processing technique, espespecially a kind of data monitoring method based on large data and equipment.
Background technology
Along with the development of infotech, improving constantly of the level of informatization, the audient user of the new system developed gets more and more, and information system is to clustering and centralized management development.In order to manage large batch of Informationization Equipment, essential to the monitoring of Informationization Equipment.
Monitor data is a very huge data volume, in existing supervisory system, data are stored in database, and by writing algorithm, monitor data are managed, but a large amount of system resource can be taken by writing algorithm management monitor data, have impact on the operational efficiency of system.
Summary of the invention
In order to solve the problems of the technologies described above, the invention provides a kind of data monitoring method based on large data and equipment, while can data monitoring being carried out, save system resource.
In order to reach the object of the invention, the invention provides a kind of data monitoring method based on large data, comprising: when reaching the collection moment, the monitor data of acquisition monitoring target; Set up current described collection moment and the corresponding relation between the identification information of described monitoring objective and the described monitor data of described monitoring objective; By the described corresponding relation write data processing equipment set up.
Alternatively, the monitor data of described acquisition monitoring target comprises: gather described monitor data according to prefixed time interval by Restful interface, thus can simpler acquisition monitoring information, reduces the implementation complexity of data monitoring device.
Alternatively, described monitor data comprises numeric data.
Further, the invention provides a kind of data monitoring method based on large data, comprise: receive monitoring and inquiry instruction, wherein, described monitoring and inquiry instruction comprises the time interval of the monitor data of the identification information of monitoring objective and the correspondence of the described monitoring objective of inquiry; Obtain the corresponding relation of described identification information and described monitor data in described time interval; Generate the operation information of described monitoring objective in described time interval according to the corresponding relation of described acquisition, and show described operation information, wherein, described operation information comprises the corresponding relation of each moment in described time interval and described monitor data.
Alternatively, describedly generate the operation information of described monitoring objective in described time interval according to described data statistics, and show that described operation information comprises: generate the operation curve figure of described monitoring objective in described time interval according to described corresponding relation, and show described operation curve figure.
Further, the invention provides a kind of data monitoring device based on large data, comprising: collecting unit, for when reaching the collection moment, the monitor data of acquisition monitoring target; Set up unit, for setting up current described collection moment and the corresponding relation between the identification information of described monitoring objective and the monitor data of described monitoring objective, and by the corresponding relation of described foundation write data processing equipment.
Alternatively, described collecting unit, for gathering described monitor data according to prefixed time interval by Restful interface.
Alternatively, described monitor data comprises numeric data.
Further, the invention provides a kind of data processing equipment based on large data, comprising: receiving element, for receiving monitoring and inquiry instruction, wherein, described monitoring and inquiry instruction comprises the time interval of the monitor data of the identification information of monitoring objective and the correspondence of the described monitoring objective of inquiry; Acquiring unit, for obtaining the corresponding relation of described identification information and described monitor data in described time interval; Processing unit, for generating the operation information of described monitoring objective in described time interval according to described corresponding relation, and show described operation information, wherein, described operation information comprises the corresponding relation of each moment in described time interval and described monitor data.
Alternatively, described processing unit, for generating the operation curve figure of described monitoring objective in described time interval according to described data statistics, and shows described operation curve figure.
Compared with prior art, present invention achieves the monitor data of collection and monitoring objective and gather the moment and be mapped, the operation information of this monitoring objective is inquired accurately by the monitor data of monitoring objective and the corresponding relation set up between time interval and the identification information of monitoring objective, thus easily unified management is carried out to the monitor data of monitoring objective, do not need to write extra algorithm again to manage monitor data, and then solve the problem that resolution system resource occupation is excessive when carrying out data monitoring.
Other features and advantages of the present invention will be set forth in the following description, and, partly become apparent from instructions, or understand by implementing the present invention.Object of the present invention and other advantages realize by structure specifically noted in instructions, claims and accompanying drawing and obtain.
Accompanying drawing explanation
Accompanying drawing is used to provide the further understanding to technical solution of the present invention, and forms a part for instructions, is used from and explains technical scheme of the present invention, do not form the restriction to technical solution of the present invention with the embodiment one of the application.
The schematic flow sheet of a kind of data monitoring method based on large data that Fig. 1 provides for the embodiment of the present invention;
The another kind that Fig. 2 provides for the embodiment of the present invention is based on the schematic flow sheet of the data monitoring method of large data;
Another schematic flow sheet based on the data monitoring method of large data that Fig. 3 provides for the embodiment of the present invention;
The schematic flow sheet of a kind of data monitoring device based on large data that Fig. 4 provides for the embodiment of the present invention;
The schematic flow sheet of a kind of data processing equipment based on large data that Fig. 5 provides for the embodiment of the present invention.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly understand, hereinafter will be described in detail to embodiments of the invention by reference to the accompanying drawings.It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combination in any mutually.
Can perform in the computer system of such as one group of computer executable instructions in the step shown in the process flow diagram of accompanying drawing.Further, although show logical order in flow charts, in some cases, can be different from the step shown or described by order execution herein.
A kind of data monitoring method based on large data that Fig. 1 provides for the embodiment of the present invention, as shown in Figure 1, the executive agent of the method embodiment can be data monitoring device, and the method comprises:
Step 101, reach gather the moment time, the monitor data of acquisition monitoring target.
Wherein, this data monitoring device can the monitor data of timing acquiring monitoring objective.
In embodiments of the present invention, this monitoring objective can be central processing unit (CPU, CentralProcessingUnit), then this identification information is the title of this CPU, this monitor data comprises numeric data, and such as this monitor data can be the information such as the temperature of the resources occupation rate of this CPU, the dominant frequency of this CPU or this CPU.
Particularly, data monitoring device gathers this monitor message according to prefixed time interval by Restful interface.
Wherein, the granularity of this prefixed time interval can be minute, hour or day, like this, the collection of the monitor data in different time span can be realized in the extremely short time (as 1 second).
It should be noted that, Restful interface is based on sign state transfer (REST, RepresentationalStateTransfer) interface of framework, REST refers to shelving structure constraint condition and a principle, the application program or the design that meet these constraint conditions and principle are exactly application program based on Restful framework or design, in embodiments of the present invention, gather this monitor message by Restful interface to need to realize Restful framework, this Restful framework is generally with HTML (Hypertext Markup Language) (HTTP, HyperTextTransferProtocol) agreement transmitted as data of agreement, what utilize the semanteme of HTTP itself to realize between client and server is mutual.Adopt this Restful interface can simpler acquisition monitoring information, reduce the implementation complexity of data monitoring device.
Step 102, set up current collection moment and the corresponding relation between the identification information of monitoring objective and the monitor data of monitoring objective.
In embodiments of the present invention, data monitoring device, after setting up corresponding relation, can generate data statistics according to this corresponding relation; Wherein, the collection moment is the moment that this data monitoring device collects this monitor data, in embodiments of the present invention, data monitoring device is gathering the moment according to identification information acquisition monitoring data, and set up the monitor data corresponding relation gathering moment and identification information and collect, and generate data statistics according to this corresponding relation, the data statistics of generation can be data statistic, for CPU, this data statistic can be as shown in the table:
Title Gather the moment Numerical value
CPU 2015-06-24 10:20:44 3
Table 1
As shown in table 1, title in table 1 is the identification information (CPU as in table 1) of this monitoring objective, collection timetable in table 1 shows that data monitoring device was on June 24th, 2015, when the morning 10,20 points collect the monitor data of this CPU for 44 seconds, numerical value in table 1 is this monitor data, this numerical value can be the information such as the resources occupation rate of this CPU or the temperature of CPU, the embodiment of the present invention is not construed as limiting this, the monitor data of other numeric types is also within the protection domain of the embodiment of the present invention, such as, the information such as dominant frequency of CPU; Numerical value " 3 " in table 1 is the numerical value of this monitor data, and certainly, this numerical value just illustrates, is not construed as limiting.
It should be noted that; the exemplary illustration that above-mentioned table 1 just carries out for convenience of description; data statistics in the embodiment of the present invention is not limited to the form of data statistic; the form of the identification information of other more enough performance monitoring objectives and the corresponding relation of collection moment and monitor data also drops in protection scope of the present invention; such as, can also be the forms such as mapping table.
Step 103, the corresponding relation write data processing equipment that will set up.
In embodiments of the present invention, this data statistics, after generating data statistics according to the corresponding relation set up, is write data processing equipment by data monitoring device.
Particularly, data statistics can be write the large data platform built based on this data processing equipment the interval several seconds by data monitoring device, and large data platform is by data persistence (namely storing this data statistics); Utilize the ability of the large data processing of large data platform, the data of 1,000,000 grades computing in less than a second can be completed, thus achieve rapid computations.
It should be noted that, data statistics can be write data processing equipment according to Preset Time by this data monitoring device, thus prevents frequently writing the system resource caused and take excessive problem, and then has saved system resource.
Adopt said method, by the monitor data of collection and the identification information gathering moment and monitoring objective are set up corresponding relation, and generate data statistics according to this corresponding relation, and by this data statistics write data processing equipment, like this, achieve the monitor data of collection and monitoring objective and gather the moment and be mapped, thus easily unified management is carried out to the monitor data obtained, do not need to write extra algorithm again to manage monitor data, and then achieve saving system resource while data monitoring.
A kind of data monitoring method based on large data that Fig. 2 provides for the embodiment of the present invention, as shown in Figure 2, the executive agent of the method embodiment can be data processing equipment, and the method comprises:
Step 201, the instruction of reception monitoring and inquiry.
Wherein, this monitoring and inquiry instruction comprises the time interval of the monitor data of the identification information of monitoring objective and the correspondence of this monitoring objective of inquiry.
Particularly, user by the large data platform set up based on data processing equipment, can input monitoring objective to be checked and inquires about time interval corresponding to this monitoring objective; This time interval can be one hour, one day or one month, and the present invention is not construed as limiting this.
The corresponding relation of identification information and monitor data in step 202, acquisition time interval.
Wherein, this corresponding relation can be represent the identification information of the monitoring objective in time interval and the corresponding relation of monitor data with the form of data statistics, and this data statistics comprises the corresponding relation of collection moment corresponding to this monitor data and this identification information and monitor data.
Illustratively, this monitoring objective is described for CPU, user inputs the title " CPU " of this CPU, and the input inquiry time " 2015-06-2410:20:44-2015-06-2411:20:44 ", then this data processing equipment obtains this CPU at data statistics corresponding to each moment of time interval " 2015-06-2410:20:44-2015-06-2411:20:44 ".
In a kind of possible implementation of the present invention, the query interface that this large data platform provides comprises the identification information (as title) of default multiple monitoring objectives, and the identification information of this monitoring objective preset is showed user's (such as showing user with the form of drop-down list), user selects monitoring objective to be checked by the identification information of the multiple monitoring objectives shown, same, this time interval also can preset multiple time period, user selects time interval to be checked by the multiple time periods shown, identification information and the time interval of above-mentioned input monitoring target just illustrate, be not construed as limiting.
Step 203, generate the operation information of this monitoring objective in this time interval according to the corresponding relation obtained, and show this operation information.
Wherein, this operation information comprises the corresponding relation of each moment in time interval and this monitor data.
Alternatively, this step 203 comprises: generate the operation curve figure of monitoring objective in time interval according to the corresponding relation obtained, and show operation curve figure.
Wherein, this operation curve figure represents the operation trend of the monitor data of this monitoring objective in time interval, and like this, user can watch the operation information of this monitoring objective intuitively, improves Consumer's Experience.
It should be noted that; this operation curve figure just illustrates; the present invention is not construed as limiting this; other can represent that the monitor data of this monitoring objective and the form of expression of time interval corresponding relation also drop within protection scope of the present invention, such as, also can be the form of expression such as histogram or bubble diagram.
Adopt said method, by the monitor data of monitoring objective and the corresponding relation set up between time interval and the identification information of monitoring objective, the operation information of this monitoring objective can be inquired accurately, thus easily unified management is carried out to the monitor data of monitoring objective, do not need to write extra algorithm again to manage monitor data, and then solve the problem that resolution system resource occupation is excessive when carrying out data monitoring.
A kind of data monitoring method based on large data that Fig. 3 provides for the embodiment of the present invention, as shown in Figure 3, the method comprises:
Step 301, reach gather the moment time, data monitoring device gathers this monitor data according to prefixed time interval by Restful interface.
Wherein, this monitor data comprises numeric data, and this data monitoring device can the monitor data of timing acquiring monitoring objective.
In embodiments of the present invention, this monitoring objective can be CPU, then this identification information is the title of this CPU, and this monitor data comprises numeric data, and such as this monitor data can be the information such as the temperature of the resources occupation rate of this CPU, the dominant frequency of this CPU or this CPU.
Particularly, data monitoring device gathers this monitor message according to prefixed time interval by Restful interface.
Wherein, the granularity of this prefixed time interval can be minute, hour or day, like this, the collection of the monitor data in different time span can be realized in the extremely short time (as 1 second).
It should be noted that, Restful interface is the interface based on REST framework, REST refers to shelving structure constraint condition and a principle, the application program or the design that meet these constraint conditions and principle are exactly application program based on Restful framework or design, in embodiments of the present invention, gather this monitor message by Restful interface to need to realize Restful framework, the agreement that this Restful framework generally transmits using http protocol as data, what utilize the semanteme of HTTP itself to realize between client and server is mutual.Adopt this Restful interface can simpler acquisition monitoring information, reduce the implementation complexity of data monitoring device.
Step 302, data monitoring device set up current collection moment and the corresponding relation between the identification information of monitoring objective and the monitor data of monitoring objective, and generate data statistics according to this corresponding relation.
Wherein, the collection moment is the moment that this data monitoring device collects this monitor data, in embodiments of the present invention, data monitoring device is gathering the moment according to identification information acquisition monitoring data, and set up and gather moment and identification information and monitor data corresponding relation, thus generating data statistics, the data statistics of generation can be data statistic, for CPU, this data statistic can be as shown in the table:
Title Gather the moment Numerical value
CPU 2015-06-24 10:20:44 3
Table 1
As shown in table 1, title in table 1 is the identification information (CPU as in table 1) of this monitoring objective, collection timetable in table 1 shows that data monitoring device was on June 24th, 2015, when the morning 10,20 points collect the monitor data of this CPU for 44 seconds, numerical value in table 1 is this monitor data, this numerical value can be the information such as the resources occupation rate of this CPU or the temperature of CPU, the embodiment of the present invention is not construed as limiting this, the monitor data of other numeric types is also within the protection domain of the embodiment of the present invention, such as, the information such as dominant frequency of CPU; Numerical value " 3 " in table 1 is the numerical value of this monitor data, and certainly, this numerical value just illustrates, is not construed as limiting.
It should be noted that; the exemplary illustration that above-mentioned table 1 just carries out for convenience of description; data statistics in the embodiment of the present invention is not limited to the form of data statistic; the form of the identification information of other more enough performance monitoring objectives and the corresponding relation of collection moment and monitor data also drops in protection scope of the present invention; such as, can also be the forms such as mapping table.
Step 303, data monitoring device are by this data statistics write data processing equipment.
Particularly, data statistics can be write the large data platform built based on this data processing equipment the interval several seconds by data monitoring device, and large data platform is by data persistence (namely storing this data statistics); Utilize the ability of the large data processing of large data platform, the data of 1,000,000 grades computing in less than a second can be completed, thus achieve rapid computations.
It should be noted that, data statistics can be write data processing equipment according to Preset Time by this data monitoring device, thus prevents frequently writing the system resource caused and take excessive problem, and then has saved system resource.
Step 304, data processing equipment receive monitoring and inquiry instruction.
Wherein, this monitoring and inquiry instruction comprises the time interval of the monitor data of the identification information of monitoring objective and the correspondence of this monitoring objective of inquiry.
Particularly, user by the large data platform set up based on data processing equipment, can input monitoring objective to be checked and inquires about time interval corresponding to this monitoring objective; This time interval can be one hour, one day or one month, and the present invention is not construed as limiting this.
Step 305, data processing equipment obtain the data statistics that in this time interval, this identification information is corresponding.
Wherein, this data statistics comprises the corresponding relation of collection moment corresponding to this monitor data and this identification information and monitor data.
Illustratively, this monitoring objective is described for CPU, user inputs the title " CPU " of this CPU, and the input inquiry time " 2015-06-2410:20:44-2015-06-2411:20:44 ", then this data processing equipment obtains this CPU at data statistics corresponding to each moment of time interval " 2015-06-2410:20:44-2015-06-2411:20:44 ".
In a kind of possible implementation of the present invention, the query interface that this large data platform provides comprises the identification information (as title) of default multiple monitoring objectives, and the identification information of this monitoring objective preset is showed user's (such as showing user with the form of drop-down list), user selects monitoring objective to be checked by the identification information of the multiple monitoring objectives shown, same, this time interval also can preset multiple moment section, user selects time interval to be checked by multiple moment sections of showing, identification information and the time interval of above-mentioned input monitoring target just illustrate, be not construed as limiting.
Step 306, data processing equipment generate the operation curve figure of this monitoring objective in this time interval according to this data statistics, and show this operation curve figure.
Wherein, this operation curve figure represents the operation trend of the monitor data of this monitoring objective in time interval, and like this, user can watch the operation information of this monitoring objective intuitively, improves Consumer's Experience.
It should be noted that; this operation curve figure just illustrates; the present invention is not construed as limiting this; other can represent that the monitor data of this monitoring objective and the form of expression of time interval corresponding relation also drop within protection scope of the present invention, such as, also can be the form of expression such as histogram or bubble diagram.
Adopt said method, by the monitor data of collection and the identification information gathering moment and monitoring objective are set up corresponding relation, and generate data statistics according to this corresponding relation, and by this data statistics write data processing equipment, user inquires about the operation information of this monitoring objective easily according to this corresponding relation by this data processing equipment, like this, achieve the monitor data of collection and monitoring objective and gather the moment and be mapped, thus easily unified management is carried out to the monitor data obtained, do not need to write extra algorithm again to manage monitor data, and then achieve saving system resource while data monitoring.
Fig. 4 is a kind of data monitoring device based on large data according to the embodiment of the present invention, and as shown in Figure 4, this data monitoring device at least comprises: collecting unit 401, set up unit 402 and writing unit 403, wherein,
Collecting unit 401, for when reaching the collection moment, the monitor data of acquisition monitoring target.
Wherein, this data monitoring device can the monitor data of timing acquiring monitoring objective.
In embodiments of the present invention, this monitoring objective can be CPU, then this identification information is the title of this CPU, and this monitor data comprises numeric data, and such as this monitor data can be the information such as the temperature of the resources occupation rate of this CPU, the dominant frequency of this CPU or this CPU.
Set up unit 402, for setting up current collection moment and the corresponding relation between the identification information of monitoring objective and the monitor data of monitoring objective.
Writing unit 403, for the corresponding relation write data processing equipment that will set up.
In embodiments of the present invention, this data statistics, after generating data statistics according to the corresponding relation set up, is write data processing equipment by data monitoring device.
Particularly, data statistics can be write the large data platform built based on this data processing equipment the interval several seconds by data monitoring device, and large data platform is by data persistence (namely storing this data statistics); Utilize the ability of the large data processing of large data platform, the data of 1,000,000 grades computing in less than a second can be completed, thus achieve rapid computations.
Further, this collecting unit 401, for gathering this monitor data according to prefixed time interval by Restful interface.
It should be noted that, Restful interface is the interface based on REST framework, REST refers to shelving structure constraint condition and a principle, the application program or the design that meet these constraint conditions and principle are exactly application program based on Restful framework or design, in embodiments of the present invention, gather this monitor message by Restful interface to need to realize Restful framework, the agreement that this Restful framework generally transmits using http protocol as data, what utilize the semanteme of HTTP itself to realize between client and server is mutual.Adopt this Restful interface can simpler acquisition monitoring information, reduce the implementation complexity of data monitoring device.
Further, this monitor data comprises numeric data.
Adopt above-mentioned data monitoring device, by the monitor data of collection and the identification information gathering moment and monitoring objective are set up corresponding relation, and generate data statistics according to this corresponding relation, and by this data statistics write data processing equipment, like this, achieve the monitor data of collection and monitoring objective and gather the moment and be mapped, thus easily unified management is carried out to the monitor data obtained, do not need to write extra algorithm again to manage monitor data, and then achieve saving system resource while data monitoring.
Affiliated those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the data monitoring device of foregoing description and description, with reference to the corresponding process in preceding method embodiment, can not repeat them here.
Fig. 5 is a kind of data processing equipment based on large data according to the embodiment of the present invention, and as shown in Figure 5, this data processing equipment at least comprises: receiving element 501, acquiring unit 502 and processing unit 503, wherein,
Receiving element 501, for receiving monitoring and inquiry instruction, wherein, monitoring and inquiry instruction comprises the time interval of the monitor data of the identification information of monitoring objective and the correspondence of this monitoring objective of inquiry.
Acquiring unit 502, for the corresponding relation of identification information and monitor data in acquisition time interval.
Particularly, user by the large data platform set up based on data processing equipment, can input monitoring objective to be checked and inquires about time interval corresponding to this monitoring objective; This time interval can be one hour, one day or one month, and the present invention is not construed as limiting this.
Processing unit 503, for generating the operation information of monitoring objective in time interval according to corresponding relation, and shows operation information.
Wherein, operation information comprises the corresponding relation of each moment in time interval and monitor data.
Illustratively, this corresponding relation can be represent the identification information of the monitoring objective in time interval and the corresponding relation of monitor data with the form of data statistics, this data statistics comprises the corresponding relation of collection moment corresponding to this monitor data and this identification information and monitor data, this monitoring objective is described for CPU, user inputs the title " CPU " of this CPU, and the input inquiry time " 2015-06-2410:20:44-2015-06-2411:20:44 ", then this data processing equipment obtains this CPU at data statistics corresponding to each moment of time interval " 2015-06-2410:20:44-2015-06-2411:20:44 ".
In a kind of possible implementation of the present invention, the query interface that this large data platform provides comprises the identification information (as title) of default multiple monitoring objectives, and the identification information of this monitoring objective preset is showed user's (such as showing user with the form of drop-down list), user selects monitoring objective to be checked by the identification information of the multiple monitoring objectives shown, same, this time interval also can preset multiple time period, user selects time interval to be checked by the multiple time periods shown, identification information and the time interval of above-mentioned input monitoring target just illustrate, be not construed as limiting.
Further, this processing unit 503, for generating the operation curve figure of this monitoring objective in this time interval according to this data statistics, and shows this operation curve figure.
Wherein, this operation curve figure represents the operation trend of the monitor data of this monitoring objective in time interval, and like this, user can watch the operation information of this monitoring objective intuitively, improves Consumer's Experience.
It should be noted that; this operation curve figure just illustrates; the present invention is not construed as limiting this; other can represent that the monitor data of this monitoring objective and the form of expression of time interval corresponding relation also drop within protection scope of the present invention, such as, also can be the form of expression such as histogram or bubble diagram.
Affiliated those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the data processing equipment of foregoing description and description, with reference to the corresponding process in preceding method embodiment, can not repeat them here.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
In the above embodiment of the present invention, the description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.
In several embodiments that the application provides, should be understood that, disclosed technology contents, the mode by other realizes.Wherein, device embodiment described above is only schematic, the such as division of described unit, can be that a kind of logic function divides, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of unit or module or communication connection can be electrical or other form.
The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed on multiple unit.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.
If described integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprises all or part of step of some instructions in order to make a computer equipment (can be personal computer, server or the network equipment etc.) perform method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, ROM (read-only memory) (ROM, Read-OnlyMemory), random access memory (RAM, RandomAccessMemory), portable hard drive, magnetic disc or CD etc. various can be program code stored medium.
Although the embodiment disclosed by the present invention is as above, the embodiment that described content only adopts for ease of understanding the present invention, and be not used to limit the present invention.Those of skill in the art belonging to any the present invention; under the prerequisite not departing from the spirit and scope disclosed by the present invention; any amendment and change can be carried out in the form implemented and details; but scope of patent protection of the present invention, the scope that still must define with appending claims is as the criterion.

Claims (10)

1. based on a data monitoring method for large data, it is characterized in that, comprising:
When reaching the collection moment, the monitor data of acquisition monitoring target;
Set up current described collection moment and the corresponding relation between the identification information of described monitoring objective and the described monitor data of described monitoring objective;
By the described corresponding relation write data processing equipment set up.
2. method according to claim 1, is characterized in that, the monitor data of described acquisition monitoring target comprises:
Described monitor data is gathered by Restful interface according to prefixed time interval.
3. method according to claim 1 and 2, is characterized in that, described monitor data comprises numeric data.
4. based on a data monitoring method for large data, it is characterized in that, comprising:
Receive monitoring and inquiry instruction, wherein, described monitoring and inquiry instruction comprises the identification information of monitoring objective and inquires about the time interval of monitor data corresponding to described monitoring objective;
Obtain the corresponding relation of described identification information and described monitor data in described time interval;
Generate the operation information of described monitoring objective in described time interval according to the corresponding relation of described acquisition, and show described operation information, wherein, described operation information comprises the corresponding relation of each moment in described time interval and described monitor data.
5. method according to claim 4, is characterized in that, describedly generates the operation information of described monitoring objective in described time interval according to described data statistics, and shows that described operation information comprises:
Generate the operation curve figure of described monitoring objective in described time interval according to described corresponding relation, and show described operation curve figure.
6. based on a data monitoring device for large data, it is characterized in that, comprising:
Collecting unit, for when reaching the collection moment, the monitor data of acquisition monitoring target;
Set up unit, for setting up current described collection moment and the corresponding relation between the identification information of described monitoring objective and the described monitor data of described monitoring objective;
Writing unit, for writing data processing equipment by the corresponding relation of described foundation.
7. equipment according to claim 6, is characterized in that, described collecting unit, for gathering described monitor data according to prefixed time interval by Restful interface.
8. the equipment according to claim 6 or 7, is characterized in that, described monitor data comprises numeric data.
9. based on a data processing equipment for large data, it is characterized in that, comprising:
Receiving element, for receiving monitoring and inquiry instruction, wherein, described monitoring and inquiry instruction comprises the time interval of the monitor data of the identification information of monitoring objective and the correspondence of the described monitoring objective of inquiry;
Acquiring unit, for obtaining the corresponding relation of described identification information and described monitor data in described time interval;
Processing unit, for generating the operation information of described monitoring objective in described time interval according to described corresponding relation, and show described operation information, wherein, described operation information comprises the corresponding relation of each moment in described time interval and described monitor data.
10. equipment according to claim 9, is characterized in that, described processing unit, for generating the operation curve figure of described monitoring objective in described time interval according to described data statistics, and shows described operation curve figure.
CN201510572121.8A 2015-09-09 2015-09-09 Data monitoring method and equipment based on big data Pending CN105279226A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510572121.8A CN105279226A (en) 2015-09-09 2015-09-09 Data monitoring method and equipment based on big data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510572121.8A CN105279226A (en) 2015-09-09 2015-09-09 Data monitoring method and equipment based on big data

Publications (1)

Publication Number Publication Date
CN105279226A true CN105279226A (en) 2016-01-27

Family

ID=55148240

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510572121.8A Pending CN105279226A (en) 2015-09-09 2015-09-09 Data monitoring method and equipment based on big data

Country Status (1)

Country Link
CN (1) CN105279226A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107705149A (en) * 2017-09-22 2018-02-16 平安科技(深圳)有限公司 Data method for real-time monitoring, device, terminal device and storage medium
CN108197001A (en) * 2018-01-11 2018-06-22 北京比特大陆科技有限公司 Data statistical approach, device and electronic equipment
CN109597736A (en) * 2018-12-03 2019-04-09 郑州云海信息技术有限公司 A kind of monitoring method, device, equipment and medium
WO2019218513A1 (en) * 2018-05-16 2019-11-21 平安科技(深圳)有限公司 Apparatus and method for monitoring testing process, and computer-readable storage medium
CN115442215A (en) * 2022-09-08 2022-12-06 平安付科技服务有限公司 Processing method, device, equipment and medium for storage cluster monitoring data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902797A (en) * 2012-10-11 2013-01-30 福建亿同世纪软件有限公司 Method for storing and retrieving real-time monitored data of large-volume equipment
CN103440726A (en) * 2013-09-03 2013-12-11 苏州太谷电力股份有限公司 Electrical fire warning information processing method and system
CN104156211A (en) * 2014-08-08 2014-11-19 北京大学 Universal data interface used for sensor and data calling method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902797A (en) * 2012-10-11 2013-01-30 福建亿同世纪软件有限公司 Method for storing and retrieving real-time monitored data of large-volume equipment
CN103440726A (en) * 2013-09-03 2013-12-11 苏州太谷电力股份有限公司 Electrical fire warning information processing method and system
CN104156211A (en) * 2014-08-08 2014-11-19 北京大学 Universal data interface used for sensor and data calling method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107705149A (en) * 2017-09-22 2018-02-16 平安科技(深圳)有限公司 Data method for real-time monitoring, device, terminal device and storage medium
CN108197001A (en) * 2018-01-11 2018-06-22 北京比特大陆科技有限公司 Data statistical approach, device and electronic equipment
CN108197001B (en) * 2018-01-11 2021-11-30 蚂蚁矿池科技有限公司 Data statistical method and device and electronic equipment
WO2019218513A1 (en) * 2018-05-16 2019-11-21 平安科技(深圳)有限公司 Apparatus and method for monitoring testing process, and computer-readable storage medium
CN109597736A (en) * 2018-12-03 2019-04-09 郑州云海信息技术有限公司 A kind of monitoring method, device, equipment and medium
CN115442215A (en) * 2022-09-08 2022-12-06 平安付科技服务有限公司 Processing method, device, equipment and medium for storage cluster monitoring data

Similar Documents

Publication Publication Date Title
CN105279226A (en) Data monitoring method and equipment based on big data
US11457029B2 (en) Log analysis based on user activity volume
US20150095381A1 (en) Method and apparatus for managing time series database
EP2456076A1 (en) Analysis of large data sets using distributed polynominal interpolation
CN102681999A (en) Method and device for collecting and sending user action information
CN103942136B (en) Log statistic tactics configuring method and device, log statistic method and apparatus
CN102880676A (en) Statistical method for user behavior data and user behavior data statistical system
CN111190888A (en) Method and device for managing graph database cluster
CN104182506A (en) Log management method
CN103714133A (en) Data operation and maintenance management method and device
CN105260414A (en) User behavior similarity computing method and device
CN105450705A (en) Service data processing method and apparatus
CN110874272A (en) Resource allocation method and device, computer readable storage medium and electronic device
CN105512261A (en) Method and system for expressing front end lightweight statistical data
CN104217004A (en) Monitoring method and device for database hot spot of transaction system
CN105049290A (en) Method and device for monitoring page access
CN112764993A (en) Node information collection method, device, equipment and readable storage medium
CN105162622B (en) A kind of storage method and system
CN115408546A (en) Time sequence data management method, device, equipment and storage medium
CN111666344A (en) Heterogeneous data synchronization method and device
CN101495978B (en) Reduction of message flow between bus-connected consumers and producers
CN105471607A (en) Tree-shaped monitoring method for large-scale cluster nodes dynamic information
CN103226572A (en) Expandable monitoring method and monitoring system based on data compression
Lee et al. Detecting anomaly teletraffic using stochastic self-similarity based on Hadoop
CN115525603A (en) Storage statistics method and device, computer readable storage medium and AI device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160127

RJ01 Rejection of invention patent application after publication