CN106549829A - Big data calculating platform monitoring system and method - Google Patents
Big data calculating platform monitoring system and method Download PDFInfo
- Publication number
- CN106549829A CN106549829A CN201610970996.8A CN201610970996A CN106549829A CN 106549829 A CN106549829 A CN 106549829A CN 201610970996 A CN201610970996 A CN 201610970996A CN 106549829 A CN106549829 A CN 106549829A
- Authority
- CN
- China
- Prior art keywords
- calculating
- monitoring
- module
- platform
- calculating platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a kind of big data calculating platform monitoring system and its method, the system includes：Data acquisition module, the monitor control index for obtaining and storing computing environment in calculating platform in real time and the monitor control index for calculating monitoring operation, and be that environment monitoring module and monitoring operation module open query interface；Environmental monitoring module, carries out monitor in real time to the computing environment of calculating platform, obtains the monitor control index of the computing environment of big data calculating platform, and the monitor control index of these computing environment is carried out visual presentation from the data acquisition module；Monitoring operation module, the calculating operation to calculating platform carry out monitor in real time, obtain the monitor control index of the calculating operation of big data calculating platform, and the monitor control index for calculating operation is carried out visual presentation from data acquisition module.The present invention can reduce the complexity that operating process is managed for big data calculating platform, there is provided the monitoring system of intelligent, directly perceived, easy-to-use and quick response.
Description
Technical field
The present invention relates to distributed computing technology field, specifically, more particularly to is directed to Storm and Hadoop big datas
The monitoring system of calculating platform.
Background technology
The continuous improvement of social informatization technology, many business scope generation magnanimity, real-time data, and different field pair
Data processing respectively has demand again.Current big data analysis gradually based on destructuring, unit device memory space and operational capability
Can not meet, the Apache Hadoop that then calculate respectively for mass data and real time data in distributed environment and
Apache Storm systems, are widely used in the application of business scope, progressively become industry main flow, also become currently in fact
Standard.
The commercial Hadoop and Storm number of clusters of industry is from hundreds of to thousands of so that management scale and difficulty
Degree is increasing, not only obtains difficult to cluster interior joint resource distribution, real time resources occupancy and service arrangement etc., makees calculating
Submission, scheduling and revocation of industry etc. are also required to expend the maintenance of manager's great effort.For example, the configuration of each cluster, cluster master
The configuration of the startup class of control node location, the calculating type of operation and operation, all considerably increases the difficulty of management.Prior art
In disclose the distributed monitoring system of some Hadoop clusters, but not yet there is the monitoring system for supporting Storm clusters.Such as public affairs
Patent document of the number of opening for CN 102130950A《Distributed monitoring system and its monitoring method based on Hadoop clusters》；It is public
Patent document of the number of opening for 103678521 A of CN《A kind of distributed document monitoring system based on Hadoop frameworks》；Publication number
For the patent document of 104615526 A of CN《A kind of monitoring system of big data platform》Deng.Analyzing ins and outs therein can
Know, its monitoring system to big data calculating platform is simultaneously imperfect and perfect, is mainly reflected in the following aspects：
First aspect：Work at present lacks to batch processing calculating and stream process calculating integrated management and monitoring.It is current
Work is both for the monitoring system of the Hadoop calculating platforms of magnanimity off-line data process, and is directed to real-time online data processing
The monitoring of Storm calculating platforms still there is blank, and the latter is already the industry main flow and the fact that big data streaming is calculated
On standard.
Second aspect：Fine granularity monitoring of the work at present to PC cluster resource supports not enough.Being directed to work at present more
The job state or file system state of Hadoop clusters is monitored, and to the fine-grained monitoring of computing resource in cluster, such as
CPU, internal memory, bandwidth and hard disk resources etc., lack and effectively support.
The third aspect：Service Management of the work at present to calculate node supports not enough.In big data calculating platform, section is calculated
Point is to support the difference in functionality role for calculating by related service.For example, Hadoop exist name-node, data-node,
The background service of tetra- kinds of services of job-tracker and task-tracker, difference corresponding data and operation；Storm is present
Tri- kinds of services of nimbus, ui, supervisor, correspond to master control, console and work service respectively.Work at present is seldom from service
The angle of management, is monitored to the calculate node in cluster.
Fourth aspect：Work at present is supported general lack of graphically managing interface and intelligence auxiliary.This causes not knowing about meter
The business personnel that cluster environment is installed is calculated, it is difficult to operate the work(such as start and stop, the submission of operation and revocation of machine and service in cluster
Energy；For the business personnel for not knowing exploitation details, it is difficult to the short time is learnt various configurations by heart and starts the parameter such as class name.
The content of the invention
The invention aims to overcome above-mentioned monitoring management defect, so as to be directed to the integration of big data calculating platform
Monitoring and management, reduce operating process complexity, there is provided the monitoring system of intelligent, directly perceived, easy-to-use and quick response.
The present invention, can be with two type of cluster machine of real time inspection by the integrated monitoring to Hadoop and Storm calculating platforms
The run time behaviour of each service on the run time behaviour of device, machine, and operation running status in the cluster, can be to pin
Machine, service and work are started and stopped, two class operation of batch processing and stream process can be directed to, realize submitting to, cancel and dispatching
Operation, patterned monitoring interface and intelligent auxiliary supporting so that layman can left-hand seat and grasp quickly.
Specifically, the invention provides following technical scheme：
First, the invention provides a kind of big data calculating platform monitoring system, the monitoring system is from big data calculating
Platform obtains data, and the system includes：
Data acquisition module, obtains and stores the monitor control index of computing environment in big data calculating platform in real time and calculate and make
The monitor control index of industry monitoring, and be that environment monitoring module and monitoring operation module open query interface；
Environmental monitoring module, carries out monitor in real time to the computing environment of big data calculating platform, from the data acquisition module
The monitor control index of the computing environment of big data calculating platform is obtained in block, and the monitor control index of these computing environment is carried out visually
Change and show；
Monitoring operation module, the calculating operation to big data calculating platform carry out monitor in real time, from data acquisition module
The monitor control index of the calculating operation of big data calculating platform is obtained, and the monitor control index for calculating operation is carried out into visual presentation.
Preferably, data of the data collecting module collected from big data calculating platform, the data acquisition module
Comprising agent unit, relation data library unit；
The system encapsulates the function of relational database and agency, there is provided JDBC interfaces and Restful interfaces, and from institute
State relation data library unit and agent unit query monitor achievement data；
The monitor control index data include environmental monitoring index and monitoring operation index.Environmental monitoring index refers to and is related to institute
The associated index of the computing environment of the big data calculating platform of monitoring, is primarily referred to as what environmental monitoring module monitored or paid close attention to
Each index；Monitoring operation index refers to the index involved by each operation for being monitored, and is primarily referred to as monitoring operation module and is supervised
Control or each index paid close attention to.Between above-mentioned two indexes can be exist mutually repeat or identical part index number, or
Each mutually different index.
Preferably, the environmental monitoring module includes calculating platform monitoring module, machine monitors module, service monitoring mould
Block, for realizing being monitored the monitor control index of computing environment, specifically includes：
The calculating platform monitoring module is for being monitored to the platform information data of each calculating platform；
The machine monitors module, monitors each calculate node in calculating platform, monitors the monitoring of calculate node association
Index；
The service monitoring module, is monitored to the service in calculating platform, and is directed to every kind of service, monitoring service
Node listing；For each node in the node listing of service, the configurable service command of the service monitoring module is at this
Node path, can start service, stop service and the service of restarting.
Preferably, the monitor control index of the calculate node association of the machine monitors module includes node identification, IP ground
Location, the service list of node, cpu load, memory usage, bandwidth occupancy, hard disk utilization rate；The machine monitors module is directed to
Each service in the service list of node, can configure service command in the node path, it is possible to starts service, stop clothes
Business and the service of restarting.
Preferably, the platform information data of the calculating platform monitoring module monitoring include multiple monitor control indexs, concrete to wrap
Include：For each Hadoop calculating platform, monitor control index include platform identification, version number, job-tracker node IP address,
Have been turned on time, calculate node quantity, calculate operation quantity, Map task quantity, Reduce task quantity, the process of Map tasks
Quantity, the number of processes of Reduce tasks occupancy, Map task capacities, Reduce task capacities, average nodal task capacity etc.；
For each Storm calculating platform, monitor control index include platform identification, version number, nimbus node IP address, when having been turned on
Between, calculate node quantity, calculate operation quantity, number of processes, idle process quantity, number of threads, task quantity etc..
Preferably, the monitoring operation module includes that new job submits module and job management module to, by realizing to based on
The monitor control index that can be regarded as industry is monitored, and specifically includes：
After the new job submits to module to be used for user upload calculating operation bag, and Configuration Online parameter, Jing network analyses
Afterwards, the calculating operation bag is distributed to suitable calculating platform；
The job management module, for monitoring the achievement data of the operation of calculating platform, the operation includes batch processing
Calculate operation, stream process and calculate operation, the component of the component list of stream calculation operation, the task of task list.
Preferably, the achievement data monitored by the job management module is specifically included：
Batch processing for Hadoop calculating platforms calculates operation, and monitor control index includes platform identification, job title, operation
Mark, job state, starting time, user name, priority etc.；
Operation is calculated for the stream process of Storm calculating platforms, monitor control index includes platform identification, job title, operation
Mark, job state, starting time, occupancy number of processes, occupancy number of threads, calculating task quantity, the component list etc.；
For the component of the component list of Storm stream calculation operations, monitor control index includes the occupancy process of each component
Quantity, task quantity, send data volume, transmitted data amount, complete delays, processing data amount, process delay, number of responses, mistake
Lose quantity, the node identification of place node, recent error daily record, task list etc.；
For the component of the component list of Storm stream calculation operations, the task to wherein task list, monitor control index include
Task identification, starting time, the node identification of place calculate node, port, send data volume, transmitted data amount, complete postpone,
Processing data amount, process delay, number of responses, failure quantity etc..
Preferably, the agent unit is arranged on the calculate node in calculating platform, remaining described data acquisition module
Part, is arranged in monitoring server；The agent unit being arranged at calculate node and the data being arranged in monitoring server
Acquisition module part is communicated, and realizes acquisition and storage to data.
Preferably, the Relation DB module is arranged in monitoring server, is stored from being arranged in calculate node
Agent unit obtain each monitor control index data.
Preferably, the environmental monitoring module, monitoring operation module, are arranged in monitoring server.
Preferably, each calculate node of the calculating platform, registers in the machine monitors module, log-on message bag
Include：Node identification, IP address, user name, password, service of node etc..
Preferably, arbitrary service present in the calculate node, registers in the service list of node, the registration of service
Information at least includes：COS, service command place path；Service command place path, refers to the order journey of service
Sequence is in the position of node.
Additionally, present invention also offers a kind of big data calculating platform monitoring method, is applied in above-mentioned system, it is described
Method includes：
Step 1, user upload and calculate operation bag；
Step 2, the type of analysis operation：According to the feature calculated in operation bag, judge that the operation is that batch processing calculates work
Industry, stream process calculate operation or abnormal operation；For the calculating operation bag for being judged as abnormal operation, prompting is returned, and is terminated
The process that new job is submitted to；
Step 3, confirmation cluster：According to the homework type that the step 2 is obtained, assignable calculating platform is confirmed；Institute is really
The calculating platform recognized must have the idle process quantity for processing the operation enough, when there is no such calculating platform, return
Prompting, and terminate the process of new job submission；
Step 4, the startup class of analysis operation：For the calculating operation bag that user uploads, all java class of operation are analyzed,
The java class list for wherein possibly starting class is returned to user；
Step 5, user configuring parameter：After the analysis of the startup class for fulfiling assignment, user must be in the java class for starting class
Unique one is selected in list, and configures the parameter for starting class；
Step 6, submission operation：For the calculating operation bag for uploading, submit to the calculating platform for confirming and calculate operation bag.
Additionally, present invention also offers a kind of big data calculating platform monitoring method, is applied in above-mentioned system, it is described
Method realizes the monitoring to job management, including：
Step 1, client send to the monitoring system and ask, and obtain the job list of big data calculating platform；
The job management module of step 2, the monitoring system, sends inquiry request to data acquisition module, obtains big number
According to the monitor control index of All Jobs in calculating platform；
Step 3, data acquisition module, obtain the monitor control index of All Jobs from big data calculating platform, to the system
Job management module return；
Step 4, the job management module, return the job list of big data calculating platform to client；The job list
In each batch processing calculate operation, monitor control index include platform identification, job title, job identification, job state, when starting
Between, user name, priority；Each stream process in the job list calculate operation, and monitor control index includes platform identification, job name
Title, job identification, job state, starting time, occupancy number of processes, occupancy number of threads, calculating task quantity, column of assemblies
Table.
Additionally, present invention also offers a kind of big data calculating platform monitoring method, is applied in above-mentioned system, it is described
Method realizes the monitoring to job management, and methods described includes：
Step 1, client send to the system and ask, for the calculating operation specified in big data calculating platform
Carry out destruction operation；
The job management module of step 2, the system, sends to data acquisition module and asks, the meter that request revocation is specified
Can be regarded as industry；
Step 3, the data acquisition module, request cancel the calculating operation specified in big data calculating platform, and will
As a result return to job management module；
Step 4, the job management module, return the operating result of big data calculating platform to client；Destruction operation
If success, job management module can monitor the specified state for calculating operation and be changed to the successful state of correspondence revocation；Revocation behaviour
If making failure, the prompting of revocation failure is returned to client.
Additionally, present invention also offers a kind of big data calculating platform monitoring method, is applied in above-mentioned system, it is described
Method realizes the monitoring to job management, and methods described includes：
Step 1, client, send to the system and ask, and for specifying in big data calculating platform calculates and makees
Industry carries out rescheduling operation；
The job management module of step 2, the system, to the transmission request of the data acquisition module of the system, request
The calculating operation specified is rescheduled in big data calculating platform；
Step 3, the data acquisition module, request reschedule the calculating operation specified in big data calculating platform,
And result is returned to the job management module；
Step 4, the job management module, return the operating result of big data calculating platform to client；Reschedule
If operation success, readjustment degree is returned to client and successfully pointed out；If rescheduling operation failure, readjustment degree is returned to client
The prompting of failure.
Compared with prior art, technical solution of the present invention, realizes calculating integrated management to batch processing calculating and stream process
And monitoring；Realize that the fine granularity to PC cluster resource is monitored；Support the Service Management to calculate node；And easily can provide
Graphically managing interface and intelligence auxiliary are supported.The present invention can be reduced and manage answering for operating process for big data calculating platform
Polygamy, there is provided the monitoring system of intelligent, directly perceived, easy-to-use and quick response.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Frameworks of the Fig. 1 for the monitoring system of the big data calculating platform of the embodiment of the present invention；
The interaction of deployment and intermodule of the Fig. 2 for the embodiment of the present invention；
Fig. 3 is the flow chart in the embodiment of the present invention when new job is submitted to.
Specific embodiment
Below in conjunction with the accompanying drawings the embodiment of the present invention is described in detail.It will be appreciated that described embodiment is only this
Invent a part of embodiment, rather than the embodiment of whole.Based on the embodiment in the present invention, those of ordinary skill in the art exist
The all other embodiment obtained under the premise of not making creative work, belongs to the scope of protection of the invention.
Those skilled in the art it is to be understood that following specific embodiments or specific embodiment, be the present invention be further
The set-up mode of series of optimum explained the specific content of the invention and enumerate, and can be mutual between those set-up modes
With reference to or it is interrelated use, unless clearly proposed some of which or a certain specific embodiment or embodiment party in the present invention
Formula cannot be associated setting with other embodiments or embodiment or be used in conjunction with.Meanwhile, following specific embodiments or
Embodiment only as optimized set-up mode, and not as limit protection scope of the present invention understanding.
Embodiment 1：
In a specific embodiment, the present invention is built upon in big data calculating platform, mainly includes three
Module.Describe the modules of the monitoring system of big data calculating platform and big data calculating platform with reference to Fig. 1 in detail.Its
In：
In a specific embodiment, the targeted big data calculating platform of the present invention calculates flat comprising Hadoop
Distributed type assemblies belonging to platform, Storm calculating platforms and calculating platform.Hadoop calculating platforms are used for the offline place of mass data
Reason, Storm calculating platforms are used for the online process of real time data.Distributed type assemblies belonging to two class calculating platforms, by being referred to as
The machine composition of calculate node.
The present invention includes data acquisition module, and the monitoring for obtaining and storing computing environment in big data calculating platform in real time refers to
The monitor control index of mark and calculating monitoring operation, and be that environment monitoring module and monitoring operation module open query interface.Wherein, adopt
Agent unit (Agent i.e. in accompanying drawing 1) in collection module can be objective using Zabbix, Yarn Restful services, Hadoop
Family end agency, Storm Client Agents and Storm Restful services etc.；Relation data library unit (the relation i.e. in accompanying drawing 1
Database) can be using MySQL, SQL Server or Oracle etc..System encapsulates the correlation function of relational database, there is provided
JDBC interfaces, from the monitor control index data of relational database query；System encapsulates the correlation function of Agent, there is provided
Restful interfaces, from Agent query monitor achievement data.
The present invention includes environmental monitoring module, carries out monitor in real time to the computing environment of big data calculating platform, from data
The monitor control index of the computing environment of big data calculating platform is obtained in acquisition module, and by these index visual presentations, and base
Graphic user interface is realized in ExtJs, monitoring information overview display are obtained by interface for user, certainly, figure herein
The implementation tool of shape user interface is only as a preferred embodiment, rather than unique mode, people in the art
Member can realize the interactive interface/graphic user interface by other common tools, to realize visualization and user mutual work(
Energy.Specifically, including calculating platform monitoring, machine monitors and service monitoring.Wherein,
(1) calculating platform monitoring：For each Hadoop calculating platform, monitor control index include platform identification, version number,
Job-tracker node IP address, have been turned on the time, calculate node quantity, calculate operation quantity, Map task quantity, Reduce
Task quantity, the number of processes of Map tasks, the number of processes of Reduce tasks occupancy, Map task capacities, Reduce tasks are held
Amount, average nodal task capacity；For each Storm calculating platform, monitor control index includes platform identification, version number, nimbus
Node IP address, have been turned on the time, calculate node quantity, calculate operation quantity, number of processes, idle process quantity, Thread Count
Amount, task quantity；(2) machine monitors：For each calculate node in calculating platform, monitor control index includes node identification, IP
Address, the service list of node, cpu load, memory usage, bandwidth occupancy, hard disk utilization rate；For the service list of node
In each service, can configure service command in the node path, can start service, stop service and the service of restarting；(3)
Service monitoring：Towards the monitoring of 8 kinds in calculating platform services, including zookeeper, nimbus, supervisor, storm-
ui、name-node、data-node、job-tracker、task-tracker；Every kind of service in for calculating platform, monitoring
Index is the node listing of service；For each node in the node listing of service, service command is can configure in the node
Path, can start service, stop service and the service of restarting.
The present invention includes monitoring operation module, and the calculating operation to big data calculating platform carries out monitor in real time, from data
The monitor control index of the calculating operation of big data calculating platform is obtained in acquisition module, and by these index visual presentations.Specifically
, submit to including new job and job management, and graphic user interface is realized based on ExtJs, obtained by interface for user
Monitoring information overview display, the available implementation of the graphic user interface are as described above.Wherein, (1) new job is submitted to：With
Family uploads and calculates operation procedure bag, and Configuration Online parameter, distributes to suitable calculating platform automatically Jing after system intellectual analysis；
(2) job management：Each batch processing for Hadoop calculating platforms calculates operation, and monitor control index includes platform identification, makees
Industry title, job identification, job state, starting time, user name, priority；At each stream of Storm calculating platforms
Reason calculates operation, and monitor control index includes platform identification, job title, job identification, job state, starting time, occupancy process
Quantity, occupancy number of threads, calculating task quantity, the component list；Each for the component list of Storm stream calculation operations
Component, monitor control index include the occupancy number of processes of each component, task quantity, send data volume, transmitted data amount, complete
Delay, processing data amount, process delays, number of responses, failure quantity, the node identification of place node, recent error daily record, times
Business list；For the component of the component list of Storm stream calculation operations, each task to wherein task list, monitoring refer to
Mark includes task identification, starting time, the node identification of place calculate node, port, transmission data volume, transmitted data amount, complete
Into delay, processing data amount, process delay, number of responses, failure quantity etc..
It is pointed out that those above-mentioned all kinds of monitor control indexs, can be what is be adjusted flexibly, however it is not limited to above-mentioned to list
Indices, those skilled in the art can arrange the needs such as demand, required precision, monitoring emphasis direction according to specific,
It is combined, delete or increases, and those changes, it is regarded as falling under the scope of the present invention.
Embodiment 2：
In a specific embodiment, monitoring system provided by the present invention can adopt following preferred deployment side
Formula, illustrates modules deployment of the present invention and module interactive relation with reference to Fig. 2.With regard to the monitoring system of big data calculating platform
Deployment, specifically includes：
(1) dispose big data calculating platform：For Hadoop calculating platforms and Storm calculating platforms, each platform is each
It is independent to dispose.
(2) dispose the monitoring system of big data calculating platform：Specifically include,
A) Agent of data acquisition module, a part are deployed in each the calculating section in big data calculating platform
Point, other parts are deployed in monitoring server；The Agent of the data acquisition module disposed in calculate node, with monitoring service
The data acquisition module disposed on device is communicated, and is obtained and data storage.
B) relational database of data acquisition module, is deployed in monitoring server, stores from calculate node data acquisition
The monitor control index of the Agent of module；
C) environmental monitoring module, is deployed in monitoring server, obtains from the data acquisition module for being deployed in monitoring server
Data, for the related monitor control index of visual presentation computing environment；
D) monitoring operation module, is deployed in monitoring server, obtains from the data acquisition module for being deployed in monitoring server
Data, calculate the related monitor control index of operation for visual presentation.
(3) register big data calculating platform：Specifically include,
A) each calculate node that big data calculating platform is related to, in the machine of the monitoring system of big data calculating platform
Register in monitoring module, the log-on message of calculate node includes, node identification, IP address, user name, password, the service of node；
B) any one service present in calculate node, registers in the service list of node, the log-on message of service
Including：COS, service command place path；Wherein, COS exist 8 kinds, including zookeeper, nimbus,
supervisor、storm-ui、name-node、data-node、job-tracker、task-tracker；Service command is located
Path, refers to the position of the command program in node of service, for positioning service command program.
(4) deploying client：It is deployed in the machine that client computer, i.e. user use；Client is the browser that user uses,
For accessing the monitoring system of big data calculating platform, the visualization result of environmental monitoring and monitoring operation is returned；Be also used for
Big data calculating platform is submitted to and calculates operation procedure bag, carries out big data calculating；It is also used for the working pipe of big data calculating platform
Reason, including the operation such as suspending, stop and reschedule.
Embodiment 3：
In one particularly preferred embodiment, the flow process for submitting operation to is illustrated with reference to Fig. 3.Monitoring operation module
Encapsulate related command line program, intelligent analysis cause user pay close attention to the different type of operation and calculating platform, also without
The configuration of different type calculating platform and all multi-parameters need to be learnt by heart, the complexity that user submits operation to is simplified.Monitoring operation mould
Block is responsible for the calculating operation bag (calculating operation procedure bag) of receive user upload, and submits to after carrying out intellectual analysis.It is concrete to wrap
Include following steps：
(1) user uploads and calculates operation bag：It is jar file form to calculate operation bag, is that user is real based on Hadoop programmings
Existing batch processing calculates the program encapsulation of operation, or stream process of the user based on Storm programming realizations calculate the journey of operation
Sequence is encapsulated；After user selects one specified to calculate operation bag, system uploads the calculating operation bag；
(2) type of network analysis operation：According to the performance of program calculated in operation bag, system judges that the operation is at criticizing
Reason calculates operation, stream process and calculates operation or abnormal operation；For the calculating operation bag for being judged as abnormal operation, return is carried
Show, and terminate the process of new job submission；
(3) system validation cluster：For the calculating operation bag that user uploads, according to the homework type analyzed, system is true
Recognize assignable calculating platform：Batch processing calculates operation and distributes to Hadoop calculating platforms, stream process calculate operation distribute to
Storm calculating platforms；The calculating platform for being confirmed must have enough idle process quantity, when there is no such calculating platform
When, prompting is returned, and terminates the process of new job submission；
(4) the startup class of network analysis operation：For the calculating operation bag that user uploads, network analysis operation it is all
Java class, returns the java class list for wherein possibly starting class to user；
(5) user configuring parameter：After the analysis of the startup class that system fulfils assignment, user must be in the java class for starting class
Unique one is selected in list；User's Configuration Online starts the parameter of class；
(6) system submits operation to：For the calculating operation bag that user uploads, system is submitted to the calculating platform for confirming and is calculated
Operation bag.
Embodiment 4：
In monitoring operation module, the management to operation can be realized by following different embodiments, need to refer to
Go out, embodiment disclosed below only conduct is preferred embodiment enumerated, and not as the protection model of the restriction present invention
Enclose understanding.
In one particularly preferred embodiment, a specific embodiment party in monitoring operation module, to job management
Formula can be realized in the following way：
(1) client in client computer, to the monitoring system of the big data calculating platform of monitoring server, sends request,
Obtain the job list of big data calculating platform；
(2) the job management module of the monitoring system of big data calculating platform, to the monitoring system of big data calculating platform
Data acquisition module send inquiry request, obtain big data calculating platform in All Jobs monitor control index；
(3) data acquisition module of the monitoring system of big data calculating platform, by Agent (i.e. agent unit)
The JDBC interfaces of Restful interfaces and relational database, obtain the monitor control index of All Jobs, Xiang great from big data calculating platform
The job management module of the monitoring system of data calculating platform is returned；
(4) the job management module of the monitoring system of big data calculating platform, returns big number to the client in client computer
According to the job list of calculating platform；Each batch processing in the job list calculates operation, and monitor control index includes platform identification, makees
Industry title, job identification, job state, starting time, user name, priority；Each stream process in the job list are calculated
Operation, monitor control index include platform identification, job title, job identification, job state, starting time, take number of processes, account for
With number of threads, calculating task quantity, the component list etc..
Additionally, in one particularly preferred embodiment, a specific embodiment of job management may be used also
In the following way：
(1) client in client computer, the monitoring system to the big data calculating platform of monitoring server send request, pin
One to specifying in big data calculating platform calculates operation and carries out destruction operation；
(2) the job management module of the monitoring system of big data calculating platform, to the monitoring system of big data calculating platform
The Agent (i.e. agent unit) of data acquisition module send request, ask the revocation in big data calculating platform to be specified
Calculate operation；
(3) data acquisition module of the monitoring system of big data calculating platform, by Agent (i.e. agent unit)
Restful interfaces, request cancel the calculating operation specified in big data calculating platform, and by result to big data calculating platform
Monitoring system job management module return；
(4) the job management module of the monitoring system of big data calculating platform, returns big number to the client in client computer
According to the operating result of calculating platform；If destruction operation success, job management module can monitor the specified state for calculating operation
It is changed to " cancelling "；If destruction operation failure, the prompting of " revocation failure " is returned to client.
Additionally, in one particularly preferred embodiment, a specific embodiment of job management can also be adopted
Following manner is realized：
(1) client in client computer, the monitoring system to the big data calculating platform of monitoring server send request, pin
One to specifying in big data calculating platform calculates operation and carries out rescheduling operation；
(2) the job management module of the monitoring system of big data calculating platform, to the monitoring system of big data calculating platform
Data acquisition module Agent (i.e. agent unit) send request, request finger is rescheduled in big data calculating platform
Fixed calculating operation；
(3) data acquisition module of the monitoring system of big data calculating platform, by Agent (i.e. agent unit)
Restful interfaces, request reschedule the calculating operation specified in big data calculating platform, and result is calculated to big data
The job management module of the monitoring system of platform is returned；
(4) the job management module of the monitoring system of big data calculating platform, returns big number to the client in client computer
According to the operating result of calculating platform；If rescheduling operation success, the prompting of " readjustment degree success " is returned to client；Again adjust
If degree operation failure, returns the prompting of " failure of readjustment degree " to client.
One of ordinary skill in the art will appreciate that all or part of flow process in realizing above-described embodiment method, can be
Instruct related hardware to complete by computer program, described program can be stored in a computer read/write memory medium
In, the program is upon execution, it may include such as the flow process of the embodiment of above-mentioned each method.Wherein, described storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, the change or replacement that can be readily occurred in all are answered
It is included within the scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.
Claims (16)
1. a kind of big data calculating platform monitoring system, the monitoring system obtain data, its feature from big data calculating platform
It is that the system includes：
Data acquisition module, obtains and stores the monitor control index of computing environment in big data calculating platform in real time and calculate operation prison
The monitor control index of control, and be that environment monitoring module and monitoring operation module open query interface；
Environmental monitoring module, carries out monitor in real time to the computing environment of big data calculating platform, from the data acquisition module
The monitor control index of the computing environment of big data calculating platform is obtained, and the monitor control index of these computing environment is carried out into visualization exhibition
Show；
Monitoring operation module, the calculating operation to big data calculating platform carry out monitor in real time, obtain from data acquisition module
The monitor control index of the calculating operation of big data calculating platform, and the monitor control index for calculating operation is carried out into visual presentation.
2. system according to claim 1, it is characterised in that the data collecting module collected calculates flat from big data
The data of platform, the data acquisition module include agent unit, relation data library unit；
The system encapsulates the function of relational database and agency, there is provided JDBC interfaces and Restful interfaces, and from the pass
It is Database Unit and agent unit query monitor achievement data；
The monitor control index data include environmental monitoring index and monitoring operation index.
3. system according to claim 1, it is characterised in that the environmental monitoring module monitors mould comprising calculating platform
Block, machine monitors module, service monitoring module, for realizing being monitored the monitor control index of computing environment, specifically include：
The calculating platform monitoring module is for being monitored to the platform information data of each calculating platform；
The machine monitors module, monitors each calculate node in calculating platform, monitors the monitor control index of calculate node association；
The service monitoring module, is monitored to the service in calculating platform, and is directed to every kind of service, the node of monitoring service
List；For each node in the node listing of service, the configurable service command of the service monitoring module is in the node
Path, can start service, stop service and the service of restarting.
4. system according to claim 3, it is characterised in that the calculate node association of the machine monitors module
Monitor control index includes that node identification, IP address, the service list of node, cpu load, memory usage, bandwidth occupancy, hard disk make
With rate；The machine monitors module can configure service command in the node for each service in the service list of node
Path, it is possible to start service, stop service and the service of restarting.
5. system according to claim 3, it is characterised in that the platform information number of the calculating platform monitoring module monitoring
According to including multiple monitor control indexs, specifically include：For each Hadoop calculating platform, monitor control index includes platform identification, version
Number, job-tracker node IP address, have been turned on the time, calculate node quantity, calculate operation quantity, Map task quantity,
Reduce task quantity, the number of processes of Map tasks, the number of processes of Reduce tasks occupancy, Map task capacities, Reduce
Task capacity, average nodal task capacity；For each Storm calculating platform, monitor control index include platform identification, version number,
Nimbus node IP address, have been turned on the time, calculate node quantity, calculate operation quantity, number of processes, idle process quantity,
Number of threads, task quantity.
6. system according to claim 1, it is characterised in that the monitoring operation module include new job submit to module and
Job management module, for realizing being monitored the monitor control index for calculating operation, specifically includes：
After the new job submits to module to be used for user upload calculating operation bag, and Configuration Online parameter, Jing after network analysis, will
The calculating operation bag distributes to suitable calculating platform；
The job management module, for monitoring the achievement data of the operation of calculating platform, the operation includes that batch processing is calculated
Operation, stream process calculate operation, the component of the component list of stream calculation operation, the task of task list.
7. system according to claim 6, it is characterised in that the achievement data monitored by the job management module is concrete
Including：
Batch processing for Hadoop calculating platforms calculates operation, and monitor control index includes platform identification, job title, operation mark
Knowledge, job state, starting time, user name, priority；
For Storm calculating platforms stream process calculate operation, monitor control index include platform identification, job title, job identification,
Job state, starting time, occupancy number of processes, occupancy number of threads, calculating task quantity, the component list；
For the component of the component list of Storm stream calculation operations, monitor control index include each component occupancy number of processes,
Task quantity, send data volume, transmitted data amount, complete delays, processing data amount, process delay, number of responses, unsuccessfully count
Amount, the node identification of place node, recent error daily record, task list；
For the component of the component list of Storm stream calculation operations, the task to wherein task list, monitor control index include task
Mark, starting time, the node identification of place calculate node, port, send data volume, transmitted data amount, complete to postpone, process
Data volume, process delay, number of responses, failure quantity.
8. system according to claim 2, it is characterised in that the agent unit is arranged on the calculating section in calculating platform
Point, remaining described data acquisition module part, is arranged in monitoring server；Be arranged on agent unit at calculate node with
The data acquisition module part being arranged in monitoring server is communicated, and realizes acquisition and storage to data.
9. system according to claim 2, it is characterised in that the Relation DB module is arranged on monitoring server
In, store each monitor control index data obtained from the agent unit being arranged in calculate node.
10. system according to claim 1, it is characterised in that the environmental monitoring module, monitoring operation module, is all provided with
Put in monitoring server.
11. systems according to claim 3, it is characterised in that each calculate node of the calculating platform, in the machine
Register in device monitoring module, log-on message includes：Node identification, IP address, user name, password, the service of node.
12. systems according to claim 11, it is characterised in that arbitrary service present in the calculate node, in section
Register in the service list of point, the log-on message of service includes：COS, service command place path；The service command
Place path, refers to the position of the command program in node of service.
A kind of 13. big data calculating platform monitoring methods, are applied in the arbitrary described system of claim 1-12, and its feature exists
In methods described includes：
Step 1, user upload and calculate operation bag；
Step 2, the type of analysis operation：According to the feature calculated in operation bag, judge that the operation is that batch processing calculates operation, stream
Process and calculate operation or abnormal operation；For the calculating operation bag for being judged as abnormal operation, prompting is returned, and terminates new job
The process of submission；
Step 3, confirmation cluster：According to the homework type that the step 2 is obtained, assignable calculating platform is confirmed；Confirmed
Calculating platform must have the idle process quantity for processing the operation enough, when there is no such calculating platform, return prompting,
And terminate the process of new job submission；
Step 4, the startup class of analysis operation：For the calculating operation bag that user uploads, all java class of operation, Xiang Yong are analyzed
Family returns the java class list for wherein possibly starting class；
Step 5, user configuring parameter：After the analysis of the startup class for fulfiling assignment, user must be in the java class list for starting class
It is middle to select unique one, and configure the parameter for starting class；
Step 6, submission operation：For the calculating operation bag for uploading, submit to the calculating platform for confirming and calculate operation bag.
A kind of 14. big data calculating platform monitoring methods, are applied in the arbitrary described system of claim 1-12, and its feature exists
In, methods described realizes the monitoring to job management, including：
Step 1, client send to the monitoring system and ask, and obtain the job list of big data calculating platform；
The job management module of step 2, the monitoring system, sends inquiry request to data acquisition module, obtains big data meter
Calculate the monitor control index of All Jobs in platform；
Step 3, data acquisition module, obtain the monitor control index of All Jobs from big data calculating platform, to the work of the system
Industry management module is returned；
Step 4, the job management module, return the job list of big data calculating platform to client；In the job list
Each batch processing calculates operation, monitor control index include platform identification, job title, job identification, job state, starting time,
User name, priority；Each stream process in the job list calculate operation, and monitor control index includes platform identification, job title, work
Industry mark, job state, starting time, occupancy number of processes, occupancy number of threads, calculating task quantity, the component list.
A kind of 15. big data calculating platform monitoring methods, are applied in the arbitrary described system of claim 1-12, and its feature exists
In methods described realizes the monitoring to job management, and methods described includes：
Step 1, client send to the system and ask, and for specifying in big data calculating platform calculates operation and carries out
Destruction operation；
The job management module of step 2, the system, sends to data acquisition module and asks, and the calculating that request revocation is specified is made
Industry；
Step 3, the data acquisition module, request cancel the calculating operation specified in big data calculating platform, and by result
Return to job management module；
Step 4, the job management module, return the operating result of big data calculating platform to client；If destruction operation into
Work(, job management module can monitor the specified state for calculating operation and be changed to the successful state of correspondence revocation；If destruction operation
Failure, returns the prompting of revocation failure to client.
A kind of 16. big data calculating platform monitoring methods, are applied in the arbitrary described system of claim 1-12, and its feature exists
In methods described realizes the monitoring to job management, and methods described includes：
Step 1, client, send to the system and ask, and for specifying in big data calculating platform calculates operation and enters
Row reschedules operation；
The job management module of step 2, the system, to the transmission request of the data acquisition module of the system, asks big
The calculating operation specified is rescheduled in data calculating platform；
Step 3, the data acquisition module, request reschedule the calculating operation specified in big data calculating platform, and will
As a result return to the job management module；
Step 4, the job management module, return the operating result of big data calculating platform to client；Reschedule operation
If success, readjustment degree is returned to client and successfully pointed out；If rescheduling operation failure, the failure of readjustment degree is returned to client
Prompting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610970996.8A CN106549829B (en) | 2016-10-28 | 2016-10-28 | Big data computing platform monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610970996.8A CN106549829B (en) | 2016-10-28 | 2016-10-28 | Big data computing platform monitoring system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106549829A true CN106549829A (en) | 2017-03-29 |
| CN106549829B CN106549829B (en) | 2019-11-12 |
Family
ID=58395218
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610970996.8A Active CN106549829B (en) | 2016-10-28 | 2016-10-28 | Big data computing platform monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106549829B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106921755A (en) * | 2017-05-15 | 2017-07-04 | 浪潮软件股份有限公司 | Enterprise data integration cloud console, implementation method and system |
| CN107729458A (en) * | 2017-10-10 | 2018-02-23 | 中国航发控制系统研究所 | The method for visually monitoring of instrument license |
| CN108198118A (en) * | 2017-12-29 | 2018-06-22 | 江苏汇环环保科技有限公司 | A kind of ECOLOGICAL ENVIRONMENTAL MONITORING gridding system based on big data framework |
| CN108319538A (en) * | 2018-02-02 | 2018-07-24 | 世纪龙信息网络有限责任公司 | The monitoring method and system of big data platform operating status |
| CN108390907A (en) * | 2018-01-09 | 2018-08-10 | 浙江航天恒嘉数据科技有限公司 | A kind of management monitoring system and method based on Hadoop clusters |
| CN108681569A (en) * | 2018-05-04 | 2018-10-19 | 亚洲保理（深圳）有限公司 | A kind of automatic data analysis system and its method |
| CN108769112A (en) * | 2018-04-18 | 2018-11-06 | 江苏物联网研究发展中心 | A kind of non-intrusion type RPC interface monitoring method and system |
| CN109067743A (en) * | 2018-08-08 | 2018-12-21 | 郑州云海信息技术有限公司 | A kind of server monitoring method and device |
| CN109144833A (en) * | 2017-06-27 | 2019-01-04 | 中兴通讯股份有限公司 | A kind of hard disk analysis method and device |
| CN109359100A (en) * | 2018-09-28 | 2019-02-19 | 北京赛博贝斯数据科技有限责任公司 | The visual modeling method of PB grades of historical datas and online data calculated in real time |
| CN109522360A (en) * | 2018-11-16 | 2019-03-26 | 江苏物联网研究发展中心 | A kind of large data center monitoring data visualization system and method |
| CN109698795A (en) * | 2019-02-19 | 2019-04-30 | 贵州电网有限责任公司 | Based on permission interactive monitoring system and method between big data streaming technology service system |
| CN109787850A (en) * | 2017-11-10 | 2019-05-21 | 阿里巴巴集团控股有限公司 | Monitoring system, monitoring method and calculate node |
| WO2019153532A1 (en) * | 2018-02-07 | 2019-08-15 | 平安科技（深圳）有限公司 | Deployment method and apparatus for monitoring system, and computer device and storage medium |
| CN110493082A (en) * | 2019-08-22 | 2019-11-22 | 北京辛诺创新科技有限公司 | Big data monitoring method, device, electronic equipment and read/write memory medium |
| CN110782122A (en) * | 2019-09-16 | 2020-02-11 | 腾讯大地通途（北京）科技有限公司 | Data processing method and device and electronic equipment |
| CN111104184A (en) * | 2019-12-18 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and device for online loading and unloading of comprehensive traffic operation monitoring indexes |
| CN112732514A (en) * | 2020-12-22 | 2021-04-30 | 航天信息股份有限公司 | Zabbix monitoring system based on distributed relational database |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103532744A (en) * | 2013-09-29 | 2014-01-22 | 国网辽宁省电力有限公司信息通信分公司 | Information-communication integrated supporting platform of intelligent power grid |
| CN104268695A (en) * | 2014-09-26 | 2015-01-07 | 武汉大学 | Multi-center watershed water environment distributed cluster management system and method |
| CN104898622A (en) * | 2015-05-21 | 2015-09-09 | 河海大学 | Concrete construction quality intelligent visualized monitoring system based on cloud technology platform |
| CN105843803A (en) * | 2015-01-12 | 2016-08-10 | 上海悦程信息技术有限公司 | Big data security visualization interaction analysis system and method |
-
2016
- 2016-10-28 CN CN201610970996.8A patent/CN106549829B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103532744A (en) * | 2013-09-29 | 2014-01-22 | 国网辽宁省电力有限公司信息通信分公司 | Information-communication integrated supporting platform of intelligent power grid |
| CN104268695A (en) * | 2014-09-26 | 2015-01-07 | 武汉大学 | Multi-center watershed water environment distributed cluster management system and method |
| CN105843803A (en) * | 2015-01-12 | 2016-08-10 | 上海悦程信息技术有限公司 | Big data security visualization interaction analysis system and method |
| CN104898622A (en) * | 2015-05-21 | 2015-09-09 | 河海大学 | Concrete construction quality intelligent visualized monitoring system based on cloud technology platform |
Non-Patent Citations (1)
| Title |
|---|
| 江樱,等: "大数据管理可视化平台设计与实践", 《大众用电》 * |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106921755A (en) * | 2017-05-15 | 2017-07-04 | 浪潮软件股份有限公司 | Enterprise data integration cloud console, implementation method and system |
| CN106921755B (en) * | 2017-05-15 | 2020-04-28 | 浪潮软件股份有限公司 | Enterprise data integration cloud console, implementation method and system |
| CN109144833A (en) * | 2017-06-27 | 2019-01-04 | 中兴通讯股份有限公司 | A kind of hard disk analysis method and device |
| CN107729458A (en) * | 2017-10-10 | 2018-02-23 | 中国航发控制系统研究所 | The method for visually monitoring of instrument license |
| CN109787850A (en) * | 2017-11-10 | 2019-05-21 | 阿里巴巴集团控股有限公司 | Monitoring system, monitoring method and calculate node |
| CN109787850B (en) * | 2017-11-10 | 2022-12-16 | 阿里巴巴集团控股有限公司 | Monitoring system, monitoring method and computing node |
| CN108198118A (en) * | 2017-12-29 | 2018-06-22 | 江苏汇环环保科技有限公司 | A kind of ECOLOGICAL ENVIRONMENTAL MONITORING gridding system based on big data framework |
| CN108390907A (en) * | 2018-01-09 | 2018-08-10 | 浙江航天恒嘉数据科技有限公司 | A kind of management monitoring system and method based on Hadoop clusters |
| CN108390907B (en) * | 2018-01-09 | 2021-06-22 | 浙江航天恒嘉数据科技有限公司 | Management monitoring system and method based on Hadoop cluster |
| CN108319538A (en) * | 2018-02-02 | 2018-07-24 | 世纪龙信息网络有限责任公司 | The monitoring method and system of big data platform operating status |
| WO2019153532A1 (en) * | 2018-02-07 | 2019-08-15 | 平安科技（深圳）有限公司 | Deployment method and apparatus for monitoring system, and computer device and storage medium |
| CN108769112A (en) * | 2018-04-18 | 2018-11-06 | 江苏物联网研究发展中心 | A kind of non-intrusion type RPC interface monitoring method and system |
| CN108769112B (en) * | 2018-04-18 | 2021-11-12 | 江苏物联网研究发展中心 | Non-invasive RPC interface monitoring method and system |
| CN108681569A (en) * | 2018-05-04 | 2018-10-19 | 亚洲保理（深圳）有限公司 | A kind of automatic data analysis system and its method |
| CN109067743A (en) * | 2018-08-08 | 2018-12-21 | 郑州云海信息技术有限公司 | A kind of server monitoring method and device |
| CN109359100A (en) * | 2018-09-28 | 2019-02-19 | 北京赛博贝斯数据科技有限责任公司 | The visual modeling method of PB grades of historical datas and online data calculated in real time |
| CN109522360A (en) * | 2018-11-16 | 2019-03-26 | 江苏物联网研究发展中心 | A kind of large data center monitoring data visualization system and method |
| CN109698795A (en) * | 2019-02-19 | 2019-04-30 | 贵州电网有限责任公司 | Based on permission interactive monitoring system and method between big data streaming technology service system |
| CN109698795B (en) * | 2019-02-19 | 2022-06-14 | 贵州电网有限责任公司 | System and method for monitoring authority interaction among service systems based on big data stream type technology |
| CN110493082A (en) * | 2019-08-22 | 2019-11-22 | 北京辛诺创新科技有限公司 | Big data monitoring method, device, electronic equipment and read/write memory medium |
| CN110782122A (en) * | 2019-09-16 | 2020-02-11 | 腾讯大地通途（北京）科技有限公司 | Data processing method and device and electronic equipment |
| CN110782122B (en) * | 2019-09-16 | 2023-11-24 | 腾讯大地通途（北京）科技有限公司 | Data processing method and device and electronic equipment |
| CN111104184A (en) * | 2019-12-18 | 2020-05-05 | 青岛海信网络科技股份有限公司 | Method and device for online loading and unloading of comprehensive traffic operation monitoring indexes |
| CN112732514A (en) * | 2020-12-22 | 2021-04-30 | 航天信息股份有限公司 | Zabbix monitoring system based on distributed relational database |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106549829B (en) | 2019-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106549829A (en) | Big data calculating platform monitoring system and method | |
| CN108549977B (en) | Multi-Agent-based order-oriented flexible production dynamic scheduling system | |
| US6909992B2 (en) | Automatically identifying replacement times for limited lifetime components | |
| US9568909B2 (en) | Industrial automation service templates for provisioning of cloud services | |
| US7761557B2 (en) | Facilitating overall grid environment management by monitoring and distributing grid activity | |
| JP5148607B2 (en) | Automation of standard operating procedures in database management | |
| CN100578455C (en) | Resource functionality verification before use by a grid job submitted to a grid environment | |
| CN108829509A (en) | Distributed container cluster framework resources management method based on domestic CPU and operating system | |
| US20030140150A1 (en) | Self-monitoring service system with reporting of asset changes by time and category | |
| US20080034093A1 (en) | System and method for managing resources | |
| JP2014515522A (en) | Mutual cloud management and fault diagnosis | |
| US20140115153A1 (en) | Apparatus for monitoring data distribution service (dds) and method thereof | |
| CN116055283A (en) | Multi-platform unified cloud management system supporting global tenant application resource quota setting | |
| CN101424941B (en) | Control implementing method and system | |
| CN109379217A (en) | A kind of different producer's arranging service device of Metropolitan Area Network (MAN) | |
| CN109150653B (en) | Remote hardware-in-loop HIL (hardware in loop) automatic testing method and system | |
| CN112395172A (en) | Visual display method based on application software automation monitoring data | |
| CN108052358B (en) | Distributed deployment system and method | |
| CN111667250A (en) | Cloud-based management method and system for automatic test execution machine | |
| CN115719207A (en) | Super-automation platform system | |
| CN113448693B (en) | SAAS cloud platform of digital factory | |
| CN113206867B (en) | Intelligent data acquisition monitoring system, method and timing acquisition service module | |
| US10362104B2 (en) | Data manager | |
| CN112415989B (en) | Whole-plant monitoring system and monitoring method for loop performance evaluation | |
| US20050198614A1 (en) | Management platform and evironment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |