CN105653425A - Complicated event processing engine based monitoring system - Google Patents
Complicated event processing engine based monitoring system Download PDFInfo
- Publication number
- CN105653425A CN105653425A CN201511000974.0A CN201511000974A CN105653425A CN 105653425 A CN105653425 A CN 105653425A CN 201511000974 A CN201511000974 A CN 201511000974A CN 105653425 A CN105653425 A CN 105653425A
- Authority
- CN
- China
- Prior art keywords
- rule
- processing engine
- event processing
- message
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/86—Event-based monitoring
Abstract
The invention discloses a complicated event processing engine based monitoring system. The system comprises one or more agents, a complicated event processing engine, a memory and a main control unit, wherein the agents are deployed in application servers; one agent is deployed in one application server; the agents are used for monitoring the application servers, collecting event information of applications and sending the event information to the complicated event processing engine; the complicated event processing engine is used for filtering and analyzing the event information based on a preconfigured rule to obtain final alarm data and sending the event information to the memory for storage; the memory is used for storing the alarm data obtained by the complicated event processing engine and storing rules required by the complicated event processing engine; and the main control unit is used for controlling the configuration of the rules required by the complicated event processing engine, controlling the display of a front-end interface based on the alarm data and controlling the agents; and the front-end interface is used for a user to configure the rules and is used for showing the alarm data to the user.
Description
Technical field
The present invention relates to monitoring technical field, particularly relate to a kind of supervisory system based on Complex event processing engine.
Background technology
In current monitoring field, all kinds of monitoring technology and monitoring software emerge in an endless stream. By these monitoring technical study are found, substantially the warning means that all monitoring technology adopt, it it is all the pattern based on " meet single rule and trigger warning ", such as " certain server CPUIDLE is lower than 10%; then report to the police ", or " certain server disk space rate of utilization more than 80%, is then reported to the police ", this kind of rule can play the effect that the abnormal conditions on basis are caught and reported to the police.
But, along with the develop rapidly of software industry, the rise of the various software architectural frameworks such as distributed, virtualization, cloud service, above-mentioned traditional monitoring alarm technology cannot meet current fortune dimension demand, because by the monitoring technology of traditional " threshold value+compare ", when the scale of service big to a certain extent time, can even same within the very short timed interval between in a large amount of alert event of generation. Thus, the defect that current fortune dimension exists is how when magnanimity server, a large amount of alert event are concurrent, eliminate the false and retain the true, magnanimity monitoring event is refined and draws the crucial alarm message that Administrator needs most, if this point can be accomplished, will greatly the saving Administrator of degree energy and significantly improve warning efficiency.
Summary of the invention
For solving the technical problem of existing existence, the embodiment of the present invention provides a kind of supervisory system based on Complex event processing engine.
For achieving the above object, the technical scheme of the embodiment of the present invention is achieved in that
Based on a supervisory system for Complex event processing engine, described system comprises:
Agency, Complex event processing engine, storer and master control unit; Described agency is one or more, disposes on the application server, application server deploy agency;
Described agency, for monitoring application server, the event information send collecting application is to described Complex event processing engine;
Complex event processing engine, for described event information being filtered and analyzed based on pre-configured rule, obtains final alert data, and transfers to described storer to preserve;
Storer, for preserving the alert data that described Complex event processing engine obtains, and preserves the rule needed for described Complex event processing engine;
Master control unit, for controlling the configuration of described Complex event processing engine desire rule, control the displaying of front-end interface based on described alert data and control described agency;
Front-end interface, configures rule for user and shows alert data to user.
Wherein, described storer comprises buffer memory unit, the rule that described buffer memory unit obtains final alert data for preserving described Complex event processing engine and for described Complex event processing engine, event information filtered and analyzed.
Wherein, described storer also comprises database, and described database is for preserving for the rule that event information is filtered and analyzed by described Complex event processing engine.
Wherein, mutual by data handler between described Complex event processing engine and described buffer memory unit.
Wherein, described master control unit, is also sent to described buffer memory unit for user by the rule that described front-end interface configures and preserves, and the rule in described buffer memory unit is dumped to described database, to carry out persistence preservation.
Wherein, described front-end interface, for providing newly-increased rule, alteration ruler, deletion rule for terminal user and/or check the function items of historical data.
Wherein, described front-end interface, for showing, for terminal user, the interface that configuration is regular, a corresponding interface of rule; Receive the Rule content that input at respective rule interface of user and generate corresponding regular; Described interface is the interface shown according to pre-configured regular template, and/or the random interface shown, described rule module is used for the class alarm rule that terminal user's configuration has identical function characteristic.
Wherein, described front-end interface, also for the rule of generation is sent to described master control unit;
Described master control unit, also preserves for described rule is sent to described buffer memory unit.
Wherein, described front-end interface, for providing the function items of rule module, management and monitoring point, administration agent and/or management application for system manager; Described rule module is used for the class alarm rule that terminal user's configuration has identical function characteristic.
Wherein, described front-end interface, for being provided for the interface of management and monitoring point; The control point information of receiving system Administrator input, and described control point information is sent to described master control unit;
Described master control unit, also for by described control point Information encapsulation be message send give described agency;
Described agency, also for receiving the message of control point information, resolves described message, and from ftp server, download concrete plug-in unit, based on the monitoring information comprised in described message, plug-in unit is processed again, finally plug-in unit is joined and perform in scheduling configuration file, and start scheduling.
Wherein, described front-end interface, also for providing the interface of administration agent for system manager; At the interface of described administration agent, the agency that receiving system Administrator selection to be upgraded and version number, send is to master control unit;
Described master control unit, also for generating upgrading message send to corresponding agency according to the described agency to be upgraded and version number;
Described agency, also for receiving described upgrading message, described upgrading message is resolved, based on described upgrading message from download agent AKU the ftp server specified, to described act on behalf of AKU carry out separate pressure replace original jar bag, autoboot after having replaced, completes the updating operation of self.
Wherein, described front-end interface, also for providing the interface of rule module for system manager, the regular Template Information of receiving system administrator configurations on the surface, send gives described master control unit;
Master control unit, also for generating corresponding rule template according to described rule module information, send preserves to described buffer memory unit; And, when terminal user configures rule, also give described front-end interface for the rule module send that calls in described buffer memory unit.
Wherein, described application comprises: data transmission blocks, task scheduling modules and task receiver module;
Task receiver module, for being received the monitoring order of master control unit transmission by message-oriented middleware, is processed described monitoring order after receiving monitoring order, generates the monitoring script that can perform one by one, and dispatch by task scheduling modules;
Described task scheduling modules, for detecting described monitoring script in real time, it has been found that generates the message of event information when application is abnormal and transfers to data transmission blocks;
Described data transmission blocks, for being sent to Complex event processing engine by the message of described event information by message-oriented middleware.
Wherein, communicated by message-oriented middleware between described Complex event processing engine and described application.
Wherein, communicated by message-oriented middleware between described master control unit and described application.
Wherein, described message-oriented middleware comprises AMQ server; Described agency, for being sent to AMQ server by the event information of application; Described AMQ server, for adopting theme topic mode to transmit data between described agency and described Complex event processing engine; Described Complex event processing engine, for obtaining the event information of described application by subscribing to the mode of topic.
The defect that the embodiment of the present invention exists for prior art, a kind of monitoring method based on Complex event processing engine and system are proposed, adopt Complex event processing technology and big data processing method, for the monitoring fortune big data processing of dimension, it is to increase also significantly improve fortune dimension monitoring alarm efficiency while warning hit rate. Meanwhile, personalized customization to greatest extent can also be supported by front-end interface.
Accompanying drawing explanation
In accompanying drawing (it is not necessarily drawn in proportion), similar Reference numeral can describe similar parts in different views. The similar reference numerals with different letter suffix can represent the different examples of similar component. Accompanying drawing generally shows each embodiment discussed herein by way of example and not limitation.
Fig. 1 is the outside connection diagram of embodiment of the present invention supervisory system;
Fig. 2 is the function items schematic diagram that embodiment of the present invention supervisory system is supplied to terminal user;
Fig. 3 is the function items schematic diagram that embodiment of the present invention supervisory system is supplied to Administrator user;
Fig. 4 is the conceptual framework schematic diagram of embodiment of the present invention supervisory system;
Fig. 5 is the monitoring logic configuration diagram of embodiment of the present invention supervisory system;
Fig. 6 is the physical structure schematic diagram of embodiment of the present invention supervisory system.
Embodiment
As shown in Figure 1, the supervisory system of the embodiment of the present invention needs from application server Collection Events information when application being monitored, and it is analyzed and filters, the final alert data produced can notify related personnel by third party, such as, by notifying related personnel or notify related personnel by mail gateway in mail mode with short message mode by Short Message Service Gateway. In addition, the supervisory system of the embodiment of the present invention provides front-end interface, for terminal user (as, fortune dimension slip-stick artist), front-end interface is rendered as the user interface of its customization, and this user interface is convenient to terminal user and is configured the rule of warning, data query etc., for system manager, front-end interface is rendered as the user interface of its customization, and this user interface is convenient to system manager and the projects such as rule configuration, control point, agency and application is managed.
As shown in Figure 2, in application example, for terminal user, the front-end interface of embodiment of the present invention supervisory system is that its user interface presented mainly provides newly-increased rule, alteration ruler, deletion rule and checks the function items such as historical data; As shown in Figure 3, in application example, for system manager, the front-end interface of embodiment of the present invention supervisory system is mainly provide the function items such as rule template, management and monitoring point, administration agent (Agent), management application in its user interface presented.
The rule Template Manager of enforcement mode:
Need first there is a concrete regular template when terminal user configures rule in interface. Rule template refers to have the template of a class alarm rule of identical function characteristic. Such as " it is reporting an error of ������ that application ������ sends ������ time containing keyword within the ������ time, reports to the police " is exactly a regular template. This rule can be supplemented complete by terminal user as required. Such as " application CUSS occurred the warning that 5 times is ERROR containing keyword then to report to the police within 60 second time ".
In the configuration process of rule template, described front-end interface provides the interface of rule module for system manager, on the surface the regular Template Information of receiving system administrator configurations, and send gives described master control unit; Master control unit generates corresponding rule template according to described rule module information, and send preserves to described buffer memory unit; And, when terminal user configures rule, master control unit calls the rule module send in described buffer memory unit to described front-end interface, and the interface that front-end interface will show configuration rule for terminal user, this interface shows this rule template.
First according to concrete regular template for terminal user provides the user interface of a human. User interface will according to concrete regular template when designing, it would be desirable to takes in self-defined and fills in by user oneself. User clicks rule after having filled in can generate a rule automatically. A concrete regular example is as shown in table 1 below:
Table 1
The final rule that user interface generates is stored in by master control unit in Redis and database. When terminal user need to revise certain concrete regular time, it is necessary to first the respective rule in Redis is deleted, then generates up-to-date rule as required. During actual disposition, it is also possible to configure the warning being associated with rule and contact people, so-called warning contact people is also exactly generate warning after event triggers this rule, and whom this warning should issue.
Management for control point:
Control point management refers to when needing certain key point applied to be monitored, how the completing of automatization. Such as, it is necessary to the key point in certain daily record of application is monitored, or needs the CPU to operating system, internal memory etc. to monitor.
The supervisory system of the embodiment of the present invention is completed by plug-in unit for during specific monitoring in realization. Plug-in unit major part described herein refers to perl script, also has the shell script of part. Such as during monitoring CPU, concrete monitoring work is completed by the perl script specified, the result (i.e. event information) checked is returned to Agent after executing by perl script, event information is encapsulated by Agent again, it is packaged into the message form meeting system and requiring, and it is sent to CEP by sending interface.
When front-end interface adds concrete control point, it is necessary to terminal user inputs some other supplementary. Monitor for daily record error-critical word, it is necessary to terminal user has in inputting: the event interval of daily record file title, path, daily record place, concrete error-critical word, plug-in unit scheduling, the application information such as title. After terminal user inputs these control point information, these control point information are sent to Agent by master control unit with the form of message by front-end interface. After Agent receives message, message is resolved, and from ftp server, download concrete plug-in unit, then based on the information comprised in message, plug-in unit is processed, finally plug-in unit is joined in the execution scheduling configuration file of Agent, and start scheduling. When adding new control point, Agent automatically loads new plug-in unit and dispatches, it is not necessary to heavily open Agent.
The Agent management of enforcement mode:
Agent self also needs management, and such as upgrade, heavily open, stopping etc. operating. Function indispensable when these operations are Agent normal operations. Emphasis tells about Agent auto-update function scheme below, its operation, such as heavily open, stopping etc. similar.
Agent is when upgrading, and front-end interface provides the interface of administration agent for system manager; Needing system manager to select the Agent to be upgraded and concrete version number in front-end interface, click and determine button after having selected, at the interface of described administration agent, receiving system Administrator selects the agency to be upgraded and version number, and send is to master control unit; Master control unit can generate a upgrading message according to the described agency to be upgraded and version number and send this upgrading message to corresponding Agent. It is resolved after receiving upgrading message by Agent, if finding it is upgrading message, then processes according to upgrading step. During upgrading, Agent downloads Agent AKU based on described upgrading message from the ftp server specified, Agent AKU carries out separate pressure and replaces original jar bag, and Agent autoboot after having replaced, this completes the updating operation of Agent.
It should be noted that, Agent autoboot needs an auxiliary means, and used herein is the javaservicewrapper increased income, and java process can be monitored by it, it has been found that it can heavily be opened by java process abnormal end automatically.
The regulation management of enforcement mode:
When user needs event to be filtered and analyze, it is necessary to configuration alarm rule. Alarm rule defines when some alert events can trigger, such as comparatively simple event stream rule " within the ������ time; occurring that ������ time comprises keyword is that reporting an error of ERROR is then reported to the police ", comparatively complicated rule " within the ������ time; the key comprising ERROR occurs in certain IP, then an other IP occurs that the key comprising WARNING is then reported to the police ".
In order to facilitate terminal user to the management of rule, the interface of the front-end interface of supervisory system one human for each Design with Rule is used for configuration rule. Wherein, each corresponding interface of rule template, terminal user only needs to input necessary item in corresponding user interface, and front-end interface will generate corresponding EPL statement based on the content of terminal user's input, and then obtains corresponding rule. The increasing of each rule, delete, the operation such as change and will be synchronized to buffer memory unit, to guarantee that the rule of CEP loading when filtering and analyze is all up-to-date.
As shown in Figure 4, the supervisory system of the embodiment of the present invention is mainly divided into following several parts in conceptual framework according to responsibility difference: Complex event processing engine, buffer memory unit, database, master control unit, front-end interface and each Agent for different application. Wherein,
Agent for collect application event information send to Complex event processing engine, be deployed on each application server. Agent can have multiple, a corresponding Agent of application. As shown in Figure 4, it is respectively arranged with Agent corresponding to application 1, application 2, application 3 and application 4.
Complex event processing engine, for memory cell loading rule of postponing, and the event information sent by each Agent based on described rule is analyzed and is filtered, and obtains final alert data. If necessary, here, Complex event processing engine is in the process to event information analysis and filtration, it is possible to adopt the rule of event correlation different event to be associated. The rale store of described event correlation in buffer memory unit, in treating processes Complex event processing engine postpone memory cell load respective rule.
Buffer memory unit, for store Complex event processing engine process after alert data, and store described Complex event processing engine required rule is analyzed and filtered to event information.
Master control unit, for managing the dump of buffer memory unit to database, leading subscriber authority, and provides front-end interface etc. Here, the front-end interface that master control unit provides, for presenting the user interface for different user, shows described alert data in described user interface and/or shows historical data etc.
Database, for storing the data of dump in described buffer memory unit.
In practical application, being deployed with corresponding Agent on the application server of each application, each Agent is responsible for the event information gathering of an application and reports and submits in real time to Complex event processing engine. Rule in buffer memory unit is deposited in database by master control unit, to carry out the storage of persistence, and can effectively alleviate data when data constantly increase and pile up, increase system efficiency. Meanwhile, master control unit, also based on the data of buffer memory unit and/or database, reads data and also presents to user by front-end interface.
The supervisory system logic framework of the embodiment of the present invention is as shown in Figure 5.
As shown in Figure 5, communicated by message-oriented middleware between Agent with Complex event processing engine and master control unit. Each Agent comprises three modules: data transmission blocks, task scheduling modules and task receiver module; Task receiver module receives the monitoring order of master control unit transmission by message-oriented middleware, described monitoring order is processed, generate the monitoring script that can perform one by one, and dispatch by task scheduling modules after receiving monitoring order. Task scheduling modules detects described monitoring script in real time, generating event information message (message of set form) when finding that application is abnormal and transfer to data transmission blocks, the event information message of application is sent to Complex event processing engine by message-oriented middleware by data transmission blocks.
As shown in Figure 5, Complex event processing engine receives the event information of each Agent transmission by communication adaptation layer, message-oriented middleware. After Complex event processing engine start, postpone loading rule in memory cell, and based on this rule, the event that Agent sends is analyzed and filtered, obtain final data (such as the need of data such as warning, warnings in which way), and it is distributed to corresponding buffer memory unit by data handler and preserves.
As shown in Figure 5, master control unit sends task by communication adaptation layer, message-oriented middleware to each Agent, such as monitoring order etc. Master control unit can comprise: data management module, sub-management module, application management module, management structure and data exhibiting interface and front-end interface, wherein, master control unit provides front-end interface for user, terminal user can configure the rule oneself needed by front-end interface, and these rules that terminal user is configured by data management module can be persisted in database while being put into buffer memory unit. System manager can configure concrete control point in front-end interface, by management interface, the control point that system manager configures transferred to Self management module and application management module, then order by Self management module and the monitoring of application management CMOS macro cell and notify that Agent performs. Master control unit memory cell of postponing reads final alert data, and is shown in front-end interface by data exhibiting interface.
As shown in Figure 6, wherein, Agent disposes on the application server the physical structure of embodiment of the present invention supervisory system, as applied 1 in Fig. 6, apply 2, apply 3 ... application N represents application server respectively, at every platform application server deployment Agent. The event information that Agent collects is sent on ActiveMQ server (AMQ server), the supervisory system of the embodiment of the present invention has 2 AMQ servers, being ActiveMQ-1, ActiveMQ-2 respectively, Agent selects an AMQ server to send at random. Here, ActiveMQ is the powerful message bus of increasing income of ability, and the effect of AMQ server is equivalent to message-oriented middleware. AMQ server adopts theme topic mode, and topic subscribed to by Complex event processing engine.
The hardware framework of Complex event processing engine comprises main frame and standby machine, and in the process that time information is analyzed and filtered, main standby detection is realized by zookeeper, and after machine delayed by zookeeper discovery main frame, standby chance is taken over automatically. The master of Complex event processing engine processes identical data for engine, loads identical rule, and the data of generation are all identical. ZooKeeper is that one distributed, the Distributed Application Program Coordination service of open source code, is Chubby realization increased income of Google, is the significant components of Hadoop and Hbase. It is one for Distributed Application provide Consistency service software, it is provided that function comprise: configuring maintenance, name Service, distributed synchronization, group service etc. The target of ZooKeeper is exactly the key service that packaged complexity is easily made mistakes, and the system of interface easy to use and performance efficiency, function-stable is supplied to user.
Buffer memory unit uses Redis to realize, and Redis is a key-value storage system, and hardware framework comprises master cache and standby buffer memory.
Master control unit adopts JBOSS, its hardware structure also comprises main frame and standby machine, and employs the HA framework of JBOSS.
During logging in system by user, can first ask Apache Server, Apache Server by request forward to JBoss and master control unit, master control unit can timing from Redis (i.e. buffer memory unit) in dump data to data storehouse. As shown in Figure 6, database (DB) comprises DM and EDB in hardware structure. The supervisory system of the embodiment of the present invention adopts the scheme of distributed deployment, Agent disposes on the application server, and every station server can only dispose an Agent, Agent is used for gathering the event information of each application, the event information that Agent gathers is sent to Complex event processing engine (CEP, ComplicateEventProcessor) by message-oriented middleware (AMQ server) and carries out analyzing and filtering. CEP adopts the mode subscribed to from subscribe message AMQ server, has two CEP, and they process identical data, and do active-standby switch by Zookeeper. Data after CEP process, if producing to report to the police, directly sent by remote alarm interface, and final data are saved in buffer memory unit (Redis), control unit regularly by the data syn-chronization in buffer memory unit in database (DB).
It is noted that the Complex event processing engine that embodiment of the present invention supervisory system uses is the Esper increased income, it can tackle Complex event processing and the analysis of event stream. There is higher throughput capacity and lower time of response simultaneously. It requires to play important role in higher system in real-time. In Esper, rule is also called EPL.
The defect that the embodiment of the present invention exists for prior art, a kind of monitoring method based on Complex event processing engine is also proposed, adopt Complex event processing technology and big data processing method, for the monitoring fortune big data processing of dimension, magnanimity fortune dimension monitoring event carries out compound associations analysis, the different levels of monitoring event, the matching analysis of different dimensions can be supported, it is to increase while warning hit rate, also significantly improve fortune dimension monitoring alarm efficiency. Meanwhile, additionally it is possible to support personalized customization to greatest extent.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or computer program. Therefore, the present invention can adopt the form of hardware embodiment, software implementation or the embodiment in conjunction with software and hardware aspect. And, the present invention can adopt the form at one or more upper computer program implemented of computer-usable storage medium (including but not limited to multiple head unit and optical memory etc.) wherein including computer usable program code.
The present invention is that schema and/or skeleton diagram with reference to method according to embodiments of the present invention, equipment (system) and computer program describe. Should understand can by the combination of the flow process in each flow process in computer program instructions flowchart and/or skeleton diagram and/or square frame and schema and/or skeleton diagram and/or square frame. These computer program instructions can be provided to the treater of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine so that the instruction performed by the treater of computer or other programmable data processing device is produced for realizing the device of function specified in schema flow process or multiple flow process and/or skeleton diagram square frame or multiple square frame.
These computer program instructions also can be stored in and can guide in computer-readable memory that computer or other programmable data processing device work in a specific way, making the instruction that is stored in this computer-readable memory produce the manufacture comprising instruction device, this instruction device realizes the function specified in schema flow process or multiple flow process and/or skeleton diagram square frame or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, make on computer or other programmable devices, to perform a series of operation steps to produce computer implemented process, thus the instruction performed on computer or other programmable devices is provided for realizing the step of the function specified in schema flow process or multiple flow process and/or skeleton diagram square frame or multiple square frame.
The above, be only the better embodiment of the present invention, be not intended to limit protection scope of the present invention.
Claims (16)
1. the supervisory system based on Complex event processing engine, it is characterised in that, described system comprises:
Agency, Complex event processing engine, storer and master control unit; Described agency is one or more, disposes on the application server, application server deploy agency;
Described agency, for monitoring application server, the event information send collecting application is to described Complex event processing engine;
Complex event processing engine, for described event information being filtered and analyzed based on pre-configured rule, obtains final alert data, and transfers to described storer to preserve;
Storer, for preserving the alert data that described Complex event processing engine obtains, and preserves the rule needed for described Complex event processing engine;
Master control unit, for controlling the configuration of described Complex event processing engine desire rule, control the displaying of front-end interface based on described alert data and control described agency;
Front-end interface, configures rule for user and shows alert data to user.
2. system according to claim 1, it is characterized in that, described storer comprises buffer memory unit, the rule that described buffer memory unit obtains final alert data for preserving described Complex event processing engine and for described Complex event processing engine, event information filtered and analyzed.
3. system according to claim 2, it is characterised in that, described storer also comprises database, and described database is for preserving for the rule that event information is filtered and analyzed by described Complex event processing engine.
4. system according to claim 2, it is characterised in that, mutual by data handler between described Complex event processing engine and described buffer memory unit.
5. system according to claim 2, it is characterized in that, described master control unit, also it is sent to described buffer memory unit for user by the rule that described front-end interface configures and preserves, and the rule in described buffer memory unit is dumped to described database, to carry out persistence preservation.
6. system according to claim 1, it is characterised in that, described front-end interface, for providing newly-increased rule, alteration ruler, deletion rule for terminal user and/or check the function items of historical data.
7. system according to claim 6, it is characterised in that, described front-end interface, for showing, for terminal user, the interface that configuration is regular, a corresponding interface of rule; Receive the Rule content that input at respective rule interface of user and generate corresponding regular; Described interface is the interface shown according to pre-configured regular template, and/or the random interface shown, described rule module is used for the class alarm rule that terminal user's configuration has identical function characteristic.
8. system according to claim 7, it is characterised in that, described front-end interface, also for the rule of generation is sent to described master control unit;
Described master control unit, also preserves for described rule is sent to described buffer memory unit.
9. system according to claim 1, it is characterised in that, described front-end interface, for providing the function items of rule module, management and monitoring point, administration agent and/or management application for system manager; Described rule module is used for the class alarm rule that terminal user's configuration has identical function characteristic.
10. system according to claim 9, it is characterised in that,
Described front-end interface, for being provided for the interface of management and monitoring point; The control point information of receiving system Administrator input, and described control point information is sent to described master control unit;
Described master control unit, also for by described control point Information encapsulation be message send give described agency;
Described agency, also for receiving the message of control point information, resolves described message, and from ftp server, download concrete plug-in unit, based on the monitoring information comprised in described message, plug-in unit is processed again, finally plug-in unit is joined and perform in scheduling configuration file, and start scheduling.
11. systems according to claim 9, it is characterised in that,
Described front-end interface, also for providing the interface of administration agent for system manager; At the interface of described administration agent, the agency that receiving system Administrator selection to be upgraded and version number, send is to master control unit;
Described master control unit, also for generating upgrading message send to corresponding agency according to the described agency to be upgraded and version number;
Described agency, also for receiving described upgrading message, described upgrading message is resolved, based on described upgrading message from download agent AKU the ftp server specified, to described act on behalf of AKU carry out separate pressure replace original jar bag, autoboot after having replaced, completes the updating operation of self.
12. systems according to claim 9, it is characterised in that,
Described front-end interface, also for providing the interface of rule module for system manager, the regular Template Information of receiving system administrator configurations on the surface, send gives described master control unit;
Master control unit, also for generating corresponding rule template according to described rule module information, send preserves to described buffer memory unit; And, when terminal user configures rule, also give described front-end interface for the rule module send that calls in described buffer memory unit.
13. systems according to claim 1, it is characterised in that, described application comprises: data transmission blocks, task scheduling modules and task receiver module;
Task receiver module, for being received the monitoring order of master control unit transmission by message-oriented middleware, is processed described monitoring order after receiving monitoring order, generates the monitoring script that can perform one by one, and dispatch by task scheduling modules;
Described task scheduling modules, for detecting described monitoring script in real time, it has been found that generates the message of event information when application is abnormal and transfers to data transmission blocks;
Described data transmission blocks, for being sent to Complex event processing engine by the message of described event information by message-oriented middleware.
14. systems according to claim 1, it is characterised in that, communicated by message-oriented middleware between described Complex event processing engine and described application.
15. systems according to claim 1, it is characterised in that, communicated by message-oriented middleware between described master control unit and described application.
16. systems according to claim 14, it is characterised in that, described message-oriented middleware comprises AMQ server;
Described agency, for being sent to AMQ server by the event information of application;
Described AMQ server, for adopting theme topic mode to transmit data between described agency and described Complex event processing engine;
Described Complex event processing engine, for obtaining the event information of described application by subscribing to the mode of topic.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511000974.0A CN105653425B (en) | 2015-12-28 | 2015-12-28 | Monitoring system based on complex event processing engine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511000974.0A CN105653425B (en) | 2015-12-28 | 2015-12-28 | Monitoring system based on complex event processing engine |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105653425A true CN105653425A (en) | 2016-06-08 |
| CN105653425B CN105653425B (en) | 2018-10-19 |
Family
ID=56476933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511000974.0A Active CN105653425B (en) | 2015-12-28 | 2015-12-28 | Monitoring system based on complex event processing engine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105653425B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095641A (en) * | 2016-06-12 | 2016-11-09 | 浪潮电子信息产业股份有限公司 | A kind of monitoring methods, devices and systems |
| CN106383758A (en) * | 2016-09-22 | 2017-02-08 | 郑州云海信息技术有限公司 | Operation system-based information acquisition method |
| CN106709026A (en) * | 2016-12-28 | 2017-05-24 | 深圳市华傲数据技术有限公司 | Data processing method and data processing system |
| CN107729214A (en) * | 2017-10-13 | 2018-02-23 | 福建富士通信息软件有限公司 | A kind of visual distributed system monitors O＆M method and device in real time |
| CN108418710A (en) * | 2018-02-09 | 2018-08-17 | 北京奇艺世纪科技有限公司 | A kind of distributed monitoring system, method and device |
| CN109086033A (en) * | 2018-07-06 | 2018-12-25 | 航天星图科技（北京）有限公司 | A kind of process dispatch method of Remote Sensing Data Processing |
| CN110189039A (en) * | 2019-06-04 | 2019-08-30 | 湖南智慧畅行交通科技有限公司 | Based on distributed charging pile Event processing engine |
| CN110347663A (en) * | 2019-06-05 | 2019-10-18 | 烽火通信科技股份有限公司 | Dynamic environment monitoring method and system based on Complex event processing engine |
| CN110399274A (en) * | 2019-07-03 | 2019-11-01 | 北京智齿博创科技有限公司 | The unified monitoring system of Prometheus monitoring strategies |
| CN111143167A (en) * | 2019-12-24 | 2020-05-12 | 北京优特捷信息技术有限公司 | Alarm merging method, device, equipment and storage medium for multiple platforms |
| CN111339062A (en) * | 2020-02-24 | 2020-06-26 | 北京达佳互联信息技术有限公司 | Data monitoring method and device, electronic equipment and storage medium |
| CN112199256A (en) * | 2020-10-16 | 2021-01-08 | 济南浪潮数据技术有限公司 | Deployment event monitoring method, device and equipment |
| CN113190423A (en) * | 2021-04-20 | 2021-07-30 | 北京异乡旅行网络科技有限公司 | Service data monitoring method, device and system |
| CN116976655A (en) * | 2023-06-15 | 2023-10-31 | 四川仕虹腾飞信息技术有限公司 | Distributed banking website transaction flow supervision system and method thereof |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010109020A (en) * | 2000-06-01 | 2001-12-08 | 최승열 | System and method for monitoring and protecting information outflow using an input/output apparatus |
| JP2006146632A (en) * | 2004-11-22 | 2006-06-08 | Yokogawa Electric Corp | Event monitoring system |
| CN101075919A (en) * | 2006-06-22 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method and system for monitoring Internet service |
| CN101714930A (en) * | 2009-12-30 | 2010-05-26 | 北京世纪互联宽带数据中心有限公司 | Method and system for realizing network monitoring |
| CN104092575A (en) * | 2014-07-29 | 2014-10-08 | 中国联合网络通信集团有限公司 | Resource monitoring method and system |
| CN104268008A (en) * | 2014-09-18 | 2015-01-07 | 中国科学院自动化研究所 | Complex event processing system and method for CPS application |
| CN104301147A (en) * | 2014-10-24 | 2015-01-21 | 国家电网公司 | Method for monitoring service and process activities in service application system |
-
2015
- 2015-12-28 CN CN201511000974.0A patent/CN105653425B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010109020A (en) * | 2000-06-01 | 2001-12-08 | 최승열 | System and method for monitoring and protecting information outflow using an input/output apparatus |
| JP2006146632A (en) * | 2004-11-22 | 2006-06-08 | Yokogawa Electric Corp | Event monitoring system |
| CN101075919A (en) * | 2006-06-22 | 2007-11-21 | 腾讯科技（深圳）有限公司 | Method and system for monitoring Internet service |
| CN101714930A (en) * | 2009-12-30 | 2010-05-26 | 北京世纪互联宽带数据中心有限公司 | Method and system for realizing network monitoring |
| CN104092575A (en) * | 2014-07-29 | 2014-10-08 | 中国联合网络通信集团有限公司 | Resource monitoring method and system |
| CN104268008A (en) * | 2014-09-18 | 2015-01-07 | 中国科学院自动化研究所 | Complex event processing system and method for CPS application |
| CN104301147A (en) * | 2014-10-24 | 2015-01-21 | 国家电网公司 | Method for monitoring service and process activities in service application system |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106095641A (en) * | 2016-06-12 | 2016-11-09 | 浪潮电子信息产业股份有限公司 | A kind of monitoring methods, devices and systems |
| CN106383758A (en) * | 2016-09-22 | 2017-02-08 | 郑州云海信息技术有限公司 | Operation system-based information acquisition method |
| CN106709026A (en) * | 2016-12-28 | 2017-05-24 | 深圳市华傲数据技术有限公司 | Data processing method and data processing system |
| CN107729214B (en) * | 2017-10-13 | 2021-03-09 | 中电福富信息科技有限公司 | Visual distributed system real-time monitoring operation and maintenance method and device |
| CN107729214A (en) * | 2017-10-13 | 2018-02-23 | 福建富士通信息软件有限公司 | A kind of visual distributed system monitors O＆M method and device in real time |
| CN108418710A (en) * | 2018-02-09 | 2018-08-17 | 北京奇艺世纪科技有限公司 | A kind of distributed monitoring system, method and device |
| CN109086033A (en) * | 2018-07-06 | 2018-12-25 | 航天星图科技（北京）有限公司 | A kind of process dispatch method of Remote Sensing Data Processing |
| CN109086033B (en) * | 2018-07-06 | 2021-08-03 | 中科星图股份有限公司 | Flow scheduling method for remote sensing data processing |
| CN110189039A (en) * | 2019-06-04 | 2019-08-30 | 湖南智慧畅行交通科技有限公司 | Based on distributed charging pile Event processing engine |
| CN110347663A (en) * | 2019-06-05 | 2019-10-18 | 烽火通信科技股份有限公司 | Dynamic environment monitoring method and system based on Complex event processing engine |
| CN110399274A (en) * | 2019-07-03 | 2019-11-01 | 北京智齿博创科技有限公司 | The unified monitoring system of Prometheus monitoring strategies |
| CN111143167B (en) * | 2019-12-24 | 2021-01-01 | 北京优特捷信息技术有限公司 | Alarm merging method, device, equipment and storage medium for multiple platforms |
| CN111143167A (en) * | 2019-12-24 | 2020-05-12 | 北京优特捷信息技术有限公司 | Alarm merging method, device, equipment and storage medium for multiple platforms |
| CN111339062A (en) * | 2020-02-24 | 2020-06-26 | 北京达佳互联信息技术有限公司 | Data monitoring method and device, electronic equipment and storage medium |
| CN111339062B (en) * | 2020-02-24 | 2024-03-19 | 北京达佳互联信息技术有限公司 | Data monitoring method and device, electronic equipment and storage medium |
| CN112199256A (en) * | 2020-10-16 | 2021-01-08 | 济南浪潮数据技术有限公司 | Deployment event monitoring method, device and equipment |
| CN113190423A (en) * | 2021-04-20 | 2021-07-30 | 北京异乡旅行网络科技有限公司 | Service data monitoring method, device and system |
| CN113190423B (en) * | 2021-04-20 | 2024-02-20 | 北京异乡旅行网络科技有限公司 | Method, device and system for monitoring service data |
| CN116976655A (en) * | 2023-06-15 | 2023-10-31 | 四川仕虹腾飞信息技术有限公司 | Distributed banking website transaction flow supervision system and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105653425B (en) | 2018-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105653425A (en) | Complicated event processing engine based monitoring system | |
| CN104199957B (en) | A kind of implementation method of Redis general-purpose proxies | |
| WO2021017301A1 (en) | Management method and apparatus based on kubernetes cluster, and computer-readable storage medium | |
| CN111090699A (en) | Service data synchronization method and device, storage medium and electronic device | |
| US9330161B2 (en) | Creating global aggregated namespaces for storage management | |
| CN111459763B (en) | Cross-kubernetes cluster monitoring system and method | |
| CN112600891B (en) | Information physical fusion-based edge cloud cooperative system and working method | |
| CN107103064B (en) | Data statistical method and device | |
| CN111752799A (en) | Service link tracking method, device, equipment and storage medium | |
| CN109684036B (en) | Container cluster management method, storage medium, electronic device and system | |
| CN110334072A (en) | A kind of distributed file system, file updating method and device | |
| US20190146839A1 (en) | Distributed data platform resource allocator | |
| CN114429210A (en) | Cloud-protogenesis-based reinforcement learning pipeline method, system, equipment and storage medium | |
| CN113867600A (en) | Development method and device for processing streaming data and computer equipment | |
| CN117130730A (en) | Metadata management method for federal Kubernetes cluster | |
| CN107291938B (en) | Order inquiry system and method | |
| CN114756301B (en) | Log processing method, device and system | |
| CN113824801B (en) | Intelligent integration terminal unified access management component system | |
| US11777810B2 (en) | Status sharing in a resilience framework | |
| CN114969199A (en) | Method, device and system for processing remote sensing data and storage medium | |
| CN112422349B (en) | Network management system, method, equipment and medium for NFV | |
| Tisbeni et al. | A Big Data Platform for heterogeneous data collection and analysis in large-scale data centres | |
| US11582345B2 (en) | Context data management interface for contact center | |
| CN110768855B (en) | Method and device for testing linkmzation performance | |
| CN112860844A (en) | Case clue processing system, method and device and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 100085 Yumin Street, Houshayu Town, Shunyi District, Beijing Patentee after: CHINA TRAVELSKY HOLDING Co. Address before: 100010, Beijing, Dongcheng District East Fourth Street, West 157 Patentee before: CHINA TRAVELSKY HOLDING Co. |