CN104731800B - Data analysis set-up - Google Patents
Data analysis set-up Download PDFInfo
- Publication number
- CN104731800B CN104731800B CN201310707342.2A CN201310707342A CN104731800B CN 104731800 B CN104731800 B CN 104731800B CN 201310707342 A CN201310707342 A CN 201310707342A CN 104731800 B CN104731800 B CN 104731800B
- Authority
- CN
- China
- Prior art keywords
- rule
- analysis
- data analysis
- event
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Debugging And Monitoring (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention proposes a kind of data analysis set-up, and described device includes event handling unit, data analysis unit, user interface and storage unit.Wherein, the event handling unit receives the event that applications are triggered, and determine whether there is analysis rule tree associated with the regular event, if there is analysis rule tree associated with the regular event, then by the event transmission to data analysis unit, the data analysis unit executes data analysis operation based on analysis rule tree associated with received event, and analysis result is sent back the applications.Data analysis set-up disclosed in this invention can carry out analysis rule effectively multiplexing and easy to maintain and extension.
Description
Technical field
The present invention relates to data analysis set-ups, more particularly, to the data analysis set-up based on analysis rule tree.
Background technology
Currently, growing and different field the type of business with information data process demand becomes increasingly abundant,
Carrying out data analysis based on scheduled analysis rule becomes more and more important.
In existing technical solution, the basic process of data analysis is as follows：（1）Preset analysis rule；（2）Judgement
Whether the input parameter received meets the analysis rule；（3）If meeting the analysis rule, scheduled action is triggered.
However, there are the following problems for existing technical solution：Due to be difficult to the relevance between each analysis rule into
The effective management of row, therefore there are the redundancies of analysis rule, it is relatively low so as to cause the reusability of analysis rule, and cause system in turn
Maintenance, extension and upgrading become difficult.
Accordingly, there exist following demands：There is provided can to analysis rule carry out effectively multiplexing and it is easy to maintain and extension
Data analysis set-up based on analysis rule tree.
Invention content
In order to solve the problems existing in the prior art scheme, the present invention, which proposes, to have analysis rule
Effect multiplexing and easy to maintain and extension the data analysis set-up based on analysis rule tree.
The purpose of the present invention is what is be achieved through the following technical solutions：
A kind of data analysis set-up, the data analysis set-up include：
Event handling unit, the event handling unit receives the event that applications are triggered, and determines whether there is
Analysis rule tree associated with the regular event, if there is analysis rule tree associated with the regular event, then by institute
Event transmission is stated to data analysis unit, wherein the event includes event argument, and analysis rule tree definition is each
Incidence relation between analysis rule and each analysis rule；
Data analysis unit, data analysis unit execute number based on analysis rule tree associated with received event
The applications are sent back according to analysis operation, and by analysis result, wherein the event argument of the event is used as analysis rule
The input parameter then set；
User interface, the user interface are used to configure the analysis rule tree according to user instruction；
Storage unit, the storage unit is for storing the analysis rule tree.
In scheme disclosed above, it is preferable that the data analysis unit is further used for scheduled according to user
Modification rule is modified the analysis result, and the analysis result being corrected is sent back the applications, wherein uses
Family can configure the modification rule via the user interface.
In scheme disclosed above, it is preferable that the analysis rule tree be only there are one root node multiway tree.
In scheme disclosed above, it is preferable that one analysis rule of each node definition in the analysis rule tree
Then, and the father and son between each node and/or brotherhood define the incidence relation between each analysis rule.
In scheme disclosed above, it is preferable that each node in the analysis rule tree includes at least following member
Element：Rule condition and rule action, the rule condition define the condition for meeting this analysis rule, the rule action definition
The performed action when the condition of this analysis rule is satisfied.
In scheme disclosed above, it is preferable that the rule condition further comprises following elements：Input parameter,
Output parameter, implementation type and realization address, wherein the input parameter is the data to be analyzed of the node, the output
Parameter is the differentiation the result data whether input parameter meets the rule condition, and the implementation type indicates the rule
The implementation type of condition, the address realized address instruction and implement the entity that the rule condition differentiates.
In scheme disclosed above, it is preferable that the rule action further comprises following elements：Input parameter,
Output parameter, implementation type and realization address, wherein the input parameter is the data to be analyzed of the node, the output
Parameter is the result data after the rule action is performed, and the implementation type indicates the implementation type of the rule action, institute
State the address for the entity for realizing that the rule action is implemented in address instruction.
In scheme disclosed above, it is preferable if the rule condition is satisfied, then dynamic by the rule therewith
The entity of work realized pointed by address executes scheduled action, and is sent back after the result data after execution is corrected described
Applications.
In scheme disclosed above, it is preferable that the result data after the rule action executes indicates alarm level,
The alarm level be it is following in one：Pass through rank, prompt rank, limitation rank and fatal error rank.
In scheme disclosed above, it is preferable that the data analysis unit can be advised according to the scheduled amendment of user
Then the alarm level indicated by result data is modified.
In scheme disclosed above, it is preferable that the data analysis unit executes data analysis behaviour as follows
Make：The node of the analysis rule tree is traversed in such a way that preamble traverses since the root node of analysis rule tree, wherein event
Event argument is used as the input parameter of the analysis rule tree.
In scheme disclosed above, it is preferable that for the node that each is traversed, when rule condition is satisfied simultaneously
And corresponding rule action execute after the alarm level that returns be corrected after less than " limitation rank " when, continue preamble traversal
Process.
In scheme disclosed above, it is preferable that for the node that each is traversed, if rule condition is satisfied
And the alarm level that corresponding rule action returns after executing is higher than " limitation rank " after being corrected, then terminates data analysis behaviour
Make.
Data analysis set-up disclosed in this invention based on analysis rule tree has the following advantages that：It is analyzed better than having used
Rule tree, and realize the separation and loose coupling of rule condition and rule action（I.e. by node by rule condition and
Rule action cohesion）, to considerably improve the reusability and configuration flexibility of analysis rule, and so that system is easy
In maintenance, extension and upgrading.
Description of the drawings
In conjunction with attached drawing, technical characteristic of the invention and advantage will be more fully understood by those skilled in the art, wherein：
Fig. 1 is the schematic diagram of data analysis set-up according to an embodiment of the invention.
Specific implementation mode
Fig. 1 is the schematic diagram of data analysis set-up according to an embodiment of the invention.As shown in Figure 1, of the invention
Disclosed data analysis set-up includes event handling unit 1, data analysis unit 2, user interface 3 and storage unit 4.Its
In, the event handling unit 1 receives applications（Such as service logic）The event triggered（Illustratively, the event
It can be generated by some node in the calling or arrival operation flow of some function）, and determine whether there is and the rule thing
The associated analysis rule tree of part, if there is analysis rule tree associated with the regular event, then by the event transmission
To data analysis unit 2, wherein the event includes event argument, and the analysis rule tree defines each analysis rule
And the incidence relation between each analysis rule.Data analysis unit 2 is based on analysis associated with received event
Rule tree executes data analysis operation, and analysis result is sent back the applications, wherein the event argument quilt of the event
Input parameter as the analysis rule tree.The user interface 3 is used to configure the analysis rule tree according to user instruction.Institute
Storage unit 4 is stated for storing the analysis rule tree.
Preferably, in data analysis set-up disclosed in this invention, the data analysis unit 2 is further used for basis
The scheduled modification rule of user is modified the analysis result, and the analysis result being corrected is sent back the outside and is answered
With, wherein user can configure the modification rule via the user interface 3.
Preferably, in data analysis set-up disclosed in this invention, the analysis rule tree is that only there are one root nodes
Multiway tree.
Preferably, in data analysis set-up disclosed in this invention, each node definition in the analysis rule tree
One analysis rule, and father and son between each node and/or brotherhood define the pass of the association between each analysis rule
System（Such as "AND" relationship, "or" relationship etc.）.
Preferably, in data analysis set-up disclosed in this invention, each node in the analysis rule tree is at least
Including following elements：Rule condition and rule action, the rule condition define the condition for meeting this analysis rule, the rule
The then action definition action performed when the condition of this analysis rule is satisfied.
Preferably, in data analysis set-up disclosed in this invention, the rule condition further comprises following elements：
Input parameter, output parameter, implementation type and realization address, wherein the input parameter is the data to be analyzed of the node
（That is the event argument of event）, the output parameter is the differentiation the number of results whether input parameter meets the rule condition
According to（Such as True expressions meet the rule condition）, the implementation type indicates the implementation type of the rule condition（Such as
Conditional expression）, the address realized address instruction and implement the entity that the rule condition differentiates（Such as URL）.
Preferably, in data analysis set-up disclosed in this invention, the rule action further comprises following elements：
Input parameter, output parameter, implementation type and realization address, wherein the input parameter is the data to be analyzed of the node
（That is the event argument of event）, the output parameter is the result data after the rule action is performed（For example, for verification class
Rule, output parameter are the explanation of check information, and for change rule-like, output parameter is the number after being changed to business datum
According to）, the implementation type indicates the implementation type of the rule action, described to realize that the rule action is implemented in address instruction
The address of entity（Such as URL）.
Preferably, in data analysis set-up disclosed in this invention, if the rule condition is satisfied, therewith by
The entity of the rule action realized pointed by address executes scheduled action, and after the result data after execution is corrected
Send back the applications.
Preferably, in data analysis set-up disclosed in this invention, the result data after the rule action executes refers to
Show alarm level, the alarm level be it is following in one：Pass through rank, prompt rank, limitation rank and fatal error
Rank.
Preferably, in data analysis set-up disclosed in this invention, the data analysis unit 2 can be pre- according to user
Fixed modification rule is modified the alarm level indicated by result data（Such as grade drops are will be prompted to as low as passing through rank）.
Preferably, in data analysis set-up disclosed in this invention, the data analysis unit 2 executes as follows
Data analysis operation：The node of the analysis rule tree is traversed in such a way that preamble traverses since the root node of analysis rule tree
（The brotgher of node is judged whether there is if rule condition is not satisfied for each node traversed, if there is brother
Younger brother's node, then a series of logics that the front nodal point of cycle is carried out, and if rule condition is satisfied and corresponding rule is dynamic
The alarm level returned after executing is less than " limitation rank " after being corrected（It indicates to allow to execute subsequent service logic）, then
Child is judged whether there is, if there is a series of logics that the front nodal point then recycled carries out, otherwise judges whether there is fraternal section
Point, if so, a series of logics that the front nodal point of same cycle carries out, otherwise continually look for the last layer node of present node
The brotgher of node traverses whole tree successively, until completing the traversal of all nodes）, wherein the event argument of event is used as this point
Analyse the input parameter of rule tree.
Preferably, in data analysis set-up disclosed in this invention, for the node that each is traversed, when regular item
Part is satisfied and corresponding rule action execute after the alarm level that returns be corrected after less than " limitation rank "（It indicates to permit
Perhaps subsequent service logic is executed）When, continue preamble ergodic process.
Preferably, in data analysis set-up disclosed in this invention, for the node that each is traversed, if regular
Condition is satisfied and corresponding rule action execute after the alarm level that returns be corrected after higher than " limitation rank "（Indicate
Refusal executes subsequent service logic）, then data analysis operation is terminated.
Illustratively, in data analysis set-up disclosed in this invention, implement the rule action and/or the rule
The entity of condition distinguishing is by script（Such as JavaScript）It realizes, and the realization address is the script
Storing path.
Alternatively, in data analysis set-up disclosed in this invention, implement the rule action and/or the rule
The entity of condition distinguishing is by static instruction（Such as Java, C++ etc.）It realizes, and the realization address is the static instruction
The path of the executable file of formation.
Alternatively, in data analysis set-up disclosed in this invention, implement the rule action and/or the rule
The entity of condition distinguishing is by structured query language（Such as PL/SQL, T-SQL etc.）It realizes, and the realization address is institute
State the storing process name of structured query language formation.
Therefore data analysis set-up disclosed in this invention has following advantages：Better than having used analysis rule tree,
And realize the separation and loose coupling of rule condition and rule action（I.e. by node by rule condition and rule action
Cohesion）, to considerably improve the reusability and configuration flexibility of analysis rule, and so that system it is easy to maintain,
Extension and upgrading.
Although the present invention is described by above-mentioned preferred embodiment, way of realization is not limited to
Above-mentioned embodiment.It should be realized that：In the case where not departing from spirit and scope of the present invention, those skilled in the art can be with
Different change and modification are made to the present invention.
Claims (12)
1. a kind of data analysis set-up, the data analysis set-up include：
Event handling unit, the event handling unit receive the event that applications are triggered, and determine whether there is and be somebody's turn to do
The associated analysis rule tree of event then arrives the event transmission if there is analysis rule tree associated with the event
Data analysis unit, wherein the event includes event argument, and the analysis rule tree each analysis rule of definition and
Incidence relation between each analysis rule；
Data analysis unit, the data analysis unit execute number based on analysis rule tree associated with received event
The applications are sent back according to analysis operation, and by analysis result, wherein the event argument of the event is used as analysis rule
The input parameter then set；
User interface, the user interface are used to configure the analysis rule tree according to user instruction；
Storage unit, the storage unit are used to store the analysis rule tree,
Wherein, one analysis rule of each node definition in the analysis rule tree, and the father and son between each node and/
Or brotherhood defines the incidence relation between each analysis rule.
2. data analysis set-up according to claim 1, which is characterized in that the data analysis unit is further used for root
The analysis result is modified according to user's scheduled modification rule, and the analysis result being corrected is sent back into the outside
Using, wherein user can configure the modification rule via the user interface.
3. data analysis set-up according to claim 2, which is characterized in that the analysis rule tree is that only there are one root sections
The multiway tree of point.
4. data analysis set-up according to claim 1, which is characterized in that each node in the analysis rule tree is extremely
Include following elements less：Rule condition and rule action, the rule condition defines the condition for meeting this analysis rule, described
Rule action defines the action performed when the condition of this analysis rule is satisfied.
5. data analysis set-up according to claim 4, which is characterized in that the rule condition further comprises following member
Element：Input parameter, output parameter, implementation type and realization address, to be analyzed wherein the input parameter is the node
Data, the output parameter are the differentiation the result data whether input parameter meets the rule condition, the realization class
Type indicates the implementation type of the rule condition, the ground realized address instruction and implement the entity that the rule condition differentiates
Location.
6. data analysis set-up according to claim 5, which is characterized in that the rule action further comprises following member
Element：Input parameter, output parameter, implementation type and realization address, to be analyzed wherein the input parameter is the node
Data, the output parameter are the result datas after the rule action is performed, and the implementation type indicates the rule action
Implementation type, the address realized address instruction and implement the entity of the rule action.
7. data analysis set-up according to claim 6, which is characterized in that if the rule condition is satisfied, with
Scheduled action is executed by the entity of the rule action realized pointed by address, and by the result data after execution through repairing
The applications are just sent back afterwards.
8. data analysis set-up according to claim 7, which is characterized in that the result data after the rule action execution
Indicate alarm level, the alarm level be it is following in one：Pass through rank, prompt rank, limitation rank and fatal mistake
Accidentally rank.
9. data analysis set-up according to claim 8, which is characterized in that the data analysis unit can be according to user
Scheduled modification rule is modified the alarm level indicated by result data.
10. data analysis set-up according to claim 9, which is characterized in that the data analysis unit is as follows
Execute data analysis operation：The section of the analysis rule tree is traversed in such a way that preamble traverses since the root node of analysis rule tree
Point, wherein the event argument of event is used as the input parameter of the analysis rule tree.
11. data analysis set-up according to claim 10, which is characterized in that for the node that each is traversed, when
Rule condition is satisfied and corresponding rule action execute after the alarm level that returns be corrected after less than " limitation rank " when,
Continue preamble ergodic process.
12. data analysis set-up according to claim 11, which is characterized in that for the node that each is traversed, such as
Fruit rule condition is satisfied and corresponding rule action execute after the alarm level that returns be corrected after higher than " limitation rank ",
Then terminate data analysis operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310707342.2A CN104731800B (en) | 2013-12-20 | 2013-12-20 | Data analysis set-up |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310707342.2A CN104731800B (en) | 2013-12-20 | 2013-12-20 | Data analysis set-up |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104731800A CN104731800A (en) | 2015-06-24 |
| CN104731800B true CN104731800B (en) | 2018-10-23 |
Family
ID=53455698
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310707342.2A Active CN104731800B (en) | 2013-12-20 | 2013-12-20 | Data analysis set-up |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104731800B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713254B (en) * | 2015-11-18 | 2019-08-06 | 中国科学院声学研究所 | It is a kind of match canonic(al) ensemble generation and deep packet inspection method |
| CN107645403B (en) * | 2016-07-22 | 2020-07-03 | 阿里巴巴集团控股有限公司 | Terminal rule engine device and terminal rule operation method |
| CN107770798A (en) * | 2016-08-22 | 2018-03-06 | 深圳市中兴微电子技术有限公司 | A kind of data analysing method and device |
| CN109118353B (en) * | 2018-07-20 | 2022-03-15 | 中国邮政储蓄银行股份有限公司 | Data processing method and device of wind control model |
| CN112800095B (en) * | 2021-04-13 | 2021-07-13 | 腾讯科技（深圳）有限公司 | Data processing method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100013910A (en) * | 2008-08-01 | 2010-02-10 | 한국전자통신연구원 | Event rule-based system and method for integrated u-city monitoring services |
| CN101902336A (en) * | 2009-05-27 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | Rule model-based security event correlation analysis system and method |
| CN102571475A (en) * | 2010-12-27 | 2012-07-11 | 中国银联股份有限公司 | Security information interacting and monitoring system and method based on data analysis |
| CN102724071A (en) * | 2012-06-19 | 2012-10-10 | 国网电力科学研究院 | Method and system for power communication failure early warning analysis based on network model and rule models |
| CN102915373A (en) * | 2012-11-06 | 2013-02-06 | 无锡江南计算技术研究所 | Data storage method and device |
-
2013
- 2013-12-20 CN CN201310707342.2A patent/CN104731800B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100013910A (en) * | 2008-08-01 | 2010-02-10 | 한국전자통신연구원 | Event rule-based system and method for integrated u-city monitoring services |
| CN101902336A (en) * | 2009-05-27 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | Rule model-based security event correlation analysis system and method |
| CN102571475A (en) * | 2010-12-27 | 2012-07-11 | 中国银联股份有限公司 | Security information interacting and monitoring system and method based on data analysis |
| CN102724071A (en) * | 2012-06-19 | 2012-10-10 | 国网电力科学研究院 | Method and system for power communication failure early warning analysis based on network model and rule models |
| CN102915373A (en) * | 2012-11-06 | 2013-02-06 | 无锡江南计算技术研究所 | Data storage method and device |
Non-Patent Citations (1)
| Title |
|---|
| 基于事件关联和数据挖掘的网络故障关联技术的研究;岳海涛;《中国优秀硕士学位论文全文数据库信息科技辑》;20110215;第48-60，图5-1，5-4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104731800A (en) | 2015-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104731800B (en) | Data analysis set-up | |
| US10592282B2 (en) | Providing strong ordering in multi-stage streaming processing | |
| US11086688B2 (en) | Managing resource allocation in a stream processing framework | |
| CN107239335B (en) | Job scheduling system and method for distributed system | |
| US10437635B2 (en) | Throttling events in entity lifecycle management | |
| JP6467497B2 (en) | Compile a graph-based program specification with automated clustering of graph components based on identifying specific data port connections | |
| US20180253335A1 (en) | Maintaining throughput of a stream processing framework while increasing processing load | |
| US20180307571A1 (en) | Recovery strategy for a stream processing system | |
| US11314808B2 (en) | Hybrid flows containing a continous flow | |
| CN106663075A (en) | Executing graph-based program specifications | |
| CN106687920A (en) | Managing invocation of tasks | |
| CN106687919A (en) | Managing state for controlling tasks | |
| CN112379884B (en) | Method and system for realizing flow engine based on Spark and parallel memory calculation | |
| CN106605209A (en) | Controlling data processing tasks | |
| CN104298598B (en) | The adjustment method of RDFS bodies under distributed environment | |
| CN103176892A (en) | Page monitoring method and system | |
| CN101393563A (en) | Web data processing method based on form concept analysis | |
| US8412732B2 (en) | Automatically generating a set of event processing rules for use in a complex event processing system | |
| US9830368B1 (en) | Asynchronous parallel processing of log data | |
| CN111651507A (en) | Big data processing method and system | |
| CN104092578B (en) | Data stream monitoring method based on pipe method | |
| CN110069243A (en) | A kind of java program threads optimization method | |
| Schewe et al. | Horizontal business process model integration | |
| US20130346353A1 (en) | Apparatus and method for providing collaboration service based on composite behavior | |
| CN110427210A (en) | A kind of fast construction method and device of storm topology task |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |