CN102111296A - Mining method for communication alarm association rule based on maximal frequent item set - Google Patents

Mining method for communication alarm association rule based on maximal frequent item set Download PDF

Info

Publication number
CN102111296A
CN102111296A CN2011100034150A CN201110003415A CN102111296A CN 102111296 A CN102111296 A CN 102111296A CN 2011100034150 A CN2011100034150 A CN 2011100034150A CN 201110003415 A CN201110003415 A CN 201110003415A CN 102111296 A CN102111296 A CN 102111296A
Authority
CN
China
Prior art keywords
alarm
data
mining
frequent item
alarm association
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011100034150A
Other languages
Chinese (zh)
Inventor
李洋
苗再良
马小波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Communication Information System Co Ltd
Original Assignee
Inspur Communication Information System Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Communication Information System Co Ltd filed Critical Inspur Communication Information System Co Ltd
Priority to CN2011100034150A priority Critical patent/CN102111296A/en
Publication of CN102111296A publication Critical patent/CN102111296A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a method for building an alarm association rule mining system based on a maximal frequent item set DM (Data Mining) and the realization of that. Three different mining ways for single equipment, cognate equipment and linked equipment are designed aiming to different types of equipment in a communication network, and according to the mining range, the DM range can be positioned at specific city level or communication equipment manufacturer level; after the mining way is confirmed, the alarm association time window, the sliding step, etc are selected to acquire an alarm affair set assembly; and alarm association result mining is performed by utilizing the maximal frequent item set mining algorism after a user inputs the minimum support, and mining result treatment and display are performed according to different mining ways. Through the mentioned steps, the alarm association rule needed by the user can be found out from plenty of alarm data. The method has broad application prospect and favorable utility value.

Description

Communication alarm association rule digging method based on Maximum Frequent item collection
Technical field
The present invention relates to a kind of communication alarm association rule digging method based on Maximum Frequent item collection, specifically a kind of.The invention belongs to communication network alarm monitoring field, particularly relate to communication warning association analysis aspect based on data mining technology.
Background technology
Store a large amount of history alarm information in the network alarm database, wherein contained the useful information of many reflection network operation states and fault rootstock, utilized these information can improve network failure management.Communication alarm association rule analysis based on data mining technology, can be by analyzing the alarm Transaction Information, excavation alarm association rule, disclose the significant knowledge and the alarm association that lie in the magnanimity original alarm data, more comprehensively and the explanation network failure and the performance issue of system, make the webmaster personnel can carry out fault location fast and further do the decision-making and predicting of being out of order.But the communication network network element device is of a great variety, and relation is complicated, and the alarm data amount is huge, and universal data mining algorithm can be excavated all frequent item sets in theory, and then obtains correlation rule wherein.But the requirement for hardware system is very high, need calculate and take a large amount of memory spaces for a long time.And the excavation result who obtains is for practical application, much be invalid result, even partial results is redundant, can't realize the efficient excavation of correlation rule, is unsuitable for the combing work and actual alarm monitoring and fault location of later stage alarm association rule.
Summary of the invention
In order to overcome the problem that prior art exists, the present invention has designed and Implemented a kind of communication alarm Maximum Frequent item set mining system.
The purpose of this invention is to provide a kind of communication alarm association rule digging method based on Maximum Frequent item collection.The objective of the invention is to realize in the following manner, the invention provides a kind of creationary, efficiently based on the communication warning association analysis system of Maximum Frequent item collection data mining.By actual communication networks being carried out alarm data analysis, network element device classification, topological structure arrangement, alarm monitoring system demand analysis etc., designed and Implemented the complete warning association analysis system of a cover, wherein excavated classification, the data mining of alarm Maximum Frequent item collection, data mining results is handled and show that four big subsystems form by alarm data preliminary treatment, network element device.
Method comprises following steps:
1) at first obtains original alarm data continuous in a period of time from the alarm monitoring platform, according to the real data excacation, by data cleansing, needed alarm data is obtained in data extract, and extraction determinant attribute wherein, set up alarm data table to be excavated;
2) excavate mode according to the difference of single network element, same category of device network element, interconnect equipment, by alarm association time window and sliding step are set, traversal alarm data table is set up the affairs type data acquisition system of needed data mining;
3) data mining support parameter and confidence level parameter are set, utilize the data mining algorithm of Maximum Frequent item collection, excavate the Maximum Frequent item collection in the alarm, obtain all Maximum Frequent items and assemble fruit;
4) frequent item set that obtains according to the different data mining mode of single network element, same category of device network element and InterWorking Equipment, take diverse ways to carry out result treatment, obtain the alarm association rule, so that data mining has better targeted to different excavation modes;
5) the alarm association rule after data excavate are handled is checked by the correlation rule that the alarm monitoring platform has been set up, and accuracy rate and coverage rate that verification msg is excavated prove the validity and the practicality of data mining;
6) the alarm association rule that data mining is obtained in conjunction with existing be used for alarm monitoring and fault location specially
The system of family carries out the alarm association analysis of network management platform, serves the communication network monitoring field.
Excellent effect of the present invention:
(1) at different excavation modes, alarm data is carried out different uniqueness marks, make and can in data mining, pick out any alarm data accurately, improve the accuracy of data mining.
(2) at practical application, the data mining algorithm that exploitation makes new advances based on Maximum Frequent item collection, guaranteeing under the correct prerequisite of data mining results, the data processing quantity and the digging efficiency of data mining have been improved greatly, this method can be handled the alarm data of 1,000,000 orders of magnitude, and obtained reasonable excavation effect, make the alarm association regular data excavate and have better engineering application.
(3) in the excavation of InterWorking Equipment, according to actual electrical communication network topological relation, the data acquisition phase and the constraint in result treatment stage are carried out in the topological network unit combination under the different topology relation, improved the digging efficiency of InterWorking Equipment.
(4) in result treatment,, take the multiple results treatment mechanism in conjunction with actual needs, the excavation result that maximum packed data excavates, and, provide suitable exhibition method as a result in conjunction with actual alarm association rule, greatly facilitate alarm association rule checking work.
Description of drawings
Accompanying drawing 1 is the structural representation based on the communication alarm association rule digging method of Maximum Frequent item collection;
Embodiment
With reference to Figure of description the communication alarm association rule digging method based on Maximum Frequent item collection of the present invention is done following detailed explanation.
Communication alarm association rule digging method based on Maximum Frequent item collection of the present invention, its step is as follows:
1) at first obtains original alarm data continuous in a period of time from the alarm monitoring platform, according to the real data excacation, by data cleansing, needed alarm data is obtained in data extract etc., and extraction determinant attribute wherein, set up alarm data table to be excavated.
2) according to different excavation modes such as single network element, same category of device network element, interconnect equipments, by alarm association time window and sliding step are set, traversal alarm data table is set up the affairs type data acquisition system of needed data mining.
3) data mining support parameter and confidence level parameter are set, utilize data mining algorithm, excavate the Maximum Frequent item collection in the alarm, obtain all Maximum Frequent items and assemble fruit based on Maximum Frequent item collection.
4) the frequent item set result that obtains of different data mining mode is also different, therefore need take diverse ways to carry out result treatment, obtains the alarm association rule, can make data mining that different excavation modes is had better targeted.
5) the alarm association rule after data excavate are handled is checked by the correlation rule that the alarm monitoring platform has been set up, and accuracy rate and coverage rate that verification msg is excavated prove the validity and the practicality of data mining.
6) the alarm association rule that data mining is obtained in conjunction with existing be used for alarm monitoring and fault location specially
The system of family carries out the alarm association analysis of network management platform, serves the communication network monitoring field.
The present invention is based on the warning association analysis system of Maximum Frequent item collection data mining, this system can excavate Maximum Frequent item collection in the mass alarm, not only can comprise all frequent item subclass, can also save a large amount of time and memory space, and in the process of system implementation, carry out classified excavation according to communication device types, carry out multiple processing to excavating the result at last, provide the alarm association rule with the succinct form of complete sum, really having realized the association rule mining of communication alarm mass data.
Under magnanimity telecommunications alarm data, has good application, can be according to different data mining demands, carrying out the alarm association regular data according to different excavation modes excavates, excavate user's interest Maximum Frequent item collection and get rid of frequent useless subclass, when having improved digging efficiency, compress the excavation result significantly, really realized the accuracy and the application efficiency of the alarm association rule digging under the mass alarm data.Excavation result of the present invention can directly apply to alarm monitoring and fault location aspect, so the present invention is with a wide range of applications and good practical value.
Embodiment
Based on data mining alarm association analytical system of the present invention, can adopt Host Based software to realize.Method and points for attention during specific implementation are as follows:
1. the set of affairs type alarm data is obtained
(1), alarm data is cleaned, extracts, sets up suitable alarm uniquely tagged according to different excavation modes.
(2) alarm association time window and the sliding step that is provided with according to the user, the ergodic data storehouse, obtain the alarm association affairs type data acquisition system that needs, wherein excavate InterWorking Equipment and need introduce corresponding network topology relation constraint, obtain the alarm association affairs type data acquisition system after the constraint.
2. Algorithms of Maximal Frequent Itemset Mining realizes
(1) utilizes the interface based on the data mining algorithm of Maximum Frequent item collection of exploitation, import user-defined minimum support into, carry out data mining.
(2) in mining process, when excavation is carried out, show the result excavated, carry out mining process monitoring and parameter input, with some relevant information records of data mining in journal file.
(3) interface of reservation and data mining results processing section is handled so that carry out corresponding results.
3. excavate result treatment and demonstration
(1) according to different excavation modes, adopt diverse ways to carry out result treatment, comprising subclass result's removal, the merging of identical result etc., farthest the result is excavated in compression, improves the practicality of excavating the result.
(2),, adopt the alarm association rule that suitable form shows and record is excavated, so that next step is applied to alarm monitoring and fault location in conjunction with practical application according to user's request.
Except that the described technical characterictic of specification, be the known technology of those skilled in the art.

Claims (1)

1. based on the communication alarm association rule digging method of Maximum Frequent item collection, it is characterized in that, comprise following steps:
(1) at first obtains original alarm data continuous in a period of time from the alarm monitoring platform, according to the real data excacation, by data cleansing, needed alarm data is obtained in data extract, and extraction determinant attribute wherein, set up alarm data table to be excavated;
(2) excavate mode according to the difference of single network element, same category of device network element, interconnect equipment, by alarm association time window and sliding step are set, traversal alarm data table is set up the affairs type data acquisition system of needed data mining;
(3) data mining support parameter and confidence level parameter are set, utilize the data mining algorithm of Maximum Frequent item collection, excavate the Maximum Frequent item collection in the alarm, obtain all Maximum Frequent items and assemble fruit;
(4) frequent item set that obtains according to the different data mining mode of single network element, same category of device network element and InterWorking Equipment, take diverse ways to carry out result treatment, obtain the alarm association rule, so that data mining has better targeted to different excavation modes;
(5) the alarm association rule after data excavate are handled is checked by the correlation rule that the alarm monitoring platform has been set up, and accuracy rate and coverage rate that verification msg is excavated prove the validity and the practicality of data mining;
(6) the alarm association rule that data mining is obtained is carried out the alarm association analysis of network management platform in conjunction with the existing expert system that is used for alarm monitoring and fault location, serves the communication network monitoring field.
CN2011100034150A 2011-01-10 2011-01-10 Mining method for communication alarm association rule based on maximal frequent item set Pending CN102111296A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100034150A CN102111296A (en) 2011-01-10 2011-01-10 Mining method for communication alarm association rule based on maximal frequent item set

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100034150A CN102111296A (en) 2011-01-10 2011-01-10 Mining method for communication alarm association rule based on maximal frequent item set

Publications (1)

Publication Number Publication Date
CN102111296A true CN102111296A (en) 2011-06-29

Family

ID=44175330

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100034150A Pending CN102111296A (en) 2011-01-10 2011-01-10 Mining method for communication alarm association rule based on maximal frequent item set

Country Status (1)

Country Link
CN (1) CN102111296A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102625350A (en) * 2012-03-09 2012-08-01 浪潮通信信息系统有限公司 Mobile communication network management automatic dispatch based on alarm correlation
CN102904738A (en) * 2011-07-26 2013-01-30 华为软件技术有限公司 Work order processing method, relevant device and relevant system
CN103927398A (en) * 2014-05-07 2014-07-16 中国人民解放军信息工程大学 Microblog hype group discovering method based on maximum frequent item set mining
CN104038375A (en) * 2014-06-30 2014-09-10 成都广达电子股份有限公司 Alarm processing analysis system and method of broadcasting and TV access network
CN105528280A (en) * 2015-11-30 2016-04-27 中电科华云信息技术有限公司 Method and system capable of determining log alarm grades according to relationship between system logs and health monitoring
CN106155468A (en) * 2015-04-16 2016-11-23 腾讯科技(深圳)有限公司 A kind of alarm methods of exhibiting and terminal
CN103793589B (en) * 2012-10-31 2017-01-18 中国科学院软件研究所 High-speed train fault handling method
CN106650273A (en) * 2016-12-28 2017-05-10 东方网力科技股份有限公司 Behavior prediction method and device
CN106789347A (en) * 2017-01-22 2017-05-31 山东浪潮商用系统有限公司 A kind of method that alarm association and network fault diagnosis are realized based on alarm data
CN106878038A (en) * 2015-12-10 2017-06-20 华为技术有限公司 Fault Locating Method and device in a kind of communication network
CN106874491A (en) * 2017-02-22 2017-06-20 北京科技大学 A kind of device fault information method for digging based on dynamic association rules
CN107133370A (en) * 2017-06-19 2017-09-05 南京邮电大学 A kind of label recommendation method based on correlation rule
CN107835087A (en) * 2017-09-14 2018-03-23 北京科东电力控制系统有限责任公司 A kind of safety means alarm regulation extraction method based on Frequent Pattern Mining
CN108415789A (en) * 2018-01-24 2018-08-17 西安交通大学 Node failure forecasting system and method towards extensive mixing heterogeneous storage system
CN109189736A (en) * 2018-08-01 2019-01-11 中国联合网络通信集团有限公司 A kind of generation method and device of alarm association rule
CN109412867A (en) * 2018-12-06 2019-03-01 国家电网有限公司信息通信分公司 A kind of alarm association merging method, device, system, equipment and storage medium
CN109492073A (en) * 2018-10-31 2019-03-19 北京达佳互联信息技术有限公司 Blog search method, blog search device and computer readable storage medium
CN109617745A (en) * 2019-01-11 2019-04-12 云智慧(北京)科技有限公司 Alarm prediction method, device, system and storage medium
CN110135603A (en) * 2019-05-21 2019-08-16 国网河南省电力公司信息通信公司 It is a kind of to alert space characteristics analysis method based on the electric power networks for improving entropy assessment
CN116634150A (en) * 2023-07-21 2023-08-22 宁波康达凯能医疗科技有限公司 Inter-frame image coding method, device and storage medium based on frequent pattern classification

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101022366A (en) * 2007-03-21 2007-08-22 Ut斯达康通讯有限公司 Trouble correlation analytic system and method
WO2007143943A1 (en) * 2006-06-01 2007-12-21 Huawei Technologies Co., Ltd. Method, system and network device of centralized maintenance of multiple devices
CN101937447A (en) * 2010-06-07 2011-01-05 华为技术有限公司 Alarm association rule mining method, and rule mining engine and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007143943A1 (en) * 2006-06-01 2007-12-21 Huawei Technologies Co., Ltd. Method, system and network device of centralized maintenance of multiple devices
CN101022366A (en) * 2007-03-21 2007-08-22 Ut斯达康通讯有限公司 Trouble correlation analytic system and method
CN101937447A (en) * 2010-06-07 2011-01-05 华为技术有限公司 Alarm association rule mining method, and rule mining engine and system

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102904738A (en) * 2011-07-26 2013-01-30 华为软件技术有限公司 Work order processing method, relevant device and relevant system
CN102904738B (en) * 2011-07-26 2017-05-24 华为软件技术有限公司 Work order processing method, relevant device and relevant system
CN102625350A (en) * 2012-03-09 2012-08-01 浪潮通信信息系统有限公司 Mobile communication network management automatic dispatch based on alarm correlation
CN103793589B (en) * 2012-10-31 2017-01-18 中国科学院软件研究所 High-speed train fault handling method
CN103927398A (en) * 2014-05-07 2014-07-16 中国人民解放军信息工程大学 Microblog hype group discovering method based on maximum frequent item set mining
CN103927398B (en) * 2014-05-07 2016-12-28 中国人民解放军信息工程大学 The microblogging excavated based on maximum frequent itemsets propagandizes colony's discovery method
CN104038375A (en) * 2014-06-30 2014-09-10 成都广达电子股份有限公司 Alarm processing analysis system and method of broadcasting and TV access network
CN106155468A (en) * 2015-04-16 2016-11-23 腾讯科技(深圳)有限公司 A kind of alarm methods of exhibiting and terminal
CN106155468B (en) * 2015-04-16 2019-12-10 腾讯科技(深圳)有限公司 Alarm display method and terminal
CN105528280A (en) * 2015-11-30 2016-04-27 中电科华云信息技术有限公司 Method and system capable of determining log alarm grades according to relationship between system logs and health monitoring
CN106878038A (en) * 2015-12-10 2017-06-20 华为技术有限公司 Fault Locating Method and device in a kind of communication network
CN106650273B (en) * 2016-12-28 2019-08-23 东方网力科技股份有限公司 A kind of behavior prediction method and apparatus
CN106650273A (en) * 2016-12-28 2017-05-10 东方网力科技股份有限公司 Behavior prediction method and device
CN106789347A (en) * 2017-01-22 2017-05-31 山东浪潮商用系统有限公司 A kind of method that alarm association and network fault diagnosis are realized based on alarm data
CN106874491A (en) * 2017-02-22 2017-06-20 北京科技大学 A kind of device fault information method for digging based on dynamic association rules
CN107133370A (en) * 2017-06-19 2017-09-05 南京邮电大学 A kind of label recommendation method based on correlation rule
CN107835087A (en) * 2017-09-14 2018-03-23 北京科东电力控制系统有限责任公司 A kind of safety means alarm regulation extraction method based on Frequent Pattern Mining
CN107835087B (en) * 2017-09-14 2022-09-02 北京科东电力控制系统有限责任公司 Automatic extraction method of alarm rule of safety equipment based on frequent pattern mining
CN108415789A (en) * 2018-01-24 2018-08-17 西安交通大学 Node failure forecasting system and method towards extensive mixing heterogeneous storage system
CN108415789B (en) * 2018-01-24 2020-05-22 西安交通大学 Node fault prediction system and method for large-scale hybrid heterogeneous storage system
CN109189736A (en) * 2018-08-01 2019-01-11 中国联合网络通信集团有限公司 A kind of generation method and device of alarm association rule
CN109492073A (en) * 2018-10-31 2019-03-19 北京达佳互联信息技术有限公司 Blog search method, blog search device and computer readable storage medium
CN109412867B (en) * 2018-12-06 2022-02-08 国家电网有限公司信息通信分公司 Alarm association combination method, device, system, equipment and storage medium
CN109412867A (en) * 2018-12-06 2019-03-01 国家电网有限公司信息通信分公司 A kind of alarm association merging method, device, system, equipment and storage medium
CN109617745A (en) * 2019-01-11 2019-04-12 云智慧(北京)科技有限公司 Alarm prediction method, device, system and storage medium
CN109617745B (en) * 2019-01-11 2022-03-04 云智慧(北京)科技有限公司 Alarm prediction method, device, system and storage medium
CN110135603A (en) * 2019-05-21 2019-08-16 国网河南省电力公司信息通信公司 It is a kind of to alert space characteristics analysis method based on the electric power networks for improving entropy assessment
CN110135603B (en) * 2019-05-21 2022-11-11 国网河南省电力公司信息通信公司 Power network alarm space characteristic analysis method based on improved entropy weight method
CN116634150A (en) * 2023-07-21 2023-08-22 宁波康达凯能医疗科技有限公司 Inter-frame image coding method, device and storage medium based on frequent pattern classification
CN116634150B (en) * 2023-07-21 2023-12-12 宁波康达凯能医疗科技有限公司 Inter-frame image coding method, device and storage medium based on frequent pattern classification

Similar Documents

Publication Publication Date Title
CN102111296A (en) Mining method for communication alarm association rule based on maximal frequent item set
US9590880B2 (en) Dynamic collection analysis and reporting of telemetry data
CN106375339B (en) Attack mode detection method based on event sliding window
CN102938708B (en) Based on alarm correlation analysis system and the analytical method thereof of alarm propagation pattern
CN108880857B (en) Method and system for discovering and presenting network application access information
CN103455636A (en) Automatic capturing and intelligent analyzing method based on Internet tax data
CN104348667A (en) Fault positioning method based on warning information
CN102142992A (en) Communication alarm frequent itemset mining engine and redundancy processing method
CN105488048A (en) Data query method and device
CN111274282A (en) Air quality mining system and method and data acquisition monitoring device
CN107332685A (en) A kind of method based on big data O&M daily record applied in state's net cloud
CN102790706A (en) Safety analyzing method and device of mass events
CN111782620A (en) Credit link automatic tracking platform and method thereof
WO2015131558A1 (en) Alarm correlation data mining method and device
CN104486116A (en) Multidimensional query method and multidimensional query system of flow data
CN106407429A (en) File tracking method, device and system
CN103745190A (en) Two-dimensional code-based performance and monitoring data presentation method
CN106126704A (en) Finance and tax integration platform, system and method
CN104317794A (en) Chinese feature word association pattern mining method based on dynamic project weight and system thereof
CN108833442A (en) A kind of distributed network security monitoring device and its method
CN103995828A (en) Cloud storage log data analysis method
CN107577769A (en) A kind of method for digging and system for measuring expert data
CN114519511A (en) Oil well full-life-cycle management method and system based on cloud architecture
CN105260465B (en) A kind of method, apparatus of diagram data processing service
CN102685222B (en) A kind of cloud SRM device for electric power system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20110629