CN114071263A - Method and device for removing duplicate of optical fiber network alarm repeated data - Google Patents
Method and device for removing duplicate of optical fiber network alarm repeated data Download PDFInfo
- Publication number
- CN114071263A CN114071263A CN202110792588.9A CN202110792588A CN114071263A CN 114071263 A CN114071263 A CN 114071263A CN 202110792588 A CN202110792588 A CN 202110792588A CN 114071263 A CN114071263 A CN 114071263A
- Authority
- CN
- China
- Prior art keywords
- alarm
- data
- storage process
- fault information
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/0001—Selecting arrangements for multiplex systems using optical switching
- H04Q11/0062—Network aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/0001—Selecting arrangements for multiplex systems using optical switching
- H04Q11/0062—Network aspects
- H04Q2011/0079—Operation or maintenance aspects
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method and a device for removing duplicate data of optical fiber network alarm, comprising the following steps: receiving an alarm message of the ActiveMQ and calling a preset storage process; performing data filtering and data deduplication based on the stored procedures; analyzing an alarm event based on the storage process; judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result; if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page for real-time display. The invention can automatically remove the repeated data, thereby realizing the non-single storage of the database and further improving the data quality.
Description
Technical Field
The invention relates to the technical field of communication network data processing, in particular to a method and a device for removing duplicate data of optical fiber network alarm repetition.
Background
The warning notification interface of the CORBA north interface pushes the warning, and the characteristics are that: real-time alarms can be pushed, and current alarms can be pushed repeatedly. The adapter collector also periodically fetches all current alarms from the interface. Based on the characteristic of a CORBA northbound interface and an adapter acquisition rule, the acquired data can be repeated. With the rapid development of communication networks, communication devices are gradually increased, and a large amount of alarm data is generated when an operation fault occurs. In order to ensure that communication is not affected and operation is safe, firstly, maintenance work of network data needs to be done, alarm data needs to be simplified, and repeated data needs to be subjected to deduplication processing.
However, the existing repeated data deduplication work is completed manually, and if a manual comparison mode is adopted, the efficiency is low, and the accuracy is also low.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a method and a device for removing duplicate data of optical fiber network alarm duplicate data.
In a first aspect, an embodiment of the present invention provides a method for deduplication of optical fiber network alarm duplicate data, including:
receiving an alarm message of the ActiveMQ and calling a preset storage process;
performing data filtering and data deduplication based on the stored procedures;
analyzing an alarm event based on the storage process;
judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result;
if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page for real-time display.
Further, the alarm message of the ActiveMQ is the alarm message of the general alarm format transmitted point to point through an ActiveMQ message queue; the alarm information of the general alarm format is obtained by the self-defined conversion of the optical fiber network alarm event extracted from the northbound interface by the acquisition adapter.
Further, still include:
and regularly transferring the alarm information in the general alarm format from the ActiveMQ message queue to a common message queue, and sequencing according to time and alarm types.
Further, performing data filtering and data deduplication based on the storage process specifically includes:
and filtering out non-alarm events, network management alarms and alarm events which exist in a history storage library in the alarm events corresponding to the current alarm information based on the storage process.
Further, the analyzing the alarm event based on the storage process specifically includes:
and analyzing one or more of alarm level, alarm ID, alarm rack frame, alarm rack slot, alarm sub-slot, alarm board card, alarm port, alarm time slot, alarm link, alarm occurrence position, alarm reason and alarm description from the alarm event corresponding to the alarm message based on the storage process.
Further, the determining whether to generate a custom fault information repository according to the generation rule based on the analysis result specifically includes:
judging whether the alarm event is repeated or not based on the analysis result;
if so, judging whether the alarm is cleared according to the alarm level; if yes, ending the alarm in the database and storing the alarm in a history table; if not, determining the alarm data as the repeated alarm data, and updating the alarm recording time;
and if the fault information is not repeated and the alarm level is not cleared, generating a self-defined fault information storage.
Further, if yes, a preset storage process is called for storage, and alarm data and the fault information are sent to a front-end page for real-time display, and the method specifically includes the following steps:
if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page through a WebSocket message for real-time display.
In a second aspect, an embodiment of the present invention provides an apparatus for removing duplicate data in an optical fiber network alarm, including:
the receiving module is used for receiving the alarm message of the ActiveMQ and calling a preset storage process;
a filtering and deduplication module for performing data filtering and data deduplication based on the storage process;
the analysis module is used for analyzing the alarm event based on the storage process;
the storage module is used for judging whether to generate a self-defined fault information library or not according to the generation rule based on the analysis result;
and the sending module is used for calling a preset storage process to store the database if the fault information is in the preset storage process, and sending the alarm data and the fault information to a front-end page for real-time display.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method for deduplicating optical network alarm duplication data according to the first aspect when executing the program.
In a fourth aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the optical network alarm repetition data deduplication method according to the first aspect.
According to the technical scheme, the method and the device for removing the duplicate of the alarm repeated data of the optical fiber network, provided by the embodiment of the invention, receive the alarm message of the ActiveMQ and call the preset storage process; performing data filtering and data deduplication based on the stored procedures; analyzing an alarm event based on the storage process; judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result; if yes, calling a preset storage process to store, and sending alarm data and the fault information to a front-end page for real-time display; repeated data can be automatically removed, so that the problem that the database is not single in storage is solved, and the data quality is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for deduplication of optical fiber network alarm duplication data according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an optical fiber network alarm repetition data deduplication device according to an embodiment of the present invention;
fig. 3 is a schematic physical structure diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some embodiments, but not all embodiments, of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. The method for removing duplicate data in optical fiber network alarm provided by the present invention will be explained and illustrated in detail by specific embodiments.
Fig. 1 is a schematic flowchart of a method for deduplication of optical fiber network alarm duplication data according to an embodiment of the present invention; as shown in fig. 1, the method includes:
step 101: and receiving an alarm message of the ActiveMQ and calling a preset storage process.
Step 102: and performing data filtering and data deduplication based on the stored procedures.
Step 103: and analyzing the alarm event based on the storage process.
Step 104: and judging whether to generate a self-defined fault information library according to the generation rule based on the analysis result.
Step 105: if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page for real-time display.
In this embodiment, it can be understood that the alarm message of the ActiveMQ is the alarm data corresponding to the alarm event, the alarm message of the ActiveMQ may be the optical fiber network alarm data transmitted point to point through an ActiveMQ message queue, and the alarm message of the ActiveMQ may also be the alarm information in the general alarm format transmitted point to point through the ActiveMQ message queue; the alarm information of the general alarm format is obtained by the self-defined conversion of the optical fiber network alarm event extracted from the northbound interface by the acquisition adapter.
In this embodiment, it can be understood that, based on the information corresponding to the analysis result, it may be automatically determined whether to generate a customized fault information repository according to the generation rule, for example, whether to generate a higher-level fault information repository according to the generation rule.
According to the technical scheme, the method for removing the repeated data of the optical fiber network alarm provided by the embodiment of the invention receives the alarm message of the ActiveMQ and calls the preset storage process; performing data filtering and data deduplication based on the stored procedures; analyzing an alarm event based on the storage process; judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result; if yes, calling a preset storage process to store, and sending alarm data and the fault information to a front-end page for real-time display; repeated data can be automatically removed, so that the problem that the database is not single in storage is solved, and the data quality is improved.
On the basis of the above embodiment, in this embodiment, the alarm message of the ActiveMQ is an alarm message in a general alarm format transmitted point-to-point through an ActiveMQ message queue; the alarm information of the general alarm format is obtained by the self-defined conversion of the optical fiber network alarm event extracted from the northbound interface by the acquisition adapter.
In order to better understand the present invention, the following examples are further provided to illustrate the present invention, but the present invention is not limited to the following examples, for example:
first, extraction
1) The acquisition adapter extracts the optical fiber network alarm data from the northbound interface and converts the optical fiber network alarm data into a general alarm format.
2) Sending alarms in a generic alarm format through an ACTIVEMQ message queue in a point-to-point messaging model
Second, removing weight
After receiving the alarm of the ActiveMQ, the micro-service calls a storage process to filter, deduplicate, analyze and store the data.
Third, analysis
And calling a storage process for analysis, and then judging whether a fault information library with a higher level needs to be generated according to the generation rule.
Fourth, store
And calling a stored procedure library.
Fifth, notify
And sending the webpage to a front-end system in a WebSocket mode.
Sixth, show
And the browser receives the data sent by the WebSocket and displays the alarm information on the page in real time.
And seventhly, the flow structure is divided into an alarm acquisition layer, an alarm service processing layer, an alarm transmission layer, an alarm storage layer and an alarm display layer.
And eighth, the acquisition program development language is JAVA, and an SPRING framework, a QUARTZ timer, a C3P0 data connection pool, an ORACLE database, an ActiveMQ message queue and a WebSocket communication protocol are applied.
According to the technical scheme, the method for removing the duplicate alarm data of the optical fiber network provided by the embodiment of the invention has the advantages that after the optical fiber network acquisition adapter extracts the duplicate alarm data, the duplicate alarm data are converted into a general alarm format, and then the duplicate alarm data are automatically deleted through the rule, so that the duplicate alarm data are removed.
On the basis of the above embodiment, in this embodiment, the method further includes:
and regularly transferring the alarm information in the general alarm format from the ActiveMQ message queue to a common message queue, and sequencing according to time and alarm types.
In this embodiment, it can be understood that, for example, first, the alarm data is obtained from the northbound interface, and the alarm event is converted into a custom generic alarm format; the alarm event is put into a LinkedBlockingQueue message queue; then, periodically transferring the messages in the queue to a common message queue, and sequencing according to time and alarm types; the messages of the alert queue are then sent out by looping through ActiveMQ messages.
According to the technical scheme, the method for removing the repeated data of the optical fiber network alarm data, provided by the embodiment of the invention, has the advantages that the alarm information in the general alarm format is periodically transferred from the ActiveMQ message queue to the common message queue and is sequenced according to time and alarm types, so that the alarm information is circularly sent out through the ActiveMQ message.
On the basis of the foregoing embodiment, in this embodiment, the data filtering and data deduplication are performed based on the storage process, and specifically includes:
and filtering out non-alarm events, network management alarms and alarm events which exist in a history storage library in the alarm events corresponding to the current alarm information based on the storage process.
In this embodiment, it can be understood that, for example, the middleware calls a storage process after receiving the alarm, and performs data filtering and data deduplication based on the storage process, such as filtering non-alarm events, filtering out network management alarms, and filtering out current alarms half a month ago (i.e., filtering out alarm events that already exist in the history repository in the alarm events corresponding to the current alarm information).
On the basis of the foregoing embodiment, in this embodiment, the analyzing an alarm event based on the storage process specifically includes:
and analyzing one or more of alarm level, alarm ID, alarm rack frame, alarm rack slot, alarm sub-slot, alarm board card, alarm port, alarm time slot, alarm link, alarm occurrence position, alarm reason and alarm description from the alarm event corresponding to the alarm message based on the storage process.
In this embodiment, it can be understood that, for example, fields such as an alarm level, an alarm device ID, an alarm rack, an alarm machine frame, an alarm machine slot, an alarm sub-slot, an alarm board card, an alarm port, an alarm time slot, an alarm located link ID, and an alarm description are analyzed from an alarm event; analyzing the alarm occurrence position and the alarm reason from the alarm event; it should be noted that the alarm data of the manufacturer network manager does not have a unique ID, so the analyzed alarm occurrence position and alarm reason are used as the basis for judging whether the alarm is repeated.
On the basis of the foregoing embodiment, in this embodiment, the determining whether to generate a custom fault information repository according to the generation rule based on the analysis result specifically includes:
judging whether the alarm event is repeated or not based on the analysis result;
if so, judging whether the alarm is cleared according to the alarm level; if yes, ending the alarm in the database and storing the alarm in a history table; if not, determining the alarm data as the repeated alarm data, and updating the alarm recording time;
and if the fault information is not repeated and the alarm level is not cleared, generating a self-defined fault information storage.
In this embodiment, it may be understood that whether the alarm event is repeated is determined based on the analysis result, if the alarm is determined to exist (i.e., be repeated), whether the alarm is to be cleared is determined according to the alarm level, and if the alarm is to be cleared, the alarm in the database is ended and stored in the history table. If the alarm is not cleared, the alarm represents repeated alarm data, and only the alarm recording time needs to be updated; and judging whether the alarm event is repeated or not based on the analysis result, if the alarm is judged not to exist in the database (namely not repeated) and the alarm level is not cleared, judging that the alarm belongs to a newly added alarm and warehousing, and then judging whether the fault can be generated or not according to the fault generation rule and warehousing.
According to the technical scheme, the method for removing the duplicate of the alarm duplicate data of the optical fiber network provided by the embodiment of the invention adopts the coding mode to remove the duplicate, and mainly adopts the database end coding to realize the duplicate removal of the alarm duplicate data.
On the basis of the foregoing embodiment, in this embodiment, if yes, a preset storage process is called to store a library, and alarm data and the fault information are sent to a front-end page for real-time display, which specifically includes:
if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page through a WebSocket message for real-time display.
In order to better understand the present invention, the following examples are further provided to illustrate the content of the present invention, but the present invention is not limited to the following examples.
1. And acquiring alarm data from the northbound interface.
2. The alarm event is converted into a customized general alarm format.
3. The alarm event is placed in the LinkedBlockingQueue message queue.
4. And periodically transferring the messages in the queue to a common message queue, and sequencing according to time and alarm types.
5. And sending out the messages of the alarm queue by circulating the ActiveMQ messages.
6. And the middleware calls a storage process after receiving the alarm.
7. And filtering non-alarm events, filtering network management alarms, and filtering current alarms before half a month.
8. And analyzing fields such as alarm level, alarm equipment ID, alarm rack, alarm machine frame, alarm machine slot, alarm sub-slot, alarm board card, alarm port, alarm time slot, alarm link ID, alarm description and the like from the alarm event.
9. The alarm data of the manufacturer network management does not have a unique ID, so the analyzed alarm occurrence position and the alarm reason are used as the basis for judging whether the alarm is repeated.
10. If the alarm exists, whether the alarm is cleared is judged according to the alarm level, and if the alarm is cleared, the alarm in the database is ended and stored in a history table. If the alarm is not cleared, it represents repeated alarm data, where only the alarm record time needs to be updated.
11. And if the alarm does not exist in the database and the alarm level is not cleared, the alarm belongs to a newly added alarm and is put in storage.
12. And judging whether the fault can be generated or not according to the fault generation rule, and storing the fault in a database.
13. And sending the processed alarm data and the generated fault data through a WebSocket message.
14. And the front-end page receives the WebSocket message display.
The method for removing the duplicate data of the optical fiber network alarm duplicate data provided by the embodiment of the invention can realize the function of automatically removing the duplicate data by a program, realize the single and non-duplicate data stored in a database and improve the data quality.
Fig. 2 is a schematic structural diagram of an optical fiber network alarm repetition data deduplication device according to an embodiment of the present invention, and as shown in fig. 2, the device includes: a receiving module 201, a filtering and de-duplication module 202, a parsing module 203, a storage module 204 and a sending module 205, wherein:
the receiving module 201 is configured to receive an alarm message of an ActiveMQ, and call a preset storage process;
a filtering and deduplication module 202, configured to perform data filtering and data deduplication based on the stored procedure;
the analysis module 203 is used for analyzing the alarm event based on the storage process;
the storage module 204 is used for judging whether to generate a self-defined fault information library according to the generation rule based on the analysis result;
and the sending module 205 is configured to, if yes, invoke a preset storage process to store the library, and send the alarm data and the fault information to a front-end page for real-time display.
The device for removing duplicate alarm data in an optical fiber network provided by the embodiment of the present invention may be specifically used to execute the method for removing duplicate alarm data in an optical fiber network according to the above embodiment, and the technical principle and the beneficial effects thereof are similar, and reference may be specifically made to the above embodiment, which is not described herein again.
Based on the same inventive concept, an embodiment of the present invention provides an electronic device, which specifically includes the following components, with reference to fig. 3: a processor 301, a communication interface 303, a memory 302, and a communication bus 304;
the processor 301, the communication interface 303 and the memory 302 complete mutual communication through the communication bus 304; the communication interface 303 is used for realizing information transmission between related devices such as modeling software, an intelligent manufacturing equipment module library and the like; the processor 301 is used for calling the computer program in the memory 302, and the processor executes the computer program to implement the method provided by the above method embodiments, for example, the processor executes the computer program to implement the following steps: receiving an alarm message of the ActiveMQ and calling a preset storage process; performing data filtering and data deduplication based on the stored procedures; analyzing an alarm event based on the storage process; judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result; if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page for real-time display.
Based on the same inventive concept, yet another embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, is implemented to perform the methods provided by the above method embodiments, for example, receiving an alert message of an ActiveMQ and calling a preset storage procedure; performing data filtering and data deduplication based on the stored procedures; analyzing an alarm event based on the storage process; judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result; if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page for real-time display.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
In addition, in the present invention, terms such as "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Moreover, in the present invention, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Furthermore, in the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for removing duplicate data in optical fiber network alarm is characterized by comprising the following steps:
receiving an alarm message of the ActiveMQ and calling a preset storage process;
performing data filtering and data deduplication based on the stored procedures;
analyzing an alarm event based on the storage process;
judging whether to generate a self-defined fault information library according to a generation rule based on the analysis result;
if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page for real-time display.
2. The method for removing duplicate data in optical network alarms according to claim 1, wherein the alarm message of ActiveMQ is an alarm message in a generic alarm format transmitted point-to-point through an ActiveMQ message queue; the alarm information of the general alarm format is obtained by the self-defined conversion of the optical fiber network alarm event extracted from the northbound interface by the acquisition adapter.
3. The method for deduplication of optical fiber network alarm duplication data according to claim 2, further comprising:
and regularly transferring the alarm information in the general alarm format from the ActiveMQ message queue to a common message queue, and sequencing according to time and alarm types.
4. The method for deduplication of optical fiber network alarm duplication data according to claim 3, wherein data filtering and data deduplication are performed based on the storage process, and specifically includes:
and filtering out non-alarm events, network management alarms and alarm events which exist in a history storage library in the alarm events corresponding to the current alarm information based on the storage process.
5. The method for deduplicating optical network alarm duplicate data according to claim 1, wherein the analyzing the alarm event based on the storage process specifically includes:
and analyzing one or more of alarm level, alarm ID, alarm rack frame, alarm rack slot, alarm sub-slot, alarm board card, alarm port, alarm time slot, alarm link, alarm occurrence position, alarm reason and alarm description from the alarm event corresponding to the alarm message based on the storage process.
6. The method for deduplicating optical network alarm duplicate data according to claim 5, wherein the determining whether to generate a custom fault information repository according to the generation rule based on the parsing result specifically includes:
judging whether the alarm event is repeated or not based on the analysis result;
if so, judging whether the alarm is cleared according to the alarm level; if yes, ending the alarm in the database and storing the alarm in a history table; if not, determining the alarm data as the repeated alarm data, and updating the alarm recording time;
and if the fault information is not repeated and the alarm level is not cleared, generating a self-defined fault information storage.
7. The method for deduplicating optical network alarm duplicate data according to claim 6, wherein if yes, a preset storage process is called for warehousing, and alarm data and the fault information are sent to a front-end page for real-time display, specifically comprising:
if yes, calling a preset storage process to store the database, and sending alarm data and the fault information to a front-end page through a WebSocket message for real-time display.
8. An optical fiber network alarm repetition data deduplication device is characterized by comprising:
the receiving module is used for receiving the alarm message of the ActiveMQ and calling a preset storage process;
a filtering and deduplication module for performing data filtering and data deduplication based on the storage process;
the analysis module is used for analyzing the alarm event based on the storage process;
the storage module is used for judging whether to generate a self-defined fault information library or not according to the generation rule based on the analysis result;
and the sending module is used for calling a preset storage process to store the database if the fault information is in the preset storage process, and sending the alarm data and the fault information to a front-end page for real-time display.
9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for deduplicating fiber network alarm duplication data according to any one of claims 1-7 when executing the program.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements a method for deduplicating fiber optic network alarm duplication data according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110792588.9A CN114071263A (en) | 2021-07-14 | 2021-07-14 | Method and device for removing duplicate of optical fiber network alarm repeated data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110792588.9A CN114071263A (en) | 2021-07-14 | 2021-07-14 | Method and device for removing duplicate of optical fiber network alarm repeated data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114071263A true CN114071263A (en) | 2022-02-18 |
Family
ID=80233299
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110792588.9A Pending CN114071263A (en) | 2021-07-14 | 2021-07-14 | Method and device for removing duplicate of optical fiber network alarm repeated data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114071263A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102436720A (en) * | 2011-09-28 | 2012-05-02 | 清华大学 | Repeated alarm processing method based on data filtering |
| CN105450445A (en) * | 2015-11-17 | 2016-03-30 | 武汉日电光通信工业有限公司 | High-performance alarm processing system under large capacity packet transmission system and method thereof |
| CN107196804A (en) * | 2017-06-01 | 2017-09-22 | 国网山东省电力公司信息通信公司 | Power system terminal communication access network Centralized Alarm Monitoring system and method |
| CN107908530A (en) * | 2017-11-27 | 2018-04-13 | 新华三云计算技术有限公司 | A kind of alert processing method and device |
| CN108234189A (en) * | 2016-12-22 | 2018-06-29 | 北京神州泰岳软件股份有限公司 | A kind of alarm data treating method and apparatus |
| CN108833148A (en) * | 2018-06-04 | 2018-11-16 | 北京天元创新科技有限公司 | Communication network warning information processing method and system |
| CN111585785A (en) * | 2020-03-27 | 2020-08-25 | 中国平安人寿保险股份有限公司 | Method and device for shielding alarm information, computer equipment and storage medium |
| CN112311617A (en) * | 2019-08-02 | 2021-02-02 | 中国移动通信有限公司政企客户分公司 | Configured data monitoring and alarming method and system |
| CN113051308A (en) * | 2019-12-27 | 2021-06-29 | 深信服科技股份有限公司 | Alarm information processing method, equipment, storage medium and device |
-
2021
- 2021-07-14 CN CN202110792588.9A patent/CN114071263A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102436720A (en) * | 2011-09-28 | 2012-05-02 | 清华大学 | Repeated alarm processing method based on data filtering |
| CN105450445A (en) * | 2015-11-17 | 2016-03-30 | 武汉日电光通信工业有限公司 | High-performance alarm processing system under large capacity packet transmission system and method thereof |
| CN108234189A (en) * | 2016-12-22 | 2018-06-29 | 北京神州泰岳软件股份有限公司 | A kind of alarm data treating method and apparatus |
| CN107196804A (en) * | 2017-06-01 | 2017-09-22 | 国网山东省电力公司信息通信公司 | Power system terminal communication access network Centralized Alarm Monitoring system and method |
| CN107908530A (en) * | 2017-11-27 | 2018-04-13 | 新华三云计算技术有限公司 | A kind of alert processing method and device |
| CN108833148A (en) * | 2018-06-04 | 2018-11-16 | 北京天元创新科技有限公司 | Communication network warning information processing method and system |
| CN112311617A (en) * | 2019-08-02 | 2021-02-02 | 中国移动通信有限公司政企客户分公司 | Configured data monitoring and alarming method and system |
| CN113051308A (en) * | 2019-12-27 | 2021-06-29 | 深信服科技股份有限公司 | Alarm information processing method, equipment, storage medium and device |
| CN111585785A (en) * | 2020-03-27 | 2020-08-25 | 中国平安人寿保险股份有限公司 | Method and device for shielding alarm information, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110661659B (en) | Alarm method, device and system and electronic equipment | |
| CN106940677A (en) | One kind application daily record data alarm method and device | |
| CN111538563A (en) | Event analysis method and device for Kubernetes | |
| CN108989128B (en) | Fault positioning method and device based on networking structure | |
| CN112416708B (en) | Asynchronous call link monitoring method and system | |
| CN113746703A (en) | Abnormal link monitoring method, system and device | |
| CN114710368A (en) | Security event detection method and device and computer readable storage medium | |
| CN113656252B (en) | Fault positioning method, device, electronic equipment and storage medium | |
| CN111327466A (en) | Alarm analysis method, system, equipment and medium | |
| CN111427749B (en) | Monitoring tool and method for ironic service in opentack environment | |
| CN114071263A (en) | Method and device for removing duplicate of optical fiber network alarm repeated data | |
| CN112433757A (en) | Method and device for determining interface calling relationship | |
| CN111679950A (en) | Interface-level dynamic data sampling method and device | |
| CN108415994B (en) | Network management system report generation method, device and equipment | |
| CN113037578B (en) | Equipment binding port fault warning method and device | |
| CN113486237B (en) | Flight information recommendation method and system, storage medium and electronic equipment | |
| CN114760109A (en) | Numerical behavior security baseline generation method and device for security analysis | |
| CN108829563B (en) | Alarm method and alarm device | |
| CN113347045A (en) | Alarm message processing method and device | |
| CN113961547A (en) | Method and system for analyzing quality of operator configuration data | |
| CN112711517A (en) | Server performance monitoring method and device, storage medium and terminal | |
| CN110166288A (en) | A kind of alarm biography reporting method and equipment based on Kafka stream process | |
| CN113612622B (en) | Method and device for alarming each module under network operating system | |
| CN108184141B (en) | Processing method of monitoring video task and server | |
| CN114443440A (en) | Method and device for responding to process instance change data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |