CN107147525A - Based on the method for realizing business datum recovery across station switching collection - Google Patents
Based on the method for realizing business datum recovery across station switching collection Download PDFInfo
- Publication number
- CN107147525A CN107147525A CN201710334552.XA CN201710334552A CN107147525A CN 107147525 A CN107147525 A CN 107147525A CN 201710334552 A CN201710334552 A CN 201710334552A CN 107147525 A CN107147525 A CN 107147525A
- Authority
- CN
- China
- Prior art keywords
- acquisition
- harvester
- data
- collection
- catalogue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0668—Management of faults, events, alarms or notifications using network fault recovery by dynamic selection of recovery network elements, e.g. replacement by the most appropriate element after failure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0677—Localisation of faults
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0686—Additional information in the notification, e.g. enhancement of specific meta-data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Environmental & Geological Engineering (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses based on the method for realizing business datum recovery across station switching collection, methods described generates performance data acquisition session by data collecting system, acquisition tasks are handed down to each harvester, the monitoring service of a monitoring collection mission dispatching catalogue is disposed simultaneously, the state of timing monitoring collection mission dispatching catalogue, judge harvester whether operation exception, by the acquisition tasks of abnormal harvester be switched on standby normal acquisition machine carry out.The present invention realizes the continuity of performance data collection, and then ensure that the continuity of the performance data relied on when achievement data analysis, positioning problems, failture evacuation, provide reliable, stable Data safeguard for network operations staff's analytical performance data, addressing network problems.
Description
Technical field
The present invention relates to telecommunication carrier networks performance management system technical field, and in particular to one kind is based on across station switching
The method that business datum is recovered is realized in collection.
Background technology
Evolution and network environment with telecommunication carrier networks is increasingly complicated, in order to more in real time and effective monitoring network
Network performance and variation tendency, supporting network operation, the data acquisition of network performance management system are most important.
The network environment of reality the characteristics of there is multi-vendor, Multi net voting domain, many technical fields, it is necessary to collecting performance data,
The initial data such as configuration data, supplemental characteristic, data on stock there is provided to Report, Dashboard, Instance Query,
The upper layer applications such as TroubleShooting carry out network performance problems root cause analysis and failure is solved.
Data acquisition faces the constraint of following actual conditions：
1）Data source category is varied, including network management system（EMS）On data acquisition, such as M2000, the EMS systems such as U2000
System；Flow flow datas, the flow data of various manufacturers includes sFlow, netFlow, cFlow etc.；The number of direct connecting ne MIB nodes
According to；
2）Data source is large number of, and the original data volume of each data source output is very big in the unit interval, directly results in collection section
The data volume that point is collected is huge, and the initial data for being finally aggregated into data collecting system is mass data；
3）Data source branch region is wide, and each data source and data collecting system are in different LANs, between them
Situations such as Internet network connection has unstable networks, bandwidth is limited, the transmission to initial data can have a significant impact；
4）Distal end harvester, in LAN, if exception occurs in distal end harvester, will be unable to normal with data collecting system
Gathered data, directly results in the interruption of business datum.
The website of different zones position is deployed in because different acquisition machine is distributed, when distal end harvester is delayed machine or exception
When, it is impossible to complete to recover by VCS switchings, can so lead to not normal acquisition, business datum is interrupted.
Accordingly, it would be desirable to the problem of a kind of data collecting mechanism is to solve remote cross-network network capturing service data recovery.
The content of the invention
The technical problem to be solved in the present invention is：The present invention is deployed in different geographical, data source number for carrier network
The characteristics of measuring huge, real-time property, high integrity demands is based on realizing that business datum is recovered across station switching collection there is provided one kind
Method.
The technical solution adopted in the present invention is：
Based on the method that business datum is recovered is realized across station switching collection, methods described generates performance number by data collecting system
According to acquisition tasks, acquisition tasks are handed down to each harvester, while disposing the monitoring of a monitoring collection mission dispatching catalogue
Service, the state of timing monitoring collection mission dispatching catalogue, judge harvester whether operation exception, by the collection of abnormal harvester
Task is switched on standby normal acquisition machine and carried out.
It is as follows that methods described specifically performs step：
Step 1：Data collecting system generates performance data acquisition session according to collection rule, acquisition target and attribute；
Step 2：Data collecting system according to the acquisition tasks of each harvester of distributed deployment situation coordinated allocation of each harvester,
Acquisition tasks are issued to the good mission dispatching catalogue of predefined；
Step 3：Data collecting system disposes a monitoring service, and timing scan, traversal, monitor task issue all under catalogue
The state of the harvester catalogue of grab type, and whether on time each harvester mistake is judged according to the timestamp of mission dispatching catalogue
To obtain acquisition tasks：If the timestamp time-out of mission dispatching, into step 4；If not timed out then into step 7；
Step 4：Short message and mail is sent to be notified and reminded to keeper, short message and Mail Contents it needs to be determined that；
Step 5：Whether keeper's manual confirmation harvester is genuine problematic, if the harvester is really problematic, by problem
The acquisition tasks of harvester A machines are switched on standby harvester B machines；Which acquisition tasks of problem harvester A machines are recorded simultaneously
It has been switched to B machines；
Step 6：When harvester A machines recover normal, the acquisition tasks switchback again of A harvesters will be originally belonged on B harvesters
To A harvesters；
Step 7：Each harvester, which packs the performance data files collected, to be compressed, and uploads to data acquisition by Secure File Transfer Protocol
Under the assigned catalogue of system；
Step 8：Data collecting system is detected after the performance data compressed file newly uploaded, carries out decompression and data parsing, will
File and data are stored in system index catalogue and storage, are used for other upper layer applications.
The acquisition system can dock different network management systems, and there is provided the ability of data acquisition and parsing, including performance number
According to, configuration data, supplemental characteristic, data on stock, the file of the data acquisition interface form of outputting standard enters for acquisition platform
Storehouse, the support of initial data is provided for each upper application module.
The acquisition system has carried out taking out for common component to be adapted to various network management systems to the acquisition protocols of bottom
As, provide general acquisition protocols interface in the way of common component, and the Uniform provisions working directory of all EAM bags
Structure, purposes and method, each EAM bag are arranged as required to personalizing parameters, and EAM bags are united by EAM bag management programs
One installation and deployment；During EAM bags are installed, in addition to doing the copy deployment of EAM programs, the offer of EAM bags can be also performed
SQL scripts are initialized, the initialization to EAM bag related datas is realized.
The system is held by harvester monitoring module timing monitoring collection mission dispatching catalogue by crontab timings
OK.
The collection main frame is got after acquisition tasks, is therefrom parsed script acquisition tasks, is called script acquisition tasks
Implementation sub-module is performed, and generates destination file according to task action result, is then compressed destination file, is uploaded to specific IP
The assigned catalogue of address.
The original performance file of acquisition system output is handled by data processing platform (DPP), including network element collects, the time collects, hurry
When calculate, the quality of data calculate, the performance data of each dimension is provided to upper layer application.
Beneficial effects of the present invention are：
The present invention realizes the continuity of performance data collection, and then ensure that achievement data analysis, positioning problems, failture evacuation
When the continuity of performance data that relies on, for network operations staff's analytical performance data, addressing network problems provide reliably, it is steady
Fixed Data safeguard.
Brief description of the drawings
Fig. 1 is the inventive method flow chart.
Embodiment
With reference to embodiment, the present invention is further described：
Embodiment 1：
Based on the method that business datum is recovered is realized across station switching collection, methods described generates performance number by data collecting system
According to acquisition tasks, acquisition tasks are handed down to each harvester, while disposing the monitoring of a monitoring collection mission dispatching catalogue
Service, the state of timing monitoring collection mission dispatching catalogue, judge harvester whether operation exception, by the collection of abnormal harvester
Task is switched on standby normal acquisition machine and carried out.The continuity of performance data collection is realized, and then ensure that index number
The continuity of the performance data relied on during according to analysis, positioning problems, failture evacuation, be network operations staff's analytical performance data,
Addressing network problems provide reliable, stable Data safeguard.
Embodiment 2：
As shown in figure 1, on the basis of embodiment 1, it is as follows that the present embodiment methods described specifically performs step：
Step 1：Data collecting system generates performance data acquisition session according to collection rule, acquisition target and attribute；
Step 2：Data collecting system according to the acquisition tasks of each harvester of distributed deployment situation coordinated allocation of each harvester,
Acquisition tasks are issued to the good mission dispatching catalogue of predefined；
Step 3：Data collecting system disposes a monitoring service, and timing scan, traversal, monitor task issue all under catalogue
The state of the harvester catalogue of grab type, and whether on time each harvester mistake is judged according to the timestamp of mission dispatching catalogue
To obtain acquisition tasks：If the timestamp of mission dispatching was more than 10 minutes, into step 4；If being not above 10 minutes,
Then enter step 7；
Step 4：Short message and mail is sent to be notified and reminded to keeper, short message and Mail Contents it needs to be determined that；
Step 5：Whether keeper's manual confirmation harvester is genuine problematic, if the harvester is really problematic, by problem
The acquisition tasks of harvester A machines are switched on standby harvester B machines；Which acquisition tasks of problem harvester A machines are recorded simultaneously
It has been switched to B machines；
Step 6：When harvester A machines recover normal, the acquisition tasks switchback again of A harvesters will be originally belonged on B harvesters
To A harvesters；
Step 7：Each harvester, which packs the performance data files collected, to be compressed, and uploads to data acquisition by Secure File Transfer Protocol
Under the assigned catalogue of system；
Step 8：Data collecting system is detected after the performance data compressed file newly uploaded, carries out decompression and data parsing, will
File and data are stored in system index catalogue and storage, are used for other upper layer applications.
Embodiment 3：
On the basis of embodiment 1 or 2, acquisition system described in the present embodiment can dock different network management systems, such as U2000,
M2000, I2000, N2000 etc. there is provided the ability of data acquisition and parsing, including performance data, configuration data, supplemental characteristic,
Data on stock, the file of the data acquisition interface form of outputting standard is put in storage for acquisition platform, is that each upper application module is carried
For the support of initial data.
Embodiment 4：
On the basis of embodiment 3, acquisition system described in the present embodiment is is adapted to various network management systems, to the acquisition protocols of bottom
The abstract of common component has been carried out, general acquisition protocols interface, and Uniform provisions are provided in the way of common component
Structure, purposes and the method for the working directory of all EAM bags, each EAM bag can also be arranged as required to personalizing parameters,
EAM bags pass through EAM bag management programs（EAM Admin）Carry out unified installation and deployment；During EAM bags are installed, except doing
Beyond the copy deployment of EAM programs, the initialization SQL scripts of EAM bags offer can be also provided, realized to the first of EAM bag related datas
Beginningization.
Embodiment 5：
On the basis of embodiment 4, system described in the present embodiment passes through harvester monitoring module timing monitoring collection mission dispatching
Catalogue, is performed once for every 5 minutes, is performed by crontab timings.
Crontab orders are common among Unix and class Unix operating system, for setting the finger being periodically performed
Order.The order is read from standard input device and instructed, and is deposited in " crontab " file, is read and is held for after
OK.
Embodiment 6：
Main frame is gathered on the basis of embodiment 5, described in the present embodiment to get after acquisition tasks, therefrom parses script collection
Task, calls script acquisition tasks implementation sub-module to perform, and generates destination file according to task action result, then by result
Compressing file, uploads to the assigned catalogue of particular ip address.
Embodiment 7：
On the basis of embodiment 6, the original performance file of the present embodiment acquisition system output is handled by data processing platform (DPP), is wrapped
Include that network element collects, the time collects, busy is calculated, the quality of data is calculated, on form, Dashboard, Instance Query etc.
Layer application provides the performance data of each dimension.
Embodiment is merely to illustrate the present invention, and not limitation of the present invention, about the ordinary skill of technical field
Personnel, without departing from the spirit and scope of the present invention, can also make a variety of changes and modification, therefore all equivalent
Technical scheme fall within scope of the invention, scope of patent protection of the invention should be defined by the claims.
Claims (7)
1. based on the method for realizing business datum recovery across station switching collection, it is characterised in that methods described passes through data acquisition
System generates performance data acquisition session, and acquisition tasks are handed down into each harvester, while disposing a monitoring collection task
Issue the monitoring service of catalogue, the state of timing monitoring collection mission dispatching catalogue, judge harvester whether operation exception, will be different
The acquisition tasks of normal harvester are switched on standby normal acquisition machine and carried out.
2. it is according to claim 1 based on the method for realizing business datum recovery across station switching collection, it is characterised in that institute
Stating method, specifically to perform step as follows：
Step 1：Data collecting system generates performance data acquisition session according to collection rule, acquisition target and attribute；
Step 2：Data collecting system according to the acquisition tasks of each harvester of distributed deployment situation coordinated allocation of each harvester,
Acquisition tasks are issued to the good mission dispatching catalogue of predefined；
Step 3：Data collecting system disposes a monitoring service, and timing scan, traversal, monitor task issue all under catalogue
The state of the harvester catalogue of grab type, and whether on time each harvester mistake is judged according to the timestamp of mission dispatching catalogue
To obtain acquisition tasks：If the timestamp time-out of mission dispatching, into step 4；If not timed out then into step 7；
Step 4：Short message and mail is sent to be notified and reminded to keeper, short message and Mail Contents it needs to be determined that；
Step 5：Whether keeper's manual confirmation harvester is genuine problematic, if the harvester is really problematic, by problem
The acquisition tasks of harvester A machines are switched on standby harvester B machines；Which acquisition tasks of problem harvester A machines are recorded simultaneously
It has been switched to B machines；
Step 6：When harvester A machines recover normal, the acquisition tasks switchback again of A harvesters will be originally belonged on B harvesters
To A harvesters；
Step 7：Each harvester, which packs the performance data files collected, to be compressed, and uploads to data acquisition by Secure File Transfer Protocol
Under the assigned catalogue of system；
Step 8：Data collecting system is detected after the performance data compressed file newly uploaded, carries out decompression and data parsing, will
File and data are stored in system index catalogue and storage, are used for other upper layer applications.
3. according to claim 1 or 2 based on the method that business datum is recovered is realized across station switching collection, its feature exists
Different network management systems can be docked there is provided the ability of data acquisition and parsing in, the acquisition system, including performance data, are matched somebody with somebody
Data, supplemental characteristic, data on stock are put, the file of the data acquisition interface form of outputting standard is put in storage for acquisition platform, is each
Individual upper application module provides the support of initial data.
4. it is according to claim 3 based on the method for realizing business datum recovery across station switching collection, it is characterised in that institute
Acquisition system is stated to be adapted to various network management systems, the abstract of common component has been carried out to the acquisition protocols of bottom, with common set
The mode of part provides general acquisition protocols interface, and the Uniform provisions structure of the working directory of all EAM bags, purposes and
Method, each EAM bag is arranged as required to personalizing parameters, and EAM bags carry out unified installation and deployment by EAM bags management program；
During EAM bags are installed, in addition to doing the copy deployment of EAM programs, the initialization SQL pin of EAM bags offer can be also performed
This, realizes the initialization to EAM bag related datas.
5. it is according to claim 4 based on the method for realizing business datum recovery across station switching collection, it is characterised in that institute
System is stated by harvester monitoring module timing monitoring collection mission dispatching catalogue, is performed by crontab timings.
6. it is according to claim 5 based on the method for realizing business datum recovery across station switching collection, it is characterised in that institute
State collection main frame to get after acquisition tasks, therefrom parse script acquisition tasks, call script acquisition tasks implementation sub-module
Perform, and destination file is generated according to task action result, then compress destination file, upload to specifying for particular ip address
Catalogue.
7. it is according to claim 6 based on the method for realizing business datum recovery across station switching collection, it is characterised in that to adopt
The original performance file of collecting system output is handled by data processing platform (DPP), including network element collects, the time collects, busy is calculated, number
According to Mass Calculation, the performance data of each dimension is provided to upper layer application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710334552.XA CN107147525A (en) | 2017-05-12 | 2017-05-12 | Based on the method for realizing business datum recovery across station switching collection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710334552.XA CN107147525A (en) | 2017-05-12 | 2017-05-12 | Based on the method for realizing business datum recovery across station switching collection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107147525A true CN107147525A (en) | 2017-09-08 |
Family
ID=59777388
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710334552.XA Pending CN107147525A (en) | 2017-05-12 | 2017-05-12 | Based on the method for realizing business datum recovery across station switching collection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107147525A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108009295A (en) * | 2017-12-26 | 2018-05-08 | 北京中关村科金技术有限公司 | A kind of control method of data acquisition session, device and equipment |
| CN109739549A (en) * | 2018-12-28 | 2019-05-10 | 武汉长光科技有限公司 | A kind of equipment performance acquisition method based on micro services |
| CN110109740A (en) * | 2019-05-08 | 2019-08-09 | 宜人恒业科技发展（北京）有限公司 | A kind of execution method and device of Crontab order |
| CN110611576A (en) * | 2018-06-14 | 2019-12-24 | 亿阳信通股份有限公司 | Data quality monitoring method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1115703A (en) * | 1997-06-19 | 1999-01-22 | Mitsubishi Electric Corp | Data collection method on occurrence of abnormality |
| KR100210803B1 (en) * | 1996-12-10 | 1999-07-15 | 유기범 | Method for collecting statistical data in full electronic switching system |
| CN106126346A (en) * | 2016-07-05 | 2016-11-16 | 东北大学 | A kind of large-scale distributed data collecting system and method |
-
2017
- 2017-05-12 CN CN201710334552.XA patent/CN107147525A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100210803B1 (en) * | 1996-12-10 | 1999-07-15 | 유기범 | Method for collecting statistical data in full electronic switching system |
| JPH1115703A (en) * | 1997-06-19 | 1999-01-22 | Mitsubishi Electric Corp | Data collection method on occurrence of abnormality |
| CN106126346A (en) * | 2016-07-05 | 2016-11-16 | 东北大学 | A kind of large-scale distributed data collecting system and method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108009295A (en) * | 2017-12-26 | 2018-05-08 | 北京中关村科金技术有限公司 | A kind of control method of data acquisition session, device and equipment |
| CN110611576A (en) * | 2018-06-14 | 2019-12-24 | 亿阳信通股份有限公司 | Data quality monitoring method, device, equipment and storage medium |
| CN110611576B (en) * | 2018-06-14 | 2023-05-09 | 亿阳信通股份有限公司 | Data quality monitoring method, device, equipment and storage medium |
| CN109739549A (en) * | 2018-12-28 | 2019-05-10 | 武汉长光科技有限公司 | A kind of equipment performance acquisition method based on micro services |
| CN110109740A (en) * | 2019-05-08 | 2019-08-09 | 宜人恒业科技发展（北京）有限公司 | A kind of execution method and device of Crontab order |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107147525A (en) | Based on the method for realizing business datum recovery across station switching collection | |
| Shaikh et al. | OSPF Monitoring: Architecture, Design, and Deployment Experience. | |
| US7657624B2 (en) | Network usage management system and method | |
| US9680722B2 (en) | Method for determining a severity of a network incident | |
| CN114143203B (en) | Method and system for collecting network data packet indexes of Kubernetes container based on dynamic service topology mapping | |
| CN110493348A (en) | A kind of intelligent monitoring and alarming system based on Internet of Things | |
| US10333724B2 (en) | Method and system for low-overhead latency profiling | |
| CN108600049B (en) | Method and device for measuring performance of TCP connection of data center network and storage medium | |
| CN103152352A (en) | Perfect information security and forensics monitoring method and system based on cloud computing environment | |
| CN102158360A (en) | Network fault self-diagnosis method based on causal relationship positioning of time factors | |
| EP1301864A1 (en) | Network management method and system | |
| US20120051263A1 (en) | Network System, Network Management Server, and OAM Test Method | |
| CN109428785A (en) | A kind of fault detection method and device | |
| CN112350854B (en) | Flow fault positioning method, device, equipment and storage medium | |
| CN103546305A (en) | Statistical method and system of network quality information | |
| CN104993944A (en) | Experiment scene backtracking technology device and method based on network environment and test equipment | |
| CN101267335A (en) | A method for guaranteeing successful alarm receiving/transmission in simple network management protocol | |
| CN105592485A (en) | Method for collecting and processing messages in real time based on SNMP | |
| CN114598493B (en) | Network traffic collection method | |
| WO2022270767A1 (en) | Device for generating and managing information bundle for intelligent network management system, and method of same | |
| KR100964392B1 (en) | System and method for managing network failure | |
| US8275869B2 (en) | Re-synchronizing data between network elements and network management system using partial node discovery | |
| Cisco | Cisco WAN Manager Release Notes, Release 10.5.10, Patch 2 | |
| Botta et al. | A customer service assurance platform for mobile broadband networks | |
| KR20050076406A (en) | Management system and method for network element in telecommunication management network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170908 |
|
| RJ01 | Rejection of invention patent application after publication |