CN114500310A - Accurate determination method for multidimensional network situation data baseline - Google Patents
Accurate determination method for multidimensional network situation data baseline Download PDFInfo
- Publication number
- CN114500310A CN114500310A CN202111592628.1A CN202111592628A CN114500310A CN 114500310 A CN114500310 A CN 114500310A CN 202111592628 A CN202111592628 A CN 202111592628A CN 114500310 A CN114500310 A CN 114500310A
- Authority
- CN
- China
- Prior art keywords
- data
- baseline
- time points
- time
- data set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a method for accurately determining a multidimensional network situation data baseline in the field of network operation and flow control, which aims at the problem of threshold difference between artificial subjective judgment and actual network flow data statistical analysis in network operation and maintenance management, firstly, the time range of a data baseline is determined, historical data in the time range is selected for cleaning and screening, time points corresponding to the cleaned and screened data are recorded at the same time, a complete data set in the time range of the data baseline is formed, the normalization processing of the complete data set is carried out on the basis to form a normalized data set, all data of the normalized data set at the same time point are solved to be an arithmetic mean value to be used as the data baseline value of the time point, the data baseline values and the time points of all the time points form a one-to-one correspondence relationship and are stored in a baseline algorithm library at the same time, a large amount of data are collected for the accuracy and the updating of the data baseline, and an accurate and quantifiable alarm judgment standard is formed, and data support is provided for accurate fault positioning and handling.
Description
Technical Field
The invention relates to the field of network operation and flow control, in particular to an accurate determination method for a multidimensional network situation data baseline.
Background
The flow monitoring and detecting equipment deployed in the current network only can aim at single node and local information, the information acquired from the network is relatively isolated, the correlation analysis and the comprehensive presentation of the multi-point information along the link are also deficient, the whole-process global monitoring of the flow cannot be realized, and a comprehensive real-time data basis cannot be provided in the aspects of quick positioning of network faults, comprehensive evaluation of network running states and the like; meanwhile, various network monitoring means are independently constructed, and resultant force is not formed. The fusion monitoring and cooperative control of the routing and the flow are not formed, and the cooperative capability of up-down linkage multi-system is not formed.
At present, the monitoring capability of network flow is limited to below kilomega, and the flow monitoring of a large-bandwidth transmission link is still blank; in addition, the monitoring equipment deployed in the current network can only aim at single node and local information, the information acquired from the network is relatively isolated, the correlation analysis and the comprehensive presentation of the multi-point information along the link are also deficient, the whole-process global monitoring of the flow can not be realized, and a comprehensive real-time data basis can not be provided in the aspects of the quick positioning of network faults, the comprehensive evaluation of the network operation state and the like; meanwhile, no unified standard which is suitable for the application characteristics of the aerospace service network is formed in the aspect of flow monitoring, and various network monitoring means are independently constructed without forming resultant force. Therefore, research on the large-bandwidth global traffic-aware monitoring technology and establishment of network traffic monitoring specifications are urgent.
Some organizations internationally propose some infrastructure for testing. For example: the Surveyor is a Network testing infrastructure based on IPPMWG standard proposed by Advanced Network & Services company in combination with other organizations, and can measure the path performance of the Internet among the organizations participating in the project; methods and tools for analyzing performance data are also presented in this project. MMI is an NSF-initiated, DARPA-sponsored project that proposes a probe-based (probe) -distributed, scalable, dynamic network testing infrastructure. Still other items such as Ripe, AMP, Pinger, etc. are related to network testing.
Disclosure of Invention
The invention aims to solve the technical problem of threshold difference between artificial subjective judgment and actual network flow data statistical analysis in network operation and maintenance management, and provides a multidimensional data baseline accurate determination method.
The technical scheme adopted by the invention is as follows:
a method for accurately determining a multidimensional network situation data baseline comprises the following steps:
s1: determining a time range of a data baseline;
s2: cleaning and screening historical data, removing abnormal data and blank data, and recording time points corresponding to the cleaned and screened data;
s3: performing a supplementing operation of corresponding time point data to form a complete data set in a data baseline time range;
s4: carrying out normalization processing on the complete data set to form a normalized data set;
s5: solving an arithmetic mean value of all data of the normalized data set at the same time point, wherein the arithmetic mean value is used as a data baseline value of the time point;
s6: forming a one-to-one corresponding relation matrix by the data base line values of all the time points and the time points, and drawing a curve in a plane coordinate system, wherein the abscissa represents the time points, and the ordinate represents the dimension values of the corresponding time points;
s7: storing the data base line into a base line algorithm library;
s8: repeating steps S1-S7 to further refine the baseline data value;
and finishing accurate determination of the multidimensional data baseline.
The advantages and innovation points of the invention relative to the prior art are as follows:
1. the method provides a concept of network situation data baseline for the first time, and applies new technologies such as data mining analysis and deep learning training to network health degree evaluation, forms a baseline model base continuously iterated and dynamically updated by carrying out multi-dimensional modeling calculation on a large amount of collected isolated original data, and provides accurate data support and judgment standards for network full-life-cycle intelligent operation and maintenance;
2. the multidimensional data baseline set provided by the invention solves the error problem existing in the threshold value of artificial subjective judgment and actual network flow data statistical analysis, improves the objectivity and scientificity of a network efficiency evaluation index system, and provides decision support for prospective management and control such as network situation prediction and health management.
Drawings
FIG. 1 is a flow chart of the present invention.
Detailed Description
The following describes in further detail a specific embodiment of the present invention with reference to fig. 1. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
The multidimensional network situation data mainly comprises: quantifiable state data, performance data, alarm data and loaded flow characteristic data (time delay, jitter, packet loss, bandwidth and disorder) can be collected in the network; through analysis and processing of multi-dimensional situation data, a data baseline set of multiple types of data is accurately determined and dynamically updated to form a data baseline model base; in the application, the time is taken as a reference, and the multi-class data base line is comprehensively applied to provide a network health degree evaluation reference for various intelligent operation and maintenance tasks.
A method for accurately determining a multidimensional network situation data baseline comprises the following steps:
s1: determining a time range of a data baseline;
s2: cleaning and screening historical data, removing abnormal data and blank data, and recording time points corresponding to the cleaned and screened data;
s3: performing a supplementing operation of corresponding time point data to form a complete data set in a data baseline time range;
s4: carrying out normalization processing on the complete data set to form a normalized data set;
s5: solving an arithmetic mean value of all data of the normalized data set at the same time point, wherein the arithmetic mean value is used as a data baseline value of the time point;
s6: forming a one-to-one correspondence relation matrix by the data base line values of all the time points and the time points, drawing a curve in a plane coordinate system, wherein the abscissa represents the time points, and the ordinate represents the dimensional values of the corresponding time points;
s7: storing the data base line into a base line algorithm library;
s8: repeating steps S1-S7 to further refine the baseline data value;
and finishing accurate determination of the multidimensional data baseline.
Claims (1)
1. A method for accurately determining a multidimensional network situation data baseline is characterized by comprising the following steps:
s1: determining a time range of a data baseline;
s2: cleaning and screening historical data, removing abnormal data and blank data, and recording time points corresponding to the cleaned and screened data;
s3: performing a supplementing operation of corresponding time point data to form a complete data set in a data baseline time range;
s4: carrying out normalization processing on the complete data set to form a normalized data set;
s5: solving an arithmetic mean value of all data of the normalized data set at the same time point, wherein the arithmetic mean value is used as a data baseline value of the time point;
s6: forming a one-to-one corresponding relation matrix by the data base line values of all the time points and the time points, and drawing a curve in a plane coordinate system, wherein the abscissa represents the time points, and the ordinate represents the dimension values of the corresponding time points;
s7: storing the data base line into a base line algorithm library;
s8: repeating steps S1-S7 to further refine the baseline data value;
and finishing the accurate determination of the multidimensional data baseline.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592628.1A CN114500310A (en) | 2021-12-23 | 2021-12-23 | Accurate determination method for multidimensional network situation data baseline |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111592628.1A CN114500310A (en) | 2021-12-23 | 2021-12-23 | Accurate determination method for multidimensional network situation data baseline |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114500310A true CN114500310A (en) | 2022-05-13 |
Family
ID=81494799
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111592628.1A Pending CN114500310A (en) | 2021-12-23 | 2021-12-23 | Accurate determination method for multidimensional network situation data baseline |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114500310A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118641124A (en) * | 2024-08-15 | 2024-09-13 | 山东雅拓集团有限公司 | Abnormal flow metering method and system for gas safety operation |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1677934A (en) * | 2004-03-31 | 2005-10-05 | 华为技术有限公司 | Method and system for monitoring network service performance |
| US7962607B1 (en) * | 2006-09-08 | 2011-06-14 | Network General Technology | Generating an operational definition of baseline for monitoring network traffic data |
| CN108111463A (en) * | 2016-11-24 | 2018-06-01 | 蓝盾信息安全技术有限公司 | The self study of various dimensions baseline and abnormal behaviour analysis based on average value and standard deviation |
| CN109167794A (en) * | 2018-09-25 | 2019-01-08 | 北京计算机技术及应用研究所 | A kind of attack detection method of network-oriented system security measure |
| CN109684310A (en) * | 2018-11-22 | 2019-04-26 | 安徽继远软件有限公司 | A kind of information system performance Situation Awareness method based on big data analysis |
| CN110134566A (en) * | 2019-04-29 | 2019-08-16 | 国网上海市电力公司 | Information system performance monitoring method under a kind of cloud environment based on label technique |
| CN113568954A (en) * | 2021-08-02 | 2021-10-29 | 湖北工业大学 | Parameter optimization method and system for network flow prediction data preprocessing stage |
-
2021
- 2021-12-23 CN CN202111592628.1A patent/CN114500310A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1677934A (en) * | 2004-03-31 | 2005-10-05 | 华为技术有限公司 | Method and system for monitoring network service performance |
| US7962607B1 (en) * | 2006-09-08 | 2011-06-14 | Network General Technology | Generating an operational definition of baseline for monitoring network traffic data |
| CN108111463A (en) * | 2016-11-24 | 2018-06-01 | 蓝盾信息安全技术有限公司 | The self study of various dimensions baseline and abnormal behaviour analysis based on average value and standard deviation |
| CN109167794A (en) * | 2018-09-25 | 2019-01-08 | 北京计算机技术及应用研究所 | A kind of attack detection method of network-oriented system security measure |
| CN109684310A (en) * | 2018-11-22 | 2019-04-26 | 安徽继远软件有限公司 | A kind of information system performance Situation Awareness method based on big data analysis |
| CN110134566A (en) * | 2019-04-29 | 2019-08-16 | 国网上海市电力公司 | Information system performance monitoring method under a kind of cloud environment based on label technique |
| CN113568954A (en) * | 2021-08-02 | 2021-10-29 | 湖北工业大学 | Parameter optimization method and system for network flow prediction data preprocessing stage |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118641124A (en) * | 2024-08-15 | 2024-09-13 | 山东雅拓集团有限公司 | Abnormal flow metering method and system for gas safety operation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108008332B (en) | New energy remote testing equipment fault diagnosis method based on data mining | |
| Aelker et al. | Managing complexity in supply chains: A discussion of current approaches on the example of the semiconductor industry | |
| WO2016122591A1 (en) | Performance testing based on variable length segmentation and clustering of time series data | |
| CN108683560A (en) | A kind of performance benchmark test system and method for high amount of traffic processing frame | |
| CN113225359A (en) | Safety flow analysis system based on brain-like calculation | |
| KR101878617B1 (en) | Method and system for processing traictory data | |
| CN111130890A (en) | Network flow dynamic prediction system | |
| CN110631849B (en) | Online identification method and system for wear state of friction system | |
| CN109062769B (en) | Method, device and equipment for predicting IT system performance risk trend | |
| US20150012255A1 (en) | Clustering based continuous performance prediction and monitoring for semiconductor manufacturing processes using nonparametric bayesian models | |
| CN115237717A (en) | Micro-service abnormity detection method and system | |
| CN115471625A (en) | Cloud robot platform big data intelligent decision method and system | |
| Becherer et al. | Intelligent choice of machine learning methods for predictive maintenance of intelligent machines | |
| Cho et al. | Discovery of resource-oriented transition systems for yield enhancement in semiconductor manufacturing | |
| CN117667585B (en) | Operation and maintenance efficiency evaluation method and system based on operation and maintenance quality management database | |
| Kim et al. | A data-driven indirect estimation of machine parameters for smart production systems | |
| CN118337654A (en) | Method, equipment and medium for monitoring industrial Internet identification analysis service | |
| CN116957361B (en) | Ship task system health state detection method based on virtual-real combination | |
| CN114500310A (en) | Accurate determination method for multidimensional network situation data baseline | |
| Sedaghat et al. | A Heuristic ETL Process to Dynamically Separate and Compress AIS Data | |
| CN117349627A (en) | Energy management and control system and management and control method for oil field | |
| CN115345256B (en) | Industrial product testing system applied to intelligent manufacturing | |
| CN110888850A (en) | Data quality detection method based on power Internet of things platform | |
| Vafadar et al. | Evaluation of the effect of product demand uncertainty on manufacturing system selection | |
| CN115297016A (en) | Deep learning-based power network activity evaluation and prediction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |