CN114745424B - Heterogeneous network-oriented multidimensional sensing data acquisition system and method - Google Patents
Heterogeneous network-oriented multidimensional sensing data acquisition system and method Download PDFInfo
- Publication number
- CN114745424B CN114745424B CN202210177758.7A CN202210177758A CN114745424B CN 114745424 B CN114745424 B CN 114745424B CN 202210177758 A CN202210177758 A CN 202210177758A CN 114745424 B CN114745424 B CN 114745424B
- Authority
- CN
- China
- Prior art keywords
- acquisition
- data
- network
- network element
- rule
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000008859 change Effects 0.000 claims abstract description 23
- 238000004458 analytical method Methods 0.000 claims abstract description 19
- 230000003993 interaction Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 38
- 238000007726 management method Methods 0.000 claims description 30
- 238000013500 data storage Methods 0.000 claims description 11
- 230000008447 perception Effects 0.000 claims description 11
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 238000010606 normalization Methods 0.000 claims description 9
- 238000013499 data model Methods 0.000 claims description 6
- 238000007405 data analysis Methods 0.000 claims description 4
- 238000013523 data management Methods 0.000 claims description 3
- 230000002688 persistence Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000002071 nanotube Substances 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/18—Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a heterogeneous network-oriented multidimensional sensing data acquisition system and a heterogeneous network-oriented multidimensional sensing data acquisition method, which belong to the technical field of networks and comprise a plurality of modules. According to the invention, the automatic sensing of network element change, the auditing of data, the comparison updating and the automatic creation of related data are realized through the network topology automatic discovery protocol and the IT system data interaction interface, so that the problem of low timeliness of manual configuration data in traditional network data acquisition is solved; the method comprises the steps of automatically incorporating an acquisition strategy according to a specific condition rule for a sensing network element to complete data acquisition, and solving the problem that the efficiency of manually creating an acquisition source, creating an acquisition source index relationship and creating an acquisition task for each network element in the traditional network data acquisition is low; scripting hot loading is provided for original result analysis, the capability of instant distribution and instant use is achieved, and the requirement of customers on agile service support readiness is perfectly met.
Description
Technical Field
The invention relates to the technical field of networks, in particular to a multidimensional sensing data acquisition system and method for heterogeneous networks.
Background
With the rapid development of cloud computing, big data and artificial intelligence, digital transformation is raised globally. Under the tide, domestic operators actively construct a new generation of operation system in a dispute layout, and aims to assist enterprises in realizing transformation and high-quality development. And under a new generation of operation system, higher requirements are put forward on cloud network fusion and cloud network operation, higher requirements are put forward on the quality of network operation data, and great challenges are generated for the existing network data maintenance means.
The basic data source approach of the existing network data acquisition method is single, and manual configuration is needed for network access/network withdrawal of each network element/acquisition source. The method has the problems of more links, large investment, low timeliness, low reliability and the like. The operation requirement of a new generation cloud network under digital transformation cannot be met rapidly. Therefore, a multidimensional sensing data acquisition system and a multidimensional sensing data acquisition method for heterogeneous networks are provided.
Disclosure of Invention
The technical problems to be solved by the invention are as follows: how to solve the problems of more manual configuration links, high investment cost, low timeliness and low reliability of traditional network data acquisition and failure to meet new requirements of cloud network operation, a multidimensional sensing data acquisition system oriented to heterogeneous networks is provided, and the system senses network changes or network element life cycle changes based on a network topology automatic discovery protocol and an IT system data interaction interface, automatically checks, compares and creates acquisition sources, realizes acquisition indexes and acquisition service association based on specific rules, and completes full-automatic acquisition of operation data (configuration, performance, alarm, log and the like) according to a scheduling strategy.
The invention solves the technical problems through the following technical proposal, which comprises the following steps:
the acquisition cluster management module is used for providing acquisition service oriented to heterogeneous networks and managing running examples based on the registration center;
the network element change perception module is used for realizing the perception and identification of network element data change based on the network topology automatic discovery protocol and the IT system data interaction interface;
the basic data management module is used for managing responsible network elements, acquisition sources, acquisition indexes and various treatment rules; the system has the capabilities of auditing, comparing and persistence of the sensing network elements and automatic creation of acquisition sources;
the acquisition management decision module is used for realizing the acquisition of network operation data of the sensing network element according to the acquisition source, the acquisition index and the acquisition service relation;
and the result analysis processing module is used for analyzing and processing the network operation data by adopting an analysis script in a hot loading mode.
Furthermore, in the acquisition cluster management module, when the acquisition service deployment is started, the information such as the network address of the acquisition service deployment is automatically sent to a registry, after the registry receives a request, the newly started acquisition service is brought into management, the registry is one of the most core basic services in a micro-service architecture, and the acquisition service is generally realized based on an open source component (such as Nacos, eureka and the like), so that the purposes of automatic sensing and quick readiness of the acquisition service are achieved.
Further, in the network element change awareness module, the network topology automatic discovery protocol mode includes SNMP, ICMP, ARP, LLDP protocol.
Furthermore, in the network element change perception module, the IT system data interface comprises a resource class data interface and a network management class data interface.
Further, in the result analysis processing module, different processing requirements are defined for each data type of each network element type, each processing defines an implementation interface of a script, the implementation content of the script is edited through a page, and the script is stored in a database after being stored; and when the data acquisition is completed, entering a result analysis processing module, wherein the module matches the processing script according to the type of the network element to which the data belongs and the data type, and after the matching is successful, acquiring script content from a database for execution, so as to complete the data processing.
The invention also provides a multidimensional sensing data acquisition method oriented to the heterogeneous network, which utilizes the multidimensional sensing data acquisition system to realize the acquisition of network operation data and comprises the following steps:
s1: based on a preset rule, identifying network element changes of a network side or an IT side, realizing auditing, comparison and updating of network element data, and sending the latest network element result data to a basic data processing module;
s2: changing a network element list, synchronously completing the creation or update of the acquisition source based on the acquisition source creation rule, and sending the latest acquisition source information to an acquisition management decision module;
s3: extracting acquisition source information, and establishing the relation among acquisition sources, acquisition indexes, acquisition services and acquisition tasks according to acquisition task execution rules; when the relation does not exist, a rule can be created through the acquisition task, the acquisition task is newly created, and the creation of the association information is completed; when the execution period is reached, the acquisition management decision module creates an acquisition task instance and issues the acquisition task instance to the acquisition cluster management module;
s4: when receiving an acquisition task execution request, performing network element connection and data acquisition according to acquisition source information, and simultaneously transmitting acquired original data to a result analysis processing module;
s5: and loading a data analysis script according to the acquired source information, finishing processing of the original data, and finishing storage, distribution and sharing of the data according to the set data processing rule.
Further, in the step S1, the preset rule is: network topology change sensing rules, IT data interface synchronization rules and network element auditing and comparison rules; the method comprises the steps of defining ports, versions, authentication information, scanning periods and scanning ranges aiming at various network topology discovery protocols through network topology change perception rules, and identifying changed network elements; defining addresses, authentication modes, interface modes and scanning periods of different IT system data synchronization interfaces through IT data interface synchronization rules, and finding out network element data changes of the IT system; the same network element judgment and comparison principle is defined through the network element auditing comparison rule, and the network element auditing comparison rule is used for judging whether the network element is already managed or not and whether the managed network element list data needs to be updated or not.
Further, in the step S2, the acquisition source is a combination of a network element and an acquisition protocol; and defining the acquisition protocol relation of different network element types and different data types through acquisition source automatic creation rules, and using the acquisition protocol relation to find the acquisition source creation of the network element.
Furthermore, in the step S2, when the network element is found, the creation of the acquisition source of the different data types and different acquisition protocols of the network element is completed according to the network element type matching acquisition source creation rule to which the network element belongs.
Still further, in said step S5, the data handling rules include data normalization, data model conversion, data storage distribution; the data normalization is used for realizing unification of network element data formats of different manufacturer models; the data model conversion is used for realizing conversion from the normalization model to the service model; data storage distribution is used to implement definitions of data storage means and storage formats.
Compared with the prior art, the invention has the following advantages: according to the heterogeneous network-oriented multidimensional sensing data acquisition system, the automatic sensing of network element change, the auditing of data, the comparison updating and the automatic creation of related data are realized through a network topology automatic discovery protocol and an IT system data interaction interface, and the problem of low timeliness of manual configuration data in traditional network data acquisition is solved; the method comprises the steps of automatically incorporating an acquisition strategy according to a specific condition rule for a sensing network element to complete data acquisition, and solving the problem that the efficiency of manually creating an acquisition source, creating an acquisition source index relationship and creating an acquisition task for each network element in the traditional network data acquisition is low; script hot loading is provided for original result analysis, the capability of instant distribution and instant use is achieved, the requirement of customers for supporting agile services is perfectly met, and the method is worthy of popularization and use.
Drawings
FIG. 1 is a block diagram of a multi-dimensional aware automatic data collection system according to a first embodiment of this invention;
FIG. 2 is a schematic diagram of an implementation flow of a multi-dimensional sensing automatic data acquisition system according to a second embodiment of the present invention;
fig. 3 is a schematic diagram of the working principle of the multi-dimensional sensing automatic data acquisition system in the third embodiment of the invention.
Detailed Description
The following describes in detail the examples of the present invention, which are implemented on the premise of the technical solution of the present invention, and detailed embodiments and specific operation procedures are given, but the scope of protection of the present invention is not limited to the following examples.
Example 1
As shown in fig. 1, this embodiment provides a technical solution: a heterogeneous network-oriented multidimensional-aware automatic data acquisition system comprising:
the acquisition cluster management module: providing acquisition service and running instance management for heterogeneous networks based on a registry;
a network element change perception module: based on the network topology automatic discovery protocol and IT system data interaction interface, realizing the rapid perception and identification of network element data change (network access/network exit);
specifically, the network topology automatic discovery protocol mode includes: SNMP, ICMP, ARP, LLDP, etc.; the IT system data interface comprises: a resource class data interface, a network management class data interface and the like;
and the basic data management module: is responsible for management of network elements, acquisition sources, acquisition indexes, various treatment rules and the like; the system comprises a sensing network element auditing capability, a comparison capability, a persistence capability and an acquisition source self-creation capability (network elements, acquisition sources, acquisition indexes and various treatment rules are all provided with system management pages, and management staff can manage the system management pages, wherein network element information defines basic information such as network element names, IP (Internet protocol), affiliated network element types and the like, the network element types are independently managed in a data dictionary mode, the acquisition sources define network element basic information and data acquisition protocol (such as snmp) information;
and the acquisition management decision module: according to the acquisition source, the acquisition index and the acquisition service relation, automatically realizing the acquisition of network operation data of the sensing network element;
the result analysis processing module: the analysis script hot loading mode analyzes and processes the network operation data, so that the instant effective effect of the instant configuration can be achieved, and various business requirements can be met rapidly.
Example two
As shown in fig. 2, in this embodiment, first, basic data configuration such as a network topology change sensing rule, an IT data interface synchronization rule, a network element auditing comparison rule, an acquisition source automatic creation rule, a task automatic creation rule, an acquisition task execution rule, etc. needs to be completed; and then realizing full-automatic acquisition capability based on rule driving.
IT should be noted that, the basic data configuration of the network topology change sensing rule, the IT data interface synchronization rule, the network element auditing comparison rule, the acquisition source automatic creation rule, the task automatic creation rule, the acquisition task execution rule and the like are all configured manually through the system management page, and the related description of each rule is as follows:
network topology change awareness rules: ports, versions, authentication information, scan periods, scan ranges (specific areas, specific IP address segments, etc.) for various types of network topology discovery protocols are defined. For discovering changes in the network, identifying changed network elements;
IT data interface synchronization rules: defining addresses, authentication modes, interface modes (active and passive), scanning periods (aiming at the active modes) and the like of data synchronous interfaces of different IT systems; network element data changes for discovering IT systems;
the network element auditing and comparing rule: defining the judgment (such as IP address) and comparison principle (such as new, modified, deleted, maintained, etc. states of the identified network elements) of the same network element; for determining whether the network element has already been managed, whether the managed network element list data needs to be updated;
the acquisition source automatically creates rules: defining the acquisition protocol relation of different network element types and different data types; the acquisition source creation is used for automatically discovering the network elements;
the task automatically creates rules: defining the relation among network element types, acquisition services and acquisition indexes; the method comprises the steps of automatically creating acquisition tasks for realizing automatic discovery of network elements;
collecting task execution rules: defining how to select a service instance to complete a collection task, such as: polling, random, fragmented, etc.
The principle of realizing full-automatic acquisition capability based on rule driving is as follows:
the acquisition source can be established based on the network topology change sensing rule, the IT data interface synchronization rule, the network element auditing comparison rule and the acquisition source self-creation rule, namely, the source of data acquisition is defined;
the system is internally provided with an acquisition index association rule, a task automatic creation rule and an acquisition task execution rule;
the collected index association rule defines the relationship of the collected index/attribute of each data type (such as configuration and performance) of each network element type; when the creation of the acquisition source is completed, automatically associating indexes to be acquired of each data type according to the type of the network element, namely defining the content which can be acquired by the data source;
the task automatic creation rule defines the collection type (single time, period), collection period and collection service of each data type (such as configuration and performance) of each network element type; when the acquisition source completes the association of the acquisition indexes, the acquisition source automatically matches with a task creation rule according to the type of the network element to which the acquisition source belongs, and the creation of the acquisition task of each data type or the acquisition source automatic nanotube of the existing acquisition task is automatically completed, namely, the data acquisition mode and period are defined; if the task is a single task, immediately acquiring data after the association is completed; if the task is a periodic task, the data acquisition is triggered regularly according to a set period.
The specific implementation process of the system is as follows:
the network element change perception module is used for identifying network element changes of a network side or an IT side based on a network topology change perception rule, an IT data interface synchronization rule and a network element auditing comparison rule, realizing automatic auditing, comparison and updating of network element data and sending the latest network element result data to the basic data processing module;
wherein:
network topology change awareness rules: defining ports, versions, authentication information, scanning periods, scanning ranges (specific areas, specific IP address segments, etc.) for various network topology discovery protocols, etc.; for discovering changes in the network, identifying changed network elements;
IT data interface synchronization rules: defining addresses, authentication modes, interface modes (active and passive), scanning periods (aiming at the active modes) and the like of data synchronous interfaces of different IT systems; for discovering network element data changes of an IT system.
The network element auditing and comparing rule: defining the judgment (such as IP address) and comparison principle (such as new, modified, deleted, maintained, etc. states of the identified network elements) of the same network element; for determining whether the network element has already been managed or not, and whether the managed network element list data needs to be updated.
The basic data processing module changes the network element list, synchronously completes the creation or update of the acquisition source based on the acquisition source creation rule, and sends the latest acquisition source information to the acquisition management decision module;
the definition of the acquisition source is the combination of the network element and the acquisition protocol;
the acquisition source automatically creates rules: defining the acquisition protocol relation of different network element types and different data types;
when the network element is found, the creation of the acquisition sources of different data types and different acquisition protocols of the network element is completed according to the network element type automatic matching acquisition source creation rule of the network element.
The acquisition management decision module is used for extracting acquisition source information and automatically establishing the relation among acquisition sources, acquisition indexes, acquisition services and acquisition tasks according to the acquisition task execution rules; when the relation does not exist, the rule can be automatically created through the acquisition task, the acquisition task is automatically newly created, and the creation of the association information is completed; when the execution period is reached, the acquisition management decision module or the acquisition task instance is automatically established and issued to the acquisition cluster management module;
the acquisition cluster management module is used for carrying out network element connection and data acquisition according to acquisition source information when receiving an acquisition task execution request, and sending acquired original data to the result analysis processing module;
and the result analysis processing module loads a data analysis script according to the acquired source information, completes processing of the original data, and completes data storage, distribution and sharing according to the set data processing rule.
The result analysis processing module defines different processing requirements for each data type (such as configuration, performance and alarm) of each network element type, each processing defines an implementation interface of a script, the implementation content of the script is edited through a page, and the script is stored in a database after being stored. And when the data acquisition is completed, a result analysis processing module is entered, the module can match the processing script according to the type of the network element to which the data belongs and the type of the data, and after the matching is successful, script content is acquired from a database for execution, so that the data processing is completed.
The data handling rules generally include: data normalization, data model conversion and data storage distribution. The data normalization realizes unification of network element data formats of different manufacturer models; the data model conversion realizes the conversion from the normalization model to the service model; data storage distribution implements definitions of data storage means (e.g., files, library tables, messages, etc.) and storage formats (e.g., csv, json, etc.).
Example III
As shown in FIG. 3, the invention is a set of complete solution system for network acquisition, and based on preset rules, the unmanned operation of the whole flow of network element discovery, data acquisition, data analysis processing and data storage sharing is truly realized. The invention applies a plurality of networks such as network topology discovery protocols (such as SNMP, ICMP, ARP, LLDP), IT interface protocols (such as rest, webservice), network acquisition protocols (such as ssh, snmp, telnet, socket, telemetry, corba) and the like, and a plurality of data transmission modes such as IT technology and file transmission protocols (such as ftp and sftp), streaming (such as flink and kafka) and the like, and has stronger network acquisition applicability (such as data network, transmission network, wireless network and the like).
In summary, in the heterogeneous network-oriented multidimensional sensing data acquisition system in the above embodiment, the network topology automatic discovery protocol and the IT system data interaction interface are used to realize automatic sensing of network element change, auditing of data, comparison updating and automatic creation of related data, so that the problem of low timeliness of manual configuration data in traditional network data acquisition is solved; the method comprises the steps of automatically incorporating an acquisition strategy according to a specific condition rule for a sensing network element to complete data acquisition, and solving the problem that the efficiency of manually creating an acquisition source, creating an acquisition source index relationship and creating an acquisition task for each network element in the traditional network data acquisition is low; script hot loading is provided for original result analysis, the capability of instant distribution and instant use is achieved, the requirement of customers for supporting agile services is perfectly met, and the method is worthy of popularization and use.
While embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the invention.
Claims (8)
1. A heterogeneous network-oriented multidimensional sensing data acquisition system, comprising:
the acquisition cluster management module is used for providing acquisition service oriented to heterogeneous networks and managing running examples based on the registration center;
the network element change perception module is used for realizing the perception and identification of network element data change based on the network topology automatic discovery protocol and the IT system data interaction interface;
the basic data management module is used for managing responsible network elements, acquisition sources, acquisition indexes and various treatment rules; the system has the capabilities of auditing, comparing and persistence of the sensing network elements and automatic creation of acquisition sources;
the acquisition management decision module is used for realizing the acquisition of network operation data of the sensing network element according to the acquisition source, the acquisition index and the acquisition service relation;
the result analysis processing module is used for analyzing and processing the network operation data by adopting an analysis script in a hot loading mode;
the multi-dimensional sensing data acquisition system is used for acquiring network operation data, and specifically comprises the following steps:
s1: based on a preset rule, identifying network element changes of a network side or an IT side, realizing auditing, comparison and updating of network element data, and sending the latest network element result data to a basic data processing module;
s2: changing a network element list, synchronously completing the creation or update of the acquisition source based on the acquisition source creation rule, and sending the latest acquisition source information to an acquisition management decision module;
s3: extracting acquisition source information, and establishing the relation among acquisition sources, acquisition indexes, acquisition services and acquisition tasks according to acquisition task execution rules; when the relation does not exist, a rule can be created through the acquisition task, the acquisition task is newly created, and the creation of the association information is completed; when the execution period is reached, the acquisition management decision module creates an acquisition task instance and issues the acquisition task instance to the acquisition cluster management module;
s4: when receiving an acquisition task execution request, performing network element connection and data acquisition according to acquisition source information, and simultaneously transmitting acquired original data to a result analysis processing module;
s5: and loading a data analysis script according to the acquired source information, finishing processing of the original data, and finishing storage, distribution and sharing of the data according to the set data processing rule.
2. The heterogeneous network-oriented multidimensional sensing data acquisition system of claim 1, wherein: in the acquisition cluster management module, when the acquisition service deployment is started, network address information of the acquisition service deployment is sent to a registration center, and after the registration center receives a request, the newly started acquisition service is brought into management; the registry is one of the basic services in the micro-service architecture, implemented based on open source components.
3. The heterogeneous network-oriented multidimensional sensing data acquisition system of claim 2, wherein: in the network element change sensing module, the network topology automatic discovery protocol mode comprises SNMP, ICMP, ARP, LLDP protocol; the IT system data interface comprises a resource class data interface and a network management class data interface.
4. A heterogeneous network-oriented multidimensional sensing data acquisition system in accordance with claim 3, wherein: in the result analysis processing module, different processing requirements are defined for each data type of each network element type, each processing defines an implementation interface of a script, the implementation content of the script is edited through a page, and the script is stored in a database after being stored; and when the data acquisition is completed, entering a result analysis processing module, wherein the module matches the processing script according to the type of the network element to which the data belongs and the data type, and after the matching is successful, acquiring script content from a database for execution, so as to complete the data processing.
5. The heterogeneous network-oriented multidimensional sensing data acquisition system as recited in claim 4, wherein: in the step S1, the preset rule is: network topology change sensing rules, IT data interface synchronization rules and network element auditing and comparison rules; the method comprises the steps of defining ports, versions, authentication information, scanning periods and scanning ranges aiming at various network topology discovery protocols through network topology change perception rules, and identifying changed network elements; defining addresses, authentication modes, interface modes and scanning periods of different IT system data synchronization interfaces through IT data interface synchronization rules, and finding out network element data changes of the IT system; the same network element judgment and comparison principle is defined through the network element auditing comparison rule, and the network element auditing comparison rule is used for judging whether the network element is already managed or not and whether the managed network element list data needs to be updated or not.
6. The heterogeneous network-oriented multidimensional sensing data acquisition system as recited in claim 5, wherein: in the step S2, the acquisition source is a combination of a network element and an acquisition protocol; and defining the acquisition protocol relation of different network element types and different data types through acquisition source automatic creation rules, and using the acquisition protocol relation to find the acquisition source creation of the network element.
7. The heterogeneous network-oriented multidimensional sensing data acquisition system of claim 6, wherein: in the step S2, when the network element is found, the creation of the acquisition sources of different data types and different acquisition protocols of the network element is completed according to the network element type matching acquisition source creation rule to which the network element belongs.
8. The heterogeneous network-oriented multidimensional sensing data acquisition system of claim 7, wherein: in the step S5, the data handling rules include data normalization, data model conversion, and data storage distribution; the data normalization is used for realizing unification of network element data formats of different manufacturer models; the data model conversion is used for realizing conversion from the normalization model to the service model; data storage distribution is used to implement definitions of data storage means and storage formats.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210177758.7A CN114745424B (en) | 2022-02-25 | 2022-02-25 | Heterogeneous network-oriented multidimensional sensing data acquisition system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210177758.7A CN114745424B (en) | 2022-02-25 | 2022-02-25 | Heterogeneous network-oriented multidimensional sensing data acquisition system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114745424A CN114745424A (en) | 2022-07-12 |
| CN114745424B true CN114745424B (en) | 2024-01-16 |
Family
ID=82275338
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210177758.7A Active CN114745424B (en) | 2022-02-25 | 2022-02-25 | Heterogeneous network-oriented multidimensional sensing data acquisition system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114745424B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115767601A (en) * | 2022-10-25 | 2023-03-07 | 中电信数智科技有限公司 | 5GC network element automatic nanotube method and device based on multidimensional data |
| CN118012697A (en) * | 2023-12-26 | 2024-05-10 | 中电信数智科技有限公司 | Cloud network IT equipment operation and maintenance data processing method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811959A (en) * | 2015-05-25 | 2015-07-29 | 中国联合网络通信有限公司成都市分公司 | Mobile network user perception analysis system and method based on big data |
| CN104915756A (en) * | 2015-05-22 | 2015-09-16 | 电信科学技术第五研究所 | Data consistency cloud auditing system and implementation method |
| CN107404400A (en) * | 2017-07-20 | 2017-11-28 | 中国电子科技集团公司第二十九研究所 | A kind of network situation awareness implementation method and device |
| CN111125450A (en) * | 2019-12-24 | 2020-05-08 | 甘肃同兴智能科技发展有限责任公司 | Management method of multilayer topology network resource object |
| CN111555915A (en) * | 2020-04-24 | 2020-08-18 | 科大国创云网科技有限公司 | Dynamic network element control system based on plug-in configuration |
-
2022
- 2022-02-25 CN CN202210177758.7A patent/CN114745424B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104915756A (en) * | 2015-05-22 | 2015-09-16 | 电信科学技术第五研究所 | Data consistency cloud auditing system and implementation method |
| CN104811959A (en) * | 2015-05-25 | 2015-07-29 | 中国联合网络通信有限公司成都市分公司 | Mobile network user perception analysis system and method based on big data |
| CN107404400A (en) * | 2017-07-20 | 2017-11-28 | 中国电子科技集团公司第二十九研究所 | A kind of network situation awareness implementation method and device |
| CN111125450A (en) * | 2019-12-24 | 2020-05-08 | 甘肃同兴智能科技发展有限责任公司 | Management method of multilayer topology network resource object |
| CN111555915A (en) * | 2020-04-24 | 2020-08-18 | 科大国创云网科技有限公司 | Dynamic network element control system based on plug-in configuration |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114745424A (en) | 2022-07-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114745424B (en) | Heterogeneous network-oriented multidimensional sensing data acquisition system and method | |
| CN109150640A (en) | A kind of method for discovering network topology and system based on double layer network agreement | |
| CN104394008B (en) | A kind of method and its system of unified configuration different type interchanger | |
| CN103546343B (en) | The network traffics methods of exhibiting of network traffic analysis system and system | |
| CN110968629A (en) | Cross-hierarchy heterogeneous data aggregation-based unified information resource management method and system | |
| US20140317313A1 (en) | Nat sub-topology management server | |
| CN101242302A (en) | Data synchronization method, device and system | |
| CN107179977B (en) | Database Full-automatic monitoring system based on mpm models | |
| CN111368166A (en) | Resource search method, resource search apparatus, and computer-readable storage medium | |
| CN107766207A (en) | Distributed automatic monitoring method, system, computer-readable recording medium and terminal device | |
| CN117194156A (en) | Unified monitoring operation and maintenance management method and system for multi-cloud platform | |
| CN114363164B (en) | Cloud network service arrangement control method, system, storage medium and electronic equipment | |
| CN115314392A (en) | Automatic network topology generation system and method based on network equipment resource discovery algorithm | |
| CN112612802A (en) | Real-time data middlebox processing method, device and platform | |
| CN110995489B (en) | Large data platform server management method, device, server and storage medium | |
| CN113824587B (en) | Multi-communication protocol equipment management method and system | |
| CN116016196B (en) | Method and system for constructing system architecture topology in real time | |
| CN102684894A (en) | Method and device for realizing northboundbound interface | |
| CN111917592A (en) | Centralized operation method and device for heterogeneous brand network equipment | |
| CN113239074B (en) | Physical port positioning method, physical port positioning device, electronic equipment and storage medium | |
| US20120136983A1 (en) | Method and System for use in Network Management of Communications Network | |
| CN114257537B (en) | Multi-dimensional priority-based network topology discovery method | |
| CN114844821A (en) | Network automatic discovery method, device, equipment and storage medium | |
| CN105743675A (en) | Method and device for acquiring information | |
| CN115081679A (en) | CDC-based industrial data dynamic change automatic perception processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |