CN111506641A - Data management method, data acquisition platform, data management system and storage medium - Google Patents
Data management method, data acquisition platform, data management system and storage medium Download PDFInfo
- Publication number
- CN111506641A CN111506641A CN202010319459.3A CN202010319459A CN111506641A CN 111506641 A CN111506641 A CN 111506641A CN 202010319459 A CN202010319459 A CN 202010319459A CN 111506641 A CN111506641 A CN 111506641A
- Authority
- CN
- China
- Prior art keywords
- data
- equipment
- network management
- different
- manufacturer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
The application provides a data management method, a data acquisition platform, a data management system and a storage medium, wherein the method is applied to the data acquisition platform, the data acquisition platform is in communication connection with different network management servers, the different network management servers are in communication connection with equipment of different manufacturers, and the method comprises the following steps: respectively acquiring data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of different network management servers; and storing the data of the equipment of different manufacturers in a database. The data acquisition platform is in communication connection with different network management servers, and the data of the equipment of different manufacturers are respectively acquired from different network management servers, so that the data of the equipment of different manufacturers can be uniformly acquired, and the data of the equipment of different manufacturers can be stored in a database, so that the data of the equipment of different manufacturers can be uniformly managed.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a data management method, a data acquisition platform, a data management system, and a storage medium.
Background
With the development of communication technology, the optical fiber communication has occupied a dominant position in each enterprise communication network, so that the variety and the number of devices in the whole network are increased, the structure of a single system becomes more and more complex, and the interconnection between the systems becomes more and more compact. This puts higher demands on the unified monitoring and system management of the entire communication network. However, in the face of the rapidly increasing communication network resources, in the face of massive and scattered data, the conventional management mode mainly based on manual work and computer forms is still used for management at present, and the logic resources are managed in an independent and complicated professional network management mode, so that the basic work of fault diagnosis and command processing is time-consuming and labor-consuming.
Disclosure of Invention
In view of this, an object of the embodiments of the present application is to provide a data management method, a data acquisition platform, a data management system, and a storage medium, so as to implement efficient management of data of devices of different manufacturers.
In a first aspect, an embodiment of the present application provides a data management method, which is applied to a data acquisition platform, where the data acquisition platform is in communication connection with different network management servers, and the different network management servers are in communication connection with devices of different manufacturers, respectively, where the method includes: respectively acquiring data of the equipment of different manufacturers based on predetermined Internet Protocol (IP) addresses and port numbers of the interconnection between the networks of different network management servers; and storing the data of the equipment of different manufacturers in a database.
In the implementation process, the data acquisition platform is in communication connection with different network management servers, and the data of the equipment of different manufacturers are respectively acquired from different network management servers, so that the data of the equipment of different manufacturers can be uniformly acquired, and the data of the equipment of different manufacturers can be stored in a database, so that the data of the equipment of different manufacturers can be uniformly managed.
In a possible design based on the first aspect, the storing the data of the devices of different manufacturers in a database includes: and storing the data of the equipment of different manufacturers into the database according to the database model corresponding to the corresponding network management server based on the predetermined database model corresponding to the different network management servers.
In the implementation process, the data of the equipment of different manufacturers is stored in the database according to the database model corresponding to the corresponding network management server, so that the data of the equipment of different manufacturers can be conveniently and quickly inquired in the follow-up process.
Based on the first aspect, in one possible design, the storing the data of the devices of different manufacturers to the database includes storing the data of the devices of different manufacturers to the database in an Extensible Markup language (XM L) format.
In the implementation described above, XM L has the capability to run between different system platforms and convert to different format target files.
Based on the first aspect, in a possible design, the data acquisition platform is communicatively connected to an integrated network management system, and the method further includes: aiming at the data of the equipment of each manufacturer, comparing the data of the equipment of the manufacturer with historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not; and when the abnormality is determined, sending prompt information representing the abnormality of the equipment of the manufacturer to the comprehensive network management system, wherein the prompt information comprises the data of the equipment of the manufacturer.
In the implementation process, when the equipment of the manufacturer is abnormal, the prompt information can be sent to the comprehensive network management system in time by the mode, wherein the prompt information comprises the data of the equipment of the manufacturer, so that the comprehensive network management system can take measures in time according to the prompt information.
Based on the first aspect, in a possible design, after sending a prompt message indicating that there is an abnormality in the device of the manufacturer to the integrated network management system, the method further includes: receiving a configuration file sent by the comprehensive network management system for reconfiguring abnormal equipment; and sending the configuration file to a network management server corresponding to the abnormal equipment so that the corresponding network management server sends the configuration file to the abnormal equipment.
In the implementation process, the configuration file can be used for automatically repairing the abnormal equipment without manually repairing the abnormal equipment, so that the cost is reduced.
Based on the first aspect, in a possible design, before the respectively acquiring data of the devices of the different manufacturers, the method further includes: receiving configuration information of a data type required to be collected, which is input by a user; the acquiring data of the devices of different manufacturers respectively based on the predetermined IP addresses and port numbers of the different network management servers includes: and respectively acquiring the data of the equipment of different manufacturers according to the configuration information based on the predetermined IP addresses and port numbers of different network management servers.
In the implementation process, only the data needing to be acquired can be acquired in the mode, the burden of increasing workload due to the acquisition of the data which is not needed is avoided, and meanwhile, the storage pressure of the database is also reduced.
In a second aspect, an embodiment of the present application provides a data acquisition platform, where the data acquisition platform is in communication connection with different network management servers, and the different network management servers are in communication connection with devices of different manufacturers, respectively, and the data acquisition platform includes: the acquisition unit is used for respectively acquiring data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of the different network management servers; and the storage unit is used for storing the data of the equipment of different manufacturers to a database.
Based on the second aspect, in a possible design, the storage unit is specifically configured to store the data of the devices of different manufacturers to the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management servers.
Based on the second aspect, in a possible design, the storage unit is further configured to store the data of the devices of different manufacturers in the XM L format to the database.
Based on the second aspect, in a possible design, the data collection platform is communicatively connected to the integrated network management system, and the collection platform further includes: the determining unit is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database according to the data of the equipment of each manufacturer to determine whether the equipment of the manufacturer is abnormal or not; and the prompting unit is used for sending prompting information for representing the abnormality of the equipment of the manufacturer to the comprehensive network management system when the abnormality is determined to exist, wherein the prompting information comprises the data of the equipment of the manufacturer.
Based on the second aspect, in a possible design, the acquisition platform further includes: a receiving unit, configured to receive a configuration file sent by the integrated network management system and used for reconfiguring an abnormal device; and the sending unit is used for sending the configuration file to the network management server corresponding to the abnormal equipment so that the corresponding network management server sends the configuration file to the abnormal equipment.
Based on the second aspect, in a possible design, the acquisition platform further includes: the device comprises a configuration information receiving unit, a data acquisition unit and a data acquisition unit, wherein the configuration information receiving unit is used for receiving configuration information of a data type required to be acquired, which is input by a user; the acquisition unit is specifically configured to acquire data of the devices of different manufacturers according to the configuration information based on predetermined IP addresses and port numbers of different network management servers.
In a third aspect, an embodiment of the present application provides a data acquisition system, where the system includes: a data acquisition platform; the data acquisition platform is in communication connection with different network management servers, and the different network management servers are in communication connection with equipment of different manufacturers respectively; the data acquisition platform is used for respectively acquiring data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of different network management servers; and storing the data of the equipment of different manufacturers in a database.
In a possible design based on the third aspect, the system further includes: the system further comprises: a comprehensive network management system; the comprehensive network management system is in communication connection with the data acquisition platform; the data acquisition platform is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database aiming at the data of the equipment of each manufacturer to determine whether the equipment of the manufacturer is abnormal or not; the data acquisition platform is used for sending prompt information for representing that the equipment of the manufacturer is abnormal to the comprehensive network management system when the abnormality is determined to exist, wherein the prompt information comprises the data of the equipment of the manufacturer; and the comprehensive network management system is used for receiving the prompt message.
In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory connected to the processor, where a computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device is caused to perform the method of the first aspect.
In a fifth aspect, embodiments of the present application provide a storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute the method of the first aspect.
Additional features and advantages of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the present application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic structural diagram of a data management system according to an embodiment of the present application.
Fig. 2 is a schematic flowchart of a data management method according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of another data management system according to an embodiment of the present application.
Fig. 4 is a schematic structural diagram of a data management platform according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Icon: 400-a data acquisition platform; 300-comprehensive network management system; 410-an acquisition unit; 420-a memory cell; 500-an electronic device; 101-a processor; 102-a memory; 103-communication interface.
Detailed Description
The technical solution in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a data management system according to an embodiment of the present application, where the system includes: a data acquisition platform 400.
The data acquisition platform 400 is in communication connection with different network management servers. And the different network management servers are respectively in communication connection with the equipment of different manufacturers. That is, for each manufacturer in different manufacturers, the device of the manufacturer is connected to one network management server, and the data of the device of the manufacturer is collected by the network management server connected to the device of the manufacturer.
Referring to fig. 2, fig. 2 is a flowchart of a data management method according to an embodiment of the present application, where the method is applied to the data acquisition platform 400 shown in fig. 1, the data acquisition platform 400 is in communication connection with different network management servers, and the different network management servers are in communication connection with devices of different manufacturers respectively. The flow shown in fig. 2 will be explained in detail below, and the method includes the steps of: s21 and S22.
S21: and respectively acquiring data of the equipment of different manufacturers based on predetermined Internet Protocol (IP) addresses and port numbers of the interconnection between the networks of the different network management servers.
S22: and storing the data of the equipment of different manufacturers in a database.
The above method is described in detail below.
As an embodiment, before step S21, the method further includes: and receiving configuration information of the data type needing to be collected, which is input by a user.
Wherein the configuration information comprises: one or more of hardware configuration data for the device, software configuration data for the device, network configuration for the device, performance data for the device, and the like.
The user may input configuration information of a data type to be acquired through an operation interface of the data acquisition platform 400, and the data acquisition platform 400 receives the configuration information after receiving an instruction representing that the user selects an input completion option.
The user may also input the configuration information through a terminal device, and send the configuration information to the data acquisition platform 400, and the data acquisition platform 400 receives the configuration information.
S21: and respectively acquiring the data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of the different network management servers.
In one embodiment, if the data collection platform 400 receives the configuration information, the data collection platform 400 is based on the predetermined IP addresses and port numbers of the different network management servers, the data acquisition platform 400 establishes communication connection with different network management servers through the interfaces corresponding to the different network management servers, then sending the configuration information to the different network management servers, so that the different network management servers can perform data acquisition on the equipment connected with the network management server based on the configuration information, the network management server sends the acquired data and the identifier of the equipment corresponding to the acquired data to the data acquisition platform 400, the data acquisition platform 400 receives the data sent by the different network management servers, and accurately determining which device the acquired data belongs to according to the identifier of the device.
As an implementation manner, if the data acquisition platform 400 does not receive the configuration information, the data acquisition platform 400 may establish a communication connection with a different network management server through an interface of the data acquisition platform 400 corresponding to the different network management server based on a predetermined IP address and port number of the different network management server, the network management server performs data acquisition on a device connected to the network management server, the network management server sends the acquired data to the data acquisition platform 400, and the data acquisition platform 400 receives the data sent by the different network management server.
As an implementation manner, the data collection platform 400 establishes communication connections with different network management servers through interfaces of the data collection platform 400 corresponding to the different network management servers based on predetermined IP addresses and port numbers of the different network management servers, and sends data collection instructions to the different network management servers based on a first preset time interval, so that the different network management servers perform data collection on devices connected to the network management servers based on the data collection instructions, the network management servers send collected data to the data collection platform 400 in real time or based on a second preset time interval, and the data collection platform 400 receives data sent by the different network management servers in real time or in an untimely manner. The first preset time interval and the second preset time interval are set according to user requirements, and are not limited herein. The shorter the first preset time interval is, the higher the data acquisition frequency is, and the shorter the second preset time interval is, the higher the data transmission frequency is.
The number of the interfaces of the data acquisition platform 400 corresponding to the different network management servers may be configured according to the requirement. The data collection platform 400 shares an Object Request Broker (ORB) interface with respect to all interfaces of the different webmaster servers. The ORB is the core of the data collection platform 400.
In the ORB environment, an application may be composed of many objects, and the functions of the application are implemented by the interaction between the objects, which is passed through the ORB. The ORB provides mechanisms for finding the correct object implementation (implementing object code or data) for a client request (where the client request may be regarded as a function call request sent by the data collection platform 400) during an interaction process, so that the client request can be accepted and a data message composing the client request can be transmitted, where the ORB determines the correct object implementation according to the name of the object to be called. The service of the ORB is transparent to the client, the client does not know where the object resides in the network, how the object communicates, how to implement and how to execute, and as long as the client holds a reference to an object, a service request can be issued to the object, enabling interoperation between distributed object applications.
The data collection platform 400 obtains the object reference of the session object through the call of getemssense of the emsssessionfactory object corresponding to the interface of the different network management servers, and obtains the object reference of each management object through the call of getManager of the session object. With the object reference of the management object, various management operations can be conveniently called, wherein each object is classified and packaged in each sub-functional block, the sub-functional blocks comprise alarm acquisition, configuration acquisition, performance acquisition and the like, and the reference of the object is the call of each functional block.
For example, the warning information of the huawei router needs to be acquired, first, the data acquisition platform needs to obtain the reference of the object of huawei through getemsssession in emsssessionfactory, and then the data acquisition platform performs data transmission with the huawei network management server through the reference of the object of huawei to obtain the warning information of the huawei router acquired by the huawei network management server.
S22: and storing the data of the equipment of different manufacturers in a database.
In an actual implementation, S22 may be implemented in such a way that the data collection platform 400 stores the data of the devices of different manufacturers into the database according to data types.
As an embodiment, S22 includes: and storing the data of the equipment of different manufacturers into the database according to the database model corresponding to the corresponding network management server based on the predetermined database model corresponding to the different network management servers.
After the data acquisition platform 400 receives the device data sent by any one network management server, the data acquisition platform 400 stores the data sent by the network management server into the database according to the corresponding database model based on the predetermined database model corresponding to the network management server.
As an implementation manner, the database model corresponding to the network management server may be determined by the data acquisition platform 400 searching and acquiring the database model corresponding to the network management server from the database models pre-stored in the database by calling a database interface (i.e., an interface through which the data acquisition platform is connected to the database).
The Data collection platform 400 may access the Database through Java Data Base Connectivity (JDBC) or Open Database Connectivity (ODBC).
When the data collection platform 400 calls the database interface, the input parameters may be converted into an Extensible Markup language (XM L) format in advance.
The data acquisition platform 400 may also obtain the corresponding database model in an XM L format.
As one embodiment, S22 includes storing data for the devices of the different vendors in XM L format to the database.
The data acquisition platform 400 converts the data of the devices of different manufacturers into the XM L format and stores the converted data in the database.
As an implementation manner, please refer to fig. 3, the system further includes: and the comprehensive network management system 300 is in communication connection with the data acquisition platform 400 through the comprehensive network management system 300.
When the system further comprises the integrated network management system 300, the method further comprises the steps of: a1 and a 2.
A1: and aiming at the data of the equipment of each manufacturer, comparing the data of the equipment of the manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not.
After the data acquisition platform 400 acquires the data of the equipment of a certain manufacturer, if the historical data of the equipment of the manufacturer is stored in the database and the data type of the historical data is the same as that of the equipment of the manufacturer, comparing the data of the equipment of the manufacturer with the historical data of the equipment of the manufacturer, if the data of the equipment of the manufacturer is different from that of the equipment of the manufacturer or the difference value is greater than a preset threshold value, determining that the equipment of the manufacturer is abnormal, otherwise, determining that the equipment of the manufacturer is normal.
The preset threshold is set according to user requirements.
The data of the equipment of the manufacturer collected at the current time are not stored in the database when the data of the equipment of the manufacturer collected at the current time are determined to be abnormal.
A2: and when determining that the abnormality exists, sending a prompt message representing that the equipment of the manufacturer exists the abnormality to the integrated network management system 300, wherein the prompt message includes data of the equipment of the manufacturer.
When it is determined that the equipment of the manufacturer is abnormal, the data acquisition platform 400 generates prompt information representing that the equipment of the manufacturer is abnormal based on the data of the equipment of the manufacturer, where the prompt information includes: the identifier of the device of the manufacturer is sent to the integrated network management system 300 based on the predetermined protocol of the integrated network management system 300, so that the integrated network management system 300 determines which device has a failure based on the identifier of the device of the manufacturer, and generates a configuration file for reconfiguring the abnormal device based on the data of the device of the manufacturer.
As an embodiment, after step a2, the method further comprises: receiving a configuration file sent by the integrated network management system 300 for reconfiguring the abnormal equipment; and sending the configuration file to a network management server corresponding to the abnormal equipment so that the corresponding network management server sends the configuration file to the abnormal equipment.
After the integrated network management system 300 generates a configuration file for reconfiguring an abnormal device, the integrated network management system 300 sends the configuration file and an identifier of the abnormal device to the data acquisition platform 400, the data acquisition platform 400 finds out an identifier of a network management server corresponding to the identifier of the abnormal device according to a predetermined correspondence between the identifier of the device and an identifier of the network management server, and sends the identifier of the abnormal device and the configuration file to the network management server corresponding to the identifier of the corresponding network management server, so that the corresponding network management server sends the configuration file to the abnormal device based on the identifier of the abnormal device.
As an embodiment, the method further comprises: the data management platform receives indication information which is sent by the comprehensive network management system 300 and indicates that the network connection with the equipment of the manufacturer needs to be established or disconnected; and responding to the indication information, and disconnecting or establishing network connection with the equipment of the manufacturer.
Referring to fig. 4, fig. 4 is a block diagram of a data acquisition platform 400 according to an embodiment of the present disclosure. The data acquisition platform 400 is in communication connection with different network management servers, the different network management servers are in communication connection with devices of different manufacturers, and the structural block diagram shown in fig. 4 will be described below, where the data acquisition platform 400 includes:
the collecting unit 410 is configured to collect data of the devices of different manufacturers respectively based on the predetermined IP addresses and port numbers of the different network management servers.
The storage unit 420 is configured to store data of the devices of different manufacturers in a database.
As an implementation manner, the storage unit 420 is specifically configured to store the data of the devices of different manufacturers in the database according to the database model corresponding to the network management server of the device of different manufacturers, based on a predetermined database model corresponding to the network management server of the device of different manufacturers.
In one embodiment, the storage unit 420 is further configured to store the data of the devices of different manufacturers in the XM L format in the database.
As an embodiment, the data collection platform 400 is communicatively connected to the integrated network management system 300, and the collection platform further includes: the determining unit is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database according to the data of the equipment of each manufacturer to determine whether the equipment of the manufacturer is abnormal or not; and a prompting unit, configured to send, to the integrated network management system 300, a prompting message indicating that the equipment of the manufacturer is abnormal when it is determined that the abnormality exists, where the prompting message includes data of the equipment of the manufacturer.
As an embodiment, the acquisition platform further comprises: a receiving unit, configured to receive a configuration file sent by the integrated network management system 300 and used for reconfiguring an abnormal device; and the sending unit is used for sending the configuration file to the network management server corresponding to the abnormal equipment so that the corresponding network management server sends the configuration file to the abnormal equipment.
As an embodiment, the acquisition platform further comprises: the device comprises a configuration information receiving unit, a data acquisition unit and a data acquisition unit, wherein the configuration information receiving unit is used for receiving configuration information of a data type required to be acquired, which is input by a user; the acquiring unit 410 is specifically configured to acquire data of the devices of different manufacturers according to the configuration information based on predetermined IP addresses and port numbers of the different network management servers.
For the process of implementing each function by each functional unit in this embodiment, please refer to the content described in the embodiments shown in fig. 1 to 3, which is not described herein again.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, where the electronic device may be a data acquisition platform 400, and the electronic device may be a Personal Computer (PC), a tablet computer, a smart phone, a Personal Digital Assistant (PDA), or the like.
The electronic device may include: a memory 102, a processor 101, a communication interface 103, and a communication bus for enabling connection communication of these components.
The Memory 102 is used for various data such as a computer program instruction corresponding to the data management method provided in the embodiment of the present application, where the Memory 102 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like.
The processor 101 is configured to execute the data management method provided by the embodiment of the present application when reading and executing the computer program instructions stored in the memory.
The processor 101 may be an integrated circuit chip having signal processing capability. The Processor 101 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed.
A communication interface 103 for receiving or transmitting data.
In addition, a storage medium is provided in an embodiment of the present application, and a computer program is stored in the storage medium, and when the computer program runs on a computer, the computer is caused to execute the method provided in any embodiment of the present application.
To sum up, the data management method, the data acquisition platform, the data management system and the storage medium provided in the embodiments of the present application are implemented by connecting the data acquisition platform to the network management servers of the devices of different manufacturers, and acquiring the data of the devices of different manufacturers from different network management servers, so as to implement uniform acquisition of the data of the devices of different manufacturers, and storing the data of the devices of different manufacturers in the database, so as to implement uniform management of the data of the devices of different manufacturers.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based devices that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
Claims (10)
1. A data management method is characterized in that the method is applied to a data acquisition platform, the data acquisition platform is in communication connection with different network management servers, the different network management servers are in communication connection with equipment of different manufacturers respectively, and the method comprises the following steps:
respectively acquiring data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of different network management servers;
and storing the data of the equipment of different manufacturers in a database.
2. The method of claim 1, wherein storing data of the devices of the different vendors to a database comprises:
and storing the data of the equipment of different manufacturers into the database according to the database model corresponding to the corresponding network management server based on the predetermined database model corresponding to the different network management servers.
3. The method of claim 1, wherein storing data of the devices of the different vendors to a database comprises:
and storing the data of the equipment of different manufacturers into the database in XM L format.
4. The method of claim 1, wherein the data collection platform is communicatively coupled to an integrated network management system, the method further comprising:
aiming at the data of the equipment of each manufacturer, comparing the data of the equipment of the manufacturer with historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not;
and when the abnormality is determined, sending prompt information representing the abnormality of the equipment of the manufacturer to the comprehensive network management system, wherein the prompt information comprises the data of the equipment of the manufacturer.
5. The method of claim 4, wherein after sending a notification message indicating that the device of the manufacturer is abnormal to the integrated network management system, the method further comprises:
receiving a configuration file sent by the comprehensive network management system for reconfiguring abnormal equipment;
and sending the configuration file to a network management server corresponding to the abnormal equipment so that the corresponding network management server sends the configuration file to the abnormal equipment.
6. The method of claim 1, wherein prior to said separately collecting data for said different vendor's equipment, said method further comprises:
receiving configuration information of a data type required to be collected, which is input by a user;
the acquiring data of the devices of different manufacturers respectively based on the predetermined IP addresses and port numbers of the different network management servers includes:
and respectively acquiring the data of the equipment of different manufacturers according to the configuration information based on the predetermined IP addresses and port numbers of different network management servers.
7. A data acquisition platform is characterized in that the data acquisition platform is in communication connection with different network management servers, the different network management servers are in communication connection with equipment of different manufacturers respectively, and the acquisition platform comprises:
the acquisition unit is used for respectively acquiring data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of the different network management servers;
and the storage unit is used for storing the data of the equipment of different manufacturers to a database.
8. A data management system, characterized in that the system comprises: a data acquisition platform; the data acquisition platform is in communication connection with different network management servers, and the different network management servers are in communication connection with equipment of different manufacturers respectively;
the data acquisition platform is used for respectively acquiring data of the equipment of different manufacturers based on the predetermined IP addresses and port numbers of different network management servers; and storing the data of the equipment of different manufacturers in a database.
9. The system of claim 8, further comprising: a comprehensive network management system; the comprehensive network management system is in communication connection with the data acquisition platform;
the data acquisition platform is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database aiming at the data of the equipment of each manufacturer to determine whether the equipment of the manufacturer is abnormal or not;
the data acquisition platform is used for sending prompt information for representing that the equipment of the manufacturer is abnormal to the comprehensive network management system when the abnormality is determined to exist, wherein the prompt information comprises the data of the equipment of the manufacturer;
and the comprehensive network management system is used for receiving the prompt message.
10. A storage medium, in which a computer program is stored which, when run on a computer, causes the computer to carry out the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010319459.3A CN111506641B (en) | 2020-04-21 | 2020-04-21 | Data management method, data acquisition platform, data management system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010319459.3A CN111506641B (en) | 2020-04-21 | 2020-04-21 | Data management method, data acquisition platform, data management system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111506641A true CN111506641A (en) | 2020-08-07 |
| CN111506641B CN111506641B (en) | 2023-07-07 |
Family
ID=71877749
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010319459.3A Active CN111506641B (en) | 2020-04-21 | 2020-04-21 | Data management method, data acquisition platform, data management system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111506641B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347198A (en) * | 2020-10-30 | 2021-02-09 | 广西电网有限责任公司南宁供电局 | Data rapid processing comparison system and method |
| CN113326294A (en) * | 2021-04-20 | 2021-08-31 | 深圳市源拓光电技术有限公司 | Optical module reliability monitoring method and device, computer equipment and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003216236A (en) * | 2002-01-24 | 2003-07-31 | Hitachi Ltd | Device for maintaining and managing plant |
| US20120278428A1 (en) * | 2011-04-29 | 2012-11-01 | Frequency Networks, Inc. | Creation and presentation of selective digital content feeds |
| CN103957127A (en) * | 2014-05-19 | 2014-07-30 | 国家电网公司 | Heterogeneous manufacturer transmission network interface adaptation method |
| CN104038371A (en) * | 2014-05-22 | 2014-09-10 | 国家电网公司 | Self-adaptive performance collecting method of power communication transmission network |
| CN105119750A (en) * | 2015-09-08 | 2015-12-02 | 南京联成科技发展有限公司 | Distributed information security operation and maintenance management platform based on massive data |
| CN106777930A (en) * | 2016-11-30 | 2017-05-31 | 南京大学 | Central network platform based on electrocardiogram unified standardization |
| US20170206255A1 (en) * | 2016-01-20 | 2017-07-20 | International Business Machines Corporation | Automating configuration of operational data pipelines for extraction, transformation and load |
| CN107370745A (en) * | 2017-08-03 | 2017-11-21 | 北京市天元网络技术股份有限公司 | One kind collection adaptation method and device |
| US20170364539A1 (en) * | 2016-06-19 | 2017-12-21 | Data.World, Inc. | Platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization |
| CN109391516A (en) * | 2017-12-29 | 2019-02-26 | 中国联合网络通信有限公司广东省分公司 | Realize the cloud third party NMS system of more producer UTN equipment centralized maintenance management |
-
2020
- 2020-04-21 CN CN202010319459.3A patent/CN111506641B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003216236A (en) * | 2002-01-24 | 2003-07-31 | Hitachi Ltd | Device for maintaining and managing plant |
| US20120278428A1 (en) * | 2011-04-29 | 2012-11-01 | Frequency Networks, Inc. | Creation and presentation of selective digital content feeds |
| CN103957127A (en) * | 2014-05-19 | 2014-07-30 | 国家电网公司 | Heterogeneous manufacturer transmission network interface adaptation method |
| CN104038371A (en) * | 2014-05-22 | 2014-09-10 | 国家电网公司 | Self-adaptive performance collecting method of power communication transmission network |
| CN105119750A (en) * | 2015-09-08 | 2015-12-02 | 南京联成科技发展有限公司 | Distributed information security operation and maintenance management platform based on massive data |
| US20170206255A1 (en) * | 2016-01-20 | 2017-07-20 | International Business Machines Corporation | Automating configuration of operational data pipelines for extraction, transformation and load |
| US20170364539A1 (en) * | 2016-06-19 | 2017-12-21 | Data.World, Inc. | Platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization |
| CN106777930A (en) * | 2016-11-30 | 2017-05-31 | 南京大学 | Central network platform based on electrocardiogram unified standardization |
| CN107370745A (en) * | 2017-08-03 | 2017-11-21 | 北京市天元网络技术股份有限公司 | One kind collection adaptation method and device |
| CN109391516A (en) * | 2017-12-29 | 2019-02-26 | 中国联合网络通信有限公司广东省分公司 | Realize the cloud third party NMS system of more producer UTN equipment centralized maintenance management |
Non-Patent Citations (1)
| Title |
|---|
| 张宇,石勇,肖文栋,许勇军: "层次式移动通信网管CIMS解决方案", 电脑开发与应用, no. 07 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112347198A (en) * | 2020-10-30 | 2021-02-09 | 广西电网有限责任公司南宁供电局 | Data rapid processing comparison system and method |
| CN113326294A (en) * | 2021-04-20 | 2021-08-31 | 深圳市源拓光电技术有限公司 | Optical module reliability monitoring method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111506641B (en) | 2023-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107704360B (en) | Monitoring data processing method, equipment, server and storage medium | |
| CN109218407B (en) | Code management and control method based on log monitoring technology and terminal equipment | |
| CN111506641B (en) | Data management method, data acquisition platform, data management system and storage medium | |
| CN112134754A (en) | Pressure testing method and device, network equipment and storage medium | |
| CN113360519A (en) | Data processing method, device, equipment and storage medium | |
| CN111586022A (en) | Firewall opening verification method, electronic device, computer equipment and storage medium | |
| CN113656252B (en) | Fault positioning method, device, electronic equipment and storage medium | |
| CN115705190A (en) | Method and device for determining dependence degree | |
| CN111444074A (en) | Data monitoring method and device, electronic equipment and readable storage medium | |
| CN115296979B (en) | Fault processing method, device, equipment and storage medium | |
| CN115378841B (en) | Method and device for detecting state of equipment accessing cloud platform, storage medium and terminal | |
| GB2583903A (en) | Testing virtualised network functions | |
| CN115442209A (en) | Fault detection method and device, electronic equipment and storage medium | |
| CN111324654A (en) | Interface calling method, system, computer device and computer readable storage medium | |
| CN112948195A (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN117251769B (en) | Abnormal data identification method, device, equipment and medium based on monitoring component | |
| CN112866008B (en) | NAT rule enabling attribute configuration method, NAT rule enabling attribute configuration device, electronic equipment and storage medium | |
| CN111464520B (en) | Data processing method and device, storage medium and electronic equipment | |
| CN114296987A (en) | Fault processing method and device, electronic equipment and computer storage medium | |
| CN117914670A (en) | Equipment information acquisition method, device and storage medium | |
| CN114048081A (en) | VPN device testing method and device, electronic device and storage medium | |
| CN116094908A (en) | Log file storage method, device, equipment and storage medium | |
| CN114461632A (en) | Multi-type data reporting and checking method and device based on rule base and storage medium | |
| CN113986661A (en) | Log output method and device, electronic equipment and storage medium | |
| CN118051432A (en) | Software testing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |