CN111506641B - Data management method, data acquisition platform, data management system and storage medium - Google Patents

Data management method, data acquisition platform, data management system and storage medium Download PDF

Info

Publication number
CN111506641B
CN111506641B CN202010319459.3A CN202010319459A CN111506641B CN 111506641 B CN111506641 B CN 111506641B CN 202010319459 A CN202010319459 A CN 202010319459A CN 111506641 B CN111506641 B CN 111506641B
Authority
CN
China
Prior art keywords
data
equipment
different
network management
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010319459.3A
Other languages
Chinese (zh)
Other versions
CN111506641A (en
Inventor
林皓
曲金羽
蒙进财
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing VRV Software Corp Ltd
Original Assignee
Beijing VRV Software Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing VRV Software Corp Ltd filed Critical Beijing VRV Software Corp Ltd
Priority to CN202010319459.3A priority Critical patent/CN111506641B/en
Publication of CN111506641A publication Critical patent/CN111506641A/en
Application granted granted Critical
Publication of CN111506641B publication Critical patent/CN111506641B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/285—Clustering or classification
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30—Computing systems specially adapted for manufacturing

Abstract

The application provides a data management method, a data acquisition platform, a data management system and a storage medium, wherein the method is applied to the data acquisition platform, the data acquisition platform is in communication connection with different network management servers, the different network management servers are in communication connection with equipment of different factories, and the method comprises the following steps: based on the predetermined IP addresses and port numbers of the different network management servers, respectively acquiring data of equipment of different factories; and storing the data of the equipment of different factories into a database. The data acquisition platform is in communication connection with different webmaster servers, and data of equipment of different factories are acquired from the different webmaster servers respectively, so that unified acquisition of the data of the equipment of different factories is realized, and the data of the equipment of different factories are stored into a database, so that unified management of the data of the equipment of different factories is realized.

Description

Data management method, data acquisition platform, data management system and storage medium
Technical Field
The present application relates to the field of communications technologies, and in particular, to a data management method, a data acquisition platform, a data management system, and a storage medium.
Background
With the recent development of communication technology, optical fiber communication has taken a dominant place in various enterprise communication networks, so that the variety and number of devices in the whole network are increased, the structure of a single system is more and more complex, and the interconnection between systems is more and more compact. This places higher demands on the unified monitoring and system management of the entire communication network. However, in the face of the rapidly increased communication network resources and in the face of massive and scattered data, the traditional management mode mainly comprising manual and computer forms is still used for management at present, and the logic resources are managed in an independent and complicated professional network management mode, so that the basic work of fault diagnosis and command processing is time-consuming and labor-consuming.
Disclosure of Invention
In view of this, an object of the embodiments of the present application is to provide a data management method, a data collection platform, a data management system, and a storage medium, so as to implement efficient management of data of devices of different manufacturers.
In a first aspect, an embodiment of the present application provides a data management method, which is applied to a data acquisition platform, where the data acquisition platform is in communication connection with different network management servers, and the different network management servers are respectively in communication connection with devices of different manufacturers, and the method includes: respectively acquiring data of equipment of different factories based on a predetermined protocol (Internet Protocol, IP) address and port number of interconnection between networks of the different network management servers; and storing the data of the equipment of different factories into a database.
In the implementation process, the data acquisition platform is in communication connection with different network management servers, so that the data of the equipment of different factories are acquired from the different network management servers respectively, the unified acquisition of the data of the equipment of different factories is realized, and the data of the equipment of different factories are stored in a database, so that the unified management of the data of the equipment of different factories is realized.
Based on the first aspect, in one possible design, the storing the data of the devices of the different manufacturers into a database includes: and storing the data of the equipment of different factories into the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management server.
In the implementation process, the data of the equipment of different factories are stored in the database according to the database model corresponding to the corresponding network management server, so that the data of the equipment of different factories can be quickly queried later.
Based on the first aspect, in one possible design, the storing the data of the devices of the different manufacturers into a database includes: the data of the devices of the different vendors are stored in an extensible markup language (Extensible Markup Language, XML) format to the database.
In the implementation described above, XML has the ability to run between different system platforms and translate into different format object files.
Based on the first aspect, in one possible design, the data collection platform is communicatively connected to an integrated network management system, and the method further includes: comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not; and when the abnormality exists, sending prompt information representing the abnormality of the equipment of the manufacturer to the comprehensive network management system, wherein the prompt information comprises data of the equipment of the manufacturer.
In the implementation process, by the mode, prompt information can be timely sent to the comprehensive network management system when the equipment of the manufacturer is abnormal, wherein the prompt information comprises data of the equipment of the manufacturer, so that the comprehensive network management system can take measures in time according to the prompt information.
Based on the first aspect, in one possible design, after sending a prompt message to the integrated network management system, where the prompt message indicates that there is an abnormality in a device of the manufacturer, the method further includes: receiving a configuration file which is sent by the comprehensive network management system and is used for reconfiguring the equipment with the abnormality; and sending the configuration file to a network management server corresponding to the equipment with the abnormality, so that the corresponding network management server sends the configuration file to the equipment with the abnormality.
In the implementation process, the configuration file can be utilized to automatically repair the equipment with the abnormality, and the equipment with the abnormality is not required to be manually repaired by the equipment with the abnormality, so that the cost is reduced.
Based on the first aspect, in one possible design, before the collecting the data of the devices of the different factories, the method further includes: receiving configuration information of a data type to be acquired, which is input by a user; the step of respectively collecting the data of the devices of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers comprises the following steps: based on the predetermined IP addresses and port numbers of the different network management servers, respectively acquiring the data of the equipment of different factories according to the configuration information.
In the implementation process, only the data to be acquired can be acquired in the mode, the workload increase caused by the acquisition of unnecessary data is avoided, and meanwhile, the storage pressure of a database is reduced.
In a second aspect, an embodiment of the present application provides a data acquisition platform, the data acquisition platform is connected with different network management servers in a communication manner, the different network management servers are connected with devices of different manufacturers in a communication manner, and the acquisition platform includes: the acquisition unit is used for respectively acquiring data of equipment of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers; and the storage unit is used for storing the data of the equipment of different factories into a database.
Based on the second aspect, in one possible design, the storage unit is specifically configured to store the data of the devices of the different manufacturers to the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management server.
Based on the second aspect, in one possible design, the storage unit is further configured to store data of devices of the different manufacturers in XML format to the database.
Based on the second aspect, in one possible design, the data collection platform is in communication connection with an integrated network management system, and the collection platform further includes: the determining unit is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not; and the prompting unit is used for sending prompting information representing that the equipment of the manufacturer is abnormal to the comprehensive network management system when the abnormality exists, wherein the prompting information comprises data of the equipment of the manufacturer.
Based on the second aspect, in one possible design, the acquisition platform further includes: the receiving unit is used for receiving a configuration file which is sent by the comprehensive network management system and is used for reconfiguring the equipment with the abnormality; and the sending unit is used for sending the configuration file to the network management server corresponding to the equipment with the abnormality, so that the corresponding network management server sends the configuration file to the equipment with the abnormality.
Based on the second aspect, in one possible design, the acquisition platform further includes: the configuration information receiving unit is used for receiving configuration information of the data types needing to be collected, which is input by a user; the collection unit is specifically configured to collect data of devices of different manufacturers according to the configuration information based on the predetermined IP addresses and port numbers of the different network management servers.
In a third aspect, embodiments of the present application provide a data acquisition system, the system comprising: a data acquisition platform; the data acquisition platform is in communication connection with different network management servers, and the different network management servers are respectively in communication connection with equipment of different manufacturers; the data acquisition platform is used for respectively acquiring data of equipment of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers; and storing the data of the equipment of the different factories into a database.
Based on the third aspect, in one possible design, the system further comprises: the system further comprises: a comprehensive network management system; the comprehensive network management system is in communication connection with the data acquisition platform; the data acquisition platform is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not; the data acquisition platform is used for sending prompt information representing that the equipment of the manufacturer is abnormal to the comprehensive network management system when the abnormality exists, wherein the prompt information comprises data of the equipment of the manufacturer; the comprehensive network management system is used for receiving the prompt information.
In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory connected to the processor, where the memory stores a computer program, and when the computer program is executed by the processor, causes the electronic device to perform the method of the first aspect.
In a fifth aspect, embodiments of the present application provide a storage medium having a computer program stored therein, which when run on a computer causes the computer to perform the method of the first aspect.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the embodiments of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered limiting the scope, and that other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a data management system according to an embodiment of the present application.
Fig. 2 is a flow chart of a data management method according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of another data management system according to an embodiment of the present application.
Fig. 4 is a schematic structural diagram of a data management platform according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Icon: 400-a data acquisition platform; 300-comprehensive network management system; 410-an acquisition unit; 420-a memory unit; 500-an electronic device; a 101-processor; 102-memory; 103-communication interface.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only to distinguish the description, and are not to be construed as indicating or implying relative importance.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a data management system according to an embodiment of the present application, where the system includes: a data acquisition platform 400.
The data acquisition platform 400 is in communication connection with different network management servers. And the different network management servers are respectively in communication connection with equipment of different factories. That is, for each manufacturer in the different manufacturers, the device of the manufacturer is connected with a network management server, and the data of the device of the manufacturer is collected by the network management server connected with the device of the manufacturer.
Referring to fig. 2, fig. 2 is a flowchart of a data management method according to an embodiment of the present application, where the method is applied to the data collection platform 400 shown in fig. 1, and the data collection platform 400 is in communication connection with different network management servers, and the different network management servers are respectively in communication connection with devices of different manufacturers. The flow shown in fig. 2 will be described in detail, and the method includes the steps of: s21 and S22.
S21: and respectively acquiring data of equipment of different factories based on a predetermined protocol (Internet Protocol, IP) address and port number of interconnection between networks of the different network management servers.
S22: and storing the data of the equipment of different factories into a database.
The above method is described in detail below.
As an embodiment, before step S21, the method further includes: and receiving configuration information of the data types to be acquired, which is input by a user.
Wherein the configuration information includes: hardware configuration data for a device, software configuration data for a device, network configuration for a device, performance data for a device, etc.
The user may input configuration information of the data type to be collected through the operation interface of the data collection platform 400, and the data collection platform 400 receives the configuration information after receiving an instruction indicating that the user selects the input completion option.
The user may also input the configuration information through a terminal device and send the configuration information to the data acquisition platform 400, and the data acquisition platform 400 receives the configuration information.
S21: and respectively acquiring data of equipment of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers.
As an embodiment, if the data collection platform 400 receives the configuration information, the data collection platform 400 establishes communication connection with the different network management servers through interfaces of the data collection platform 400 corresponding to the different network management servers based on predetermined IP addresses and port numbers of the different network management servers, and then sends the configuration information to the different network management servers, so that the different network management servers perform data collection on devices connected with the network management servers based on the configuration information, the network management servers send the collected data and the identification of the device corresponding to the collected data to the data collection platform 400, and the data collection platform 400 receives the data sent by the different network management servers and accurately determines which device the collected data belongs to according to the identification of the device.
As an implementation manner, if the data collection platform 400 does not receive the configuration information, the data collection platform 400 may establish communication connection with the different network management servers through the interfaces of the data collection platform 400 corresponding to the different network management servers according to the predetermined IP addresses and port numbers of the different network management servers, the network management servers perform data collection on devices connected with the network management servers, the network management servers send the collected data to the data collection platform 400, and the data collection platform 400 receives the data sent by the different network management servers.
As an embodiment, the data collection platform 400 establishes communication connection with the different network management server through the interface of the data collection platform 400 corresponding to the different network management server based on the predetermined IP address and port number of the different network management server, and sends a data collection instruction to the different network management server based on a first preset time interval, so that the different network management server performs data collection on the device connected with the network management server based on the data collection instruction, the network management server sends the collected data to the data collection platform 400 in real time or based on a second preset time interval, and the data collection platform 400 receives the data sent by the different network management server in real time or at an untimely time. The first preset time interval and the second preset time interval are set according to user requirements, and are not limited herein. The shorter the first preset time interval is, the higher the data acquisition frequency is, and the shorter the second preset time interval is, the higher the data transmission frequency is.
The number of interfaces of the data collection platform 400 corresponding to the different network management servers can be configured according to requirements. Wherein, all interfaces of the data collection platform 400 corresponding to the different network management servers share an object request agent (Object Request Broker, ORB) interface. The ORB is the core of the data acquisition platform 400.
In an ORB environment, an application may consist of many objects, with the functions of the application being implemented by interactions between the objects, which are communicated through the ORB. The ORB provides a mechanism for finding the correct object implementation (code or data that implements the object) for the client request (where the client request may be considered as a function call request sent by the data acquisition platform 400) during the interaction process, enabling it to accept the client request and transmit the data messages that make up the client request, where the ORB determines the correct object implementation based on the name of the object to be called. The services of the ORB are transparent to the client, who does not know where in the network the object resides, how the object communicates, how it is implemented, and how it is executed, and as long as the client holds a reference to an object, a service request can be issued to the object, enabling interoperability between distributed object applications.
The data collection platform 400 obtains the object references of the session objects through the call to the getEmsSession of the emsSessionFacto object, and then obtains the object references of the management objects through the call to the getManager of the session objects. Various management operations can be conveniently invoked by the object reference of the management object, wherein each object is classified and packaged in each sub-functional block, and sub-functional blocks such as alarm acquisition, configuration acquisition, performance acquisition and the like are provided, and the reference to the object is the invocation of each functional block.
For example, alarm information collection needs to be performed on a Huacheng router, firstly, a data collection platform needs to obtain a reference of a Huacheng object through getEmsSession in emsSessionFactoy, and then the data collection platform performs data transfer with a Huacheng network management server through the obtained reference of the Huacheng object to obtain alarm information of the Huacheng router collected by the Huacheng network management server.
S22: and storing the data of the equipment of different factories into a database.
In an actual implementation process, S22 may be implemented as follows, where the data collection platform 400 stores the data of the devices of different manufacturers into the database according to the data type.
As one embodiment, S22 includes: and storing the data of the equipment of different factories into the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management server.
After receiving the data of the device sent by any one network management server, the data acquisition platform 400 stores the data sent by the network management server into the database according to the corresponding database model based on a predetermined database model corresponding to the network management server.
As an implementation manner of determining the database model corresponding to the network management server may be that the data collection platform 400 searches and obtains the database model corresponding to the network management server from the database models stored in the database in advance by calling a database interface (i.e., an interface where the data collection platform is connected to the database).
Wherein the data acquisition platform 400 may access the database through a Java database connection (Java Data Base Connectivity, JDBC) or an open database interconnect (Open Database Connectivity, ODBC).
The data collection platform 400 may convert the input parameters into an extensible markup language (Extensible Markup Language, XML) format in advance when invoking the database interface.
The data collection platform 400 may also obtain the corresponding database model in an XML format.
As one embodiment, S22 includes: and storing the data of the equipment of different factories into the database in an XML format.
The data collection platform 400 converts the data of the devices of different factories into an XML format and stores the XML format into the database.
As an embodiment, referring to fig. 3, the system further includes: the comprehensive network management system 300, the comprehensive network management system 300 is in communication connection with the data acquisition platform 400.
When the system further includes the integrated network management system 300, the method further includes the steps of: a1 and A2.
A1: and comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not.
After obtaining the data of the device of a certain manufacturer, if the historical data of the device of the manufacturer is stored in the database and the data type of the historical data is the same as the data of the device of the manufacturer, the data collection platform 400 compares the data of the device of the manufacturer with the historical data of the device of the manufacturer, and if the data of the device of the manufacturer is different from the historical data of the device of the manufacturer or the difference value is greater than a preset threshold value, it is determined that the device of the manufacturer is abnormal, otherwise, it is determined that the device of the manufacturer is normal.
The preset threshold is set according to user requirements.
When the abnormality of the equipment of the manufacturer is determined according to the data of the equipment of the manufacturer acquired at the current moment, the data of the equipment of the manufacturer acquired at the current moment is not stored in a database.
A2: and when the abnormality exists, sending prompt information representing the abnormality of the equipment of the manufacturer to the comprehensive network management system 300, wherein the prompt information comprises data of the equipment of the manufacturer.
When determining that the equipment of the manufacturer is abnormal, the data acquisition platform 400 generates prompt information representing that the equipment of the manufacturer is abnormal based on the data of the equipment of the manufacturer, wherein the prompt information comprises: the identity of the equipment of the manufacturer and the predetermined protocol of the integrated network management system 300 are used for sending the prompt message to the integrated network management system 300, so that the integrated network management system 300 determines which equipment fails based on the identity of the equipment of the manufacturer and generates a configuration file for reconfiguring the equipment with abnormality based on the data of the equipment of the manufacturer.
As an embodiment, after step A2, the method further comprises: receiving a configuration file sent by the comprehensive network management system 300 for reconfiguring the equipment with the abnormality; and sending the configuration file to a network management server corresponding to the equipment with the abnormality, so that the corresponding network management server sends the configuration file to the equipment with the abnormality.
After the integrated network management system 300 generates a configuration file for reconfiguring an abnormal device, the integrated network management system 300 sends the configuration file and an identifier of the abnormal device to the data acquisition platform 400, and the data acquisition platform 400 searches an identifier of a network management server corresponding to the identifier of the abnormal device according to a corresponding relation between a predetermined identifier of the device and an identifier of the network management server, and sends the identifier of the abnormal device and the configuration file to the network management server corresponding to the identifier of the corresponding network management server, so that the corresponding network management server sends the configuration file to the abnormal device based on the identifier of the abnormal device.
As an embodiment, the method further comprises: the data management platform receives indication information which is sent by the comprehensive network management system 300 and used for representing that network connection with equipment of a manufacturer needs to be established or disconnected; and responding to the indication information, and disconnecting or establishing network connection with equipment of the manufacturer.
Referring to fig. 4, fig. 4 is a block diagram illustrating a data acquisition platform 400 according to an embodiment of the present application. The data collection platform 400 is in communication connection with different network management servers, which are respectively in communication connection with devices of different manufacturers, and the structural block diagram shown in fig. 4 will be described below, where the data collection platform 400 includes:
and the acquisition unit 410 is configured to acquire data of devices of different manufacturers respectively based on the predetermined IP addresses and port numbers of the different network management servers.
And the storage unit 420 is used for storing the data of the devices of different factories into a database.
As an implementation manner, the storage unit 420 is specifically configured to store, based on a predetermined database model corresponding to the network management server of the device of the different manufacturer, the data of the device of the different manufacturer to the database according to the database model corresponding to the network management server of the device of the different manufacturer.
As an embodiment, the storage unit 420 is further configured to store data of devices of different manufacturers in the database in XML format.
As an embodiment, the data collection platform 400 is communicatively connected to the integrated network management system 300, and the collection platform further includes: the determining unit is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not; and the prompting unit is used for sending prompting information representing that the equipment of the manufacturer is abnormal to the comprehensive network management system 300 when the abnormality exists, wherein the prompting information comprises data of the equipment of the manufacturer.
As an embodiment, the collection platform further comprises: a receiving unit, configured to receive a configuration file sent by the integrated network management system 300 for reconfiguring a device with an exception; and the sending unit is used for sending the configuration file to the network management server corresponding to the equipment with the abnormality, so that the corresponding network management server sends the configuration file to the equipment with the abnormality.
As an embodiment, the collection platform further comprises: the configuration information receiving unit is used for receiving configuration information of the data types needing to be collected, which is input by a user; the collecting unit 410 is specifically configured to collect data of devices of different factories according to the configuration information based on the predetermined IP addresses and port numbers of the different network management servers.
For the process of implementing the respective functions by the functional units in the embodiment, please refer to the contents described in the embodiment shown in fig. 1-3, which are not described herein.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the electronic device may be a data collection platform 400, and the electronic device may be a personal computer (personal computer, PC), a tablet computer, a smart phone, a personal digital assistant (personal digital assistant, PDA), or the like.
The electronic device may include: memory 102, processor 101, communication interface 103, and a communication bus for enabling connected communication of these components.
The Memory 102 is used for various data such as computer program instructions corresponding to the data management method provided in the embodiments of the present application, where the Memory 102 may be, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read Only Memory (ROM), a programmable Read Only Memory (Programmable Read-Only Memory, PROM), an erasable Read Only Memory (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable Read Only Memory (Electric Erasable Programmable Read-Only Memory, EEPROM), and the like.
The processor 101 is configured to execute the data management method provided in the embodiment of the present application when it reads and executes the computer program instructions stored in the memory.
The processor 101 may be an integrated circuit chip with signal processing capability. The processor 101 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present application may be implemented or performed.
A communication interface 103 for receiving or transmitting data.
Furthermore, the embodiment of the present application provides a storage medium, in which a computer program is stored, which when executed on a computer, causes the computer to perform the method provided in any one of the embodiments of the present application.
In summary, according to the data management method, the data collection platform, the data management system and the storage medium provided by the embodiments of the present application, the data collection platform is in communication connection with the webmaster servers of the devices of different manufacturers, and the data of the devices of different manufacturers are obtained from the webmaster servers respectively, so that the unified collection of the data of the devices of different manufacturers is achieved, and the data of the devices of different manufacturers are stored in the database, so that the unified management of the data of the devices of different manufacturers is achieved.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners as well. The apparatus embodiments described above are merely illustrative, for example, flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based devices which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present application may be integrated together to form a single part, or each module may exist alone, or two or more modules may be integrated to form a single part.

Claims (9)

1. The data management method is characterized by being applied to a data acquisition platform, wherein the data acquisition platform is in communication connection with different network management servers, and the different network management servers are respectively in communication connection with equipment of different manufacturers, and the method comprises the following steps:
based on the predetermined IP addresses and port numbers of the different network management servers, respectively acquiring data of equipment of different factories;
storing the data of the equipment of different factories into a database;
the storing the data of the devices of different factories into a database comprises the following steps:
and storing the data of the equipment of different factories into the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management server.
2. The method of claim 1, wherein storing the data of the devices of the different vendors to a database comprises:
and storing the data of the equipment of different factories into the database in an XML format.
3. The method of claim 1, wherein the data acquisition platform is communicatively coupled to an integrated network management system, the method further comprising:
comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not;
and when the abnormality exists, sending prompt information representing the abnormality of the equipment of the manufacturer to the comprehensive network management system, wherein the prompt information comprises data of the equipment of the manufacturer.
4. The method of claim 3, wherein after sending a notification to the integrated network management system that an abnormality exists in the equipment of the manufacturer, the method further comprises:
receiving a configuration file which is sent by the comprehensive network management system and is used for reconfiguring the equipment with the abnormality;
and sending the configuration file to a network management server corresponding to the equipment with the abnormality, so that the corresponding network management server sends the configuration file to the equipment with the abnormality.
5. The method of claim 1, wherein prior to the separately collecting data for the devices of the different vendors, the method further comprises:
receiving configuration information of a data type to be acquired, which is input by a user;
the step of respectively collecting the data of the devices of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers comprises the following steps:
based on the predetermined IP addresses and port numbers of the different network management servers, respectively acquiring the data of the equipment of different factories according to the configuration information.
6. The utility model provides a data acquisition platform, its characterized in that, data acquisition platform and different network management servers communication connection, different network management servers respectively with the equipment communication connection of different producer, acquisition platform includes:
the acquisition unit is used for respectively acquiring data of equipment of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers;
the storage unit is used for storing the data of the equipment of different factories into a database;
the storing the data of the devices of different factories into a database comprises the following steps:
and storing the data of the equipment of different factories into the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management server.
7. A data management system, the system comprising: a data acquisition platform; the data acquisition platform is in communication connection with different network management servers, and the different network management servers are respectively in communication connection with equipment of different manufacturers;
the data acquisition platform is used for respectively acquiring data of equipment of different factories based on the predetermined IP addresses and port numbers of the different webmaster servers; storing the data of the equipment of different factories into a database;
the storing the data of the devices of different factories into a database comprises the following steps:
and storing the data of the equipment of different factories into the database according to the database model corresponding to the corresponding network management server based on a predetermined database model corresponding to the different network management server.
8. The system of claim 7, wherein the system further comprises: a comprehensive network management system; the comprehensive network management system is in communication connection with the data acquisition platform;
the data acquisition platform is used for comparing the data of the equipment of each manufacturer with the historical data of the equipment of the manufacturer stored in the database to determine whether the equipment of the manufacturer is abnormal or not;
the data acquisition platform is used for sending prompt information representing that the equipment of the manufacturer is abnormal to the comprehensive network management system when the abnormality exists, wherein the prompt information comprises data of the equipment of the manufacturer;
the comprehensive network management system is used for receiving the prompt information.
9. A storage medium having stored therein a computer program which, when run on a computer, causes the computer to perform the method of any of claims 1-5.
CN202010319459.3A 2020-04-21 2020-04-21 Data management method, data acquisition platform, data management system and storage medium Active CN111506641B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010319459.3A CN111506641B (en) 2020-04-21 2020-04-21 Data management method, data acquisition platform, data management system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010319459.3A CN111506641B (en) 2020-04-21 2020-04-21 Data management method, data acquisition platform, data management system and storage medium

Publications (2)

Publication Number Publication Date
CN111506641A CN111506641A (en) 2020-08-07
CN111506641B true CN111506641B (en) 2023-07-07

Family

ID=71877749

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010319459.3A Active CN111506641B (en) 2020-04-21 2020-04-21 Data management method, data acquisition platform, data management system and storage medium

Country Status (1)

Country Link
CN (1) CN111506641B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112347198A (en) * 2020-10-30 2021-02-09 广西电网有限责任公司南宁供电局 Data rapid processing comparison system and method
CN113326294A (en) * 2021-04-20 2021-08-31 深圳市源拓光电技术有限公司 Optical module reliability monitoring method and device, computer equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003216236A (en) * 2002-01-24 2003-07-31 Hitachi Ltd Device for maintaining and managing plant
CN106777930A (en) * 2016-11-30 2017-05-31 南京大学 Central network platform based on electrocardiogram unified standardization

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2011202182B1 (en) * 2011-05-11 2011-10-13 Frequency Ip Holdings, Llc Creation and presentation of selective digital content feeds
CN103957127B (en) * 2014-05-19 2017-08-01 国家电网公司 Isomery producer transport network interface adaptation method
CN104038371B (en) * 2014-05-22 2018-05-01 国家电网公司 A kind of electric power communication transmission network adaptive performance acquisition method
CN105119750B (en) * 2015-09-08 2019-04-19 南京联成科技发展股份有限公司 A kind of safe operation management platform system of distributed information based on big data
US10789264B2 (en) * 2016-01-20 2020-09-29 International Business Machines Corporation Automating configuration of operational data pipelines for extraction, transformation and load
US10452975B2 (en) * 2016-06-19 2019-10-22 Data.World, Inc. Platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization
CN107370745A (en) * 2017-08-03 2017-11-21 北京市天元网络技术股份有限公司 One kind collection adaptation method and device
CN109391516B (en) * 2017-12-29 2021-03-19 中国联合网络通信有限公司广东省分公司 Cloud third-party network management system for realizing centralized maintenance and management of multi-manufacturer UTN equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003216236A (en) * 2002-01-24 2003-07-31 Hitachi Ltd Device for maintaining and managing plant
CN106777930A (en) * 2016-11-30 2017-05-31 南京大学 Central network platform based on electrocardiogram unified standardization

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
层次式移动通信网管CIMS解决方案;张宇,石勇,肖文栋,许勇军;电脑开发与应用(第07期);全文 *

Also Published As

Publication number Publication date
CN111506641A (en) 2020-08-07

Similar Documents

Publication Publication Date Title
CN101605056B (en) J2EE server monitoring device and monitoring method employing same
CN111506641B (en) Data management method, data acquisition platform, data management system and storage medium
CN111913818A (en) Method for determining dependency relationship between services and related device
CN111447102A (en) SDN network device access method and device, computer device and storage medium
CN112134754A (en) Pressure testing method and device, network equipment and storage medium
CN114490268A (en) Full link monitoring method, device, equipment, storage medium and program product
CN114745295A (en) Data acquisition method, device, equipment and readable storage medium
CN113656252B (en) Fault positioning method, device, electronic equipment and storage medium
CN113360519A (en) Data processing method, device, equipment and storage medium
CN117176802B (en) Full-link monitoring method and device for service request, electronic equipment and medium
CN114167181B (en) Method and system for monitoring local and allopatric line fault tracing
CN113297148B (en) Method, device and equipment for collecting service log data and readable storage medium
CN113965447B (en) Online cloud diagnosis method, device, system, equipment and storage medium
KR101757259B1 (en) Integrated management system for cim based real-time data exchange
CN115705259A (en) Fault processing method, related device and storage medium
CN111324654A (en) Interface calling method, system, computer device and computer readable storage medium
CN111124542A (en) Configuration information management system
CN115145989B (en) Data sharing method and device based on data model of Internet of things
CN117251769B (en) Abnormal data identification method, device, equipment and medium based on monitoring component
CN112866008B (en) NAT rule enabling attribute configuration method, NAT rule enabling attribute configuration device, electronic equipment and storage medium
CN113055468B (en) Chip management and control method, device and system
CN111464520B (en) Data processing method and device, storage medium and electronic equipment
CN115412601A (en) Data acquisition method and device, electronic equipment and nonvolatile storage medium
CN114077527A (en) Anomaly detection method and system for bottom hardware of intelligent device
CN114386838A (en) Index configuration method and device, computer equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant