Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a residual data cleaning method and a residual data cleaning system, which can improve the accuracy of screening residual data and the cleaning efficiency.
In order to achieve the above purposes, the technical scheme adopted by the invention is as follows: a residual data cleaning method comprises the following steps:
creating a form, and storing configuration data of all service data which are transmitted by a control plane and pass through a front node in the form;
acquiring a slot position and a time slot number of equipment generating an alarm through a network manager;
searching whether the equipment slot position and the time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager exist in the form, and if so, judging that the form is normal data; if not, determining the residual data, and deleting the service data corresponding to the equipment slot position and the time slot number in the equipment.
On the basis of the above scheme, the configuration data includes the slot position information of the device occupied by the service data and the slot position used time slot number.
On the basis of the scheme, whether the equipment slot position and the time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager exist in the form or not is searched, and if the equipment slot position and the time slot number exist, the normal data are judged; if the residual data does not exist, determining the residual data, specifically comprising the following steps:
the table is judged to be normal data when the equipment slot position and the time slot number which are the same as the equipment slot position and the time slot number obtained by the network manager exist and the equipment slot position and the time slot number which are related to the equipment slot position and the time slot number obtained by the network manager exist;
and when the device slot position and the time slot number which are the same as the device slot position and the time slot number obtained by the network manager do not exist in the form, or the device slot position and the time slot number which are associated with the device slot position and the time slot number obtained by the network manager do not exist, determining that the data is residual data.
On the basis of the above scheme, the device slot position and the slot time number associated with the device slot position and the slot time number acquired by the network manager are as follows: the device slot position which has physical topological connection relation with the device slot position obtained by the network manager and the time slot number of the device slot position.
On the basis of the scheme, the form is an MIB table.
The invention also provides a residual data cleaning system, which comprises the following steps:
a form creation module to: creating a form, and storing configuration data of all service data which are sent by a control plane and pass through a front node in the form;
a data processing module to: acquiring a slot position and a time slot number of equipment generating an alarm through a network manager; searching whether the equipment slot position and the time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager exist in the form, and if so, judging that the form is normal data; if not, determining the residual data, and deleting the service data corresponding to the equipment slot position and the time slot number in the equipment.
On the basis of the above scheme, the configuration data includes information of a slot position of the device occupied by the service data and a slot number used by the slot position.
On the basis of the scheme, the data processing module searches whether the form has the equipment slot position and the time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager, and if so, the form is judged to be normal data; if the residual data does not exist, determining the residual data, specifically comprising the following steps:
the table is judged to be normal data when the equipment slot position and the time slot number which are the same as the equipment slot position and the time slot number obtained by the network manager exist and the equipment slot position and the time slot number which are related to the equipment slot position and the time slot number obtained by the network manager exist;
and when the device slot position and the time slot number which are the same as the device slot position and the time slot number obtained by the network manager do not exist in the form, or the device slot position and the time slot number which are associated with the device slot position and the time slot number obtained by the network manager do not exist, determining that the data is residual data.
On the basis of the above scheme, the device slot position and the slot time number associated with the device slot position and the slot time number acquired by the network manager are as follows: the device slot position which has physical topological connection relation with the device slot position obtained by the network manager and the time slot number of the device slot position.
On the basis of the scheme, the form is an MIB table.
Compared with the prior art, the invention has the advantages that:
the method and the device take the data issued by the control plane as a reference for comparison, so that the accuracy of screening the residual data can be ensured; meanwhile, the difference comparison is carried out between the slot position and the time slot number of the equipment which is obtained by the network manager and generates the alarm and the configuration data stored in the form, the relevance of the data does not need to be further analyzed, if the data are judged to be inconsistent, the data can be directly deleted, the artificial judgment is not needed, the risk and other extra work which are possibly brought by the artificial participation are effectively reduced, and the data cleaning efficiency is improved.
Detailed Description
Embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
The embodiment of the invention provides a residual data cleaning method, which comprises the following steps:
creating a form, and storing configuration data of all service data which are sent by a control plane and pass through a front node in the form;
acquiring a slot position and a time slot number of equipment generating an alarm through a network manager;
searching whether the equipment slot position and the time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager exist in the form, and if so, judging that the form is normal data; if the data does not exist, the data is judged to be residual data, and the service data corresponding to the equipment slot position and the time slot number is deleted in the equipment. Preferably, the form is a MIB (Management Information Base) table.
As a preferred practical manner, the configuration data includes device slot information occupied by the service data and a slot number used by the slot.
As a preferred practical mode, whether the device slot position and the time slot number which are matched with the device slot position and the time slot number acquired by the network manager exist in the form or not is searched, and if the device slot position and the time slot number exist, the normal data are judged; if the residual data does not exist, determining the residual data, specifically comprising the following steps:
the table is judged to be normal data when the equipment slot position and the time slot number which are the same as the equipment slot position and the time slot number obtained by the network manager exist and the equipment slot position and the time slot number which are related to the equipment slot position and the time slot number obtained by the network manager exist;
and when the device slot position and the time slot number which are the same as the device slot position and the time slot number obtained by the network manager do not exist in the form, or the device slot position and the time slot number which are associated with the device slot position and the time slot number obtained by the network manager do not exist, determining that the data is residual data.
As a preferred practical manner, the device slot and the time slot number associated with the device slot and the time slot number obtained by the network manager are: the equipment slot position which has physical topological connection relation with the equipment slot position obtained by the network manager and the time slot number of the equipment slot position.
The following describes an implementation method of the residual data cleaning method with reference to specific embodiments.
In SPC (Soft Permanent Connection) service created by the control plane, configuration information (used device slot information and slot number used by the slot) is stored to each node that passes through according to the routing table, as shown in fig. 2, at any time, each node stores configuration information of all services that pass through the point currently, namely, a slot (slot) and a used slot (time, hereinafter referred to as ts, and ts j is the jth slot):
step 1: the control plane creates SPC1 … SPC n services, the services pass through a certain node, the configuration used by the node is stored in the form of MIB (management Information base) table, the content comprises the equipment slot (slot n) used by each service in the node and the corresponding time slot (ts n) of the slot, thus data recording is carried out according to the service route, the data has relevance, and the data analysis is conveniently carried out in sequence.
Step 2: according to the abnormal alarm provided by the control center (network management), the alarm information includes the node where the alarm is located, the equipment slot position and the slot position corresponding to the slot position (the jth slot of slot i (ts j)),
in the step1, slot i (ts j) is searched in the MIB table, wherein an external interface (namely, an object which can be searched) is mainly provided, namely, manual searching can be carried out, and searching can also be carried out by designing a script;
and step 3: if the abnormal alarm information provided by the control center is not found in the MIB table through the step 2, the configuration corresponding to the abnormal alarm is the residual configuration,
deleting the ts j configuration information in the slot i;
and 4, step 4: if the slot i (ts j) is found in the step 2, another related configuration slot a (ts b) matched with the slot is found according to the MIB, and since the MIB provides related data, the related data can be directly retrieved;
and 5: and (4) finding the slot a (ts b) in the step (4) in the slot i of the equipment, if the slot a (ts b) is in normal configuration, otherwise, the slot i (ts j) in the equipment is in residual configuration, and deleting the configuration information of the slot i (ts j) in the equipment.
The implementation of the residual data cleaning method is described below with reference to the specific topology of fig. 1.
Referring to fig. 1, since nodes are connected by optical fibers, a solid line drawn in fig. 1 is a topology diagram formed by physical connection before the nodes, a service trend must be performed according to a path shown in the topology diagram, for example, in fig. 2, a 01 slot is connected to a 1 node, a 02 slot is connected to a 3 node 01 slot, a 03 slot is connected to a 5 node, and a configuration issued by a control plane is also on a slot used by the topology, so that the issued configuration has relevance, for the node 2, the issued configuration can only be 01- >02 or 01- >03, but slots of the slot are sequentially allocated according to a specific idle slot number, for the configuration form existing in the device described in the figure 01.1- >02.1 and 01.1- >03.1, "- >" arrow left end is an inlet of the configuration (a physical slot connected to an upstream node 1), and "-" arrow right end is a configuration outlet (a physical slot connected to a downstream node), step1-Step5 described below corresponds to the above 5 steps, and because the MIB table of each node is stored in the same way, the processing way of each node is the same; (ii) a
Step 1:
part of SPC service passes through the nodes 2 and 4, and no service passes through the node 3;
step 2:
looking up node 2 slot1(ts1), slot 2(ts 1), node 3slot 1(ts1), slot 2(ts 1), node 4 slot1(ts1) at the control center, abnormal alarm is reported in slot 2(ts 1) [ note ]: slot1(ts1) is slot1, the first slot, and the like;
for the node 2 and the node 4, respectively searching whether slot1(ts1) and slot 2(ts 1) exist in the respective MIB tables;
for the node 3, whether slot1(ts1) and slot 2(ts 1) exist or not is searched in the MIB table;
and 3, step 3:
for node 2 and node 4, slot1(ts1) exists in the MIB; slot 2(ts 1) is not present in the MIB;
for node 3, slot1(ts1) and slot 2(ts 1) do not exist in the MIB, so that configurations of node 3 related to slot1(ts1) and slot 2(ts 1) are residual configurations, and configurations existing in the node 3 device are 01.1- >02.1, so that the configurations are deleted;
step 4, step 5:
for node 2 and node 4, there is slot 3(ts 1) associated with slot1(ts1) in the MIB, so the correct configuration should be 01.1- >03.1, and the configurations of node 2 and node 4, which are 01.1- >02.1 but not the associated configuration is the residual configuration, are all the residual configurations, which can be deleted.
Because the source of the data is the organization and the issuing of the control plane, the data of the equipment changes along with the change of the data issued by the control plane, and the data to be kept by the equipment can be confirmed as long as the data of the current control plane is obtained, the data issued by the control plane is taken as the reference for comparison, so that the accuracy of the data processing of the embodiment of the invention can be ensured;
the control plane issued data is changed and dynamically updated in real time based on the current state of the network, and the updated data of the control plane can be updated in real time in the MIB table, and all the issued control plane data of the node are stored in the MIB table, so that the data issued by the control plane can be rapidly and visually acquired, and the data acquisition efficiency is improved;
the data stored in the MIB table is the data directly acquired from the memory of the control plane, the data is accurate, when the data is stored, the data is associated according to the service routing information, namely the data which should be maintained by the equipment, the equipment data only needs to be compared with the difference of the data, the association of the data does not need to be further analyzed, and then whether the data needs to be deleted or not is judged;
in addition, because the data acquired by the embodiment of the invention is data of a memory of a control plane, the data does not have interaction with other modules, the inconsistency caused by data transmission and interaction is avoided, the data analysis method can also be used as reference data for positioning problems, when equipment data is unreliable, communication is abnormal or the equipment is abnormal, the data is taken as an initial point to analyze the data, and the data flow and trend are gradually combed to confirm the problem occurrence point (if whether the data of the equipment is correct or not can not be confirmed, the correct data can be acquired by the embodiment of the invention and then compared with the data on the equipment, the data acquired by the embodiment of the invention is carried out according to the trend of a service route, the correctness of each equipment data passed by the service can be searched along the route according to the service route), and the capability requirement on network maintenance personnel is greatly reduced, the delivery capacity of the product is improved;
finally, because the embodiment of the invention provides the most basic data, the embodiment of the invention can be used as a basis for extending related interfaces, developing a tool for automatically cleaning residual data, assisting in network operation and maintenance, improving network stability and reducing maintenance cost.
The embodiment of the invention also provides a residual data cleaning system, which comprises the following steps:
a form creation module to: creating a form, and storing configuration data of all service data which are sent by a control plane and pass through a front node in the form;
a data processing module to: acquiring a slot position and a time slot number of equipment generating an alarm through a network manager; searching whether the equipment slot position and the time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager exist in the form, and if so, judging that the form is normal data; if the data does not exist, the residual data is judged, and the service data corresponding to the equipment slot position and the time slot number is deleted in the equipment. Preferably, the form is a MIB table.
As a preferred embodiment, the configuration data includes device slot information occupied by the service data and a slot number used by the slot.
As a preferred embodiment, the data processing module searches whether an equipment slot position and a time slot number which are matched with the equipment slot position and the time slot number acquired by the network manager exist in the form, and if so, the form is judged to be normal data; if the residual data does not exist, determining the residual data, specifically comprising the following steps:
the table is judged to be normal data when the equipment slot position and the time slot number which are the same as the equipment slot position and the time slot number obtained by the network manager exist and the equipment slot position and the time slot number which are related to the equipment slot position and the time slot number obtained by the network manager exist;
and when the device slot position and the time slot number which are the same as the device slot position and the time slot number obtained by the network manager do not exist in the form, or the device slot position and the time slot number which are associated with the device slot position and the time slot number obtained by the network manager do not exist, determining that the data is residual data.
As a preferred embodiment, the device slot position and the slot number associated with the device slot position and the slot number acquired by the network manager are as follows: the device slot position which has physical topological connection relation with the device slot position obtained by the network manager and the time slot number of the device slot position.
Based on the same inventive concept, embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements all or part of the method steps of the residual data cleaning method.
The present invention can implement all or part of the processes in the above residual data cleaning method, and can also be implemented by instructing related hardware through a computer program, where the computer program can be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above method embodiments can be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution media, and the like. It should be noted that the computer readable medium may contain other components which may be suitably increased or decreased as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, in accordance with legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunications signals.
Based on the same inventive concept, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program running on the processor, and the processor executes the computer program to implement all or part of the method steps in the residual data cleaning method.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the processor being the control center of the computer device and the various interfaces and lines connecting the various parts of the overall computer device.
The memory may be used to store computer programs and/or modules, and the processor may implement various functions of the computer device by executing or executing the computer programs and/or modules stored in the memory, as well as by invoking data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, video data, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, server, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), servers and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.