CN114564758A - Management method and system of operation and maintenance data - Google Patents
Management method and system of operation and maintenance data Download PDFInfo
- Publication number
- CN114564758A CN114564758A CN202210455694.2A CN202210455694A CN114564758A CN 114564758 A CN114564758 A CN 114564758A CN 202210455694 A CN202210455694 A CN 202210455694A CN 114564758 A CN114564758 A CN 114564758A
- Authority
- CN
- China
- Prior art keywords
- data
- maintenance
- environment
- result
- management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3058—Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/142—Network analysis or design using statistical or mathematical methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Security & Cryptography (AREA)
- Mathematical Physics (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Medical Informatics (AREA)
- Bioethics (AREA)
- Software Systems (AREA)
- Algebra (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Computer Hardware Design (AREA)
- Probability & Statistics with Applications (AREA)
- Pure & Applied Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The application discloses a management method and a system of operation and maintenance data, wherein the management system of the operation and maintenance data comprises the following steps: a plurality of servers and a management center; a server: for sending a transmission request; transmitting operation and maintenance environment data; receiving and executing an operation and maintenance data acquisition instruction, and sending the acquired operation and maintenance data to a management center; the management center: for performing the steps of: acquiring operation and maintenance environment data according to the transmission request, and analyzing the operation and maintenance environment data to obtain an operation and maintenance environment result; if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data; and processing the data to be detected to obtain standard operation and maintenance data, and storing the standard operation and maintenance data. The method and the device have the technical effects that unified management of the operation and maintenance data is facilitated, and the accuracy of the stored operation and maintenance data is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a management method and a management system for operation and maintenance data.
Background
The operation and maintenance data mainly comprises monitoring, logging, performance, configuration, flow, application operation data and the like. Except for the data formats of several processes in the unified monitoring alarm, configuration, machine log and ITIL (Information Technology Infrastructure Library), which are relevant standards, other data have the characteristics of numerous formats, unstructured performance, high real-time requirement, large data volume, complex acquisition mode and the like, and the data quality problems of incompleteness, inaccuracy and the like easily occur in the operation and maintenance data management process. In addition, all networks, systems, terminal monitoring and safety tools in the operation maintenance system are subjected to unilateral decentralized management facing equipment, and the management mode invisibly splits the safety operation work of the information system which should be integrated, so that the problems of multiple alarms, multi-party troubleshooting, large manpower waste, low failure processing efficiency and the like can be caused after a single problem occurs.
Disclosure of Invention
The application aims to provide a management method and a management system for operation and maintenance data, which have the technical effects of facilitating unified management of the operation and maintenance data and improving the accuracy of the stored operation and maintenance data.
In order to achieve the above object, the present application provides an operation and maintenance data management system, including: a plurality of servers and a management center; a server: for sending a transmission request; transmitting operation and maintenance environment data; receiving and executing an operation and maintenance data acquisition instruction, and sending the acquired operation and maintenance data to a management center; the management center: for performing the steps of: acquiring operation and maintenance environment data according to the transmission request, and analyzing the operation and maintenance environment data to obtain an operation and maintenance environment result; if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data; and processing the data to be detected to obtain standard operation and maintenance data, and storing the standard operation and maintenance data.
As above, wherein the management center includes: the device comprises a detection unit, a transmitting-receiving unit, an analysis unit, a processing unit and a storage unit; wherein the detection unit: carrying out management environment detection, and generating a management environment result, wherein the management environment result comprises: normal and abnormal; receiving operation and maintenance environment data, analyzing the operation and maintenance environment data, and obtaining operation and maintenance environment results, wherein the operation and maintenance environment results comprise: normal and abnormal; a transmitting and receiving unit: if the management environment result is normal, receiving a transmission request, and sending an operation and maintenance environment data acquisition instruction according to the transmission request; receiving operation and maintenance environment data and sending the operation and maintenance environment data to a detection unit; an analysis unit: if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data; a processing unit: processing the data to be detected and stored to obtain standard operation and maintenance data; a storage unit: the system comprises a database for storing historical management environment database and operation and maintenance standard database; and receiving standard operation and maintenance data, and storing the standard operation and maintenance data in an operation and maintenance standard database.
As above, wherein the analyzing unit comprises: an abnormality detection unit and a sorting unit; wherein the abnormality detection unit: the operation and maintenance data are classified, and the data type is determined; carrying out anomaly detection on the operation and maintenance data according to the data type to generate an anomaly detection result, wherein the anomaly detection result comprises the following steps: normal and abnormal; a finishing unit: and calling the storage template when the anomaly detection result is normal, and storing the operation and maintenance data according to the storage template to obtain the storage data to be detected.
As above, wherein the processing unit comprises: the method comprises the following steps of (1) a first detection model, a second detection model and a check model; the first detection model: and carrying out integrity detection on the to-be-detected storage data to obtain an integrity result, wherein the integrity result comprises: intact and missing; the second detection model is as follows: when the integrity result is complete, carrying out accuracy detection on the storage data to be detected to obtain an accuracy result, wherein the accuracy result comprises the following steps: the method comprises the steps of accuracy and error, and when the accuracy result is accurate, the stored data to be detected is sent to a storage unit as standard operation and maintenance data; checking the model: and when the integrity result is missing or the accuracy result is wrong, the operation and maintenance data and the storage template are obtained again, the operation and maintenance data are stored again according to the storage template, the storage data are used as new storage data to be detected, and the integrity detection is performed on the new storage data to be detected again.
The application also provides a management method of the operation and maintenance data, which comprises the following steps: acquiring operation and maintenance environment data according to the transmission request, and analyzing the operation and maintenance environment data to obtain an operation and maintenance environment result; if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data; and processing the data to be detected to obtain standard operation and maintenance data, and storing the standard operation and maintenance data.
As above, the sub-step of obtaining the operation and maintenance environment result by obtaining the operation and maintenance environment data according to the transmission request and analyzing the operation and maintenance environment data is as follows: carrying out management environment detection, and generating a management environment result, wherein the management environment result comprises: normal and abnormal; if the management environment result is normal, receiving a transmission request, and sending an operation and maintenance environment data acquisition instruction according to the transmission request; receiving operation and maintenance environment data obtained according to the operation and maintenance environment data acquisition instruction, analyzing the operation and maintenance environment data, and obtaining an operation and maintenance environment result, wherein the operation and maintenance environment result comprises: normal and abnormal.
As above, the sub-step of performing management environment detection and generating a management environment result is as follows:
acquiring management environment data, wherein the management environment data comprises: network performance data and power data;
acquiring standard historical data, processing the standard historical data, and acquiring a threshold range, wherein the threshold range comprises: a network threshold range and a power threshold range; judging the management environment data by using the threshold range, and if the management environment data falls into the threshold range, generating a management environment result as normal; and if the management environment data is out of the threshold range, generating a management environment result as an abnormal result, ending the process and giving an alarm.
As above, wherein the threshold range includes: a network threshold range and a power threshold range; the network threshold ranges include: a throughput threshold range, a delay threshold range, and a channel utilization threshold range; the power threshold ranges include: a voltage threshold range and a current threshold range; wherein the content of the first and second substances,the expression for the throughput threshold range is as follows:
(ii) a Wherein the content of the first and second substances,
is a throughput threshold range;
is a first
The throughput of the data in the past is measured,
，
the total number of historical throughputs;
the maximum throughput of the management center in normal operation.
As above, the substep of processing the operation and maintenance data to obtain the storage data to be detected is as follows: carrying out anomaly detection on the operation and maintenance data to generate an anomaly detection result, wherein the anomaly detection result is as follows: normal and abnormal; and if the abnormal detection result is normal, calling the storage template, storing the operation and maintenance data according to the storage template, and obtaining the storage data to be detected.
As above, the substeps of processing the data to be detected and stored to obtain the standard operation and maintenance data and storing the standard operation and maintenance data are as follows: and carrying out integrity detection on the to-be-detected storage data to obtain an integrity result, wherein the integrity result comprises: intact and missing; when the integrity result is complete, carrying out accuracy detection on the storage data to be detected to obtain an accuracy result, wherein the accuracy result comprises the following steps: accuracy and error; and when the accuracy result is accurate, the to-be-detected storage data is used as standard operation and maintenance data, and the standard operation and maintenance data is stored.
The method and the device have the technical effects that unified management of the operation and maintenance data is facilitated, and the accuracy of the stored operation and maintenance data is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the description below are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art according to these drawings.
FIG. 1 is a schematic diagram of an embodiment of a management system for operation and maintenance data;
fig. 2 is a flowchart of an embodiment of a method for managing operation and maintenance data.
Detailed Description
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, the present application provides an operation and maintenance data management system, including: a plurality of servers 110 and a management center 120.
The server 110: for sending a transmission request; transmitting operation and maintenance environment data; and receiving and executing an operation and maintenance data acquisition instruction, and sending the acquired operation and maintenance data to a management center.
The management center 120: for performing the steps of:
acquiring operation and maintenance environment data according to the transmission request, and analyzing the operation and maintenance environment data to obtain an operation and maintenance environment result;
if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data;
and processing the data to be detected to obtain standard operation and maintenance data, and storing the standard operation and maintenance data.
Further, the management center includes: the device comprises a detection unit, a transmitting and receiving unit, an analysis unit, a processing unit and a storage unit.
Wherein the detection unit: carrying out management environment detection, and generating a management environment result, wherein the management environment result comprises: normal and abnormal; receiving operation and maintenance environment data, analyzing the operation and maintenance environment data, and obtaining operation and maintenance environment results, wherein the operation and maintenance environment results comprise: normal and abnormal.
A transmitting and receiving unit: if the management environment result is normal, receiving a transmission request, and sending an operation and maintenance environment data acquisition instruction according to the transmission request; and receiving the operation and maintenance environment data and sending the operation and maintenance environment data to the detection unit.
An analysis unit: and if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, processing the operation and maintenance data, and obtaining the to-be-detected storage data.
A processing unit: and processing the data to be detected and stored to obtain standard operation and maintenance data.
A storage unit: the system comprises a database for storing historical management environment database and operation and maintenance standard database; and receiving standard operation and maintenance data, and storing the standard operation and maintenance data in an operation and maintenance standard database.
Further, the analysis unit includes: an abnormality detection unit and a sorting unit.
Wherein the abnormality detection unit: the operation and maintenance data are classified, and the data type is determined; and carrying out anomaly detection on the operation and maintenance data according to the data type to generate an anomaly detection result, wherein the anomaly detection result comprises the following steps: normal and abnormal.
A sorting unit: and when the anomaly detection result is normal, calling the storage template, and storing the operation and maintenance data according to the storage template to obtain the storage data to be detected.
Further, the processing unit includes: the device comprises a first detection model, a second detection model and a check model.
The first detection model: and carrying out integrity detection on the to-be-detected storage data to obtain an integrity result, wherein the integrity result comprises: intact and missing.
The second detection model is as follows: when the integrity result is complete, carrying out accuracy detection on the storage data to be detected to obtain an accuracy result, wherein the accuracy result comprises the following steps: and when the accuracy result is accurate, the stored data to be detected is sent to the storage unit as standard operation and maintenance data.
Checking the model: and when the integrity result is missing or the accuracy result is wrong, the operation and maintenance data and the storage template are obtained again, the operation and maintenance data are stored again according to the storage template, the storage data are used as new storage data to be detected, and the integrity detection is performed on the new storage data to be detected again.
As shown in fig. 2, the present application provides a management method of operation and maintenance data, including the following steps:
s210: and acquiring operation and maintenance environment data according to the transmission request, analyzing the operation and maintenance environment data, and acquiring an operation and maintenance environment result.
Further, the operation and maintenance environment data is obtained according to the transmission request, and is analyzed, and the operation and maintenance environment result is obtained through the following substeps:
s2101: carrying out management environment detection, and generating a management environment result, wherein the management environment result comprises: normal and abnormal.
Further, the sub-step of detecting the management environment and generating the management environment result is as follows:
s21011: acquiring management environment data, wherein the management environment data comprises: network performance data and power data.
Specifically, the detection unit obtains management environment data of the management center, where the management environment data includes: network performance data and power data.
Wherein the network performance data comprises at least: throughput, latency, and channel utilization. Specifically, the throughput represents the amount of data actually transmitted per unit time in the network of the management center. The delay represents the time interval in the network of the management center from when one end of the network starts sending data to when the other end of the network completely receives the data. The channel utilization is equal to the transmission delay/(transmission delay + round trip delay), for example: the length of the channel is 10km, the round-trip transmission delay is 10ms, the length of the transmission data is 2048 bits, the sending rate of the sending end is 1Mbps, and under the condition that other delays are ignored, the sending delay is as follows: 2048/(1 × 1000) =2.048 ms; the channel utilization is: 2.048/(2.048+10) = 17%.
The power data at least comprises; voltage and current.
S21012: acquiring standard historical data, processing the standard historical data, and acquiring a threshold range, wherein the threshold range comprises: a network threshold range and a power threshold range.
Specifically, the history management environment database pre-stored in the storage unit includes a plurality of history management environment data, and each history management environment data includes: historical throughput, historical delay, and historical channel utilization. And taking historical management environment data in a preset time range as standard historical data. The preset time range may be m days, where m days are m days ahead from the current operation time of the management center, for example: the current running time is 3 months and 30 days, m =20, the preset actual range is 3 months and 10 days to 20 days, namely 3 months and 30 days, and the historical management environment data in the 20 days are standard historical data.
Wherein the threshold range includes: a network threshold range and a power threshold range. The network threshold ranges include: a throughput threshold range, a delay threshold range, and a channel utilization threshold range. The power threshold ranges include: a voltage threshold range and a current threshold range.
Further, the expression of the throughput threshold range is as follows:
；
wherein the content of the first and second substances,
is a throughput threshold range;
is as follows
The throughput of the individual pieces of historical throughput,
，
is the total number of historical throughputs;
the maximum throughput of the management center in normal operation.
Further, the expression of the delay threshold range is as follows:
；
wherein the content of the first and second substances,
is a delay threshold range;
is as follows
The time delay of the history,
，
the total number of the historical time delays;
the maximum time delay of the management center in normal operation.
Further, the expression of the channel utilization threshold range is as follows:
；
wherein the content of the first and second substances,
is a channel utilization threshold range;
is as follows
The utilization of one of the historical channels,
，
the total number of the historical channel utilization rates;
the maximum channel utilization rate when the management center normally operates.
Further, the expression of the voltage threshold range is as follows:
；
wherein the content of the first and second substances,
is a voltage threshold range;
is as follows
The voltage of the current is measured according to the historical voltage,
，
the total number of the historical voltages;
the maximum voltage for normal operation of the management center.
Further, the expression of the current threshold range is as follows:
；
wherein the content of the first and second substances,
is a current threshold range;
is as follows
The current of the current in the past is measured,
，
the total number of the historical currents;
the maximum current when the management center normally operates.
S21013: judging the management environment data by using the threshold range, and if the management environment data falls into the threshold range, generating a management environment result as normal; and if the management environment data is out of the threshold range, generating a management environment result as an abnormal result, ending the process and giving an alarm.
Specifically, the management environment data is judged by using a threshold range, and if the throughput falls within the threshold range of the throughput, the throughput is normal; if the time delay is within the time delay threshold range, indicating that the time delay is normal; if the channel utilization rate is within the threshold range of the channel utilization rate, the channel utilization rate is normal; if the voltage falls within the voltage threshold range, indicating that the voltage is normal; if the current falls within the current threshold range, the current is normal. If the throughput is out of the threshold range of the throughput, indicating that the throughput is abnormal; if the time delay is out of the time delay threshold range, indicating that the time delay is abnormal; if the channel utilization rate falls outside the threshold range of the channel utilization rate, the channel utilization rate is abnormal; if the voltage falls outside the voltage threshold range, indicating that the voltage is abnormal; if the current falls outside the current threshold range, the current is abnormal. If the throughput, the time delay, the channel utilization rate, the voltage and the current are all normal, generating a management environment result as normal, and executing S2102; and if one or more of throughput, time delay, channel utilization rate, voltage and current are abnormal, generating a management environment result as an abnormal result, ending the process and giving an alarm.
S2102: and if the management environment result is normal, receiving the transmission request, and sending an operation and maintenance environment data acquisition instruction according to the transmission request.
Specifically, if the management environment result is normal, the transmission request sent by the server is received through the transceiving unit, the operation and maintenance environment data acquisition instruction is generated according to the transmission request, and the operation and maintenance environment data acquisition instruction is sent to the server. Wherein the transmission request includes at least: the server ID.
S2103: receiving operation and maintenance environment data obtained according to the operation and maintenance environment data acquisition instruction, analyzing the operation and maintenance environment data, and obtaining an operation and maintenance environment result, wherein the operation and maintenance environment result comprises: normal and abnormal.
Specifically, the server receives and executes the operation and maintenance environment data acquisition instruction, and sends the operation and maintenance environment data to the management center, and the management center receives the operation and maintenance environment data, analyzes the operation and maintenance environment data, and acquires an operation and maintenance environment result.
Wherein, the operation and maintenance environment data at least comprises: server ID, real-time operating parameters, real-time network data, and real-time power data.
The real-time operation parameters are equipment operation parameters of the server in the current operation.
The real-time network data is the network performance data of the server in the current operation. The real-time network data comprises: real-time throughput, real-time latency, and real-time channel utilization.
The real-time power data is power data of the server in the current operation. The real-time power data includes: real-time voltage and real-time current.
Further, the sub-steps of analyzing the operation and maintenance environment data and obtaining the operation and maintenance environment result are as follows:
s21031: generating an access request according to the operation and maintenance environment data, and sending the access request, wherein the access request comprises: server ID and access content.
Specifically, the detection unit receives the operation and maintenance environment data, and generates an access request according to the operation and maintenance environment data, where the access request includes: the server ID and the access content, wherein the access content is used for acquiring the operation and maintenance standard data. After the detection unit generates the access request, the detection unit sends the access request to the storage unit.
S21032: receiving an access permission instruction sent according to the access request, and acquiring operation and maintenance standard data according to the access permission instruction, wherein the access permission instruction comprises the following steps: server ID and access location; the operation and maintenance standard data comprises: an operating parameter standard range, a network data standard range, and a power data standard range.
Specifically, after receiving the access request, the storage unit generates an access permission instruction according to access content in the access request, and sends the access permission instruction to the detection unit, and the detection unit accesses the operation and maintenance standard database of the storage unit according to an access position in the access permission instruction, so as to obtain corresponding operation and maintenance standard data.
The operation and maintenance standard database comprises a plurality of operation and maintenance standard data, each operation and maintenance standard data corresponds to a server ID, and each operation and maintenance standard data at least comprises: an operating parameter standard range, a network data standard range, and a power data standard range.
In particular, operationStandard range of parameters of
；
Wherein the content of the first and second substances,
to support the minimum of the operational parameters of the device required for normal operation of the server,
is the maximum value of the operating parameters of the equipment required for supporting the normal operation of the server.
The network data standard range comprises: a throughput standard range, a delay standard range, and a channel utilization standard range.
Specifically, the standard range of throughput is
；
Wherein the content of the first and second substances,
is the minimum value of the throughput when the server is operating normally,
is the maximum value of the throughput when the server is normally running.
The standard range of the time delay is
；
Wherein the content of the first and second substances,
is the minimum value of the time delay when the server normally operates,
the maximum value of the time delay when the server operates normally.
Standard range of channel utilizationEnclose as
；
Wherein the content of the first and second substances,
is the minimum value of channel utilization when the server is operating normally,
the maximum value of the channel utilization rate when the server operates normally.
The power data standard ranges include: a voltage standard range and a current standard range.
The standard range of voltage is
；
Wherein the content of the first and second substances,
is the minimum value of the voltage when the server operates normally,
the maximum voltage value when the server operates normally.
Current standard range of
；
Wherein the content of the first and second substances,
is the minimum value of the current when the server is in normal operation,
the maximum value of the current when the server operates normally.
S21033: and analyzing the operation and maintenance environment data according to the operation and maintenance standard data to obtain an operation and maintenance environment result.
Specifically, if the real-time operation parameter is within the standard range of the operation parameter, the server is indicated to operate normally; if the real-time network data falls within the standard range of the network data, the network performance of the server in operation is normal; if the real-time power data fall within the power data standard range, indicating that the power resources are normal when the server operates; and if the real-time operation parameters, the real-time network data and the real-time power data are normal, generating an operation and maintenance environment result as normal.
If the real-time operation parameter is out of the standard range of the operation parameter, indicating that the server is abnormal in operation; if the real-time network data falls out of the standard range of the network data, the network performance is abnormal when the server operates; if the real-time power data fall out of the standard range of the power data, the power data indicate that the power resources are abnormal when the server operates; and if at least one of the real-time operation parameters, the real-time network data and the real-time power data is abnormal, generating an operation and maintenance environment result as an abnormal result, ending the process and sending an alarm.
S220: and if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, processing the operation and maintenance data, and obtaining the to-be-detected storage data.
Specifically, if the operation and maintenance environment result is normal, the analysis unit generates an operation and maintenance data acquisition instruction, sends the operation and maintenance data acquisition instruction to the server, and the server sends the acquired operation and maintenance data to the management center, and the analysis unit analyzes the operation and maintenance data.
Further, the substeps of processing the operation and maintenance data and obtaining the storage data to be detected are as follows:
s2201: carrying out anomaly detection on the operation and maintenance data to generate an anomaly detection result, wherein the anomaly detection result is as follows: normal and abnormal.
Further, the operation and maintenance data are subjected to anomaly detection, and the substep of generating an anomaly detection result is as follows:
s22011: and inputting the operation and maintenance data into a classification unit for classification, and determining the data type.
Specifically, a neural network trained in advance is arranged in the abnormality detection unit and used for classifying the operation and maintenance data, the operation and maintenance data are input into the abnormality detection unit, and the operation and maintenance data are classified by the abnormality detection unit, so that the data type of the operation and maintenance data is determined.
Wherein, the operation and maintenance data comprises: the data content of the operation and maintenance data and the numerical value of the operation and maintenance data.
Wherein, as an embodiment, the data types are classified according to the action of the operation and maintenance data. For example: operation and maintenance data for managing network conditions, operation and maintenance data for managing device conditions, operation and maintenance data for managing storage conditions, and the like.
S22012: and determining the configuration quantity of the operation and maintenance data according to the data type.
Specifically, a configuration database is preset in an abnormality detection unit of the analysis unit. The configuration database includes a plurality of sub-configuration data, each sub-configuration data corresponding to a data type. The sub-configuration data includes: configuration number, mutation threshold, and storage template.
The configuration number represents the set number of the operation and maintenance data collected according to the time sequence in unit time.
And the analysis unit acquires corresponding sub-configuration data from the configuration database according to the data type of the operation and maintenance data, and takes the configuration number in the sub-configuration data as the configuration number of the operation and maintenance data.
S22013: and calculating the dynamic deviation of the operation and maintenance data according to the configuration quantity.
Further, the expression of the dynamic deviation is as follows:
wherein the content of the first and second substances,
dynamic deviation of operation and maintenance data;
is as follows
The value of each operation and maintenance data;
the configuration quantity of the operation and maintenance data;
the operation and maintenance quantity of the operation and maintenance data;
is the size of the sliding window;
show to get
Maximum value of (2).
The operation and maintenance quantity is the actual quantity of the operation and maintenance data acquired by the current operation and maintenance data according to the time sequence in unit time. The size of the sliding window is the minimum integer value of the quotient of the configuration number and the operation and maintenance number.
S22014: acquiring a mutation threshold, analyzing the dynamic deviation by using the mutation threshold, and when the dynamic deviation is greater than the mutation threshold, determining that the generated abnormal detection result is abnormal; and when the dynamic deviation is less than or equal to the mutation threshold, the generated abnormal detection result is normal.
Specifically, a corresponding mutation threshold is obtained from the configuration database, if the dynamic deviation is greater than the mutation threshold, it indicates that the change rate of the operation and maintenance data is too large, abnormal operation and maintenance data exists in the operation and maintenance data, the generated abnormal detection result is abnormal, the process is ended, and an alarm is given. If the dynamic deviation is smaller than or equal to the mutation threshold, the change rate of the operation and maintenance data is normal, abnormal operation and maintenance data does not exist in the operation and maintenance data, and the generated abnormal detection result is normal.
S2202: and if the abnormal detection result is normal, calling the storage template, storing the operation and maintenance data according to the storage template, and obtaining the storage data to be detected.
Specifically, if the anomaly detection result is normal, the analysis unit calls a corresponding storage template from the configuration database, stores the operation and maintenance data by using the storage template, and takes the stored data as the to-be-detected storage data. After the analysis unit obtains the storage data to be detected, the storage data to be detected is sent to the processing unit, and S230 is executed. The storage template is preset and can be in a storage form such as a table, and the storage form of the data table is preferred in the application.
The operation and maintenance data are cut into a plurality of sub-operation and maintenance data according to the size of the sliding window, and each sub-operation and maintenance data is stored according to the storage template to obtain a plurality of to-be-detected storage data.
S230: and processing the data to be detected to obtain standard operation and maintenance data, and storing the standard operation and maintenance data.
Further, the substeps of processing the data to be detected and stored to obtain the standard operation and maintenance data and storing the standard operation and maintenance data are as follows:
s2301: and carrying out integrity detection on the to-be-detected storage data to obtain an integrity result, wherein the integrity result comprises: intact and missing.
Specifically, a trained first detection model for detecting integrity is preset in the processing unit, the stored data to be detected is input into the first detection model, the first detection model acquires an integrity value of the stored data to be detected, the integrity value is analyzed according to a preset integrity threshold, if the integrity value is larger than or equal to the integrity threshold, the stored data to be detected is completely stored, a generated integrity result is complete, if the integrity value is smaller than the integrity threshold, the stored data to be detected is incompletely stored, and the generated integrity result is missing. If the integrity result is complete, S2302 is executed. And if the integrity result is missing, re-acquiring the operation and maintenance data and the storage template, sending the operation and maintenance data and the storage template to the checking unit for re-storage, taking the storage data as new storage data to be detected, and re-executing S2301.
Further, the expression of the integrity value is as follows:
wherein, the first and the second end of the pipe are connected with each other,
is an integrity value;
is as follows
The number of records violating the preset storage rule in the storage template in the storage data to be detected,
is as follows
The total number of actual records in the stored data to be detected;
，
the total number of the stored data to be detected.
The record number represents the number of data in the to-be-detected stored data recorded in each storage template.
S2302: when the integrity result is complete, carrying out accuracy detection on the storage data to be detected to obtain an accuracy result, wherein the accuracy result comprises the following steps: accuracy and error.
Specifically, a trained second detection model for detecting accuracy is preset in the processing unit, the stored data to be detected is input to the second detection model, the accuracy value of the stored data to be detected is obtained by the second detection model, the accuracy value is analyzed according to a preset accuracy threshold, if the accuracy value is greater than or equal to the accuracy threshold, the stored data to be detected is stored accurately, the generated accuracy result is accurate, and S2303 is executed. If the accuracy value is smaller than the accuracy threshold value, it indicates that the storage data to be detected is stored with errors, and if the generated accuracy result is an error, the operation and maintenance data and the storage template are obtained again, and are sent to the checking unit for storage again, and the storage data is used as new storage data to be detected, and S2301 is executed again.
S2303: and when the accuracy result is accurate, the to-be-detected storage data is used as standard operation and maintenance data, and the standard operation and maintenance data is stored.
Specifically, when the accuracy result is accurate, the processing unit sends the storage data to be detected to the storage unit as the standard operation and maintenance data, and the storage unit stores the standard operation and maintenance data in the operation and maintenance standard database, so that the operation and maintenance data can be managed in a unified mode.
The method and the device have the technical effects that unified management of the operation and maintenance data is facilitated, and the accuracy of the stored operation and maintenance data is improved.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, the scope of protection of the present application is intended to be interpreted to include the preferred embodiments and all variations and modifications that fall within the scope of the present application. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A management system for operation and maintenance data, comprising: a plurality of servers and a management center;
a server: for sending a transmission request; transmitting operation and maintenance environment data; receiving and executing an operation and maintenance data acquisition instruction, and sending the acquired operation and maintenance data to a management center;
the management center: for performing the steps of:
acquiring operation and maintenance environment data according to the transmission request, and analyzing the operation and maintenance environment data to obtain an operation and maintenance environment result;
if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data;
and processing the data to be detected and stored to obtain standard operation and maintenance data, and storing the standard operation and maintenance data.
2. The operation and maintenance data management system according to claim 1, wherein the management center comprises: the device comprises a detection unit, a transmitting-receiving unit, an analysis unit, a processing unit and a storage unit;
wherein the detection unit: carrying out management environment detection, and generating a management environment result, wherein the management environment result comprises: normal and abnormal; receiving operation and maintenance environment data, analyzing the operation and maintenance environment data, and obtaining operation and maintenance environment results, wherein the operation and maintenance environment results comprise: normal and abnormal;
a transmitting and receiving unit: if the management environment result is normal, receiving a transmission request, and sending an operation and maintenance environment data acquisition instruction according to the transmission request; receiving operation and maintenance environment data and sending the operation and maintenance environment data to a detection unit;
an analysis unit: if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data;
a processing unit: processing the data to be detected and stored to obtain standard operation and maintenance data;
a storage unit: the system comprises a database for storing historical management environment database and operation and maintenance standard database; and receiving standard operation and maintenance data, and storing the standard operation and maintenance data in an operation and maintenance standard database.
3. The operation and maintenance data management system according to claim 2, wherein the analysis unit comprises: an abnormality detection unit and a sorting unit;
wherein the abnormality detection unit: the operation and maintenance data are classified, and the data type is determined; and carrying out anomaly detection on the operation and maintenance data according to the data type to generate an anomaly detection result, wherein the anomaly detection result comprises the following steps: normal and abnormal;
a finishing unit: and when the anomaly detection result is normal, calling the storage template, and storing the operation and maintenance data according to the storage template to obtain the storage data to be detected.
4. The operation and maintenance data management system according to claim 3, wherein the processing unit comprises: the method comprises the following steps of (1) a first detection model, a second detection model and a check model;
the first detection model: and carrying out integrity detection on the to-be-detected storage data to obtain an integrity result, wherein the integrity result comprises: intact and missing;
the second detection model is as follows: when the integrity result is complete, carrying out accuracy detection on the storage data to be detected to obtain an accuracy result, wherein the accuracy result comprises the following steps: the method comprises the steps of accuracy and error, and when the accuracy result is accurate, the stored data to be detected is sent to a storage unit as standard operation and maintenance data;
checking the model: and when the integrity result is missing or the accuracy result is wrong, the operation and maintenance data and the storage template are obtained again, the operation and maintenance data are stored again according to the storage template, the storage data are used as new storage data to be detected, and the integrity detection is performed on the new storage data to be detected again.
5. A management method of operation and maintenance data is characterized by comprising the following steps:
acquiring operation and maintenance environment data according to the transmission request, and analyzing the operation and maintenance environment data to obtain an operation and maintenance environment result;
if the operation and maintenance environment result is normal, sending an operation and maintenance data acquisition instruction, receiving the operation and maintenance data sent after the operation and maintenance data acquisition instruction is executed, and processing the operation and maintenance data to obtain to-be-detected storage data;
and processing the data to be detected and stored to obtain standard operation and maintenance data, and storing the standard operation and maintenance data.
6. The operation and maintenance data management method according to claim 5, wherein the operation and maintenance environment data is obtained according to the transmission request, and the operation and maintenance environment data is analyzed, and the sub-step of obtaining the operation and maintenance environment result is as follows:
carrying out management environment detection, and generating a management environment result, wherein the management environment result comprises: normal and abnormal;
if the management environment result is normal, receiving a transmission request, and sending an operation and maintenance environment data acquisition instruction according to the transmission request;
receiving operation and maintenance environment data obtained according to the operation and maintenance environment data acquisition instruction, analyzing the operation and maintenance environment data, and obtaining an operation and maintenance environment result, wherein the operation and maintenance environment result comprises: normal and abnormal.
7. The method for managing operation and maintenance data according to claim 6, wherein the sub-step of performing management environment detection and generating the management environment result is as follows:
acquiring management environment data, wherein the management environment data comprises: network performance data and power data;
acquiring standard historical data, processing the standard historical data, and acquiring a threshold range, wherein the threshold range comprises: a network threshold range and a power threshold range;
judging the management environment data by using the threshold range, and if the management environment data falls into the threshold range, generating a management environment result as normal; and if the management environment data is out of the threshold range, generating a management environment result as an abnormal result, ending the process and giving an alarm.
8. The method for managing operation and maintenance data according to claim 7, wherein the network threshold range comprises: a throughput threshold range, a delay threshold range, and a channel utilization threshold range; the power threshold ranges include: a voltage threshold range and a current threshold range;
wherein, the expression of the throughput threshold range is as follows:
；
wherein the content of the first and second substances,
is a throughput threshold range;
is as follows
The throughput of the individual pieces of historical throughput,
，
is the total number of historical throughputs;
the maximum throughput of the management center in normal operation.
9. The operation and maintenance data management method according to claim 5, wherein the substep of processing the operation and maintenance data to obtain the storage data to be detected is as follows:
carrying out anomaly detection on the operation and maintenance data to generate an anomaly detection result, wherein the anomaly detection result is as follows: normal and abnormal;
and if the abnormal detection result is normal, calling the storage template, storing the operation and maintenance data according to the storage template, and obtaining the storage data to be detected.
10. The operation and maintenance data management method according to claim 5, wherein the substeps of processing the to-be-detected storage data to obtain the standard operation and maintenance data and storing the standard operation and maintenance data are as follows:
and carrying out integrity detection on the to-be-detected storage data to obtain an integrity result, wherein the integrity result comprises: intact and missing;
when the integrity result is complete, carrying out accuracy detection on the storage data to be detected to obtain an accuracy result, wherein the accuracy result comprises the following steps: accuracy and error;
and when the accuracy result is accurate, the to-be-detected storage data is used as standard operation and maintenance data, and the standard operation and maintenance data is stored.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210455694.2A CN114564758A (en) | 2022-04-28 | 2022-04-28 | Management method and system of operation and maintenance data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210455694.2A CN114564758A (en) | 2022-04-28 | 2022-04-28 | Management method and system of operation and maintenance data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114564758A true CN114564758A (en) | 2022-05-31 |
Family
ID=81720821
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210455694.2A Pending CN114564758A (en) | 2022-04-28 | 2022-04-28 | Management method and system of operation and maintenance data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114564758A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114840770A (en) * | 2022-07-04 | 2022-08-02 | 睿至科技集团有限公司 | Management method and system based on big data |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025536A (en) * | 2010-11-25 | 2011-04-20 | 成都勤智数码科技有限公司 | Method and device for collecting Unix/Linux system operation data |
| CN105893628A (en) * | 2016-05-17 | 2016-08-24 | 中国农业银行股份有限公司 | Real-time data collection system and method |
| CN106100868A (en) * | 2016-05-27 | 2016-11-09 | 努比亚技术有限公司 | A kind of project operation and maintenance device, system and method |
| CN107086944A (en) * | 2017-06-22 | 2017-08-22 | 北京奇艺世纪科技有限公司 | A kind of method for detecting abnormality and device |
| CN108809701A (en) * | 2018-05-23 | 2018-11-13 | 郑州云海信息技术有限公司 | A kind of data center's wisdom data platform and its implementation |
| CN112132555A (en) * | 2020-11-25 | 2020-12-25 | 睿至科技集团有限公司 | Operation and maintenance operation integrated platform and working method thereof |
| CN113835387A (en) * | 2021-09-16 | 2021-12-24 | 国家计算机网络与信息安全管理中心 | Operation and maintenance management method, system and medium |
| CN114070654A (en) * | 2022-01-17 | 2022-02-18 | 睿至科技集团有限公司 | Safety management and control method and system based on big data |
| CN114142614A (en) * | 2021-12-03 | 2022-03-04 | 浙江省交通运输科学研究院 | Highway power distribution room intelligent operation and maintenance management system based on SD-WAN network |
-
2022
- 2022-04-28 CN CN202210455694.2A patent/CN114564758A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025536A (en) * | 2010-11-25 | 2011-04-20 | 成都勤智数码科技有限公司 | Method and device for collecting Unix/Linux system operation data |
| CN105893628A (en) * | 2016-05-17 | 2016-08-24 | 中国农业银行股份有限公司 | Real-time data collection system and method |
| CN106100868A (en) * | 2016-05-27 | 2016-11-09 | 努比亚技术有限公司 | A kind of project operation and maintenance device, system and method |
| CN107086944A (en) * | 2017-06-22 | 2017-08-22 | 北京奇艺世纪科技有限公司 | A kind of method for detecting abnormality and device |
| CN108809701A (en) * | 2018-05-23 | 2018-11-13 | 郑州云海信息技术有限公司 | A kind of data center's wisdom data platform and its implementation |
| CN112132555A (en) * | 2020-11-25 | 2020-12-25 | 睿至科技集团有限公司 | Operation and maintenance operation integrated platform and working method thereof |
| CN113835387A (en) * | 2021-09-16 | 2021-12-24 | 国家计算机网络与信息安全管理中心 | Operation and maintenance management method, system and medium |
| CN114142614A (en) * | 2021-12-03 | 2022-03-04 | 浙江省交通运输科学研究院 | Highway power distribution room intelligent operation and maintenance management system based on SD-WAN network |
| CN114070654A (en) * | 2022-01-17 | 2022-02-18 | 睿至科技集团有限公司 | Safety management and control method and system based on big data |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114840770A (en) * | 2022-07-04 | 2022-08-02 | 睿至科技集团有限公司 | Management method and system based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111475370A (en) | Operation and maintenance monitoring method, device and equipment based on data center and storage medium | |
| CN112611936A (en) | Distribution network transformer fault dynamic detection and classification system based on edge calculation | |
| CN111611146B (en) | Micro-service fault prediction method and device | |
| CN114201374A (en) | Operation and maintenance time sequence data anomaly detection method and system based on hybrid machine learning | |
| CN115529595A (en) | Method, device, equipment and medium for detecting abnormity of log data | |
| CN115576738B (en) | Method and system for realizing equipment fault determination based on chip analysis | |
| CN115454778A (en) | Intelligent monitoring system for abnormal time sequence indexes in large-scale cloud network environment | |
| CN116680113B (en) | Equipment detection implementation control system | |
| US10733514B1 (en) | Methods and apparatus for multi-site time series data analysis | |
| CN110929896A (en) | Security analysis method and device for system equipment | |
| CN114564758A (en) | Management method and system of operation and maintenance data | |
| CN111860980A (en) | Method for interpolating and supplementing missing value by applying classification regression tree in power load prediction | |
| CN112365186A (en) | Health degree evaluation method and system for electric power information system | |
| CN109308225B (en) | Virtual machine abnormality detection method, device, equipment and storage medium | |
| CN110689272A (en) | Sensitive equipment tolerance characteristic real-time online evaluation method based on stream computing | |
| CN115114124A (en) | Host risk assessment method and device | |
| CN115150248A (en) | Network flow abnormity detection method and device, electronic equipment and storage medium | |
| CN113891342A (en) | Base station inspection method and device, electronic equipment and storage medium | |
| CN116415851A (en) | Intelligent identification and evaluation method for facility operation and maintenance performance indexes based on deep learning | |
| KR101984257B1 (en) | Cloud service based big data analysing system and method therein | |
| CN112737120B (en) | Regional power grid control report generation method and device and computer equipment | |
| CN116126807A (en) | Log analysis method and related device | |
| CN115037592A (en) | Data relevance analysis method and system | |
| CN111061609A (en) | Log monitoring method and system | |
| CN116112414B (en) | Remote inspection system for edge computing gateway equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220531 |