CN113517998A - Processing method, device and equipment of early warning configuration data and storage medium - Google Patents

Processing method, device and equipment of early warning configuration data and storage medium Download PDF

Info

Publication number
CN113517998A
CN113517998A CN202110433773.9A CN202110433773A CN113517998A CN 113517998 A CN113517998 A CN 113517998A CN 202110433773 A CN202110433773 A CN 202110433773A CN 113517998 A CN113517998 A CN 113517998A
Authority
CN
China
Prior art keywords
early warning
preset
configuration data
warning configuration
initial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110433773.9A
Other languages
Chinese (zh)
Other versions
CN113517998B (en
Inventor
晏彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kangjian Information Technology Shenzhen Co Ltd
Original Assignee
Kangjian Information Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kangjian Information Technology Shenzhen Co Ltd filed Critical Kangjian Information Technology Shenzhen Co Ltd
Priority to CN202110433773.9A priority Critical patent/CN113517998B/en
Publication of CN113517998A publication Critical patent/CN113517998A/en
Application granted granted Critical
Publication of CN113517998B publication Critical patent/CN113517998B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06—Management of faults, events, alarms or notifications
    • H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06—Management of faults, events, alarms or notifications
    • H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/0803—Configuration setting
    • H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14—Network analysis or design
    • H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/2866—Architectures; Arrangements
    • H04L67/30—Profiles

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to the technical field of big data, is applied to the field of intelligent medical treatment, and provides a processing method, a device, equipment and a storage medium of early warning configuration data, which are used for improving the processing reliability of the early warning configuration data. The processing method of the early warning configuration data comprises the following steps: splitting and storing initial early warning configuration data read from a preset monitoring system by calling a preset service interface to a preset cluster; calling a preset lightweight configuration management system, reading initial early warning configuration data in a preset cluster and generating a configuration file to obtain an initial early warning configuration file; writing a target early warning configuration file meeting preset detection conditions in the initial early warning configuration file into a preset distributed system; and reading early warning configuration data of a target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain target early warning configuration data. In addition, the invention also relates to a block chain technology, and the initial early warning configuration data can be stored in the block chain.

Description

Processing method, device and equipment of early warning configuration data and storage medium
Technical Field
The invention relates to the field of risk management and control, in particular to a method, a device, equipment and a storage medium for processing early warning configuration data.
Background
With the development of computer technology, configuration data plays an important role in the technical fields of network security, operation and maintenance and the like, and technologies related to early warning configuration data for early warning in the configuration data are also the technological directions which are often concerned about. At present, the processing method for the early warning configuration data is generally to edit the early warning configuration file manually and then import the early warning configuration file into the storage system.
However, in the above processing method of the early warning configuration data, there are problems of a long time and a low security and a low reading efficiency due to the manual editing and the centralized storage of the early warning configuration files, which results in a low processing reliability of the early warning configuration data.
Disclosure of Invention
The invention provides a processing method, a processing device, processing equipment and a storage medium of early warning configuration data, which are used for improving the processing reliability of the early warning configuration data.
The invention provides a method for processing early warning configuration data in a first aspect, which comprises the following steps:
calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster, wherein the preset cluster is a lightweight distributed high-availability system cluster;
calling a preset lightweight configuration management system, reading initial early warning configuration data in a preset cluster and generating a configuration file to obtain an initial early warning configuration file;
detecting the initial early warning configuration file to obtain a target early warning configuration file meeting preset detection conditions, and writing the target early warning configuration file into a preset distributed system;
and reading early warning configuration data of the target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain target early warning configuration data.
Optionally, in a first implementation manner of the first aspect of the present invention, the invoking a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster includes:
when the completion of the updating of object creating information in a preset monitoring system is monitored in real time through a preset monitoring pool, calling a preset service interface, and reading initial early warning configuration data corresponding to the object creating information in the preset monitoring system, wherein the object creating information comprises monitoring service configuration object information and early warning rule configuration object information;
splitting and verifying the splitting result of the initial early warning configuration data in sequence to obtain splitting configuration data;
and creating key value pairs of the splitting configuration data, and storing the key value pairs to a preset cluster.
Optionally, in a second implementation manner of the first aspect of the present invention, the invoking a preset lightweight configuration management system to read initial early warning configuration data in the preset cluster and generate a configuration file to obtain an initial early warning configuration file includes:
when a preset lightweight configuration management system monitors that the preset cluster stores the initial early warning configuration data in real time, reading the initial early warning configuration data from the preset cluster;
acquiring an early warning configuration type of the initial early warning configuration data, and performing format standardization processing on the initial early warning configuration data to obtain early warning configuration data to be processed;
and acquiring a to-be-written configuration file corresponding to the early warning configuration type, and writing the to-be-processed early warning configuration data into the to-be-written configuration file to obtain an initial early warning configuration file, wherein the format of the to-be-written configuration file is a system monitoring alarm framework format.
Optionally, in a third implementation manner of the first aspect of the present invention, the detecting the initial early warning configuration file to obtain a target early warning configuration file meeting a preset detection condition, and writing the target early warning configuration file into a preset distributed system includes:
detecting initial early warning configuration data in the initial early warning configuration file through preset detection conditions to obtain a target early warning configuration file meeting the preset detection conditions, wherein the preset detection conditions comprise a grammar detection rule, a format detection rule, a missing item detection rule and a safety detection rule;
and performing subfile splitting on the target early warning configuration file to obtain a plurality of split configuration files, and serially loading the split configuration files to a preset distributed system.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the splitting the target early warning configuration file into subfiles to obtain multiple split configuration files, and serially loading the multiple split configuration files to a preset distributed system includes:
according to a preset splitting strategy, performing subfile splitting on the target early warning configuration file to obtain a plurality of split configuration files, and performing data reading on the plurality of split configuration files to obtain split configuration file data corresponding to each split configuration file;
writing the splitting configuration file data corresponding to each splitting configuration file into a preset message queue respectively to obtain a configuration message queue corresponding to each splitting configuration file;
and storing the target early warning configuration file to a preset distributed system through a configuration message queue corresponding to each split configuration file.
Optionally, in a fifth implementation manner of the first aspect of the present invention, after the reading, by a preset system monitoring alarm framework, early warning configuration data of a target early warning configuration file in the distributed system to obtain the target early warning configuration data, the method further includes:
acquiring initial monitoring data of the preset monitoring system, and comparing and analyzing the initial monitoring data through the target early warning configuration data to generate early warning information to obtain target monitoring information;
and acquiring evaluation information based on the target monitoring information and the target early warning configuration data, and optimizing the execution process of the target monitoring information and the target early warning configuration data according to the evaluation information and a preset optimization algorithm.
Optionally, in a sixth implementation manner of the first aspect of the present invention, the obtaining initial monitoring data of the preset monitoring system, performing comparative analysis on the initial monitoring data through the target early warning configuration data, and generating early warning information to obtain target monitoring information includes:
calling a preset interface to read initial monitoring data of the preset monitoring system, and classifying the monitoring types of the initial monitoring data through a preset classification model to obtain the monitoring types;
matching early warning configuration data corresponding to the monitoring type from the target early warning configuration data to obtain monitoring configuration data;
and based on a preset neural network model and the monitoring configuration data, performing early warning feature extraction, early warning feature matching and early warning information template writing on the initial monitoring data in sequence to obtain target monitoring information.
The second aspect of the present invention provides an apparatus for processing early warning configuration data, including:
the split storage module is used for calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster, wherein the preset cluster is a lightweight distributed high-availability system cluster;
the generating module is used for calling a preset lightweight configuration management system, reading initial early warning configuration data in the preset cluster and generating a configuration file to obtain an initial early warning configuration file;
the detection module is used for detecting the initial early warning configuration file to obtain a target early warning configuration file meeting a preset detection condition, and writing the target early warning configuration file into a preset distributed system;
and the reading module is used for reading the early warning configuration data of the target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain the target early warning configuration data.
Optionally, in a first implementation manner of the second aspect of the present invention, the split storage module is specifically configured to:
when the completion of the updating of object creating information in a preset monitoring system is monitored in real time through a preset monitoring pool, calling a preset service interface, and reading initial early warning configuration data corresponding to the object creating information in the preset monitoring system, wherein the object creating information comprises monitoring service configuration object information and early warning rule configuration object information;
splitting and verifying the splitting result of the initial early warning configuration data in sequence to obtain splitting configuration data;
and creating key value pairs of the splitting configuration data, and storing the key value pairs to a preset cluster.
Optionally, in a second implementation manner of the second aspect of the present invention, the generating module is specifically configured to:
when a preset lightweight configuration management system monitors that the preset cluster stores the initial early warning configuration data in real time, reading the initial early warning configuration data from the preset cluster;
acquiring an early warning configuration type of the initial early warning configuration data, and performing format standardization processing on the initial early warning configuration data to obtain early warning configuration data to be processed;
and acquiring a to-be-written configuration file corresponding to the early warning configuration type, and writing the to-be-processed early warning configuration data into the to-be-written configuration file to obtain an initial early warning configuration file, wherein the format of the to-be-written configuration file is a system monitoring alarm framework format.
Optionally, in a third implementation manner of the second aspect of the present invention, the detection module includes:
the detection unit is used for detecting initial early warning configuration data in the initial early warning configuration file through preset detection conditions to obtain a target early warning configuration file meeting the preset detection conditions, wherein the preset detection conditions comprise a grammar detection rule, a format detection rule, a missing item detection rule and a safety detection rule;
and the loading unit is used for splitting the subfiles of the target early warning configuration file to obtain a plurality of split configuration files and serially loading the split configuration files to a preset distributed system.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the loading unit is specifically configured to:
according to a preset splitting strategy, performing subfile splitting on the target early warning configuration file to obtain a plurality of split configuration files, and performing data reading on the plurality of split configuration files to obtain split configuration file data corresponding to each split configuration file;
writing the splitting configuration file data corresponding to each splitting configuration file into a preset message queue respectively to obtain a configuration message queue corresponding to each splitting configuration file;
and storing the target early warning configuration file to a preset distributed system through a configuration message queue corresponding to each split configuration file.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the processing apparatus for early warning configuration data further includes:
the analysis module is used for acquiring initial monitoring data of the preset monitoring system, comparing and analyzing the initial monitoring data through the target early warning configuration data and generating early warning information to obtain target monitoring information;
and the optimization module is used for acquiring evaluation information based on the target monitoring information and the target early warning configuration data and optimizing the execution process of the target monitoring information and the target early warning configuration data according to the evaluation information and a preset optimization algorithm.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the analysis module is specifically configured to:
calling a preset interface to read initial monitoring data of the preset monitoring system, and classifying the monitoring types of the initial monitoring data through a preset classification model to obtain the monitoring types;
matching early warning configuration data corresponding to the monitoring type from the target early warning configuration data to obtain monitoring configuration data;
and based on a preset neural network model and the monitoring configuration data, performing early warning feature extraction, early warning feature matching and early warning information template writing on the initial monitoring data in sequence to obtain target monitoring information.
A third aspect of the present invention provides an apparatus for processing early warning configuration data, including: a memory and at least one processor, the memory having instructions stored therein; the at least one processor calls the instructions in the memory to enable the processing device of the early warning configuration data to execute the processing method of the early warning configuration data.
A fourth aspect of the present invention provides a computer-readable storage medium having stored therein instructions, which, when run on a computer, cause the computer to execute the above-mentioned processing method of the warning configuration data.
In the technical scheme provided by the invention, a preset service interface is called, initial early warning configuration data of a preset monitoring system is read, and the initial early warning configuration data is stored in a preset cluster in a split manner, wherein the preset cluster is a lightweight distributed high-availability system cluster; calling a preset lightweight configuration management system, reading initial early warning configuration data in a preset cluster and generating a configuration file to obtain an initial early warning configuration file; detecting the initial early warning configuration file to obtain a target early warning configuration file meeting preset detection conditions, and writing the target early warning configuration file into a preset distributed system; and reading early warning configuration data of the target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain target early warning configuration data. In the embodiment of the invention, the automatic processing of the initial early warning configuration data is realized, the management convenience, the access efficiency, the reading correctness and the access safety of the initial early warning configuration data are improved, and the decoupling of a processing system of the initial early warning configuration data is realized, so that the processing reliability of the early warning configuration data is improved.
Drawings
Fig. 1 is a schematic diagram of an embodiment of a method for processing early warning configuration data according to an embodiment of the present invention;
fig. 2 is a schematic diagram of another embodiment of a processing method of early warning configuration data in an embodiment of the present invention;
fig. 3 is a schematic diagram of an embodiment of a processing device for early warning configuration data according to an embodiment of the present invention;
fig. 4 is a schematic diagram of another embodiment of a processing device for early warning configuration data according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an embodiment of a device for processing early warning configuration data in an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a method, a device, equipment and a storage medium for processing early warning configuration data, and the processing reliability of the early warning configuration data is improved.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," or "having," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For convenience of understanding, a detailed flow of an embodiment of the present invention is described below, and referring to fig. 1, an embodiment of a method for processing early warning configuration data in an embodiment of the present invention includes:
101. calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster, wherein the preset cluster is a lightweight distributed high-availability system cluster.
It is to be understood that the execution subject of the present invention may be a processing device of the early warning configuration data, and may also be a terminal or a server, which is not limited herein. The embodiment of the present invention is described by taking a server as an execution subject.
The front end submits initial early warning configuration data to a configuration database of a preset monitoring system, the initial early warning configuration data comprises early warning names, expressions, duration, levels, monitoring item names, early warning descriptions and instance names, a server calls a preset monitoring interface to monitor the configuration database of the preset monitoring system, when the configuration database is monitored to have configuration data update, the updated configuration data is retrieved through a preset early warning configuration form field to obtain initial early warning configuration data, the preset service interface consul is called to read the initial early warning configuration data, sub items of each configuration item in the initial early warning configuration data are split into specific form items to obtain split early warning configuration data, the split early warning configuration data are split to obtain split configuration data, and the sequence of the form items in the initial early warning configuration data is determined, the method comprises the steps of sequentially sequencing and creating indexes on fragment data to obtain sequencing fragment configuration data for creating the indexes, generating key value pairs of the sequencing fragment configuration data for creating the indexes, and storing the fragment configuration data for creating the key value pairs to a lightweight distributed high-availability system cluster consul, namely a preset cluster, based on a preset consistency algorithm Raft.
102. And calling a preset lightweight configuration management system, reading initial early warning configuration data in a preset cluster and generating a configuration file to obtain an initial early warning configuration file.
The method comprises the steps that a server calls a preset lightweight configuration management system Confd to monitor a preset cluster in real time, when it is monitored that the preset cluster stores initial early warning configuration data, retrieval is carried out on all nodes of the preset cluster based on a preset search engine to obtain the initial early warning configuration data, integrity detection and safety detection are carried out on the initial early warning configuration data to obtain candidate early warning configuration data, file configuration items in a preset configuration file are obtained, the candidate early warning configuration data are classified according to the file configuration items to obtain classified configuration data, and the classified configuration data are written into the preset configuration file according to the file configuration items to obtain the initial early warning configuration file.
103. And detecting the initial early warning configuration file to obtain a target early warning configuration file meeting preset detection conditions, and writing the target early warning configuration file into a preset distributed system.
The preset detection conditions include, but are not limited to, syntax detection rules and format detection rules, and a detection order of the syntax detection rules and the format detection rules in the preset detection conditions is not limited, where one detection order is exemplified, for example: the server carries out grammar detection on the initial early warning configuration file according to grammar detection rules in preset detection conditions, and carries out grammar adjustment on contents which do not accord with the grammar rules to obtain a detection configuration file; and judging whether the format of the detection configuration file is the format of the system monitoring alarm framework in the format detection rule, if so, determining the detection configuration file as a target early warning configuration file, and if not, performing format conversion on the detection configuration file to obtain the target early warning configuration file.
The method comprises the steps that a server reads configuration data in a target early warning configuration file, an index of the configuration data in the target early warning configuration file is created through a preset inverted index algorithm, a command line tool kubecect in a preset open source container cluster kubernates is called, the configuration data with the created index is led into a preset distributed system, and the distributed system can be a high-availability key value storage system ETCD.
104. And reading early warning configuration data of a target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain target early warning configuration data.
When the server receives the early warning configuration reading request, the early warning configuration reading request is analyzed to obtain an early warning type, an index and a sub-index corresponding to a target early warning configuration file are obtained, and the system monitoring alarm frame can be an open source monitoring alarm system and a time sequence database prometheus and is used for retrieving early warning configuration data of the target early warning configuration file in a distributed system to obtain the target early warning configuration data. The early warning configuration data in the distributed system is read through the system monitoring alarm framework, so that the reading management flexibility, modification convenience and reading safety of the target early warning configuration data are improved, and the processing reliability of the early warning configuration data is improved.
In the embodiment of the invention, the automatic processing of the initial early warning configuration data is realized, the management convenience, the access efficiency, the reading correctness and the access safety of the initial early warning configuration data are improved, and the decoupling of a processing system of the initial early warning configuration data is realized, so that the processing reliability of the early warning configuration data is improved. This scheme can be applied to in the wisdom medical field to promote the construction in wisdom city.
Referring to fig. 2, another embodiment of the method for processing early warning configuration data according to the embodiment of the present invention includes:
201. calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster, wherein the preset cluster is a lightweight distributed high-availability system cluster.
Specifically, when monitoring that the updating of the object creating information in the preset monitoring system is completed in real time through a preset monitoring pool, the server calls a preset service interface, reads initial early warning configuration data corresponding to the object creating information in the preset monitoring system, wherein the object creating information comprises monitoring service configuration object information and early warning rule configuration object information; splitting the initial early warning configuration data and verifying the splitting result to obtain split configuration data; and creating key value pairs of the split configuration data, and storing the key value pairs to a preset cluster.
The method comprises the steps that a server creates a monitoring pool in advance, real-time monitoring is carried out on a database of a preset monitoring system through the monitoring pool based on a preset time period, when the monitoring pool monitors that object creating information is generated or object creating information is completely updated in the database of the preset monitoring system within the preset time period, a preset service interface consul is called, initial early warning configuration data corresponding to the generated or updated object creating information are extracted, and therefore initial early warning configuration data are obtained, wherein the object creating information comprises monitoring service configuration object information and early warning rule configuration object information.
The server splits the initial early warning configuration data into line data to obtain initial line data, and converts the data format of the initial line data into a preset format to obtain configuration line data, or the server splits the initial early warning configuration data into line data in the preset format through a pre-established line splitting model to obtain configuration line data, wherein the preset format can be a data storage format of a preset cluster. After the server obtains the configuration line data, integrity detection, format detection and rule detection are carried out on the configuration line data, the integrity detection is used for detecting whether the configuration line data has a missing value or not, the format detection is used for detecting whether the format of the configuration line data conforms to a preset format or not, the rule detection is used for detecting whether the configuration line data conforms to a grammar rule or not, the configuration line data passing the detection is determined to be split configuration data, the configuration line data failing the detection is detected again (the re-detection comprises integrity detection, format detection and rule detection) and reprocessed (the reprocessed data comprises but is not limited to missing value filling corresponding to the integrity detection, preset format conversion corresponding to the format detection, grammar rule conversion corresponding to the rule detection and the like), and the split configuration data are obtained until the detection is passed.
And the server generates key value pairs of the splitting configuration data, and stores the splitting configuration data into each node of a preset cluster consul in a key value pair mode based on a preset consistency algorithm Raft. The initial early warning configuration data is split and the split result is verified, so that the management convenience of the initial early warning configuration data is improved, the efficiency and automation of the follow-up modification configuration of the initial early warning configuration data are facilitated, the split configuration data are stored in the preset cluster consul, the consistency and high availability of the split configuration data are guaranteed, the access efficiency and the reading accuracy of the split configuration data are improved, and the processing reliability of the early warning configuration data is improved.
202. And calling a preset lightweight configuration management system, reading initial early warning configuration data in a preset cluster and generating a configuration file to obtain an initial early warning configuration file.
Specifically, when a preset lightweight configuration management system monitors initial early warning configuration data stored in a preset cluster in real time, a server reads the initial early warning configuration data from the preset cluster; acquiring an early warning configuration type of initial early warning configuration data, and carrying out format standardization processing on the initial early warning configuration data to obtain early warning configuration data to be processed; and acquiring a to-be-written configuration file corresponding to the early warning configuration type, and writing the to-be-processed early warning configuration data into the to-be-written configuration file to obtain an initial early warning configuration file, wherein the format of the to-be-written configuration file is a system monitoring alarm framework format.
The method comprises the steps that a server calls a preset lightweight configuration management system Confd, real-time monitoring is conducted on a preset cluster based on a preset binary file, when it is monitored that the preset cluster stores initial early warning configuration data, the initial early warning configuration data are read, the read initial early warning configuration data are classified according to early warning types through a preset classification network to obtain classification configuration data, label information in the classification configuration data is extracted through a preset label extraction algorithm to obtain the early warning configuration types of the initial early warning configuration data, the format of the initial early warning configuration data is converted into an early warning configuration format which accords with a system monitoring alarm framework, and early warning configuration data to be processed are obtained.
The server obtains fields of the early warning configuration data to be processed, traversal and similarity calculation are carried out on a preset configuration file set through a preset edit distance algorithm based on the early warning configuration types and the fields to obtain a similarity value set, the configuration file sets are sorted according to the sequence of the similarity value set values from large to small, the first sorted configuration file is determined to be a configuration file to be written in, the early warning configuration data to be processed are written in the configuration file to be written in, and therefore an initial early warning configuration file yml is obtained. By reading the initial early warning configuration data, processing the format standardization and writing the configuration file to be written, the processing efficiency and the safety of the initial early warning configuration file are improved, and the processing reliability of the early warning configuration data is improved.
203. And detecting the initial early warning configuration file to obtain a target early warning configuration file meeting preset detection conditions, and writing the target early warning configuration file into a preset distributed system.
Specifically, the server detects initial early warning configuration data in the initial early warning configuration file through preset detection conditions to obtain a target early warning configuration file meeting the preset detection conditions, wherein the preset detection conditions comprise a grammar detection rule, a format detection rule, a missing item detection rule and a safety detection rule; and splitting the subfiles of the target early warning configuration file to obtain a plurality of split configuration files, and serially loading the split configuration files to a preset distributed system.
The preset detection condition may include other detection rules besides the syntax detection rule, the format detection rule, the missing item detection rule, and the security detection rule, and a detection order of the syntax detection rule, the format detection rule, the missing item detection rule, the security detection rule, and the like in the preset detection condition is not limited, where one detection order is exemplified, for example: the server carries out grammar detection on the initial early warning configuration file according to grammar detection rules in preset detection conditions, and carries out grammar adjustment on contents which do not accord with the grammar rules to obtain a first detection configuration file; judging whether the format of the first detection configuration file is the format of the system monitoring alarm frame in the format detection rule, if so, determining the first detection configuration file as a second detection configuration file, if not, performing format conversion on the first detection configuration file to obtain a second detection configuration file, acquiring null value items of the second detection configuration file, judging whether the null value items are missing items according to a missing item detection rule, if so, marking and missing value filling are carried out on the empty value items to obtain a third detection configuration file, if not, the second detection configuration file is determined as the third detection configuration file, judging whether the third detection configuration file has potential safety hazard information or not through safety detection rules, if so, calling a safety processing script, and carrying out security processing on the third detection configuration file to obtain a target configuration file, and if not, determining the third detection configuration file as the target early warning configuration file.
The method comprises the steps that a server splits a target configuration file according to a preset splitting strategy, wherein the preset splitting strategy comprises splitting size and splitting quantity, so that a plurality of splitting configuration files are obtained, a plurality of processes corresponding to the splitting configuration files are created, each process comprises a parent process and a plurality of child processes, the parent process corresponds to a target early warning configuration file, one child process corresponds to one splitting configuration file, a command line tool kubecect in a preset open source container cluster kubernates is called, the splitting configuration files are led into a preset distributed system based on the multiple processes, and the distributed system can be a high-availability key value storage system ETCD.
Specifically, the server splits a subfile of a target early warning configuration file according to a preset splitting strategy to obtain a plurality of splitting configuration files, and reads data of the splitting configuration files to obtain splitting configuration file data corresponding to each splitting configuration file; respectively writing the splitting configuration file data corresponding to each splitting configuration file into a preset message queue to obtain a configuration message queue corresponding to each splitting configuration file; and storing the target early warning configuration file to a preset distributed system through a configuration message queue corresponding to each split configuration file.
The method comprises the steps that a server obtains the file size and the data number of a target early warning configuration file, retrieves a preset splitting strategy according to the file size and the data number to obtain target splitting information, the preset splitting strategy comprises the splitting size and the splitting number, the target early warning configuration file is split into a plurality of splitting configuration files of the sub-file number in the target splitting information according to the sequence of the target early warning configuration file, and splitting configuration file data in each splitting configuration file are read. The server creates indexes among a plurality of splitting configuration files, creates sub-indexes of splitting configuration file data in each splitting configuration file based on the created indexes, sequentially writes the splitting configuration file data of the created sub-indexes into corresponding preset message queues according to the splitting configuration files, or randomly extracts the splitting configuration file data corresponding to all the splitting configuration files and writes the splitting configuration file data into the preset message queues, so that a configuration message queue corresponding to each splitting configuration file is obtained, and a target early warning configuration file is stored into a preset distributed system through the configuration message queue corresponding to each splitting configuration file. The target early warning configuration file is subjected to subfile splitting and is stored in the preset distributed system, so that the access efficiency and the access safety of the target early warning configuration file are improved, decoupling of a processing system of initial early warning configuration data is realized, and the processing reliability of the early warning configuration data is improved.
204. And reading early warning configuration data of a target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain target early warning configuration data.
The process of step 204 is similar to the process of step 104, and is not described herein again.
205. Acquiring initial monitoring data of a preset monitoring system, comparing and analyzing the initial monitoring data through target early warning configuration data, generating early warning information, and obtaining target monitoring information.
Specifically, the server calls a preset interface to read initial monitoring data of a preset monitoring system, and carries out monitoring type classification on the initial monitoring data through a preset classification model to obtain a monitoring type; matching early warning configuration data corresponding to the monitoring type from the target early warning configuration data to obtain monitoring configuration data; and based on a preset neural network model and monitoring configuration data, performing early warning feature extraction, early warning feature matching and early warning information template writing on the initial monitoring data in sequence to obtain target monitoring information.
The initial monitoring data comprises data obtained by performing data analysis on data of a target vertical field and/or operation data of a processing system of the target vertical field, the data of the target vertical field can be medical data, the data obtained by performing data analysis on the medical data in the initial monitoring data can comprise prediction data and access analysis data of the medical data, the prediction data comprises but is not limited to prediction operation time, prediction accuracy, prediction result abnormity, model training data and the like, and the operation data of the processing system of the medical data comprises but is not limited to resource occupation ratio, operation condition and the like. The server calls a preset interface to read initial monitoring data monitored by a preset monitoring system, classifies the monitoring types of the initial monitoring data through a preset classification model to obtain classification label information, extracts the monitoring types in the classification label information to obtain the monitoring types, obtains fields of the monitoring types, retrieves and matches target early warning configuration data through the fields of the monitoring types to obtain corresponding monitoring configuration data, the monitoring configuration data comprises early warning monitoring items and early warning conditions, calls a preset neural network model, extracts early warning characteristics of multiple levels from the initial monitoring data to obtain initial early warning characteristics, matches the initial early warning characteristics with a preset early warning characteristic library to obtain corresponding candidate early warning characteristics, and filters the candidate early warning characteristics based on the configuration items of the monitoring configuration data to obtain the target early warning characteristics, and converting the data format of the initial monitoring data corresponding to the target early warning characteristics into the data format of the early warning information template to obtain target data, writing the target data into the early warning information template to obtain initial monitoring information, and detecting the correctness and integrity of the initial monitoring information to obtain target monitoring information.
Through the target early warning configuration data, the monitoring data are contrastively analyzed and early warning information is generated, the universality of system processing corresponding to the target early warning configuration data is improved, the versatility, the processing flexibility and the processing efficiency of the target early warning configuration data are improved, and the processing automation of the target early warning configuration data is enhanced.
206. And acquiring evaluation information based on the target monitoring information and the target early warning configuration data, and optimizing the execution process of the target monitoring information and the target early warning configuration data according to the evaluation information and a preset optimization algorithm.
The server generates a target report according to the target monitoring information and the target early warning configuration data, and sends the target report, sequentially sending the evaluation results to a preset evaluation terminal according to the levels, auditing and modifying the evaluation results of the previous level by the preset evaluation terminal of the next level so as to obtain final evaluation information, the evaluation information comprises abnormal conditions and processing duration of an execution process corresponding to the target monitoring information and the target early warning configuration data, and the satisfaction degree, the accuracy and the improvement strategy of the execution results of the target monitoring information and the target early warning configuration data, the server performs the optimization on the target monitoring information and the target early warning configuration data according to the evaluation information and a preset optimization algorithm, the execution process and the adopted model of the target monitoring information and the target early warning configuration data are optimized, so that the accuracy and the processing efficiency of the target monitoring information and the target early warning configuration data are improved, and the processing reliability of the early warning configuration data is improved.
In the embodiment of the invention, the automatic processing of the initial early warning configuration data is realized, the management convenience, the access efficiency, the reading accuracy and the access safety of the initial early warning configuration data are improved, the decoupling of a processing system of the initial early warning configuration data is realized, the processing reliability of the early warning configuration data is improved, the monitoring data is contrasted and analyzed through the target early warning configuration data to generate the early warning information, the universality of system processing corresponding to the target early warning configuration data is improved, the versatility, the processing flexibility and the processing efficiency of the target early warning configuration data are improved, the processing automation of the target early warning configuration data is enhanced, the execution process of the target monitoring information and the target early warning configuration data is optimized according to the evaluation information and the preset optimization algorithm, and the accuracy and the processing efficiency of the target monitoring information and the target early warning configuration data are improved, therefore, the processing reliability of the early warning configuration data is improved. This scheme can be applied to in the wisdom medical field to promote the construction in wisdom city.
In the above description of the processing method of the early warning configuration data in the embodiment of the present invention, referring to fig. 3, a processing device of the early warning configuration data in the embodiment of the present invention is described below, where an embodiment of the processing device of the early warning configuration data in the embodiment of the present invention includes:
the splitting and storing module 301 is configured to call a preset service interface, read initial early warning configuration data of a preset monitoring system, and split and store the initial early warning configuration data to a preset cluster, where the preset cluster is a lightweight distributed high-availability system cluster;
a generating module 302, configured to invoke a preset lightweight configuration management system, read initial early warning configuration data in a preset cluster, and generate a configuration file to obtain an initial early warning configuration file;
the detection module 303 is configured to detect the initial early warning configuration file to obtain a target early warning configuration file meeting a preset detection condition, and write the target early warning configuration file into a preset distributed system;
the reading module 304 is configured to read, through a preset system monitoring alarm framework, the early warning configuration data of the target early warning configuration file in the distributed system to obtain target early warning configuration data.
The function implementation of each module in the processing apparatus for early warning configuration data corresponds to each step in the processing method embodiment for early warning configuration data, and the function and implementation process thereof are not described in detail herein.
In the embodiment of the invention, the automatic processing of the initial early warning configuration data is realized, the management convenience, the access efficiency, the reading correctness and the access safety of the initial early warning configuration data are improved, and the decoupling of a processing system of the initial early warning configuration data is realized, so that the processing reliability of the early warning configuration data is improved. This scheme can be applied to in the wisdom medical field to promote the construction in wisdom city.
Referring to fig. 4, another embodiment of the apparatus for processing early warning configuration data according to the embodiment of the present invention includes:
the splitting and storing module 301 is configured to call a preset service interface, read initial early warning configuration data of a preset monitoring system, and split and store the initial early warning configuration data to a preset cluster, where the preset cluster is a lightweight distributed high-availability system cluster;
a generating module 302, configured to invoke a preset lightweight configuration management system, read initial early warning configuration data in a preset cluster, and generate a configuration file to obtain an initial early warning configuration file;
the detection module 303 is configured to detect the initial early warning configuration file to obtain a target early warning configuration file meeting a preset detection condition, and write the target early warning configuration file into a preset distributed system;
a reading module 304, configured to read, through a preset system monitoring alarm framework, early warning configuration data of a target early warning configuration file in a distributed system to obtain target early warning configuration data;
the analysis module 305 is configured to obtain initial monitoring data of a preset monitoring system, perform comparative analysis on the initial monitoring data through target early warning configuration data, and generate early warning information to obtain target monitoring information;
and the optimization module 306 is configured to acquire evaluation information based on the target monitoring information and the target early warning configuration data, and optimize an execution process of the target monitoring information and the target early warning configuration data according to the evaluation information and a preset optimization algorithm.
Optionally, the split storage module 301 may be further specifically configured to:
when the completion of the updating of the object creating information in the preset monitoring system is monitored in real time through a preset monitoring pool, calling a preset service interface, and reading initial early warning configuration data corresponding to the object creating information in the preset monitoring system, wherein the object creating information comprises monitoring service configuration object information and early warning rule configuration object information;
splitting the initial early warning configuration data and verifying the splitting result to obtain split configuration data;
and creating key value pairs of the split configuration data, and storing the key value pairs to a preset cluster.
Optionally, the generating module 302 may be further specifically configured to:
when a preset lightweight configuration management system monitors initial early warning configuration data stored in a preset cluster in real time, reading the initial early warning configuration data from the preset cluster;
acquiring an early warning configuration type of initial early warning configuration data, and carrying out format standardization processing on the initial early warning configuration data to obtain early warning configuration data to be processed;
and acquiring a to-be-written configuration file corresponding to the early warning configuration type, and writing the to-be-processed early warning configuration data into the to-be-written configuration file to obtain an initial early warning configuration file, wherein the format of the to-be-written configuration file is a system monitoring alarm framework format.
Optionally, the detecting module 303 includes:
a detecting unit 3031, configured to detect, through a preset detection condition, initial early warning configuration data in the initial early warning configuration file to obtain a target early warning configuration file meeting the preset detection condition, where the preset detection condition includes a syntax detection rule, a format detection rule, a missing item detection rule, and a security detection rule;
the loading unit 3032 is configured to split the sub-file of the target early warning configuration file to obtain a plurality of split configuration files, and serially load the plurality of split configuration files to a preset distributed system.
Optionally, the loading unit 3032 may further be specifically configured to:
according to a preset splitting strategy, performing subfile splitting on a target early warning configuration file to obtain a plurality of split configuration files, and performing data reading on the plurality of split configuration files to obtain split configuration file data corresponding to each split configuration file;
respectively writing the splitting configuration file data corresponding to each splitting configuration file into a preset message queue to obtain a configuration message queue corresponding to each splitting configuration file;
and storing the target early warning configuration file to a preset distributed system through a configuration message queue corresponding to each split configuration file.
Optionally, the analysis module 305 may be further specifically configured to:
calling a preset interface to read initial monitoring data of a preset monitoring system, and classifying the monitoring types of the initial monitoring data through a preset classification model to obtain the monitoring types;
matching early warning configuration data corresponding to the monitoring type from the target early warning configuration data to obtain monitoring configuration data;
and based on a preset neural network model and monitoring configuration data, performing early warning feature extraction, early warning feature matching and early warning information template writing on the initial monitoring data in sequence to obtain target monitoring information.
The function implementation of each module and each unit in the processing apparatus for early warning configuration data corresponds to each step in the processing method embodiment for early warning configuration data, and the function and implementation process thereof are not described in detail herein.
In the embodiment of the invention, the automatic processing of the initial early warning configuration data is realized, the management convenience, the access efficiency, the reading accuracy and the access safety of the initial early warning configuration data are improved, the decoupling of a processing system of the initial early warning configuration data is realized, the processing reliability of the early warning configuration data is improved, the monitoring data is contrasted and analyzed through the target early warning configuration data to generate the early warning information, the universality of system processing corresponding to the target early warning configuration data is improved, the versatility, the processing flexibility and the processing efficiency of the target early warning configuration data are improved, the processing automation of the target early warning configuration data is enhanced, the execution process of the target monitoring information and the target early warning configuration data is optimized according to the evaluation information and the preset optimization algorithm, and the accuracy and the processing efficiency of the target monitoring information and the target early warning configuration data are improved, therefore, the processing reliability of the early warning configuration data is improved. This scheme can be applied to in the wisdom medical field to promote the construction in wisdom city.
Fig. 3 and fig. 4 describe the processing apparatus of the early warning configuration data in the embodiment of the present invention in detail from the perspective of the modular functional entity, and the processing apparatus of the early warning configuration data in the embodiment of the present invention is described in detail from the perspective of hardware processing.
Fig. 5 is a schematic structural diagram of an early warning configuration data processing device according to an embodiment of the present invention, where the early warning configuration data processing device 500 may generate a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 510 (e.g., one or more processors) and a memory 520, and one or more storage media 530 (e.g., one or more mass storage devices) for storing applications 533 or data 532. Memory 520 and storage media 530 may be, among other things, transient or persistent storage. The program stored on the storage medium 530 may include one or more modules (not shown), each of which may include a series of instruction operations in the processing device 500 for alert configuration data. Still further, the processor 510 may be configured to communicate with the storage medium 530, and execute a series of instruction operations in the storage medium 530 on the processing device 500 for the early warning configuration data.
The processing device 500 of the early warning configuration data may also include one or more power supplies 540, one or more wired or wireless network interfaces 550, one or more input-output interfaces 560, and/or one or more operating systems 531, such as Windows server, Mac OS X, Unix, Linux, FreeBSD, and the like. Those skilled in the art will appreciate that the configuration of the processing device of the early warning configuration data shown in fig. 5 does not constitute a limitation of the processing device of the early warning configuration data, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium, and which may also be a volatile computer-readable storage medium, having stored therein instructions, which, when executed on a computer, cause the computer to perform the steps of the method for processing the warning configuration data.
Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A processing method of early warning configuration data is characterized in that the processing method of the early warning configuration data comprises the following steps:
calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster, wherein the preset cluster is a lightweight distributed high-availability system cluster;
calling a preset lightweight configuration management system, reading initial early warning configuration data in a preset cluster and generating a configuration file to obtain an initial early warning configuration file;
detecting the initial early warning configuration file to obtain a target early warning configuration file meeting preset detection conditions, and writing the target early warning configuration file into a preset distributed system;
and reading early warning configuration data of the target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain target early warning configuration data.
2. The method for processing early warning configuration data according to claim 1, wherein the calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster comprises:
when the completion of the updating of object creating information in a preset monitoring system is monitored in real time through a preset monitoring pool, calling a preset service interface, and reading initial early warning configuration data corresponding to the object creating information in the preset monitoring system, wherein the object creating information comprises monitoring service configuration object information and early warning rule configuration object information;
splitting and verifying the splitting result of the initial early warning configuration data in sequence to obtain splitting configuration data;
and creating key value pairs of the splitting configuration data, and storing the key value pairs to a preset cluster.
3. The method for processing early warning configuration data according to claim 1, wherein the calling a preset lightweight configuration management system to read initial early warning configuration data in the preset cluster and generate a configuration file to obtain an initial early warning configuration file comprises:
when a preset lightweight configuration management system monitors that the preset cluster stores the initial early warning configuration data in real time, reading the initial early warning configuration data from the preset cluster;
acquiring an early warning configuration type of the initial early warning configuration data, and performing format standardization processing on the initial early warning configuration data to obtain early warning configuration data to be processed;
and acquiring a to-be-written configuration file corresponding to the early warning configuration type, and writing the to-be-processed early warning configuration data into the to-be-written configuration file to obtain an initial early warning configuration file, wherein the format of the to-be-written configuration file is a system monitoring alarm framework format.
4. The method for processing early warning configuration data according to claim 1, wherein the step of detecting the initial early warning configuration file to obtain a target early warning configuration file meeting a preset detection condition and writing the target early warning configuration file into a preset distributed system comprises:
detecting initial early warning configuration data in the initial early warning configuration file through preset detection conditions to obtain a target early warning configuration file meeting the preset detection conditions, wherein the preset detection conditions comprise a grammar detection rule, a format detection rule, a missing item detection rule and a safety detection rule;
and performing subfile splitting on the target early warning configuration file to obtain a plurality of split configuration files, and serially loading the split configuration files to a preset distributed system.
5. The method for processing early warning configuration data according to claim 4, wherein the splitting the target early warning configuration file into subfiles to obtain a plurality of split configuration files, and serially loading the plurality of split configuration files to a preset distributed system comprises:
according to a preset splitting strategy, performing subfile splitting on the target early warning configuration file to obtain a plurality of split configuration files, and performing data reading on the plurality of split configuration files to obtain split configuration file data corresponding to each split configuration file;
writing the splitting configuration file data corresponding to each splitting configuration file into a preset message queue respectively to obtain a configuration message queue corresponding to each splitting configuration file;
and storing the target early warning configuration file to a preset distributed system through a configuration message queue corresponding to each split configuration file.
6. The processing method of the early warning configuration data according to any one of claims 1 to 5, wherein the reading of the early warning configuration data of the target early warning configuration file in the distributed system by a preset system monitoring alarm framework further comprises, after obtaining the target early warning configuration data:
acquiring initial monitoring data of the preset monitoring system, and comparing and analyzing the initial monitoring data through the target early warning configuration data to generate early warning information to obtain target monitoring information;
and acquiring evaluation information based on the target monitoring information and the target early warning configuration data, and optimizing the execution process of the target monitoring information and the target early warning configuration data according to the evaluation information and a preset optimization algorithm.
7. The method for processing the early warning configuration data according to claim 6, wherein the obtaining of the initial monitoring data of the preset monitoring system, the performing of the comparative analysis on the initial monitoring data through the target early warning configuration data, and the generating of the early warning information to obtain the target monitoring information comprises:
calling a preset interface to read initial monitoring data of the preset monitoring system, and classifying the monitoring types of the initial monitoring data through a preset classification model to obtain the monitoring types;
matching early warning configuration data corresponding to the monitoring type from the target early warning configuration data to obtain monitoring configuration data;
and based on a preset neural network model and the monitoring configuration data, performing early warning feature extraction, early warning feature matching and early warning information template writing on the initial monitoring data in sequence to obtain target monitoring information.
8. An early warning configuration data processing device, characterized in that the early warning configuration data processing device comprises:
the split storage module is used for calling a preset service interface, reading initial early warning configuration data of a preset monitoring system, and splitting and storing the initial early warning configuration data to a preset cluster, wherein the preset cluster is a lightweight distributed high-availability system cluster;
the generating module is used for calling a preset lightweight configuration management system, reading initial early warning configuration data in the preset cluster and generating a configuration file to obtain an initial early warning configuration file;
the detection module is used for detecting the initial early warning configuration file to obtain a target early warning configuration file meeting a preset detection condition, and writing the target early warning configuration file into a preset distributed system;
and the reading module is used for reading the early warning configuration data of the target early warning configuration file in the distributed system through a preset system monitoring alarm framework to obtain the target early warning configuration data.
9. A device for processing early warning configuration data, the device comprising: a memory and at least one processor, the memory having instructions stored therein;
the at least one processor invokes the instructions in the memory to cause the processing device of the early warning configuration data to perform the processing method of early warning configuration data according to any one of claims 1 to 7.
10. A computer-readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement a method for processing early warning configuration data according to any of claims 1-7.
CN202110433773.9A 2021-04-22 2021-04-22 Processing method, device, equipment and storage medium of early warning configuration data Active CN113517998B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110433773.9A CN113517998B (en) 2021-04-22 2021-04-22 Processing method, device, equipment and storage medium of early warning configuration data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110433773.9A CN113517998B (en) 2021-04-22 2021-04-22 Processing method, device, equipment and storage medium of early warning configuration data

Publications (2)

Publication Number Publication Date
CN113517998A true CN113517998A (en) 2021-10-19
CN113517998B CN113517998B (en) 2024-04-09

Family

ID=78062601

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110433773.9A Active CN113517998B (en) 2021-04-22 2021-04-22 Processing method, device, equipment and storage medium of early warning configuration data

Country Status (1)

Country Link
CN (1) CN113517998B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114090387A (en) * 2021-11-24 2022-02-25 建信金融科技有限责任公司 Server monitoring method and device, server and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109214741A (en) * 2017-07-07 2019-01-15 北京京东尚科信息技术有限公司 A kind of method for early warning and early warning system of monitor control index
CN111865691A (en) * 2020-07-22 2020-10-30 平安证券股份有限公司 Alarm file distribution method, device, equipment and medium based on artificial intelligence
CN112311617A (en) * 2019-08-02 2021-02-02 中国移动通信有限公司政企客户分公司 Configured data monitoring and alarming method and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109214741A (en) * 2017-07-07 2019-01-15 北京京东尚科信息技术有限公司 A kind of method for early warning and early warning system of monitor control index
CN112311617A (en) * 2019-08-02 2021-02-02 中国移动通信有限公司政企客户分公司 Configured data monitoring and alarming method and system
CN111865691A (en) * 2020-07-22 2020-10-30 平安证券股份有限公司 Alarm file distribution method, device, equipment and medium based on artificial intelligence

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114090387A (en) * 2021-11-24 2022-02-25 建信金融科技有限责任公司 Server monitoring method and device, server and storage medium

Also Published As

Publication number Publication date
CN113517998B (en) 2024-04-09

Similar Documents

Publication Publication Date Title
CN111813845B (en) Incremental data extraction method, device, equipment and medium based on ETL task
CN111858352B (en) Method, device, equipment and storage medium for automatic test monitoring
CN112307374A (en) Jumping method, device and equipment based on backlog and storage medium
CN113687972B (en) Processing method, device, equipment and storage medium for abnormal data of business system
CN115794798B (en) Market supervision informatization standard management and dynamic maintenance system and method
CN115576999B (en) Task data processing method, device and equipment based on cloud platform and storage medium
CN113221570A (en) Processing method, device, equipment and storage medium based on-line inquiry information
CN114328095A (en) Task abnormity warning method and device
CN113656183B (en) Task processing method, device, equipment and storage medium
CN116361147A (en) Method for positioning root cause of test case, device, equipment, medium and product thereof
CN113517998B (en) Processing method, device, equipment and storage medium of early warning configuration data
CN114880312A (en) Flexibly-set application system service data auditing method
CN114385668A (en) Cold data cleaning method, device, equipment and storage medium
CN110941957A (en) Traffic science and technology data indexing method and system
CN114238474A (en) Data processing method, device and equipment based on drainage system and storage medium
CN113742329A (en) Data checking method, device, equipment and storage medium
CN115147020B (en) Decoration data processing method, device, equipment and storage medium
CN114465875B (en) Fault processing method and device
CN115470034A (en) Log analysis method, device and storage medium
CN115017187A (en) Data query method, device, equipment and storage medium
CN114610590A (en) Method, device and equipment for determining operation time length and storage medium
CN114245895A (en) Method for generating consistent representation for at least two log files
CN115203057B (en) Low code test automation method, device, equipment and storage medium
CN113190805B (en) Code asset management system
CN114611114A (en) Code auditing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant