CN113934592A - Data processing method and device and storage medium - Google Patents

Data processing method and device and storage medium Download PDF

Info

Publication number
CN113934592A
CN113934592A CN202111144920.7A CN202111144920A CN113934592A CN 113934592 A CN113934592 A CN 113934592A CN 202111144920 A CN202111144920 A CN 202111144920A CN 113934592 A CN113934592 A CN 113934592A
Authority
CN
China
Prior art keywords
information
monitoring system
installation
zabix
configuration information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111144920.7A
Other languages
Chinese (zh)
Inventor
田川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Technology Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Technology Co Ltd
Priority to CN202111144920.7A priority Critical patent/CN113934592A/en
Publication of CN113934592A publication Critical patent/CN113934592A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324—Display of status information
    • G06F11/327—Alarm or error message display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/61—Installation

Abstract

The invention discloses a data processing method, a device and a storage medium, wherein the method comprises the following steps: acquiring installation process configuration information, wherein the installation process configuration information comprises preset installation task definition information and task execution sequence information; installing a bundle monitoring system based on the installation task definition information and the task execution sequence information; the zabix monitoring system can automatically acquire data of the target object to be monitored through a preset interface so as to monitor the target object to be monitored. The data of the target object to be monitored is acquired through the preset interface of the Zabyx monitoring system so as to monitor the equipment to be monitored, so that the data of the target object to be monitored can be acquired automatically and standardly, and the deployment efficiency of the Zabyx monitoring system is improved. By adopting the technical scheme, the method and the device can realize rapid automatic deployment of the zabyx monitoring system.

Description

Data processing method and device and storage medium
Technical Field
The present invention relates to the field of communications, and in particular, to a data processing method, apparatus, and storage medium.
Background
Database operation and maintenance management is an important component in IT service work. In the face of increasingly complex business systems and increasingly diversified user requirements, an increasingly reasonable working mode is needed to ensure that IT services can be continuously performed flexibly, conveniently, safely and stably, and one of important guarantee factors in the mode is database operation and maintenance management. The initial independent servers are developed to huge data centers, the requirements on technology, business, management and the like cannot be met by people independently, and the IT service cost is inevitably reduced in a standardized, streamlined and automatic mode.
In the prior art, the database operation and maintenance management is mainly performed through a large amount of manual work or scattered small tools, the maintenance cost is high, and the operability and the reliability are poor. But deployment delivery and running state of the database system directly affect the user experience of the application system. How to quickly install, deploy and deliver the database is the key to ensure the normal operation of the IT service.
The open-source free Zabbix monitoring system supports distributed centralized management, supports multiple devices and is provided with multiple monitoring templates, has the advantages of low requirement on performance of basic resources, open interface, strong expansibility, easy writing of script plug-ins and the like, and is the first choice for daily monitoring work of many IT operation and maintenance personnel at present. However, the traditional Zabbix monitoring system is based on the LAMP architecture, mainly uses the relational database MySQL to store business data, and has the disadvantages of poor database efficiency and large disk storage space occupation when a large number of monitoring devices are used. Therefore, the TimescaleDB (i.e. time sequence database) with high performance, convenient management, strong expansion and small disk occupation becomes a data storage scheme recommended by Zabbix officials. However, at present, there is no method for automatically deploying TimescaleDB and Zabbix quickly and conveniently, so that many operation and maintenance personnel are prohibitive to the Zabbix application based on the TimescaleDB database.
In the prior art, when a Zabbix monitoring system is installed and deployed, operation and maintenance personnel are generally required to manually introduce information such as a monitoring template and a host to be monitored into the Zabbix monitoring system, so that the installation speed of the Zabbix monitoring system is low, and automatic and rapid installation cannot be realized.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a data processing device and a data storage medium, which are used for at least solving the problem that a zabyx monitoring system cannot be automatically deployed quickly in the related art.
According to an embodiment of the present invention, there is provided a data processing method, including: acquiring installation process configuration information, wherein the installation process configuration information comprises preset installation task definition information and task execution sequence information; installing a bundle monitoring system based on the installation task definition information and the task execution sequence information; installing the bundle monitoring system based on the configuration information under the condition that the local information and the installation package information are determined to meet preset conditions; the zabix monitoring system can automatically acquire data of a target object to be monitored through a preset interface so as to monitor the target object to be monitored.
In an exemplary embodiment, the installation process configuration information further includes network information, the network information includes a preset website for acquiring the zabix monitoring system, and before installing the zabix monitoring system based on the installation task definition information and the task execution sequence information, the method further includes: acquiring local information based on the installation flow configuration information, and judging whether the local information and the installation package information meet preset conditions; installing the bundle monitoring system based on the installation flow configuration information under the condition that the local information and the installation package information are determined to meet preset conditions; and acquiring the installation package information of the Zabix monitoring system based on the installation task definition information, the task execution sequence information and the network information.
In an exemplary embodiment, the method of installing the zabix monitoring system based on the installation flow configuration information further comprises: detecting supporting component information of the bundle monitoring system based on the local information and the installation process configuration information; and judging whether the supporting component information meets a preset condition or not, and installing the supporting component of the zabix monitoring system based on the supporting component information, the installation task definition information and the task execution sequence information under the condition that the supporting component information meets the preset condition.
In an exemplary embodiment, the zabix monitoring system includes a database, the database is used for storing data of the target object to be monitored, and the method for installing the zabix monitoring system based on the installation process configuration information further includes: installing the database based on the installation process configuration information; and acquiring initial information of the zabix monitoring system, and importing the initial information into the database, wherein the initial information is used for initializing the database.
In an exemplary embodiment, installing the zabix monitoring system based on the installation flow configuration information further comprises; and acquiring system parameters of the zabix monitoring system based on the installation process configuration information, wherein the system parameters are used for representing basic parameters of the zabix monitoring system after the installation is finished.
In an exemplary embodiment, after installing the zabix monitoring system based on the installation flow configuration information comprises: judging whether the installation of the zab monitoring system is successful; and under the condition that the installation of the bundle monitoring system is determined to be successful, ending the installation process of the bundle monitoring system, and under the condition that the installation of the bundle monitoring system is determined to be unsuccessful, installing the bundle monitoring system based on the installation flow configuration information again.
In an exemplary embodiment, the data of the target object to be monitored includes at least one of monitoring template information, monitored host information, and alarm configuration parameter information.
In one exemplary embodiment, the database comprises a time series database.
According to another embodiment of the present invention, there is also provided a data processing apparatus including: the acquisition module is used for acquiring the configuration information of the installation process; the installation module is used for installing the zabyx monitoring system based on the installation process configuration information; a determination module for determining whether the installation of the zabix monitoring system is successful.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above data processing method when running.
In the embodiment of the invention, installation flow configuration information is obtained, wherein the installation flow configuration information comprises preset installation task definition information and task execution sequence information; installing a bundle monitoring system based on the installation task definition information and the task execution sequence information; installing the bundle monitoring system based on the configuration information under the condition that the local information and the installation package information are determined to meet preset conditions; the zabix monitoring system can automatically acquire data of a target object to be monitored through a preset interface so as to monitor the target object to be monitored. The method comprises the steps of installing a zabix monitoring system according to configuration information based on an installation process, automatically and quickly deploying the zabix monitoring system, acquiring data of a target object to be monitored through a preset interface of the zabix monitoring system to monitor equipment to be monitored, automatically and standardly acquiring the data of the target object to be monitored, and improving deployment efficiency of the zabix monitoring system. By adopting the technical scheme, the efficiency of deploying the zabix monitoring system is effectively improved, and the rapid automatic deployment of the zabix monitoring system can be realized.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a computer terminal of a data processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a method of processing data according to an embodiment of the invention;
FIG. 3 is a flow chart of a method of processing data according to an embodiment of the invention;
fig. 4 is a flowchart of a front-end application configuration of a processing method of data according to an embodiment of the present invention;
fig. 5 is a block diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The method embodiments provided in the present application may be executed in a computer terminal, a computer terminal or a similar computing device. Taking the example of the present invention running on a computer terminal, fig. 1 is a block diagram of a hardware structure of a computer terminal of a data processing method according to an embodiment of the present invention. As shown in fig. 1, the computer terminal may include one or more (only one shown in fig. 1) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and in an exemplary embodiment, may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the computer terminal. For example, the computer terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration with equivalent functionality to that shown in FIG. 1 or with more functionality than that shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the data processing method in the embodiment of the present invention, and the processor 102 executes various functional applications and data by running the computer programs stored in the memory 104, so as to implement the above-mentioned method. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a computer terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
Fig. 2 is a schematic diagram of a data processing method according to an embodiment of the present invention, including the following steps:
step S102, obtaining installation process configuration information, wherein the installation process configuration information comprises preset installation task definition information and task execution sequence information;
step S104, installing a bundle monitoring system based on the installation task definition information and the task execution sequence information;
step S106, the Zabix monitoring system can automatically acquire the data of the target object to be monitored through a preset interface so as to monitor the target object to be monitored.
In this application, the zabix monitoring system refers to a zabbix monitoring system and a database for storing information of devices to be monitored.
In the data processing method, firstly, installation flow configuration information is obtained, wherein the installation flow configuration information comprises preset installation task definition information and task execution sequence information, then, a bundle monitoring system is installed based on the installation task definition information and the task execution sequence information, and finally, the bundle monitoring system can automatically obtain data of a target object to be monitored through a preset interface so as to monitor the target object to be monitored. The method comprises the steps of installing a zabix monitoring system according to configuration information based on an installation process, automatically and quickly deploying the zabix monitoring system, acquiring data of a target object to be monitored through a preset interface of the zabix monitoring system to monitor equipment to be monitored, automatically and standardly acquiring the data of the target object to be monitored, and improving deployment efficiency of the zabix monitoring system. By adopting the technical scheme, the efficiency of deploying the zabix monitoring system is effectively improved, and the rapid automatic deployment of the zabix monitoring system can be realized.
In step 102, obtaining the installation process configuration information includes a technician first maintaining a pre-written installation configuration file, and reading the installation configuration file to obtain the installation process configuration information
In step S106, the zabbx monitoring system may automatically obtain data of the target object to be monitored through the preset interface, so that monitoring the target object to be monitored may be understood as that the zabbx monitoring system automatically monitors the target object to be monitored after automatically importing the data of the target object to be monitored through the preset interface, where the preset interface is an API interface of the zabbix monitoring system itself, and information such as a monitoring template and a monitoring host may be automatically and quickly imported through the API interface, so that the zabbix monitoring system may automatically and normatively write in the data of the target object to be monitored, thereby greatly improving efficiency of deploying the zabbix monitoring system.
In an exemplary embodiment, the installation process configuration information further includes network information, the network information includes a preset website for acquiring the zabix monitoring system, and before installing the zabix monitoring system based on the installation task definition information and the task execution sequence information, the method further includes: acquiring local information based on the installation flow configuration information, and judging whether the local information and the installation package information meet preset conditions; installing the bundle monitoring system based on the installation flow configuration information under the condition that the local information and the installation package information are determined to meet preset conditions; and acquiring the installation package information of the Zabix monitoring system based on the installation task definition information, the task execution sequence information and the network information.
Before that, the system firstly runs an installation configuration file to initialize a system installation environment, installation flow configuration information comprises network information, installation task definition information and task execution sequence information, and the network information comprises ip information of a zabbix monitoring system. Obtaining the local information and the installation package information of the zabbx monitoring system based on the installation process configuration information can be understood as automatically downloading the installation package of the zabbix monitoring system from a preset website based on the installation task definition information, the task execution sequence information and the ip information. After downloading is finished, detecting a local server based on the installation process configuration information, taking the detected server scale parameter, server memory parameter, server processor parameter and other parameters as local information, and judging whether the local information and the installation package information meet preset conditions. If the scale parameter of the server and the installation package information of the zabbix monitoring system do not meet the preset condition, the scale parameter of the server and the monitoring capability of the zabbix monitoring system are not adapted. And under the condition that the local information and the installation package information are determined to meet the preset conditions, installing the bundle-based monitoring system based on the installation flow configuration information. Wherein, the zabix monitoring system can also be another monitoring system.
Under the condition that the local information and the installation package information are determined to meet the preset conditions, the installation of the zab monitoring system based on the installation process configuration information can be understood as that the zab monitoring system is installed based on the installation process configuration information under the condition that the zabbix monitoring system containing the local information server and the installation package information are adapted; and when the zabbix monitoring system containing the local information server and the installation package information is not adaptive, stopping installing the zabix monitoring system.
Specifically, the installation task definition information and the task execution sequence information include yum source information and apt source information, and based on the installation flow configuration information, yum source information is acquired when the operating system is identified as the RHEL operating system or the CentOS operating system, and apt source information is acquired when the operating system is identified as the Debian operating system or the Ubuntu operating system. Yum is a front-end software package manager, which can automatically download and install installation packages from a designated server, automatically process dependency relationship, and install all dependent software packages at one time without complicated downloading and installation at one time.
In one exemplary embodiment, the method of installing a zabix monitoring system based on installation flow configuration information further comprises: detecting supporting component information of the zabyx monitoring system based on the local information and the installation process configuration information; and judging whether the supporting component information meets a preset condition or not, and installing the supporting component of the Zabix monitoring system based on the supporting component information, the installation task definition information and the task execution sequence information under the condition that the supporting component information meets the preset condition.
In other words, the method for installing the zabbx monitoring system based on the installation process configuration information further includes first detecting a version of the operating system of the local server and the already-provided supporting components of the zabbix monitoring system, where the local information includes version information of the operating system of the local server and information of the already-provided supporting components of the zabbix monitoring system.
In an exemplary embodiment, the method for installing the zabix monitoring system based on the installation process configuration information further includes: installing a database based on the installation flow configuration information; the method comprises the steps of obtaining initial information of the zabix monitoring system, and importing the initial information into a database, wherein the initial information is used for initializing the database.
The zabix monitoring system comprises a database, wherein the database can be various types of databases, such as a Mysql database, an Hbase database and a Timescale database, and the database is used for storing data of a target object to be monitored, and can be understood as importing information of a monitoring template, a host to be monitored and the like into the database. After the database is installed based on the installation process configuration information, the database needs to be initialized, that is, the initial information of the zabix monitoring system is imported into the database. The initial information for the zabix monitoring system may be an sql instruction file. After the initial information of the zabyx monitoring system is imported into the database, the database is connected with the zabyx monitoring system, and the database acquires information such as an initial account number, an initial password and the like of the zabyx monitoring system.
In an exemplary embodiment, installing the zabix monitoring system based on the installation flow configuration information further comprises; and acquiring system parameters of the zabix monitoring system based on the installation process configuration information, wherein the system parameters are used for representing basic parameters of the zabix monitoring system after installation.
And acquiring system parameters of the zabix monitoring system based on the installation process configuration information, wherein the system parameters are used for representing basic parameters of the zabix monitoring system after installation. It may be understood that the system parameters of the automatically set zabix monitoring system are obtained based on the installation process configuration information, where the system parameters of the zabix monitoring system include basic parameters of the PHP language environment and basic parameters of the database, and system parameters of other parts of the zabix monitoring system. When a zabyx monitoring system is initially deployed, the system parameters of the zabyx monitoring system are usually required to be set in a self-adaptive manner, and then the system parameters of the zabyx monitoring system are acquired based on the installation process configuration information, so that the monitoring performance of the zabyx monitoring system can be reasonably exerted, and useless energy consumption and equipment occupancy caused by too low system parameter setting of the zabyx monitoring system are avoided.
In an exemplary embodiment, installing the zabix monitoring system based on the installation flow configuration information comprises: judging whether the installation of the zab monitoring system is successful; and under the condition that the installation of the bundle monitoring system is determined to be successful, ending the installation process of the bundle monitoring system, and under the condition that the installation of the bundle monitoring system is determined to be unsuccessful, installing the bundle monitoring system based on the installation flow configuration information again.
In other words, the above-described embodiments relate to a determination of whether installation of the zabix monitoring system was successful based on the installation flow configuration information, i.e., in the case where it is determined that the installation of the zabix monitoring system was successful, the entire installation flow ends, and the user is prompted on the front end page that the installation is complete,
further, verifying whether installation of the zabix monitoring system based on the installation process configuration information is successful is the following process: firstly, whether the process of the zabix monitoring system exists or not is verified, then whether the front section page of the zabix monitoring system is normal or not is verified, a 404 value is returned after the test, the fact that the front section page of the zabix monitoring system is abnormal is determined, and finally whether the installed zabix monitoring system can operate successfully or not is verified based on initial information.
In an exemplary embodiment, the data of the target object to be monitored includes at least one of monitoring template information, monitored host information, and alarm configuration parameter information. And under the condition that the installation of the zabix monitoring system is determined to be unsuccessful, installing the zabix monitoring system again based on the installation flow configuration information, and returning back to the installation flow for installation again.
In one exemplary embodiment, the database comprises a time series database.
The time sequence database in the application is a Timescale database, and the Timescale database has the advantages of high performance, convenience in management, strong expansion, small disk occupation and the like.
In order to better understand the process of the data processing method, the following describes a flow of an implementation method of the data processing with reference to an alternative embodiment, but the flow is not limited to the technical solution of the embodiment of the present invention.
In the present embodiment, a data processing method is provided, and fig. 3 is a schematic diagram of a first embodiment of a data processing method according to an embodiment of the present invention, as shown in fig. 3, the flow includes the following steps:
step 201: starting an installation program;
that is, the worker first introduces the installation program into the installation server, and the installation program is automatically started after the server is operated.
Step 202: installing a Postgresql database;
it should be noted that before the Timescale database is installed, a Postgresql database needs to be installed, and the Postgresql database is used as a bottom database of the Timescale database and is actually responsible for managing and storing data. In this application, references to the Timescale database all include the Postgresql database.
Step 203: installing a Timescale database;
further, installing the zabix monitoring system based on the installation process configuration information includes detecting supporting component information of the zabix monitoring system based on the local information and the installation process configuration information; and judging whether the supporting component information meets a preset condition or not, and installing the supporting component of the Zabix monitoring system based on the supporting component information, the installation task definition information and the task execution sequence information under the condition that the supporting component information meets the preset condition. Installing the zabix monitoring system based on the installation flow configuration information further comprises detecting a PHP language environment of the system and installing a PHP language software package based on the installation flow configuration information and the local information.
Step 204: installing a Zabbix monitoring system;
and installing the Zabbix monitoring system based on the installation flow configuration information.
Step 205: configuring the operation parameters of the Zabbix monitoring system;
further, the operation parameters of the Zabbix monitoring system comprise basic parameters of the PHP language environment, basic parameters of the database and system parameters of other parts of the zabix monitoring system.
Step 206: verifying whether the installation of the zabix monitoring system is successful;
if it is determined that the installation of the zabix monitoring system is successful, go to step 207; in the event that it is determined that the installation of the zabix monitoring system was unsuccessful, step 208 is performed.
Step 207: finishing the installation process and prompting the user that the installation is finished;
step 208: backing and reinstalling;
further, a report of the installation failure is generated, and the report is returned to the front-end page.
In the data processing method, the installation flow configuration information is acquired, the local information and the installation package information of the zabix monitoring system are acquired based on the installation flow configuration information, whether the current zabix system is suitable to be deployed can be judged in a self-adaptive mode according to the installation environment, the zabix monitoring system can be automatically and rapidly deployed by installing the zabix monitoring system based on the installation flow configuration information, the data of the target object to be monitored is acquired through the preset interface of the zabix monitoring system to monitor the equipment to be monitored, the data of the target object to be monitored can be acquired automatically and standardly, and the deployment efficiency of the zabix monitoring system is improved. By adopting the technical scheme, the efficiency of deploying the zabix monitoring system is effectively improved, and the rapid automatic deployment of the zabix monitoring system can be realized.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Fig. 4 is a flowchart of a front-end application configuration of a processing method of data according to an embodiment of the present invention.
Step 301: installing an agent or starting a snmp;
step 301 is the operation of the device to be monitored, i.e. optionally installing an agent or turning on a snmp.
Step 302: configuring parameters;
step 301 is the operation of the device to be monitored, that is, the user can selectively configure the parameters of the monitored device;
step 303: logging in a zabbix monitoring system;
step 304: adding users, setting alarm medium and global parameters
The warning media include warning media such as WeChat, telephone, web page, nail, etc., and the global parameter is the system parameter of the zabbix monitoring system.
Step 305: creating a template;
the zabbix monitoring system can call a monitoring template carried by the zabbix monitoring system, and a user can create a new template.
Step 306: add host (monitor host);
further, the host is the device to be monitored.
Step 307: creating item, trigger and graph;
wherein, the item is a monitoring item, such as a monitoring item for monitoring network fluctuation. trigger is a trigger, i.e. when the condition of the trigger is met, an alarm is triggered, and graph is a single chart.
Step 308: creating action;
wherein the action is alarm configuration.
An embodiment of the present invention further provides a data processing apparatus, where the data processing apparatus includes: the acquisition module is used for acquiring the configuration information of the installation process; the installation module is used for installing the zabyx monitoring system based on the installation process configuration information; and the determining module is used for determining whether the installation of the zabix monitoring system is successful.
Fig. 5 is a block diagram of a data processing apparatus according to an embodiment of the present invention; as shown in fig. 5, includes:
an obtaining module 42, configured to obtain installation process configuration information;
an installation module 44, configured to install the zabix monitoring system based on the installation process configuration information;
a determination module 46 for determining whether the installation of the zabix monitoring system is successful;
by the device, the installation process configuration information is obtained, the local information and the installation package information of the zabix monitoring system are obtained based on the installation process configuration information, whether the current zabix system is properly deployed can be judged in a self-adaptive mode according to the installation environment, the zabix monitoring system can be automatically and quickly deployed by installing the zabix monitoring system based on the installation process configuration information, the data of the target object to be monitored are obtained through the preset interface of the zabix monitoring system to monitor the equipment to be monitored, the data of the target object to be monitored can be automatically and standardly obtained, and the deployment efficiency of the zabix monitoring system is improved. By adopting the technical scheme, the efficiency of deploying the zabix monitoring system is effectively improved, and the rapid automatic deployment of the zabix monitoring system can be realized.
Embodiments of the invention also provide a storage medium comprising a stored program, wherein the program performs any of the above methods when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, acquiring installation flow configuration information, wherein the installation flow configuration information comprises preset installation task definition information and task execution sequence information;
s2, installing the bundle monitoring system based on the installation task definition information and the task execution sequence information;
s3, the Zabix monitoring system can automatically acquire the data of the target object to be monitored through a preset interface so as to monitor the target object to be monitored.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring installation flow configuration information, wherein the installation flow configuration information comprises preset installation task definition information and task execution sequence information;
s2, installing the bundle monitoring system based on the installation task definition information and the task execution sequence information;
s3, the Zabix monitoring system can automatically acquire the data of the target object to be monitored through a preset interface so as to monitor the target object to be monitored.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The invention relates to the technical field of computer automation operation and maintenance and monitoring, in particular to a method for automatically installing and deploying a Zabbix monitoring system.
In a preferred embodiment, the flow of the method for automatically installing and deploying the Zabbix monitoring system is as follows:
s1, maintaining an installation configuration file and a system operation configuration file;
the configuration file is a pre-written file. The configuration file contains yum source or apt source information, TimescaleDB database and Zabbix server IP information.
S2, initializing system installation, reading installation configuration files, and acquiring yum (RHEL/CentOS operating system) or apt (Debian/Ubuntu operating system) source information;
when the operating system is an RHEL operating system or a CentOS operating system, acquiring source information; and when the operating system is a Debian operating system or a Ubuntu operating system, acquiring the source information. The system initializes or apt source files according to the installation flow configuration information.
S3, based on the installation flow configuration information, the installation program reads the server environment and starts to detect the Linux system support program components required by the installation of Zabbix and Timescale DB; the support component needs to contain libpq-dev, language-pack-zh-hans-base.
S4, based on the installation flow configuration information, the installation program detects the PHP environment in the server operating system and installs and configures the PHP software package;
the PHP software package can increase the support of PHP to timescaleDB, and a PHP7.4-pgsql component is added.
S5, based on the installation flow configuration information, the installation program completes the installation of the Timescale DB, and the database initialization configuration file is led into the Timescale DB;
the method comprises the steps of automatically reading an SQL (structured query language) file attached to a Zabbix installation package, and importing a basic model required by Zabbix operation into a Timescale DB (database) according to installation process configuration information. The SQL file is the initial information.
S6, based on the installation flow configuration information, the installation program completes the Zabbix installation;
s7, based on the installation flow configuration information, the installation program completes the Zabbix system parameter setting based on the timescaleDB;
wherein, the Zabix system parameter setting is completed based on the Zabbix system parameter setting of the TimescaleDB. And automatically updating the Zabbix running and installing process configuration information, updating database connection and server information into a main configuration file Zabbix _ server.
And S8, based on the installation flow configuration information, the installation program calls the API interface of Zabbix, and the monitoring template, the monitored host and the configuration alarm are imported to realize the monitoring of the equipment to be monitored.
The API interface is a preset interface. And calling an API (application program interface) of the Zabbix monitoring system, automatically importing a monitoring template, information of a monitored host and alarm configuration parameters, immediately checking a real-time monitoring result, and realizing fault early warning through an alarm trigger.
In another preferred embodiment, the specific flow of the skilled person in the practice of the invention is as follows:
s1, uploading the related program file of the invention to a Linux server for deploying and operating Zabbix and timescaleDB;
s2, configuring an installation configuration file zabbix _ install.ini according to actual conditions;
s3, calling a script zabbix _ install. py, and deploying software according to the program shown in the figure 3; py is the script zabbix _ install.
S4, after the software deployment is completed, background data based on the timescaleDB library can be inquired by logging in a Zabbix foreground page;
s5, installing a deployment client or starting an accessed function (such as SNMP) on the equipment to be monitored, and completing configuration;
and S6, completing the configuration of the monitoring object, the monitoring item, the early warning and the like according to the application configuration flow in the figure 4.
In another preferred embodiment, the front-end application configuration flow is as follows:
s1, logging in a Zabbix front-end interface, adding users, and setting an alarm medium and global parameters;
s2, creating a template, adding H0ST, and judging whether the template is linked; if the template is not linked to, creating item, adding trigger, maps, graph and screen, and then entering step S3; if linking to a template, then the creation item can be selected, which proceeds directly to step S3;
wherein, item is a monitoring item, maps are topological graph, graph is a single graph, and screen is a polymerization graph.
And S3, finally, establishing a Web monitoring mechanism, creating an alarm action and finishing the whole configuration.
By adopting the technical scheme of the application, the full-automatic setting of the parameters of the Zabbix system based on the Timescale DB can be realized through a Python script by using a code injection technology based on the source code analysis of the Zabbix monitoring system and the Timescale DB; and by calling the API interface of Zabbix, the monitoring template, the monitored host and the configuration alarm are imported, so that the monitoring of the equipment to be monitored is realized. The arrangement enables the process of data of the equipment to be monitored through the API of the Zabbix to be automated and standardized, and the Zabbix monitoring system can be automatically deployed at high speed and in a standardized manner.
The automatic installation deployment and operation and maintenance monitoring method of the Zabbix monitoring system not only provides a high-efficiency and reliable operation and maintenance installation and configuration tool, but also provides a method for quickly and conveniently detecting and installing software packages, and realizes monitoring and early warning notification of common software and hardware equipment by means of a plurality of (2000) monitoring templates and by means of enterprise WeChat, mobile phone short messages, mails, nails and the like, so that the whole IT operation environment of an enterprise is automatically, accurately monitored in real time, the manual maintenance cost is saved, and the IT operation and maintenance efficiency is improved.
The data processing method of the application creatively uses the API of the monitoring system for data writing of the equipment to be monitored, can realize rapid deployment of the monitoring system, and can carry out data processing by adopting the data processing method of the application as long as the significance of the invention is not violated.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A method of processing data, the method comprising the steps of:
acquiring installation process configuration information, wherein the installation process configuration information comprises preset installation task definition information and task execution sequence information;
installing a bundle monitoring system based on the installation task definition information and the task execution sequence information;
the zabix monitoring system can automatically acquire data of a target object to be monitored through a preset interface so as to monitor the target object to be monitored.
2. The method of claim 1, wherein the installation flow configuration information further includes network information, the network information including a preset website address for obtaining the zabix monitoring system, and the method further comprises, before installing the zabix monitoring system based on the installation task definition information and the task execution order information:
acquiring local information based on the installation flow configuration information, and judging whether the local information and the installation package information meet preset conditions;
installing the bundle monitoring system based on the installation flow configuration information under the condition that the local information and the installation package information are determined to meet preset conditions;
and acquiring the installation package information of the Zabix monitoring system based on the installation task definition information, the task execution sequence information and the network information.
3. The method of claim 2, wherein installing the bundle monitoring system based on the installation flow configuration information further comprises:
detecting supporting component information of the bundle monitoring system based on the local information and the installation process configuration information;
and judging whether the supporting component information meets a preset condition or not, and installing the supporting component of the zabix monitoring system based on the supporting component information, the installation task definition information and the task execution sequence information under the condition that the supporting component information meets the preset condition.
4. The method of claim 3, wherein the bundle monitoring system includes a database for storing data of the target object to be monitored, and wherein the method of installing the bundle monitoring system based on the installation process configuration information further comprises:
installing the database based on the installation process configuration information;
and acquiring initial information of the zabix monitoring system, and importing the initial information into the database, wherein the initial information is used for initializing the database.
5. The method of claim 2, further comprising, after installing the bundle monitoring system based on the installation flow configuration information;
and acquiring system parameters of the zabix monitoring system based on the installation process configuration information, wherein the system parameters are used for representing basic parameters of the zabix monitoring system after the installation is finished.
6. The method of claim 1, wherein installing the bundle monitoring system based on the installation flow configuration information comprises, after:
judging whether the installation of the zab monitoring system is successful;
and under the condition that the installation of the bundle monitoring system is determined to be successful, ending the installation process of the bundle monitoring system, and under the condition that the installation of the bundle monitoring system is determined to be unsuccessful, installing the bundle monitoring system based on the installation flow configuration information again.
7. The method according to claim 1, wherein the data of the target object to be monitored comprises at least one of monitoring template information, monitored host information, and alarm configuration parameter information.
8. The method of claim 4, wherein the database comprises a time series database.
9. An apparatus for processing data, comprising:
the acquisition module is used for acquiring the configuration information of the installation process;
the installation module is used for installing the zabyx monitoring system based on the installation process configuration information;
a determination module for determining whether the installation of the zabix monitoring system is successful.
10. A computer-readable storage medium, comprising a stored program, wherein the program is operable to perform the method of any one of claims 1 to 9.
CN202111144920.7A 2021-09-28 2021-09-28 Data processing method and device and storage medium Pending CN113934592A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111144920.7A CN113934592A (en) 2021-09-28 2021-09-28 Data processing method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111144920.7A CN113934592A (en) 2021-09-28 2021-09-28 Data processing method and device and storage medium

Publications (1)

Publication Number Publication Date
CN113934592A true CN113934592A (en) 2022-01-14

Family

ID=79277474

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111144920.7A Pending CN113934592A (en) 2021-09-28 2021-09-28 Data processing method and device and storage medium

Country Status (1)

Country Link
CN (1) CN113934592A (en)

Similar Documents

Publication Publication Date Title
CN107896244B (en) Version file distribution method, client and server
CN110096424B (en) Test processing method and device, electronic equipment and storage medium
CN110597531B (en) Distributed module upgrading method and device and storage medium
US20120005325A1 (en) Systems and methods for automated processing of devices
CN110098952B (en) Server management method and device
CN104246697A (en) Version management for applications
CN113312064B (en) Method and device for installing and configuring physical machine and computer readable medium
CN111324522A (en) Automatic test system and method
CN110659198A (en) Application program test case execution method and device and software test system
CN111026581A (en) Application program repairing method, device, system, storage medium and electronic device
CN115016820A (en) Application program updating method, device, equipment and storage medium
CN112596784B (en) Iterative version deployment method and device
CN114546588A (en) Task deployment method and device, storage medium and electronic device
CN109992295B (en) Version management method and server
CN109471646A (en) A kind of upgrade method, device and the storage medium of the BMC version of server
CN113452556A (en) Product skill configuration method and device, storage medium and electronic device
CN113886220A (en) Application upgrade test method and tool based on Linux operating system
CN116303099B (en) Cross-platform rapid deployment method, device, medium and equipment for automatic test environment
CN113934592A (en) Data processing method and device and storage medium
CN116483416A (en) Firmware online upgrading method, server and storage medium
CN112650815B (en) Method and device for synchronizing environment data, storage medium and electronic device
CN115113890A (en) Automatic deployment method, system, equipment and medium of terminal software
CN115543491A (en) Microservice processing method and device
CN113934552A (en) Method and device for determining function code, storage medium and electronic device
CN110618943B (en) Security service test method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination