CN111104310B - Method for data center platform layer configuration compliance check and log analysis - Google Patents
Method for data center platform layer configuration compliance check and log analysis Download PDFInfo
- Publication number
- CN111104310B CN111104310B CN201911146301.4A CN201911146301A CN111104310B CN 111104310 B CN111104310 B CN 111104310B CN 201911146301 A CN201911146301 A CN 201911146301A CN 111104310 B CN111104310 B CN 111104310B
- Authority
- CN
- China
- Prior art keywords
- server
- check
- configuration
- database
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/366—Software debugging using diagnostics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method for configuration compliance check and log analysis of a data center platform layer, which comprises the steps of server configuration check, database configuration check and log collection analysis check. For each step, firstly obtaining a server list to be checked, then removing the server list which cannot be communicated on the network, then writing a script for acquiring database content and RAC database state on one server, creating a client through a paramiko packet in a python program, sending the script to each database server to be checked through the client by using sshpass for execution, keeping result files of checking results with ip addresses of the database servers as names on a main server uniformly, and acquiring database checking result items in each result file through sed according to start and end labels. The method can acquire the database content and the RAC database state more universally.
Description
Technical Field
The invention relates to the technical field of computers, in particular to data center platform layer configuration compliance inspection and log analysis.
Background
IT technology has been developed to date, and by using software automation (including automated server configuration and system management), IT has been undoubtedly helped to improve agility and efficiency, and adequately address various demands from businesses.
Urgent need of server administrator is a comprehensive heterogeneous life cycle management solution applicable to enterprise serverThe server operations are standardized, integrated and automated in its hybrid data center for operating system configuration, security patch management, auditing and compliance, and configuration management (across data centers)
Linux and->
Platform), whether running on top of physical hardware, or in a virtualized platform or cloud environment.
Disclosure of Invention
The invention aims to provide a method for configuration compliance check and log analysis of a data center platform layer, which can be used by a server administrator to comprehensively manage compliance of applications, servers, storage equipment and the like.
One technical scheme for achieving the above purpose is as follows: a method for configuration compliance check and log analysis of a data center platform layer is used for compliance management of an application, a server and a storage device, and comprises the following steps:
step 1, server configuration checking step, which comprises the following steps:
step 1.1, uploading an excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
step 1.2, performing connectivity check on the server list through a ping command, and removing the server list which cannot be communicated on the network;
step 1.3, compiling a server configuration check script for each server check configuration item on a configuration check server, creating a client through a paramiko package in a python program, remotely checking a server to be checked through a sshpass command and the server configuration check script by the client, returning a check result, and finally displaying the check result on a page;
step 2, database configuration checking, which comprises the following specific steps:
step 2.1, uploading the excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
2.2, performing connectivity check on the server list through the ping command, and removing the server list which cannot be communicated on the network;
step 2.3, compiling a database configuration check script for each database check configuration item on a configuration check server, creating a client through a paramiko package in a python program, remotely checking a database to be checked through the client by using a sshpass command and the server configuration check script, writing a return check into a txt file which is under a/tmp directory of the configuration check server and takes an ip address of the check server as a file name, reading the txt files through sed, taking out a result of each database check item, and finally displaying the result on a page;
step 3, log collection, analysis and inspection, which comprises the following specific steps:
step 3.1, uploading the excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
step 3.2, firstly, performing connectivity check on the server list through the ping command, and removing the server list which cannot be communicated on the network;
and 3.3, creating an elasticsearch service on the configuration check server, creating a client through a paramiko package in a python program, remotely copying logstack software to other remote servers through the client by using a scp command, automatically configuring logstack, sending an rsyslog log on the server to the elasticsearch server (namely, the configuration check server) on the main server, and finally displaying the configuration check server through kibana (starting the kibana service on the configuration check server), wherein the log is viewed and visualized on the kibana server by a user.
The invention discloses a method for configuring compliance check and log analysis on a data center platform layer, which comprises the steps of server configuration check, database configuration check and log collection analysis check, wherein for each step, an excel file is uploaded in advance, the excel file is read through python to obtain a server list needing to be checked, then the server list is subjected to connectivity check through a ping command to remove the server list which cannot be connected on a network, then scripts for obtaining database contents and RAC database states are compiled on one server, starting and ending labels are printed before the start and the end of each check item, a client is established through a paramiko packet in a python program, the scripts are sent to each database server needing to be checked through the client, the check result is stored on a main server by taking the ip address of the database server as the name, and the database check result item in each result file is obtained through sed according to the starting and ending labels. The experimental result proves that the method can more universally acquire the database content and the RAC database state.
Detailed Description
In order to better understand the technical solution of the present invention, the following detailed description is made by specific examples:
the invention discloses a method for configuration compliance check and log analysis of a data center platform layer, which is used for compliance management of an application, a server and a storage device and comprises the following steps:
step 1, server configuration checking step, which comprises the following steps:
step 1.1, uploading an excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
step 1.2, performing connectivity check on the server list through a ping command, and removing the server list which cannot be communicated on the network;
step 1.3, compiling a server configuration check script for each server check configuration item on a configuration check server, creating a client through a paramiko package in a python program, remotely checking a server to be checked through a sshpass command and the server configuration check script by the client, returning a check result, and finally displaying the check result on a page;
step 2, database configuration checking, which comprises the following specific steps:
step 2.1, uploading the excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
2.2, performing connectivity check on the server list through the ping command, and removing the server list which cannot be communicated on the network;
step 2.3, compiling a database configuration check script for each database check configuration item on a configuration check server, creating a client through a paramiko package in a python program, remotely checking a database to be checked through the client by using a sshpass command and the server configuration check script, writing a return check into a txt file which is under a/tmp directory of the configuration check server and takes an ip address of the check server as a file name, reading the txt files through sed, taking out a result of each database check item, and finally displaying the result on a page;
step 3, log collection, analysis and inspection, which comprises the following specific steps:
step 3.1, uploading the excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
step 3.2, firstly, performing connectivity check on the server list through a ping command, and removing the server list which cannot be connected on the network;
and 3.3, creating an elasticsearch service on the configuration check server, creating a client through a paramiko package in a python program, remotely copying logstack software to other remote servers through the client by using a scp command, automatically configuring logstack, sending an rsyslog log on the server to the elasticsearch server (namely, the configuration check server) on the main server, and finally displaying the configuration check server through kibana (starting the kibana service on the configuration check server), wherein the log is viewed and visualized on the kibana server by a user.
It should be understood by those skilled in the art that the above embodiments are only for illustrating the present invention and are not to be used as a limitation of the present invention, and that changes and modifications to the above described embodiments are within the scope of the claims of the present invention as long as they are within the spirit and scope of the present invention.
Claims (1)
1. A method for configuration compliance check and log analysis of a data center platform layer is used for compliance management of an application, a server and a storage device, and comprises the following steps:
step 1, server configuration checking step, which comprises the following steps:
step 1.1, uploading an excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
step 1.2, performing connectivity check on the server list through the ping command, and removing the server list which cannot be communicated on the network;
step 1.3, compiling a server configuration check script for each server check configuration item on a configuration check server, creating a client through a paramiko package in a python program, remotely checking a server to be checked through a sshpass command and the server configuration check script by the client, returning a check result, and finally displaying the check result on a page;
step 2, database configuration checking, which comprises the following specific steps:
step 2.1, uploading the excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
2.2, performing connectivity check on the server list through the ping command, and removing the server list which cannot be communicated on the network;
step 2.3, compiling a database configuration check script for each database check configuration item on a configuration check server, creating a client through a paramiko package in a python program, remotely checking a database to be checked through the client by using a sshpass command and the server configuration check script, writing a return check into a txt file which is under a/tmp directory of the configuration check server and takes an ip address of the check server as a file name, reading the txt files through sed, taking out a result of each database check item, and finally displaying the result on a page;
step 3, log collection, analysis and inspection, which comprises the following specific steps:
step 3.1, uploading the excel file by a user, reading the excel file through python, and obtaining a server list needing to be checked;
step 3.2, firstly, performing connectivity check on the server list through the ping command, and removing the server list which cannot be communicated on the network;
and 3.3, creating an elasticsearch service on the configuration check server, creating a client through a paramiko package in a python program, remotely copying logstack software to other remote servers through the client by using a scp command, automatically configuring logstack, sending an rsyslog log on the server to the elasticsearch server (namely, the configuration check server) on the main server, and finally displaying the configuration check server through kibana (starting the kibana service on the configuration check server), wherein the log is viewed and visualized on the kibana server by a user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911146301.4A CN111104310B (en) | 2019-11-21 | 2019-11-21 | Method for data center platform layer configuration compliance check and log analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911146301.4A CN111104310B (en) | 2019-11-21 | 2019-11-21 | Method for data center platform layer configuration compliance check and log analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111104310A CN111104310A (en) | 2020-05-05 |
| CN111104310B true CN111104310B (en) | 2023-03-24 |
Family
ID=70421649
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911146301.4A Active CN111104310B (en) | 2019-11-21 | 2019-11-21 | Method for data center platform layer configuration compliance check and log analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111104310B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115277466A (en) * | 2022-07-04 | 2022-11-01 | 上海轩田工业设备有限公司 | Performance test data collection method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105119757A (en) * | 2015-09-14 | 2015-12-02 | 沈文策 | Method and system for operation and maintenance automation of enterprise servers |
| CN106301912A (en) * | 2016-08-15 | 2017-01-04 | 上海新炬网络技术有限公司 | The method building desktop version C/S automatization operation platform based on phthon |
| CN107276841A (en) * | 2017-04-26 | 2017-10-20 | 杭州沃趣科技股份有限公司 | A kind of method that health status detection is carried out for Oracle Goldengate |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9378100B2 (en) * | 2013-05-17 | 2016-06-28 | Go Daddy Operating Company, LLC | Tools for storing, accessing and restoring website content via a website repository |
-
2019
- 2019-11-21 CN CN201911146301.4A patent/CN111104310B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105119757A (en) * | 2015-09-14 | 2015-12-02 | 沈文策 | Method and system for operation and maintenance automation of enterprise servers |
| CN106301912A (en) * | 2016-08-15 | 2017-01-04 | 上海新炬网络技术有限公司 | The method building desktop version C/S automatization operation platform based on phthon |
| CN107276841A (en) * | 2017-04-26 | 2017-10-20 | 杭州沃趣科技股份有限公司 | A kind of method that health status detection is carried out for Oracle Goldengate |
Non-Patent Citations (1)
| Title |
|---|
| 基于脚本自动化运行的服务器管理软件开发;陈衍鹏;《自动化技术与应用》;20180625(第06期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111104310A (en) | 2020-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8028200B2 (en) | Tracing operations in multiple computer systems | |
| CN107959579B (en) | Multi-system deployment method and deployment system | |
| US20130152078A1 (en) | Method and system for deploying multiple distributed application stacks on a target machine | |
| US10754741B1 (en) | Event-driven replication for migrating computing resources | |
| GB2501287A (en) | Installing applications at selected runtime instances | |
| CN109902073B (en) | Log processing method and device, computer equipment and computer readable storage medium | |
| US20190332495A1 (en) | Automatic creation of application-centric extended metadata for a storage appliance | |
| US20210165785A1 (en) | Remote processing of memory and files residing on endpoint computing devices from a centralized device | |
| CN103577425A (en) | Data processing method and device | |
| WO2015157209A1 (en) | Remote processing of files residing on endpoint computing devices | |
| US8560895B2 (en) | Distillation and reconstruction of provisioning components | |
| CN111104310B (en) | Method for data center platform layer configuration compliance check and log analysis | |
| CN114143171B (en) | Alarm root cause positioning method and system based on TR069 protocol | |
| US8539048B2 (en) | Electronic device and method for loading configuration files using the same | |
| CN114598687B (en) | Grabbing method, system and terminal for HTTPS data packet | |
| Joukov et al. | Application-storage discovery | |
| US10129328B2 (en) | Centralized management of webservice resources in an enterprise | |
| CN112214231A (en) | CI-based virtualized software upgrade package generation method and system | |
| CN114500348B (en) | CDN gateway testing method and system | |
| US20220353341A1 (en) | Efficient deployment of cloud resources | |
| US7921324B2 (en) | Providing file system availability during local path failure of a non-server node | |
| KR102048602B1 (en) | Iterative disk upload based on differencing disk format | |
| CN107992422B (en) | Method and device for improving software compatibility test | |
| CN111813588A (en) | Computer hard disk fault positioning method, device, equipment and storage medium | |
| CN115757041B (en) | Method for collecting dynamically configurable multi-cluster logs and application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |