CN102437938B - Large-scale network monitoring oriented virtual deployment system and method - Google Patents
Large-scale network monitoring oriented virtual deployment system and method Download PDFInfo
- Publication number
- CN102437938B CN102437938B CN2012100050285A CN201210005028A CN102437938B CN 102437938 B CN102437938 B CN 102437938B CN 2012100050285 A CN2012100050285 A CN 2012100050285A CN 201210005028 A CN201210005028 A CN 201210005028A CN 102437938 B CN102437938 B CN 102437938B
- Authority
- CN
- China
- Prior art keywords
- deployment
- measurement probe
- target machine
- center platform
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000012544 monitoring process Methods 0.000 title claims abstract description 35
- 238000005259 measurement Methods 0.000 claims abstract description 133
- 239000000523 sample Substances 0.000 claims abstract description 129
- 238000001514 detection method Methods 0.000 claims abstract description 88
- 238000007726 management method Methods 0.000 claims abstract description 40
- 238000009434 installation Methods 0.000 claims abstract description 22
- 230000008569 process Effects 0.000 claims abstract description 14
- 230000007246 mechanism Effects 0.000 claims abstract description 6
- 238000004891 communication Methods 0.000 claims description 33
- 230000001419 dependent effect Effects 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 11
- 238000012795 verification Methods 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000004422 calculation algorithm Methods 0.000 claims description 6
- 239000000284 extract Substances 0.000 claims description 6
- 230000006870 function Effects 0.000 claims description 4
- 230000002159 abnormal effect Effects 0.000 claims description 2
- 238000010276 construction Methods 0.000 claims description 2
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Landscapes
- Debugging And Monitoring (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a large-scale network monitoring oriented virtual deployment system and method. The system is provided with a deployment center platform and a plurality of deployment target machines communicated with the deployment center platform via a network. The deployment center platform is responsible for uniformly planning and managing a topology structure of measurement probe deployment in an entire computer network, issuing a deployment task according to the existing measurement probe deployment condition and network congestion condition, and executing management and version control on the deployed measurement probes. The deployment target machines receive and execute commands from the deployment center platform, and automatically execute corresponding operations so as to enable the measurement probes to be usable in the network; and a software dependency detection mechanism and a process matching rule are respectively used for realizing the platform independency of deployment and verifying the achievement of deployment. The system and the method can be used for solving a plurality of problems, such as dependency detection for deployment environment of the target machines, upgrading and maintaining of a management system version, concurrent deployment, automatic installation and detection of the plurality of target machines, dynamic scheduling and the like, in the prior art, and have better promotion and application prospects.
Description
Technical Field
The invention relates to a virtualization deployment system and a virtualization deployment method for large-scale IP network monitoring, and belongs to the technical field of large-scale computer networks and distributed data acquisition systems and acquisition methods.
Background
With the rapid development of various network technologies and the popularization of products, and the increasing of user and service types, networks become more and more complex; the increasing number of users and applications causes a heavy burden on the network, which results in a reduction in network performance, and thus requires extraction and analysis of network performance indicators. The network performance data has important reference values for analyzing network behaviors, knowing network faults, planning new services and the like.
Because the current computer network is complex and huge and has great difficulty in real-time monitoring, the development of a monitoring system and method for large-scale network measurement has positive significance. How to accurately and flexibly deploy monitoring tasks according to specific monitoring targets and reduce manual intervention is very critical to performance monitoring of computer networks. The collection of monitoring data can be done by using measurement probes deployed in large-scale network measurement, however, the deployment of these measurement probes requires a macro-control by a central platform. The central platform typically runs on a large pool of service resources that can be self-maintained and managed, consisting of a single server or a cluster of servers. The monitoring probe controlled by the central platform can be dynamically deployed at the position to be monitored according to the computer network condition. The large-scale network monitoring virtualization deployment system for dynamically deploying the monitoring probes according to the monitoring requirements of the monitored computer network can meet the performance monitoring requirements of the large computer network and dynamically bear the deployment requirements of monitoring network topology.
The meanings or definitions of the related technical terms used in the present invention will be described below:
virtualized deployment: a deployment mode using a virtualization system platform or a virtual machine as a deployment target point is characterized by shielding system internal differences, unifying deployment interfaces, improving expandability and reducing management difficulty.
The virtualization deployment system comprises: a distributed system oriented to large-scale network measurement and mainly used for monitoring topology deployment and management. The method is used for meeting the requirements of monitoring a computer network and dynamically deploying a monitoring environment, and can provide a required monitoring environment for users.
A central platform: means for performing a deployment scheduling control function, consisting of a single server or a cluster of servers.
A target machine: the terminal as the target of the virtualized deployment can run on a PC physical machine or a virtual machine. After the deployment is successful, the target machine becomes a measurement probe point in the large-scale network measurement system.
Rpm (red hat Package manager) a mainstream commercial-grade LINUX operating system, red hat's software Package management tool or an open software Package management system, although the file format name indicates that it is related to red hat, its original design concept is open, and the distribution versions of LINUX, including OpenLinux, s.u.s.e., and Turbo LINUX, are now designed and managed using it, which has been recognized as an industry standard. It works with Red Hat Linux, as well as other Linux and UNIX systems, and can be used by anyone.
Extensible Markup language xml (extensible Markup language): its markup is an information symbol that can be understood by computers, and documents containing various information can be processed between the computers through the markup, which needs to be interpreted by means of another language in order to achieve a desired effect or be accepted by the computers.
Adapter mode Adapter: the method is a very practical design mode and is used for converting an original interface into a desired other interface so as to solve the problem that the original interfaces are incompatible and cannot work together.
SSH (secure Shell hibernate): as one of the most widely used protocols in the current Linux system, it is an encrypted data transmission protocol, which can prevent DNS and IP spoofing, and encrypt the transmitted data, thereby increasing the transmission speed.
Message Digest Algorithm fifth version MD5 (Message Digest Algorithm 5): a method for checking the correctness of received transmitted data by executing hash operation on it includes comparing the hash value obtained by calculation with the hash value transmitted with data, judging that the transmitted data is complete and correct if two values are identical, not being tampered and being used for sure. This verification approach finds application in many areas, for example: checking confidential data and downloaded documents, etc.
In the prior art, most of measurement probes for network measurement are deployed manually. The specific method is that a worker arrives at the geographical position where a measuring probe needs to be deployed, and a measuring device is manually installed on a physical machine. For large-scale computer network monitoring, a very large number of measurement probes need to be deployed and distributed at remote positions. If the manual installation tends to consume a large amount of manpower and material resources, the monitoring cost is increased. Most importantly, manually deployed measurement probes are extremely inconvenient in managing maintenance and version control. It is not reasonable to have a large number of these measurement probes maintained by manual upgrade if improvements or upgrades to the measurement probes are required. Therefore, the existing deployment mode is difficult to meet or satisfy the requirement of monitoring a large-scale computer network. Therefore, how to improve the above-mentioned problems is a focus of attention of technicians in the industry.
Disclosure of Invention
In view of this, the present invention provides a large-scale network monitoring-oriented virtualization deployment system and method, which are used to solve the problems of dependency detection of a target deployment environment and concurrent deployment of a plurality of target machines in the prior art.
In order to achieve the above object, the present invention provides a large-scale network monitoring oriented virtualization deployment system, which is characterized in that: the system comprises: a deployment center platform and a plurality of deployment target machines in communication therewith via a network, wherein,
the deployment center platform is responsible for collecting topological structures of measurement probe deployment in the whole computer network so as to realize unified planning and management, and issues deployment tasks by combining the existing measurement probe deployment situation and network congestion situation: determining a topological position of a measurement probe to be deployed, and performing the deployment of the measurement probe at the position; before the measurement probe is deployed, detecting the system environment of a deployed target machine to ensure the compatibility of deployment; after the measurement probe is deployed, collecting and storing a deployment result, and updating a current deployment topology; managing and version controlling the deployed measuring probes; the platform is provided with: the system comprises a measurement probe deployment module, and a deployment environment detection module, a system version management module, a deployment topology management module and a communication module which are respectively connected with the measurement probe deployment module;
the deployment target machine is responsible for receiving and executing commands from the deployment center platform, automatically installs the dependency software and the measurement probe software sent by the deployment center platform, and automatically executes corresponding operation after returning the deployment result to the deployment center platform so as to enable the deployment target machine to become an available measurement probe in the network; the deployment target machine realizes platform independence of deployment by using a software dependence detection mechanism, and verifies the success of deployment by using a process matching principle; is provided with: a dependency detection execution module, a deployment execution module, and a communication module.
In order to achieve the above object, the present invention further provides a virtualization deployment method for a large-scale network monitoring-oriented virtualization deployment system, which is characterized in that: the deployment center platform firstly analyzes the existing network state according to the deployment topology management module, provides a host which is urgently required to deploy the measurement probe in the network topology, and transmits the host information which is urgently required to deploy the measurement probe in the network topology to the deployment environment detection module; the deployment environment monitoring module is communicated with the deployment target machine through the communication module, detects the deployment environment, and sends a detection result back to the deployment center platform by the deployment target machine; the deployment center platform executes the following operations according to the detection result of the deployment environment: sending installation results of the deployment environment system version and the deployment environment system version waiting to be deployed to a deployment target machine, or transferring the results of the deployment environment detection to a measurement probe deployment module; the measurement probe deployment module is connected with a deployment target machine, a deployment execution module of the deployment target machine automatically installs a measurement probe system version, and after installation, the result is sent back to a deployment center platform, and the deployment center platform records the deployment result; if the system version or the measurement probe system version is updated, the system version management module sends a notice to prompt whether the upgrade depending on the system version or the measurement probe version is started or not, and automatically executes the upgrade operation after the upgrade passes.
The invention has the following beneficial effects: by adopting the method, the current situation of the large-scale network and the deployment situation of the existing large-scale network monitoring nodes can be combined, the topological position of the network monitoring node which needs to be deployed additionally is selected, and the transmission resource reconstruction which is adjusted according to the requirement is realized. The invention supports the automatic completion of the environment detection of the deployment target machine, and sends the description documents of the existing different working environment detection aiming at the deployment target machines of different systems, thereby realizing the separation of the operating system of the deployment target machine and the monitoring software, avoiding the need of redeploying the operating system when the monitoring software is deployed, and effectively improving the working efficiency of the virtual monitoring deployment environment. The system of the invention manages the upgrade and maintenance of the system version by using the system version management module in the deployment center platform, automatically prompts the upgrade of the measurement probe software once the system version library is updated, and can accurately and effectively control the software version of the measurement probe. The method has good expansibility, supports the dynamic joining of a deployment target machine into the virtualization deployment system, and can be deployed at any set position in the network; and multi-machine concurrent deployment is supported, and the deployment efficiency is good. In a word, the invention has good popularization and application prospect.
Drawings
Fig. 1 is a schematic diagram of the structural composition and data flow of the large-scale network monitoring oriented virtualization deployment system of the present invention.
Fig. 2 is a flowchart of a monitoring method of the large-scale network monitoring oriented virtualization deployment system of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and examples.
The technical scheme adopted by the invention for solving the technical problems is as follows: the large-scale network measurement oriented virtualization deployment system comprises two devices: respectively a deployment center platform and a deployment target machine.
Referring to fig. 1, the structural composition of the large-scale network monitoring oriented virtualization deployment system of the present invention is described: the system is provided with a deployment center platform and a plurality of deployment target machines which are communicated with the deployment center platform through a network. Wherein,
the deployment center platform is used as a control center of the system and is responsible for collecting topological structures deployed by the measuring probes in the whole computer network and carrying out unified planning and management; and the deployment task is issued by combining the prior measurement probe deployment situation and the network congestion situation: determining a topological position of a measurement probe to be deployed, and performing the deployment of the measurement probe at the position; before the measurement probe is deployed, detecting the system environment of a deployed target machine to ensure the compatibility of deployment; after the measurement probe is deployed, collecting and storing a deployment result, and updating a current deployment topology; and manage and versioning the deployed measurement probes. The deployment center platform is arranged on a virtualization monitoring platform of a server and is provided with the following functional modules: the system comprises a measurement probe deployment module, and a deployment environment detection module, a system version management module, a deployment topology management module and a communication module which are respectively connected with the measurement probe deployment module. Wherein,
the deployment topology management module is used as a presentation interface of the deployment center platform topology management, is used for collecting the information of the existing deployed measurement probes, and stores the information into a database and presents the information by using WEB; the database stores user name and password information of a host computer capable of deploying the measurement probe, so as to facilitate subsequent deployment operation.
The system version management module is responsible for managing and controlling system versions, and the system versions comprise a measurement probe installation package and a dependent environment installation package which needs to be installed before deployment; the virtualization deployment system stores a record for each target machine, and the record stores the configuration of the target machine, the deployment and the relevant data of the deployment result, so that the target machine can be managed and upgraded conveniently after deployment; the system versions are uniformly stored in a system version library of the module, and the management module performs addition, deletion, upgrading and acquisition operations on the system versions.
The deployment environment detection module is used for detecting the operation environment for deploying the target machine and collecting a dependence detection result before the deployment of the measurement probe, and then extracting a corresponding dependence software installation package from a system version library of the system version management module according to the dependence detection result to perform dependence deployment on the deployed target machine because the environment versions of the target machine are many and the difference of the operation environment is large; then, it is determined whether to start a deployment operation of the measurement probe system version according to the result of the dependent deployment.
The measurement probe deployment module, as the core of the deployment center platform, is responsible for executing the measurement probe deployment operation of deploying the target machine: firstly, acquiring a result that a deployment environment can meet conditions from a deployment environment detection module, applying for a system version of a measurement probe to be deployed from a system version management module after the result is confirmed to be correct, and then automatically deploying on a deployment target machine; the deployment process realizes concurrent deployment operation by using an adapter mode, and after the deployment is finished, the deployment result is submitted to a deployment topology management module for processing;
and the communication module is connected with a bridge between the deployment center platform and the deployment target machine and is also a channel for issuing commands to the deployment target machine and transmitting the system version by the deployment center platform.
The deployment target machine is a small embedded system, a common PC machine or a virtual machine which is selected as a measuring probe in a computer network. The execution terminal of the system is responsible for receiving and executing commands from the deployment center platform, and comprises the steps of automatically installing the dependent software and the measurement probe software sent by the deployment center platform, and automatically executing corresponding operations after the deployment result is sent back to the deployment center platform, so that the measurement probe becomes the measurement probe available in the network. The deployment target machine realizes platform independence of deployment by using a software dependence detection mechanism, and verifies the success of deployment by using a process matching principle. The device is provided with the following functional modules: the system comprises a dependence detection execution module, a deployment execution module and a communication module; the functions of the modules are as follows:
the dependence detection execution module is responsible for analyzing the dependence detection command and automatically installing the dependence system version: the module extracts and executes a dependency detection command from a dependency detection command file issued by the deployment center platform, and feeds back a dependency detection result to the deployment center platform so as to obtain a corresponding deployment system version, then automatically install the dependency system version, and return the installation result to the deployment center platform; the dependency detection command description file is written by adopting extensible Markup language XML (extensible Markup language), and has excellent extensibility.
The deployment execution module is responsible for analyzing the deployment command description file and automatically installing the deployment system version, and completes the self-starting of the measurement probe after the installation: and acquiring the system version of the measurement probe from the deployment center platform, automatically installing the system version, and automatically starting the measurement probe after the installation result is fed back to the deployment center platform, so that the measurement probe becomes an available measurement node in the network.
The communication module is provided with two channels: the system version receiving channel and the deployment state reply channel are communicated by utilizing the SSH protocol which is commonly used under various operating system platforms, have high data transmission rate and can complete the system version receiving in a short time; the latter has low requirement on data transmission rate and utilizes network socket communication.
The system supports the acquisition and analysis of measurement data in various formats, supports data transmission in various communication modes, executes a load balancing strategy in the transmission process, and supports the dynamic addition and withdrawal of the measurement probes, so that the measurement probes can dynamically generate an optimal topology to balance the load and the flow of a network.
The invention also provides a virtualization deployment method of the virtualization deployment system for large-scale network monitoring, which comprises the following steps: the deployment center platform firstly analyzes the existing network state according to the deployment topology management module, provides a host which is in urgent need of deploying the measurement probe in the network topology, and transmits the information to the deployment environment detection module. The deployment environment monitoring module is communicated with the deployment target machine through the communication module, detects the deployment environment, and sends a detection result back to the deployment center platform through the deployment target machine. The deployment center platform executes the following operations according to the detection result of the deployment environment: sending installation results of the deployment environment system version and the deployment environment system version waiting to be deployed to a deployment target machine, or transferring the results of the deployment environment detection to a measurement probe deployment module; the measurement probe deployment module is connected with the deployment target machine, the deployment execution module of the deployment target machine automatically installs the version of the measurement probe system, after installation, the result is sent back to the deployment center platform, and the deployment center platform records the deployment result. If the system version or the measurement probe system version is updated, the system version management module sends a notice to prompt whether the upgrade depending on the system version or the measurement probe version is started or not, and automatically executes the upgrade operation after the upgrade passes.
Referring to fig. 2, the specific operation steps of the method of the present invention are described:
step 1, a topology management module in a deployment center platform acquires and extracts the existing network topology, a host which needs to deploy a measurement probe urgently in a network is given by combining the current network condition and the deployment condition of the existing measurement probe, and the user name and password information of the host are sent to a communication module.
And 2, the deployment center platform is connected with one or more deployment target machines through the communication module in an adapter mode to execute multi-machine concurrent deployment so as to improve the deployment efficiency. In the step, a process class is adapted to a thread class by multi-machine concurrent deployment operation adopted by a management center platform, so that the process has thread asynchronism and can obtain construction parameters at the same time; so as to solve the problem that the management center platform is easy to block the first connection by using network socket communication, and a default asynchronous mechanism provided by a thread is well utilized.
Step 3, after the connection is successful, detecting the deployment environment of the deployment target machine through a dependence detection execution module of the deployment target machine in the deployment center platform, and recovering a dependence detection result; if the dependency detection is passed, the following operation step 4 is performed; otherwise, the deployment environment detection module of the deployment center platform sends the dependence software lacking in the deployment target machine to the deployment target machine through the communication module, the dependence detection execution module of the deployment target machine installs the dependence software, and the installation result is sent back to the deployment center platform for storage. The method comprises the following steps:
(31) sending a working environment detection packet: when the deployment center platform is successfully connected with the deployment target machine, the deployment environment detection module sends a deployment environment detection package comprising a deployment description document and a deployment environment detection script to the deployment target machine; the deployment description document is written by adopting an XML language and respectively describes deployment environments of deployment target machines of different system types: the method comprises five parts of operating system type, deployment requirement authority, deployment command, dependent software existence and deployment result, and provides corresponding detection basis; the deployment environment detection script is compiled by adopting a Python language, the Python language is provided with a special library for XML file analysis, and the deployment description document can be analyzed and the deployment environment can be detected by calling an XML file analysis method;
(32) automatically detecting a deployment environment: the dependence detection execution module of the deployment target machine extracts deployment description document information by using the detection script, automatically detects the deployment environment of the deployment target machine, and automatically stores an environment detection result in a result file;
(33) recovering and deploying environment detection results: the deployment center platform receives the detection result file fed back by the communication module of the deployment target machine, and automatically executes the following processing operations after extracting relevant information from the detection result file: if the deployment environment meets the deployment requirement, the measurement probe deployment module deploys the measurement probe to the deployment target machine, namely, the subsequent step (4) is executed; otherwise, if the deployment target machine is found to lack the dependent software, the dependent detection execution module of the deployment target machine automatically installs the dependent system version and sends the result back to the deployment center platform, so that the deployment center platform can reprocess the deployment environment detection result.
And 4, deploying the measurement probe of the deployment target machine by the measurement probe deployment module of the deployment center platform, automatically executing deployment operation by the deployment target machine by using the deployment execution module, and sending a deployment result to the deployment center platform for processing. The step (4) comprises the following operations:
(41) sending a measurement probe installation package: after the deployment environment detection module informs the measurement probe deployment module to start automatic deployment, the measurement probe deployment module sends a measurement probe installation software package to a deployment target machine through a communication module, in order to avoid incomplete or incorrect reception of a system version document caused by poor network environment, the deployment target machine needs to perform message digest Algorithm fifth version MD5 (MessageDigest Algorithm 5) verification on the received system version document, and only if the reception is correct, a subsequent automatic deployment step (42) is executed; otherwise, the deployment center platform is required to retransmit the measurement probe installation software package;
(42) automatic deployment of the measurement probe: a deployment execution module of the deployment target machine analyzes the deployment description document information and executes the automatic deployment operation of the measurement probe; after the deployment is finished, the measuring probe is automatically started to become an available measuring node in the network; since the deployment of the measurement probe is automatically completed by the program, the deployment may fail or be abnormal due to the difference of the operating environments during the deployment process, so after the deployment is completed, the correctness verification must be performed: the deployment execution module is provided with corresponding deployment correctness verification and fault-tolerant processing strategies, and the correctness verification is carried out by adopting process matching under the Linux environment: if the verification result is correct, executing the subsequent step (43); once abnormity occurs, immediately alarming to a deployment center platform so as to take corresponding measures;
(43) recovering the deployment result: after the deployment target machine generates a deployment result, directly returning the deployment result to the deployment center platform through the communication module; the deployment center platform executes the following processing aiming at the deployment result: if the deployment is successful, transmitting the node information which becomes the measurement probe to a deployment topology management module so as to manage and control the node information; and if the deployment fails, generating alarm information and waiting for manual processing.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (10)
1. A virtualization deployment system for large-scale network monitoring is characterized in that: the system comprises: a deployment center platform and a plurality of deployment target machines in communication therewith via a network, wherein,
the deployment center platform is responsible for collecting topological structures of measurement probe deployment in the whole computer network so as to realize unified planning and management, and issues deployment tasks by combining the existing measurement probe deployment situation and network congestion situation: determining a topological position of a measurement probe to be deployed, and performing the deployment of the measurement probe at the position; before the measurement probe is deployed, detecting the system environment of a deployed target machine to ensure the compatibility of deployment; after the measurement probe is deployed, collecting and storing a deployment result, and updating a current deployment topology; managing and version controlling the deployed measuring probes; the platform is provided with: the system comprises a measurement probe deployment module, and a deployment environment detection module, a system version management module, a deployment topology management module and a communication module which are respectively connected with the measurement probe deployment module;
the deployment target machine is responsible for receiving and executing commands from the deployment center platform, automatically installs the dependency software and the measurement probe software sent by the deployment center platform, and automatically starts corresponding operation after returning a deployment result to the deployment center platform so as to enable the deployment target machine to become an available measurement probe in a network; the deployment target machine realizes platform independence of deployment by using a software dependence detection mechanism, and verifies the success of deployment by using a process matching principle; is provided with: a dependency detection execution module, a deployment execution module, and a communication module.
2. The virtualization deployment system of claim 1 wherein: the functions of the modules of the deployment center platform are as follows:
the deployment topology management module is used as a presentation interface of the deployment center platform topology management, is used for collecting the information of the existing deployed measurement probes, and stores the information into a database and presents the information by using WEB; the database stores user name and password information of a host capable of deploying the measurement probe so as to facilitate subsequent deployment operation;
the system version management module is responsible for managing and controlling system versions, and the system versions comprise a measurement probe installation package and a dependent environment installation package which needs to be installed before deployment; the virtualization deployment system stores a record for each target machine, and the record stores the configuration of the target machine, the deployment and the relevant data of the deployment result, so that the target machine can be managed and upgraded conveniently after deployment; the system versions are uniformly stored in a system version library of the module, and the management module performs addition, deletion, upgrading and acquisition operations on the system versions;
the deployment environment detection module is used for detecting the operation environment for deploying the target machine and collecting a dependence detection result before the deployment of the measurement probe, and then extracting a corresponding dependence software installation package from a system version library of the system version management module according to the dependence detection result to perform dependence deployment on the deployed target machine because the environment versions of the target machine are many and the difference of the operation environment is large; then, determining whether to start a deployment operation of the measurement probe system version according to a result of the dependent deployment;
the measurement probe deployment module, as the core of the deployment center platform, is responsible for executing the measurement probe deployment operation of deploying the target machine: firstly, acquiring a result that a deployment environment can meet conditions from a deployment environment detection module, applying for a system version of a measurement probe to be deployed from a system version management module after the result is confirmed to be correct, and then automatically deploying on a deployment target machine; the concurrent deployment operation realized by the adapter mode is utilized in the deployment process, and after the deployment is finished, the deployment result is uploaded to the deployment topology management module for processing;
and the communication module is connected with a bridge between the deployment center platform and the deployment target machine and is also a channel for the deployment center platform to issue commands to the deployment target machine and transmit the system version.
3. The virtualization deployment system of claim 1 wherein: the functions of the modules of the deployment target machine are as follows:
the dependence detection execution module is responsible for analyzing the dependence detection command and automatically installing the dependence system version: the module extracts and executes a dependency detection command from a dependency detection command file issued by the deployment center platform, and feeds back a dependency detection result to the deployment center platform so as to obtain a corresponding deployment system version, then automatically install the dependency system version, and return the installation result to the deployment center platform; the dependency detection command description file is compiled by adopting extensible markup language XML, and has excellent extensibility;
the deployment execution module is responsible for analyzing the deployment command description file and automatically installing the deployment system version, and completes the self-starting of the measurement probe after the installation: acquiring a system version of the measurement probe from a deployment center platform and automatically installing the system version, and after an installation result is fed back to the deployment center platform, automatically starting the measurement probe to enable the measurement probe to become an available measurement node in a network;
the communication module is provided with two channels: the system version receiving channel and the deployment state reply channel are communicated by utilizing the SSH protocol which is commonly used under various operating system platforms, have high data transmission rate and can complete the system version receiving in a short time; the latter has low requirement on data transmission rate and utilizes network socket communication.
4. The virtualization deployment system of claim 1 wherein: the deployment center platform is arranged on a virtualization monitoring platform of the server; the deployment target machine is a small embedded system, a common PC machine or a virtual machine which is selected as a measuring probe in a computer network.
5. The virtualization deployment system of claim 1 wherein: the system supports the acquisition and analysis of measurement data in various formats, supports data transmission in various communication modes, executes a load balancing strategy in the transmission process, and supports the dynamic joining and exiting of the measurement probes, so that the plurality of measurement probes can dynamically generate an optimal topology to balance the load and the flow of a network.
6. A virtualization deployment method using the virtualization deployment system of claim 1, characterized in that: the deployment center platform firstly analyzes the existing network state according to the deployment topology management module, provides a host which is urgently required to deploy the measurement probe in the network topology, and transmits the host information which is urgently required to deploy the measurement probe in the network topology to the deployment environment detection module; the deployment environment detection module is communicated with the deployment target machine through the communication module, detects the deployment environment, and then sends a detection result to the deployment center platform through the deployment target machine; the deployment center platform executes the following operations according to the detection result of the deployment environment: sending installation results of the deployment environment system version and the deployment environment system version waiting to be deployed to a deployment target machine, or transferring the results of the deployment environment detection to a measurement probe deployment module; the measurement probe deployment module is connected with a deployment target machine, a deployment execution module of the deployment target machine automatically installs a measurement probe system version, and after installation, the result is sent back to a deployment center platform, and the deployment center platform records the deployment result; if the system version or the measurement probe system version is updated, the system version management module sends a notice to prompt whether the upgrade depending on the system version or the measurement probe version is started or not, and automatically executes the upgrade operation after the upgrade passes.
7. The virtualization deployment method of claim 6, wherein: the method comprises the following operation steps:
(1) a topology management module in a deployment center platform acquires and extracts the existing network topology, gives a host which needs to deploy a measurement probe urgently in a network by combining the current network condition and the deployment condition of the existing measurement probe, and sends the user name and password information of the host to a communication module;
(2) the deployment center platform is connected with one or more deployment target machines through the communication module in an adapter mode to execute multi-machine concurrent deployment so as to improve the deployment efficiency;
(3) after the connection is successful, detecting the deployment environment of the deployment target machine through a dependence detection execution module of the deployment target machine in the deployment center platform, and recovering a dependence detection result; if the dependency detection is passed, performing a subsequent operation step (4); otherwise, the deployment environment detection module of the deployment center platform sends the dependence software lacking in the deployment target machine to the deployment target machine through the communication module, the dependence detection execution module of the deployment target machine installs the dependence software, and the installation result is sent back to the deployment center platform for storage;
(4) and the measurement probe deployment module of the deployment center platform deploys the measurement probe on the deployment target machine, the deployment target machine automatically executes deployment operation by using the deployment execution module, and the deployment result is sent to the deployment center platform for processing.
8. The virtualization deployment method of claim 7, wherein: in the step (2), the concurrent deployment operation adopted by the management center platform adapts the process class to the thread class, so that the process has the asynchronism of the thread and can obtain the construction parameters at the same time; so as to solve the problem that the management center platform is easy to block the first connection by using network socket communication, and a default asynchronous mechanism provided by a thread is well utilized.
9. The virtualization deployment method of claim 7, wherein: the step (3) comprises the following operations:
(31) sending a working environment detection packet: when the deployment center platform is successfully connected with the deployment target machine, the deployment environment detection module sends a deployment environment detection package comprising a deployment description document and a deployment environment detection script to the deployment target machine; the deployment description document is written by adopting an XML language and respectively describes deployment environments of deployment target machines of different system types: the method comprises five parts of operating system type, deployment requirement authority, deployment command, dependent software existence and deployment result, and provides corresponding detection basis; the deployment environment detection script is compiled by adopting a Python language, the Python language is provided with a special library for XML file analysis, and the deployment description document can be analyzed and the deployment environment can be detected by calling an XML file analysis method;
(32) automatically detecting a deployment environment: the dependence detection execution module of the deployment target machine extracts deployment description document information by using the detection script, automatically detects the deployment environment of the deployment target machine, and automatically stores an environment detection result in a result file;
(33) recovering and deploying environment detection results: the deployment center platform receives the detection result file fed back by the communication module of the deployment target machine, and automatically executes the following processing operations after extracting relevant information from the detection result file: if the deployment environment meets the deployment requirement, the measurement probe deployment module deploys the measurement probe to the deployment target machine, namely, the subsequent step (4) is executed; otherwise, if the deployment target machine is found to lack the dependent software, the dependent detection execution module of the deployment target machine automatically installs the dependent system version and sends the result back to the deployment center platform, so that the deployment center platform can reprocess the deployment environment detection result.
10. The virtualization deployment method of claim 7, wherein: the step (4) comprises the following operations:
(41) sending a measurement probe installation package: after the deployment environment detection module informs the measurement probe deployment module to start automatic deployment, the measurement probe deployment module sends a measurement probe installation software package to a deployment target machine through a communication module, in order to avoid incomplete or incorrect reception of a system version document caused by poor network environment, the deployment target machine needs to perform message digest Algorithm fifth version MD5 (MessageDigest Algorithm 5) verification on the received system version document, and only if the reception is correct, a subsequent automatic deployment step (42) is executed; otherwise, the deployment center platform is required to retransmit the measurement probe installation software package;
(42) automatic deployment of the measurement probe: a deployment execution module of the deployment target machine analyzes the deployment description document information and executes the automatic deployment operation of the measurement probe; after the deployment is finished, the measuring probe is automatically started to become an available measuring node in the network; since the deployment of the measurement probe is automatically completed by the program, the deployment may fail or be abnormal due to the difference of the operating environments or other factors during the deployment process, and therefore, after the deployment is completed, correctness verification must be performed: the deployment execution module is provided with corresponding deployment correctness verification and fault-tolerant processing strategies, and the correctness verification is carried out by adopting process matching under the Linux environment: if the verification result is correct, executing the subsequent step (43); once abnormity occurs, immediately alarming to a deployment center platform so as to take corresponding measures;
(43) recovering the deployment result: after the deployment target machine generates a deployment result, directly returning the deployment result to the deployment center platform through the communication module; the deployment center platform executes the following processing aiming at the deployment result: if the deployment is successful, transmitting the node information which becomes the measurement probe to a deployment topology management module so as to manage and control the node information; and if the deployment fails, generating alarm information and waiting for manual processing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100050285A CN102437938B (en) | 2012-01-09 | 2012-01-09 | Large-scale network monitoring oriented virtual deployment system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100050285A CN102437938B (en) | 2012-01-09 | 2012-01-09 | Large-scale network monitoring oriented virtual deployment system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102437938A CN102437938A (en) | 2012-05-02 |
| CN102437938B true CN102437938B (en) | 2013-11-13 |
Family
ID=45985822
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012100050285A Expired - Fee Related CN102437938B (en) | 2012-01-09 | 2012-01-09 | Large-scale network monitoring oriented virtual deployment system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102437938B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111338656A (en) * | 2020-02-25 | 2020-06-26 | 平安科技（深圳）有限公司 | Method and device for installing software package to target host and computer equipment |
Families Citing this family (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2504663B (en) * | 2012-06-29 | 2017-08-02 | Neul Ltd | Secure Deployment of Communication Devices in a Communications Network |
| CN102801587B (en) * | 2012-08-29 | 2014-09-17 | 北京邮电大学 | Large-scale network-oriented virtualized monitoring system and dynamic monitoring method thereof |
| CN103067444B (en) * | 2012-11-09 | 2017-12-29 | 深圳市极限网络科技有限公司 | The method that result data is echoed by WEB managers remote management in real time |
| CN103095821B (en) * | 2013-01-05 | 2015-07-01 | 国都兴业信息审计系统技术（北京）有限公司 | Continuous auditing system based on virtual machine migration recognition |
| CN103118383B (en) * | 2013-02-01 | 2015-06-17 | 中国科学技术大学 | System and method for comprehensively supervising wireless access point state |
| CN104519010B (en) * | 2013-09-27 | 2018-01-16 | 中国电信股份有限公司 | The dispositions method and device of network security probe |
| CN103685568B (en) * | 2013-12-31 | 2018-01-30 | 曙光云计算集团有限公司 | The platform service application dispositions method and system of PAAS platforms under cloud computing environment |
| EP3142322B1 (en) * | 2015-09-10 | 2018-04-25 | Alcatel Lucent | Auto configuration server and method |
| CN107463476A (en) * | 2016-06-02 | 2017-12-12 | 中兴通讯股份有限公司 | The acquisition methods and device of information |
| JP6783638B2 (en) * | 2016-11-29 | 2020-11-11 | キヤノン株式会社 | Management system and control method |
| CN106775882A (en) * | 2016-12-26 | 2017-05-31 | 中国银联股份有限公司 | Cloud computing server batch dispositions method and device |
| CN107066338A (en) * | 2017-04-13 | 2017-08-18 | 中国人民解放军国防科学技术大学 | The computing environment method of automatic configuration of distributed computing system |
| CN108920158A (en) * | 2018-06-12 | 2018-11-30 | 郑州云海信息技术有限公司 | A kind of automatically dispose device and method under linux environment |
| CN109117145A (en) * | 2018-07-20 | 2019-01-01 | 郑州云海信息技术有限公司 | A kind of batch testing environment automaticly inspects and dispositions method and system |
| CN110377294A (en) * | 2019-07-23 | 2019-10-25 | 上海金融期货信息技术有限公司 | A kind of multi-environment configuration system and method based on DevOps |
| CN112988168B (en) * | 2019-11-29 | 2024-10-18 | 北京沃东天骏信息技术有限公司 | Environment building method and device |
| CN111162953B (en) * | 2019-12-31 | 2023-04-28 | 四川省公安科研中心 | Data processing method, system upgrading method and server |
| CN111835592B (en) * | 2020-07-14 | 2022-09-27 | 北京百度网讯科技有限公司 | Method, apparatus, electronic device and readable storage medium for determining robustness |
| CN113973127B (en) * | 2020-07-24 | 2024-03-19 | 中移(苏州)软件技术有限公司 | Network deployment method, device and storage medium |
| CN112383447B (en) * | 2020-11-02 | 2022-11-08 | 中移系统集成有限公司 | Service quality measuring method, device, equipment and storage medium |
| CN113434246B (en) * | 2021-06-15 | 2023-04-07 | 竹间智能科技（上海）有限公司 | Multilayer dependency deployment method, tool, equipment and medium |
| CN114024879B (en) * | 2021-10-18 | 2023-04-14 | 中国联合网络通信集团有限公司 | Network probe deployment method, device and storage medium |
| CN115865825A (en) * | 2022-12-01 | 2023-03-28 | 南京中孚信息技术有限公司 | Distributed full-flow analysis system based on cloud computing |
| CN115599410B (en) * | 2022-12-15 | 2023-03-14 | 杭州数列网络科技有限责任公司 | Large-scale JAVA probe management method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101170447A (en) * | 2007-11-22 | 2008-04-30 | 北京邮电大学 | Service failure diagnosis system based on active probe and its method |
| CN101547114A (en) * | 2008-03-25 | 2009-09-30 | 中国科学院计算技术研究所 | Topology processing system and method in autonomous system |
| CN101916207A (en) * | 2010-08-28 | 2010-12-15 | 华为技术有限公司 | Energy saving method, device and system under desktop virtual environment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8533828B2 (en) * | 2003-01-21 | 2013-09-10 | Hewlett-Packard Development Company, L.P. | System for protecting security of a provisionable network |
-
2012
- 2012-01-09 CN CN2012100050285A patent/CN102437938B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101170447A (en) * | 2007-11-22 | 2008-04-30 | 北京邮电大学 | Service failure diagnosis system based on active probe and its method |
| CN101547114A (en) * | 2008-03-25 | 2009-09-30 | 中国科学院计算技术研究所 | Topology processing system and method in autonomous system |
| CN101916207A (en) * | 2010-08-28 | 2010-12-15 | 华为技术有限公司 | Energy saving method, device and system under desktop virtual environment |
Non-Patent Citations (1)
| Title |
|---|
| 郭振兴，黎文伟.分布式网络故障监测的探针部署方法.《计算机系统应用》.2011,第20卷(第11期),第59-62页. * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111338656A (en) * | 2020-02-25 | 2020-06-26 | 平安科技（深圳）有限公司 | Method and device for installing software package to target host and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102437938A (en) | 2012-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102437938B (en) | Large-scale network monitoring oriented virtual deployment system and method | |
| CN108549580B (en) | Method for automatically deploying Kubernets slave nodes and terminal equipment | |
| CN110471831B (en) | Automatic method and device for compatibility test | |
| CN103677858B (en) | Method, system and the equipment of software virtual machine management in a kind of cloud environment | |
| US8832680B2 (en) | Installation event counting apparatus and package creation method | |
| CN111698283B (en) | Management and control method, device, equipment and storage medium of distributed cluster host | |
| CN105653329A (en) | Application management method, apparatus and system | |
| KR20050087129A (en) | Method of testing osgi service platform and test tool thereof | |
| CN104573494A (en) | Safety mobile office method based on WMI software whitelist mechanism | |
| WO2012088905A1 (en) | Polling sub-system and polling method for communication network system and communication apparatus | |
| CN106919485A (en) | A kind of system based on configuration hardware testing instrument on server | |
| CN105912389A (en) | Technique for implementing virtual machine transition system in hybrid cloud environment on basis of data virtualization | |
| CN103198007A (en) | Multi-process log output method and system | |
| CN103685567A (en) | Virtual application server configuration method under cloud environment | |
| CN114385759A (en) | Configuration file synchronization method and device, computer equipment and storage medium | |
| CN109558147A (en) | A kind of continuous integrating platform construction method based on Jenkins and Gitlab | |
| WO2015062217A1 (en) | Connection processing method and device for peripheral in virtual desktop system | |
| CN113127009A (en) | Automatic deployment method and device for big data management platform | |
| CN110063042A (en) | A kind of response method and its terminal of database failure | |
| WO2016197688A1 (en) | Data collection method and device | |
| CN105389254A (en) | System and method for verifying compatibility of server and Oracle Linux system | |
| CN113434155A (en) | Automatic deployment system in mixed cloud mode | |
| CN113672336A (en) | K8S container cluster deployment method, device, equipment and readable storage medium | |
| CN116700751A (en) | Upgrading method of server firmware and computing device | |
| CN115390861A (en) | Resource deployment method, device and equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20131113 Termination date: 20170109 |