CN111752680A

CN111752680A - IPC simulation method, device, storage medium and equipment based on KVM

Info

Publication number: CN111752680A
Application number: CN202010597824.7A
Authority: CN
Inventors: 陈玫彤; 沈业业; 杜金翰
Original assignee: Chongqing Unisinsight Technology Co Ltd
Current assignee: Chongqing Unisinsight Technology Co Ltd
Priority date: 2020-06-28
Filing date: 2020-06-28
Publication date: 2020-10-09
Anticipated expiration: 2040-06-28
Also published as: CN111752680B

Abstract

The invention discloses an IPC simulation method based on a KVM, which comprises the following steps: at least one virtual machine is deployed on a physical machine, and an IPC simulation unit is deployed on each virtual machine and used for simulating multiple paths of IPCs to generate multiple paths of virtual IPCs; setting at least one storage server; configuring parameters of the IPC simulation unit and parameters of the at least one storage server; and the IPC analog unit is butted with at least one storage server, wherein each storage server comprises at least one storage node, and each path of virtual IPC of the IPC analog unit is butted with one storage node. The invention combines the virtual machine and the IPC simulation unit together, saves server resources, can be matched with a plurality of sets of storage environments, and does not influence the use.

Description

IPC simulation method, device, storage medium and equipment based on KVM

Technical Field

The invention relates to the field of monitoring, in particular to an IPC simulation method and system based on a KVM.

Background

In recent years, the advantages of a digital and networked video monitoring system to a traditional CCTV system are more obvious, the high standard, openness, integration and flexibility of the system provide a wider development space for the development of the whole security industry, the video monitoring industry needs to access a large number of network cameras (ipcameras, IPCs) for service testing and restoring an actual application scene, if all the network cameras are accessed to a real IPC, not only a large amount of financial resources are consumed, but also a large amount of manpower is needed to install and maintain the real IPCs, and the cost is higher.

Disclosure of Invention

In view of the above-mentioned shortcomings of the prior art, the present invention provides a KVM-based IPC simulation method and system, which are used to solve the shortcomings of the prior art.

To achieve the above and other related objects, the present invention provides an IPC simulation method based on KVM, comprising:

at least one virtual machine is deployed on a physical machine, and an IPC simulation unit is deployed on each virtual machine and used for simulating multiple paths of IPCs to generate multiple paths of virtual IPCs;

setting at least one storage server;

configuring parameters of the IPC simulation unit and parameters of the at least one storage server;

and the IPC analog unit is butted with at least one storage server, wherein each storage server comprises at least one storage node, and each path of virtual IPC of the IPC analog unit is butted with one storage node.

Optionally, when the IPC simulation unit is deployed on a virtual machine, a dependent component is deployed on the virtual machine, including a pgsql database, a redis database, and a zookeeper node.

Optionally, configuring the parameters of the IPC analog unit includes configuring storage node information; configuring parameters of the storage server includes: configuring a cfg file and updating zookeeper node data.

Optionally, the IPC simulation unit interfaces with the at least one storage server through a TCP protocol.

Optionally, the IPC simulation unit includes a media stream process and two storage management processes, the media stream process interfaces the storage management service of the server, and the storage management process interfaces the streaming media service of the server.

Optionally, interfacing the IPC analog unit with at least one storage server, comprising:

writing node data to the zookeeper node, comprising: process IP address and port number;

the IPC simulation unit starts a docking service process, the docking service process reads the node data of the zookeeper node and acquires a corresponding storage server process;

initiating a connection request to a process IP address written into a zookeeper node;

and the storage server returns the connection determination information to complete the butt joint of the IPC simulation unit and at least one storage server.

Optionally, after the IPC simulation unit is docked with at least one storage server, a keep-alive thread is created in a process session of the IPC simulation unit, a keep-alive message is sent to the storage server at regular time, when the session is disconnected, node data retained in the zookeeper node is read again, and a session connection request is initiated again to an address of the corresponding storage server.

To achieve the above and other related objects, the present invention provides an IPC simulator based on KVM, comprising:

the IPC simulation unit is deployed on each virtual machine and used for simulating multiple paths of IPCs to generate multiple paths of virtual IPCs;

at least one storage server;

the IPC simulation unit is in butt joint with at least one storage server, wherein each storage server comprises at least one storage node, and each virtual IPC of the IPC simulation unit is in butt joint with one storage node.

To achieve the above and other related objects, the present invention provides a storage medium storing a computer program which, when executed by a processor, performs the method.

To achieve the above and other related objects, the present invention provides an apparatus comprising: a processor and a memory;

the memory is configured to store a computer program and the processor is configured to execute the computer program stored by the memory to cause the apparatus to perform the method.

As described above, the IPC simulation method and apparatus based on KVM according to the present invention have the following advantages:

the invention provides an IPC simulation method based on a KVM virtual machine, wherein a plurality of virtual machines are installed on one physical machine, and a plurality of paths of IPCs are simulated on the virtual machines, so that the IPC simulation method can be used by a plurality of people at the same time, and has the following advantages that: 1. save resources, installation and simple to use: a physical machine can be used for deploying a plurality of virtual machines, systems of different versions or the same version can be installed according to actual test requirements, the virtual machines are logically isolated and do not influence each other in use, other software can be installed and deployed on the virtual machines, video data of different code rates can be uploaded according to requirements, the code rates can be changed, such as commonly-used code rates of 1MB/S, 2MB/S, 4MB/S and the like, the time for deploying and adjusting a test environment is shortened to dozens of minutes, the environment is greatly convenient for testers to deploy and maintain, the virtual machines and an IPC simulation unit are combined together, server resources are saved, and the physical machine can be matched with a plurality of storage environments and do not influence each other in use. 2. The IPC simulation unit can be directly connected with the storage server in a butt joint mode, signaling and media flows of a real environment are simplified through simulation of the IPC and the VMS (video monitoring platform software), resource consumption of the server is reduced, and the number of the final simulation cameras is increased.

Drawings

FIG. 1 is a flowchart of an IPC simulation method based on KVM according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an IPC simulation apparatus based on KVM according to an embodiment of the present invention.

Detailed Description

The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.

It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.

As shown in fig. 1, an IPC simulation method based on KVM includes:

s11, at least one virtual machine is deployed on the physical machine, and an IPC simulation unit is deployed on each virtual machine and used for simulating multiple paths of IPCs to generate multiple paths of virtual IPCs;

s12, setting at least one storage server;

s13 configuring the IPC simulation unit parameters and the at least one storage server parameters;

s14, the IPC analog unit is connected with at least one storage server, wherein, each storage server comprises at least one storage node, and each virtual IPC of the IPC analog unit is connected with one storage node.

The invention discloses a technology for realizing the maximization of the resource utilization rate and the flexible management by deploying virtual machines on a physical machine, wherein a plurality of virtual machines (Virtualmachine) can be operated on one physical machine, the virtual machines share the CPU (Central processing Unit), the memory and the IO hardware resources of the physical machine, but the virtual machines are isolated from one another logically, the original physical structure is broken through, and a user can flexibly manage the resources. The physical machine is generally called a Host (Host), the virtual machine on the Host is called a client (Guest), and the physical machine realizes the virtualization of hardware resources through a Hypervisor program and is provided for the Guest to use. The KVM is called a Kernel-based virtual machine (Kernel-based virtual machine) and is a Kernel module of linux, which makes linux become a Hypervisor.

The method for deploying the virtual machine on the physical machine comprises the following steps:

step 1, uploading an iso image file to a specified path;

step 2, automatically installing the KVM, comprising the following steps:

A. installing a KVM related rpm dependent package;

B. identifying the uploaded iso image file and the server IP;

C. modifying the network information, configuring a bridging network card, and starting libvirt service. Libvirt is a virtual machine management tool and comprises libvird service, virsh commands, Libvirt API and other contents, a network card virbr0 is generated after the Libvirt service is started, a virtual machine is created and started to generate a network card vnet0, the virtual machine is bridged on br through vnet0 in a default mode, the internet is accessed through a nat mode, the virtual machine cannot be directly connected with the virtual machine through xshell and other tools directly, and the virtual machine can only be connected with the virtual machine through a host machine. By creating a virtual network card br0 on a host machine, wherein br0 is bridged to eth0, and after the ip of the host machine is occupied, the virtual machine can be directly communicated with other servers in the same network segment, and the virtual machine at the moment can be regarded as a server which is in the same position as the host machine;

D. configuring information such as the name, the memory, the CPU and the like of the virtual machine, installing the virtual machine, finishing the installation and checking whether the network of the virtual machine is normal or not, and whether the network of the virtual machine can be communicated with other servers in the same network segment or not so as to finish the deployment of the virtual machine.

It should be noted that, according to the actual service requirement and the hardware configuration of the physical machine, multiple virtual machines may be deployed, and the virtual machines are isolated from each other and do not affect each other.

And step 3, installing a virtual machine system (OS) and configuring an IP. And installing a virtual machine system according to the uploaded mirror image version, and configuring a virtual machine IP according to actual service requirements.

By this point, deployment of the virtual machine is completed. After the deployment of the virtual machine is completed, an IPC simulation unit is deployed on the virtual machine, and the method comprises the following steps:

step 1, installing components which are depended by an IPC simulation unit on a virtual machine, wherein the components comprise a pgsql database, a redis database, a zookeeper node and the like. Most of the pgsql database stores persistent data, and the persistent data are generally changed little; most data stored in a redis database are data with more changes, such as node states, distributed locks and the like, high-efficiency reading and writing are emphasized, if 2 million user information is stored in a system, the user information is basically fixed, once the input is rarely changed, when all the user information is loaded each time, if the database is required, the database compiles and executes query statements, the efficiency is low, the system access efficiency can be greatly improved by using the redis database, and data conflict cannot occur in single-thread processing; the zookeeper node is distributed program coordination service, data is communicated and coordinated among software program processes, complex and error-prone key service is packaged, and a simple and easy-to-use interface, a system with high performance and stable functions are provided for a user.

And 2, configuring parameters of the IPC simulation unit and parameters of the storage server. The parameters for configuring the IPC analog unit mainly comprise information such as configured storage nodes. The parameters for configuring the storage server comprise two parts, one is configuring a cfg file on the side of the storage server, pointing an access IP of a streaming media service process to a virtual machine IP where an IPC simulation unit is located, and modifying relevant service address information into address information of relevant dependent component installation, namely a pgsql database, a redis database, a zookeeper node and the like; and the other part is to update the node data of the zookeeper node into the corresponding node data in the test environment.

And 3, setting parameters such as code stream size and analog path number to simulate streaming, circularly reading specified video data through an IPC simulation unit to generate an RTSP (real time streaming protocol) stream, after configuration is completed, butting the storage server to the operated analog IPC software, and performing authentication, signaling interaction and keep-alive between the RTSP stream and the storage server through a TCP (Transmission control protocol) protocol.

And 4, butting with a storage server, and starting a video storage task. The IPC simulation unit has three processes which are in butt joint with the storage server and comprises a media stream process and two storage management processes, wherein the media stream process is in butt joint with the storage management service of the server, and the storage management processes are in butt joint with the stream media service of the server.

The specific flow of accessing the media stream is as follows:

and step 41, reading the data in the specified path to generate the RTSP stream based on the data. And generating virtual IPC information based on the real IPC information structure, binding a unique ID and a uniform RTSP data address by each virtual IPC, and writing the unique ID and the uniform RTSP data address into a data table for persistence. The tool reads an IPC data table of a local configuration file and equally divides IPC according to the data of the storage node of the server connected at present;

step 42, registering IPC analog unit service to the storage coordination service process, writing tool host address and port into the corresponding path, and reporting information such as persistent database and the like as nodes;

step 43, the storage service is butted through a TCP (Transmission control protocol) protocol, and as tcp communication is directly carried out with the bottom layer service, an intermediate protocol layer interaction flow is omitted, and all the request data directly reach the storage service;

step 44, initiating a new storage plan task request for each storage node in the storage server;

step 45, aiming at each path of virtual IPC data, initiating a cell and token application request to a storage node, wherein one cell corresponds to two tokens (one token for reading and one token for writing), the tokens are used for media data identification and verification, and the tokens and the cell design interior are increased progressively to ensure uniqueness;

step 46, initiating an IPC binding token reading request to a storage node, wherein the request carries information such as a stream address, a user name and a password;

step 47, finishing startstream response, designating a direct memory mode, finishing cell, token and other information and finally confirming;

step 48, the storage node receives the response, starts to fetch the stream from the appointed stream address, and stores the stream to the local disk;

step 49, the corresponding pull stream task information can be queried through the plan task query command of the tool.

The IPC simulation unit is deployed on the virtual machine through the foregoing steps, after the IPC simulation unit and the virtual machine are deployed, the IPC simulation unit needs to be connected with the storage server, and the connection establishment process is described in detail below, and the connection establishment mode is initialized: the storage server side modifies the configuration file and specifies node data of the zookeeper node, wherein the node data comprises: address and port information; and restarting the storage management process and the streaming media process, creating a tcpserver after the storage management process and the streaming media process are restarted, monitoring the specified port number, and writing information such as a process IP address, a port number and the like into the zookeeper node.

The IPC simulation unit starts a docking service process, the process reads node data on the zookeeper node to obtain corresponding service end process information, then writes a process IP address on the zookeeper node to initiate a connection request, and the request body data comprises various information (id numbers, addresses, ports and the like) of a local end and an opposite end.

And after the storage server returns the connection confirmation information, the initialization of establishing the connection by the tool is completed.

After the initial connection between the IPC simulation unit and the storage server is established, a keep-alive thread is established in process conversation of the IPC simulation unit, keep-alive messages are sent to the storage server at regular time (30 seconds can be achieved, and other values can be set according to requirements), all processes support a conversation reconnection mechanism, when the conversation is disconnected (when an empty message or socket is received abnormally), node data reserved in a zookeeper node is read again, and a conversation connection request is initiated to the corresponding storage server address again.

After the connection is established, the IPC simulation unit can initiate various request messages, such as query storage information, query task information, and the like, and one query request process is as follows: the IPC simulation unit generates a request message, wherein a message data header comprises basic information such as an id number, data length and the like, and a data body carries a request method name and request parameters, and after receiving the request message, the storage service executes corresponding operation and returns a message response to the IPC simulation unit.

As shown in fig. 2, an IPC analog apparatus based on KVM includes:

at least one virtual machine 22 deployed on the physical machine 21, each virtual machine being deployed with an IPC simulation unit for simulating multiple paths of IPCs to generate multiple paths of virtual IPCs;

at least one storage server 23;

Since the embodiment of the apparatus portion and the embodiment of the method portion correspond to each other, please refer to the description of the embodiment of the method portion for the content of the embodiment of the apparatus portion, which is not repeated here.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. For the specific I process of the units and modules in the system, reference may be made to the corresponding process in the foregoing method embodiments, which is not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may comprise any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a Read-only memory (ROM), a Random Access Memory (RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, etc.

The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims

1. An IPC simulation method based on KVM is characterized by comprising the following steps:

setting at least one storage server;

2. The IPC simulation apparatus based on KVM according to claim 1, wherein when IPC simulation unit is deployed on a virtual machine, dependent components are deployed on the virtual machine, including pgsql database, redis database, zookeeper node.

3. The IPC analog device based on KVM of claim 2, wherein configuring the parameters of the IPC analog unit comprises configuring storage node information; configuring parameters of the storage server includes: configuring a cfg file and updating zookeeper node data.

4. The IPC simulation method based on KVM of claim 1, wherein the IPC simulation unit interfaces with the at least one storage server through TCP protocol.

5. The IPC simulation method based on KVM as claimed in claim 3, wherein the IPC simulation unit comprises a media stream process and two storage management processes, the media stream process interfaces the storage management service of the server, the storage management process interfaces the streaming media service of the server.

6. The KVM-based IPC simulation method of claim 5, interfacing the IPC simulation unit with at least one storage server, comprising:

7. The IPC simulation method based on KVM as claimed in claim 6, wherein after the IPC simulation unit is docked with at least one storage server, the process session of the IPC simulation unit creates a keep alive thread, sends keep alive message to the storage server at regular time, re-reads the node data retained in the zookeeper node when the session is disconnected, and re-initiates the session connection request to the address of the corresponding storage server.

8. An IPC analog device based on KVM is characterized by comprising:

at least one storage server;

9. A storage medium storing a computer program, characterized in that the computer program, when executed by a processor, performs the method according to any one of claims 1 to 7.

10. An apparatus, comprising: a processor and a memory;

the memory for storing a computer program, the processor for executing the computer program stored by the memory to cause the apparatus to perform the method of any of claims 1 to 7.