CN110858890A

CN110858890A - Method, device and system for video monitoring multi-picture display

Info

Publication number: CN110858890A
Application number: CN201810968074.2A
Authority: CN
Inventors: 高莹; 肖晶
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2018-08-23
Filing date: 2018-08-23
Publication date: 2020-03-03

Abstract

The embodiment of the invention relates to a method, a device and a system for video monitoring multi-picture display. The method comprises the following steps: the method comprises the steps that an intelligent analysis device obtains a video monitoring picture collected by a camera, if the content of the video monitoring picture accords with a preset rule, the video monitoring picture is determined to be a key picture, the video monitoring picture is identified to be the key picture, the video monitoring picture and a key picture identification are sent, and the key picture identification is used for indicating that the video monitoring picture is the key picture; the monitoring server receives the at least two paths of video monitoring pictures and the key picture identification, acquires the corresponding key picture window display template according to the number of the key pictures, sets a position parameter, and the position parameter is used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures and sending the at least two paths of video monitoring pictures and the position parameter to the display equipment. According to the embodiment of the invention, the key pictures can be automatically identified and highlighted, and the window for displaying the key pictures can be timely adjusted.

Description

Method, device and system for video monitoring multi-picture display

Technical Field

The invention relates to the field of video monitoring, in particular to a method, a device and a system for multi-picture display of video monitoring.

Background

At present, in a video monitoring program interface, the application of simultaneously displaying a plurality of sub-pictures is very common. The multi-screen display usually adopts the split-screen multi-screen display mode, such as 4, 9 and 16 split-screen modes, and the derived 6, 8 and 10 split-screen modes. The plurality of sub-pictures play different contents, so that a user can simultaneously, quickly and intuitively browse video images captured by the plurality of monitoring cameras, and monitor points with abnormal conditions are analyzed and processed in time. In a typical application scenario, in order to prevent various abnormal situations that may occur in public or private places such as a cell \ a company \ a supermarket \ a home, a plurality of monitoring cameras are usually distributed in different locations, and monitoring pictures of the plurality of cameras are displayed on a monitoring display interface at the same time, so as to find the abnormal situations in time. Under the mode of the multi-picture display with the equal split screen, due to the fact that the importance of a plurality of video pictures is not distinguished, workers need to keep the same attention degree on all the video pictures, and key information in all the pictures is difficult to be considered at any moment, so that abnormal conditions occurring in a certain picture are easily missed, and necessary timely intervention cannot be implemented.

In view of the above-mentioned disadvantages of the split-screen multi-screen display mode, the prior art proposes a method for displaying multiple video monitor screens, which displays multiple video monitor screens in a non-split-screen multi-screen display mode (i.e. a key screen display mode), for example, the display size and position of a window in a video monitor program interface can be adjusted according to a user instruction, so that the key screen can be displayed in a larger window or a more obvious position.

As can be seen from the above, in the method for video monitoring multi-screen display in the prior art, although the key screen can be displayed in a larger window or a more obvious position, the key screen needs to be manually identified and the window for displaying the key screen needs to be manually adjusted in the multi-screen display process, so that the user may fail to identify the key screen in time and correspondingly fail to adjust the window for displaying the key screen in time, which may cause an abnormal situation occurring in a certain screen to be missed, and thus, the necessary timely intervention cannot be implemented.

Disclosure of Invention

The embodiment of the invention provides a method, a device and a system for displaying multiple video monitoring pictures, which can automatically identify and highlight key pictures and timely adjust windows for displaying the key pictures, so that workers can easily pay attention to abnormal conditions in the pictures, and necessary timely intervention is implemented.

In a first aspect, a method for video surveillance multi-view display is provided. The intelligent analysis device acquires a video monitoring picture acquired by the camera; if the content of the video monitoring picture conforms to a preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture and identifies the video monitoring picture as the key picture; the intelligent analysis device sends the video monitoring picture and a key picture identifier, wherein the key picture identifier is used for indicating that the video monitoring picture is a key picture.

The preset rule can be used for the intelligent analysis device to analyze whether the video monitoring picture comprises preset characters or behavior characteristics, wherein the character characteristics comprise age characteristics, gender characteristics or appearance characteristics and the like, the behavior characteristics comprise falling characteristics, stealing characteristics, robbery characteristics or stealing characteristics and the like, and if the video monitoring picture comprises the preset characteristics, the intelligent analysis device marks the video monitoring picture as a key picture.

In a possible implementation manner, the intelligent analysis device may receive a user instruction, set the preset rule according to the user instruction, and then analyze whether the content of the video monitoring picture conforms to the preset rule. According to the embodiment, the preset rule can be set by the user, and whether the picture is the key picture is determined according to the preset rule set by the user, so that the key picture can be flexibly determined according to the requirements of the user.

In the embodiment of the invention, after the video monitoring picture is collected by the camera, the video monitoring picture is not directly provided for the display equipment to display, but the video monitoring picture collected by the camera is firstly obtained by the intelligent analysis device, then determining the video monitoring picture as a key picture by analyzing the content of the video monitoring picture, and identifying the video monitoring picture as a key picture, sending the video monitoring picture and the key picture identification, wherein the key picture identification is used for indicating that the video monitoring picture is the key picture, therefore, the video monitoring picture carries the key picture identification when being sent out, the display equipment can identify the key picture in time according to the key picture identification, and accordingly the window for displaying the key picture is adjusted in time, so that workers can easily pay attention to abnormal conditions appearing in the picture, and necessary timely intervention is implemented.

It can be understood that, in the embodiment of the present invention, the intelligent analysis apparatus may be a camera integrated with the intelligent analysis module, or may be a device independent from the camera.

In a possible implementation manner, the intelligent analysis device acquires at least two paths of video monitoring pictures acquired by at least two cameras; the intelligent analysis device acquires corresponding key picture window display templates according to the number of the key pictures; the intelligent analysis device sets the position parameters of the at least two paths of video monitoring pictures according to the key picture window display template; and the intelligent analysis device sends the position parameter, and the position parameter is used for indicating the display position of each video monitoring picture in the at least two paths of video monitoring pictures. According to the embodiment, the intelligent analysis device can send the position parameters according to the number of the key pictures, and the position parameters are used for indicating the display position of each video monitoring picture in the at least two video monitoring pictures, so that the display equipment can more easily determine the window for displaying the key pictures, and workers can easily pay attention to abnormal conditions appearing in the pictures, thereby implementing necessary timely intervention.

In a second aspect, a method for video surveillance multi-view display is provided. The monitoring server receives at least two paths of video monitoring pictures and key picture identifications; the monitoring server determines a key picture in the at least two paths of video monitoring pictures according to the key picture identification; the monitoring server acquires corresponding key picture window display templates according to the number of the key pictures; the monitoring server sets position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures; and the monitoring server sends the at least two paths of video monitoring pictures and the position parameters to display equipment.

In the embodiment of the invention, the monitoring server can send the position parameters according to the number of the key pictures, and the position parameters are used for indicating the display position of each video monitoring picture in the at least two video monitoring pictures, so that the display equipment can more easily determine the window for displaying the key pictures, and workers can easily pay attention to abnormal conditions appearing in the pictures, thereby implementing necessary timely intervention.

In a possible embodiment, the display device is provided separately from the monitoring server, or the display device is integrated with the monitoring server, and the display device may be an integral part of the monitoring server. According to the embodiment, the monitoring server and the display device can be flexibly set.

In a third aspect, a method for video surveillance multi-view display is provided. The intelligent analysis device acquires a video monitoring picture acquired by the camera; if the content of the video monitoring picture conforms to a preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture and identifies the video monitoring picture as the key picture; the intelligent analysis device sends the video monitoring picture and a key picture identifier, wherein the key picture identifier is used for indicating that the video monitoring picture is a key picture; the monitoring server receives at least two paths of video monitoring pictures and key picture identifications; the monitoring server determines a key picture in the at least two paths of video monitoring pictures according to the key picture identification; the monitoring server acquires corresponding key picture window display templates according to the number of the key pictures; the monitoring server sets position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures; and the monitoring server sends the at least two paths of video monitoring pictures and the position parameters to display equipment.

In the embodiment of the invention, after the video monitoring picture is collected by the camera, the video monitoring picture is not directly provided for the display equipment to be displayed, but the video monitoring picture collected by the camera is firstly obtained by the intelligent analysis device, then the content of the video monitoring picture is analyzed to determine that the video monitoring picture is the key picture, the video monitoring picture is identified as the key picture, the video monitoring picture and the key picture identification are sent, the key picture identification is used for indicating that the video monitoring picture is the key picture, so that the video monitoring picture carries the key picture identification when being sent out, the monitoring server can send the position parameter according to the number of the key pictures, the position parameter is used for indicating the display position of each video monitoring picture in at least two paths of video monitoring pictures, and therefore, the display equipment can more easily determine the window for displaying the key picture, the staff can easily pay attention to the abnormal situation appearing in the picture, thereby implementing necessary timely intervention.

In a fourth aspect, an embodiment of the present invention provides an intelligent analysis apparatus, where the intelligent analysis apparatus may implement the functions performed in the method design in the first aspect, where the functions may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described functions.

In one possible design, the structure of the intelligent analysis apparatus includes a processor configured to support the intelligent analysis apparatus to perform the corresponding functions in the method of the first aspect. The intelligent analysis apparatus may also include a memory for coupling with the processor that retains the necessary program instructions and data for the intelligent analysis apparatus. The intelligent analysis device may further include a communication interface for transmitting or receiving information, transmitting video data, and the like.

In a fifth aspect, an embodiment of the present invention provides a monitoring server, where the monitoring server may implement the function executed in the method design in the second aspect, where the function may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described functions.

In one possible design, the monitoring server includes a processor configured to support the monitoring server to perform the corresponding functions in the method of the second aspect. The monitoring server may also include a memory, coupled to the processor, that stores program instructions and data necessary for the monitoring server. The monitoring server may also include a communication interface for sending or receiving information, transmitting video data, and the like.

In a sixth aspect, an embodiment of the present invention provides a system for video monitoring and multi-screen display, where the system can implement the functions performed in the method design of the third aspect, and the system can include the intelligent analysis device of the fourth aspect and the monitoring server of the fifth aspect.

In a seventh aspect, an embodiment of the present invention provides a communication device, which may be, for example, a chip, and which may be disposed in an intelligent analysis device, where the communication device includes a processor and an interface. The processor is configured to enable the communication device to perform the corresponding functions in the method of the first aspect. The interface is used to support communication between the communication device and other communication devices or other network elements. The communication device may also include a memory, coupled to the processor, that retains program instructions and data necessary for the communication device.

In an eighth aspect, an embodiment of the present invention provides a communication device, which may be a chip, for example, and which may be disposed in a monitoring server, where the communication device includes a processor and an interface. The processor is configured to enable the communication device to perform the corresponding functions of the method of the second aspect. The interface is used to support communication between the communication device and other communication devices or other network elements. The communication device may also include a memory, coupled to the processor, that retains program instructions and data necessary for the communication device.

In a ninth aspect, an embodiment of the present invention provides a computer storage medium, which stores instructions that, when executed on a computer, cause the computer to perform the method described in the first aspect or any one of the possible designs of the first aspect.

In a tenth aspect, embodiments of the present invention provide a computer storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the method of the second aspect or any one of the possible designs of the second aspect.

In an eleventh aspect, an embodiment of the present invention provides a computer program product, which contains instructions that, when the program is executed by a computer, cause the computer to execute the method described in the first aspect or any one of the possible designs of the first aspect.

In a twelfth aspect, an embodiment of the present invention provides a computer program product, which contains instructions that, when the program is executed by a computer, cause the computer to execute the method described in the second aspect or any one of the possible designs of the second aspect.

In a thirteenth aspect, an embodiment of the present invention provides a computer program, which includes instructions, when the program is executed by a computer, the instructions make the computer perform the method described in the first aspect or any one of the possible designs of the first aspect.

In a fourteenth aspect, an embodiment of the present invention provides a computer program, which includes instructions that, when the program is executed by a computer, cause the computer to perform the method described in the second aspect or any one of the possible designs of the second aspect.

Drawings

Fig. 1 is a schematic diagram of a video monitoring multi-screen display system according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating a method for video monitoring multi-screen display according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a highlight window display template according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating another highlight window display template according to an embodiment of the present invention;

FIG. 5 is a flowchart illustrating another method for video surveillance multi-screen display according to an embodiment of the present invention;

FIG. 6 is a flowchart illustrating another method for video surveillance multi-screen display according to an embodiment of the present invention;

fig. 7 is a flowchart of a method for processing inside a camera according to an embodiment of the present invention;

fig. 8 is a flowchart of a method for determining a key frame according to an embodiment of the present invention;

FIG. 9 is a flowchart of a method for video surveillance multi-screen display according to an embodiment of the present invention;

fig. 10 is a schematic diagram of a possible structure of an intelligent analysis device according to an embodiment of the present invention;

fig. 11 is a schematic diagram of another possible structure of an intelligent analysis device according to an embodiment of the present invention;

fig. 12 is a schematic diagram of a possible structure of a monitoring server according to an embodiment of the present invention;

fig. 13 is a schematic diagram of another possible structure of a monitoring server according to an embodiment of the present invention;

fig. 14 is a schematic diagram of a communication device according to an embodiment of the present application.

Detailed Description

Fig. 1 is a schematic structural diagram of a video monitoring multi-screen display system according to an embodiment of the present invention. Referring to fig. 1, the system mainly includes a camera 101 integrated with an intelligent analysis module, a monitoring server 102, and a display device 103. The camera 101 integrated with the intelligent analysis module may be referred to as an intelligent analysis device, and the monitoring server 102 is generally a monitoring server, and is configured to implement a control function on video monitoring pictures sent by a plurality of intelligent analysis devices, and send the video monitoring pictures to the display device 103. It can be understood that an intelligent analysis module may be integrated in each camera 101, and the intelligent analysis module only analyzes whether a video monitoring picture acquired by the camera 101 where the intelligent analysis module is located is a key picture, or may be integrated in only one of the cameras 101, and the intelligent analysis module analyzes whether the video monitoring pictures acquired by the plurality of cameras 101 are key pictures, and in addition, the intelligent analysis module may be further independently provided with the cameras 101, and the intelligent analysis module independently constitutes an intelligent analysis device. The monitoring server 102 may receive at least two video monitoring pictures and highlight picture identifications from the intelligent analysis device (e.g., the camera 101), and make further analysis processing based on the analysis result of the intelligent analysis device. For example, the monitoring server 102 controls the number of the key pictures, the monitoring server 102 sends the at least two paths of video monitoring pictures and the key picture identifiers to the display device 103, and the display device 103 displays the video monitoring pictures, which are identified as the key pictures by the key picture identifiers, in the corresponding windows according to the at least two paths of video monitoring pictures and the key picture identifiers. For another example, the monitoring server 102 determines position parameters of at least two paths of video monitoring pictures based on the key picture window display template, where the position parameters are used to indicate the display position of each of the at least two paths of video monitoring pictures; the monitoring server 102 sends the at least two paths of video monitoring pictures and the position parameters to the display device 103, and the display device 103 displays each path of video monitoring picture in a corresponding window according to the at least two paths of video monitoring pictures and the position parameters.

It should be noted that the system architecture shown in fig. 1 is only one possible system architecture provided by the embodiment of the present invention, and there may be many possible variations based on the system architecture, for example, the monitoring server 102 is combined with the functions of the intelligent analysis device, the combined functions are realized by the monitoring server 102 or the combined functions are realized by the intelligent analysis device; for another example, the functions of the monitoring server 102 and the display device 103 are combined, and the combined function is realized by the monitoring server 102 or the combined function is realized by the display device 103.

Fig. 2 is a schematic flow chart of a method for video monitoring multi-screen display according to an embodiment of the present invention, where the embodiment may be based on the system architecture shown in fig. 1, and the method includes:

step 201, the intelligent analysis device obtains a video monitoring picture collected by the camera.

Step 202, if the content of the video monitoring picture conforms to a preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture, and identifies the video monitoring picture as the key picture.

In one example, the intelligent analysis device analyzes whether the content of the video monitoring picture conforms to a preset rule. When the content of the video monitoring picture accords with the preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture; when the content of the video monitoring picture does not accord with the preset rule, the intelligent analysis device determines that the video monitoring picture is not a key picture (namely a common picture).

Step 203, the intelligent analysis device sends the video monitoring picture and a key picture identifier, where the key picture identifier is used to indicate that the video monitoring picture is a key picture.

It is understood that the intelligent analysis device 1 and the intelligent analysis device 2 in fig. 2 can respectively execute the foregoing steps 201 to 203, and possible cases include: the intelligent analysis device 1 and the intelligent analysis device 2 both recognize key pictures; the intelligent analysis device 1 identifies key pictures, and the intelligent analysis device 2 identifies common pictures; the intelligent analysis device 1 identifies common pictures, and the intelligent analysis device 2 identifies key pictures; the intelligent analysis device 1 and the intelligent analysis device 2 both recognize the normal screen. Fig. 2 shows only a case where both the intelligent analysis device 1 and the intelligent analysis device 2 recognize the key screen.

It should be noted that only one intelligent analysis device may be used to obtain the video monitoring pictures acquired by the multiple cameras, identify the common pictures and the key pictures in the video monitoring pictures acquired by the multiple cameras, and send the identified results to other devices, that is, one intelligent analysis device executes the above steps 201 to 203.

It should be noted that, if the content in the video monitoring picture that meets the preset rule is not found after the intelligent analysis device analyzes the video monitoring picture, that is, the video monitoring picture is a normal picture, the intelligent analysis device may add a normal picture identifier to the normal monitoring picture, or may not add any identifier. In step 203, the intelligent analysis device not only sends the video surveillance pictures marked as key pictures, but also sends the normal pictures and the normal picture identification (if any).

And step 204, the monitoring server receives at least two paths of video monitoring images and key image identifications.

In one example, the at least two paths of video surveillance pictures are all identified as key pictures, and each of the at least two paths of video surveillance pictures corresponds to a key picture identifier.

In another example, if a part of the at least two video surveillance pictures is identified as a key picture, each of the at least two video surveillance pictures corresponds to a key picture identifier.

Step 205, the monitoring server determines a key picture in the at least two video monitoring pictures according to the key picture identifier.

And step 206, the monitoring server acquires a corresponding key picture window display template according to the number of the key pictures.

And step 207, setting position parameters of the at least two paths of video monitoring pictures by the monitoring server according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures.

And 208, the monitoring server sends the at least two paths of video monitoring pictures and the position parameters to a display device.

Specific execution modes of the above steps are described below.

In step 201, the intelligent analysis device obtains a video monitoring picture collected by a camera. It can be understood that, when the intelligent analysis module is integrated inside the camera, the camera is an intelligent analysis device, and the camera can transmit the collected video monitoring pictures to the intelligent analysis module through an internal communication mechanism. When the intelligent analysis module is independent of the camera, the intelligent analysis device and the camera are different devices, and the camera can transmit the collected video monitoring pictures to the intelligent analysis device.

In step 202, if the content of the video surveillance picture conforms to a preset rule, the intelligent analysis device determines that the video surveillance picture is a key picture, and identifies the video surveillance picture as a key picture. In one example, the intelligent analysis device analyzes whether the content of the video monitoring picture includes a person or an action conforming to preset characteristics, for example, the preset characteristics include an age characteristic, a gender characteristic, a shape characteristic falling characteristic, a theft characteristic, a robbery characteristic or a crowding characteristic. It can be understood that the preset rules may be configured in a unified manner, or the preset rules may be changed by the user at any time according to the user requirement. For example, before step 202, the intelligent analysis device receives a user instruction, and sets the preset rule according to the user instruction.

It can be understood that the intelligent analysis device may adopt any target detection algorithm or video analysis algorithm to identify whether the content of the video monitoring picture conforms to the preset rule, which is not described herein again.

In step 203, the intelligent analysis device sends the video monitoring picture and a key picture identifier, where the key picture identifier is used to indicate that the video monitoring picture is a key picture. It can be understood that when the video monitoring picture is not the highlight picture, the video monitoring picture can be marked as a normal picture and carries a normal picture identifier, or does not carry any identifier. In addition, the intelligent analysis device can directly send the video monitoring picture and the key picture identifier to the display equipment, and the display equipment displays the video monitoring picture in a corresponding window according to the key picture identifier; or the intelligent analysis device sends the video monitoring picture and the key picture identification to a monitoring server, and the monitoring server performs further analysis processing and then displays the video monitoring picture in a corresponding window by display equipment.

In step 204, the monitoring server receives at least two video monitoring pictures and an identification of the key picture. It can be understood that the monitoring server can receive at least two paths of video monitoring pictures and key picture identifications from the intelligent analysis device.

In step 205, the monitoring server determines a key picture in the at least two video monitoring pictures according to the key picture identifier. It can be understood that the at least two paths of video monitoring pictures may include a key picture and a general picture, and the monitoring server may determine the key picture in the at least two paths of video monitoring pictures according to the key picture identifier.

In step 206, the monitoring server obtains a corresponding highlight window display template according to the number of the highlight. It can be understood that, in order to adapt to different situations of the number of the key pictures, a plurality of key picture window display templates may be preset, for example, if the number of the video monitoring pictures is 5, when the number of the key pictures is 1, the key picture window display template shown in fig. 3 may be adopted, the key picture is displayed in the window marked as E, and the normal picture is displayed in the window marked as A, B, C, D; when the number of highlight frames is 2, the highlight frame window display template shown in fig. 4 may be used, and the highlight frames may be displayed in the windows labeled D and E, and the normal frame may be displayed in the window labeled A, B, C.

In step 207, the monitoring server sets position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, where the position parameters are used to indicate a display position of each of the at least two paths of video monitoring pictures. It is understood that each video surveillance picture may be set with a position parameter, which may be a mark (e.g., a or B or C or D or E) of a window in the highlight window display template, and may also be a vertex coordinate of the window. Alternatively, only one position parameter may be set for each key picture, and the position parameter may not be set for the normal picture.

In step 208, the monitoring server sends the at least two video monitoring pictures and the position parameter to a display device. It can be understood that, when the display device receives the at least two paths of video monitoring pictures and the position parameter of each path of video monitoring picture, the at least two paths of video monitoring pictures can be displayed according to the position parameter; when the display device receives the at least two paths of video monitoring pictures and the position parameters of each path of key picture, the key pictures can be displayed according to the position parameters, and common pictures can be displayed at preset positions.

Fig. 5 is a schematic flow chart of another method for monitoring multi-screen display by video according to an embodiment of the present invention, where the embodiment may be based on a variation of the system architecture shown in fig. 1, that is, the monitoring server is combined with the functions of the intelligent analysis device, and the intelligent analysis device implements the combined functions, where the method includes:

step 501, the intelligent analysis device obtains a video monitoring picture collected by a camera.

It can be understood that when the monitoring server is combined with the functions of the intelligent analysis device, the intelligent analysis device obtains at least two video monitoring pictures collected by at least two cameras.

Step 502, the intelligent analysis device analyzes whether the content of the video monitoring picture meets a preset rule.

Step 503, when the content of the video monitoring picture conforms to the preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture.

In step 504, the intelligent analysis device determines whether the number of the key frames exceeds a preset threshold.

Step 505, if the intelligent analysis device determines that the number of the key frames exceeds the preset threshold, selecting key frames with the same number as the preset threshold from the key frames.

Wherein, step 504 and step 505 are optional steps.

Step 506, the intelligent analysis device obtains a corresponding key picture window display template according to the number of the key pictures.

And 507, setting the position parameters of the at least two paths of video monitoring images by the intelligent analysis device according to the key image window display template.

And step 508, the intelligent analysis device sends the position parameter, and the position parameter is used for indicating the display position of each video monitoring picture in the at least two paths of video monitoring pictures.

In step 509, the intelligent analysis device sends the video surveillance picture and a key picture identifier, where the key picture identifier is used to indicate that the video surveillance picture is a key picture.

Step 508 and step 509 may be combined, and step 508 and step 509 are combined into one step, and the key picture identifier therein may be used as an optional parameter, that is, the intelligent analysis device may only send the video monitoring picture and the location parameter, but not send the key picture identifier.

The embodiment of the invention simplifies the system architecture, combines the functions of the monitoring server and the intelligent analysis device, realizes the combined function by the intelligent analysis device, and the intelligent analysis device can send the position parameters according to the number of the key pictures, and the position parameters are used for indicating the display position of each video monitoring picture in the at least two video monitoring pictures, so that the display equipment can more easily determine the window for displaying the key pictures, and the working personnel can easily pay attention to the abnormal conditions in the pictures, thereby implementing necessary timely intervention.

Fig. 6 is a communication schematic diagram of another video monitoring multi-screen display method according to an embodiment of the present invention, where the embodiment may be based on another variation of the system architecture shown in fig. 1, that is, a monitoring server is combined with functions of a display device, for example, the display device is integrated with the monitoring server, and the monitoring server includes functions of the display device and is capable of displaying a monitoring screen, where the method includes:

step 601, the intelligent analysis device acquires a video monitoring picture acquired by the camera.

Step 602, the intelligent analysis device analyzes whether the content of the video monitoring picture meets a preset rule.

Step 603, when the content of the video monitoring picture conforms to the preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture.

Step 604, the intelligent analysis device sends the video monitoring picture and a key picture identifier, where the key picture identifier is used to indicate that the video monitoring picture is a key picture.

Step 605, the monitoring server receives at least two paths of video monitoring pictures and key picture identifiers.

And 606, the monitoring server determines a key picture in the at least two paths of video monitoring pictures according to the key picture identification.

Step 607, the monitoring server obtains the corresponding key picture window display template according to the number of the key pictures.

Step 608, the monitoring server sets position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, where the position parameters are used to indicate a display position of each of the at least two paths of video monitoring pictures.

And 609, the monitoring server displays the at least two paths of video monitoring pictures at corresponding positions according to the position parameters.

The embodiment of the invention simplifies the system architecture, integrates the functions of the monitoring server and the display equipment together, realizes the function of the display equipment by the monitoring server, and can determine the position parameter according to the number of the key pictures, wherein the position parameter is used for indicating the display position of each video monitoring picture in the at least two video monitoring pictures, so that the monitoring server can more easily determine the window for displaying the key pictures, and the working personnel can easily pay attention to the abnormal conditions in the pictures, thereby implementing necessary timely intervention.

It can be understood that, in the embodiment of the present invention, the intelligent analysis device analyzes the content of the video monitoring picture, and divides the video monitoring picture into the key picture and the normal picture according to the content of the video monitoring picture. After receiving the multiple paths of video monitoring pictures, the monitoring server adjusts the picture layout according to the number of the key pictures, further determines the key pictures and/or sets the position parameters of the at least two paths of video monitoring pictures according to a key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures. And the display equipment determines that the key picture and the common picture are respectively displayed in the key picture window and the common picture window according to the key picture identification and/or the position parameter sent by the monitoring server.

In one example, the criterion (i.e. the preset rule) for determining whether the picture is the key picture may include, but is not limited to: specific target objects (e.g., special objects such as suspicious people, elderly children, etc.); the presence of abnormal behavior (vandalism, falls, etc.); other target characteristics or behaviors, etc.

The above-mentioned basis can be preset by service provider, also can be changed according to the need by user at any time.

It can be understood that, in the embodiment of the present invention, the preset rule according to which the key picture is determined is flexible, and mainly reflects that a picture including some target features or behaviors set by the user is the key picture, which has the characteristic of user-defined. Because the video monitoring picture is continuously refreshed, a periodic judgment mode can be adopted for judging whether the video monitoring picture is the key picture, and refreshing can be carried out once at intervals or when the change of the front frame picture and the back frame picture exceeds a preset threshold value.

The intelligent analysis module can be integrated in the camera or be independent from the camera. Taking the example of the intelligent analysis module integrated in the camera as an example, fig. 7 shows a flowchart of a method for processing inside the camera, and referring to fig. 7, the processing procedure includes:

and 701, acquiring a video monitoring picture acquired by a camera.

For example, the camera sends video surveillance pictures to the intelligent analysis module.

And step 702, analyzing the content of the video monitoring picture, and determining whether the video monitoring picture is a key picture according to an analysis result.

If the video monitoring picture is determined to be the key picture, executing step 704; if it is determined that the video surveillance picture is not the key picture, step 703 is performed.

For example, the intelligent analysis module analyzes and processes a video monitoring picture; and marking the video monitoring picture according to the analysis result, wherein the marking result is a key picture or a common picture.

And 703, sending the video monitoring picture.

It can be understood that, when it is determined in step 702 that the video monitoring picture is not the key picture, that is, the video monitoring picture is the normal picture, the video monitoring picture sent in step 703 may carry the normal picture identifier or may not carry any identifier, as a default.

And step 704, sending the video monitoring picture with the key picture identification.

If the intelligent analysis module determines that the video monitoring picture is a key picture, a key picture identifier is generated, the video monitoring picture is marked as the key picture, and then the marking result and the corresponding video monitoring picture are sent to the display equipment.

In one example, the display device determines that the number of the received key pictures is different from the number of the key pictures displayed in the current window, and the display device obtains a new key picture window display template from a template library (on a server or in a local database) according to the number of the received key pictures, and displays the key pictures and the common pictures according to the new key picture window display template.

In an example, the camera further integrates the function of a monitoring server, as shown in fig. 8, which is a flowchart of a method for determining a highlight according to an embodiment of the present invention, with reference to fig. 8, step 702 includes:

step 7021, determining whether an abnormal event meeting a preset rule exists in the video monitoring picture.

If it is determined that an abnormal event meeting a preset rule exists in the video monitoring picture, executing step 7022; if it is determined that there is no abnormal event meeting the preset rule in the video monitoring picture, step 7025 is executed.

Step 7022, determine whether the number of the current key frames exceeds the maximum number N.

If the number of the current key pictures exceeds the maximum number N, executing a step 7024; if the number of the current key pictures is judged not to exceed the maximum number N, step 7023 is executed.

Step 7023, determining the video monitoring picture as a key picture.

Step 7024, determine whether a ranking policy is set.

If the ranking policy is set, then step 7026 is performed; if the ordering policy is not set, step 7025 is performed.

Step 7025, determining the video monitoring picture to be a common picture.

Step 7026, redetermine N key pictures from the video monitoring picture and the N key pictures according to the sorting strategy.

It should be understood that, in the embodiment of the present invention, when the determination result in the step 7021 is yes, the step 7023 may be directly performed without performing the determination processes in the steps 7022 and 7024, where the steps 7022, 7024, and 7026 are optional steps.

As can be seen from the above, the method for determining the key pictures shown in fig. 8 considers both the picture content and the number of the key pictures, so that the determined number of the key pictures is within a certain range, and is more likely to attract the attention of the monitoring personnel.

In an example, the display device further integrates the function of a monitoring server, as shown in fig. 9, which is a flowchart of a method for video monitoring multi-screen display according to an embodiment of the present invention, with reference to fig. 9, the method includes:

step 901, the display device receives at least two paths of video monitoring pictures.

And 902, judging whether the at least two paths of video monitoring pictures contain key pictures.

If the at least two paths of video monitoring pictures do not contain key pictures, executing step 903; if it is determined that the at least two video surveillance pictures include a key picture, step 904 is executed.

And 903, displaying the at least two paths of video monitoring pictures according to an equal division mode.

Step 904, determine whether the number of the key frames is the same as the number of the key frames displayed in the current window.

If the number of the key pictures displayed in the current window is different, executing step 905; if the number of the key pictures displayed in the current window is the same, step 906 is executed.

And step 905, acquiring a corresponding key picture window display template according to the number of the key pictures.

Step 906, displaying the key screen in the key screen window.

Step 907, displaying the normal picture in the normal picture window.

When step 905 is executed first and then step 906 and step 907 are executed, step 906 is to apply the newly acquired template and display the key screen in the key screen window, and step 907 is to apply the newly acquired template and display the normal screen in the normal screen window.

In the embodiment of the invention, the intelligent analysis technology is fully utilized, manual operation is not needed, the multi-channel video monitoring pictures are automatically divided into the key pictures and the common pictures, the content of the key pictures is highlighted, the key video pictures containing abnormal conditions are prevented from being ignored, and the optimal prevention intervention opportunity for the abnormal conditions is missed.

In addition, aiming at the scenes of multiple cameras, the monitoring server is used for carrying out unified control and management, a user can customize a key picture window display template, and the user-defined template can also be sent to the monitoring server.

In one example, the monitoring server obtains video monitoring pictures and their identifiers (e.g., highlight identifiers) from a plurality of cameras, and the monitoring server determines whether the video monitoring pictures are highlight according to rules and sends the video monitoring pictures and their identifiers to the display device for display.

In another example, the monitoring server obtains video monitoring pictures and their identifications from a plurality of cameras, and the monitoring server downloads the templates and combines the pictures by itself, and directly sends the combined pictures to the display device for display.

Further, the display apparatus may have two display modes, i.e., a halving mode and an emphasized-screen window mode. And when the received video monitoring picture contains the key picture and the current mode is the equal division mode (the window layout does not contain the key picture window), adjusting the video monitoring display window to be the key picture window mode.

The above description mainly introduces the scheme of the embodiment of the present invention from the perspective of the method flow. It is understood that each network element, such as the intelligent analysis device, the monitoring server, etc., contains corresponding hardware structures and/or software modules for executing each function in order to realize the functions. Those of skill in the art will readily appreciate that the present invention can be implemented in hardware or a combination of hardware and computer software, with the exemplary elements and algorithm steps described in connection with the embodiments disclosed herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the embodiment of the present invention, the intelligent analysis device, the monitoring server, and the like may be divided into functional modules according to the above method examples, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the embodiment of the present invention is schematic, and is only a logic function division, and there may be another division manner in actual implementation.

Fig. 10 shows a schematic diagram of a possible structure of the intelligent analysis device according to the above-described embodiment, in the case of an integrated module. The intelligent analysis device 1000 includes: a processing module 1002 and a communication module 1003. Processing module 1002 is used to control and manage the actions of the intelligent analysis device, e.g., processing module 1002 is used to support the intelligent analysis device to perform the processes of fig. 2, 5, 7, 8, and/or other processes for the techniques described herein. The communication module 1003 is used to support communication between the intelligent analysis device and other network entities, for example, communication with a monitoring server. The intelligent analysis apparatus may further include a storage module 1001 for storing program codes and data of the intelligent analysis apparatus.

The communication module 1003 is configured to acquire a video monitoring picture acquired by the camera;

the processing module 1002 is configured to determine that the video monitoring picture is a key picture if the content of the video monitoring picture meets a preset rule, and identify the video monitoring picture as the key picture; the communication module 1003 is further configured to send the video monitoring picture and an important picture identifier, where the important picture identifier is used to indicate that the video monitoring picture is an important picture.

In an example, the communication module 1003 is specifically configured to acquire at least two paths of video monitoring pictures acquired by at least two cameras;

the processing module 1002 is further configured to obtain a corresponding key image window display template according to the number of the key images; setting position parameters of the at least two paths of video monitoring pictures according to the key picture window display template;

the communication module 1003 is further configured to send the position parameter, where the position parameter is used to indicate a display position of each of the at least two paths of video monitoring pictures.

In an example, the communication module 1003 is further configured to receive a user instruction; the processing module 1002 is further configured to set the preset rule according to the user instruction.

In the embodiment of the invention, after a video monitoring picture is collected by a camera, the video monitoring picture is not directly provided for display of a display device, but a communication module 1003 of an intelligent analysis device firstly acquires the video monitoring picture collected by the camera, then a processing module 1002 analyzes the content of the video monitoring picture to determine that the video monitoring picture is a key picture and marks the video monitoring picture as the key picture, the communication module 1003 sends the video monitoring picture and a key picture mark, the key picture mark is used for indicating that the video monitoring picture is the key picture, so that the video monitoring picture carries the key picture mark when being sent out, the display device can timely identify the key picture according to the key picture mark and correspondingly timely adjust a window for displaying the key picture, and workers can easily pay attention to abnormal conditions appearing in the picture, thereby effecting the necessary timely intervention.

The processing module 1002 may be a Processor or a controller, such as a Central Processing Unit (CPU), a general-purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with the embodiment disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others. The communication module 1003 may be a communication interface, a transceiver circuit, etc., wherein the communication interface is generally referred to and may include one or more interfaces. The storage module 1001 may be a memory.

When the processing module 1002 is a processor, the communication module 1003 is a communication interface, and the storage module 1001 is a memory, the intelligent analysis device according to the embodiment of the present invention may be the intelligent analysis device shown in fig. 11.

Referring to fig. 11, the intelligent analysis apparatus 1100 includes: a processor 1102, a communication interface 1103, and a memory 1101. The communication interface 1103, the processor 1102, and the memory 1101 may be connected to each other through a communication connection.

Fig. 12 shows a schematic diagram of a possible configuration of the monitoring server according to the above exemplary embodiment, in the case of an integrated module. The monitoring server 1200 includes: a processing module 1202, and a communication module 1203. The processing module 1202 is used to control and manage the actions of the monitoring server, e.g., the processing module 1202 is used to support the monitoring server to perform the processes of fig. 2, 5, 6, 8, 9, and/or other processes for the techniques described herein. The communication module 1203 is used to support communication between the monitoring server and other network entities, for example, communication between the intelligent analysis apparatus or the display device. The monitoring server may further comprise a storage module 1201 for storing program codes and data of the monitoring server.

The communication module 1203 is configured to receive at least two video monitoring pictures and key picture identifiers;

a processing module 1202, configured to determine a key picture in the at least two paths of video monitoring pictures according to the key picture identifier received by the communication module 1203; acquiring corresponding key picture window display templates according to the number of the key pictures; setting position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures;

the communication module 1203 is further configured to send the at least two video monitoring pictures and the position parameter to a display device.

In one example, the display device is provided separately from the monitoring server, or the display device is integrated with the monitoring server, or the display device is a component of the monitoring server.

In the embodiment of the present invention, the processing module 1202 of the monitoring server may determine a position parameter according to the number of the key pictures, and send the position parameter through the communication module 1203, where the position parameter is used to indicate the display position of each of the at least two video monitoring pictures, so that the display device may more easily determine a window for displaying the key pictures, and a worker may easily pay attention to an abnormal situation occurring in the pictures, thereby implementing necessary timely intervention.

The processing module 1202 may be a Processor or a controller, such as a Central Processing Unit (CPU), a general-purpose Processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with the embodiment disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others. The communication module 1203 may be a communication interface, a transceiver circuit, etc., wherein the communication interface is a generic term and may include one or more interfaces. The storage module 1201 may be a memory.

When the processing module 1202 is a processor, the communication module 1203 is a communication interface (e.g., a Radio Frequency (RF) circuit), and the storage module 1201 is a memory, the monitoring server according to the embodiment of the present invention may be the monitoring server shown in fig. 13.

Referring to fig. 13, the monitoring server 1300 includes: processor 1302, communication interface 1303, memory 1301. The communication interface 1303, the processor 1302, and the memory 1301 may be connected to each other through a communication connection.

Fig. 14 is a schematic diagram of a communication device according to an embodiment of the present application, and as shown in fig. 14, the communication device 1400 may be a chip, where the chip includes a processing unit and a communication unit. The processing unit may be a processor 1410, which may be of the various types described previously. The communication unit may be, for example, an input/output interface 1420, a pin or a circuit, etc., which may include or be connected to a system bus. Optionally, the communication device further includes a storage unit, which may be a memory 1430 inside the chip, such as a register, a cache, a Random Access Memory (RAM), an EEPROM, or a FLASH; the memory unit may also be a memory located outside the chip, which may be of the various types described hereinbefore. A processor is coupled to the memory, and the processor can execute the instructions stored in the memory to cause the communication device to perform the methods described above with reference to fig. 2, 5-9.

In the various embodiments of the invention described above, implementation may be in whole or in part via software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), among others.

The above-mentioned embodiments, objects, technical solutions and advantages of the present invention are further described in detail, it should be understood that the above-mentioned embodiments are only exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present invention should be included in the scope of the present invention.

Claims

1. A method for video surveillance multi-view display, the method comprising:

the intelligent analysis device acquires a video monitoring picture acquired by the camera;

if the content of the video monitoring picture conforms to a preset rule, the intelligent analysis device determines that the video monitoring picture is a key picture and identifies the video monitoring picture as the key picture;

the intelligent analysis device sends the video monitoring picture and a key picture identifier, wherein the key picture identifier is used for indicating that the video monitoring picture is a key picture.

2. The method of claim 1, wherein the intelligent analysis device obtains video surveillance pictures captured by a camera, comprising:

the intelligent analysis device acquires at least two paths of video monitoring pictures acquired by at least two cameras.

3. The method of claim 2, wherein the method further comprises:

the intelligent analysis device acquires corresponding key picture window display templates according to the number of the key pictures;

the intelligent analysis device sets the position parameters of the at least two paths of video monitoring pictures according to the key picture window display template;

and the intelligent analysis device sends the position parameters, and the position parameters are used for indicating the display positions of the at least two paths of video monitoring pictures.

4. The method of any of claims 1 to 3, further comprising:

and the intelligent analysis device receives a user instruction and sets the preset rule according to the user instruction.

5. A method for video surveillance multi-view display, the method comprising:

the monitoring server receives at least two paths of video monitoring pictures and key picture identifications;

the monitoring server determines a key picture in the at least two paths of video monitoring pictures according to the key picture identification;

the monitoring server acquires corresponding key picture window display templates according to the number of the key pictures;

the monitoring server sets position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures;

and the monitoring server sends the at least two paths of video monitoring pictures and the position parameters to display equipment.

6. The method of claim 5, wherein before the monitoring server obtains the corresponding highlight window display template according to the number of the highlight, the method further comprises:

the monitoring server judges whether the number of the key pictures exceeds a preset threshold value;

and if the number of the key pictures exceeds the preset threshold value, the monitoring server selects key pictures with the same number as the preset threshold value from the key pictures.

7. The method of claim 5 or 6, wherein the display device is provided independently of the monitoring server; or,

the display device is a component of the monitoring server.

8. A method for video surveillance multi-view display, the method comprising:

the intelligent analysis device sends the video monitoring picture and a key picture identifier, wherein the key picture identifier is used for indicating that the video monitoring picture is a key picture;

9. An intelligent analysis apparatus, characterized in that the apparatus comprises:

the communication module is used for acquiring a video monitoring picture acquired by the camera;

the processing module is used for determining the video monitoring picture as a key picture if the content of the video monitoring picture accords with a preset rule, and identifying the video monitoring picture as the key picture;

the communication module is further configured to send the video monitoring picture and a key picture identifier, where the key picture identifier is used to indicate that the video monitoring picture is a key picture.

10. The apparatus according to claim 9, wherein the communication module is specifically configured to obtain at least two video surveillance pictures acquired by at least two cameras;

the processing module is further used for acquiring corresponding key picture window display templates according to the number of the key pictures; setting position parameters of the at least two paths of video monitoring pictures according to the key picture window display template;

the communication module is further configured to send the position parameter, where the position parameter is used to indicate a display position of each of the at least two paths of video monitoring pictures.

11. The apparatus of claim 9 or 10, wherein the communication module is further configured to receive a user instruction; the processing module is further configured to set the preset rule according to the user instruction.

12. A monitoring server, characterized in that the apparatus comprises:

the communication module is used for receiving at least two paths of video monitoring pictures and key picture identifications;

the processing module is used for determining key pictures in the at least two paths of video monitoring pictures according to the key picture identification; acquiring corresponding key picture window display templates according to the number of the key pictures; setting position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures;

the communication module is further configured to send the at least two video monitoring pictures and the position parameter to a display device.

13. The monitoring server according to claim 12, wherein the processing module is further configured to determine whether the number of the key pictures exceeds a preset threshold before acquiring the corresponding key picture window display template according to the number of the key pictures; and if the number of the key pictures exceeds the preset threshold value, selecting key pictures with the same number as the preset threshold value from the key pictures.

14. The monitoring server of claim 12 or 13, the display device being an integral part of the monitoring server.

15. A system for video surveillance multi-view display, the system comprising:

the intelligent analysis device is used for acquiring a video monitoring picture acquired by the camera; if the content of the video monitoring picture conforms to a preset rule, determining that the video monitoring picture is a key picture, and identifying the video monitoring picture as the key picture; sending the video monitoring picture and a key picture identifier, wherein the key picture identifier is used for indicating that the video monitoring picture is a key picture;

the monitoring server is used for receiving at least two paths of video monitoring pictures and key picture identifications; determining key pictures in the at least two paths of video monitoring pictures according to the key picture identification; acquiring corresponding key picture window display templates according to the number of the key pictures; setting position parameters of the at least two paths of video monitoring pictures according to the key picture window display template, wherein the position parameters are used for indicating the display position of each path of video monitoring picture in the at least two paths of video monitoring pictures; and sending the at least two paths of video monitoring pictures and the position parameters to display equipment.

16. An intelligent analysis apparatus, comprising a memory, a processor, and a communication interface;

the memory to store program instructions;

the processor configured to perform the method of any one of claims 1 to 4 in accordance with program instructions stored in the memory.

17. A monitoring server, comprising a memory, a processor, and a communication interface;

the memory to store program instructions;

the processor for performing the method of claim 5 or 7 according to program instructions stored in the memory.

18. A computer-readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform the method of any of claims 1 to 8.