CN117676079A

CN117676079A - Video monitoring system, method and storage medium

Info

Publication number: CN117676079A
Application number: CN202311476093.0A
Authority: CN
Inventors: 詹志海; 梁小兵; 叶理德; 梅超凡; 涂鹏飞
Original assignee: Wisdri Engineering and Research Incorporation Ltd
Current assignee: Wisdri Engineering and Research Incorporation Ltd
Priority date: 2023-11-07
Filing date: 2023-11-07
Publication date: 2024-03-08

Abstract

The application provides a video monitoring system, a video monitoring method and a storage medium, and relates to the technical field of security protection. The technical scheme of the method and the system can meet the intelligent and personalized video monitoring requirements, the system monitors a plurality of accessed data sources through the event collecting module, and the data sources of the triggering event are pushed; the rule engine module performs event matching according to preset rules, and triggers the alarm module to automatically pull the corresponding video stream and trigger the alarm notification for the matched event. Based on the technical scheme, the event triggering rule can be flexibly defined according to application requirements, and after an event occurs, related video information can be obtained in real time and alarm notification can be carried out, so that the industrial production efficiency is effectively improved, and the safety management is optimized.

Description

Video monitoring system, method and storage medium

Technical Field

The present disclosure relates to the field of security technologies, and in particular, to a video monitoring system, a video monitoring method, and a storage medium.

Background

Industrial video surveillance systems play an important role in modern industrial production and safety management. However, the conventional video monitoring system can only provide real-time monitoring and video playback functions, and lacks intelligent and personalized application functions. Therefore, a video monitoring system is needed to meet the diversified demands of industrial production.

Disclosure of Invention

In order to achieve the above objective, the present application provides a video monitoring system, a method and a storage medium, which can meet the intelligent and personalized video monitoring requirements, and through presetting event triggering rules, when an event occurs, related video information can be obtained in real time and alarm notification can be performed, so that the industrial production efficiency is effectively improved, and the safety management is optimized.

In a first aspect, the present application provides a video monitoring system, the system including a rule engine module, an event collection module, and an alert module;

the event collection module is used for: monitoring a plurality of accessed data sources, and pushing the data sources of the triggering event to the rule engine module, wherein the plurality of accessed data sources comprise video data and/or sensor data;

the rule engine module is used for: according to a preset rule, event matching is carried out in the received data source, and under the condition that matching is successful, an alarm module is triggered according to the matched event data;

the alarm module is used for: and pulling the video stream corresponding to the event data, and carrying out alarm notification.

In one possible implementation, the event collection module is configured to:

and accessing the data sources from a third party system and/or a digital acquisition gateway, responding to an event trigger signal, processing the data sources of the trigger event according to a preset format, and pushing the processed data sources to the rule engine module.

In one possible implementation, each preset rule includes a judgment statement and an execution statement, and the rule engine module is configured to:

judging whether the event data in the data source accords with the triggering condition of the event or not by adopting a judging statement in the rule, if so, successfully matching, and executing an executing statement corresponding to the rule, wherein the executing statement indicates a mode of alarming the matched event.

In one possible implementation, the rules engine module supports one or more of the following:

rule definition: configuring at least one of the names, descriptions, triggering conditions and executing actions of the rules;

rule storage: storing the configured rules in a database, and supporting query of the rules in the database;

rule loading: uploading one or more rules from the database and for event matching;

rule matching: and carrying out event matching based on rules, and processing matching results of the events.

In one possible implementation, the alarm module is configured to:

pulling a video stream corresponding to the event data according to a video channel corresponding to the event data, pushing the video stream to a front-end page for playing through a video plug-in, and pre-configuring the corresponding relation between the event data and the video channel;

and carrying out alarm notification by adopting at least one mode of information early warning, sound alarm and/or short message pushing.

In one possible implementation, the system further comprises a data analysis module,

the data analysis module is used for: and generating a statistical report and/or analysis information according to the historical video clips and the historical sensor data of the trigger event, and supporting playback and/or inquiry of the historical video clips and the historical sensor data.

In one possible implementation, the system further comprises a streaming media module,

the streaming media module is used for: configuring video stream basic information of different video streams and corresponding video channels;

performing video encoding and decoding and/or compression on the accessed video stream;

and extracting key information from the video codec and/or the compressed video stream, and storing video clips related to the key information.

In one possible embodiment, the system further comprises a plug flow module,

the streaming media module is further configured to: selecting a corresponding transmission protocol according to the equipment type and the network condition;

the plug flow module is used for: transmitting the video stream to be pushed to the streaming media module according to the selected transmission protocol;

in the process of transmitting the video stream, the streaming media module is further used for dynamically adjusting the transmission protocol adopted by the video stream according to the network condition and the change of the equipment type, and processing the abnormality occurring among different transmission protocols.

In a second aspect, a video monitoring method is provided, the method including:

monitoring a plurality of accessed data sources, and pushing the data sources of the triggering event, wherein the plurality of accessed data sources comprise video data and/or sensor data;

and carrying out event matching on the data sources according to a preset rule, and pulling a video stream corresponding to the event data and carrying out alarm notification under the condition that the matching is successful.

In one possible implementation manner, the method further comprises relevant steps executed by corresponding functional modules in any possible implementation manner of the video monitoring system.

In a third aspect, there is provided a computing device comprising a memory and a processor, the memory storing at least one program, the at least one program being executable by the processor to implement the video surveillance method as provided in the second aspect.

In a fourth aspect, there is provided a computer readable storage medium having stored therein at least one program that is executed by a processor to implement the video surveillance method as provided in the second aspect.

The technical scheme provided by the application at least comprises the following technical effects:

the technical scheme of the method and the system can meet the intelligent and personalized video monitoring requirements, the system monitors a plurality of accessed data sources through the event collecting module, and the data sources of the triggering event are pushed; the rule engine module performs event matching according to preset rules, and triggers the alarm module to automatically pull the corresponding video stream and trigger the alarm notification for the matched event. Based on the technical scheme, the event triggering rule can be flexibly defined according to application requirements, and after an event occurs, related video information can be obtained in real time and alarm notification can be carried out, so that the industrial production efficiency is effectively improved, and the safety management is optimized.

Drawings

Fig. 1 is a schematic diagram of a video monitoring system according to an embodiment of the present application;

FIG. 2 is a schematic diagram of another video surveillance system according to an embodiment of the present application;

fig. 3 is a schematic flow chart of pushing a video stream according to an embodiment of the present application;

FIG. 4 is a schematic diagram of another video surveillance system according to an embodiment of the present application;

fig. 5 is a schematic flow chart of a video monitoring method according to an embodiment of the present application;

fig. 6 is a schematic hardware structure of a computing device according to an embodiment of the present application.

Detailed Description

To further illustrate the embodiments, the present application provides the accompanying drawings. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate embodiments and together with the description, serve to explain the principles of the embodiments. With reference to these matters, one of ordinary skill in the art would understand other possible embodiments and the advantages of the present application. The components in the figures are not drawn to scale and like reference numerals are generally used to designate like components. The term "at least one" in this application means one or more, the term "plurality" in this application means two or more, for example, a plurality of events means two or more.

The present application will now be further described with reference to the drawings and detailed description.

The application provides a video monitoring system, which is a video monitoring system based on a rule engine and event triggering alarm and aims to realize automatic event detection and alarm functions. The system monitors the appointed event through the preset rule, and triggers the corresponding alarm flow once the event accords with a certain preset rule.

Fig. 1 is a schematic diagram of a video monitoring system provided in the present application according to an exemplary embodiment, and referring to fig. 1, the video monitoring system provided in the present application includes: the rule engine module, the event collection module and the alarm module are described below in connection with the functional implementation of the various modules of some possible embodiments.

1. And an event collection module.

In this embodiment of the present application, the event collection module is configured to: monitoring the accessed data sources, pushing the data sources of the triggering event to the rule engine module, wherein the accessed data sources comprise video data and/or sensor data.

The event collection module is equivalent to a data source of the video monitoring system, is responsible for collecting and monitoring in real time in the data source, and transmits the data source with the event to the rule engine module for matching. The key task of the event collection module is to implement data collection and formatting to ensure that event data in the data sources can be correctly identified by the rules engine module.

Specifically, the event collection module is configured to: and accessing a plurality of data sources from a third party system and/or a digital acquisition gateway, responding to the event trigger signal, processing the data sources of the trigger event according to a preset format, and pushing the processed data sources to a rule engine module.

The third party system or digital acquisition gateway illustratively transmits the data to the rules engine module in the form of a resfu/MQTT/MQ or the like.

The event collection module is used for configuring the accessed related industrial monitoring equipment before monitoring the accessed multiple data sources. Industrial monitoring devices are for example cameras and sensors etc. Firstly, the output of the industrial monitoring equipment is accessed into a video monitoring system, and then corresponding parameter configuration and equipment centralized management are carried out, so that the normal operation of the accessed industrial monitoring equipment is ensured, and video stream and/or event trigger signals can be acquired in real time.

The event triggering signals are, for example, temperature signals collected by the sensor, equipment abnormality or fault triggered interrupt signals, and the like.

2. A rule engine module.

In the embodiment of the application, the rule engine module is used for: and carrying out event matching in the received data source according to a preset rule, and triggering an alarm module according to the matched event data under the condition that the matching is successful.

In one possible implementation, each preset rule includes a judgment statement and an execution statement, and the rule engine module is configured to: judging whether event data in a data source accords with the triggering condition of the event by adopting a judging statement in the rule, if so, successfully matching, executing an executing statement corresponding to the rule, and indicating a mode of alarming the matched event by the executing statement.

Wherein, the rules can be customized by the user according to specific industrial production requirements. For example, the trigger condition of the event and the name and description of the event, the types of the event include: the temperature exceeds a threshold, the equipment fails, abnormal behaviors and the like, and the corresponding triggering conditions can be that the temperature exceeds a target threshold, the equipment sends out fault signaling, abnormal behaviors are detected and the like.

In one possible implementation, the rules engine module supports one or more of the following functions:

rule definition: at least one of the name, description, trigger condition, and execution action of the rule is configured. Wherein, the rule is configured, namely, the relevant information and judgment logic of the event judged by the rule are defined.

rule loading: uploading one or more rules from a database and for event matching;

The rule engine module is a core component of the whole video monitoring system and is responsible for processing rule matching requests. The rule engine module adopts a rule-based reasoning mechanism, and each rule consists of a judging statement and an executing statement. When a certain event arrives, the rule engine module uses the existing rule and event data to match, and if the matching is successful, the operation corresponding to the rule is executed, for example, over-temperature warning is carried out, equipment obstacle removal is carried out, and the like.

And when the rule engine module of the video monitoring system analyzes the video stream and the sensor data in real time according to the set rule (trigger condition of the event), and triggers an alarm flow after detecting and identifying the event meeting the condition.

3. Alarm module

In this embodiment of the present application, the alarm module is configured to: and pulling the video stream corresponding to the event data, and carrying out alarm notification.

Specifically, the alarm module pulls a video stream corresponding to event data according to a video channel corresponding to the event data, pushes the video stream to a front-end page for playing through a video plug-in, and the corresponding relation between the event data and the video channel is preconfigured; and the alarm notification is carried out by adopting at least one mode of information early warning, sound warning and/or short message pushing.

The alarm module is an important component of the video monitoring system and is responsible for triggering an alarm signal immediately after the event matching is successful and sending the event information to related personnel. The key task of the alarm module is to realize the mode of alarm notification and the content of information so as to ensure that related personnel can process events in time.

In one possible implementation, the modules use queues for data interaction. Specifically, the event collection module pushes source data to be alarmed to the rule engine module through a third party system or a digital acquisition platform, matches the source data with defined rules in the rule engine module, and sends event queue messages to the alarm module if the matching rules are met, and the alarm module consumes the event queue messages, pulls a video stream, previews the video stream in a front-end web page in real time and can be accompanied with alarm notification in the various modes.

In one possible implementation manner, the video monitoring system provided by the application further comprises other functional modules. Fig. 2 is a schematic diagram of another video monitoring system according to an embodiment of the present application, and further description of the functions of the video monitoring system is provided below in conjunction with fig. 2.

Referring to fig. 2, the video monitoring system provided in the present application includes: the system comprises a rule engine module, an event collection module, an alarm module, a streaming media module and a pushing module data analysis module, wherein the pushing module acquires video streams from terminal monitoring equipment.

The description of the rule engine module, the event collection module and the alarm module is referred to above, and will not be described herein.

The streaming media module is used for processing and storing the video stream. Specifically, the streaming media module is used for configuring video stream basic information of different video streams and corresponding video channels; performing video encoding and decoding and/or compression on the accessed video stream; key information is extracted from the video codec and/or the compressed video stream, and video clips related to the key information are stored.

The video stream basic information is, for example: IP, port, channel, master subcode information, etc. of a camera or network video recorder (Network Video Recorder, NVR). Further, the streaming media module may also be preconfigured with supported transport protocols, including but not limited to: RTMP, webRTC, HLS, HTTP-FLV, SRT, MPEG-DASH and GB28181, etc.

Wherein, the streaming media module is further used for: selecting a corresponding transmission protocol according to the equipment type and the network condition; the streaming media module is further configured to: and dynamically adjusting the transmission protocol adopted for transmitting the video stream according to the change of the network condition and the equipment type, and processing the abnormality generated among different transmission protocols.

The push flow module and the streaming media module cooperatively realize stable transmission of the video flow, so that the pull-able video flow is provided in time when the alarm module executes an alarm flow.

Specifically, the streaming media module identifies the type of the device and the network condition currently used by detecting the type of the device and the network environment of the terminal monitoring device. And then, according to the support of the equipment type and the real conditions such as the bandwidth, delay and the like of the network, a proper transmission protocol is selected for video streaming transmission.

The streaming media module is also capable of adapting and transcoding the video stream according to the selected transmission protocol. The method specifically comprises the steps of adjusting parameters such as coding format, resolution, bit rate and the like of the video so as to ensure that the video can obtain better playing effect in target equipment and network environment.

Also, in the video streaming process, the situation that performance fluctuation or device switching may occur in different protocols is considered. The streaming media module dynamically adjusts protocol selection and transcoding parameters of the video stream by monitoring indexes such as network bandwidth, delay and the like and changes of equipment types so as to keep smooth video playing.

Further, for the multi-protocol adaptation scheme, compatibility between different protocols and stability of the user terminal device need to be considered. The plug flow module and the streaming media module support the continuous guarantee of the interoperability of various transmission protocols through testing and optimization, and process abnormal situations and error information which may occur.

The transport protocol includes, but is not limited to, the foregoing protocols of the streaming media module support configuration, which is not limited in this application.

The flow of the push module transmitting the video stream to be pushed to the streaming media module is described below. Fig. 3 is a schematic flow chart of pushing a video stream according to an embodiment of the present application. Referring to fig. 3, the process of pushing the video stream by the push module includes the following steps (1) to (4).

(1) After the plug flow module is started, pulling the basic information of the video stream, checking whether a universal unique number (Universally Unique Identifier, UUID) of a plug flow task exists in a thread pool, if so, analyzing the basic information of the video stream by using the existing number, setting a communication mode and address information according to task attributes, and adding the basic information into the task pool; if the task is not present, a new task number (UUID) is created, and then a communication mode and address information are set according to task attributes and added into a task pool.

(2) At the moment, the pushing task formally starts, the pull communication is checked, the check passes, and the push communication check is entered; if the pull flow communication is abnormal, the abnormality is thrown out, and the channel pull flow abnormal state is updated.

(3) Checking whether a push communication (rstp server is normal or not), checking to pass, and creating a push process; if the push communication is abnormal, the abnormality is thrown out, and the channel push abnormal state is updated.

(4) Pushing the updated channel push stream to the streaming media module, and updating the channel push stream normal state.

In one possible implementation manner, the video monitoring system provided by the application further comprises a data analysis module. Fig. 4 is a schematic diagram of another video monitoring system provided in an embodiment of the present application, referring to fig. 3, the video monitoring system provided in the present application includes: the system comprises a rule engine module, an event collection module, an alarm module, a streaming media module, a push stream module and a data analysis module.

The description of the rule engine module, the event collection module, the alarm module, the streaming media module and the push module is referred to above, and will not be described here.

The data analysis module is used for generating a statistical report and/or analysis information according to the historical video clips and the historical sensor data of the trigger event, and supporting playback and/or inquiry of the historical video clips and the historical sensor data. The data analysis module can manage and analyze the video and sensor data of the trigger event so as to help users to better know the industrial production condition and safety management.

Further, the system also supports functions such as media service and data analysis, the media service can ensure stability, smoothness and compatibility of video stream pushing, and the data analysis can manage and analyze related data of the trigger event so as to help users to better know industrial production conditions and safety management.

The video monitoring method provided by the present application will be described in detail below in conjunction with the video monitoring system described in fig. 1-4. Fig. 5 is a schematic flow chart of a video monitoring method provided in an embodiment of the present application, and referring to fig. 5, the technical solution provided in the present application includes the following steps S1 and S2, which are executed by related functional modules in the video monitoring system.

S1, monitoring a plurality of accessed data sources, pushing the data sources of the trigger event, wherein the plurality of accessed data sources comprise video data and/or sensor data.

Specifically, the present step is executed by the event collection module, and the principle is referred to the description of the video monitoring system above, which is not repeated here.

S2, carrying out event matching on the data sources according to a preset rule, and pulling a video stream corresponding to the event data and carrying out alarm notification under the condition that the matching is successful.

In the embodiment of the application, the user may define a rule script in the rule engine module, for example, may define events such as temperature exceeding a threshold, equipment failure, abnormal behavior, etc., set corresponding trigger conditions, store the defined rule in the database, and load the defined rule for use when matching is required. The rule engine module screens and schedules the acquired data and matches the acquired data based on the rules after validation. After the matching is successful, the video stream component is called up based on the corresponding video channel, pushing and pushing are carried out, and the front-end web page can consume video stream information through the video plug-in so as to play real-time video.

In the embodiment of the application, the video stream basic information and the corresponding video channels of the video streams corresponding to various events are preconfigured, and the defined rules and related information are enabled to be effective.

The video channel corresponds to a terminal monitoring device, for example, the video channel a is from a camera 1 deployed in the area a, and the event a is an abnormal situation occurring in the area a, and the corresponding video stream is pulled through the video channel a to present a real-time video picture.

It should be noted that, the specific implementation of the embodiment of the method may refer to the foregoing description of the video monitoring system, and the video monitoring method and the video monitoring system provided in the foregoing embodiment belong to the same concept, which is not repeated herein.

The application provides a computing device which can be implemented as all or part of the functional modules in the video monitoring system or used for executing the video monitoring method. Fig. 6 is a schematic diagram of a hardware structure of a computing device provided in an embodiment of the present application, where, as shown in fig. 6, the computing device includes a processor 601, a memory 602, a bus 603, and a computer program stored in the memory 602 and capable of running on the processor 601, where the processor 601 includes one or more processing cores, the memory 602 is connected to the processor 601 through the bus 603, and the memory 602 is used to store program instructions, and when the processor executes the computer program, the processor implements all or part of the steps in the foregoing method embodiments provided in the present application.

Further, as an executable scheme, the computing device may be a computer unit, and the computer unit may be a computing device such as a desktop computer, a notebook computer, a palm computer, and a cloud server. The computer unit may include, but is not limited to, a processor, a memory. It will be appreciated by those skilled in the art that the constituent structures of the computer unit described above are merely examples of the computer unit and are not limiting, and may include more or fewer components than those described above, or may combine certain components, or different components. For example, the computer unit may further include an input/output device, a network access device, a bus, etc., which is not limited in this embodiment of the present application.

Further, as an implementation, the processor may be a central processing unit (Central Processing Unit, CPU), other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is a control center of the computer unit, connecting various parts of the entire computer unit using various interfaces and lines.

The memory may be used to store the computer program and/or modules, and the processor may implement the various functions of the computer unit by running or executing the computer program and/or modules stored in the memory, and invoking data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for a function; the storage data area may store data created according to the use of the cellular phone, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.

The present application also provides a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the methods described above in the embodiments of the present application.

The modules/units integrated with the computer unit may be stored in a computer readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each method embodiment described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a software distribution medium, and so forth. It should be noted that the content of the computer readable medium can be appropriately increased or decreased according to the requirements of the legislation and the patent practice in the jurisdiction.

While this application has been particularly shown and described with references to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the application as defined by the appended claims.

Claims

1. The video monitoring system is characterized by comprising a rule engine module, an event collection module and an alarm module;

2. The video surveillance system of claim 1, wherein the event collection module is configured to:

3. The video surveillance system of claim 1, wherein each preset rule includes a judgment statement and an execution statement, the rule engine module being configured to:

4. The video surveillance system of claim 3, wherein the rules engine module supports one or more of:

5. The video monitoring system of claim 1, wherein the alert module is configured to:

6. The video surveillance system of claim 1, further comprising a data analysis module,

7. The video surveillance system of claim 1, further comprising a streaming media module,

8. The video surveillance system of claim 7, further comprising a push module,

9. A video monitoring method, the method comprising:

10. A computer-readable storage medium, wherein at least one program is stored in the storage medium, the at least one program being executed by a processor to implement the video surveillance method of claim 9.