CN109544870B - Alarm judgment method for intelligent monitoring system and intelligent monitoring system - Google Patents

Alarm judgment method for intelligent monitoring system and intelligent monitoring system Download PDF

Info

Publication number
CN109544870B
CN109544870B CN201811565587.5A CN201811565587A CN109544870B CN 109544870 B CN109544870 B CN 109544870B CN 201811565587 A CN201811565587 A CN 201811565587A CN 109544870 B CN109544870 B CN 109544870B
Authority
CN
China
Prior art keywords
alarm
preset
monitoring terminal
category
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811565587.5A
Other languages
Chinese (zh)
Other versions
CN109544870A (en
Inventor
张叔奇
高川
孟娈
于昊
李荐民
孙尚民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tongfang Vision Technology Jiangsu Co ltd
Nuctech Co Ltd
Original Assignee
Tongfang Vision Technology Jiangsu Co ltd
Nuctech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tongfang Vision Technology Jiangsu Co ltd, Nuctech Co Ltd filed Critical Tongfang Vision Technology Jiangsu Co ltd
Priority to CN201811565587.5A priority Critical patent/CN109544870B/en
Publication of CN109544870A publication Critical patent/CN109544870A/en
Application granted granted Critical
Publication of CN109544870B publication Critical patent/CN109544870B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/182Level alarms, e.g. alarms responsive to variables exceeding a threshold
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The disclosure provides an alarm judgment method and device for an intelligent monitoring system. The alarm judgment method for the intelligent monitoring system comprises the following steps: acquiring real-time video streams from a plurality of monitoring terminal devices; identifying each real-time video stream by using a preset identification model and outputting an alarm frame meeting a preset alarm rule; identifying an alarm scene according to alarm frames from more than a preset number of real-time video streams; and outputting alarm information and a corresponding alarm frame according to the alarm category. The alarm judgment method for the intelligent monitoring system can improve the alarm judgment precision and reduce the alarm judgment cost.

Description

Alarm judgment method for intelligent monitoring system and intelligent monitoring system
Technical Field
The present disclosure relates to the field of computer vision technologies, and in particular, to an alarm determination method for an intelligent monitoring system and an intelligent monitoring system.
Background
With the development of computer technology, it is important to monitor a target site and alarm in time in the field of video monitoring.
In the related art, an intelligent camera is generally used to complete video acquisition and image recognition, so as to send alarm information through the intelligent camera when a preset alarm scene occurs in image recognition. However, this method requires a high technical requirement for the monitoring terminal device, i.e., the camera, and the purchase cost burden is heavy for the user using the device. In addition, the camera has high maintenance cost and high misjudgment probability, and is not suitable for application scenes requiring low cost and high precision.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The present disclosure is directed to an alarm determination method for an intelligent monitoring system and an intelligent monitoring system using the same, which are used to overcome the problems of high monitoring alarm cost and low accuracy caused by the limitations and disadvantages of the related art at least to a certain extent.
According to a first aspect of the embodiments of the present disclosure, an alarm determination method for an intelligent monitoring system is provided, including:
acquiring real-time video streams from a plurality of monitoring terminal devices;
using a plurality of preset identification models to simultaneously identify a plurality of real-time video streams and output alarm frames meeting preset alarm rules and alarm categories corresponding to the alarm frames;
judging whether an alarm is needed or not according to the alarm category and the monitoring terminal equipment corresponding to the alarm frame;
and when the alarm is needed, outputting alarm information according to the alarm category.
In an exemplary embodiment of the present disclosure, the determining, according to the alarm category and the monitoring terminal device corresponding to the alarm frame, whether an alarm is required according to the device identifier of the alarm monitoring terminal device corresponding to the alarm frame includes:
determining alarm monitoring terminal equipment for outputting alarm frames and corresponding alarm categories according to the plurality of equipment identifiers;
and when the number of the alarm monitoring terminal equipment corresponding to one alarm category is more than 1, judging the alarm frames output by the alarm monitoring terminal equipment corresponding to the alarm category according to a preset logic relation so as to determine whether an alarm is required.
In an exemplary embodiment of the present disclosure, when the preset logical relationship is "yes", the determining, according to the preset logical relationship, an alarm frame output by the plurality of alarm monitoring terminal devices corresponding to the alarm category includes:
and outputting alarm information corresponding to the alarm category when the alarm monitoring terminal equipment corresponding to the alarm category exceeds a first preset value.
In an exemplary embodiment of the present disclosure, when the preset logical relationship is "or", the determining, according to the preset logical relationship, an alarm frame output by the plurality of alarm monitoring terminal devices corresponding to the alarm category includes:
and outputting alarm information corresponding to the alarm category when the equipment identifiers of the plurality of alarm monitoring terminal equipment corresponding to the alarm category are one or more preset identifiers.
In an exemplary embodiment of the present disclosure, when the preset logical relationship is weighted, the determining, according to the preset logical relationship, an alarm frame output by the plurality of alarm monitoring terminal devices corresponding to the alarm category includes:
and calculating an alarm weighted value according to the weight values corresponding to the alarm monitoring terminal devices corresponding to the alarm category, and when the alarm weighted value is greater than a second preset value, obtaining alarm information corresponding to the alarm category.
In an exemplary embodiment of the present disclosure, further comprising:
acquiring the preset alarm rule, a plurality of training pictures corresponding to the preset alarm rule and preset detection area parameters, wherein the preset alarm rule comprises that a person enters and more than a fourth preset object exists;
and establishing the preset identification model by using a preset pattern identification algorithm and training the preset identification model according to the preset alarm rule, the plurality of training pictures and the preset detection area parameters.
In an exemplary embodiment of the present disclosure, the identifying a plurality of the real-time video streams simultaneously using a plurality of preset identification models includes:
identifying a preset detection area of each frame in the real-time video stream according to the preset identification model;
and when the preset detection area meets the preset alarm rule, marking the frame as an alarm frame and marking the alarm category according to the preset alarm rule.
In an exemplary embodiment of the present disclosure, the identifying a plurality of the real-time video streams simultaneously using a plurality of preset identification models includes:
and when the real-time video streams which are more than a third preset value do not include the alarm frame, stopping identifying the real-time video streams acquired this time.
In an exemplary embodiment of the present disclosure, further comprising:
and responding to a preset mode setting signal to stop acquiring the real-time video stream, identifying the real-time video stream or outputting the alarm information.
According to a second aspect of the present disclosure, there is provided an alarm determination device for an intelligent monitoring system, comprising:
the data acquisition module is arranged for acquiring real-time video streams from a plurality of monitoring terminal devices;
the mode identification module is set to simultaneously identify a plurality of real-time video streams by using a plurality of preset identification models and output alarm frames meeting preset alarm rules and alarm categories corresponding to the alarm frames;
the comprehensive judgment module is set to judge whether an alarm is needed or not according to the alarm category and the monitoring terminal equipment corresponding to the alarm frame;
and the information output module is set to output alarm information according to the alarm category when judging that the alarm is needed.
According to a third aspect of the present disclosure, there is provided an intelligent monitoring system, comprising:
the monitoring terminal equipment is used for shooting and outputting a real-time video stream;
the background processing device is in signal transmission with the monitoring terminal devices and comprises a memory and a processor coupled to the memory, wherein the processor is configured to execute the alarm judgment method for the intelligent monitoring system based on instructions stored in the memory.
According to a fourth aspect of the present disclosure, there is provided an electronic device comprising: a memory; and a processor coupled to the memory, the processor configured to perform the method of any of the above based on instructions stored in the memory.
According to a fifth aspect of the present disclosure, there is provided a computer-readable storage medium, on which a program is stored, which when executed by a processor, implements the alarm determination method for an intelligent monitoring system as described in any one of the above.
The alarm judging method provided by the embodiment of the disclosure can effectively improve the accuracy of alarm judgment, reduce the requirements on the monitoring terminal devices and reduce the user cost by acquiring the real-time video streams output by the plurality of monitoring terminal devices in real time, identifying the real-time video streams through the preset identification model to judge the alarm category and the alarm frame and judging whether to output alarm information according to the preset logical relationship of the monitoring terminal devices corresponding to the alarm frame.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 schematically illustrates a flowchart of an alarm determination method for an intelligent monitoring system in an exemplary embodiment of the present disclosure.
Fig. 2 schematically illustrates a schematic diagram of an intelligent monitoring system in an exemplary embodiment of the present disclosure.
Fig. 3 schematically illustrates a sub-flowchart of an alarm determination method for an intelligent monitoring system in an exemplary embodiment of the present disclosure.
Fig. 4 schematically illustrates a sub-flowchart of an alarm determination method for an intelligent monitoring system in an exemplary embodiment of the present disclosure.
Fig. 5 schematically illustrates a block diagram of an alarm determination device for an intelligent monitoring system according to an exemplary embodiment of the present disclosure.
Fig. 6 schematically illustrates a block diagram of an electronic device in an exemplary embodiment of the disclosure.
Fig. 7 schematically illustrates a schematic diagram of a computer-readable storage medium in an exemplary embodiment of the disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Further, the drawings are merely schematic illustrations of the present disclosure, in which the same reference numerals denote the same or similar parts, and thus, a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The following detailed description of exemplary embodiments of the disclosure refers to the accompanying drawings.
Fig. 1 schematically illustrates a flowchart of an alarm determination method for an intelligent monitoring system in an exemplary embodiment of the present disclosure. Referring to fig. 1, an alarm determination method 100 for an intelligent monitoring system may include:
step S102, acquiring real-time video streams from a plurality of monitoring terminal devices;
step S104, using a preset identification model to identify each real-time video stream and outputting an alarm frame meeting a preset alarm rule;
step S106, identifying an alarm scene according to alarm frames from more than a preset number of real-time video streams;
and S108, outputting alarm information and a corresponding alarm frame according to the alarm category.
The alarm judging method provided by the embodiment of the disclosure can effectively improve the accuracy of alarm judgment, reduce the requirements on the monitoring terminal devices and reduce the user cost by acquiring the real-time video streams output by the plurality of monitoring terminal devices in real time, identifying the real-time video streams through the preset identification model to judge the alarm category and the alarm frame and judging whether to output alarm information according to the preset logical relationship of the monitoring terminal devices corresponding to the alarm frame.
The following describes the steps of the alarm determination method 100 for an intelligent monitoring system in detail.
In step S102, real-time video streams from a plurality of monitoring terminal devices are acquired.
Fig. 2 is a schematic diagram of an intelligent monitoring system provided by the present disclosure.
Referring to fig. 2, the smart monitoring system 200 may include:
a plurality of monitor terminal devices 21 for shooting and outputting a real-time video stream;
the background processing device 22, which performs signal transmission with the plurality of monitoring terminal devices 21, includes a memory and a processor coupled to the memory, and the processor is configured to execute the alarm determination method for the intelligent monitoring system provided by the embodiment of the present disclosure based on the instructions stored in the memory.
The way for the background processing device 22 to obtain the real-time video streams of the multiple monitoring terminal devices 21 may be, for example, obtaining at regular time, that is, simultaneously obtaining the real-time video streams shot by all the multiple monitoring terminal devices 21 between two times of obtaining at the same time; or may be a real-time video stream that continuously receives the output of all of the plurality of monitoring terminal devices 21. In addition, the signal transmission mode between the background processing device 22 and the monitoring terminal device 21 includes wired transmission and wireless transmission, and the disclosure is not limited thereto.
In step S104, each of the real-time video streams is identified by using a preset identification model and an alarm frame satisfying a preset alarm rule is output.
The pre-set recognition model may be first built and trained before being used.
In some embodiments of the present disclosure, establishing and training a preset recognition model may include obtaining the preset alarm rule, a plurality of training pictures corresponding to the preset alarm rule, and a preset detection region parameter, where the preset alarm rule includes that a person enters and more than a fourth preset object exists; and establishing the preset identification model by using a preset pattern identification algorithm and training the preset identification model according to the preset alarm rule, the plurality of training pictures and the preset detection area parameters.
The preset pattern recognition algorithm may include, for example, a K-Nearest Neighbor, a bayesian method, a Principal Component Analysis (PCA) method, etc., which is not limited in this disclosure.
When the embodiment of the present disclosure is applied to the field of, for example, channel monitoring, for example, in the process of X-ray detection monitoring, the preset alarm rule may include that someone intrudes, more than a fourth preset object exists in the picture, and the like. Meanwhile, a plurality of pictures corresponding to different alarm rules can be provided to train the established preset recognition model, so that the model can accurately recognize different objects and judge whether the pictures meet the preset alarm rules. A preset recognition model can be established through a preset pattern recognition algorithm, and feature extraction and recognition training are carried out according to a preset alarm rule.
In addition, in some embodiments, a preset detection area parameter set by a user may also be received, where the parameter is, for example, a small area in a picture, so as to improve recognition efficiency when a picture or a video frame is recognized. And different preset detection area parameters can be set for the monitoring terminal equipment with different installation positions.
Fig. 3 is a sub-flowchart of step S104.
Referring to fig. 3, step S104 may include, for example:
step S1041, identifying a preset detection area of each frame in the real-time video stream according to the preset identification model;
step S1042, when the preset detection area meets the preset alarm rule, marking the frame as an alarm frame and marking the alarm category according to the preset alarm rule.
After model training is complete, each frame of the real-time video stream may be identified using the model. In order to improve the image processing efficiency, a preset identification model corresponding to the detection area of each monitoring terminal device can be configured independently for each monitoring terminal device, so that real-time video streams output by all the monitoring terminal devices can be identified simultaneously.
When the preset identification model identifies the video frame meeting the preset alarm rule, the preset identification model can mark an alarm position or a target outside the alarm frame and the alarm category, for example, when a person exists in the preset detection area, the position of the person is marked, and then the preset identification model outputs information of the alarm frame and the corresponding equipment identifier, the alarm category, the alarm position and the like of the monitoring terminal equipment.
In step S106, an alarm scene is identified based on alarm frames from more than a preset number of real-time video streams.
For the field of video monitoring, a monitoring result of a single monitoring terminal device is affected by light, an accident, and the like, and there is a possibility of erroneous judgment, for example, a picture taken by one camera due to light and shadow is judged to include two objects (shadows), and a picture taken by another camera is judged to include only one object, so that in the embodiment of the present disclosure, output results of a plurality of monitoring terminal devices are integrated to comprehensively judge whether an alarm is required.
Fig. 4 is a sub-flowchart of step S106.
Referring to fig. 4, in one embodiment, step S106 may include:
step S1061, determining alarm monitoring terminal equipment for outputting alarm frames and corresponding alarm categories according to the plurality of equipment identifiers;
step S1062, when the number of the alarm monitoring terminal devices corresponding to one alarm category is greater than 1, judging the alarm frames output by the alarm monitoring terminal devices corresponding to the alarm category according to a preset logic relationship to determine whether an alarm is required.
The preset logical relationship may be preset or may be set by a user according to a requirement, and may include, for example, an and, or, a weighting, and the like.
When the preset logical relationship is yes, the alarm information corresponding to the alarm category can be output when the alarm monitoring terminal equipment corresponding to the alarm category exceeds a first preset value, that is, when the alarm frames of the same alarm category are output by one or more alarm monitoring terminal equipment with the first preset value, the alarm of the alarm category can be judged to exist. For example, when the real-time video streams of the three cameras all have a "person intrusion" alarm, alarm information corresponding to the "person intrusion" category can be directly output.
And when the preset logic relationship is OR, outputting alarm information corresponding to the alarm category when the equipment identifiers of the plurality of alarm monitoring terminal equipment corresponding to the alarm category are one or more of preset identifiers. For example, when the preset logical relationship is that any one of the cameras 1, 2 and 3 shoots a person intrusion, namely an alarm, if the camera outputting the warning frame of the person intrusion is the camera 2, the warning information corresponding to the category of the person intrusion can be output.
And when the preset logical relationship is weighted, calculating an alarm weighted value according to the weights corresponding to the plurality of alarm monitoring terminal devices corresponding to the alarm category, and when the alarm weighted value is greater than a second preset value, calculating alarm information corresponding to the alarm category. For example, when the weight of the camera 1 is set to be 0.2, the weight of the camera 2 is set to be 0.4, the weight of the camera 3 is set to be 0.1, the weight of the camera 4 is set to be 0.3, and the second preset value is set to be 0.4 according to the importance, the definition, the error rate and the like of the shooting position, if the camera outputting the "person intrusion" alarm frame includes the camera 2, alarm information corresponding to the "person intrusion" category can be output; if the cameras for outputting the 'personnel intrusion' alarm frame comprise a camera 1 and a camera 4, alarm information corresponding to the 'personnel intrusion' category can be output; if the camera outputting the alarm frame of 'personnel intrusion' is only the camera No. 3, the alarm information is not output.
Besides the preset logic relationship, a person skilled in the art can set the comprehensive judgment logic of the output result of each monitoring terminal device according to the attribute, the actual requirement and the like of each monitoring terminal device, and the disclosure does not specially limit the logic.
In addition, in the above process, when the real-time video stream is obtained at regular time and it is judged that no real-time video stream more than the third preset value includes the alarm frame, the identification of the real-time video stream obtained this time may be stopped and the next real-time video streams may be continuously obtained.
In step S108, alarm information and a corresponding alarm frame are output according to the alarm category.
In some embodiments, multiple alarm categories may exist as determined by steps S104-S106. For example, there may be two alarm messages of "person intrudes" and "a plurality of preset objects" at the same time. At this time, the alarm information and the corresponding alarm frame can be respectively output according to the alarm category. The alarm information may be output by sending information to a preset terminal through a communication means or sending a driving signal to an acoustic/optical/electrical alarm device, which is not limited in this disclosure.
In some embodiments, in order to cope with a possible debugging scene, etc., a setting signal for stopping acquiring the real-time video stream, recognizing the real-time video stream, or outputting the alarm information may be further set in response to a preset mode.
The following is the execution process of the alarm determination method in one embodiment:
1. the actual images are first taken from the real-time video stream and transcoded into RPG image data.
2. And training a preset identification model according to an alarm rule and a detection area set by client software, identifying each real-time video stream by using the preset identification model, and framing an alarm target.
3. And judging whether to alarm or not according to a preset logical relation between the monitoring terminal devices set by the client software.
4. The alarm information is stored locally, and the alarm information is output externally (the output mode comprises ROS information, TCP information and DO output). Wherein, the alarm information may include, for example: alarm time, alarm camera name, alarm trigger conditions, etc.
The intelligent monitoring system and the alarm judging method thereof provided by the embodiment of the disclosure realize real-time image acquisition by using the image acquisition equipment, can identify and comprehensively judge personnel and vehicles in the image through a pattern recognition algorithm, send alarm information to the system when the personnel accidentally intrude into a protection area, can be applied to vehicle identification in the field of vehicle security inspection and personnel identification in the field of radiation protection, and replace infrared alarms and even fences in the systems.
Corresponding to the method embodiment, the present disclosure further provides an alarm determination device for an intelligent monitoring system, which can be used to execute the method embodiment.
Fig. 5 schematically illustrates a block diagram of an alarm determination device for an intelligent monitoring system according to an exemplary embodiment of the present disclosure.
Referring to fig. 5, the alarm determination device 500 for an intelligent monitoring system may include:
a data acquisition module 502 configured to acquire real-time video streams from a plurality of monitoring terminal devices;
a pattern recognition module 504 configured to use a plurality of preset recognition models to simultaneously recognize a plurality of real-time video streams and output an alarm frame satisfying a preset alarm rule and an alarm category corresponding to the alarm frame;
a comprehensive judgment module 506 configured to judge whether an alarm is required according to the alarm category and the monitoring terminal device corresponding to the alarm frame;
and the information output module 508 is configured to output alarm information according to alarm categories when judging that an alarm is required.
Since the functions of the apparatus 500 have been described in detail in the corresponding method embodiments, the disclosure is not repeated herein.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 6. The electronic device 600 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 6, the electronic device 600 is embodied in the form of a general purpose computing device. The components of the electronic device 600 may include, but are not limited to: the at least one processing unit 610, the at least one memory unit 620, and a bus 630 that couples the various system components including the memory unit 620 and the processing unit 610.
Wherein the storage unit stores program code that is executable by the processing unit 610 to cause the processing unit 610 to perform steps according to various exemplary embodiments of the present invention as described in the above section "exemplary methods" of the present specification. For example, the processing unit 610 may execute step S102 as shown in fig. 1: acquiring real-time video streams from a plurality of monitoring terminal devices; step S104: identifying each real-time video stream by using a preset identification model and outputting an alarm frame meeting a preset alarm rule; step S106: identifying an alarm scene according to alarm frames from more than a preset number of real-time video streams; step S108: and outputting alarm information and a corresponding alarm frame according to the alarm category.
The storage unit 620 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)6201 and/or a cache memory unit 6202, and may further include a read-only memory unit (ROM) 6203.
The memory unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 630 may be one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 600, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the electronic device 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 660. As shown, the network adapter 660 communicates with the other modules of the electronic device 600 over the bus 630. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above section "exemplary methods" of the present description, when said program product is run on the terminal device.
Referring to fig. 7, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Furthermore, the above-described figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims (12)

1. An alarm judgment method for an intelligent monitoring system is characterized by comprising the following steps:
acquiring real-time video streams from a plurality of monitoring terminal devices;
respectively identifying a plurality of real-time video streams simultaneously by using a plurality of preset identification models and outputting alarm frames meeting preset alarm rules and alarm categories corresponding to the alarm frames;
judging whether an alarm is needed or not according to the alarm category and the monitoring terminal equipment corresponding to the alarm frame;
when the alarm is needed, outputting alarm information according to the alarm category;
wherein, the determining whether to alarm according to the alarm category and the monitoring terminal device corresponding to the alarm frame includes:
determining alarm monitoring terminal equipment for outputting alarm frames and corresponding alarm categories according to the plurality of equipment identifiers;
when the number of the alarm monitoring terminal devices corresponding to one alarm category is larger than 1, judging alarm frames output by a plurality of alarm monitoring terminal devices corresponding to the alarm category according to a preset logic relationship to determine whether an alarm is needed, wherein the preset logic relationship comprises an and relationship, an OR relationship and a weighting relationship.
2. The alarm determination method for an intelligent monitoring system according to claim 1, wherein when the preset logical relationship is "on", the determining, according to the preset logical relationship, the alarm frames output by the plurality of alarm monitoring terminal devices corresponding to the alarm category includes:
and outputting alarm information corresponding to the alarm category when the alarm monitoring terminal equipment corresponding to the alarm category exceeds a first preset value.
3. The alarm determination method for an intelligent monitoring system according to claim 1, wherein when the preset logical relationship is "or", the determining, according to the preset logical relationship, the alarm frames output by the plurality of alarm monitoring terminal devices corresponding to the alarm category includes:
and outputting alarm information corresponding to the alarm category when the equipment identifiers of the plurality of alarm monitoring terminal equipment corresponding to the alarm category are one or more preset identifiers.
4. The alarm determination method for an intelligent monitoring system according to claim 1, wherein when the preset logical relationship is weighted, the determining, according to the preset logical relationship, the alarm frames output by the plurality of alarm monitoring terminal devices corresponding to the alarm category includes:
and calculating an alarm weighted value according to the weight values corresponding to the alarm monitoring terminal devices corresponding to the alarm category, and when the alarm weighted value is greater than a second preset value, obtaining alarm information corresponding to the alarm category.
5. The alarm determination method for an intelligent monitoring system according to claim 1, further comprising:
acquiring the preset alarm rule, a plurality of training pictures corresponding to the preset alarm rule and preset detection area parameters, wherein the preset alarm rule comprises that a person enters and more than a fourth preset object exists;
and establishing the preset identification model by using a preset pattern identification algorithm and training the preset identification model according to the preset alarm rule, the plurality of training pictures and the preset detection area parameters.
6. The alarm determination method for intelligent monitoring system according to claim 1 or 5, wherein said identifying a plurality of said real-time video streams simultaneously using a plurality of preset identification models comprises:
identifying a preset detection area of each frame in the real-time video stream according to the preset identification model;
and when the preset detection area meets the preset alarm rule, marking the frame as an alarm frame and marking the alarm category according to the preset alarm rule.
7. The alarm determination method for intelligent monitoring system according to claim 1, wherein said identifying a plurality of said real-time video streams simultaneously using a plurality of preset identification models comprises:
and when the real-time video streams which are more than a third preset value do not include the alarm frame, stopping identifying the real-time video streams acquired this time.
8. The alarm determination method for an intelligent monitoring system according to claim 1, further comprising:
and responding to a preset mode setting signal to stop acquiring the real-time video stream, identifying the real-time video stream or outputting the alarm information.
9. An alarm judging device for an intelligent monitoring system, comprising:
the data acquisition module is arranged for acquiring real-time video streams from a plurality of monitoring terminal devices;
the mode identification module is set to respectively identify a plurality of real-time video streams by using a plurality of preset identification models and output alarm frames meeting preset alarm rules and alarm categories corresponding to the alarm frames;
the comprehensive judgment module is set to judge whether an alarm is needed or not according to the alarm category and the monitoring terminal equipment corresponding to the alarm frame;
the information output module is set to output alarm information according to the alarm category when judging that the alarm is needed;
wherein, the alarm frame corresponds to the equipment identifier of the alarm monitoring terminal equipment, and the comprehensive judgment module is set as: determining alarm monitoring terminal equipment for outputting alarm frames and corresponding alarm categories according to the plurality of equipment identifiers; when the number of the alarm monitoring terminal devices corresponding to one alarm category is larger than 1, judging alarm frames output by a plurality of alarm monitoring terminal devices corresponding to the alarm category according to a preset logic relationship to determine whether an alarm is needed, wherein the preset logic relationship comprises an and relationship, an OR relationship and a weighting relationship.
10. An intelligent monitoring system, comprising:
the monitoring terminal equipment is used for shooting and outputting a real-time video stream;
a background processing device in signal communication with the plurality of monitoring terminal devices, comprising a memory and a processor coupled to the memory, the processor being configured to execute the alarm determination method for an intelligent monitoring system according to any one of claims 1 to 8 based on instructions stored in the memory.
11. An electronic device, comprising:
a memory; and
a processor coupled to the memory, the processor configured to perform the alarm determination method for an intelligent monitoring system of any of claims 1-8 based on instructions stored in the memory.
12. A computer-readable storage medium on which a program is stored, the program, when executed by a processor, implementing the alarm determination method for an intelligent monitoring system according to any one of claims 1 to 8.
CN201811565587.5A 2018-12-20 2018-12-20 Alarm judgment method for intelligent monitoring system and intelligent monitoring system Active CN109544870B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811565587.5A CN109544870B (en) 2018-12-20 2018-12-20 Alarm judgment method for intelligent monitoring system and intelligent monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811565587.5A CN109544870B (en) 2018-12-20 2018-12-20 Alarm judgment method for intelligent monitoring system and intelligent monitoring system

Publications (2)

Publication Number Publication Date
CN109544870A CN109544870A (en) 2019-03-29
CN109544870B true CN109544870B (en) 2021-06-04

Family

ID=65855789

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811565587.5A Active CN109544870B (en) 2018-12-20 2018-12-20 Alarm judgment method for intelligent monitoring system and intelligent monitoring system

Country Status (1)

Country Link
CN (1) CN109544870B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110930623B (en) * 2019-11-20 2021-12-21 万翼科技有限公司 Danger early warning method and device
CN111818237A (en) * 2020-07-21 2020-10-23 南京智金科技创新服务中心 Video monitoring analysis system and method
CN112052732A (en) * 2020-07-31 2020-12-08 陕西瑞海工程智慧数据科技有限公司 Method and device for automatically alarming cable abnormity
CN112543203B (en) * 2020-12-28 2023-04-28 杭州迪普科技股份有限公司 Terminal access method, device and system
CN114281024A (en) * 2021-12-23 2022-04-05 大族激光科技产业集团股份有限公司 Anti-collision detection method, numerical control system, machining equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006067139A (en) * 2004-08-25 2006-03-09 Matsushita Electric Ind Co Ltd Method, device, and program for searching videos of a plurality of cameras
CN100375530C (en) * 2005-08-26 2008-03-12 北京中星微电子有限公司 Movement detecting method
US20090195382A1 (en) * 2008-01-31 2009-08-06 Sensormatic Electronics Corporation Video sensor and alarm system and method with object and event classification
CN101639961B (en) * 2009-09-14 2012-06-13 北京航星网讯技术股份有限公司 Detection alarm method and system thereof
CN107071342B (en) * 2016-12-13 2019-07-30 中国科学院计算技术研究所 A kind of anomalous event automatic push and monitoring method and system based on historical operation

Also Published As

Publication number Publication date
CN109544870A (en) 2019-03-29

Similar Documents

Publication Publication Date Title
CN109544870B (en) Alarm judgment method for intelligent monitoring system and intelligent monitoring system
CN108921159B (en) Method and device for detecting wearing condition of safety helmet
KR102195706B1 (en) Method and Apparatus for Detecting Intruder
CN110889339B (en) Head and shoulder detection-based dangerous area grading early warning method and system
US20210124914A1 (en) Training method of network, monitoring method, system, storage medium and computer device
WO2021031954A1 (en) Object quantity determination method and apparatus, and storage medium and electronic device
CN111931862B (en) Method and system for detecting illegal posted advertisements and electronic equipment
KR101454644B1 (en) Loitering Detection Using a Pedestrian Tracker
CN115082813A (en) Detection method, unmanned aerial vehicle, detection system and medium
CN114332925A (en) Method, system and device for detecting pets in elevator and computer readable storage medium
CN113888024A (en) Operation monitoring method and device, electronic equipment and storage medium
US11393181B2 (en) Image recognition system and updating method thereof
CN111325198B (en) Video object feature extraction method and device, and video object matching method and device
CN114553725B (en) Machine room monitoring alarm method and device, electronic equipment and storage medium
CN112949359A (en) Convolutional neural network-based abnormal behavior identification method and device
CN116246416A (en) Intelligent analysis early warning platform and method for security protection
CN116597501A (en) Video analysis algorithm and edge device
CN115880631A (en) Power distribution station fault identification system, method and medium
CN115953815A (en) Monitoring method and device for infrastructure site
CN114973135A (en) Head-shoulder-based sequential video sleep post identification method and system and electronic equipment
KR20230103890A (en) Video surveillance system based on multi-modal video captioning and method of the same
CN113128414A (en) Personnel tracking method and device, computer readable storage medium and electronic equipment
CN114758296A (en) Power grid equipment remote monitoring method and system based on VR technology
CN114708557B (en) Electric power construction monitoring method and system based on air-ground communication
US20170277954A1 (en) System and method for early detecting disasters based on svm

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant