WO2014139416A1 - Emergent abnormal event intelligent identification alarm device and system - Google Patents

Emergent abnormal event intelligent identification alarm device and system Download PDF

Info

Publication number
WO2014139416A1
WO2014139416A1 PCT/CN2014/073260 CN2014073260W WO2014139416A1 WO 2014139416 A1 WO2014139416 A1 WO 2014139416A1 CN 2014073260 W CN2014073260 W CN 2014073260W WO 2014139416 A1 WO2014139416 A1 WO 2014139416A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
alarm
information
image
signal
Prior art date
Application number
PCT/CN2014/073260
Other languages
French (fr)
Chinese (zh)
Inventor
黄鹏宇
何跃凯
周建雄
彭元华
郭振中
Original Assignee
成都百威讯科技有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN 201310075931 priority Critical patent/CN103198605A/en
Priority to CN201310075931.3 priority
Application filed by 成都百威讯科技有限责任公司 filed Critical 成都百威讯科技有限责任公司
Publication of WO2014139416A1 publication Critical patent/WO2014139416A1/en

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal operating condition and not elsewhere provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/04Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438Sensor means for detecting
    • G08B21/0476Cameras to detect unsafe condition, e.g. video cameras
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light or radiation of shorter wavelength; Actuation by intruding sources of heat, light or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19697Arrangements wherein non-video detectors generate an alarm themselves
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal operating condition and not elsewhere provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/04Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • G08B21/043Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed circuit television systems, i.e. systems in which the signal is not broadcast

Abstract

A intelligent identification alarm device for emergent abnormal events, comprises a video collecting module, a comprehensive information collecting module, an alarm sending module and a signal processing module. The video collecting module collects surrounding video information; the comprehensive information collecting module collects in real time surrounding signals, and transfers in real time the video information and the surrounding signals to the signal processing module. The invention is characterized in that the signal processing module processes and analyzes the images from the video information, and eliminates background images from said video information, so as enable identification of images from the video information. According to the result of the image identification, the signal processing module combines the surrounding signals and comprehensively analyzes same so as to identify whether the present event is an emergent abnormal event, and when distinguishing an emergent abnormal event is complete, thus decides whether to start the alarm sending module to send an alarm signal. Also provided is an intelligent identification alarm system for emergent abnormal events. The present emergent abnormal event intelligent identification alarm device and system are capable of comprehensive analysis and intelligent identification, and send alarm signals according to the identified emergent abnormal event.

Description

 Instruction manual

 Intelligent alarm device and alarm system for sudden abnormal events

 The invention relates to an alarm system, in particular to an intelligent identification alarm device and system for sudden abnormal events. Background technique

 We know that in order to prevent theft, anti-theft devices such as cameras are usually installed in residential areas or outdoor corridors, doors and windows, etc., for example, an intelligent video-based monitoring and alarm system for indoor personnel entering, mainly through the image of the camera. Intelligent analysis realizes the analysis of moving targets in indoor places, and the illegal intrusion of personnel reaches timely detection and alarm, while ignoring non-hazardous sports and reducing false alarms. There is also a home smart anti-theft system which is composed of at least a security door, a mechanical lock, a window, an open-air balcony and a balcony door. By installing on: (1) door net sensor on the security door, anti-theft door magnetic sensor, (2) lock tongue sensor mounted on the lock, key insertion/extraction sensor, single-bounce sensor, (3) mounted on the outside handle The handle position sensor in the assembly, at the same time, sets the balcony path detection area from the open balcony into the balcony door passage, and enters the window path detection area in the passage of the room from the window, thereby realizing automatic identification of the home and the thief in the home. system.

 Existing door and window anti-intrusion systems have the following disadvantages:

 1. Most products in the existing market have a single function and do not have comprehensive analysis capabilities.

 2. A single anti-intrusion detection technology has its own defects. In some cases, it cannot work normally. Once it is not working properly, the entire detection system is in a paralyzed state, and the stability of the system is poor. For example: Intelligent video analysis and detection may be interfered by unrelated motions such as ambient light changes and specular reflections, resulting in a large number of false alarms; pyroelectric infrared detection is susceptible to interference from temperature, strong light, and complex environmental motion; vibration detection is susceptible to wind The external force causes the interference caused by the vibration of the door and window; the glass breakage detection is easily interfered by the noise of the external environment; the door magnetic detection requires the door and window to be strictly closed, and will not be used if the room needs ventilation. For example, in hot summer, the user often needs to open the window. ventilation.

 3. The traditional alarm system, such as "home intelligent anti-theft system", involves a large number of various sensors. Installation and debugging are usually very complicated, and the alarm information is not intuitive, and the scene cannot be known.

 4. The traditional alarm system can't work when the external power supply is cut off, and it can be used for illegal intruders.

5. It is impossible to carry out certain monitoring of legal persons in the room. For example, the elderly who often go out or live alone for their children need certain measures to monitor them to ensure that they can be rescued in time when abnormal situations occur, but there is no current This type of functionality.

Summary of the invention

 The object of the present invention is to provide an intelligent identification device and system for sudden abnormal events, which solves the problem that the existing alarm system has a single function, a high false alarm rate, is easy to be interfered, cannot work normally, and cannot fall to a legal person such as an elderly person. The problem of violent attacks and sudden anomalies.

 In order to solve the above technical problems, the present invention adopts the following technical solutions:

 An intelligent identification and alarm device for sudden abnormal events, comprising a video acquisition module, an integrated information collection module, an alarm transmission module, and a signal processing module, wherein the video collection module collects surrounding video information, and the integrated information collection module collects surrounding signals in real time. And the video information and the surrounding signal real-time rumor processing module; wherein: the signal processing module processes and analyzes the image in the video information, and removes the background image in the video information, Realizing image recognition in the video information;

 According to the image recognition result, the signal processing module combines the surrounding signals to comprehensively analyze and identify whether the current event is a sudden abnormal event, complete the resolution of the sudden abnormal event, thereby determining whether to activate the alarm sending module, and issue an alarm. signal.

 The alarm device as described above is characterized in that:

 A supplemental illumination module is further included. When the video acquisition module performs video acquisition, the supplemental illumination module is automatically activated when the ambient illumination is insufficient, and the auxiliary illumination source is provided for the video acquisition module.

An alarm device according to any of the preceding claims, characterized in that: a power management module is further provided, and the alarm device is powered, and the power management module is connected to an external power source and a battery;

 When the external power supply is normally powered, the entire product uses an external power supply;

 When the external power source is turned off, the battery is automatically enabled to supply power to the alarm device.

 An alarm device according to any of the preceding claims, characterized in that:

 The integrated information collection module includes one or more modules of an audio collection module, a heat release infrared detection module, a vibration detection module, a glass break detection module, a door magnetic detection module, a smoke detector module, and a gas detector module; The heat release infrared detecting module detects difference information of temperature and background temperature in the surrounding space, and converts the information into a voltage signal;

 The vibration detecting module detects a vibration condition in a surrounding space and converts into a voltage signal;

 The glass breakage detecting module and the door magnetic detecting module detect broken sound and door magnetic change information of the surrounding glass and convert into a voltage signal;

 The ambient signal collected by the integrated information collection module includes voice information collected by the audio collection module, information detected by the smoke detector module and the gas detector module, the heat release infrared detection module, and vibration detection. The voltage signal detected by the module, the glass breakage detection module and the door magnetization detection module.

 The alarm device as described above is characterized in that:

 The light source of the fill light illumination module is annular;

 The heat release infrared detecting module, the vibration detecting module, the video collecting module, the audio collecting module and the alarm sending module are arranged and arranged on an outer edge of the annular light source;

 The signal processing module and the power management module are installed in the middle of the annular light source.

 An alarm device according to any of the preceding claims, characterized in that:

 The glass breakage detection module and the door magnetization detection module respectively convert the detected information into a voltage signal to output to the signal processing module by wired or wireless communication.

 An alarm device according to any of the preceding claims, characterized in that:

 The alarm sending module sends out an alarm signal sent by the signal processing module by using wired or wireless communication. The alarm device as described above is characterized in that:

 The wireless communication method includes 3G, WIFK Zigbee. Bluetooth or other wireless communication methods.

 The alarm device as described above is characterized in that:

 The signal processing module collects signals and videos sent by one or more modules of the heat release infrared detection module, the vibration detection module, the glass break detection module, the door magnetic detection module, the smoke detector module, and the gas detector module. The signal transmitted by the acquisition module and the audio collection module is subjected to comprehensive analysis, thereby completing the resolution of the sudden abnormal event, and issuing an alarm signal through the alarm sending module.

 An alarm device according to any of the preceding claims, characterized in that:

 The signal processing module includes a main processing chip that employs a dual core architecture mode in which the main core processor and the slave core processor are combined.

 The alarm device as described above is characterized in that:

 The main core processor receives the video information and the surrounding signals collected by the video collection module and the integrated information detection module;

 Transmitting the video information and the surrounding signal to form a multi-source signal to the slave core processor;

 The slave processor resolves the sudden abnormal event to form a final decision signal.

 The alarm device as described above is characterized in that:

 The distinguishing sudden abnormal event mainly includes running an audio and video intelligent analysis algorithm, and simultaneously distinguishing with other information in the surrounding signal.

 An alarm device according to any of the preceding claims, characterized in that:

 The alarm linkage module is further included, and the alarm linkage module sends a warning to the sound and light alarm device in response to the alarm transmission module.

 An alarm device according to any of the preceding claims, characterized in that:

Also included is a voice output module that receives voice from the remote terminal and broadcasts the output. The invention also provides a sudden abnormal event intelligent identification alarm system, the system comprising a storage module and an alarm device as described above; the storage module establishes communication with the alarm device by means of wired or wireless communication Connecting, storing information collected by the alarm device; It is characterized by:

 The distinguishing the abnormality event includes processing, analyzing, and identifying the image in the video information; and analyzing the surrounding signal that is synchronously collected by the integrated information collecting module;

 The signal processing module completes the identification of the current event based on the processing, analysis, identification, and analysis of the surrounding signal in the video information, and realizes the resolution of the sudden abnormal event, thereby determining whether to activate the alarm. Send module, send out an alarm signal.

 The alarm system as described above is characterized by:

 The synchronization means that the video information and the surrounding signals are collected and analyzed simultaneously at the same time.

 The alarm system as described above is characterized by:

 The alarm system further includes a face database and a face registration module, and the feature of the standardized face image is extracted by the face registration module, and is entered and registered in the face database;

 The processing, analysis, and identification of the image in the video information includes determining the identity of the person in the video information by face recognition.

 The alarm system as described above is characterized by:

 In the face recognition, the face recognition is performed by using the HAAR feature combined with the adaboost algorithm for face detection. The two-layer human eye locator is used to obtain the human eye positioning by the adaboost algorithm, and the face positioning result is used to correct the binoculars by image rotation. Horizontal face normalization;

 Feature extraction is performed by two-dimensional Gabor filter, and the covariance distance between vectors is used as the matching metric. The nearest neighbor classification method is used to match the face image to be recognized with the face image in the face database.

 An alarm system as claimed in any of the preceding claims, characterized in that:

 The processing of the video information includes removing a background image in the video information, leaving a foreground image.

 The alarm system as described above is characterized by:

 Removing the background image in the video information includes the following steps:

 A mixed Gaussian background model is used. Hybrid Gaussian background modeling assumes that the probability distribution of signal changes is fitted with K Gaussian distributions, expressed as

 κ

Prob(x) = ω ί η ί (χ, μ ί , σ ι )

 ί=1

Where ^ and σ are the mean and variance of the Gaussian distribution, and each Gaussian distribution "i ' ^ ) in the model is given a weight °^, where ^ and σ; respectively represent the mean and standard deviation of the Gaussian distribution;

 The Gaussian distribution of multiple Gaussian distributions yields the probability distribution prob(x) of the signal, and the K Gaussian distributions are arranged in descending order, where the top Gaussian distribution

 b

B = arg min fc ω η (χ) > Γ)

 =1=1

 Representing the background model, the remaining Gaussian distribution is the foreground model;

The pixel values of the video image information (and the front Β matching Gaussian distributions, if any, and wherein a Gaussian distribution of the pixel matching is successful as background pixels, the foreground image otherwise.

 An alarm system as claimed in any of the preceding claims, characterized in that:

 The identifying of the current event further includes removing an unrelated motion in the video information, tracking the target motion.

 The alarm system as described above is characterized by:

 The removing of extraneous motion in the video information includes employing a light interference filter to remove interference due to changes in light.

 The alarm system as described above is characterized by:

 The light interference filter removes interference by:

Through the background image modeling of the gray image, the motion region is Rg , and the region in the corresponding depth image is Rd . The real target region must satisfy the following conditions:

Figure imgf000006_0001

Wherein, and p g are depth image and gray image motion detection results, respectively;

p ( =1 means the target motion pixel, p ( = 0 means the background pixel).

 The alarm system as described above is characterized by:

 The alarm system also includes a face and head and shoulder detection filter to identify the action when the target is a person.

 The alarm system as described above is characterized by:

 The face and head and shoulder detection filters respectively use a haar wavelet combined with an adaboost classifier to implement face detection in a grayscale image, and a HOG feature combined with an SVM classifier to implement head and shoulder detection;

 Recognizing as a target motion when the motion region detects a face feature or a head and shoulder feature;

 Otherwise it is considered to be interference and filtered out.

 An alarm system as claimed in any of the preceding claims, characterized in that:

 After confirming the target action in the video information, the method further includes tracking the target action by the target association between the frames to form a motion track of the target, and providing a basis for the signal processing module to intelligently identify the event.

 The alarm system as described above is characterized by:

 The tracking includes:

 Target position prediction, target feature selection, target association matching, and target feature update,

 among them,

 The target position prediction is to estimate the position of the target in the next frame according to the current frame and the position of the previous target, thereby improving the accuracy of the subsequent association matching, and using the following formula to complete the prediction of the position of the next frame.

Σ ) Σ (y t -„ - y

 V; =^ V =^

 N_ and N _

Where ^ and 7 respectively represent the velocity of the target in the X direction and the y direction at time t , N is the time window, and "and · ^ ^" respectively represent the abscissa and ordinate of the center of the target outer rectangle at time tn, the same as -" - 1 denotes the abscissa and ordinate of the center of the outer rectangle of the target at t>nl, respectively;

 The target feature selection is to select two features of the relatively stable and reliable target area S and the target circumscribed rectangular frame center C; the target association matching is to find the position of the previous frame target in the current frame, to achieve the target matching, and the target j at time t is

0f , the target i is 0 " at time t-1, and the feature matching is performed when the following formula is satisfied:

Jsi(0 {C},0_ 1 {C})<r where ^ is the search distance and needs to be determined according to the actual scene;

The matching criterion is as follows: arg min(« x (—— f ' fu ) + (1-ω)χ < T r

Figure imgf000006_0002
Where ω is the characteristic weighting factor, taking the value of 0.5, 13⁄4 error upper limit, preventing mismatch, taking the value 0.4;

 The target feature is updated by filtering out the mutation data, using the following formula

O t {F}=axO t _ 1 {F}+(la)xO t {F} F={S,Q

 Among them, "for the update factor, take the value of 0.2 to achieve the update of the target feature.

 28. An alarm system according to any of claims 15-27, characterized in that:

 The alarm system can also realize the identification of a fall event, and the identification of the fall event includes the following steps: automatic three-dimensional modeling of the ground, setting the origin of the camera coordinate system on the image coordinate system, so that the translation matrix is reduced to

 0

 0

 H

 The conversion distance between the camera's optical center and the ground, the camera coordinate system and the world coordinate system are as follows

0

 τ 0

 H

Figure imgf000007_0001
R = R x {a)*R y (. )*R r ^ The angle between the three coordinate axes of the camera coordinate system and the three coordinate axes of the world coordinate system is ", and ^ assumes the origin of the image coordinate system and the camera coordinate system. If the origins coincide, then a point u , v , d in the depth image is

 Ud vd , ,

 (x = -, y = -, z = d)

The coordinates in the camera coordinate system are where ( w , v ) is the coordinates of the pixel in the image, d is the distance of the subject from the camera, and the focal length of the camera in the horizontal and vertical directions on the imaging plane; The point F ( x , y, z ) satisfies the following plane constraints in the camera coordinate system: ax + by + cz + d =0 where V = [a, b, (:: Γ is the normal vector of the ground plane, passing the normal vector It is possible to calculate the angle α of the three coordinate axes, β Y a n bc

 a = arccos - β = arccos - γ = arccos -

 Ivi; , ivi

After obtaining a frame of depth image data, the plane fitting is performed by using the EANSAC algorithm, and multiple candidate ground planes D i, b i, c i, d i are obtained by fitting, and the plane is performed by the following prior knowledge. Coarse screening:

First, the ground occupies a large area in the image, that is, the real ground plane should include more image pixel points; 2. Normally, the angle Y between the camera and the z-axis is between 40 degrees and 80 degrees, and the angle a from the X-axis is between 0 degrees and 20 degrees, and the angle with the y-axis is substantially equal to 0 degrees.

 In the plane remaining after the coarse screening, the plane farthest from the camera is selected as the ground plane, that is, it satisfies:

= arg max d t

 L≤i≤n

The distance from any point in the camera coordinates to the ground plane is:

Figure imgf000008_0001

 Calculate the distance from the target center to the ground plane by the above formula;

 The target is stationary, and the target is determined to be stationary by calculating the time domain difference of the grayscale image in the target area:

M = (x 'y>eR where & represents the gray value of the pixel point in the gray image at time t, and the target area of the knee is the pixel area of the target area;

 When M < indicates that the target is stationary, where is a small positive number.

 An alarm system as claimed in any of the preceding claims, characterized in that:

 The alarm system can also realize the identification of a limb conflict event, and the identification of the limb conflict event is implemented by an optical flow vector and an audio analysis, and the optical flow vector analysis includes the following steps:

Optical flow vector analysis, the target region is obtained by target tracking, and the optical flow vector ^ ^, ^,... in the target region is calculated by using the optical flow of the locating point, and the region is realized by the amplitude weighted histogram H P = , h j , jD Statistical analysis of the optical flow vector, and then obtain the jth-order histogram hj by the following formula, h j =C h ∑A v S(b(v i )-j)

i=l The order value is 12, which is the normalization parameter, 'is the amplitude of the normalized optical flow vector V '', ^ V '') is the histogram interval corresponding to the optical flow vector V '', through the vector The direction is determined, ^(•) Ko neckerdelta function, using the regional entropy E H to achieve a measure of severe irregular motion, the expression of E H is as follows:

Figure imgf000008_0002
It represents the j-th order amplitude weighted histogram. The larger the £ H is, the more severe the movement in the area is. The threshold T is set. When E H > T , the limb conflict is broken in the area.

 Compared with the prior art, the beneficial effects of the present invention are as follows: The invention adopts intelligent audio and video analysis such as target behavior analysis, face recognition, voice recognition as the core technology, and combines advanced pyroelectric infrared detection, vibration detection, and audio. Internet of Things and wireless communication technologies such as detection, glass breakage detection, magnetic door detection and smoke detection, real-time dynamic detection and analysis of people in the indoor control area, long-term fall, illegal intrusion, theft, serious limb conflict, fire, gas leak, Sudden anomalous security incidents such as explosions, and the audio-visual or picture-based visual alarm signal is sent to the alarm receiving and processing terminal such as the household mobile phone or computer, the community monitoring computer, etc. through wired or wireless communication. The sound and light alarm is alarmed, and the voice output of the terminal device is received, and the voice intercom is realized. The invention also adopts a false alarm filter based on the sudden abnormal event review algorithm and the moving target feature analysis, and combines the multi-source detection information. , better solved the traditional indoor security system (such as Infrared detectors, intelligent anti-theft locks, etc.) have high false alarm rate and poor reliability. Finally, this product comes with a spare battery, which can supply itself for 2-24 hours without external power supply.

DRAWINGS

 FIG. 1 is a schematic diagram of a connection of an embodiment of an indoor sudden abnormal event alarm system according to the present invention.

 2 is a schematic diagram of hardware connection of an indoor sudden abnormal event alarm system according to the present invention.

 FIG. 3 is a software structural diagram of a sudden abnormal event alarm system in the present invention.

 4 is a schematic flow chart of a main processor end in a signal processing module of an indoor sudden abnormal event alarm system according to the present invention. FIG. 5 is a schematic flow chart of a slave processor in a signal processing module of an indoor sudden abnormal event alarm system according to the present invention. FIG. 6 is a schematic diagram of a face registration and face recognition process of the indoor emergency abnormal event alarm system of the present invention.

 Fig. 7 is a schematic diagram showing the analysis of the face image of the face normalization in the indoor emergency abnormality alarm system of the present invention.

 FIG. 8 is a schematic diagram of a fall detection process of the indoor emergency abnormal event alarm system of the present invention.

 FIG. 9 is a schematic diagram of coordinate modeling for fall detection in the indoor sudden abnormal event alarm system of the present invention. FIG. 10 is a schematic diagram of a specific sound detection process of the indoor emergency abnormal event alarm system of the present invention.

 FIG. 11 is a schematic diagram of a product experiment system connection of an indoor sudden abnormal event alarm system according to the present invention.

detailed description

 The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

 1 shows an embodiment of an indoor sudden abnormal event alarm system of the present invention: an indoor sudden abnormal event alarm system, including

 The video acquisition module uses a video sensor to collect a video stream signal, completes digitization of the image signal, and preprocesses the image signal to obtain a digital video signal that satisfies the requirements of the signal processing module and outputs the signal to the signal processing module;

 The audio acquisition module completes the digital-to-analog conversion of the speech signal, the sampling and encoding of the speech signal, and the filtering process to obtain a digital audio signal required by the signal processing module and output to the signal processing module;

 The heat release infrared detecting module senses the difference between the temperature of the moving object and the background object. When the human body moves, the pyroelectric infrared can sense the difference information between the human body temperature and the background temperature, and converts it into a voltage signal and outputs it to the signal processing module; the vibration detecting module Transforming the deformation or force information of the external vibration into a voltage signal and outputting it to the signal processing module;

The glass break detection module and the door magnetic detection module convert the corresponding information into a voltage signal and output to the signal processing module through wired or wireless communication, and the auxiliary signal processing module makes a corresponding judgment; The signal processing module collects the signals transmitted by the heat release infrared detection alarm module, the vibration detection module, the video acquisition module and the audio collection module, and performs comprehensive analysis to distinguish between an illegal invasion, a violent conflict, a long-term fall, a gas leak, and the like. An abnormal event, and an alarm signal is sent to the alarm sending module;

 a wireless receiving module, configured to receive an alarm signal sent by the vibration detecting module, the glass breaking detecting module, the smoke detector, the emergency call button, and the alarm sensor on the door magnetic detecting module;

 The alarm sending module adopts wired or wireless communication mode, and is mainly used for receiving an alarm signal sent by the signal processing module and sending an alarm message to the mobile phone or the cell management center of the household;

 Alarm linkage module, linkage sound and light alarm equipment work at the same time;

 a voice output module that implements voice output from a remote terminal device such as a mobile phone or a monitoring center;

 The infrared LED fill light module provides an auxiliary light source to the video capture module when the ambient illumination is insufficient, so that it can still collect valid image data in a low illumination environment;

 The power management module is connected to the external power supply and the battery. When the external power supply is normally powered, the whole product uses an external power supply. When the external power supply is cut off, the internal backup battery is automatically enabled to ensure that the above modules continue to work normally after the external power supply is interrupted.

 1 also shows a preferred embodiment of the indoor sudden abnormal event alarm system of the present invention, the system is installed in a casing, the video acquisition module, the audio collection module, the heat release infrared detection alarm module, and the vibration detection module. The alarm sending module, the wireless receiving module, the alarm linkage module and the alarm sending module are installed in a casing, and the signal processing module and the power management module and the switch light control module are installed in the middle of the casing, and the infrared LED fill light module is set. Between the outer edge of the casing and the middle.

 2 shows another embodiment of the indoor emergency abnormality alarm system of the present invention. The core processing chip in the signal processing module adopts a dual-core architecture mode, that is, a "main processor + slave processor" dual-core architecture mode, and the main processor is mainly Complete audio and video signal collection, audio and video coding, pyroelectric infrared alarm signal collection, receiving vibration detection module, glass break detection module, door magnetic detection module, smoke detector, emergency call button and other distributed alarm sensors through wireless receiving module The sent alarm signal transmits the multi-source alarm signal together with the audio and video data to the slave processor; the slave processor is mainly used to run the audio and video intelligent analysis algorithm, and judges whether there is a sudden abnormal event through video and sound, and simultaneously combines pyroelectricity Infrared alarm signal, vibration alarm signal, glass break alarm signal, door magnetic alarm signal and other multi-source information form the final decision signal. If it is determined that a sudden abnormal event occurs, send an alarm signal to the main processor and activate the sound and light alarm. Alarm.

 As shown in FIG. 3, the software of the indoor emergency abnormal event alarm system of the present invention is mainly composed of a main processing process and an intelligent processing process, and the main processing process is composed of a signal acquisition module, a voice output module and an alarm sending module. Running on the ARM side; intelligent processing process, consisting of intelligent analysis module and multi-source information fusion false alarm filtering module, running on the DSP side. The signal acquisition includes audio and video acquisition module, pyroelectric infrared alarm signal acquisition module and wireless alarm signal acquisition module, which is responsible for the acquisition of audio and video signals and voice output. In order to ensure that the collected signals can be synchronized for subsequent processing, appropriate delay processing is performed on various alarm signals to synchronize with the audio and video acquisition signals. The intelligent processing process completes intelligent audio and video analysis, multi-source information fusion and false alarm filtering, and sends an alarm signal to the main processing process. The main processing process sends an alarm message to the external terminal or activates the linkage alarm device alarm through the alarm sending module.

 As shown in Figure 4, the main processing software flow: After the system is powered on, the initialization of the main processor program is completed first, then the peripheral acquisition device is completed, the communication device is initialized, and the slave processor program is started. Create an audio and video capture thread, a pyroelectric infrared detection thread, a wireless receiving thread, a slave processor communication thread, and an alarm sending thread.

 Audio and video collection thread: When receiving audio and video data, combine one frame of multi-source data, including video data, audio data and other various sensor alarm identifiers, put them into Rame Buffe r for communication thread to call, and complete audio and video pre-processing. Recorded to provide alarm information.

Pyroelectric infrared detection thread and wireless receiving thread: Receive alarm signals Ai of various alarm sensors, wherein Ai can be pyroelectric infrared alarm signal, vibration alarm signal, glass broken alarm signal, door magnetic alarm signal and so on. When the alarm signal is received, the corresponding alarm flag H is set to 1, indicating that the i-th sensor has an alarm, and the counter Ci is set to an initial value. Value, otherwise the counter Cii is decremented. When the counter is reset to zero, the alarm flag H is set to 0. The delay counter is set here to ensure that the alarm information of various sensors can be synchronized.

 From the processor side communication thread: Receive an alarm signal sent from the processor side to notify the alarm sending thread. If there is one frame of multi-source data in the Rame Buffer, the data is sent to the slave processor.

 Voice output / alarm sending thread: After receiving the alarm signal, organize related alarm information, such as audio and video of the quotation, pictures, etc., send to the external terminal, and start the equipment such as sound and light alarm. If the voice output information is received, the voice output function is immediately turned on, and the remote terminal is connected to complete the voice output.

 As shown in Figure 5, the intelligent processing software flow: First, after the main processor side main processing process is started, the multi-tasking kernel and the intelligent processing process are added to the slave processor memory, and the slave processor completes a series of initializations to automatically create a communication. Threads and analysis threads. The communication thread first determines whether it is necessary to send an alarm signal, and if so, sends an alarm signal to the main processing process, otherwise it determines whether a multi-source information is received, wherein the multi-source information includes: audio and video data and alarm information of other sensors, which will be more The source information is placed in the frame buffer RameBuffe r, and a receiving confirmation signal is sent to the main processing process, indicating that the intelligent processing process works normally. The analysis thread reads a frame of data from Rame Buffe r, extracts audio and video data from it for analysis, and obtains the analysis result, and combines other alarm information in the data frame to complete multi-source data fusion and false alarm filtering to determine whether an alarm needs to be sent. signal.

 FIG. 6 is another embodiment of the indoor emergency abnormality alarm system of the present invention. The household identity determination includes the identification of the household owner by face recognition, wherein the face recognition is mainly divided into:

 Face registration, collecting positive face photos of different angles of the same person, finding the position of the face in the image through face positioning, and normalizing the face size, face angle and illumination, extracting the features of the standardized face image, and entering Register a user database;

 Face recognition, using HAAE sign combined with a dab oo st algorithm to realize face detection to achieve face localization, using a two-layer human eye locator, all obtained eye positioning by a dab 0 0 st algorithm, using face positioning results The face is normalized by image rotation to correct the face, the feature extraction is performed by the two-dimensional Gab 0 ι3⁄4 chopper, and the covariance distance between the vectors is used as the matching metric. The face image and database of the query are realized by the nearest neighbor classification method. Matching of face images. The Adab o o st algorithm combines a large number of weak classifiers with general classification ability into a strong classifier according to the decline of the training error index. The HAAE sign provides a large number of weak classification features for the adab o o st algorithm, which ensures that the adab o o st algorithm generally finds weak classifications with excellent performance. In the implementation process of face detection, the use of integral histogram and cascade classifier greatly reduces the processing time while ensuring higher detection accuracy; human eye positioning is generally divided into two layers, wherein the first layer is coarse positioning. The positioning area selects most of the eye area including the eyebrows, the second layer is the precise positioning, and the positioning area only contains the eye area. Compared with the precision positioner, the coarse positioner has more regional information, so the stability of the positioning is higher, there is basically no large positional deviation, and the precise positioner can achieve precise positioning of the human eye, but is susceptible to The interference of the eyebrows and the corners of the eyes caused a positioning error. The approximate position range of the human eye is determined by the geometric proportional relationship on the coarsely positioned ^ ftH, within which the precise positioning of the human eye is achieved using a precise positioner. Through the coarse to fine positioning method, the influence of eyebrows and eye corners on positioning is reduced, and the accuracy of positioning is improved. Face standardization is a very important step in face recognition, and the standardization result directly affects the quality. The accuracy of face recognition. The face standardization mainly completes the geometric correction and brightness correction of the face image. It is easy to realize the geometric correction of the face image by using the result of the human eye positioning in the previous step. First, the eyes are corrected to the horizontal by the image rotation, and the face image is intercepted by the distance d between the eyes. As shown in Figure 7, the image is finally scaled to 80x80 pixels.

The brightness correction mainly eliminates the influence of uneven illumination on subsequent recognition to some extent. It mainly includes the illumination surface fitting, deducting the illumination surface, histogram equalization and gray value normalization to zero mean, unit variance. It is assumed here that the illumination surface is a plane. The point on the light surface satisfies the following formula: /5 = + ^ + ( written in matrix form ie " 3⁄4 = , where column vector representing the gray value of the pixel of the image is arranged, N represents the coordinates corresponding to the pixel point, One column represents the abscissa, The second column represents the ordinate, the third column is filled with 1, p = [ ab C F. The plane parameters a, b, c can be obtained by linear regression, ? Ρ =, Ν Τ ΝΠ

 The Gab 0 r wavelet feature can be selected, and the Gab o r transform has excellent performance in analyzing the local texture of the image. Two-dimensional Gab on filter ^ (can be expressed as:

Figure imgf000012_0001
Where is the image coordinates, which is the center frequency of the filter, and y are the projections on the horizontal and vertical axes, respectively.

Shadow, % is the direction of the filter, "and v represents different values,

Figure imgf000012_0002
For Gaussian envelope, ex P( fc ) is a complex-valued plane wave. The two-dimensional Gab 0 waver modulates the sine wave plane of a specific frequency and direction by a two-dimensional Gaussian function, and realizes the analysis of image textures of different scales and different directions by changing the frequency and direction of the sine wave plane.

 A face image of 80x80 size is obtained by face normalization. Here, five filter scales and eight filter directions are selected to obtain 40 Gab 0 waves of different directions and frequencies, and a face image is passed through the filter roll. After the product, 40 amplitude images of Gab 0 r wavelet transform are obtained, and the obtained Gab o 1# dimension is 163840. Such a high-dimensional feature vector greatly reduces the speed of identifying the classification, so it is necessary to reduce the dimension of the feature vector. Here, 4x4 uniform downsampling is used to achieve feature dimensionality reduction.

 The nearest neighbor classification method is used to match the face image of the query with the database face image, and the covariance distance between the vectors is used as the matching metric. At the same time, the reliability of the final matching can be measured by the covariance distance.

 According to another embodiment of the indoor emergency abnormality alarm system of the present invention, the signal processing module is connected with a storage module (Storage), and different types of storage media are used for different application situations, and SD and TF cards are controlled by SDIO. This type of storage medium is easy to replace; Nand is controlled by Nandfksh, this type of integration is high, but it is not easy to replace the storage medium; SSD is controlled by PCI-E or S VIA interface, this type of storage space can be very large;

 Set up with Ethernet interface (RJ45);

 An external power supply (DC IN) and a battery (Batter) are connected through a power management module (Powermanage r); and a memory (DDR) for controlling the operation of the CPU is connected;

 Connected to a flash (Hash) for storing system boot programs, configuration parameters, and log information;

 Connected with wireless module (3G, W1FX) for audio and video data and remote control signal transmission; connected with wireless module (zigb ee, Hue to oh or other wireless module), used to receive 4 分布式 sent by distributed alarm Alarm signals, such as glass break signals and door open signals, can also send control information to other devices.

 The linkage alarm module is connected with an external alarm light, a siren linkage device, a local sound and light alarm, or other related equipment.

8 and 9 illustrate a preferred embodiment of the indoor sudden abnormal event alarm system of the present invention. The video capture module includes an ordinary camera detection module and a depth camera detection module in which image data are aligned with each other, for a point P in the image. The six-dimensional information component ^, ^^, ^", ^^> is obtained, where <"^^> is the coordinate of the pixel point in the image, d is the distance of the subject from the camera, and <^^> is the color component. The method for detecting the moving target and detecting the sudden abnormal event alarm system in this room is as follows:

 The color image is converted into a gray image, and the background model is established for the gray image and the depth image respectively. The background model is established by using mixed Gaussian. The mixed Gaussian background model assumes that the probability distribution of the signal change can be fitted by a Gaussian distribution, expressed as

 κ

ρΓθΗχ) = ^ ω ί η ί (χ, μ ί , σ ί ) where; "and σ is the mean and variance of the Gaussian distribution, each Gaussian distribution C^'A' in the model) is given a weight, where A and σ '' respectively represents the mean and standard deviation of the Gaussian distribution, and the Gaussian distribution obtains the probability distribution of the signal by linear combination. One Gaussian distribution is arranged in descending order of *^°", and the Gaussian distribution of the front ranks enough to represent the distribution of the background. At the same time, the mixed Gaussian model can automatically maintain the changes of the scene, and at the same time, the error can be corrected by learning to correct the error.

 The first Gaussian distribution is used as the background model, and the remaining Gaussian distribution is considered to be the foreground.

B = arg min fc ω η (χ) > Τ) Match the current pixel value ^ with the previous Gaussian distribution. If any of the Gaussian distributions match successfully, the pixel is the background pixel, otherwise it is the foreground. Motion pixel, matching method is as follows

\ Ι(χ) - μ ί (x) l< c χ c ; (x) i = l .· ·· · B .

 The target confirms that the moving object is detected by the background modeling method, but many movements are caused by the change of indoor light, the swing of the curtain, the flashing of the TV picture, etc., and the monitoring object here is a person, so the person needs to be The movement is separated from a large number of unrelated movements. Here, through the light interference filter, the face detection filter and the head and shoulder detection filter, the gray image analysis is mainly used, and the depth image analysis is supplemented, and the face detection and the head and shoulder detection are combined to realize the monitoring target confirmation.

The light interference filter: the change of the light causes the gray value of the image to change. When the speed and amplitude of the gray value change exceeds the adaptation range of the background model, it is detected as a moving target, and the light image is filtered by the depth image. Motion, depth image is based on the infrared light detection method, which is basically free from the interference of illumination changes. The motion region is Rg through the background image modeling of gray image, and the region in the corresponding depth image is Rd . The real target region must satisfy the following conditions. condition:

^ >τ

Where (and p g (respectively for depth image and grayscale image motion detection results, p ) = 1 for motion image Prime, P ^) = () represents the background pixel;

 Face and head and shoulder detection filter: There are a lot of real movements in the actual monitoring scene, such as the rotation of the fan, the swing of the curtain, the flickering of the TV picture, the movement of the pet, and the present invention only cares about the movement of the person, the person is different from The obvious appearance features of these movements, such as face features and head and shoulder features, here in the gray image using haar wavelet combined with the adab oo st classifier for face detection, HOG features combined with SVM classifier to achieve head and shoulder detection, when in motion When the area detects a face feature or a head and shoulder feature, it is described as a person who is exercising, otherwise it is considered to be interference and filtered out;

 Target tracking, based on the target confirmation, forms the target's motion trajectory through the target association between frames, and provides a basis for subsequent target behavior analysis. Target tracking mainly includes: target location prediction, target feature selection, target association matching, and target feature update, among which

 The target position prediction is to estimate the position of the target in the next frame according to the current frame and the position of the previous target, which is beneficial to improve the accuracy of the subsequent association matching. Here, the method of estimating the target speed is used, and the position is predicted by the following formula.

Σ ( Χ , -η - X tnl ) Σ (y t -n - -„-1 )

Where V f and 7 respectively represent the velocity of the target in the x direction and the y direction at time t, N is the time window, and "and · ^ ^" respectively represent the abscissa and ordinate of the center of the target outer rectangle at time tn, and the same - "- 1 denotes the abscissa and ordinate of the center of the outer rectangle of the target at t>nl, respectively;

The target feature selection is to select two features of the relatively stable and reliable target area S and the center C of the target circumscribed rectangular frame. The target association matching is to find the position of the previous frame target in the current frame and achieve the target positioning. According to the correlation tracking principle, as long as sufficient image sampling rate is ensured, the position change of the same target between adjacent frames will not be Too large, so the target search range can be limited to a small distance range, and the risk of mismatching is greatly reduced. The target j is Qf at time t, and the target i is 0 " at time t-1. Feature matching only when:

J si(0 {C}, 0 _ 1 {C}) < r where ^ is the search distance and needs to be determined according to the actual scene.

The matching criterion is as follows: arg min(« χ (—— f ' f — ' ) + (1 - ω) χ ~ '- ' ) < T where w is the weighting factor of the feature, which is 0.5, Ί3⁄4 upper error limit, Prevent mismatch, value 0.4

The update of the target features is performed by filtering out the mutated data to ensure that the data does not appear to have large fluctuations in the first-order smoothing manner. For the specific implementation, see the formula for the next line.

q {F} =ax O tl {F} +(la)xO t {F} F = {S, Q

Where "is the update factor, value 0.2

The indoor sudden abnormal event alarm system is used to detect the fall as follows, the ground automatic three-dimensional modeling, will be with the video The camera connected to the acquisition module is tilted down at an angle to the ground, and the origin of the camera coordinate system is set to the image.

 0

 0

 H

On the Z axis of the coordinate system, the translation matrix T is simplified to , where H represents the distance from the camera's optical center to the ground, and the conversion formula of the camera coordinate system and the world coordinate system is as follows

0

 T 0

HR = R x (a)*R y (fi)*R

Figure imgf000015_0001
The angle between the three coordinate axes of the camera coordinate system and the three coordinate axes of the world coordinate system a J . Assuming that the origin of the image coordinate system coincides with the origin of the camera coordinate system, a point (", v , ) in the depth image is in the camera coordinate system. Lower coordinates

Ud vd , ,

Where ( w , v ) is the coordinates of the pixel in the image, d is the distance of the subject from the camera, and is the focal length of the camera in the horizontal and vertical directions on the imaging plane; set the point y, z ) on the ground The following plane constraints are satisfied in the camera coordinate system: ax + by + cz + d =0 where = , c f is the normal vector of the ground plane, and the angle α of the three coordinate axes can be calculated by the normal vector, and Ϊ■ a n bc

 a = arccos - β = arccos - γ = arccos -

 Ivi; , ivi

After obtaining a frame of depth image data, the EANSAC algorithm is used to achieve plane fitting. By fitting, multiple candidate ground planes ^^ , ^', 6 ^ 6 ^ can be obtained, and the plane is coarsely filtered by the following prior knowledge. ;: First, the ground occupies a large area in the image, that is, the real ground plane should include more image pixel points; Second, the angle between the camera and the z-axis is usually 40 degrees and 80 degrees. The angle a between the axis and the X axis is between 0 and 20 degrees, and the angle with the y axis is substantially equal to 0 degrees.

 In the plane remaining after the coarse screening, the plane farthest from the camera is selected as the ground plane, that is, it satisfies:

= arg max d i

 1

 The distance from any point in the camera coordinates to the ground plane is:

 , I ax

La 2 +b + c Calculate the distance from the target center to the ground plane by the above formula;

The target is judged statically, and the target is still determined by calculating the time domain difference of the grayscale image in the target area: ) g t x, y) - g t _ l x, y) \

M = (x 'y>eR where & (JC , which represents the gray value of the pixel point in the gray image at time t, and R represents the target area, which is the pixel area of the target area. When M < indicates that the target is stationary, Where ε is a small positive number.

 In general, firstly, the ground 3D modeling is performed to determine the ground area in the image, and the 3D coordinates of the ground are obtained. On the basis of the target tracking, the distance between the center of the target and the ground plane is calculated, if Η is smaller than the set The value of 阔 indicates that the person’s body is close to the ground. If the time when the target is detected to be stationary is greater than a certain threshold, the fall report is triggered.

 FIG. 10 shows another preferred embodiment of the indoor sudden abnormal event alarm system of the present invention. The audio collection module also detects a specific sound, and the detection method package is as follows: Voice signal preprocessing, assuming the sampling rate of the audio signal X ( For the value 83⁄4Ήζ, X (subsequently pre-emphasis, framing and windowing, the window function selects the Hanning window, and removes the mean, avoiding the DC component affecting the line near w = 0;

 Feature extraction, using the periodic graph method in classical spectral estimation, using IFT, finally obtaining a normalized power spectrum

Χ η , , Extract a number of 24 Mel filter banks. The power spectrum is filtered by the Me l filter bank to obtain the logarithm, and then the discrete cosine transform is used to obtain the Mel cepstrum MFC C coefficient. The Mel filter bank is composed of a set of triangular bandpass filters distributed according to the Mel frequency standard;

The training of GMM audio identification model adopts the maximum expectation: EM algorithm to obtain the GMM model, given the training sample set Χ = { χ ι, χ 2,···, χ η } , the likelihood function of GMM is

Figure imgf000016_0001
Where model parameters =
Figure imgf000016_0002
Pi represents the probability of the Gaussian model, w ''' '' represents the mean vector and covariance matrix of the Gaussian model, respectively.

The EVI algorithm consists of two steps, E step to obtain the expectation, calculate the auxiliary function β( , ), maximize the expectation of the step, and maximize the β(Λ^).

Figure imgf000016_0003

 y

Where X is the observed value and Y is the implicit state. When the expected maximum values calculated by two adjacent iterations are not much different, the algorithm converges and stops iterating, as shown in the following equation:

Q t ( , )-Q t ( ,i)<s

Where t represents the number of iterations, which is a smaller positive number;

 Using the training model to identify, the model parameters are obtained through GMM training. The speech segments are extracted and sent to the GMM model to calculate the similarity. The similarity is used to judge the category of the speech segment.

 According to an embodiment of the indoor sudden abnormal event alarm system of the present invention, a method for detecting a limb conflict in an indoor sudden abnormal event alarm system includes optical flow vector analysis and audio analysis, accompanied by severe irregularity in an outbreak of limb conflict The movement and loud whistling can detect limb conflicts by optical flow vector analysis and audio analysis. When both methods detect limb conflicts, they trigger a limb conflict alarm and capture a live photo.

Optical flow vector analysis, the target area can be obtained by target tracking, and the optical flow vector V = ι, ν2 , ···, in the target area is calculated by using the MT feature point optical flow, and the amplitude weighted histogram is used = {h j = i, 2, .., n realizes the statistical analysis of the regional optical flow vector, and then obtains the jth order kj , h^C^Sibiv,)-])

Here, the order can take the value 12, ^^ is the normalization parameter, 'is the amplitude of the normalized optical flow vector V '', and ( ν '') is the histogram interval corresponding to the optical flow vector 7 ', through the vector The direction is determined, ^(·) is the Koneckerdelta function, and the regional entropy is used to achieve the measure of severe irregular motion. The expression is as follows:

Where ^ denotes the jth order amplitude weighted histogram. A larger one indicates that the movement in the area is more severe and irregular, and the threshold T is set, indicating that a physical conflict has erupted in the area.

 The entire workflow of the present invention:

 The user can turn the alarm function on or off as needed. The detection method can select one or several of video detection, audio detection, pyroelectric infrared detection, vibration detection, glass breakage detection, smoke detection, and magnetic detection. Falling and serious attitude conflicts are detected by audio and video. Pyroelectric infrared detection, vibration detection and glass breakage detection are used in the window area. Video detection, audio detection, pyroelectric infrared detection, vibration detection and door magnetic detection are used in the area where the door is located. The alarm information can be one or more of video, audio or picture.

 (1) After the device is powered on or reset, the signal processing module adds the operating system and application program from HASH, completes the initialization of the main processing chip and the configuration of the peripheral hardware, and then completes the initialization of each subsystem, and finally enters the normal state. Working status. When you use it for the first time, register your family member's face.

(2) The main processor end of the main processing chip continuously collects the audio and video signals and the pyroelectric infrared detection signals of the monitoring site, and simultaneously receives the alarm signals of other distributed alarm sensors through the wireless receiving module, and sends the multi-source data into the processing. The analyzer performs analysis and simultaneously performs audio and video pre-recording. If an alarm or warning signal is received from the processor, the pre-recorded audio and video, together with the captured photo, is sent to the cell monitoring center or the mobile phone of the household owner through the alarm signal sending module, and the alarm device such as the sound and light alarm is activated. .

 (3) The main processing chip runs the intelligent audio and video analysis algorithm from the processor side, and analyzes from the perspective of video and audio respectively to find out whether there are sudden abnormal events such as falling for a long time, serious limb conflict, strangers entering the room illegally. Occurs, combined with other sensor alarm information, and uses decision fusion technology to obtain the final decision result, and sends the result to the main processor.

 (4) After receiving the alarm, the head of the household or the monitoring center can confirm the alarm information sent back, or open the voice intercom function, and talk with the indoor personnel to further understand the occurrence of sudden abnormal events.

 Product experiment

 Experimental environment and equipment

 Experimental site: 120 square meters 2 bedrooms 2 halls residential homes.

 Experimental equipment: (1) 1 camera carrying a sudden abnormal event alarm system; (2) 1 wireless magnetic detector; (3) 2 wireless glass break detectors; (4) Wireless smoke detector 1 (5) One wireless gas leakage sensor; (6) One mobile phone that installs the emergency abnormality alarm receiving processing software.

 As shown in Figure 11, a ceiling-type emergency alarm camera is installed in the living room, and a glass break detector, a gas leak detector, a smoke sensor, a door magnetic detector, and a wireless detector are installed in the bedroom, the kitchen, and the entrance door respectively. Communicate with the alarm camera, and connect the alarm alarm through the output port of the alarm camera 10.

 Test methods and results: sudden abnormalities test face method

 test results

 Condition Condition

 Simulated old people in the living room during the day, the siren screamed 101 times. Detection accuracy: between the room, the corner of the house, the door and window, etc. The phone receives the sound, Figure 98%;

 The position fell 100 times, view the hand piece alarm: 101 times, its false positive rate: 3%; the machine receives the alarm situation. Misreported 3 times, underreported 2 Missing rate:

 Times. 2% simulated old man night (light weak) Siren tweet 104 times. Detection accuracy: Turn on audio and video, drop

 In the middle of the living room, in the corner of the house, the phone receives the sound, Figure 97%;

 Inverted, infrared detection,

Falling down by doors and windows, etc. 100 pieces of alarm: 104 times, its false positive rate: 4%;

 Interference filtering algorithm.

 Times, check the mobile phone to receive the alarm. 4 false positives, false negatives 3 false negative rate: situation. Times. 3% Turn on the indoor TV, make the window, and the siren will sound 55 times. Detection accuracy: The curtain flutters, the dog runs indoors, the phone receives the sound, the picture is 94%;

 Motion and other interference phenomena. At the same time, the module alarm: 55 times, of which the false positive rate: 95%; the old man falls: 50 times. False positive 5 times, underreported 3 times false negative rate:

 6% severe physical rushing to start severe physical examination Simulated personnel conflict: 40 times The siren screamed 41 times. Detection accuracy: Detecting algorithm, vibration detection, receiving sound, mobile phone, figure 100%;

Measurement, infrared detection, film alarm: 41 times, of which the false positive rate: 2.5%; interference filtering and other miscalculations 1 time, missing 0 times false negative rate: law. 0% Illegal intrusion turns on intrusion detection, and the simulated thief screams 52 times from the door and window. Detection accuracy: Vibration detection, infrared into the room: 50 times. The phone receives the sound, the picture is 100%;

 Detection, interference filtering, slice alarm: 52 times, of which the false positive rate: 4%; and other algorithms. False positive 2 times, false negative 0 times false negative rate:

 0% Smoke Detection Turn on the smoke detector Simulate smoke indoors: The siren screams 19 times. Detection accuracy:

 20 times. The mobile phone receives the smoke SMS report 100%;

 Police: 19 times, of which false positives false positive rate: 0%; 0 times, missed one time, false negative rate:

 5% Gas Leakage Open Gas Leakage Simulation Simulate indoor gas production. The siren screams 10 times. Detection accuracy: Tester Leak: 10 times. The mobile phone receives a gas leak of 100% short;

 Letter alarm: 10 times, of which false positive rate: 0%; false positive 0 times, missing 0 times false negative rate:

 0% glass breakage open glass breakage simulation window glass broken: 10 sirens 10 times. Detection accuracy: Tester times. Mobile phone connected glass broken text message 100%;

 Alarm: 10 times, of which false positive rate: 0%; reported 0 times, missed 0 times, false negative rate:

 0% door magnetic detection Open door magnetic detection Simulate open the door to the home: 100 sirens 98 times. Detection accuracy: times. The mobile phone access door opens 98%;

 SMS alarm: 98 times, its false positive rate: 0%; misreported 0 times, missed 2 times, false negative rate:

 2% Explosion Turn on audio and video detection. Simulate indoor household appliances explosion. The siren screams 20 times. Detection accuracy: Measurement, vibration detection Sound: 20 times. Mobile phone connected to the room explosion SMS 100%;

 law. Alarm: 20 times, of which the false positive rate is: 0%;

 0 times, missed 0 times, false negative rate:

 0% emergency button Turn on emergency call function Press the emergency button at intervals: 50 Emergency call: 20 Detected accurately: times. Times, of which 0 is falsely reported and 100% is missed;

 Report 0 times false positive rate:

 0%;

 Reporting rate: 0% Test conclusion: In the indoor environment, the test results are consistent with the test expectations, and the function and performance are in full compliance with the product design requirements.

 The invention has the following advantages:

 Advantage 1: Strong function and wide application. The product can detect almost all abnormal events in the room, especially the high-precision fall detection can be widely used for the supervision of elderly people living alone.

 Advantage 2: The false positive rate is low. Built-in powerful false alarm filtering algorithm, which filters the sudden abnormal events caused by indoor ambient light changes, curtains, and pets.

 Advantage 3: The alarm is timely, the alarm information is intuitive and flexible, and it can be audio, video or picture.

Advantage 4: The equipment is easy to use, install and maintain. With wireless transmission, the wiring is simple and easy to use and maintain. Advantage 5: It can be used without interruption. Even if the power is cut off, the built-in battery can be automatically turned on and continue to be used.

 Although the present invention has been described herein with reference to the various embodiments of the present invention, it is understood that many modifications and embodiments may be Within the scope and spirit of the principle. More specifically, various variations and modifications can be made in the component parts and/or arrangements of the subject combination arrangement within the scope of the present disclosure, the drawings and the claims. In addition to variations and modifications to the components and/or arrangements, other uses will be apparent to those skilled in the art.

Claims

Rights request
 1. An intelligent identification and alarm device for sudden abnormal events, comprising a video acquisition module, a comprehensive information collection module, an alarm transmission module, and a signal processing module, wherein the video collection module collects surrounding video information, and the comprehensive information collection module collects surrounding information in real time. a signal, and the video information and the surrounding signal real-time rumor processing module; wherein: the signal processing module processes and analyzes an image in the video information, and uses a background image in the video information Removing, implementing image recognition in the video information;
 According to the image recognition result, the signal processing module combines the surrounding signals to comprehensively analyze and identify whether the current event is a sudden abnormal event, complete the resolution of the sudden abnormal event, thereby determining whether to activate the alarm sending module, and issue an alarm. signal.
 2. The alarm device of claim 1 wherein:
 A supplemental illumination module is further included. When the video acquisition module performs video acquisition, the supplemental illumination module is automatically activated when the ambient illumination is insufficient, and the auxiliary illumination source is provided for the video acquisition module.
 3. An alarm device according to any of claims 1 or 2, characterized in that:
 a power management module is further provided, and the alarm device is powered, and the power management module is connected to an external power source and a battery;
 When the external power supply is normally powered, the entire product uses an external power supply;
 When the external power source is turned off, the battery is automatically enabled to supply power to the alarm device.
 4. An alarm device according to any of claims 1-3, characterized in that:
 The integrated information collection module includes one or more modules of an audio collection module, a heat release infrared detection module, a vibration detection module, a glass break detection module, a door magnetic detection module, a smoke detector module, and a gas detector module; The heat release infrared detecting module detects difference information of temperature and background temperature in the surrounding space, and converts the information into a voltage signal;
 The vibration detecting module detects a vibration condition in a surrounding space and converts into a voltage signal;
 The glass breakage detecting module and the door magnetic detecting module detect broken sound and door magnetic change information of the surrounding glass and convert into a voltage signal;
 The ambient signal collected by the integrated information collection module includes voice information collected by the audio collection module, information detected by the smoke detector module and the gas detector module, the heat release infrared detection module, and vibration detection. The voltage signal detected by the module, the glass breakage detection module and the door magnetization detection module.
 5. An alarm device according to any of claims 1-4, characterized in that:
 The signal processing module includes a main processing chip that employs a dual core architecture mode in which the main core processor and the slave core processor are combined.
 6. A sudden abnormal event intelligent identification alarm system, the system comprising a storage module and an alarm device according to any one of claims 1-5; the storage module and the alarm device by wired or wireless communication Establishing a communication connection, and storing information collected by the alarm device;
 It is characterized by:
 The distinguishing the abnormality event includes processing, analyzing, and identifying the image in the video information; and analyzing the surrounding signal that is synchronously collected by the integrated information collecting module;
 The signal processing module completes the identification of the current event based on the processing, analysis, identification, and analysis of the surrounding signal in the video information, and realizes the resolution of the sudden abnormal event, thereby determining whether to activate the alarm. Send module, send out an alarm signal.
 7. The alarm system of claim 6 wherein:
 The synchronization means that the video information and the surrounding signals are collected and analyzed simultaneously at the same time.
 8. The alarm system of claim 6 wherein:
 The alarm system further includes a face database and a face registration module, and the feature of the standardized face image is extracted by the face registration module, and is entered and registered in the face database;
 The processing, analysis, and identification of the image in the video information includes determining the identity of the person in the video information by face recognition.
 9. The alarm system of claim 8 wherein:
In the face recognition, the face recognition is performed by using the HAAR feature combined with the adaboost algorithm for face detection; the two-layer human eye locator is used to obtain the human eye positioning through the adaboost algorithm, and the face positioning result is used to pass the image. Rotation corrects both eyes to level to achieve face normalization;
 Feature extraction is performed by two-dimensional Gabor filter, and the covariance distance between vectors is used as the matching metric. The nearest neighbor classification method is used to match the face image to be recognized with the face image in the face database.
 10. An alarm system according to any of claims 6-9, characterized in that:
 The processing of the video information includes removing a background image in the video information, leaving a foreground image.
PCT/CN2014/073260 2013-03-11 2014-03-11 Emergent abnormal event intelligent identification alarm device and system WO2014139416A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN 201310075931 CN103198605A (en) 2013-03-11 2013-03-11 Indoor emergent abnormal event alarm system
CN201310075931.3 2013-03-11

Publications (1)

Publication Number Publication Date
WO2014139416A1 true WO2014139416A1 (en) 2014-09-18

Family

ID=48721094

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/073260 WO2014139416A1 (en) 2013-03-11 2014-03-11 Emergent abnormal event intelligent identification alarm device and system

Country Status (2)

Country Link
CN (2) CN103198605A (en)
WO (1) WO2014139416A1 (en)

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103198605A (en) * 2013-03-11 2013-07-10 成都百威讯科技有限责任公司 Indoor emergent abnormal event alarm system
CN103240551B (en) * 2013-05-23 2015-06-24 北京斯达峰控制技术有限公司 Method, device and system for controlling numerically controlled welding speed
CN103327122B (en) * 2013-07-11 2016-09-07 北京信息科技大学 A kind of intelligent remote monitoring system
CN103354006A (en) * 2013-07-23 2013-10-16 深圳辉锐天眼科技有限公司 Networking alarm service system and hardware equipment arrangement method thereof
CN103605951A (en) * 2013-09-11 2014-02-26 中科润程(北京)物联科技有限责任公司 Novel behavior characteristic identification algorithm for vibration intrusion detection
CN103607534A (en) * 2013-12-12 2014-02-26 湖南理工学院 Integrated fisheye camera with seamless intelligent monitoring and alarming functions
CN104252775A (en) * 2013-12-20 2014-12-31 上海通富立信息科技有限公司 Real-time video and voice emergency warning device and method thereof
CN103677275A (en) * 2013-12-31 2014-03-26 福建创高安防技术有限公司 Wireless alarm with gesture recognition function
CN104954543A (en) * 2014-03-31 2015-09-30 小米科技有限责任公司 Automatic alarm method and device and mobile terminal
CN103984315A (en) * 2014-05-15 2014-08-13 成都百威讯科技有限责任公司 Domestic multifunctional intelligent robot
CN104008627A (en) * 2014-05-22 2014-08-27 四川和芯微电子股份有限公司 Monitoring system
CN104077899A (en) * 2014-06-25 2014-10-01 深圳中视康科技有限公司 Wireless alarm device
CN104268963A (en) * 2014-08-06 2015-01-07 成都百威讯科技有限责任公司 Intelligent door lock system, intelligent door lock and intelligent alarm door
CN104240418B (en) * 2014-09-22 2019-03-22 无锡物联网产业研究院 A kind of signal processing method and warning device
CN105512602A (en) * 2014-10-16 2016-04-20 南京索酷信息科技有限公司 Method of applying face recognition based on global and local features to smart community
CN104394359A (en) * 2014-11-05 2015-03-04 浪潮(北京)电子信息产业有限公司 Security monitoring method and system based on infrared and face recognition technologies
CN104601369A (en) * 2014-12-15 2015-05-06 中电长城网际系统应用有限公司 Alarm method, device and system for IT (information technology) operation and maintenance
CN104581047A (en) * 2014-12-15 2015-04-29 苏州福丰科技有限公司 Three-dimensional face recognition method for supervisory video recording
CN104598878A (en) * 2015-01-07 2015-05-06 深圳市唯特视科技有限公司 Multi-modal face recognition device and method based on multi-layer fusion of gray level and depth information
CN104660991B (en) * 2015-02-02 2017-12-05 上海理工大学 Indoor video monitoring system
CN104992708B (en) * 2015-05-11 2018-07-24 国家计算机网络与信息安全管理中心 Specific audio detection model generation in short-term and detection method
CN104935886A (en) * 2015-06-09 2015-09-23 宁夏大学 Indoor intelligent video monitoring system based on SOPC
EP3311334A4 (en) * 2015-06-18 2019-08-07 Wizr Cloud platform with multi camera synchronization
CN104978817A (en) * 2015-06-25 2015-10-14 苏州昊枫环保科技有限公司 Indoor safety anti-theft monitoring system
CN105042447B (en) * 2015-08-05 2017-11-03 上海宇芯科技有限公司 Intelligent anti-terror street lamp and method for safety monitoring
CN105100724B (en) * 2015-08-13 2018-06-19 电子科技大学 A kind of smart home telesecurity monitoring method of view-based access control model analysis
CN105225392A (en) * 2015-08-26 2016-01-06 潘玲玉 A kind of active Domestic anti-theft denial system
CN105118226A (en) * 2015-09-27 2015-12-02 电子科技大学中山学院 IoT protection device based on monitoring
CN105451235A (en) * 2015-11-13 2016-03-30 大连理工大学 Wireless sensor network intrusion detection method based on background updating
WO2017132930A1 (en) * 2016-02-04 2017-08-10 武克易 Internet of things smart caregiving method
CN107221133B (en) * 2016-03-22 2018-12-11 杭州海康威视数字技术股份有限公司 A kind of area monitoring alarm system and alarm method
CN105760861A (en) * 2016-03-29 2016-07-13 华东师范大学 Epileptic seizure monitoring method and system based on depth data
CN108304827A (en) * 2016-04-01 2018-07-20 张海东 Automate facial-recognition security systems
CN106056836A (en) * 2016-08-16 2016-10-26 哈尔滨理工大学 Home security system
CN106327738B (en) * 2016-08-26 2017-11-24 特斯联(北京)科技有限公司 A kind of intelligent hierarchical monitoring system
CN106377265A (en) * 2016-09-21 2017-02-08 俞大海 Behavior detection system based on depth image and eye movement watching information
CN106331648A (en) * 2016-09-27 2017-01-11 北海益生源农贸有限责任公司 Remote security protection monitoring system and method
CN106530585A (en) * 2016-11-02 2017-03-22 南阳盛世光明软件有限公司 Fire-fighting probe based on mobile induction positioning and mobile terminal feature code acquisition
CN106325190A (en) * 2016-11-09 2017-01-11 柏海蛟 Intelligent aquaculture system and method
CN108074381B (en) * 2016-11-10 2019-09-10 杭州海康威视系统技术有限公司 Alarm method, apparatus and system
CN106601271A (en) * 2016-12-16 2017-04-26 北京灵众博通科技有限公司 Voice abnormal signal detection system
CN106599865A (en) * 2016-12-21 2017-04-26 四川华雁信息产业股份有限公司 Disconnecting link state recognition device and method
CN106683328A (en) * 2016-12-30 2017-05-17 安徽杰瑞信息科技有限公司 Household security system
CN106846713A (en) * 2017-03-22 2017-06-13 清华大学合肥公共安全研究院 A kind of smart city warning system for public security
CN107123219A (en) * 2017-06-02 2017-09-01 安徽福讯信息技术有限公司 A kind of household safety-protection integrated system based on Internet of Things
CN107289586A (en) * 2017-06-15 2017-10-24 广东美的制冷设备有限公司 Air-conditioning system, air conditioner and the method that tumble alarm is carried out by air-conditioning system
CN107067640A (en) * 2017-06-20 2017-08-18 合肥博之泰电子科技有限公司 A kind of intellectual communityintellectualized village's safety protecting method and system
CN107515596A (en) * 2017-07-25 2017-12-26 北京航空航天大学 A kind of statistical process control method for becoming the monitoring of window defect based on view data
CN107564226A (en) * 2017-09-25 2018-01-09 珠海市领创智能物联网研究院有限公司 A kind of smart home security system
CN107917342A (en) * 2017-11-15 2018-04-17 北京科创三思科技发展有限公司 The unattended Sound image localization monitoring system and method for natural gas station
CN108091092A (en) * 2018-01-24 2018-05-29 上海胜战科技发展有限公司 A kind of intelligent safety and defence system based on network security chip
CN108399700A (en) * 2018-01-31 2018-08-14 上海乐愚智能科技有限公司 Theft preventing method and smart machine
CN108492518A (en) * 2018-03-01 2018-09-04 上海市保安服务总公司 Intelligent safety and defence system
CN108460360B (en) * 2018-03-23 2019-03-01 深兰科技(上海)有限公司 Device distribution image-recognizing method
CN108694796A (en) * 2018-06-04 2018-10-23 四川斐讯信息技术有限公司 Security audit pre-warning system and its method are realized based on router and smart home
CN108985266A (en) * 2018-08-14 2018-12-11 刘纪君 House forms image pickup driving
CN109087477A (en) * 2018-08-17 2018-12-25 穗阳软件技术有限公司 The boundary partitioning device in region can be divided

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN200990672Y (en) * 2006-12-26 2007-12-12 黄德胜 Long-distance monitoring device
CN101227600A (en) * 2008-02-02 2008-07-23 北京海鑫科金高科技股份有限公司 Intelligent monitoring apparatus and method for self-service bank and ATM
US20090045949A1 (en) * 2007-08-14 2009-02-19 Miller Landon C G Pattern Driven Effectuator System
CN101609588A (en) * 2008-06-16 2009-12-23 云南正卓信息技术有限公司 Full-automatic anti-intrusion intelligent video monitoring alarm system for unattended villa
CN103198605A (en) * 2013-03-11 2013-07-10 成都百威讯科技有限责任公司 Indoor emergent abnormal event alarm system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090195382A1 (en) * 2008-01-31 2009-08-06 Sensormatic Electronics Corporation Video sensor and alarm system and method with object and event classification
JP2010176177A (en) * 2009-01-27 2010-08-12 Panasonic Electric Works Co Ltd Load control system
CN201298284Y (en) * 2009-02-04 2009-08-26 健 秦 Wireless video alarm for safety guard
CN201965714U (en) * 2010-12-29 2011-09-07 吴晓航 Home intelligent early-warning security system based on human face recognition

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN200990672Y (en) * 2006-12-26 2007-12-12 黄德胜 Long-distance monitoring device
US20090045949A1 (en) * 2007-08-14 2009-02-19 Miller Landon C G Pattern Driven Effectuator System
CN101227600A (en) * 2008-02-02 2008-07-23 北京海鑫科金高科技股份有限公司 Intelligent monitoring apparatus and method for self-service bank and ATM
CN101609588A (en) * 2008-06-16 2009-12-23 云南正卓信息技术有限公司 Full-automatic anti-intrusion intelligent video monitoring alarm system for unattended villa
CN103198605A (en) * 2013-03-11 2013-07-10 成都百威讯科技有限责任公司 Indoor emergent abnormal event alarm system

Also Published As

Publication number Publication date
CN103198605A (en) 2013-07-10
CN103839373B (en) 2016-08-17
CN103839373A (en) 2014-06-04

Similar Documents

Publication Publication Date Title
US8036425B2 (en) Neural network-controlled automatic tracking and recognizing system and method
Zhou et al. Activity analysis, summarization, and visualization for indoor human activity monitoring
Yu et al. A posture recognition-based fall detection system for monitoring an elderly person in a smart home environment
US20040161133A1 (en) System and method for video content analysis-based detection, surveillance and alarm management
US9338409B2 (en) System and method for home health care monitoring
US20040240542A1 (en) Method and apparatus for video frame sequence-based object tracking
Zajdel et al. CASSANDRA: audio-video sensor fusion for aggression detection
CN202976256U (en) Intelligent entrance guard control system
Benezeth et al. Towards a sensor for detecting human presence and characterizing activity
US8605155B2 (en) Video surveillance system
US20050168574A1 (en) Video-based passback event detection
Cardinaux et al. Video based technology for ambient assisted living: A review of the literature
JP2011523106A (en) Image sensor, alarm system and method for classifying objects and events
JP2007512738A (en) Video surveillance line system, initial setting method, computer-readable storage medium, and video surveillance method
Gill et al. A system for change detection and human recognition in voxel space using the Microsoft Kinect sensor
US7504942B2 (en) Local verification systems and methods for security monitoring
US8908034B2 (en) Surveillance systems and methods to monitor, recognize, track objects and unusual activities in real time within user defined boundaries in an area
CN100504942C (en) Module set of intelligent video monitoring device, system and monitoring method
CN100585656C (en) An all-weather intelligent video analysis monitoring method based on a rule
WO2004003848A9 (en) Video surveillance with probabilistic modelling of human behaviour
CN101465033B (en) Automatic tracking recognition system and method
CN101068342A (en) Video frequency motion target close-up trace monitoring method based on double-camera head linkage structure
CN101577812B (en) Method and system for post monitoring
CN101032405A (en) Safe driving auxiliary device based on omnidirectional computer vision
CN102089770A (en) Apparatus and method of classifying movement of objects in a monitoring zone

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14762588

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC

122 Ep: pct application non-entry in european phase

Ref document number: 14762588

Country of ref document: EP

Kind code of ref document: A1