EP3155600A1 - Erkennung des zustandes eines geländes unter verwendung von audioanalytik - Google Patents

Erkennung des zustandes eines geländes unter verwendung von audioanalytik

Info

Publication number
EP3155600A1
EP3155600A1 EP15807201.7A EP15807201A EP3155600A1 EP 3155600 A1 EP3155600 A1 EP 3155600A1 EP 15807201 A EP15807201 A EP 15807201A EP 3155600 A1 EP3155600 A1 EP 3155600A1
Authority
EP
European Patent Office
Prior art keywords
sound
sounds
microphone
class
detecting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP15807201.7A
Other languages
English (en)
French (fr)
Other versions
EP3155600A4 (de
Inventor
Michael David Child
Jeremy B. Warren
James E. NYE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivint Inc
Original Assignee
Vivint Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/304,644 external-priority patent/US10922935B2/en
Priority claimed from US14/316,597 external-priority patent/US9454882B2/en
Application filed by Vivint Inc filed Critical Vivint Inc
Publication of EP3155600A1 publication Critical patent/EP3155600A1/de
Publication of EP3155600A4 publication Critical patent/EP3155600A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B19/00Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/02Mechanical actuation
    • G08B13/04Mechanical actuation by breaking of glass
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/16Actuation by interference with mechanical vibrations in air or other fluid
    • G08B13/1654Actuation by interference with mechanical vibrations in air or other fluid using passive vibration detection systems
    • G08B13/1672Actuation by interference with mechanical vibrations in air or other fluid using passive vibration detection systems using sonic detecting means, e.g. a microphone operating in the audio frequency range
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/04Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • G08B21/043Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • G08B21/04Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0438Sensor means for detecting
    • G08B21/0469Presence detectors to detect unsafe condition, e.g. infrared sensor, microphone
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/006Alarm destination chosen according to type of event, e.g. in case of fire phone the fire service, in case of medical emergency phone the ambulance
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B29/00Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
    • G08B29/18Prevention or correction of operating errors
    • G08B29/185Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
    • G08B29/188Data fusion; cooperative systems, e.g. voting among different detectors
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78Detection of presence or absence of voice signals

Definitions

  • the security system component 104-a may include an ability to detect sounds from the ambient environment. Such a capability may include the ability to determine attributes about the detected sounds. For example, the security system component 104-a can determine the waveform generated by the sound, the pitch of the sound, the amplitude of the sound, decibel level of the sound, the reflection characteristics of the sound, the period of the sound' s wavelength cycle, the acoustic pressure of the sound, the intensity of the sound, the speed of the sound, the direction of the sound, other attributes of the sound, or combinations thereof.
  • the attributes of the sound can be used to determine the sound's source and to recognize the type of sound.
  • the sound of an automobile driving by the home may be detected by the security system component 104-a.
  • the security system component 104-a may analyze the detected sound' s attributes, such as frequency and amplitude. Such attributes may be compared to sound signatures stored in a sound library within the security system component 104-a to determine if there is a correlation between the sound attributes and one of the stored sound signatures. If there appears to be a strong enough correlation, the security system component 104-a may conclude that the sound belongs to a particular recognized class of sounds.
  • the security system component 104-a may include signatures to sound sources that should not trigger a predetermined response, but may be confused with similar types of sounds that come from sources that should trigger a predetermined response.
  • FIG. 2 is a block diagram illustrating one example of a control unit 102-b.
  • the control unit 102-b has a class recognition module 200-a and a response module 202-a.
  • the camera module 300 may include specific predetermined responses associated with the receipt of a recognized class, the camera module 300 may also include the ability to make dynamic decisions depending on the situation. For example, if the predetermined response is to turn on the camera, the camera module may make additional decisions beyond the predetermined response as appropriate. Such additional decisions may include zooming, panning, trucking, tilting, or otherwise controlling the camera' s field of view if the camera' s or the control unit' s logic determines that the field of view could be positioned differently to get more useful information.
  • the video camera may detect the presence of a hazard, such as a fire, flooding, an intruder, other hazards, or combinations thereof. In response to such detections, the camera module 300 may cause additional types of appropriate predetermined responses to occur.
  • the health condition module 304 may be notified to summon the medical assistance.
  • Sounds that may be assigned to such a recognized class include choking sounds, falling sounds, yelling sounds, explosion sounds, gunshot sounds, other types of sounds, or combinations thereof.
  • the sounds indicate that there is a potential danger to the medical personnel, like explosion or gunshot sounds, the medical personnel may still be notified and allow the medical personnel to be aware that their services may be requested. The medical personnel can coordinate their rescue efforts with the appropriate rescue agency.
  • the communications module 404 communicates with the control unit 102. Such communications may be wireless communications or wired communications.
  • the communications module 404 may send the identified recognized class to the control unit 102, where the control unit 102 can make a decision about how to respond to the recognized class.
  • the analysis for determining the sound's recognized class is performed at the security system component 104-b and the decision for how to respond to the recognized class is performed at the control unit 102.
  • glass break detectors may be located in an area of a home or business where people and/or animals may pass through. Such a glass break detector may monitor for sounds generated by passing people and/or animals.
  • a glass break detector may be mounted near a window located relative to a family room of a home. Such a home may include a number of human occupants and a pet. Glass break detectors may detect sounds generated by both the occupants as well as the pet.
  • a glass break detector may be configured to identify human-generated sounds and animal-generated sounds.
  • Examples of the device 605 may include any combination of a microphone, a glass break sensor, mobile devices, smart phones, personal computing devices, computers, laptops, desktops, servers, media content set top boxes, satellite set top boxes, cable set top boxes, DVRs, personal video recorders (PVRs), etc.
  • device 605 may include a building automation controller integrated within device 605, or as depicted, may be in communication with an automation controller via network 615.
  • Examples of the automation controller 655 may include any device configured to control a building such as a home, a business, a government facility, etc. Accordingly, examples of automation controller 655 include any combination of a dedicated building automation computing device (e.g. , wall-mounted controller), a personal computing device (e.g.
  • server 610 may be coupled to database 620.
  • Database 620 may be internal or external to the server 610.
  • device 605 may be coupled directly to database 620 or a database similar to database 620.
  • database 620 may be internal or external to device 605.
  • Database 620 may include sounds data 660.
  • device 605 may access sounds data 660 in database 620 over network 615 via server 610.
  • Sounds data 660 may include data regarding algorithms for identifying sounds (e.g. , signal transforms such as DCTs, FFTs, etc.) such as algorithms for detecting human voice patterns, algorithms for detecting human footsteps, algorithms for detecting animal sounds, algorithms for detecting animal footsteps, etc.
  • sounds data 660 may include algorithms for distinguishing between footsteps of bipeds (e.g. , humans) and quadrupeds (e.g. , a pet dog, a pet cat, etc.).
  • Sounds data 660 may include human speech signatures, human footstep signatures, signatures for one or more animals sounds (e.g. , dog bark, cat meow, bird chirp, etc.).
  • a sound detected in the building may be compared to a signature stored in database 620, and upon detecting a match, identifying the source of the sound as human and/or from a pet.
  • sounds data 660 may include samples of human speech, samples of animal sounds, and the like.
  • FIG. 7 is a block diagram illustrating one example of an occupancy detection module 645-a.
  • Occupancy detection module 645-a may be one example of occupancy detection module 645 depicted in FIG. 6.
  • occupancy detection module 645-a may include monitoring module 705, a sound identification module 710, a motion detection module 715, a sound categorization module 720, and a notification module 725.
  • glass break sensors 830- 1 may be installed in relation to window 815
  • glass break sensors 830-2 may be installed in relation to window 820
  • glass break sensors 830-3 may be installed in relation to window 825
  • building 805 may include a motion sensor 835.
  • the method 900 includes detecting 902 a sound with a security system component, determining 904 with a security system component whether the sound belongs to a recognized class of sounds, and sending 906 the recognized class to a remote control unit.
  • a method 900 may be implemented with a security system component 104 shown in FIGS. 1 and/or 4.
  • method 900 may be performed generally by the environment 100 shown in FIG. 1.
  • a sound is detected with the security system component 104.
  • Such a sound may be a sound that indicates a condition on the premise where some kind of predetermined response is desirable.
  • any appropriate mechanism for determining recognized classes and executing predetermined responses may be implemented according to the principles described herein.
  • the method 1 100 may evaluate the sound against the criteria of each recognized class in any appropriate order. Further, more or less recognized classes may be considered than depicted in the example of FIG. 1 1.
  • the examples above identify a single predetermined response for specific recognized classes, any appropriate number of predetermined responses and any appropriate type of predetermined response may be used in accordance with the principles described herein.
  • a detected sound may belong to more than one recognized class. As such, the detected sound may be compared to multiple recognized classes, even if the sound characteristics already satisfy the requisite conditions to fall within one of the recognized classes.
  • FIG. 14 Many other devices or subsystems (not shown) may be connected in a similar manner (e.g., entertainment system, computing device, remote cameras, wireless key fob, wall mounted user interface device, cell radio module, battery, alarm siren, door lock, lighting system, thermostat, home appliance monitor, utility equipment monitor, and so on).
  • All of the devices shown in FIG. 14 need not be present to practice the present systems and methods.
  • the devices and subsystems can be interconnected in different ways from that shown in FIG. 14. The aspect of some operations of a system such as that shown in FIG. 14 are readily known in the art and are not discussed in detail in this application.
  • Code to implement the present disclosure can be stored in a non-transitory computer-readable medium such as one or more of system memory 1415 or fixed disk 1475.
  • the operating system provided on controller 1400 may be iOS ® , ANDROID ® , MS-DOS ® , MS-WINDOWS ® , OS/2 ® , UNIX ® , LINUX ® , or another known operating system.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Alarm Systems (AREA)
EP15807201.7A 2014-06-13 2015-06-10 Erkennung des zustandes eines geländes unter verwendung von audioanalytik Withdrawn EP3155600A4 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/304,644 US10922935B2 (en) 2014-06-13 2014-06-13 Detecting a premise condition using audio analytics
US14/316,597 US9454882B2 (en) 2014-06-26 2014-06-26 Verifying occupancy of a building
PCT/US2015/035119 WO2015191722A1 (en) 2014-06-13 2015-06-10 Detecting a premise condition using audio analytics

Publications (2)

Publication Number Publication Date
EP3155600A1 true EP3155600A1 (de) 2017-04-19
EP3155600A4 EP3155600A4 (de) 2018-02-28

Family

ID=54834249

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15807201.7A Withdrawn EP3155600A4 (de) 2014-06-13 2015-06-10 Erkennung des zustandes eines geländes unter verwendung von audioanalytik

Country Status (3)

Country Link
EP (1) EP3155600A4 (de)
CA (1) CA2949370A1 (de)
WO (1) WO2015191722A1 (de)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10745263B2 (en) 2015-05-28 2020-08-18 Sonicu, Llc Container fill level indication system using a machine learning algorithm
US10746586B2 (en) 2015-05-28 2020-08-18 Sonicu, Llc Tank-in-tank container fill level indicator
ES2574091A1 (es) * 2016-01-19 2016-06-14 Smart Things And Friends, S.L. Procedimiento y dispositivo de análisis, discriminación y gestión de sonido ambiental
CN107767880B (zh) * 2016-08-16 2021-04-16 杭州萤石网络有限公司 一种语音检测方法、摄像机和智能家居看护系统
US10257629B2 (en) * 2017-04-18 2019-04-09 Vivint, Inc. Event detection by microphone
US10558917B2 (en) * 2017-04-20 2020-02-11 Tyco Fire & Security Gmbh Artificial intelligence and natural language processing based building and fire systems management system
DE102017109012A1 (de) * 2017-04-27 2018-10-31 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Verfahren zum Schutz von Fahrzeuginsassen
US20190139565A1 (en) * 2017-11-08 2019-05-09 Honeywell International Inc. Intelligent sound classification and alerting
CN107942709B (zh) * 2017-12-21 2023-10-31 华南理工大学广州学院 一种智能家居控制系统及其控制方法
EP3667629B1 (de) 2018-12-14 2022-12-07 Carrier Corporation Vorrichtung und verfahren zum testen eines glasbruchdetektionssystems
EP3723456A1 (de) * 2019-04-11 2020-10-14 Cowhill Studio BV VOF Altenpflege- und sicherheitssystem
WO2021063951A1 (de) * 2019-09-30 2021-04-08 Truck Norris GmbH Verfahren und vorrichtung zur erkennung einer unbefugten manipulation an einem gegenstand oder einem raum
US20210344798A1 (en) * 2020-05-01 2021-11-04 Walla Technologies Llc Insurance information systems
CN113947855A (zh) * 2021-09-18 2022-01-18 中标慧安信息技术股份有限公司 一种基于语音识别的智能楼宇人员安全报警系统
DK202370292A1 (en) * 2022-06-14 2024-02-14 Pressalit As A management system for monitoring a facility, a method and use therefore and a facility

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6204760B1 (en) * 1998-01-30 2001-03-20 Interactive Technologies, Inc. Security system for a building complex having multiple units
US6134303A (en) * 1999-01-20 2000-10-17 Tempa Communication Inc. United home security system
US6215404B1 (en) * 1999-03-24 2001-04-10 Fernando Morales Network audio-link fire alarm monitoring system and method
US6850601B2 (en) * 2002-05-22 2005-02-01 Sentinel Vision, Inc. Condition detection and notification systems and methods
US7173525B2 (en) * 2004-07-23 2007-02-06 Innovalarm Corporation Enhanced fire, safety, security and health monitoring and alarm response method, system and device
US20070183604A1 (en) * 2006-02-09 2007-08-09 St-Infonox Response to anomalous acoustic environments
US9025779B2 (en) * 2011-08-08 2015-05-05 Cisco Technology, Inc. System and method for using endpoints to provide sound monitoring
DE102012211154B4 (de) * 2012-06-28 2019-02-14 Robert Bosch Gmbh Überwachungssystem, Freiflächenüberwachung sowie Verfahren zur Überwachung eines Überwachungsbereichs

Also Published As

Publication number Publication date
CA2949370A1 (en) 2015-12-17
EP3155600A4 (de) 2018-02-28
WO2015191722A1 (en) 2015-12-17

Similar Documents

Publication Publication Date Title
US10922935B2 (en) Detecting a premise condition using audio analytics
WO2015191722A1 (en) Detecting a premise condition using audio analytics
US10522012B1 (en) Verifying occupancy of a building
US10665072B1 (en) Sensor to characterize the behavior of a visitor or a notable event
US10807563B1 (en) Premises security
US11196907B1 (en) Automatic greetings by outdoor IP security cameras
US11183037B2 (en) Street watch
US10861305B2 (en) Drone enabled street watch
US20220301401A1 (en) Control access utilizing video analytics
US10803720B2 (en) Intelligent smoke sensor with audio-video verification
US9870694B2 (en) Networked security cameras and automation
US10986717B1 (en) Reduced false alarms for outdoor IP security cameras
US9542832B1 (en) eReceptionist and eNeighborhood watch system for crime prevention and/or verification
EP3483851B1 (de) Intelligente klangklassifizierung und alarmierung
CN116457851B (zh) 用于地产监控的系统和方法
US10212778B1 (en) Face recognition systems with external stimulus
GB2520099A (en) Intruder detection method and system
CN102411833A (zh) 基于音频识别的联网报警装置
US20190180735A1 (en) Ambient sound classification based message routing for local security and remote internet query systems
US10798506B2 (en) Event detection by microphone
JP2022507973A (ja) スマート障壁警報デバイス
US20150379111A1 (en) Crowdsourcing automation sensor data
WO2018106437A2 (en) Street watch
EP3301656A2 (de) System und verfahren für ein alarmsystem
EP3598404A1 (de) Verfahren zum betrieb eines alarmsystems für ein gebäude, alarmsystem für ein gebäude und alarmanlage

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170109

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20180131

RIC1 Information provided on ipc code assigned before grant

Ipc: G08B 3/00 20060101ALI20180125BHEP

Ipc: G08B 21/04 20060101ALI20180125BHEP

Ipc: G10L 15/00 20130101ALI20180125BHEP

Ipc: G08B 13/04 20060101ALI20180125BHEP

Ipc: G08B 13/196 20060101ALI20180125BHEP

Ipc: G08B 13/16 20060101AFI20180125BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200207

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20200618