WO2008016360A1 - Video surveillance system and method with combined video and audio recognition - Google Patents
Video surveillance system and method with combined video and audio recognition Download PDFInfo
- Publication number
- WO2008016360A1 WO2008016360A1 PCT/US2006/030560 US2006030560W WO2008016360A1 WO 2008016360 A1 WO2008016360 A1 WO 2008016360A1 US 2006030560 W US2006030560 W US 2006030560W WO 2008016360 A1 WO2008016360 A1 WO 2008016360A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- audio
- recognition
- signals
- information
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/16—Actuation by interference with mechanical vibrations in air or other fluid
- G08B13/1654—Actuation by interference with mechanical vibrations in air or other fluid using passive vibration detection systems
- G08B13/1672—Actuation by interference with mechanical vibrations in air or other fluid using passive vibration detection systems using sonic detecting means, e.g. a microphone operating in the audio frequency range
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B19/00—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B31/00—Predictive alarm systems characterised by extrapolation or other computation using updated historic data
Definitions
- the present invention generally relates to surveillance systems and methods for providing security, and, more particularly to a novel on-line (real-time) video and audio recognition system and process for surveillance systems.
- a smart surveillance engine in this case will recognize (with some level of success which is less than 100%) fast sudden motion and generate an alarm at the monitoring station.
- Police forces can be dispatched to the monitored location as a consequence of such an alarm.
- fast sudden motion could have been generated by a child running towards his/her parent/friend and in this case the generated alarm becomes a false alarm which will cause an expensive dispatch of the police force.
- Another outcome of smart surveillance engine misdetection is an absence of alarm generation in case of a real emergency. This case may arise, for example, when there is more than one person at the scene. Not sending a police force when the true emergency situation is taking place is yet another drawback of current surveillance systems.
- FIG. 1 Prior art video-only surveillance system is depicted in Figure 1.
- a camera array 10 feeds video information into a video compression engine 12 through video link 11.
- the video information is compressed and sent through link 16 to a storage device 14 for a long-term storing.
- Video information is additionally fed to video recognition engine 13 through the same video link 11.
- Video recognition engine 13 performs video recognition tasks, such as face recognition, motion detection and others, and generates events and alarms that are sent through link 17 to an events data base 15 and monitoring station 18.
- Monitoring station 18 may comprise a manned monitoring station whereby an operator performs real-time visual monitoring of a particular amount of cameras. When an emergency situation takes place, as interpreted by the operator, it is his/her decision whether or not to dispatch a police force or other emergency response team to the monitored area. It is clear from the above description that there is no use of audio information although such information is very often available at the monitored area.
- FIG. 1 Prior Art video surveillance system with audio recording is shown in Figure 2.
- Camera array 20 feeds video information into video and audio compression engine 22 through video link 21.
- audio information is fed from microphone array 29 through audio link 30 to the video and audio compression engine 22.
- the video and audio information is compressed and sent through link 26 to a storage device 24 for a long-term storing.
- Video info ⁇ nation is similarly fed to the video recognition engine 23 through the same video link 21.
- Video recognition engine 23 performs video recognition tasks, such as face recognition, motion detection and others, and generates events and alarms that are sent through link 27 to a database 25 and monitoring station 28.
- Monitoring station 28 is a manned monitoring station whereby an operator performs visual monitoring of a particular amount of cameras.
- the surveillance system of the invention includes both video and audio signal inputs.
- Video inputs are sourced from digital or analog cameras and audio inputs are received from microphones installed at a monitored area.
- Video and audio information is compressed and sent to a digital storage device. Compression of the aitdio and video information is preferred in order to save amount of digital storage required for all cameras and microphones implemented.
- video and audio inputs are fed into a smart recognition engine that performs video recognition, audio recognition and performs instantaneous correlation of the results from video-audio recognition for detecting/recognizing a particular set of events, indicative of a panic situation, e.g., high-pitch screaming voices, explosion, gun shots, etc.
- Ala ⁇ ns generated by the smart recognition engine may be sent to a monitoring station where a human operator decides whether to dispatch a police or emergency personnel to a monitored area.
- the smart recognition engine executes available video recognition algorithms, such as face recognition, motion detection, etc., as well as audio/speech recognition algorithms for speech recognition of a particular vocabulary ("Help", "Robbery”, etc.).
- the audio recognition engine may be trained to recognize special audio signals such as gun shots, explosions, etc. as well as high-pitch and other voice signatures indicative of an alarm or emergency situation.
- Directional audio information may then be delivered to a camera control unit for directing a camera/cameras in the direction of interest. Further video/audio recognition may then be performed with better efficiency.
- an explosion sound may be detected by audio recognition engine using an array of microphones in a monitored area.
- cameras will be directed into explosion direction and follow-on actions will take place in the video recognition engine - from alarming the monitoring station up to scene recognition/understanding.
- a surveillance system and method, and computer program product comprising: a means for generating real-time video signals comprising video information taken over an area under surveillance; a means for obtaining real-time audio signals comprising audio information from the area under surveillance; a means for simultaneously receiving the video signals and audio signals, determining relevant video and audio recognition information therefrom, and mutually correlating the realtime audio and video information to determine likelihood of occurrence of a particular event; and, a means for generating an alarm condition based on occurrence of the particular event.
- Figure 1 illustrates a video only surveillance system according to the prior art
- Figure 2 illustrates a Video Surveillance System with Audio Recording capability according to the prior art
- Figure 3 illustrates a Video Surveillance System with Video and Audio Recognition according to the invention
- Figure 4 illustrates details of the Smart Recognition Engine according to the invention.
- FIG. 3 illustrates a Video Surveillance System with video and audio recognition according to the invention.
- a camera array 40 comprising one or more still or video electronic cameras, e.g., CCD or CMOS cameras, either color or monochrome or having an equivalent combination of components that capture an area under surveillance feeds video signals into a digital video and audio compression engine 42 through a video communications link 41.
- Motion and operation of each camera device of the camera array 40 may be controlled by received control signals, e.g., under computer and/or software control.
- operational parameters for each camera in camera array 40 including pan/tilt mirror, lens system, focus motor, pan motor, and tilt motor control are controlled by received control signals, as will be explained in greater detail herein.
- signal processing techniques Prior to outputting the digital video signals, many signal processing techniques may be applied for reducing noise or providing filtering/image enhancing techniques, for example.
- a microphone array 49 comprising microphone sensor devices (omnidirectional and/or highly directional microphones) that can convert acoustic pressure into electrical signals are provided to feed audio information into the digital video and audio compression engine 42 through audio communications link 50.
- microphone sensor devices omnidirectional and/or highly directional microphones
- a directivity level of the microphone array varies with respect to sound frequencies so that the number of microphones and the distance between the microphones may be determined in consideration of a required frequency range capable in order to provide any given degree of directivity.
- the microphones implemented in the array may be controlled under software control, for example, to accomplish these ends and, include transducers configured to have a pick-up pattern that may be distinctly biased towards various frequency receptions, e.g., in the range of human speech, explosions, gun shots, etc. In this manner the microphone array is ensured to be receptive to respond to an acoustic event's soundfield with a high degree of accuracy. Further audio signal conditioning techniques may be applied for digitizing the analog audio signals obtained using an A/D converter, for example, and for providing gain control, reducing/filtering noise, for example.
- the digitized video and audio information is digitally compressed and sent through link 46 to a memory storage device 44 for a long-term storage, e.g., a database, a hard disk drive, magnetic or optical media including but not limited to: a CD-ROM, DVD, tape, platter, disk array, or the like.
- the output of each camera of the camera array 40 is stored in the storage medium in a compressed format, such as MPEGl, MPEG2, and the like.
- the output of each camera of the array may be stored in a particular location on the storage medium associated with that camera or, is stored with an indication to which camera each stored output corresponds.
- the same video information and audio information is additionally simultaneously fed to a smart recognition engine 43 through respective video link 41 and audio link 50.
- the communication links 41 and 50 between the respective camera array and audio microphone array and the video and audio compression engine 42 and smart recognition engine 43 may be hardwired, or wireless links may be employed.
- these communication links may take the form of cable, satellite, RF and microwave transmission, fiber optics, and the like.
- the smart recognition engine 43 comprises a video recognition engine 62, audio recognition engine 63, a mutual recognition engine and an alarm generation module 64.
- the smart recognition engine 43 implements software for controlling a computer device to perform methods and processes for executing video recognition algorithms and face recognition algorithms. These may be executed with and in conjunction with motion detection algorithms (for example, the well-known patch correlation or tracking algorithms that tracks the individual points) to estimate the motion of features in the image stream), etc.
- the smart recognition engine 43 additionally implements software for controlling a computer device to perform methods and processes for executing audio recognition and speech recognition algorithms. Speech recognition algorithms implemented as computer readable instructions, data structures, program modules, etc. may be used for recognizing particular spoken words that may be potentially indicative of an emergency or alarm-worthy situation ("Help", "Robbery”, etc.).
- An audio recognition engine 63 comprising computer readable instructions, data structures, program modules or other data, may be trained to recognize special audio signals such as gun shots, explosions, etc., as well as high-pitch sounds, e.g., screams, shrieks, and other sound and voice signatures associated with known potential alarm provoking events. It is understood however, that the various recognition algorithms may be employed according to the invention, that do not require prior training.
- the computing device(s) implemented includes a general purpose computer device such as a PC, device, laptop, mobile device, and the like, having components including, but not limited to a processing unit, a system memory, and a system bus that couples various system components including the system memory to the processing unit.
- the computer device implements these components for executing the smart recognition engine and audio recognition engine that are stored on a well-known computer-readable medium comprising any available media that can be accessed by the computer device including both removable, non-removable media, volatile, and nonvolatile media.
- the computer-readable recording may be centralized at one location or decentralized over computer systems connected via network, for example, and computer-readable recognition algorithms can be stored in the computer-readable recording medium and be executed in a decentralized manner.
- Directional information concerning a sensed audio event is delivered to camera microphone control module 52 through a wired or wireless communications link 53.
- the camera/microphone control module 52 includes all of the software necessary to implement motor position control for directing camera/cameras of array 40 and controlling the positions of the microphone array 49 in the direction of interest by means of control signals 54.
- the control signals may be input to camera array 40 to adjust or control camera pan/tilt mirrors, lens system(s), focus motor, pan motor, and tilt motor components and sub-systems.
- control signals are additionally used to automatically direct the field of view seen by the cameras in order to obtain a better centered image or, more zoomed, focused or more resolved image with more information regarding the actual alarm or alarm event, hi one non-limiting example, in response to audio recognition of a gun shot audio signal by the smart recognition engine, control signals may be generated that direct one or more cameras of the camera array to the scene to "look" in the direction of the gun-shot. If video camera array is directed at the location of a crime from audio recognition of the gun-shot, then the "crime event" recognition will be better off because more information about the gun-shot is available.
- these control signals may be generated are used to automatically adjust the orientation of the microphones and the distance between the microphones to better receive the accompanying audio information.
- the microphones orientation may be additionally adjusted in consideration of detecting audio signals of a required frequency range, or for providing any given degree of directivity.
- one or more microphones may be redirected to "listen" from a particular direction in response to a video recognition event.
- outputs from video recognition 62 engine and audio recognition engine 63 are analyzed by the mutual recognition engine 64 for processing the simultaneously received video and audio recognition information and ultimately determining whether an alarm condition exists.
- alarms may be generated that are forwarded to the manned monitoring station 48 through communications link 47.
- the recognition processes employed as computer readable instructions, data structures, program modules, etc. used in the mutual recognition engine 64 are generally based upon a pattern matching and/or hypotheses evaluation.
- an estimate of the probabilities of various events This may be accomplished by determining from the real-time video recognition information and audio signals to what extent a correlation exists between the respective recognized video scenes and accompanying recognized voice or audio signatures.
- the video information is used for the purpose of trying to evaluate probabilities of various video scenes. If it is known that such scenes would be accompanied by high pitch voice (screaming etc) then detecting a high-pitch from the audio input will increase the probability of it being a result of a stabbing motion as captured in the video signals.
- An operator performs visual monitoring of a particular area surveyed by the camera array 40 and when an alarm indication is provided by the alarm generating unit takes place, it the operator's decision to dispatch or not to dispatch a police or emergency personnel to the monitored area. It is clear from the above description that there is an extraction of useful information from the audio inputs which is, being combined with video recognition events, improves the total operation of the surveillance system.
- communications link 60 between video recognition engine 62 and mutual recognition engine 64 is bidirectional, as are the communications link 61 between audio recognition engine 63 and mutual recognition engine 64.
- Bi-directionality of links 60 and 61 allows mutual influence of video and audio recognition algorithms in the manner as described, which, as a consequence, gives better recognition level for video and audio as well as possibility to implement detection of particular events that were heretofore impossible to detect.
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA002656268A CA2656268A1 (en) | 2006-08-03 | 2006-08-03 | Video surveillance system and method with combined video and audio recognition |
CN2006800555140A CN101501564B (en) | 2006-08-03 | 2006-08-03 | video surveillance system and method with combined video and audio recognition |
BRPI0621897-0A BRPI0621897B1 (en) | 2006-08-03 | 2006-08-03 | “SURVEILLANCE SYSTEM USING VIDEO AND AUDIO RECOGNITION, SURVEILLANCE METHOD AND MACHINE-READY STORAGE DEVICE” |
MX2009001254A MX2009001254A (en) | 2006-08-03 | 2006-08-03 | Video surveillance system and method with combined video and audio recognition. |
PCT/US2006/030560 WO2008016360A1 (en) | 2006-08-03 | 2006-08-03 | Video surveillance system and method with combined video and audio recognition |
JP2009522745A JP5043940B2 (en) | 2006-08-03 | 2006-08-03 | Video surveillance system and method combining video and audio recognition |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2006/030560 WO2008016360A1 (en) | 2006-08-03 | 2006-08-03 | Video surveillance system and method with combined video and audio recognition |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008016360A1 true WO2008016360A1 (en) | 2008-02-07 |
Family
ID=38997456
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2006/030560 WO2008016360A1 (en) | 2006-08-03 | 2006-08-03 | Video surveillance system and method with combined video and audio recognition |
Country Status (6)
Country | Link |
---|---|
JP (1) | JP5043940B2 (en) |
CN (1) | CN101501564B (en) |
BR (1) | BRPI0621897B1 (en) |
CA (1) | CA2656268A1 (en) |
MX (1) | MX2009001254A (en) |
WO (1) | WO2008016360A1 (en) |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2466242A (en) * | 2008-12-15 | 2010-06-23 | Audio Analytic Ltd | Identifying sounds and reducing false positive identification of sound |
EP2819108A1 (en) * | 2013-06-24 | 2014-12-31 | Panasonic Corporation | Directivity control system and sound output control method |
EP2927885A1 (en) * | 2014-03-31 | 2015-10-07 | Panasonic Corporation | Sound processing apparatus, sound processing system and sound processing method |
EP2938097A1 (en) * | 2014-04-24 | 2015-10-28 | Panasonic Corporation | Sound processing apparatus, sound processing system and sound processing method |
US9286911B2 (en) | 2008-12-15 | 2016-03-15 | Audio Analytic Ltd | Sound identification systems |
CN105491336A (en) * | 2015-12-08 | 2016-04-13 | 成都芯软科技发展有限公司 | Image identification module with low power consumption |
EP3059733A3 (en) * | 2015-02-18 | 2016-10-05 | Honeywell International Inc. | Automatic alerts for video surveillance systems |
EP3147902A1 (en) * | 2015-09-24 | 2017-03-29 | Canon Kabushiki Kaisha | Sound processing apparatus, sound processing method, and computer program |
US9813484B2 (en) | 2014-12-31 | 2017-11-07 | Motorola Solutions, Inc. | Method and apparatus analysis of event-related media |
CN109033997A (en) * | 2018-07-02 | 2018-12-18 | 厦门快商通信息技术有限公司 | A kind of lumbering event detecting method and system |
US10182280B2 (en) | 2014-04-23 | 2019-01-15 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing apparatus, sound processing system and sound processing method |
US10726270B2 (en) | 2016-10-21 | 2020-07-28 | Xinova, LLC | Selecting media from mass social monitoring devices |
US10810854B1 (en) | 2017-12-13 | 2020-10-20 | Alarm.Com Incorporated | Enhanced audiovisual analytics |
CN112929372A (en) * | 2021-02-06 | 2021-06-08 | 北京第七九七音响股份有限公司 | Network intelligent audio terminal, monitoring method and monitoring system |
EP3839909A1 (en) * | 2019-12-18 | 2021-06-23 | Koninklijke Philips N.V. | Detecting the presence of an object in a monitored environment |
DE102020209025A1 (en) | 2020-07-20 | 2022-01-20 | Robert Bosch Gesellschaft mit beschränkter Haftung | Method for determining a conspicuous partial sequence of a surveillance image sequence |
EP4012678A1 (en) * | 2020-12-14 | 2022-06-15 | Ava Video Security Limited | Security system |
GB2620594A (en) * | 2022-07-12 | 2024-01-17 | Ava Video Security Ltd | Computer-implemented method, security system, video-surveillance camera, and server |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102082948B (en) * | 2009-11-30 | 2012-07-25 | 中国移动通信集团北京有限公司 | System, method and equipment for acquiring video information |
CN103067655A (en) * | 2011-10-24 | 2013-04-24 | 鸿富锦精密工业(深圳)有限公司 | System and method of controlling video camera device |
CN103136899B (en) * | 2013-01-23 | 2016-01-20 | 宁凯 | Based on the intelligent alarm method for supervising of Kinect somatosensory device |
CN103747217A (en) * | 2014-01-26 | 2014-04-23 | 国家电网公司 | Video monitoring method and device |
CN105338294A (en) * | 2014-08-07 | 2016-02-17 | 富士通株式会社 | Monitoring device and method |
CN104269016A (en) * | 2014-09-22 | 2015-01-07 | 北京奇艺世纪科技有限公司 | Alarm method and device |
CN104333686B (en) * | 2014-11-27 | 2018-03-27 | 天地伟业技术有限公司 | Intelligent monitoring camera and its control method based on face and Application on Voiceprint Recognition |
US9598076B1 (en) * | 2015-10-22 | 2017-03-21 | Ford Global Technologies, Llc | Detection of lane-splitting motorcycles |
CN106028217B (en) * | 2016-06-20 | 2020-01-21 | 咻羞科技(深圳)有限公司 | Intelligent equipment interaction system and method based on audio recognition technology |
CN106023515A (en) * | 2016-07-06 | 2016-10-12 | 中警科技(江苏)开发有限公司 | Remote automatic alarm police kiosk |
CN106600876A (en) * | 2017-01-24 | 2017-04-26 | 璧典寒 | Automatic machine room duty alarming system and alarming method |
CN109089087B (en) * | 2018-10-18 | 2020-09-29 | 广州市盛光微电子有限公司 | Multi-channel audio-video linkage device |
CN109543538A (en) * | 2018-10-23 | 2019-03-29 | 深圳壹账通智能科技有限公司 | Obtain method, apparatus, computer equipment and the storage medium of the track of alert object |
TWI687753B (en) * | 2018-12-06 | 2020-03-11 | 宏碁股份有限公司 | Panoramic camera and panoramic photography system |
CN110336976A (en) * | 2019-06-13 | 2019-10-15 | 长江大学 | A kind of intelligent monitoring probe and system |
CN111091073A (en) * | 2019-11-29 | 2020-05-01 | 清华大学 | Abnormal event monitoring equipment and method combining video and audio |
CN111460907B (en) * | 2020-03-05 | 2023-06-20 | 浙江大华技术股份有限公司 | Malicious behavior identification method, system and storage medium |
CN111818237A (en) * | 2020-07-21 | 2020-10-23 | 南京智金科技创新服务中心 | Video monitoring analysis system and method |
CN112396801A (en) * | 2020-11-16 | 2021-02-23 | 苏州思必驰信息科技有限公司 | Monitoring alarm method, monitoring alarm device and storage medium |
CN113920660B (en) * | 2021-09-30 | 2023-04-18 | 中国工商银行股份有限公司 | Safety monitoring method and system suitable for safety storage equipment |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6611206B2 (en) * | 2001-03-15 | 2003-08-26 | Koninklijke Philips Electronics N.V. | Automatic system for monitoring independent person requiring occasional assistance |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3381343B2 (en) * | 1993-12-03 | 2003-02-24 | 株式会社日立製作所 | Monitoring device |
JPH0983856A (en) * | 1995-09-07 | 1997-03-28 | Nippon Telegr & Teleph Corp <Ntt> | Intelligent camera equipment |
US6175382B1 (en) * | 1997-11-24 | 2001-01-16 | Shell Oil Company | Unmanned fueling facility |
CN1186923C (en) * | 2003-04-03 | 2005-01-26 | 上海交通大学 | Abnormal object automatic finding and tracking video camera system |
JP4175180B2 (en) * | 2003-05-29 | 2008-11-05 | 松下電工株式会社 | Monitoring and reporting system |
CN1716329A (en) * | 2004-06-29 | 2006-01-04 | 乐金电子(沈阳)有限公司 | Baby monitoring system and its method using baby's crying frequency |
CN200966113Y (en) * | 2006-11-08 | 2007-10-24 | 天津三星电子有限公司 | A monitor with the audio locking functions |
-
2006
- 2006-08-03 CN CN2006800555140A patent/CN101501564B/en active Active
- 2006-08-03 MX MX2009001254A patent/MX2009001254A/en active IP Right Grant
- 2006-08-03 CA CA002656268A patent/CA2656268A1/en not_active Abandoned
- 2006-08-03 WO PCT/US2006/030560 patent/WO2008016360A1/en active Application Filing
- 2006-08-03 JP JP2009522745A patent/JP5043940B2/en not_active Expired - Fee Related
- 2006-08-03 BR BRPI0621897-0A patent/BRPI0621897B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6611206B2 (en) * | 2001-03-15 | 2003-08-26 | Koninklijke Philips Electronics N.V. | Automatic system for monitoring independent person requiring occasional assistance |
Cited By (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102246228A (en) * | 2008-12-15 | 2011-11-16 | 音频分析有限公司 | Sound identification systems |
GB2466242B (en) * | 2008-12-15 | 2013-01-02 | Audio Analytic Ltd | Sound identification systems |
CN102246228B (en) * | 2008-12-15 | 2014-06-18 | 音频分析有限公司 | Sound identification systems |
US8918343B2 (en) | 2008-12-15 | 2014-12-23 | Audio Analytic Ltd | Sound identification systems |
US9286911B2 (en) | 2008-12-15 | 2016-03-15 | Audio Analytic Ltd | Sound identification systems |
US10586543B2 (en) | 2008-12-15 | 2020-03-10 | Audio Analytic Ltd | Sound capturing and identifying devices |
GB2466242A (en) * | 2008-12-15 | 2010-06-23 | Audio Analytic Ltd | Identifying sounds and reducing false positive identification of sound |
US9747454B2 (en) | 2013-06-24 | 2017-08-29 | Panasonic Intellectual Property Management Co., Ltd. | Directivity control system and sound output control method |
EP2819108A1 (en) * | 2013-06-24 | 2014-12-31 | Panasonic Corporation | Directivity control system and sound output control method |
EP2927885A1 (en) * | 2014-03-31 | 2015-10-07 | Panasonic Corporation | Sound processing apparatus, sound processing system and sound processing method |
US10182280B2 (en) | 2014-04-23 | 2019-01-15 | Panasonic Intellectual Property Management Co., Ltd. | Sound processing apparatus, sound processing system and sound processing method |
EP2938097A1 (en) * | 2014-04-24 | 2015-10-28 | Panasonic Corporation | Sound processing apparatus, sound processing system and sound processing method |
US9813484B2 (en) | 2014-12-31 | 2017-11-07 | Motorola Solutions, Inc. | Method and apparatus analysis of event-related media |
EP3059733A3 (en) * | 2015-02-18 | 2016-10-05 | Honeywell International Inc. | Automatic alerts for video surveillance systems |
EP3147902A1 (en) * | 2015-09-24 | 2017-03-29 | Canon Kabushiki Kaisha | Sound processing apparatus, sound processing method, and computer program |
US10109299B2 (en) | 2015-09-24 | 2018-10-23 | Canon Kabushiki Kaisha | Sound processing apparatus, sound processing method, and storage medium |
CN106558317A (en) * | 2015-09-24 | 2017-04-05 | 佳能株式会社 | Sound processing apparatus and sound processing method |
CN105491336A (en) * | 2015-12-08 | 2016-04-13 | 成都芯软科技发展有限公司 | Image identification module with low power consumption |
US10726270B2 (en) | 2016-10-21 | 2020-07-28 | Xinova, LLC | Selecting media from mass social monitoring devices |
US11393317B2 (en) | 2017-12-13 | 2022-07-19 | Alarm.Com Incorporated | Enhanced audiovisual analytics |
US10810854B1 (en) | 2017-12-13 | 2020-10-20 | Alarm.Com Incorporated | Enhanced audiovisual analytics |
CN109033997A (en) * | 2018-07-02 | 2018-12-18 | 厦门快商通信息技术有限公司 | A kind of lumbering event detecting method and system |
EP3839909A1 (en) * | 2019-12-18 | 2021-06-23 | Koninklijke Philips N.V. | Detecting the presence of an object in a monitored environment |
WO2021123185A1 (en) * | 2019-12-18 | 2021-06-24 | Koninklijke Philips N.V. | Detecting the presence of an object in a monitored environment |
DE102020209025A1 (en) | 2020-07-20 | 2022-01-20 | Robert Bosch Gesellschaft mit beschränkter Haftung | Method for determining a conspicuous partial sequence of a surveillance image sequence |
EP4012678A1 (en) * | 2020-12-14 | 2022-06-15 | Ava Video Security Limited | Security system |
CN112929372A (en) * | 2021-02-06 | 2021-06-08 | 北京第七九七音响股份有限公司 | Network intelligent audio terminal, monitoring method and monitoring system |
GB2620594A (en) * | 2022-07-12 | 2024-01-17 | Ava Video Security Ltd | Computer-implemented method, security system, video-surveillance camera, and server |
Also Published As
Publication number | Publication date |
---|---|
BRPI0621897B1 (en) | 2018-03-20 |
MX2009001254A (en) | 2009-02-11 |
CN101501564A (en) | 2009-08-05 |
JP5043940B2 (en) | 2012-10-10 |
JP2009545911A (en) | 2009-12-24 |
CN101501564B (en) | 2012-02-08 |
CA2656268A1 (en) | 2008-02-07 |
BRPI0621897A2 (en) | 2011-03-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060227237A1 (en) | Video surveillance system and method with combined video and audio recognition | |
WO2008016360A1 (en) | Video surveillance system and method with combined video and audio recognition | |
CN109300471B (en) | Intelligent video monitoring method, device and system for field area integrating sound collection and identification | |
USRE44527E1 (en) | Abnormality detection and surveillance system | |
JP4861723B2 (en) | Monitoring system | |
CN102737480B (en) | Abnormal voice monitoring system and method based on intelligent video | |
Valenzise et al. | Scream and gunshot detection and localization for audio-surveillance systems | |
KR101445367B1 (en) | Intelligent cctv system to recognize emergency using unusual sound source detection and emergency recognition method | |
USRE44225E1 (en) | Abnormality detection and surveillance system | |
CN111601074A (en) | Security monitoring method and device, robot and storage medium | |
WO1997008896A1 (en) | Open area security system | |
JP2012048689A (en) | Abnormality detection apparatus | |
KR101384781B1 (en) | Apparatus and method for detecting unusual sound | |
KR101687296B1 (en) | Object tracking system for hybrid pattern analysis based on sounds and behavior patterns cognition, and method thereof | |
CN110634506A (en) | Voice data processing method and device | |
KR20180093596A (en) | Safety Sensor Based on Scream Detection | |
WO2011025460A1 (en) | Method and system for event detection | |
KR102518615B1 (en) | Apparatus and Method for complex monitoring to judge abnormal sound source | |
Park et al. | Sound learning–based event detection for acoustic surveillance sensors | |
KR102034176B1 (en) | Emergency Situation Perception Method by Voice Recognition, and Managing Server Used Therein | |
KR102319687B1 (en) | Surveillance system adopting wireless acoustic sensors | |
JP2004357014A (en) | Monitor report system | |
CN111627178A (en) | Sound identification positioning warning system and method thereof | |
JP5907487B2 (en) | Information transmission system, transmission device, reception device, information transmission method, and program | |
Kotus et al. | Multimodal surveillance based personal protection system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200680055514.0 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 06800808 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2656268 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009522745 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2009/001254 Country of ref document: MX |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
NENP | Non-entry into the national phase |
Ref country code: RU |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 06800808 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: PI0621897 Country of ref document: BR Kind code of ref document: A2 Effective date: 20090203 |