WO2017093839A1 - Flexible surveillance system - Google Patents
Flexible surveillance system Download PDFInfo
- Publication number
- WO2017093839A1 WO2017093839A1 PCT/IB2016/056936 IB2016056936W WO2017093839A1 WO 2017093839 A1 WO2017093839 A1 WO 2017093839A1 IB 2016056936 W IB2016056936 W IB 2016056936W WO 2017093839 A1 WO2017093839 A1 WO 2017093839A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- surveillance
- mobile
- unit
- lighting
- surveillance system
- Prior art date
Links
- 238000004891 communication Methods 0.000 claims abstract description 63
- 238000010295 mobile communication Methods 0.000 claims abstract description 16
- 230000003068 static effect Effects 0.000 claims abstract description 13
- 230000033001 locomotion Effects 0.000 claims description 63
- 238000001514 detection method Methods 0.000 claims description 22
- 238000013500 data storage Methods 0.000 claims description 16
- 238000001228 spectrum Methods 0.000 claims description 9
- 230000003287 optical effect Effects 0.000 claims description 8
- 239000000779 smoke Substances 0.000 claims description 7
- 238000004146 energy storage Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 3
- 230000001788 irregular Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 description 14
- 238000000034 method Methods 0.000 description 10
- 238000004378 air conditioning Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000000087 stabilizing effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 238000002329 infrared spectrum Methods 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000009423 ventilation Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- VGGSQFUCUMXWEO-UHFFFAOYSA-N Ethene Chemical compound C=C VGGSQFUCUMXWEO-UHFFFAOYSA-N 0.000 description 1
- 239000005977 Ethylene Substances 0.000 description 1
- 208000019695 Migraine disease Diseases 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000004035 construction material Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 206010015037 epilepsy Diseases 0.000 description 1
- 206010027599 migraine Diseases 0.000 description 1
- 230000004297 night vision Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000002211 ultraviolet spectrum Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19647—Systems specially adapted for intrusion detection in or around a vehicle
- G08B13/1965—Systems specially adapted for intrusion detection in or around a vehicle the vehicle being an aircraft
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
- G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B19/00—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow
- G08B19/005—Alarms responsive to two or more different undesired or abnormal conditions, e.g. burglary and fire, abnormal temperature and abnormal rate of flow combined burglary and fire alarm systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
- H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
- B64U2101/31—UAVs specially adapted for particular uses or applications for imaging, photography or videography for surveillance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2201/00—UAVs characterised by their flight controls
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/14—Central alarm receiver or annunciator arrangements
Definitions
- the present invention relates to the field of surveillance systems.
- An surveillance system which employs a camera equipped mobile surveillance device and which relies on lighting devices for providing system communication and positioning information via for example visible light communication is proposed.
- the invention further includes a lighting device and a mobile surveillance device for such a surveillance system.
- Indoor positioning applications relate to systems and methods for estimating a mobile device's position within a confined space, for example a building.
- Radio wave based indoor positioning applications encounter specific difficulties, which affect the availability and precision of satellite based positioning systems .
- Ultrasonic based and also light based systems are proposed as specific indoor positioning systems for providing position information to location based applications in the areas of marketing, entertainment, logistics or management.
- a retail enterprise may use a VLC based system to alert a customer via his camera equipped mobile device to a particular item in a store and provide a navigation function for guiding the customer through a maze of aisles situated between shelves to the particular item.
- the mobile device of the customer and its location are tracked with time and corresponding data is generated which describes how the customer moves through a store, where they spend their time in the retail store, in order to improve store layout, product arrangement and placement of merchandize displays .
- GNSS Global navigation Satellite systems
- RSSI received signal strength indication
- WLAN - WiFiTM wireless local area network
- Ultrasonic based techniques which rely on inaudible acoustic waves received by microphones can also be used to estimate an indoor position, nevertheless a limited range and lack for suitable devices requires significant funding in order to implement a positioning system based on ultrasonic communication techniques.
- HVAC heating, ventilation and air conditioning
- Commissioning is the process of associating a physical position of an installed building technology device with a logical address such as a network address according to a applicable network protocol. It is an essential step during the installation and setup of an intelligent lighting system, for example a light management system. The commissioning step typically requires electric, electronic and/or software expertise by the staff installing the light system. During the commissioning process dedicated software is used to assign an address and/or a geographical position to a building technology device . Commissioning is a costly process during installation due to the needed staff qualification.
- the building technology device to be commissioned generally needs to be equipped with a communication component that is able to communicate with a commissioning tool, usually by means of wireless communication.
- the commissioning tool can then be used to read or set an address for the building technology device and to read or configure operating parameters.
- the commissioning tool can associate a position with the address of a building technology device.
- this type of commissioning requires a peer-to-peer- communication between the commissioning tool and each building technology device and also rises extra costs as the building technology device not only needs to be provided with the communication component, but also with additional means to allow control and configuration by a wireless commissioning functionality.
- a definition of a location of a building technology device, e.g. based on a floor, building or room plan still needs to be performed manually.
- the invention aims at resolving these problems and to furthermore improve commissioning of a building technology device .
- a surveillance system for adaptable surveillance comprises at least one lighting device including a communication unit and at least one mobile surveillance device including a mobile communication unit for communicating with the communication unit of the at least one lighting device.
- the at least one mobile surveillance device is configured to navigate based on data received from the at least one lighting device and including information that allows to determine a current position of the surveillance device.
- the mobile surveillance device offers the advantage of moving the surveillance device to different accessible locations in a given surveillance space.
- the surveillance system dispenses with the need of installing numerous surveillance devices covering the entire surveillance space or even providing key areas with multiple coverage. Not only a large number of static surveillance devices can be reduced to a number or even a simple mobile surveillance device, the cost for dedicated cabling between units of the surveillance system is also reduced.
- the surveillance system is also capable to react in a flexible manner to different threats and presents a much more challenging task to intruders. Even more advantageous, by reacting to a triggered alarm with moving a mobile surveillance device to verify the reported intrusion, an independent verification of an alarm is provided which under some jurisdictions is a prerequisite for involving public security authorities.
- a further advantage is that other security infrastructure systems such as emergency lighting, fire alarm can be integrated which further reduces the overall infrastructure cost.
- the surveillance system of a preferred embodiment comprises the at least one communication unit being configured to use for communicating with the mobile communication unit at least one of visible light communication, infrared light communication, ultraviolet light communication and wireless communication.
- the available lighting network for the surveillance provides the system infrastructure for operating with mobile surveillance devices such as autonomously flying aerial vehicles (intelligent flying drones), for example quadrocopters or ducted fan aerial vehicles, robots driving on the ground or robots travelling at rails below the ceiling.
- the mobile surveillance device can be equipped with camera sensors.
- the autonomously moving surveillance device relies for navigation and for transmission of acquired surveillance data such as images, videos (image streams), for transmission of control signals, status signals on the lighting device network installed in the space under surveillance.
- the surveillance system of the invention accordingly has the capability to act independent from external input by an operator in order to react to an intrusion.
- the surveillance system is capable to autonomously adapt its surveillance coverage to changing surveillance requirements .
- the term autonomous is to be understood as having the ability to act independently from operator instructions and based on its own set of rules and right.
- the surveillance system includes the at least one mobile surveillance device further comprising a sensor unit including at least one of an optical sensor, an acoustic sensor, a smoke detector, a gas detector, an humidity sensor, an accelerometer, a magnetometer, a relative pressure sensor and a temperature sensor.
- a sensor unit including at least one of an optical sensor, an acoustic sensor, a smoke detector, a gas detector, an humidity sensor, an accelerometer, a magnetometer, a relative pressure sensor and a temperature sensor.
- the accelerometer provides in particular the capability to determine an optical sensor viewing point and viewing angle in addition to support stabilizing the mobile surveillance device.
- the magnetometer may also assist the corresponding tasks as the accelerometer in addition to support determining the actual direction for navigation of the mobile surveillance device.
- the relative pressure sensor barometric sensor
- the cited sensor technologies of the sensor unit support fulfilling the surveillance task as well as support navigation of the surveillance device in a surveillance space.
- the cited and further sensor technologies may assist the mobile surveillance device to navigate back into a coverage area of the at least one lighting device and hence into a zone in which communication via VLC is possible if the mobile surveillance device left the coverage area of the lighting device .
- An advantageous surveillance system of an embodiment comprises at least one base station for the mobile surveillance device, The at least one base station is configured to perform at least one of sheltering the mobile surveillance device and charging an energy storage unit of the mobile surveillance device.
- the surveillance system of a preferred embodiment further additionally comprises at least one static surveillance device.
- a static surveillance device may combine the double functions of providing a control of the lighting of the surveillance space and detecting any intruder into the surveillance space, for example by motion detection.
- a typical example of the at least one static surveillance device may be a motion detector unit used for example for lighting control, air conditioning control or in security systems.
- the surveillance system further comprises a surveillance control unit which is configured to determine if a motion reported by for example such a static surveillance device is within a predefined time period, and if the reported motion is within the predefined time period, to control the mobile surveillance device to move to a location suitable for investigating the reported motion.
- a predefined time period might be for example non working hours in office buildings, stores or the like.
- An advantageous surveillance system has the lighting device configured to radiate light in a frequency spectrum outside the visible light spectrum, and the least one sensor unit is configured to obtain light in the frequency spectrum radiated by the lighting device.
- An embodiment of the inventive surveillance system comprises a data storage device configured to store at least one of map data, lighting device location information and mobile surveillance device position information.
- the map data for autonomous operation of the mobile surveillance device can be stored centrally on a data storage unit to be readily accessible and updateable, for planning of flight and movement paths for different mobile surveillance devices which avoid interference with other mobile surveillance devices as well as coordinating of individual surveillance mission profiles.
- the data storage device may be a local server or a remote server such as a cloud server.
- An advantageous embodiment of the surveillance system includes the mobile surveillance device including a sensor unit which is configured to optically inspect at least one of an emergency lighting unit and a smoke detector unit, and the surveillance system further comprises a surveillance control unit configured to control the mobile surveillance device to move to a location of the at least one emergency lighting unit or smoke detection unit .
- a lighting device (luminaire) for use in a surveillance system for adaptable surveillance comprises a communication unit configured to transmit data including information for determining a current position of a surveillance device for a time period in which the surveillance device is present in an area illuminated by the lighting device.
- the lighting device of a further embodiment of the surveillance system transmits data including beacon identification information changing with time.
- the change of beacon identification as well as only transmitting the data including information for determining a current position of a surveillance device for a time period improves the security of the system. Transmitting the data only for a time period when the data is required also reduces negative effects on people suffering from epilepsy or migraine due to intensity modulated lighting, or possible interference with dimming of the lighting device .
- a lighting device for use in a surveillance system for adaptable surveillance comprises a communication unit which is configured to transmit data including information for determining a current position of a mobile surveillance device, and to receive surveillance data from the mobile surveillance device.
- the lighting device provides an interface for a mobile surveillance device to the static backbone of the autonomous surveillance system.
- a mobile surveillance device for use in a surveillance system for adaptable surveillance comprises a mobile communication unit configured to receive data from a lighting device including information that allows determining a current position of the mobile surveillance device and at least one sensor unit. The mobile communication unit is further configured to transmit data acquired by the sensor unit to the lighting device.
- the mobile surveillance device for use in a surveillance system for adaptable surveillance of an advantageous embodiment includes the mobile communication unit configured to receive and transmit the data using at least one of visible light communication, infrared light communication, ultraviolet light communication and wireless communication.
- a mobile surveillance device comprises a mobile communication unit configured to receive data from at least one lighting device, the data including identification information for uniquely identifying the lighting device, and a processing unit configured to associate the received identification information with a position information of the mobile surveillance device when receiving the data identification information.
- the mobile surveillance device significantly improves the configuration phase of a lighting system.
- the movable surveillance device moves to a location of an installed lighting device, determines the identity of the lighting device and associates the determined identity with the location information.
- the identity of a lighting device in particular an operation address, a bus address or network address, and the corresponding location can be gathered in convenient and efficient manner.
- Fig. 1 provides a scenario for an autonomous camera surveillance system according to a preferred embodiment employed in an indoor environment
- Fig. 2 shows a scenario of a surveillance system in an indoor environment according to prior art
- Fig. 3 provides general steps of employing the autonomous camera surveillance system in a flowchart
- Fig. 4 shows a block diagram of an autonomous camera surveillance system according to a preferred embodiment.
- Fig. 1 provides an overview of a scene of an autonomous surveillance system 1 showing some of the structural elements constituting the autonomous surveillance system.
- the surveillance space 9 depicted in fig. 1 corresponds to a portion of a building.
- the depicted building interior shows elements of a lighting system including lighting devices 4 mounted in a ceiling and PIR motion detection sensors 6 at suitable locations on the walls .
- the PIR motion detection sensors 6 are spatially arranged in order to provide motion detection coverage of the interior of the building.
- At least some of the lighting devices 4 include a communication unit adapted to communicate via visible light communication.
- the infrastructure of the building further includes "Heating, Ventilation & Air Conditioning" (HVAC) - devices 7 which also may be controlled based on own PIR presence sensors integrated into the HVAC devices 7.
- HVAC Heating, Ventilation & Air Conditioning
- the mobile surveillance device 2 may be an aerial vehicle in form of a quadrocopter carrying a sensor unit in form of a camera.
- the hovering capability of the aerial vehicle and its capability to manoeuvre in the restricted space of a building provide a suitable mobile and highly flexible basis for a camera in the autonomous surveillance system 1.
- the invention is described with reference to an autonomous camera surveillance system for a building.
- the detailed functions for the autonomous surveillance system are manifold.
- the autonomous surveillance system 1 may detect any activity in the surveillance space 9 representing an area of interest and may notify a facility management on any logged event in the surveillance space 9. This function can be fulfilled without need of further infrastructure but using the lighting system which has to be installed anyway.
- a further detailed use scenario of the autonomous surveillance system 1 employs a mobile surveillance device 2 using a sensor unit which acquires an extended parameter set including at least one of optical images, humidity values, gas concentration values, temperature values for example.
- the mobile surveillance device 2 performs scheduled runs through aisles during closing hours of a supermarket, offices, ... to collect respective data.
- the data collected during the scheduled runs provides information on the state of the doors of refrigerators, in particular if they are properly closed, if the humidity and/or temperature are within specified limits, or if an ethylene concentration in a flower department is within specified concentration limits .
- Fig. 2 depicts the view of a surveillance space 9 situated within a building and corresponds to the view as depicted in fig. 1.
- the view of fig. 2 includes devices of known building infrastructure for comparison purposes.
- the exemplary building might be an office building including lighting infrastructure, HVAC infrastructure and a security alarm infrastructure .
- the lighting in the depicted example includes lighting devices 4 mounted at the ceiling which are switched between an ON state and an OFF state by motion detector units 6 which are mounted at the walls of the corridors or rooms.
- the air condition infrastructure is also controlled by using signals provided by motion detectors included in the HVAC units 7 mounted high on the walls of rooms which detect the presence of a person in the corresponding room.
- the depicted exemplary infrastructure also includes a conventional security surveillance system which employs motion detector units 11 for the detection of intruders and employs cameras 12 for acquiring visual images from the monitored surveillance space 9.
- a parallel emergency lighting system could exist with parallel sensor devices and actuating devices and/or information display devices could be installed within the surveillance space 9.
- Mobile surveillance devices 2 movable to any accessible position in the surveillance space 9 and adapted to monitor the surveillance space 9 from different angles avoid the requirement of fixedly installing a dense network of cameras 12 and the corresponding cabling.
- the costs for hardware, installation of hardware and maintaining the hardware are significantly reduced.
- no cameras 12 are visible and accordingly no discussion of admissibility of surveillance cameras 12 may arise .
- the inventive autonomous surveillance system 1 is particularly suited for refitting into existing buildings due to the lower proportion of static installation when compared to conventional surveillance systems and reuse of existing motion detection units 6 for security purposes .
- a dedicated motion detector network for controlling the security surveillance system 1 is dispensable, as the lighting systems motion detector units 6 fulfil the motion detection task also.
- the lighting devices 4 installed throughout the building of fig. 1 also include a VLC capability and thus are able to provide a communication capability to the autonomous surveillance system 1. Accordingly, a dedicated security system cabling for communicating the surveillance results from the sensor units is not necessary, and furthermore the communication between sensor units and the backbone of the autonomous surveillance system 1 benefits from a more flexible communication network enabling mobile communication and whose layout may more easily be designed to include a second backup communication link. Even more advantageous, an office building equipped with the autonomous surveillance system according to a preferred embodiment can be adapted to changing layout of rooms, for example when changing to another tenant without the respective high costs of changing room layout and changing the fixed infrastructure of a fixedly installed conventional surveillance system at the same time. According to the inventive surveillance system 1 an adaption of map data, drone coordination data may suffice to take account of a different spatial layout of the surveillance space 9 and different security requirements of the new tenant.
- Fig. 3 provides a flowchart with general steps of employing the autonomous camera surveillance system 1 according to a preferred embodiment.
- the autonomous camera surveillance system 1 starts in step 1 with a step of detecting a motion in the monitored surveillance space 9. If for example one of a plurality of PIR motion detectors 6 of the lighting system in the surveillance space 9 detects a motion and issues a corresponding detection report including a movement location to the surveillance control unit 15, the autonomous camera surveillance system 1 proceeds to a next step S2.
- the surveillance control unit 15 acquires an actual time and compares the acquired actual time with preset time limits. If the acquired actual time is between first time and second time, the surveillance control unit 15 determines that movement in the monitored space is admissible and proceeds to step S3.
- step S3 a respective lighting device 4 is switched in order to illuminate the portion of the surveillance space 9 in which at least one of the PIR motion detectors 6 reports a movement.
- the surveillance control unit 15 determines that the detected movement may be due to an intruder violating the surveillance space 9.
- the surveillance control unit 15 proceeds to a step S4 of investigating the reported movement.
- the surveillance control unit 15 starts to investigate the reported movement.
- the step S4 of investigating the reported movement includes for example issuing a surveillance task to the mobile surveillance device 2 for moving to and reconnoitring the reported movement location.
- the mobile surveillance device 2 for example an autonomously operating drone equipped with a camera, starts or is summoned from a routine flight pattern, transfers autonomously to a sensing location 5.2 suitable for optically investigating an area around the reported movement location, and uses its camera to search for a possible intruder which might have caused the received detection report.
- the autonomously operating mobile surveillance device 2 navigates through the surveillance space 9 based on VLC capable lighting devices 4.
- a planned movement path 5.1, 5.2, 5.3 of the mobile surveillance device 2 including the sensing location 5.2 with respective imaging directions for the camera are determined using positioning information and direction information determined from VLC signals emitted from the lighting devices 4.
- the mobile surveillance device 2 transmits image information acquired by its camera via VLC to the lighting devices 4.
- the lighting devices 4 relay the acquired image information to the surveillance control unit 15 for further processing .
- the surveillance control unit 15 evaluates the received image information and determines if indeed an intruder into the surveillance space 9 is the reason for the motion detection reported in step SI. If in the step S5 an intruder is confirmed, the method proceeds to step S6 and starts a suitable action in response to the detected and confirmed violation of the surveillance space 9. A suitable action may in particular be starting an acoustic alarm, triggering an in depth investigation by security personnel, issuing a security report to a law enforcement authorities, ... If in step S5 of confirming an intruder, the result of the movement investigation step S4 is assessed to be no violation of the surveillance space is to be determined, the method returns to step SI of detecting a motion.
- Step S2 is described above to merely compare an actual time if it is within a time period between the first time and the second time.
- a more complex evaluation of the detection time, the detection location and a set of rules which define the requirement of investigating in response to a movement report may be executed in step S2.
- the set of rules may regard office hours in a business building, regular patrol patterns for mobile devices 2, map data.
- the set of rules can be stored in central data storage unit 23 which can be accessed by the surveillance control unit 15.
- the central data storage unit 23 may also be implemented as a cloud server or as distributed network of servers .
- the term 'interface' is used.
- the term interface describes a shared boundary across which two separate components of the surveillance system exchange information.
- the information exchange can be between software, hardware, peripheral devices and combinations of these.
- Hardware interfaces exist in many of the components such as the various buses, storage devices, other I/O devices, etc.
- a hardware interface is described by the mechanical, electrical and logical signals at the interface and the protocol for sequencing them, often also called signaling .
- Fig. 4 shows a block diagram of an autonomous camera surveillance system 1 according to a preferred embodiment.
- the autonomous camera surveillance system 1 is capable to perform surveillance of the surveillance space 9.
- the surveillance space 9 includes a lighting system which is controlled based on the signals of numerous PIR motion detector units 6.
- PIR motion detector unit 6 may directly communicate with a plurality of lighting devices 4.1, 4.2, 4.3 as depicted in fig. 4 or may be linked to a central lighting control unit 19.
- the PIR motion detector unit 6 according to the preferred embodiment transmits a motion detection report to a lighting control unit 19.
- the lighting control unit 19 performs the known function of switching the lighting devices 4.1, 4.2, 4.3,...
- the plurality of lighting devices 4.1, 4.2, 4.3 is distributed in the surveillance space 9 for illumination purposes. At least some of the lighting devices 4.1, 4.2, 4.3 have a VLC communication capability. In particular the lighting devices 4.1, 4.2, 4.3 with the VLC capability radiate modulated light 3 which includes a positioning signal and a downlink signal to a mobile surveillance device 2.
- the downlink signal may in one embodiment comprise data defining a surveillance task for the mobile surveillance device 2.
- a surveillance task may comprise an area or location of the surveillance space 9 which is to be monitored or more closely examined.
- the mobile surveillance unit 2 is capable of autonomously moving in the surveillance space 9.
- the mobile surveillance device 2 may be a ground vehicle, an aerial vehicle or a unit which moves along rails, for example rails mounted below a ceiling of a large office area filled with cubicles.
- the mobile surveillance device according to a preferred embodiment is a fully or partially autonomously operating aerial vehicle with a hover flight capability, for example a helicopter drone, a quadrocopter drone or a ducted fan aerial vehicle.
- the mobile surveillance device 2 carries a sensor unit as a payload which may be fixedly or interchangeably installed on the mobile surveillance device 2.
- the sensor unit may comprise one or more imaging devices, for example a camera or a video camera.
- the one or more imaging devices may acquire a still image or preferably a video in the optical spectrum or in the ultraviolet or infrared spectrum.
- the sensor unit may additionally or alternatively include for example one or more highly sensitive motion detection sensors, one or more acoustic sensors such as directional or omni-directional microphones, one or more smoke detectors, temperature sensors, accelerometer, magnetometer relative (barometric) pressure sensor.
- the accelerometer enables the mobile surveillance device 2 to determine a viewing point and an optical sensor viewing angle. In addition to support fulfilling the surveillance task the accelerometer may provide data for stabilizing the mobile surveillance device 2.
- the magnetometer may also assist stabilizing the mobile surveillance device 2 in addition to aid determining the actual direction for navigation of the mobile surveillance device 2 in the surveillance space 9.
- the relative pressure sensor barometric sensor
- the mobile surveillance device 2 may use one of the above mentioned sensing technologies to determine a travel altitude relative to a floor level and a ceiling level.
- An additional relative barometric pressure sensor would allow the mobile surveillance device 2 to determine the travel altitude on a coarser scale, for example on which level the mobile surveillance device 2 is travelling at in a building.
- the relative barometric pressure sensor could contribute to determine navigation paths in large areas, in areas with high ceiling heights, in airports and stadiums .
- the cited sensor technologies of the sensor unit support fulfilling the surveillance task as well as support navigation of the mobile surveillance device 2 in the surveillance space 9.
- the cited and further sensor technologies may assist the mobile surveillance device 2 to navigate into a coverage area of the at least one lighting device 4 and hence into a zone in which communication using VLC is possible. This may be of particular importance if the mobile surveillance device 2 left the coverage area of the lighting device 4 accidentally.
- the surveillance unit of the mobile surveillance device 2 includes an optical sensor unit which has night vision capability.
- the optical sensor unit operates for example in the infrared spectrum and acquires image information of a scene which is illuminated by infrared light.
- the infrared light is emitted by infrared lighting means either forming part of the sensor unit of the mobile surveillance device 2 or advantageously be integrated with one or more of the lighting devices 4.1, 4.2, 4.3.
- the plurality of lighting devices 4.1, 4.2, 4.3 is further linked via a lighting interface 15 with a lighting control unit 19 which provides the necessary power to the lighting devices 4.1, 4.2, 4.3 as well as provides a bi-directional data exchange capability for monitoring and controlling each of the lighting devices 4.1, 4.2, 4.3.
- a PIR motion detector interface 26 provides a data link capability as well as a power supply between the lighting control unit 19 and the PIR motion detector unit 6.
- the PIR motion detector interface 26, the lighting interface 15 and an interface between the lighting devices 4.1, 4.2, 4.3 and the PIR motion detector unit 6 may be based on a technical interface standard for network based systems for controlling lighting in building automation such as the digital addressable lighting interface (DALITM) .
- DALITM digital addressable lighting interface
- a VLC control unit 17 provides the lighting control unit 19 with a communication capability employing visible light communication (VLC) .
- the VLC control interface 18 between the VLC control unit 17 and the lighting control unit 19 is a bidirectional interface which receives on the one hand surveillance data acquired by the mobile surveillance device 2, transmitted via VLC communication to a VLC receiver portion of the communication unit in at least one of the lighting devices
- the surveillance data is then transferred to the surveillance control unit 15 for evaluation via the VLC surveillance interface 16.
- the VLC control unit 17 provides to the lighting control unit 19 via the VLC control interface 18, positional information forming the basis for the position signal emitted by the individual lighting devices 4.1,
- This position signal to be emitted by the individual lighting devices 4.1, 4.2, 4.3 and information on the respective location of the individual lighting devices 4.1, 4.2, 4.3 in the surveillance space 9 forms the basis for determining the position of the mobile surveillance device 2 in the surveillance space 9.
- the information including the location the individual lighting devices 4.1, 4.2, 4.3 is to be provided by the data storage unit 23 to the VLC control unit 17 via the VLC data base interface 22.
- the VLC control unit 17 of an embodiment can also use information including the location of the individual lighting devices 4.1, 4.2, 4.3 to control the transmission of mobile surveillance device control data via the lighting devices 4.1, 4.2, 4.3 in a targeted manner.
- a lighting device 4.1, 4.2, 4.3 in whose illumination area the mobile surveillance device 2 is actually moving may radiate via VLC communication surveillance control data to the mobile surveillance device 2.
- the surveillance control unit 13 provides a core control capability for the autonomous surveillance system 1.
- the surveillance control unit 13 receives motion detection reports from the PIR motion detector units 6, status reports from one or more mobile surveillance devices 2, surveillance data from one or more mobile surveillance devices 2.
- the surveillance control unit 15 is adapted to access the data storage unit 23 via the data storage interface 1 .
- the surveillance control unit 15 may record (store) and retrieve (read) data from the data storage unit 23.
- Data stored in the data storage unit 23 may comprise map data of the surveillance space 9, for example a floor plan, furniture locations, spatial data relating to the lighting system such as positions of the lighting devices 4.1, 4.2, 4.3, respective illumination areas of the individual lighting devices 4.1, 4.2, 4.3, location and coverage areas of the individual PIR motion detector units 6.
- the stored data in the data storage unit 23 may include time related data such as office hours, timetables of security requirements applicable to the surveillance space 9, external light conditions such as daylight or night.
- Data in the data storage unit 23 may include status information of the mobile surveillance device 2 such as availability, current location, remaining range due to energy storage reserve, capabilities of the sensor unit.
- the data storage unit 14 may also include data on surveillance missions such as predefined surveillance missions, for example regular patrolling schedules or predefined tasks for responding to a specific motion detection report or specific motion report pattern being received by the surveillance control unit 15.
- a mobile surveillance device base unit 28 is configured to provide shelter for the mobile surveillance device 2 when not moving and/or reloading its energy storage unit.
- the mobile surveillance device base unit 28 may include a connector for reloading the energy storage unit of the mobile surveillance device 2 and thus be connected to the mains power supply.
- the mobile surveillance device base unit 28 may be situated within the surveillance space 9 at a suitable location for moving within a short reaction time to possible surveillance positions 5.2.
- the mobile surveillance device base unit 28 may be equipped with a surveillance control interface 13 to the surveillance control unit 15 and may also have a mobile surveillance device interface 25 for directly communicating with the mobile surveillance device 2.
- the mobile surveillance device interface 25 may be implemented via a wired connection, a wireless link or integrated with the VLC communication interface between the mobile communication unit of the mobile surveillance device 2 and the communication unit of the lighting device 4.1, 4.2, 4.3.
- the mobile surveillance device 2 is an aerial vehicle, preferably with a capability to hover a certain time in a surveillance position 5.2.
- the mobile surveillance device 2 may for example be a micro aerial vehicle in form of a quadrocopter and designed to operate autonomously or semi-autonomously in the surveillance space 9.
- the mobile surveillance device 2 carries a payload specific to its surveillance mission.
- the payload includes a sensor unit which preferably may comprise one or more cameras or other sensors (detectors ) .
- the payload includes a mobile navigation unit which is adapted to control the motion of the mobile surveillance device 2 from one location in the surveillance space 9 to another location in the surveillance space 9.
- the mobile navigation unit is adapted to determine (calculate) the position of the mobile surveillance device 2 in the surveillance space 9 based on received light signals emitted from the VLC capable lighting devices 4.1, 4.2, 4.3.
- the received light signals may be in the visual light spectrum or alternatively in the infrared or ultraviolet range of the electromagnetic frequency spectrum.
- the mobile navigation unit determines a direction of movement in the three dimensions of the surveillance space 9, a movement speed or (movement speed profile) suitable to perform a specific surveillance task. Determining the position of the mobile surveillance device 2 may be performed by triangulation when evaluating the received light signals from different lighting devices 4.1, 4.2, 4.3 which emit respectively coded VLC IR or UV signals.
- the surveillance control unit 15 is configured to determine and to adapt a surveillance task. This surveillance task can be triggered for example by a motion detection report received via the lighting system from the PIR motion detection sensor 6.
- the surveillance control unit 15 accesses the data storage device 23 for acquiring the corresponding location information of the PIR motion sensor 6 data including information on availability and current location of the mobile surveillance device 2.
- the surveillance control unit 15 instructs a navigation unit 20 via a navigation interface 21 to determine a route to a suitable monitoring position 5.2.
- the navigation unit 20 may also read map data of the surveillance space 9 from the data storage unit 23 and further relevant data such as location data and envisaged further movement paths of other mobile surveillance devices 2 operating in the same surveillance space 9.
- the navigation unit 20 returns via the navigation interface 21 navigation data to the surveillance control unit 15.
- the surveillance control unit 15 generates the surveillance task information including the received navigation data from the navigation unit and communicates the generated surveillance task information to the mobile surveillance device 2.
- the generated surveillance task may preferably be communicated to the mobile surveillance device 2 by using the VLC communication link between the communication unit of the lighting device 4.1, 4.2, 4.3 and the mobile communication unit of the mobile surveillance device 2.
- the description of the preferred embodiment focuses on investigating a detected intrusion into a building representing the surveillance space 9. However it is to be understood that this represents only one out of plurality of applications of the claimed autonomous surveillance system 1 which employs mobile surveillance devices 2 in combination with a system backbone linked via lighting devices 4, 4.1, 4.2, 4.3 for communication and positioning purposes.
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB1808354.3A GB2559293B (en) | 2015-12-01 | 2016-11-17 | Flexible surveillance system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562261580P | 2015-12-01 | 2015-12-01 | |
US62/261,580 | 2015-12-01 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017093839A1 true WO2017093839A1 (en) | 2017-06-08 |
Family
ID=57396776
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2016/056936 WO2017093839A1 (en) | 2015-12-01 | 2016-11-17 | Flexible surveillance system |
Country Status (2)
Country | Link |
---|---|
GB (1) | GB2559293B (en) |
WO (1) | WO2017093839A1 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018010915A1 (en) * | 2016-07-12 | 2018-01-18 | Minimax Gmbh & Co. Kg | Method and unmanned vehicle for testing fire protection components |
WO2019137930A1 (en) * | 2018-01-11 | 2019-07-18 | Minimax Viking Research & Development Gmbh | Extinguishing robot |
IT201800021415A1 (en) * | 2018-12-28 | 2020-06-28 | Sisspre Soc It Sistemi E Servizi Di Precisione S R L | AID EQUIPMENT FOR THE TRACEABILITY OF AGRI-FOOD PRODUCTS |
EP3704679A1 (en) * | 2017-10-30 | 2020-09-09 | Carrier Corporation | Compensator in a detector device |
WO2021008721A1 (en) | 2019-07-15 | 2021-01-21 | Sew-Eurodrive Gmbh & Co. Kg | Method for operating a mobile system and an alarm gateway as subscribers in a wireless network |
WO2021247621A3 (en) * | 2020-06-02 | 2022-02-03 | Flir Unmanned Aerial Systems Ulc | Locomotion systems and methods for aerial vehicles |
DE102021211008A1 (en) | 2021-09-30 | 2023-03-30 | Robert Bosch Gesellschaft mit beschränkter Haftung | Room air monitoring device, room air monitoring system, base station and method for operating the room air monitoring device and/or the room air monitoring system |
US11790745B2 (en) | 2018-12-05 | 2023-10-17 | Carrier Corporation | Fire detection with data transmission |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080144884A1 (en) * | 2006-07-20 | 2008-06-19 | Babak Habibi | System and method of aerial surveillance |
WO2015179120A1 (en) * | 2014-05-20 | 2015-11-26 | Ooma, Inc. | Security monitoring and control |
-
2016
- 2016-11-17 GB GB1808354.3A patent/GB2559293B/en active Active
- 2016-11-17 WO PCT/IB2016/056936 patent/WO2017093839A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080144884A1 (en) * | 2006-07-20 | 2008-06-19 | Babak Habibi | System and method of aerial surveillance |
WO2015179120A1 (en) * | 2014-05-20 | 2015-11-26 | Ooma, Inc. | Security monitoring and control |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018010915A1 (en) * | 2016-07-12 | 2018-01-18 | Minimax Gmbh & Co. Kg | Method and unmanned vehicle for testing fire protection components |
US10832562B2 (en) | 2016-07-12 | 2020-11-10 | Minimax Gmbh & Co. Kg | Method and unmanned vehicle for testing fire protection components |
EP3704679A1 (en) * | 2017-10-30 | 2020-09-09 | Carrier Corporation | Compensator in a detector device |
WO2019137930A1 (en) * | 2018-01-11 | 2019-07-18 | Minimax Viking Research & Development Gmbh | Extinguishing robot |
US11790745B2 (en) | 2018-12-05 | 2023-10-17 | Carrier Corporation | Fire detection with data transmission |
IT201800021415A1 (en) * | 2018-12-28 | 2020-06-28 | Sisspre Soc It Sistemi E Servizi Di Precisione S R L | AID EQUIPMENT FOR THE TRACEABILITY OF AGRI-FOOD PRODUCTS |
WO2020136618A1 (en) * | 2018-12-28 | 2020-07-02 | Sisspre - Societa' Italiana Sistemi E Servizi Di Precisione S.R.L. | Equipment for aiding the traceability of agri-food products |
JP7374197B2 (en) | 2018-12-28 | 2023-11-06 | シッスプレ-ソシエタ イタリアーナ システミ エ セルヴィツィ ディ プレチジオーネ エセ.エレ.エレ. | Equipment to support traceability of agricultural products |
WO2021008721A1 (en) | 2019-07-15 | 2021-01-21 | Sew-Eurodrive Gmbh & Co. Kg | Method for operating a mobile system and an alarm gateway as subscribers in a wireless network |
WO2021247621A3 (en) * | 2020-06-02 | 2022-02-03 | Flir Unmanned Aerial Systems Ulc | Locomotion systems and methods for aerial vehicles |
DE102021211008A1 (en) | 2021-09-30 | 2023-03-30 | Robert Bosch Gesellschaft mit beschränkter Haftung | Room air monitoring device, room air monitoring system, base station and method for operating the room air monitoring device and/or the room air monitoring system |
Also Published As
Publication number | Publication date |
---|---|
GB2559293B (en) | 2021-10-27 |
GB2559293A (en) | 2018-08-01 |
GB201808354D0 (en) | 2018-07-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017093839A1 (en) | Flexible surveillance system | |
US10384351B2 (en) | Mobile robot with removable fabric panels | |
US11215986B2 (en) | Automated drone systems | |
US11209832B2 (en) | Elevator interactions by mobile robot | |
US11772270B2 (en) | Inventory management by mobile robot | |
US11782452B2 (en) | Surveillance prevention by mobile robot | |
US11720111B2 (en) | Automated route selection by a mobile robot | |
US20210337168A1 (en) | Contextual automated surveillance by a mobile robot | |
US11445152B2 (en) | Security automation in a mobile robot | |
KR101895811B1 (en) | A high performance large coverage surveillance system | |
US20180312255A1 (en) | Flying Service Equipment | |
CN105704437A (en) | Integrated camera awareness and wireless sensor system | |
US20210046655A1 (en) | Latency control in human operated mobile robot | |
WO2003016938A2 (en) | Distributed communications system | |
Stampa et al. | A scenario for a multi-UAV mapping and surveillance system in emergency response applications | |
CN112739619A (en) | Using an unmanned vehicle to locate assets deployed in a ceiling or floor space or other inconvenient space or equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16801596 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 201808354 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20161117 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1808354.3 Country of ref document: GB |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16801596 Country of ref document: EP Kind code of ref document: A1 |