EP3924870A1 - Procédé, dispositif, et système de détection d'objets dangereux - Google Patents

Procédé, dispositif, et système de détection d'objets dangereux

Info

Publication number
EP3924870A1
EP3924870A1 EP20703042.0A EP20703042A EP3924870A1 EP 3924870 A1 EP3924870 A1 EP 3924870A1 EP 20703042 A EP20703042 A EP 20703042A EP 3924870 A1 EP3924870 A1 EP 3924870A1
Authority
EP
European Patent Office
Prior art keywords
surveillance
unmanned aerial
aerial vehicle
surveillance device
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20703042.0A
Other languages
German (de)
English (en)
Inventor
Jaanus Tamm
Kalev SARAPU
Vladimir NEPOCHATOV
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Defsecintel Solutions Oue
Original Assignee
Defsecintel Solutions Oue
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Defsecintel Solutions Oue filed Critical Defsecintel Solutions Oue
Publication of EP3924870A1 publication Critical patent/EP3924870A1/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G06V20/13—Satellite images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G06V20/17—Terrestrial scenes taken from planes or by drones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Definitions

  • the invention relates to security. More specifically, the invention relates to detecting and surveilling hazardous objects in a sector.
  • United States patent application 2018/0150087 A1 discloses a tagging drone (TD) that responds to a received query of availability initiated from a command and control drone (CCD) or command and control station (CCS), over a network, for investigating or tagging a designated target.
  • the TD receives one or more dispatching instructions and heads to the designated target.
  • the TD performs tagging of the designated target and determines whether the designated target was successfully tagged as a tagged target.
  • the tagged target is tracked and tracking data is provided for recovery resource capture of the tagged target.
  • the present invention relates to a method for detecting hazardous objects in a sector.
  • the method can comprise the steps of capturing data corresponding to a sector, analyzing captured data via an object detection algorithm, detecting at least one predetermined object at a first location based on the analyzed data, assigning an importance parameter to the detected object and in response to the importance parameter exceeding a set or self-adjusted or self-learned threshold, classifying the detected object as a hazardous object and deploying an unmanned aerial vehicle to the first location.
  • the data captured can be any kind of data that can be used to detect an object, such as a human being, animal, any manmade structure.
  • the data can comprise at least one of electromagnetic sensor data, particle sensor data, acoustic sensor data etc., video data, photographic data, infrared data, ultrasonic data, radar data, any kind of derived data etc.
  • the detection algorithm can comprise any detection of an object on the basis of the before- mentioned data.
  • the capturing data can be done by a sensor component, the analyzing, the detecting, and/or the classifying by a processing component. It can further comprise at least one of visual images, infrared (IR) images, and thermal images.
  • the sensor component can thus be sensitive to one or more electromagnetic wave lengths.
  • the predetermined object can particularly comprise at least one of a person; and a land borne, seaborne and/or airborne vehicle, and a land borne, seaborne and/or airborne mobile robot; and a chemical component or composition.
  • the importance parameter can be assigned based on a type of detected object.
  • the importance parameter can be assigned based at least partially on the first location. Additionally or alternatively, it can be assigned based at least partially on a detection of an individual or aggregated amount, size, speed, volume and/or a predetermined combination of detected objects.
  • the importance parameter can be assigned based at least partially on behavior of the detected object.
  • the importance parameter can be trained by a machine learning algorithm on the basis of positive and/or negative training data.
  • the present invention can also comprise the step of triggering an alert in response to the importance parameter exceeding a set threshold . It can further comprise the step of notifying a remote operator in response to the importance parameter exceeding a threshold, preferably a set or machined learned threshold.
  • the present invention can further comprise the step of, prior to deploying an unmanned aerial vehicle, assessing at least one environmental condition.
  • This environment condition comprises at least one of precipitation, chemical parameters, physical parameters, wind speed, and ambient light.
  • the chemical parameters could be any toxic or harmful compositions of unallowed warfare and could particularly positively trigger the deployment of the unmanned vehicles.
  • a charting a course to the hazardous object Prior to deploying the unmanned aerial vehicle, a charting a course to the hazardous object can be done. A charting of the unmanned aerial vehicle's course can be based on the assessed environmental condition.
  • An instructing of the unmanned aerial vehicle to navigate to a second location can also be realized while en route to the first location, the second location corresponding to a hazardous object's new location.
  • the present invention can prior to deploying the unmanned aerial vehicle further comprise the steps of verifying battery status of at least two unmanned aerial vehicles by a verifying component, and selecting the unmanned aerial vehicle to deploy based on the battery status by a selecting component.
  • the unmanned aerial vehicle can be configured for travelling with a speed of at least 150 km/h to the first location.
  • the speed can even be around 250 km/h.
  • the unmanned aerial vehicle can be configured for arriving to the first location within 5 minutes, preferably within 3 minutes of the designation of the hazardous object. This provides a reliable and fast enough monitoring of the section at issue.
  • these are particularly configured to take a top speed of at least 150 km/h, even to around 250 km/h as well.
  • the unmanned aerial vehicle can be configured for initiating data collection upon arrival to the first location wherein further data collection comprises capturing a plurality of images corresponding to the hazardous object.
  • the method can further comprise the unmanned aerial vehicle to broadcast at least one message upon arrival to the first location.
  • is can transmit the at least one message upon detection of the hazardous object of during the commuting back.
  • the present invention can further comprise the step of recalling to unmanned aerial vehicle while en route to the first location in response to at least one of the detected object no longer classified as a hazardous object and the hazardous object moving outside of a predetermined geographical sector.
  • predicting likely future locations associated with future hazardous objects can be also comprised.
  • the present invention also comprises a surveillance device for detecting hazardous objects, the device comprising at least one sensor configured to capture data corresponding to a sector at least one processing component configured to analyze captured data via an object detection algorithm, detect at least one predetermined object at a first location in the analyzed data, assign an importance parameter to the detected object, in response to the importance parameter exceeding a set threshold, classifying the detected object as a hazardous object and deploying an unmanned aerial vehicle to the first location.
  • a surveillance device for detecting hazardous objects
  • the device comprising at least one sensor configured to capture data corresponding to a sector at least one processing component configured to analyze captured data via an object detection algorithm, detect at least one predetermined object at a first location in the analyzed data, assign an importance parameter to the detected object, in response to the importance parameter exceeding a set threshold, classifying the detected object as a hazardous object and deploying an unmanned aerial vehicle to the first location.
  • the device can further comprise a ground station, a body, and/or a dock configured for an unmanned aerial vehicle.
  • the sensor can comprise at least one of a visual camera, an IR camera and a thermal camera.
  • It can further comprise a communication component wherein the communication component can be configured to communicate with a remote server.
  • the processing component can be further configured to transmit an alert via the communication component wherein the processing component can be further configured to transmit data associated with the hazardous object.
  • the device can further comprise an enclosed compartment configured to store at least one unmanned aerial vehicle wherein the compartment can be temperature controlled and can comprise a lid configured to open and close automatically, and/or a battery station.
  • the battery station can comprise a battery swapping component configured to exchange unmanned aerial vehicle's battery.
  • the battery station can additionally or alternatively comprise a battery charger configured to charge batteries of the unmanned aerial vehicle.
  • the device can further comprise at least one ambient sensor wherein the ambient sensor can be configured to detect ambient conditions in its surroundings.
  • the device can further comprise a surveillance module wherein the surveillance module can comprises a shaft, preferably a telescoping shaft, configured to extend to a height of at least 10m, preferably at least 15m, more preferably at least 20 m.
  • the surveillance module can comprises a shaft, preferably a telescoping shaft, configured to extend to a height of at least 10m, preferably at least 15m, more preferably at least 20 m.
  • the surveillance module can comprise at least one idle position and at least one active position wherein in the idle position, the surveillance module can be arranged significantly flush with the body.
  • the surveillance module In the active position the surveillance module can protrude substantially vertically from the body wherein in the active position the surveillance module extends from the body by at least 10m, preferably at least 15m, such as at least 20m.
  • the sensor can be arranged on the surveillance module.
  • a motion component can be configured to propel the surveillance device in a direction.
  • the device can further comprise a trailer on which all components are arranged so that the trailer is configured to dislocate.
  • the present invention is also related to a system for surveying a sector.
  • This system can be particularly adapted to carry out any of the method steps described before and below and claimed.
  • the system can comprise at least one surveillance device comprising a body, at least one sensor configured to capture data corresponding to a sector, a dock for an unmanned aerial vehicle, and at least one unmanned aerial vehicle configured to dock at the surveillance device and to be deployed from the surveillance device.
  • the surveillance device can further can further comprise a processing component configured to analyze sensor data via an object detection algorithm, detect at least one predetermined object at a first location in the analyzed data, assign an importance parameter to the detected object, in response to the importance parameter exceeding a set threshold, classifying the detected object as a hazardous object and deploying the unmanned aerial vehicle to the first location.
  • a processing component configured to analyze sensor data via an object detection algorithm, detect at least one predetermined object at a first location in the analyzed data, assign an importance parameter to the detected object, in response to the importance parameter exceeding a set threshold, classifying the detected object as a hazardous object and deploying the unmanned aerial vehicle to the first location.
  • the unmanned aerial vehicle can be configured to reach any point within the sector in a time shorter than a predetermined time after classification of the detected object as the hazardous object.
  • the unmanned aerial vehicle can be a drone that is capable of fulfilling the requirements as set out before and below.
  • the predetermined time interval can comprise 10 minutes, preferably 5 minutes, more preferably 3 minutes wherein the unmanned aerial vehicle an be further configured to travel with a top speed of at least 100 km/h, preferably at least 150 km/h, more preferably at least 200 km/h, such as 250 km/h.
  • the body can comprise an enclosed compartment configured to store the unmanned aerial vehicle wherein the enclosed compartment can comprise a lid and the surveillance device can be configured to open the lid so as to release and the unmanned aerial vehicle and close the lid after its departure.
  • the dock can be arranged within the enclosed compartment.
  • the surveillance device can further comprise a battery station configured for at least one of exchanging a battery of an unmanned aerial vehicle and/or charging a battery of an unmanned aerial vehicle.
  • the system according to the present invention can also comprise a second unmanned aerial vehicle configured to dock at the surveillance device and wherein the surveillance device can be configured to monitor a battery status of the two unmanned aerial vehicles and arrange at least one of battery exchange and battery charging so that at least one of the two unmanned aerial vehicles has a charged battery at any time.
  • Thee surveillance device can further comprise at least one ambient sensor wherein the ambient sensor can be configured to detect ambient conditions around the surveillance device.
  • the surveillance device can be configured to analyze the detected ambient conditions and abort deploying the unmanned aerial vehicle if the ambient conditions are unsuitable for it.
  • the surveillance device can be configured to track the hazardous object.
  • the surveillance device can be further configured to send updated information regarding the hazardous object to the unmanned aerial vehicle while it is en route to the first location.
  • the surveillance device can be configured to reroute the unmanned aerial vehicle to a second location while it is en route to the first location in response to detecting that the hazardous object has moved.
  • the unmanned aerial vehicle can further comprise at least one UAV sensor and can be configured to start transmitting data from the UAV sensor to the surveillance device upon approach to the first location.
  • At least one remote sensing device can be configured to at least detect predetermined objects and placed within the sector at a location different from the surveillance device and wherein the remote sensing device is configured to alert the surveillance device upon detection of a predetermined object.
  • the surveillance device can be configured to deploy the unmanned aerial vehicle in response to an alert from the remote sensing device.
  • system can comprise a remote server that is configured to store and/or process information submitted by the surveillance device.
  • the remote server can be configured to communicate with the surveillance device and wherein the communication comprises at least one of sending instructions to the surveillance device and/or receiving data from the surveillance device.
  • the remote server can be configured to predict likely future hazardous objects based on analyzing previously classified hazardous objects.
  • the server can be further configured to predict likely future locations of hazardous objects.
  • a system for detecting hazardous objects can further comprise a plurality of surveillance devices as described before and below, each surveillance device assigned to a different sector, a plurality of unmanned vehicles, each unmanned vehicle assigned to at least one surveillance device wherein the surveillance devices are configured to communicate with each other.
  • the surveillance devices can be configured to modify assignment of unmanned vehicles.
  • the surveillance devices can be further configured to exchange data related to at least one of ambient conditions, ongoing unmanned aerial vehicles' deployment, detected hazardous objects in a sector, and/or movement of hazardous objects from one sector to another.
  • the device or system as described before or below can be further configured to automatically modify assignment of the aerial vehicles according to demand and to control the relocation of the aerial vehicles.
  • the aerial vehicles can then be controlled to leave one surveillance device it is assigned to and located in or at to another surveillance device. This can be also done en route of one aerial vehicle so that it returns to a different surveillance device than the one it has started from.
  • the device or the system can also comprise an automatic guiding component for independently guiding the aerial vehicles to the surveillance device. This would enable a guiding even in case other means of navigation, such as the GPS signal, are not available.
  • a method for detecting hazardous objects in a sector comprising
  • M7 The method according to any of the preceding embodiments wherein the importance parameter is assigned based at least partially on a detection of an individual or aggregated amount, size, speed, volume and/or a predetermined combination of detected objects.
  • M8 The method according to any of the preceding embodiments wherein the importance parameter is assigned based at least partially on behavior of the detected object.
  • a surveillance device for detecting hazardous objects comprising
  • At least one sensor configured to capture data corresponding to a sector
  • At least one processing component configured to
  • the device according to the preceding embodiment comprising a ground station.
  • the device according to any of the preceding device embodiments further comprising a body.
  • the device according to any of the preceding device embodiments further comprising a dock configured for an unmanned aerial vehicle.
  • the senor comprises at least one of a visual camera, an IR camera and a thermal camera.
  • the device according to any of the preceding device embodiments further comprising a communication component.
  • D7 The device according to the preceding embodiment wherein the communication component is configured to communicate with a remote server.
  • D8 The device according to any of the two preceding embodiments wherein the processing component is further configured to transmit an alert via the communication component.
  • the device according to any of the preceding device embodiments further comprising an enclosed compartment configured to store at least one unmanned aerial vehicle.
  • the compartment comprises a lid configured to open and close automatically.
  • the device according to any of the preceding device embodiments further comprising a battery station.
  • the battery station comprises a battery swapping component configured to exchange unmanned aerial vehicle's battery.
  • the battery station further comprises a battery charger configured to charge batteries of the unmanned aerial vehicle.
  • the device according to any of the preceding device embodiments further comprising at least one ambient sensor.
  • D17 The device according to the preceding embodiment wherein the ambient sensor is configured to detect ambient conditions in its surroundings.
  • the device according to any of the preceding device embodiments further comprising a surveillance module.
  • the surveillance module comprises a shaft, preferably a telescoping shaft, configured to extend to a height of at least 10m, preferably at least 15m, more preferably at least 20 m.
  • the device according to any of the preceding device embodiments further comprising a motion component configured to propel the surveillance device in a direction.
  • the device according to any of the preceding device embodiments further comprising a trailer on which all components are arranged so that the trailer is configured to dislocate.
  • the device according to any of the preceding device embodiments further comprising an automatic guiding component for independently guiding the aerial vehicles to the surveillance device.
  • a system for surveying a sector comprising
  • At least one surveillance device comprising
  • At least one sensor configured to capture data corresponding to a sector; a dock for an unmanned aerial vehicle;
  • At least one unmanned aerial vehicle configured to dock at the surveillance device and to be deployed from the surveillance device.
  • the system according to the preceding embodiment wherein the predetermined time interval comprises 10 minutes, preferably 5 minutes, more preferably 3 minutes.
  • the unmanned aerial vehicle is configured to travel with a top speed of at least 100 km/h, preferably at least 150 km/h, more preferably at least 200 km/h, such as 250 km/h.
  • the body comprises an enclosed compartment configured to store the unmanned aerial vehicle.
  • the enclosed compartment comprises a lid and the surveillance device is configured to open the lid so as to release and the unmanned aerial vehicle and close the lid after its departure.
  • the system according to the preceding embodiment further comprising a second unmanned aerial vehicle configured to dock at the surveillance device and wherein the surveillance device is configured to monitor battery status of the two unmanned aerial vehicles and arrange at least one of battery exchange and battery charging so that at least one of the two unmanned aerial vehicles has a charged battery at any time.
  • the surveillance device further comprises at least one ambient sensor and wherein the ambient sensor is configured to detect ambient conditions around the surveillance device.
  • the surveillance device is configured to send updated information regarding the hazardous object to the unmanned aerial vehicle while it is en route to the first location.
  • 514 The system according to any of the two preceding embodiments wherein the surveillance device is configured to reroute the unmanned aerial vehicle to a second location while it is en route to the first location in response to detecting that the hazardous object has moved.
  • the unmanned aerial vehicle further comprises at least one UAV sensor and is configured to start transmitting data from the UAV sensor to the surveillance device upon approach to the first location.
  • the system according to any of the preceding system embodiments further comprising at least one remote sensing device configured to at least detect predetermined objects and placed within the sector at a location different from the surveillance device and wherein the remote sensing device is configured to alert the surveillance device upon detection of a predetermined object.
  • a system for detecting hazardous objects comprising
  • a plurality of surveillance devices according to any of the device claims, each surveillance device assigned to a different sector;
  • a plurality of unmanned vehicles each unmanned vehicle assigned to at least one surveillance device;
  • surveillance devices are configured to communicate with each other.
  • the system according to any of the preceding system embodiments further comprising an automatic guiding component for independently guiding the aerial vehicles to the surveillance device.
  • Figure 1 depicts a schematic embodiment of a surveillance device according to an embodiment of the invention
  • Figure 2 schematically depicts a system for detecting hazardous objects in a sector
  • Figure 3 shows a flowchart embodying a method for detecting hazardous objects in a sector
  • Figure 4 illustrates one possible embodiment corresponding to a method for detecting hazardous objects in a sector
  • Figure 5 shows another schematic embodiment of a surveillance device according to an embodiment of the invention
  • Figure 6 depicts another schematic embodiment of a surveillance device according to an embodiment of the invention.
  • Figure 1 schematically depicts an embodiment of a surveillance device 1 according to an aspect of the present invention.
  • the surveillance device 1 can be used to monitor and survey a certain region or sector and to detect hazardous objects, which may correspond to intruders in the sector.
  • the surveillance device 1 is depicted as a ground station 1.
  • the surveillance device 1 comprises a body 2, which may have any convenient shape and may be manufactured out of plastic, metal, or another material.
  • the surveillance device comprises a sensor 4, which can collect data relating to the surveillance device's 1 surroundings.
  • the sensor 4 may comprise a camera, such as a high- resolution camera and/or a plurality of cameras.
  • the sensor 4 may comprise a high-resolution camera for daytime surveillance and an infrared camera for nighttime surveillance.
  • the camera(s) can monitor a section or can alone or in concert with each other monitor 360°.
  • the camera(s) can also configured to capture light, infrared and/or thermal signals.
  • the sensor 4 may be fitted on a surveillance module 12.
  • the surveillance module 12 can comprise a shaft 14.
  • the surveillance module 12 can, in a concrete example, comprise a telescoping or extending part (which, in the fully extended position comprises the shaft 14), and one or more sensors located on top of the extending part, in such a way that the sensors may survey the surroundings from a height.
  • the shaft 14 may comprise a telescoping or extendable rod, antenna, or the like.
  • the surveillance module 12 may be configured so that it has at least one active and idle positions.
  • Figure 1 schematically shows the surveillance module 12 in an active position, with the shaft 14 fully extended and the sensor 4 placed at the top part.
  • the sensor 4 preferably comprising at least one camera, may survey a larger area, as it is placed at a height.
  • the shaft 14 may extend to a height of at least 10 m, preferably at least 15 m, such as at least 20 m above the ground.
  • the surveillance device 1 further comprises a processing component 6 and a communication component 8, depicted schematically in the drawing.
  • the processing component 6 preferably comprises a computing device, such as a central processing unit, system on a chip, or the like.
  • the processing component 6 can generally control and coordinate the operation of the surveillance device 1.
  • the communication component 8 may comprise one or more communication modules. For example, a short-range communication module such as a Bluetooth, WiFi or a similar protocol-enabled module may be used for communication in the range below 10km, and a long-range communication module such as a SIM-Card, Modem or the like may be used for communication in the range above 10km.
  • the surveillance device 1 further comprises an optional ambient sensor 10.
  • the ambient sensor 10 may sense ambient conditions around the surveillance device 1.
  • the ambient sensor 10 may detect weather conditions such as wind speed, precipitation, dust or sand storms, humidity, temperature and the like.
  • the surveillance device 1 as shown in figure 1 further comprises a motion component 16, depicted as wheels.
  • the motion component 16 can also comprise tracks or the like.
  • the motion component 16 can be used to propel the surveillance device 1 from one location to another. It may be used to bring the surveillance device 1 to its location of operation.
  • the transfer of the surveillance device 1 can also be realized as an autonomous or semi-autonomous or remote controlled drive.
  • the surveillance device 1 is preferably stationary, but it may move between different operational locations.
  • the surveillance device 1 as depicted also comprises an energy component 18. It is shown as a solar cell.
  • the energy component 18 may also comprise one or more batteries, one or more wind turbines, or other components.
  • the compartment 20 can preferably be an enclosed compartment with a lid 22.
  • the lid 22 may be controlled by the processing component 6 to open or close.
  • the compartment 20 may house one or more unmanned aerial vehicles 100.
  • the aerial vehicles 100 may dock to a dock 24 when not in use.
  • There may be further a battery station within the compartment 20.
  • the battery station may have a battery swapping component 32 and a battery charger 34.
  • the battery swapping component 32 may be used to swap or change a battery 102 of the unmanned aerial vehicle 100.
  • the battery charger 34 may be used to charge the battery 102 of the unmanned aerial vehicle 100, either while the battery 102 is placed within the unmanned aerial vehicle 100, or when it is removed as shown in figure 1.
  • the compartment can comprise a rapid charger for rapidly charging the battery/batteries of the aerial vehicle(s) 100.
  • the unmanned aerial vehicles 100 can be released from the surveillance device 1 (via the lid 22 of the compartment 20) upon detection of a hazardous object within the surveillance device's 1 sector. Such a hazardous object may then be investigated by the unmanned aerial vehicle 100 from close-by, whereupon its status or classification as a hazardous object may be maintained or revoked. In other words, the unmanned aerial vehicle 100 may approach a hazardous object detected by the surveillance device 1 for further investigation.
  • the unmanned aerial vehicle 100 is a drone configured to navigate with a speed of at least 100 km/h, preferably 150 km/h. This advantageously allows for very quick investigation of a potential intruder or threat by the unmanned aerial vehicle 100.
  • FIG. 2 schematically depicts an embodiment of a surveillance device 1 in operation.
  • Two neighbouring sectors 70, 70' are shown.
  • Each sector 70, 70' has a surveillance device 1, 1' monitoring it.
  • the sectors may correspond to a geographical area with a radius of 5-20 km, preferably 5-15 km.
  • the sectors may be partially intersecting, and may have any shape (such as circular, elliptical and the like).
  • the sectors may also be of different sizes and shapes, depending on local topography, vegetation, buildings and the like.
  • the surveillance device 1, monitoring sector 70 has detected several predetermined objects 42.
  • the predetermined objects 42 may correspond to objects such as persons, vehicles, mobile robots, and the like.
  • the predetermined objects 42 may also correspond to an arbitrary moving object with certain predetermined characteristics (such as size, speed of movement, general shape and the like).
  • the detection of the predetermined objects can be done by analysing data from the sensor 4, which preferably comprises visual images. Such images can be analysed by an object-detection algorithm on the processing component 6, and predetermined objects 42 can be identified.
  • the object-detection algorithm can be preferably a neural network-based algorithm.
  • the surveillance device 1 can also classify some of the detected predetermined objects 42 as hazardous objects 62. This can be done by a computer and a respective classification software. Signals, such as camera signals, can be streamed, analysed and, if decided manually or automatically by the software, send out. Meta data can be added or can be sent out without the camera signals instead. This would make the message shorter and easier and faster to be submitted. Such classification may be based on several parameters assigned a certain weight. For instance, location of the detected objects, a certain combination of the detected objects, movement patterns of the detected objects can all be used to classify a detected predetermined object 42 as a hazardous object 62. In the figure, the hazardous object 62 is shown as a first location 72.
  • the surveillance device 1 may dispatch an unmanned aerial vehicle 100 to the first location 72 to investigate the hazardous object 62.
  • the surveillance device 1' shown in the sector 70' has only detected predetermined objects 42, and not classified any of them as hazardous objects 62 (for example, the predetermined objects 42 may correspond to known and authorized persons or vehicles, animals, known and authorized mobile robots and the like).
  • the unmanned aerial vehicle 100' corresponding to the surveillance device 1' is shown docked to the surveillance device 1', ready to be deployed if a hazardous object 62 is identified.
  • Figure 3 depicts a schematic embodiment of a method for detecting hazardous objects, shown as a schematic algorithm.
  • a predetermined object is detected, it is assigned an importance parameter.
  • Such a parameter may be based on several factors such as location of detection, movement patterns, time of day, a certain combination of predetermined objects and the like. Different weights may be assigned to different factors. Such weights may be constantly updated. If no predetermined object is detected, previous task of capturing and analysing data is resumed.
  • an importance parameter is assigned to a detected predetermined object, it is evaluated whether the parameter exceeds a certain predetermined threshold. If it does not, the object is classified as predetermined object and the previous task is resumed. The object is then still monitored, and its importance parameter continuously updated to reflect any ongoing changes (such as movement).
  • the predetermined object is classified as a hazardous object. This then leads to UAV deployment for further investigation of the hazardous object. Additionally, an alert may be raised, and a remote operator may be contacted.
  • the steps of the method as shown in figure 3 may be performed by the surveillance device 1, particularly by its processing component 6 (with the data captured by the sensor 4).
  • Figure 4 schematically depicts the implementation of the method for detecting hazardous objects.
  • Sketches a, b, c, d show a progression in a time of an event.
  • Sketch a shows a surveillance device 1 that has detected a predetermined object 42 at a first location 72.
  • the predetermined object 42 may have just entered sector 70 (denoted by the borders of the sketch).
  • the surveillance device 1 can also comprise software with machine learning software that optimizes the transmission decision.
  • Sketch b depicts the surveillance device 1 classifying the detected predetermined object 42 as a hazardous object 62. This can be based, for example, on the first location 72 where the predetermined object 42 has been detected, on the nature of the predetermined object 42 (such as a group of people for example), on the movement pattern of the predetermined object 42, on the time of day, on a combination of these factors, or the like.
  • the surveillance device 1 deploy an unmanned aerial vehicle 100 to the first location 72 to further investigate the hazardous object 62. While the unmanned aerial vehicle 100 is en route to the first location 72, the surveillance device 1 detects that the hazardous object 62 has moved to a second location 74.
  • the surveillance device 1 instructs the unmanned aerial vehicle 100 to navigate to the second location 74 where the hazardous object 62 has moved.
  • the unmanned aerial vehicle 1 may start transmitting sensor data such as a video stream or images back to the surveillance device 1.
  • the surveillance device 1 may then analyse this data and/or send it to a remote server or operator for further analysis.
  • FIG. 5 shows another schematic embodiment of a surveillance device 1 according to an aspect of the invention.
  • the surveillance module 12 comprising a shaft 14 are shown.
  • a sensor 4 is placed at the top of the shaft 14 on the surveillance module 12.
  • the sensor 4 may comprise a visual camera, an infrared camera, or a plurality of cameras. Additionally, a radar sensor may be used together with the visual camera.
  • the surveillance module 12 is shown in an active position, where the shaft 14 is fully expanded and monitoring of the surroundings can be performed. During transport or storage, the shaft 14 may be collapsed or telescoped so as to be generally flush with the body 2 of the surveillance device 1.
  • Compartment 20 is shown, along with the lid 22.
  • the compartment may comprise the unmanned aerial vehicle, its dock, a battery station and the like (not shown).
  • the compartment may also be temperature controlled (in all embodiments of the surveillance device 1).
  • An energy component 18 is shown, depicted as a solar cell.
  • the energy component 18 may supply power to the surveillance device 1.
  • a motion component 16 depicted as wheels.
  • the surveillance device 1 can be advantageously moved from one position to another by using the motion component 16.
  • FIG. 6 depicts another schematic embodiment of the surveillance device 1.
  • the surveillance device 1 of figure 6 is shown with a surveillance module 12 extending above the surveillance device 1 via a shaft 14.
  • the shaft can telescope to make it more compact for transport of the device 1.
  • Attached to the shaft 14 is a fixing component 142 which comprises a plurality of cables or the like with one end attached to the shaft 14 and another configured to be fixed to the ground, soil, or the like. In this way, the surveillance module 12 may remain stable even when significantly exceeding the height of the surveillance device's body.
  • first option and a second option is intended to mean the first option or the second option or the first option and the second option.
  • a relative term such as “about”, “substantially” or “approximately” is used in this specification, such a term should also be construed to also include the exact term. That is, e.g., “substantially straight” should be construed to also include “(exactly) straight”.
  • step (X) preceding step (Z) encompasses the situation that step (X) is performed directly before step (Z), but also the situation that (X) is performed before one or more steps (Yl), ..., followed by step (Z) .
  • step (X) preceding step (Z) encompasses the situation that step (X) is performed directly before step (Z), but also the situation that (X) is performed before one or more steps (Yl), ..., followed by step (Z) .
  • Corresponding considerations apply when terms like "after” or "before” are used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Remote Sensing (AREA)
  • Astronomy & Astrophysics (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention concerne un procédé, un dispositif, et un système de détection d'objets dangereux dans un secteur. Ce procédé peut comprendre les étapes consistant à : capturer des données correspondant à un secteur ; analyser les données capturées par l'intermédiaire d'un algorithme de détection d'objet ; détecter au moins un objet prédéterminé à un premier emplacement sur la base des données analysées ; attribuer un paramètre d'importance à l'objet détecté et en réponse au paramètre d'importance dépassant un seuil réglé ou auto-réglé ou auto-appris,classifier l'objet détecté en tant qu'objet dangereux et déployer un véhicule aérien sans pilote vers ce premier emplacement. Les données de capture peuvent être réalisées par un composant capteur, l'analyse, la détection et/ou la classification par un composant de traitement. Ces données peuvent en outre comprendre au moins une image d'images visuelles et/ou d'images infrarouges (IF) et/ou d'images thermiques. Le composant de capteur peut ainsi être sensible à au moins une longueur d'onde électromagnétique. L'objet prédéterminé peut comprendre au moins une personne et/ou un véhicule terrestre, maritime et/ou aérien, et/ou un robot mobile terrestre, maritime et/ou aérien, et/ou un composant ou une composition chimique.
EP20703042.0A 2019-02-15 2020-02-07 Procédé, dispositif, et système de détection d'objets dangereux Pending EP3924870A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP19157524 2019-02-15
PCT/EP2020/053175 WO2020165050A1 (fr) 2019-02-15 2020-02-07 Procédé, dispositif, et système de détection d'objets dangereux

Publications (1)

Publication Number Publication Date
EP3924870A1 true EP3924870A1 (fr) 2021-12-22

Family

ID=65443781

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20703042.0A Pending EP3924870A1 (fr) 2019-02-15 2020-02-07 Procédé, dispositif, et système de détection d'objets dangereux

Country Status (2)

Country Link
EP (1) EP3924870A1 (fr)
WO (1) WO2020165050A1 (fr)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9947215B2 (en) * 2014-09-26 2018-04-17 Harman International Industries, Incorporated Pedestrian information system
IL246386B (en) * 2016-06-22 2018-03-29 Tarantula Tech Ltd A device for identifying dangerous objects located at a certain distance from a surface
US10279908B2 (en) 2016-11-29 2019-05-07 Patrick ENOS Border surveillance and tagging unauthorized targets using drone aircraft and sensors

Also Published As

Publication number Publication date
WO2020165050A1 (fr) 2020-08-20

Similar Documents

Publication Publication Date Title
Flammini et al. Railway infrastructure monitoring by drones
Berrahal et al. Border surveillance monitoring using quadcopter UAV-aided wireless sensor networks
US11320829B2 (en) Battery powered artificial intelligence autonomous patrol vehicle
US11656633B2 (en) Determining method of article transfer place, determining method of landing place, article transfer system, and information processing device
CN109333504A (zh) 一种巡逻机器人和巡逻机器人管理系统
KR101895811B1 (ko) 고성능 광역 감시 시스템
CN110082782A (zh) 一种危化品园区巡检系统及其实现方法
JP7047374B2 (ja) 情報収集システム
US20120215383A1 (en) Security control apparatus, track security apparatus, autonomous mobile robot apparatus, and security control service system and method
CN109740462B (zh) 目标的识别跟随方法
CN114115296B (zh) 一种重点区域智能巡检与预警系统及方法
KR102335994B1 (ko) 드론 감시를 위한 촬영 감시 장치들의 통합 제어 장치
CN113554775B (zh) 无人机电力巡检系统
US20090276110A1 (en) System and Method for Detecting Reflection with a Mobile Sensor Platform
JP6748797B1 (ja) 無人航空機制御システム、無人航空機制御方法、及びプログラム
Krishna et al. Autonomous human detection system mounted on a drone
KR20170098082A (ko) 드론을 이용한 물류관리 시스템
KR200487177Y1 (ko) 드론을 이용한 물류관리 장치
CN113625773A (zh) 一种无人机应急消防森林巡防指挥系统
KR20150031530A (ko) 무인 항공 감시 장치를 이용한 영상 감시 방법 및 장치
CN107045805B (zh) 一种用于小型航空器和空飘物的监测方法及系统
CN113568428A (zh) 一种基于多无人机协同的校园安防方法及系统
EP3924870A1 (fr) Procédé, dispositif, et système de détection d'objets dangereux
KR101802612B1 (ko) 이동형 로봇의 모니터링시스템
KR20220029809A (ko) 긴급 상황 정보에 따라 정찰 비행 패턴을 결정하는 드론을 이용한 보안 서비스 제공 장치

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210910

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230601

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230907

RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: DEFSECINTEL SOLUTIONS OUE