EP2264677B1 - Method for fire prevention and/or detection, and monitoring system and computer product thereof - Google Patents

Method for fire prevention and/or detection, and monitoring system and computer product thereof Download PDF

Info

Publication number
EP2264677B1
EP2264677B1 EP10165726A EP10165726A EP2264677B1 EP 2264677 B1 EP2264677 B1 EP 2264677B1 EP 10165726 A EP10165726 A EP 10165726A EP 10165726 A EP10165726 A EP 10165726A EP 2264677 B1 EP2264677 B1 EP 2264677B1
Authority
EP
European Patent Office
Prior art keywords
detection means
video camera
video cameras
control unit
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10165726A
Other languages
German (de)
French (fr)
Other versions
EP2264677A1 (en
Inventor
Giorgio Pelosio
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Teletron Euroricherche SRL
Original Assignee
Teletron Euroricherche SRL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Teletron Euroricherche SRL filed Critical Teletron Euroricherche SRL
Publication of EP2264677A1 publication Critical patent/EP2264677A1/en
Application granted granted Critical
Publication of EP2264677B1 publication Critical patent/EP2264677B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00Fire alarms; Alarms responsive to explosion
    • G08B17/12Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Fire-Detection Mechanisms (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Fire-Extinguishing By Fire Departments, And Fire-Extinguishing Equipment And Control Thereof (AREA)
  • Alarm Systems (AREA)

Description

  • The present invention relates to a method for fire prevention and/or detection according to the preamble of claim 1. Such method is disclosed in US 2007 000317 .
  • In addition, the present invention also relates to a monitoring system and a computer product adapted to implement said method.
  • It is known in the art that the electromagnetic spectrum (or EM spectrum) is the interval of all possible frequencies of radiations, which are electromagnetic waves characterized by a wavelength and a frequency; since wavelength and frequency of a radiation are inversely proportional to each other, the shorter the wavelength the higher the frequency, and thus the energy.
  • Human beings can perceive with their eyes wavelengths in the range of 380 to 760 nanometres (nm), which are called "visible light".
  • Shorter wavelengths correspond to ultraviolet rays, X-rays and gamma rays, all of which have frequencies higher than visible light, and therefore more energy than the latter. On the contrary, the wavelengths of radio waves, microwaves and infrared radiations are longer than visible light, and therefore they carry less energy.
  • Monitoring systems for fire prevention and/or detection are known in the art which comprise automatic panoramic shooting means, thus acquiring images supplied by a plurality of video cameras and assembling said images together in order to immediately provide the operator with a clear global view of the monitored scenario.
  • More specifically, the fire prevention monitoring systems known in the art employ a plurality of video cameras, which in particular include:
    • at least a first video camera operating within the visible light range, in particular a Pan Tilt Zoom (PTZ) video camera, to provide the user with a plurality of data and a global view of the surrounding scenario;
    • at least a second video camera operating within the infrared radiation range.
  • Said first and second video cameras usually perform a 360° rotation in order to attain a global view of the area to be monitored.
  • In addition, the fire prevention monitoring systems known in the art comprise:
    • environmental detection means for detecting some parameters relating to the area to be monitored;
    • a control unit adapted to receive and analyse the data coming from said plurality of video cameras and from said environmental detection means in order to detect a fire. Consequently, the control unit of known systems performs the following tasks:
    • it controls the traverse for positioning said plurality of video cameras;
    • it takes a snapshot by means of the second video camera operating within the infrared radiation range;
    • it analyses said snapshot, in particular through suitable filters and algorithms, in order to detect any danger and/or starting fire;
    • it saves the snapshot and pastes it to the previous images in order to create a global view;
    • it controls the traverse to a next position.
  • However, it has been observed that the fire prevention monitoring systems known in the art imply a number of drawbacks, in that they are not capable of preserving a high analysis quality as the climatic conditions of the surrounding scenario and of the monitored area change.
  • In particular, the fire prevention monitoring systems known in the art are not suited to detecting a fire in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
  • A further drawback suffered by the fire prevention monitoring systems known in the art is that they cannot monitor in a detailed manner the state of the vegetation in the monitored area.
  • In this frame, it is the main object of the present invention to overcome the above-mentioned drawbacks by providing a fire prevention and/or detection method which ensures a high analysis quality even when the climatic conditions of the surrounding scenario change.
  • It is another object of the present invention to provide a fire prevention and/or detection method which is suited to detecting a fire even in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
  • It is a further object of the present invention to provide a fire prevention and/or detection method which can monitor in a detailed manner the state of the vegetation in the surrounding scenario.
  • Said objects are achieved by the present invention through a fire prevention and/or detection method incorporating the features set out in the appended claims, which are intended as an integral part of the present description.
  • The present invention also relates to a fire prevention monitoring system as well as to a computer product which can be loaded into a memory of a control unit of the monitoring system, comprising software code portions for implementing said method when the product is executed in the control unit.
  • Further objects, features and advantages of the present invention will become apparent from the following detailed description and from the annexed drawings, which are supplied by way of an explicative and non-limiting example, wherein:
    • Fig. 1 is a schematic view of a fire prevention monitoring system according to the present invention;
    • Fig. 2 is a block diagram of a method for fire prevention and/or detection according to the present invention.
  • In the annexed drawings, reference numeral 1 designates as a whole a fire prevention monitoring system according to the present invention.
  • The monitoring system 1 comprises a plurality of video cameras, indicated as a whole by reference numeral 10. In particular, said plurality of video cameras 10 is of the Pan Tilt Zoom (PTZ) type and performs a non-continuous 360° rotation.
  • According to the present invention, said plurality of video cameras 10 comprises:
    • at least a first video camera 11 operating within the near infrared range (NIR);
    • at least a second video camera 12 operating within the thermal infrared range (FIR);
    • at least a third video camera 13 operating within the ultraviolet range (UV). Preferably, the monitoring system 1 according to the present invention also comprises at least a fourth video camera 14 operating within the visible light range, in order to provide the user with a plurality of data and a global view of the area to be monitored.
  • Furthermore, the monitoring system 1 according to the present invention comprises:
    • environmental detection means 20 for detecting some parameters relating to the area to be monitored;
    • a control unit 30 adapted to receive and analyse the data coming from said plurality of video cameras 10 and from said environmental detection means 20.
  • In accordance with the present invention, said control unit 30 implements the fire prevention and/or detection method according to the present invention by carrying out the following steps:
    1. a) it controls the traverse for positioning said plurality of video cameras 10,
    2. b) it selects the best performing video camera 11, 12, 13 among said plurality of video cameras 10 on the basis of an entropy value of an image obtained by each video camera 11, 12, 13 and as a function of the data detected by said detection means 20.
  • As a result, the monitoring system 1 according to the present invention allows to carry out an analysis of the territory within different ranges of the electromagnetic spectrum, so that said analysis can be adapted to the different climatic conditions of the area to be monitored.
  • As a matter of fact, the infrared range analysis varies much depending on the degree of humidity in the monitored area, i.e. of the degree of transparency of the air in said area.
  • In turn, the air transparency degree is strongly affected by climatic conditions (in particular, degree of humidity and temperature). The quality of the area analysis performed by using a video camera operating in a certain wavelength may vary considerably; for example, ultraviolet analyses (10 nm - 0.4 µm) are more detailed, but at the same time they are more sensitive to transparency than near IR analyses (0.7 - 1.3 µm), which may be more accurate in the presence of greater atmospheric opacity.
  • Consequently, the use of a plurality of video cameras 10 operating within different ranges of the electromagnetic spectrum allows to attain optimal fire detection and prevention whatever the environmental condition of the area to be monitored.
  • In accordance with the present invention, said step b) of selecting a video camera 11, 12, 13 is implemented according to a choice made within a database 31 stored in a memory 32 of said control unit 30, said database 31 concerning the existing relationship between the entropy of the images of said video cameras 11, 12, 13 and the data detected by said detection means 20.
  • As known, according to the image processing theory, entropy is that parameter which estimates the quantity of information contained in a certain image. The less significant data is present in an image, the closer to zero is the maximum entropy value obtained therefrom; on the contrary, the higher the quantity of significant data contained in an image, the higher the entropy value thereof.
  • In particular, the method according to the present invention comprises a self-calibration step for automatically adapting to the environmental conditions detected by the detection means 20.
  • In particular, during said self-calibration step, the control unit 30 implements the following steps at each traverse for positioning said plurality of video cameras 10:
    • it calculates an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13 as a function of the data detected by said detection means 20;
    • it indicates which image type (NIR, FIR, UV) received from said video cameras 11, 12, 13 has the highest entropy value as a function of said data detected by said detection means 20;
    • it stores into said database 31 an indication about which video camera 11, 12, 13 among said plurality of video cameras 10 must be selected in the presence of said data detected by the detection means 20.
  • Thanks to said self-calibration step, the system adapts itself automatically to the environmental conditions without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13.
  • In fact, when the monitoring system 1 is operating normally, the control unit 30 directly uses the image received from said video cameras 11, 12, 13 by associating the data detected by said detection means 20 with the corresponding entropy value; this association is especially quick and advantageous, in that both the data detected by said detection means 20 and the corresponding entropy values have been stored in said database 31 during the self-calibration step.
  • Preferably, the monitoring system 1 according to the present invention also provides the user with a global view of the monitored area through images supplied by a fourth video camera 14 operating within the visible light range, in particular by associating the images supplied by said fourth video camera 14 with those supplied by a video camera 11, 12, 13 selected among said first 11, second 12 and third 13 video cameras.
  • Fig. 2 shows a block diagram of the method for fire prevention and/or detection according to the present invention.
  • At each traverse for positioning said plurality of video cameras, the control unit 30 carries out the following steps:
    • the datum Di detected by said detection means 20, in particular corresponding to temperature Ti and humidity Hi at an instant i, is searched for in the database 31 (step 100). If the datum Di does not exist, it is created (step 101) and added to the database 31 (step 102);
    • if the datum Di detected by said detection means 20 has already been associated with a definitive spectrum DSi, a snapshot is taken based on said definitive spectrum DSi (step 103), otherwise a calibration is carried out (step 104);
    • snapshots are taken for each electromagnetic spectrum (UV, NIR and FIR), and, for each of them, a respective entropy value EUV, ENIR, EFIR is calculated (step 105);
    • the obtained spectrum Si' having the highest entropy EMAX is selected (step 106), and it is then verified (step 107) how many times the obtained spectrum Si' has been selected for that particular datum Di detected by said detection means 20, in particular corresponding to temperature Ti and humidity Hi. If the number of occurrences Rsi is equal to a predetermined maximum number of occurrences Rmax, then the obtained spectrum Si' becomes the definitive spectrum DSi (step 108), thus ending the calibration for the datum detected by said detection means 20. Otherwise, the relative number of occurrences Rsi for the obtained spectrum Si' is incremented (step 109), and the calibration for the detected datum Di goes on.
  • As can be understood from the above description, during the self-calibration step the indication relating to which video camera 11, 12, 13 must be selected in the presence of the data detected by the detection means 20 is only stored into the database when an image type (NIR, FIR, UV) having a maximum entropy value (equivalent to the relative number of occurrences Rsi) is received for a determined number of times (equivalent to the maximum number of occurrences Rmax set in the system 1).
  • It is also apparent from the above that said detection means 20 mainly detect data corresponding to a temperature Ti and a degree of humidity Hi at a certain time instant i.
  • It is clear that the detection means 20 may also detect additional data, such as data pertaining to wind intensity, time of detection, and so on. In such cases, the control unit 30 may increment the maximum number of occurrences Rmax in order to adapt the self-calibration step to the increase in the quantity of data to be taken into account; this is essentially equal to saying that the control unit 30 increments the number of times that the picking up of an image type (NIR, FIR, UV) having a maximum entropy value is to be repeated in the presence of said additional data detected by the detection means 20.
  • It is also plain that the control unit 30 may send the data to a remote centre 40, e.g. via an Internet connection, thus allowing an appropriate fire fighting strategy to be planned.
  • The advantages of a method for fire prevention and/or detection and a monitoring system thereof according to the present invention are apparent from the above description.
  • In particular, such advantages consist in that the method for fire prevention and/or detection according to the present invention, as well as the monitoring system thereof, allow a high analysis quality to be preserved as the climatic conditions in the surrounding scenario and in the monitored area change.
  • In fact, the monitoring system 1 according to the present invention allows to perform an analysis of the territory within different ranges of the electromagnetic spectrum as a function of the data detected by the detection means 20, said data pertaining to temperature, humidity, wind intensity, time of detection, and so on.
  • Furthermore, the method for fire prevention and/or detection according to the present invention uses that video camera 11, 12, 13 which is most suitable for operating in certain environmental conditions on the basis of the data detected by said detection means 20; this ensures optimization of the fire prevention and detection process whatever the environmental condition in the monitored area.
  • It follows that the method and system according to the present invention are suited to detecting a fire even in the presence of critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc., as well as to monitoring in a detailed manner the state of the vegetation in the surrounding scenario.
  • A further advantage of the method and system according to the present invention lies in the fact that, thanks to the execution of a self-calibration step, the method and system according to the present invention adapt themselves automatically to the actual environmental conditions, without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13; as a consequence, the monitoring system 1 can directly use the image having the highest entropy, thus reacting very quickly and bringing an unquestionable advantage in terms of fire detection rapidity.
  • It can therefore be easily understood that the present invention is not limited to the above-described method and system, but may be subject to many modifications, improvements or replacements of equivalent parts and elements without departing from the inventive idea, as clearly specified in the following claims.

Claims (12)

  1. Method for fire prevention and/or detection through a monitoring system (1) comprising:
    - a plurality of video cameras (10);
    - environmental detection means (20) for detecting some parameters relating to the area to be monitored;
    - a control unit (30) adapted to receive and analyse the data coming from said plurality of video cameras (10) and from said environmental detection means (20),
    characterized in that
    said control unit (30) implements the following steps:
    a) it controls the traverse for positioning said plurality of video cameras (10), said plurality of video cameras (10) comprising at least a first video camera (11) operating within the near infrared range (NIR), at least a second video camera (12) operating within the thermal infrared range (FIR), and at least a third video camera (13) operating within the ultraviolet range (UV);
    b) it selects the best performing video camera (11, 12, 13) among said plurality of video cameras (10) on the basis of a entropy value of an image obtained by each video camera (11, 12, 13) and as a function of the data detected by said detection means (20);
    c) it detects and/or prevents fire by using said selected video camera (11, 12, 13).
  2. Method according to claim 1, characterized in that said step b) of selecting a video camera (11, 12, 13) is implemented according to a choice made within a database (31) stored in a memory (32) of said control unit (30), said database (31) concerning the existing relationship between the entropy of the images of said video cameras (11, 12, 13) and the data detected by said detection means (20).
  3. Method according to claim 1, characterized by comprising a self-calibration step for automatically adapting to the environmental conditions detected by the detection means (20).
  4. Method according to claim 3, characterized in that, during said self-calibration step, the control unit (30) implements the following steps at each traverse for positioning said plurality of video cameras (10):
    c) it calculates an entropy value for each image (NIR, FIR, UV) received from said video cameras (11, 12, 13) as a function of the data detected by said detection means (20);
    d) it indicates which image type (NIR, FIR, UV) received from said video cameras (11, 12, 13) has the highest entropy value as a function of said data detected by said detection means (20);
    e) it stores into said database (31) an indication about which video camera (11, 12, 13) among said plurality of video cameras (10) must be selected in the presence of said data detected by the detection means (20).
  5. Method according to claim 4, characterized in that said step e) of storing into said database (31) the indication of the video camera (11, 12, 13) to be selected only occurs when said step d) of picking an image type (NIR, FIR, UV) having the highest entropy value has been repeated for a predetermined number of times.
  6. Method according to claim 1, characterized in that said detection means (20) detect data corresponding to a temperature (Ti) and a degree of humidity (Hi) at a certain time instant (i).
  7. Method according to claim 1, characterized in that said detection means (20) also detect additional data, in particular relating to wind intensity and time of detection.
  8. Method according to claims 5 and 7, characterized in that said control unit (30) increases the number of times that step d) of picking an image type (NIR, FIR, UV) having the highest entropy value is to be repeated in the presence of said additional data detected by the detection means (20).
  9. Method according to claim 1, characterized by providing a global view of the monitored area through images supplied by a fourth video camera (14) operating within the visible light range, in particular by associating the images supplied by said fourth video camera (14) with those supplied by that video camera (11, 12, 13) which has been selected among said first (11), second (12) and third (13) video cameras.
  10. Method according to claim 1, characterized in that the control unit (30) sends the data to a remote centre (40) in order to allow for planning an adequate fire fighting strategy.
  11. Monitoring system (1) adapted to implement the method according to any of claims 1 to 10.
  12. Computer product which can be loaded into a memory (32) of a control unit (30) of a monitoring system (1), comprising software code portions for implementing the method according to any of claims 1 to 10 when the product is executed in the control unit (30).
EP10165726A 2009-06-17 2010-06-11 Method for fire prevention and/or detection, and monitoring system and computer product thereof Active EP2264677B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
ITTO2009A000459A IT1394450B1 (en) 2009-06-17 2009-06-17 METHOD OF PREVENTION AND / OR DETECTION OF FIRE, AND RELATIVE CONTROL SYSTEM AND IT PRODUCT

Publications (2)

Publication Number Publication Date
EP2264677A1 EP2264677A1 (en) 2010-12-22
EP2264677B1 true EP2264677B1 (en) 2012-05-30

Family

ID=41314542

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10165726A Active EP2264677B1 (en) 2009-06-17 2010-06-11 Method for fire prevention and/or detection, and monitoring system and computer product thereof

Country Status (2)

Country Link
EP (1) EP2264677B1 (en)
IT (1) IT1394450B1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108806165A (en) * 2018-08-15 2018-11-13 重庆英卡电子有限公司 Photo taking type flame detection system and its control method
CN108961647A (en) * 2018-08-15 2018-12-07 重庆英卡电子有限公司 Photo taking type flame detector and its control method
CN108986379A (en) * 2018-08-15 2018-12-11 重庆英卡电子有限公司 Flame detector and its control method with infrared photography
CN110097732A (en) * 2019-05-08 2019-08-06 江西省天眼科技有限公司 A kind of flame detecting monitoring device and its processing method

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2739817T3 (en) 2013-12-17 2020-02-04 Tyco Fire Products Lp System and method to detect and suppress a fire using wind information
CN103903020B (en) * 2014-04-22 2017-10-27 天津市协力自动化工程有限公司 A kind of fire image recognition methods and device based on CodeBook
CN112013250A (en) * 2020-07-13 2020-12-01 安徽建筑大学 Indoor fire alarm combining infrared and video analysis technologies

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5959589A (en) * 1997-07-02 1999-09-28 Waveband Corporation Remote fire detection method and implementation thereof
PT1523738E (en) * 2002-07-16 2007-06-06 Gs Gestione Sistemi S R L System and method for territory thermal monitoring

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108806165A (en) * 2018-08-15 2018-11-13 重庆英卡电子有限公司 Photo taking type flame detection system and its control method
CN108961647A (en) * 2018-08-15 2018-12-07 重庆英卡电子有限公司 Photo taking type flame detector and its control method
CN108986379A (en) * 2018-08-15 2018-12-11 重庆英卡电子有限公司 Flame detector and its control method with infrared photography
CN108986379B (en) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 Flame detector with infrared photographing function and control method thereof
CN108961647B (en) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 Photographing type flame detector and control method thereof
CN108806165B (en) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 Photographing type flame detection system and control method thereof
CN110097732A (en) * 2019-05-08 2019-08-06 江西省天眼科技有限公司 A kind of flame detecting monitoring device and its processing method
CN110097732B (en) * 2019-05-08 2021-07-20 江西省天眼科技有限公司 Flame detection monitoring device and processing method thereof

Also Published As

Publication number Publication date
ITTO20090459A1 (en) 2010-12-18
EP2264677A1 (en) 2010-12-22
IT1394450B1 (en) 2012-06-15

Similar Documents

Publication Publication Date Title
EP2264677B1 (en) Method for fire prevention and/or detection, and monitoring system and computer product thereof
US11467098B2 (en) Systems and methods for monitoring remote installations
AU2021202136B2 (en) Object tracking system optimization and optimizers
KR101533905B1 (en) A surveillance system and a method for detecting a foreign object, debris, or damage in an airfield
US9000371B2 (en) Camera, computer program and method for measuring thermal radiation and thermal rates of change
JP6557225B2 (en) System and method for ensuring and improving process quality
JP7040443B2 (en) Gas detection system
US11393102B2 (en) Autonomous camera-to-camera change detection system
US8115655B2 (en) Method and system for monitoring of the temperature of the surface of an aircraft
CN104902858A (en) Welding helmet for detecting arc data
WO2012155200A1 (en) Surveillance system
KR20120081496A (en) The method for fire warning using analysis of thermal image temperature
US10983515B2 (en) Driving information display device, driving information display method, and method of controlling driving speed of working vehicle
KR20210118749A (en) Method, device, and system for temperature calibration and determination of temperature in scene
US20220377242A1 (en) Auto-focus tracking for remote flying targets
KR20150128586A (en) Method and apparatus for determining a need for a change in a pixel density requirement due to changing light conditions
FR2989456A1 (en) TELEOPERATED TARGET PROCESSING SYSTEM
US20190020791A1 (en) Techniques for correcting oversaturated pixels in shutterless fir cameras
KR20190109644A (en) Apparatus and method for detecting greenhouse data collection error
EP2505975A1 (en) Device and method for sequentially positioning markers on an image
KR102192686B1 (en) Drone controlling system for checking of facility, and method for the same
US10656250B2 (en) Geospatial data collection system with a look ahead sensor and associated methods
KR101824042B1 (en) Camera-integrated laser detector and driving method thereof
US20190025543A1 (en) Method for producing a photo- or video-image of at least one object to be recorded
US20230360211A1 (en) Systems, apparatuses, and methods for detecting early drought stress in plants

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

17P Request for examination filed

Effective date: 20110614

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G08B 17/12 20060101AFI20111104BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20120802

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120930

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120831

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121001

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20130101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120910

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130101

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

26N No opposition filed

Effective date: 20130301

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120730

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100611

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140611

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230524

Year of fee payment: 14