EP2264677B1 - Method for fire prevention and/or detection, and monitoring system and computer product thereof - Google Patents
Method for fire prevention and/or detection, and monitoring system and computer product thereof Download PDFInfo
- Publication number
- EP2264677B1 EP2264677B1 EP10165726A EP10165726A EP2264677B1 EP 2264677 B1 EP2264677 B1 EP 2264677B1 EP 10165726 A EP10165726 A EP 10165726A EP 10165726 A EP10165726 A EP 10165726A EP 2264677 B1 EP2264677 B1 EP 2264677B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- detection means
- video camera
- video cameras
- control unit
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims description 53
- 238000000034 method Methods 0.000 title claims description 28
- 238000012544 monitoring process Methods 0.000 title claims description 26
- 230000002265 prevention Effects 0.000 title claims description 24
- 238000004458 analytical method Methods 0.000 claims description 14
- 230000007613 environmental effect Effects 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 7
- 238000001228 spectrum Methods 0.000 description 13
- 230000008901 benefit Effects 0.000 description 5
- 230000005855 radiation Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B17/00—Fire alarms; Alarms responsive to explosion
- G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
- G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Fire-Detection Mechanisms (AREA)
- Closed-Circuit Television Systems (AREA)
- Fire-Extinguishing By Fire Departments, And Fire-Extinguishing Equipment And Control Thereof (AREA)
- Alarm Systems (AREA)
Description
- The present invention relates to a method for fire prevention and/or detection according to the preamble of claim 1. Such method is disclosed in
US 2007 000317 . - In addition, the present invention also relates to a monitoring system and a computer product adapted to implement said method.
- It is known in the art that the electromagnetic spectrum (or EM spectrum) is the interval of all possible frequencies of radiations, which are electromagnetic waves characterized by a wavelength and a frequency; since wavelength and frequency of a radiation are inversely proportional to each other, the shorter the wavelength the higher the frequency, and thus the energy.
- Human beings can perceive with their eyes wavelengths in the range of 380 to 760 nanometres (nm), which are called "visible light".
- Shorter wavelengths correspond to ultraviolet rays, X-rays and gamma rays, all of which have frequencies higher than visible light, and therefore more energy than the latter. On the contrary, the wavelengths of radio waves, microwaves and infrared radiations are longer than visible light, and therefore they carry less energy.
- Monitoring systems for fire prevention and/or detection are known in the art which comprise automatic panoramic shooting means, thus acquiring images supplied by a plurality of video cameras and assembling said images together in order to immediately provide the operator with a clear global view of the monitored scenario.
- More specifically, the fire prevention monitoring systems known in the art employ a plurality of video cameras, which in particular include:
- at least a first video camera operating within the visible light range, in particular a Pan Tilt Zoom (PTZ) video camera, to provide the user with a plurality of data and a global view of the surrounding scenario;
- at least a second video camera operating within the infrared radiation range.
- Said first and second video cameras usually perform a 360° rotation in order to attain a global view of the area to be monitored.
- In addition, the fire prevention monitoring systems known in the art comprise:
- environmental detection means for detecting some parameters relating to the area to be monitored;
- a control unit adapted to receive and analyse the data coming from said plurality of video cameras and from said environmental detection means in order to detect a fire. Consequently, the control unit of known systems performs the following tasks:
- it controls the traverse for positioning said plurality of video cameras;
- it takes a snapshot by means of the second video camera operating within the infrared radiation range;
- it analyses said snapshot, in particular through suitable filters and algorithms, in order to detect any danger and/or starting fire;
- it saves the snapshot and pastes it to the previous images in order to create a global view;
- it controls the traverse to a next position.
- However, it has been observed that the fire prevention monitoring systems known in the art imply a number of drawbacks, in that they are not capable of preserving a high analysis quality as the climatic conditions of the surrounding scenario and of the monitored area change.
- In particular, the fire prevention monitoring systems known in the art are not suited to detecting a fire in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
- A further drawback suffered by the fire prevention monitoring systems known in the art is that they cannot monitor in a detailed manner the state of the vegetation in the monitored area.
- In this frame, it is the main object of the present invention to overcome the above-mentioned drawbacks by providing a fire prevention and/or detection method which ensures a high analysis quality even when the climatic conditions of the surrounding scenario change.
- It is another object of the present invention to provide a fire prevention and/or detection method which is suited to detecting a fire even in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
- It is a further object of the present invention to provide a fire prevention and/or detection method which can monitor in a detailed manner the state of the vegetation in the surrounding scenario.
- Said objects are achieved by the present invention through a fire prevention and/or detection method incorporating the features set out in the appended claims, which are intended as an integral part of the present description.
- The present invention also relates to a fire prevention monitoring system as well as to a computer product which can be loaded into a memory of a control unit of the monitoring system, comprising software code portions for implementing said method when the product is executed in the control unit.
- Further objects, features and advantages of the present invention will become apparent from the following detailed description and from the annexed drawings, which are supplied by way of an explicative and non-limiting example, wherein:
-
Fig. 1 is a schematic view of a fire prevention monitoring system according to the present invention; -
Fig. 2 is a block diagram of a method for fire prevention and/or detection according to the present invention. - In the annexed drawings, reference numeral 1 designates as a whole a fire prevention monitoring system according to the present invention.
- The monitoring system 1 comprises a plurality of video cameras, indicated as a whole by
reference numeral 10. In particular, said plurality ofvideo cameras 10 is of the Pan Tilt Zoom (PTZ) type and performs a non-continuous 360° rotation. - According to the present invention, said plurality of
video cameras 10 comprises: - at least a
first video camera 11 operating within the near infrared range (NIR); - at least a
second video camera 12 operating within the thermal infrared range (FIR); - at least a
third video camera 13 operating within the ultraviolet range (UV). Preferably, the monitoring system 1 according to the present invention also comprises at least afourth video camera 14 operating within the visible light range, in order to provide the user with a plurality of data and a global view of the area to be monitored. - Furthermore, the monitoring system 1 according to the present invention comprises:
- environmental detection means 20 for detecting some parameters relating to the area to be monitored;
- a
control unit 30 adapted to receive and analyse the data coming from said plurality ofvideo cameras 10 and from said environmental detection means 20. - In accordance with the present invention, said
control unit 30 implements the fire prevention and/or detection method according to the present invention by carrying out the following steps: - a) it controls the traverse for positioning said plurality of
video cameras 10, - b) it selects the best performing
video camera video cameras 10 on the basis of an entropy value of an image obtained by eachvideo camera - As a result, the monitoring system 1 according to the present invention allows to carry out an analysis of the territory within different ranges of the electromagnetic spectrum, so that said analysis can be adapted to the different climatic conditions of the area to be monitored.
- As a matter of fact, the infrared range analysis varies much depending on the degree of humidity in the monitored area, i.e. of the degree of transparency of the air in said area.
- In turn, the air transparency degree is strongly affected by climatic conditions (in particular, degree of humidity and temperature). The quality of the area analysis performed by using a video camera operating in a certain wavelength may vary considerably; for example, ultraviolet analyses (10 nm - 0.4 µm) are more detailed, but at the same time they are more sensitive to transparency than near IR analyses (0.7 - 1.3 µm), which may be more accurate in the presence of greater atmospheric opacity.
- Consequently, the use of a plurality of
video cameras 10 operating within different ranges of the electromagnetic spectrum allows to attain optimal fire detection and prevention whatever the environmental condition of the area to be monitored. - In accordance with the present invention, said step b) of selecting a
video camera database 31 stored in amemory 32 of saidcontrol unit 30, saiddatabase 31 concerning the existing relationship between the entropy of the images of saidvideo cameras - As known, according to the image processing theory, entropy is that parameter which estimates the quantity of information contained in a certain image. The less significant data is present in an image, the closer to zero is the maximum entropy value obtained therefrom; on the contrary, the higher the quantity of significant data contained in an image, the higher the entropy value thereof.
- In particular, the method according to the present invention comprises a self-calibration step for automatically adapting to the environmental conditions detected by the detection means 20.
- In particular, during said self-calibration step, the
control unit 30 implements the following steps at each traverse for positioning said plurality of video cameras 10: - it calculates an entropy value for each image (NIR, FIR, UV) received from said
video cameras - it indicates which image type (NIR, FIR, UV) received from said
video cameras - it stores into said
database 31 an indication about whichvideo camera video cameras 10 must be selected in the presence of said data detected by the detection means 20. - Thanks to said self-calibration step, the system adapts itself automatically to the environmental conditions without having to calculate an entropy value for each image (NIR, FIR, UV) received from said
video cameras - In fact, when the monitoring system 1 is operating normally, the
control unit 30 directly uses the image received from saidvideo cameras database 31 during the self-calibration step. - Preferably, the monitoring system 1 according to the present invention also provides the user with a global view of the monitored area through images supplied by a
fourth video camera 14 operating within the visible light range, in particular by associating the images supplied by saidfourth video camera 14 with those supplied by avideo camera -
Fig. 2 shows a block diagram of the method for fire prevention and/or detection according to the present invention. - At each traverse for positioning said plurality of video cameras, the
control unit 30 carries out the following steps: - the datum Di detected by said detection means 20, in particular corresponding to temperature Ti and humidity Hi at an instant i, is searched for in the database 31 (step 100). If the datum Di does not exist, it is created (step 101) and added to the database 31 (step 102);
- if the datum Di detected by said detection means 20 has already been associated with a definitive spectrum DSi, a snapshot is taken based on said definitive spectrum DSi (step 103), otherwise a calibration is carried out (step 104);
- snapshots are taken for each electromagnetic spectrum (UV, NIR and FIR), and, for each of them, a respective entropy value EUV, ENIR, EFIR is calculated (step 105);
- the obtained spectrum Si' having the highest entropy EMAX is selected (step 106), and it is then verified (step 107) how many times the obtained spectrum Si' has been selected for that particular datum Di detected by said detection means 20, in particular corresponding to temperature Ti and humidity Hi. If the number of occurrences Rsi is equal to a predetermined maximum number of occurrences Rmax, then the obtained spectrum Si' becomes the definitive spectrum DSi (step 108), thus ending the calibration for the datum detected by said detection means 20. Otherwise, the relative number of occurrences Rsi for the obtained spectrum Si' is incremented (step 109), and the calibration for the detected datum Di goes on.
- As can be understood from the above description, during the self-calibration step the indication relating to which
video camera - It is also apparent from the above that said detection means 20 mainly detect data corresponding to a temperature Ti and a degree of humidity Hi at a certain time instant i.
- It is clear that the detection means 20 may also detect additional data, such as data pertaining to wind intensity, time of detection, and so on. In such cases, the
control unit 30 may increment the maximum number of occurrences Rmax in order to adapt the self-calibration step to the increase in the quantity of data to be taken into account; this is essentially equal to saying that thecontrol unit 30 increments the number of times that the picking up of an image type (NIR, FIR, UV) having a maximum entropy value is to be repeated in the presence of said additional data detected by the detection means 20. - It is also plain that the
control unit 30 may send the data to aremote centre 40, e.g. via an Internet connection, thus allowing an appropriate fire fighting strategy to be planned. - The advantages of a method for fire prevention and/or detection and a monitoring system thereof according to the present invention are apparent from the above description.
- In particular, such advantages consist in that the method for fire prevention and/or detection according to the present invention, as well as the monitoring system thereof, allow a high analysis quality to be preserved as the climatic conditions in the surrounding scenario and in the monitored area change.
- In fact, the monitoring system 1 according to the present invention allows to perform an analysis of the territory within different ranges of the electromagnetic spectrum as a function of the data detected by the detection means 20, said data pertaining to temperature, humidity, wind intensity, time of detection, and so on.
- Furthermore, the method for fire prevention and/or detection according to the present invention uses that
video camera - It follows that the method and system according to the present invention are suited to detecting a fire even in the presence of critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc., as well as to monitoring in a detailed manner the state of the vegetation in the surrounding scenario.
- A further advantage of the method and system according to the present invention lies in the fact that, thanks to the execution of a self-calibration step, the method and system according to the present invention adapt themselves automatically to the actual environmental conditions, without having to calculate an entropy value for each image (NIR, FIR, UV) received from said
video cameras - It can therefore be easily understood that the present invention is not limited to the above-described method and system, but may be subject to many modifications, improvements or replacements of equivalent parts and elements without departing from the inventive idea, as clearly specified in the following claims.
Claims (12)
- Method for fire prevention and/or detection through a monitoring system (1) comprising:- a plurality of video cameras (10);- environmental detection means (20) for detecting some parameters relating to the area to be monitored;- a control unit (30) adapted to receive and analyse the data coming from said plurality of video cameras (10) and from said environmental detection means (20),characterized in that
said control unit (30) implements the following steps:a) it controls the traverse for positioning said plurality of video cameras (10), said plurality of video cameras (10) comprising at least a first video camera (11) operating within the near infrared range (NIR), at least a second video camera (12) operating within the thermal infrared range (FIR), and at least a third video camera (13) operating within the ultraviolet range (UV);b) it selects the best performing video camera (11, 12, 13) among said plurality of video cameras (10) on the basis of a entropy value of an image obtained by each video camera (11, 12, 13) and as a function of the data detected by said detection means (20);c) it detects and/or prevents fire by using said selected video camera (11, 12, 13). - Method according to claim 1, characterized in that said step b) of selecting a video camera (11, 12, 13) is implemented according to a choice made within a database (31) stored in a memory (32) of said control unit (30), said database (31) concerning the existing relationship between the entropy of the images of said video cameras (11, 12, 13) and the data detected by said detection means (20).
- Method according to claim 1, characterized by comprising a self-calibration step for automatically adapting to the environmental conditions detected by the detection means (20).
- Method according to claim 3, characterized in that, during said self-calibration step, the control unit (30) implements the following steps at each traverse for positioning said plurality of video cameras (10):c) it calculates an entropy value for each image (NIR, FIR, UV) received from said video cameras (11, 12, 13) as a function of the data detected by said detection means (20);d) it indicates which image type (NIR, FIR, UV) received from said video cameras (11, 12, 13) has the highest entropy value as a function of said data detected by said detection means (20);e) it stores into said database (31) an indication about which video camera (11, 12, 13) among said plurality of video cameras (10) must be selected in the presence of said data detected by the detection means (20).
- Method according to claim 4, characterized in that said step e) of storing into said database (31) the indication of the video camera (11, 12, 13) to be selected only occurs when said step d) of picking an image type (NIR, FIR, UV) having the highest entropy value has been repeated for a predetermined number of times.
- Method according to claim 1, characterized in that said detection means (20) detect data corresponding to a temperature (Ti) and a degree of humidity (Hi) at a certain time instant (i).
- Method according to claim 1, characterized in that said detection means (20) also detect additional data, in particular relating to wind intensity and time of detection.
- Method according to claims 5 and 7, characterized in that said control unit (30) increases the number of times that step d) of picking an image type (NIR, FIR, UV) having the highest entropy value is to be repeated in the presence of said additional data detected by the detection means (20).
- Method according to claim 1, characterized by providing a global view of the monitored area through images supplied by a fourth video camera (14) operating within the visible light range, in particular by associating the images supplied by said fourth video camera (14) with those supplied by that video camera (11, 12, 13) which has been selected among said first (11), second (12) and third (13) video cameras.
- Method according to claim 1, characterized in that the control unit (30) sends the data to a remote centre (40) in order to allow for planning an adequate fire fighting strategy.
- Monitoring system (1) adapted to implement the method according to any of claims 1 to 10.
- Computer product which can be loaded into a memory (32) of a control unit (30) of a monitoring system (1), comprising software code portions for implementing the method according to any of claims 1 to 10 when the product is executed in the control unit (30).
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ITTO2009A000459A IT1394450B1 (en) | 2009-06-17 | 2009-06-17 | METHOD OF PREVENTION AND / OR DETECTION OF FIRE, AND RELATIVE CONTROL SYSTEM AND IT PRODUCT |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2264677A1 EP2264677A1 (en) | 2010-12-22 |
EP2264677B1 true EP2264677B1 (en) | 2012-05-30 |
Family
ID=41314542
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10165726A Active EP2264677B1 (en) | 2009-06-17 | 2010-06-11 | Method for fire prevention and/or detection, and monitoring system and computer product thereof |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2264677B1 (en) |
IT (1) | IT1394450B1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108806165A (en) * | 2018-08-15 | 2018-11-13 | 重庆英卡电子有限公司 | Photo taking type flame detection system and its control method |
CN108961647A (en) * | 2018-08-15 | 2018-12-07 | 重庆英卡电子有限公司 | Photo taking type flame detector and its control method |
CN108986379A (en) * | 2018-08-15 | 2018-12-11 | 重庆英卡电子有限公司 | Flame detector and its control method with infrared photography |
CN110097732A (en) * | 2019-05-08 | 2019-08-06 | 江西省天眼科技有限公司 | A kind of flame detecting monitoring device and its processing method |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ES2739817T3 (en) | 2013-12-17 | 2020-02-04 | Tyco Fire Products Lp | System and method to detect and suppress a fire using wind information |
CN103903020B (en) * | 2014-04-22 | 2017-10-27 | 天津市协力自动化工程有限公司 | A kind of fire image recognition methods and device based on CodeBook |
CN112013250A (en) * | 2020-07-13 | 2020-12-01 | 安徽建筑大学 | Indoor fire alarm combining infrared and video analysis technologies |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5959589A (en) * | 1997-07-02 | 1999-09-28 | Waveband Corporation | Remote fire detection method and implementation thereof |
PT1523738E (en) * | 2002-07-16 | 2007-06-06 | Gs Gestione Sistemi S R L | System and method for territory thermal monitoring |
-
2009
- 2009-06-17 IT ITTO2009A000459A patent/IT1394450B1/en active
-
2010
- 2010-06-11 EP EP10165726A patent/EP2264677B1/en active Active
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108806165A (en) * | 2018-08-15 | 2018-11-13 | 重庆英卡电子有限公司 | Photo taking type flame detection system and its control method |
CN108961647A (en) * | 2018-08-15 | 2018-12-07 | 重庆英卡电子有限公司 | Photo taking type flame detector and its control method |
CN108986379A (en) * | 2018-08-15 | 2018-12-11 | 重庆英卡电子有限公司 | Flame detector and its control method with infrared photography |
CN108986379B (en) * | 2018-08-15 | 2020-09-08 | 重庆英卡电子有限公司 | Flame detector with infrared photographing function and control method thereof |
CN108961647B (en) * | 2018-08-15 | 2020-09-08 | 重庆英卡电子有限公司 | Photographing type flame detector and control method thereof |
CN108806165B (en) * | 2018-08-15 | 2020-09-08 | 重庆英卡电子有限公司 | Photographing type flame detection system and control method thereof |
CN110097732A (en) * | 2019-05-08 | 2019-08-06 | 江西省天眼科技有限公司 | A kind of flame detecting monitoring device and its processing method |
CN110097732B (en) * | 2019-05-08 | 2021-07-20 | 江西省天眼科技有限公司 | Flame detection monitoring device and processing method thereof |
Also Published As
Publication number | Publication date |
---|---|
ITTO20090459A1 (en) | 2010-12-18 |
EP2264677A1 (en) | 2010-12-22 |
IT1394450B1 (en) | 2012-06-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2264677B1 (en) | Method for fire prevention and/or detection, and monitoring system and computer product thereof | |
US11467098B2 (en) | Systems and methods for monitoring remote installations | |
AU2021202136B2 (en) | Object tracking system optimization and optimizers | |
KR101533905B1 (en) | A surveillance system and a method for detecting a foreign object, debris, or damage in an airfield | |
US9000371B2 (en) | Camera, computer program and method for measuring thermal radiation and thermal rates of change | |
JP6557225B2 (en) | System and method for ensuring and improving process quality | |
JP7040443B2 (en) | Gas detection system | |
US11393102B2 (en) | Autonomous camera-to-camera change detection system | |
US8115655B2 (en) | Method and system for monitoring of the temperature of the surface of an aircraft | |
CN104902858A (en) | Welding helmet for detecting arc data | |
WO2012155200A1 (en) | Surveillance system | |
KR20120081496A (en) | The method for fire warning using analysis of thermal image temperature | |
US10983515B2 (en) | Driving information display device, driving information display method, and method of controlling driving speed of working vehicle | |
KR20210118749A (en) | Method, device, and system for temperature calibration and determination of temperature in scene | |
US20220377242A1 (en) | Auto-focus tracking for remote flying targets | |
KR20150128586A (en) | Method and apparatus for determining a need for a change in a pixel density requirement due to changing light conditions | |
FR2989456A1 (en) | TELEOPERATED TARGET PROCESSING SYSTEM | |
US20190020791A1 (en) | Techniques for correcting oversaturated pixels in shutterless fir cameras | |
KR20190109644A (en) | Apparatus and method for detecting greenhouse data collection error | |
EP2505975A1 (en) | Device and method for sequentially positioning markers on an image | |
KR102192686B1 (en) | Drone controlling system for checking of facility, and method for the same | |
US10656250B2 (en) | Geospatial data collection system with a look ahead sensor and associated methods | |
KR101824042B1 (en) | Camera-integrated laser detector and driving method thereof | |
US20190025543A1 (en) | Method for producing a photo- or video-image of at least one object to be recorded | |
US20230360211A1 (en) | Systems, apparatuses, and methods for detecting early drought stress in plants |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME RS |
|
17P | Request for examination filed |
Effective date: 20110614 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G08B 17/12 20060101AFI20111104BHEP |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 560371 Country of ref document: AT Kind code of ref document: T Effective date: 20120615 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602010001751 Country of ref document: DE Effective date: 20120802 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20120530 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120830 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120930 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 560371 Country of ref document: AT Kind code of ref document: T Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120831 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121001 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602010001751 Country of ref document: DE Effective date: 20130101 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120910 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130101 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120611 |
|
26N | No opposition filed |
Effective date: 20130301 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20130426 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120830 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120730 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120530 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20120611 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20100611 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20140611 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140630 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140611 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20230524 Year of fee payment: 14 |