EP2264677B1 - Verfahren zur Verhütung und/oder Feststellung von Bränden, Überwachungssystem und Computerprogramm dafür - Google Patents

Verfahren zur Verhütung und/oder Feststellung von Bränden, Überwachungssystem und Computerprogramm dafür Download PDF

Info

Publication number
EP2264677B1
EP2264677B1 EP10165726A EP10165726A EP2264677B1 EP 2264677 B1 EP2264677 B1 EP 2264677B1 EP 10165726 A EP10165726 A EP 10165726A EP 10165726 A EP10165726 A EP 10165726A EP 2264677 B1 EP2264677 B1 EP 2264677B1
Authority
EP
European Patent Office
Prior art keywords
detection means
video camera
video cameras
control unit
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10165726A
Other languages
English (en)
French (fr)
Other versions
EP2264677A1 (de
Inventor
Giorgio Pelosio
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Teletron Euroricherche SRL
Original Assignee
Teletron Euroricherche SRL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Teletron Euroricherche SRL filed Critical Teletron Euroricherche SRL
Publication of EP2264677A1 publication Critical patent/EP2264677A1/de
Application granted granted Critical
Publication of EP2264677B1 publication Critical patent/EP2264677B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke

Definitions

  • the present invention relates to a method for fire prevention and/or detection according to the preamble of claim 1. Such method is disclosed in US 2007 000317 .
  • the present invention also relates to a monitoring system and a computer product adapted to implement said method.
  • the electromagnetic spectrum (or EM spectrum) is the interval of all possible frequencies of radiations, which are electromagnetic waves characterized by a wavelength and a frequency; since wavelength and frequency of a radiation are inversely proportional to each other, the shorter the wavelength the higher the frequency, and thus the energy.
  • Shorter wavelengths correspond to ultraviolet rays, X-rays and gamma rays, all of which have frequencies higher than visible light, and therefore more energy than the latter.
  • the wavelengths of radio waves, microwaves and infrared radiations are longer than visible light, and therefore they carry less energy.
  • Monitoring systems for fire prevention and/or detection are known in the art which comprise automatic panoramic shooting means, thus acquiring images supplied by a plurality of video cameras and assembling said images together in order to immediately provide the operator with a clear global view of the monitored scenario.
  • the fire prevention monitoring systems known in the art employ a plurality of video cameras, which in particular include:
  • Said first and second video cameras usually perform a 360° rotation in order to attain a global view of the area to be monitored.
  • fire prevention monitoring systems known in the art comprise:
  • the fire prevention monitoring systems known in the art are not suited to detecting a fire in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
  • a further drawback suffered by the fire prevention monitoring systems known in the art is that they cannot monitor in a detailed manner the state of the vegetation in the monitored area.
  • the present invention also relates to a fire prevention monitoring system as well as to a computer product which can be loaded into a memory of a control unit of the monitoring system, comprising software code portions for implementing said method when the product is executed in the control unit.
  • reference numeral 1 designates as a whole a fire prevention monitoring system according to the present invention.
  • the monitoring system 1 comprises a plurality of video cameras, indicated as a whole by reference numeral 10.
  • said plurality of video cameras 10 is of the Pan Tilt Zoom (PTZ) type and performs a non-continuous 360° rotation.
  • PTZ Pan Tilt Zoom
  • said plurality of video cameras 10 comprises:
  • the monitoring system 1 comprises:
  • control unit 30 implements the fire prevention and/or detection method according to the present invention by carrying out the following steps:
  • the monitoring system 1 allows to carry out an analysis of the territory within different ranges of the electromagnetic spectrum, so that said analysis can be adapted to the different climatic conditions of the area to be monitored.
  • the infrared range analysis varies much depending on the degree of humidity in the monitored area, i.e. of the degree of transparency of the air in said area.
  • the air transparency degree is strongly affected by climatic conditions (in particular, degree of humidity and temperature).
  • the quality of the area analysis performed by using a video camera operating in a certain wavelength may vary considerably; for example, ultraviolet analyses (10 nm - 0.4 ⁇ m) are more detailed, but at the same time they are more sensitive to transparency than near IR analyses (0.7 - 1.3 ⁇ m), which may be more accurate in the presence of greater atmospheric opacity.
  • said step b) of selecting a video camera 11, 12, 13 is implemented according to a choice made within a database 31 stored in a memory 32 of said control unit 30, said database 31 concerning the existing relationship between the entropy of the images of said video cameras 11, 12, 13 and the data detected by said detection means 20.
  • entropy is that parameter which estimates the quantity of information contained in a certain image. The less significant data is present in an image, the closer to zero is the maximum entropy value obtained therefrom; on the contrary, the higher the quantity of significant data contained in an image, the higher the entropy value thereof.
  • the method according to the present invention comprises a self-calibration step for automatically adapting to the environmental conditions detected by the detection means 20.
  • control unit 30 implements the following steps at each traverse for positioning said plurality of video cameras 10:
  • the system adapts itself automatically to the environmental conditions without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13.
  • control unit 30 directly uses the image received from said video cameras 11, 12, 13 by associating the data detected by said detection means 20 with the corresponding entropy value; this association is especially quick and advantageous, in that both the data detected by said detection means 20 and the corresponding entropy values have been stored in said database 31 during the self-calibration step.
  • the monitoring system 1 also provides the user with a global view of the monitored area through images supplied by a fourth video camera 14 operating within the visible light range, in particular by associating the images supplied by said fourth video camera 14 with those supplied by a video camera 11, 12, 13 selected among said first 11, second 12 and third 13 video cameras.
  • Fig. 2 shows a block diagram of the method for fire prevention and/or detection according to the present invention.
  • control unit 30 carries out the following steps:
  • the indication relating to which video camera 11, 12, 13 must be selected in the presence of the data detected by the detection means 20 is only stored into the database when an image type (NIR, FIR, UV) having a maximum entropy value (equivalent to the relative number of occurrences R si ) is received for a determined number of times (equivalent to the maximum number of occurrences R max set in the system 1).
  • NIR image type
  • FIR FIR
  • UV maximum entropy value
  • said detection means 20 mainly detect data corresponding to a temperature T i and a degree of humidity H i at a certain time instant i.
  • the detection means 20 may also detect additional data, such as data pertaining to wind intensity, time of detection, and so on.
  • the control unit 30 may increment the maximum number of occurrences R max in order to adapt the self-calibration step to the increase in the quantity of data to be taken into account; this is essentially equal to saying that the control unit 30 increments the number of times that the picking up of an image type (NIR, FIR, UV) having a maximum entropy value is to be repeated in the presence of said additional data detected by the detection means 20.
  • NIR image type
  • control unit 30 may send the data to a remote centre 40, e.g. via an Internet connection, thus allowing an appropriate fire fighting strategy to be planned.
  • such advantages consist in that the method for fire prevention and/or detection according to the present invention, as well as the monitoring system thereof, allow a high analysis quality to be preserved as the climatic conditions in the surrounding scenario and in the monitored area change.
  • the monitoring system 1 allows to perform an analysis of the territory within different ranges of the electromagnetic spectrum as a function of the data detected by the detection means 20, said data pertaining to temperature, humidity, wind intensity, time of detection, and so on.
  • the method for fire prevention and/or detection according to the present invention uses that video camera 11, 12, 13 which is most suitable for operating in certain environmental conditions on the basis of the data detected by said detection means 20; this ensures optimization of the fire prevention and detection process whatever the environmental condition in the monitored area.
  • the method and system according to the present invention are suited to detecting a fire even in the presence of critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc., as well as to monitoring in a detailed manner the state of the vegetation in the surrounding scenario.
  • a further advantage of the method and system according to the present invention lies in the fact that, thanks to the execution of a self-calibration step, the method and system according to the present invention adapt themselves automatically to the actual environmental conditions, without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13; as a consequence, the monitoring system 1 can directly use the image having the highest entropy, thus reacting very quickly and bringing an unquestionable advantage in terms of fire detection rapidity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Fire-Detection Mechanisms (AREA)
  • Alarm Systems (AREA)
  • Fire-Extinguishing By Fire Departments, And Fire-Extinguishing Equipment And Control Thereof (AREA)

Claims (12)

  1. Verfahren zum Verhindern und/oder Detektieren von Feuer durch ein Überwachungssystem (1), mit
    einer Mehrzahl von Videokameras (10),
    Umweltdetektionsmittel (20) zum Detektieren einiger Parameter, welche sich auf den zu überwachenden Bereich beziehen,
    einer Steuereinheit (30), welche dazu ausgestaltet ist, die Daten von der Mehrzahl der Videokameras (10) und von den Umweltdetektionsmitteln (20) zu empfangen und zu analysieren,
    dadurch gekennzeichnet, dass die Steuereinheit (30) die folgenden Schritte ausführt:
    a) es steuert das Schwenken zum Positionieren der Mehrzahl von Videokameras (10), wobei die Mehrzahl von Videokameras (10) mindestens eine erste Videokamera (11), die innerhalb des Nah-Infrarotbereiches (NIR) betrieben wird, zumindest eine zweite Videokamera (12), die innerhalb des Thermal-Infrarotbereiches (FIR) betrieben wird, und zumindest eine dritte Videokamera (13) aufweist, welche innerhalb des Ultraviolett-Bereiches (UV) betrieben wird,
    b) es wählt die am besten arbeitende Videokamera (11, 12, 13) aus der Vielzahl der Videokameras (10) auf der Basis eines Entropiewertes eines Bildes, welches durch jede Videokamera (11, 12, 13) erhalten wurde und als eine Funktion der Daten, die durch das Detektionsmittel (20) detektiert sind, aus, und
    c) es detektiert und/oder verhindert Feuer durch Verwendung der ausgewählten Videokamera (11, 12, 13).
  2. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass der Schritt b) des Auswählens einer Videokamera (11, 12, 13) gemäß einer Auswahl implementiert wird, welche innerhalb einer Datenbank (31) durchgeführt wird, die in einem Speicher (32) der Steuereinheit (30) gespeichert ist,
    wobei die Datenbank (31) sich auf die bestehende Beziehung zwischen der Entropie der Bilder der Videokameras (11, 12, 13) und der durch die Detektionsmittel (20) detektierten Daten bezieht.
  3. Verfahren nach Anspruch 1, gekennzeichnet durch einen Selbst-Kalibrierschritt zum automatischen Adaptieren der Umweltbedingungen, die durch die Detektionsmittel (20) detektiert wurden.
  4. Verfahren nach Anspruch 3, dadurch gekennzeichnet, dass während des Selbst-Kalibrierschrittes die Steuereinheit (30) die folgenden Schritte bei jedem Schwenken zum Positionieren der Mehrzahl von Videokameras (10) durchführt:
    c) es berechnet einen Entropiewert für jedes Bild (NIR, FIR, UV), das von den Videokameras (11, 12, 13) empfangen wurde, als eine Funktion der durch die Detektionsmittel (20) detektierten Daten,
    d) es zeigt an, welcher Bildtyp (NIR, FIR, UV), der von den Videokameras (11, 12, 13) empfangen wurde, den höchsten Entropiewert als eine Funktion der durch die Detektionsmittel (20) detektierten Daten aufweist,
    e) es speichert in die Datenbank (31) einen Hinweis, welche Videokamera (11, 12, 13) aus der Mehrzahl der Videokameras (10) bei Vorhandensein der durch die Detektionsmittel (20) detektierten Daten ausgewählt werden muss.
  5. Verfahren nach Anspruch 4, dadurch gekennzeichnet, dass der Schritt e) des Speicherns in die Datenbank (31) einen Hinweis hinsichtlich der auszuwählenden Videokamera (11, 12, 13) lediglich erfolgt, wenn der Schritt d) des Auswählens eines Bildtypes (NIR, FIR, UV) mit dem höchsten Entropiewert eine vorbestimmte Anzahl wiederholt worden ist.
  6. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass die Detektionsmittel (20) Daten entsprechend einer Temperatur (Ti) und einer Luftfeuchtigkeit (Hi) zu einem bestimmten Zeitpunkt (i) detektiert.
  7. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass das Detektionsmittel (20) ebenfalls zusätzliche Daten insbesondere hinsichtlich der Windintensität und der Erfassungszeit detektiert.
  8. Verfahren nach einem der Ansprüche 5 und 7, dadurch gekennzeichnet, dass die Steuereinheit (30) die Anzahl der Wiederholungen des Schrittes d) des Auswählens eines Bildtypes (NIR, FIR, UV) mit dem höchsten Entropiewert bei Vorhandensein der durch die Detektionsmittel (20) detektierten zusätzlichen Daten erhöht.
  9. Verfahren nach Anspruch 1, gekennzeichnet durch ein Vorsehen einer globalen Übersicht des überwachten Bereiches durch Bilder von einer vierten Videokamera (14), welche innerhalb des sichtbaren Lichtbereiches betrieben wird, insbesondere durch Assoziierung der Bilder, die durch die vierte Videokamera (14) geliefert werden, mit denjenigen Bildern, welche durch die Videokamera (11, 12, 13) geliefert werden, welche aus der ersten, zweiten und dritten Videokamera (11, 12, 13) ausgewählt wurde.
  10. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass die Steuereinheit (30) die Daten an ein Remote Center (40) sendet, um eine Planung einer adäquaten Feuerbekämpfungsstrategie zu ermöglichen.
  11. Überwachungssystem (1), welches zur Implementierung des Verfahrens nach einem der Ansprüche 1 bis 10 ausgestaltet ist.
  12. Computerprogrammprodukt, welches in einen Speicher (32) einer Steuereinheit (30) des Überwachungssystems (1) geladen werden kann, mit
    Softwarecodeabschnitten zum Implementieren des Verfahrens nach einem der Ansprüche 1 bis 10, wenn das Produkt in der Steuereinheit (30) ausgeführt wird.
EP10165726A 2009-06-17 2010-06-11 Verfahren zur Verhütung und/oder Feststellung von Bränden, Überwachungssystem und Computerprogramm dafür Active EP2264677B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
ITTO2009A000459A IT1394450B1 (it) 2009-06-17 2009-06-17 Metodo di prevenzione e/o di rilevazione di un incendio, e relativi sistema di controllo e prodotto informatico

Publications (2)

Publication Number Publication Date
EP2264677A1 EP2264677A1 (de) 2010-12-22
EP2264677B1 true EP2264677B1 (de) 2012-05-30

Family

ID=41314542

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10165726A Active EP2264677B1 (de) 2009-06-17 2010-06-11 Verfahren zur Verhütung und/oder Feststellung von Bränden, Überwachungssystem und Computerprogramm dafür

Country Status (2)

Country Link
EP (1) EP2264677B1 (de)
IT (1) IT1394450B1 (de)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108806165A (zh) * 2018-08-15 2018-11-13 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN108961647A (zh) * 2018-08-15 2018-12-07 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN108986379A (zh) * 2018-08-15 2018-12-11 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN110097732A (zh) * 2019-05-08 2019-08-06 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3084736B1 (de) 2013-12-17 2019-05-01 Tyco Fire Products LP System und verfahren zur erkennung und unterdrückung von bränden mittels windinformationen
CN103903020B (zh) * 2014-04-22 2017-10-27 天津市协力自动化工程有限公司 一种基于CodeBook 的火灾图像识别方法及装置
CN112013250A (zh) * 2020-07-13 2020-12-01 安徽建筑大学 一种红外与视频分析技术结合的室内火灾报警器

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5959589A (en) * 1997-07-02 1999-09-28 Waveband Corporation Remote fire detection method and implementation thereof
ATE355576T1 (de) * 2002-07-16 2006-03-15 Gs Gestione Sistemi S R L System und verfahren zur thermischen überwachung eines gebietes

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108806165A (zh) * 2018-08-15 2018-11-13 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN108961647A (zh) * 2018-08-15 2018-12-07 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN108986379A (zh) * 2018-08-15 2018-12-11 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN108961647B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN108986379B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN108806165B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN110097732A (zh) * 2019-05-08 2019-08-06 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法
CN110097732B (zh) * 2019-05-08 2021-07-20 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法

Also Published As

Publication number Publication date
ITTO20090459A1 (it) 2010-12-18
IT1394450B1 (it) 2012-06-15
EP2264677A1 (de) 2010-12-22

Similar Documents

Publication Publication Date Title
EP2264677B1 (de) Verfahren zur Verhütung und/oder Feststellung von Bränden, Überwachungssystem und Computerprogramm dafür
US11467098B2 (en) Systems and methods for monitoring remote installations
CN110602943B (zh) 监测作物的系统和方法
JP7040443B2 (ja) ガス検知システム
EP3621850B1 (de) Blendenfreie ferninfrarot (fir)-kamera für sicherheits- und antriebssysteme in kraftfahrzeugen
CA3192820C (en) Object tracking system optimization and tools
JP6557225B2 (ja) プロセス品質を保証し向上させるためのシステム及び方法
KR101533905B1 (ko) 비행장 내의 이물질, 파편 또는 손상 검출 감시 시스템 및 방법
US10762638B2 (en) Autonomous camera-to-camera change detection system
US20150211933A1 (en) Camera, computer program and method for measuring thermal radiation and thermal rates of change
US8115655B2 (en) Method and system for monitoring of the temperature of the surface of an aircraft
EP3340603B1 (de) Fokussierung einer überwachungskamera, die eine szene überwacht
CN104902858A (zh) 用于检测弧数据的焊接面罩
WO2012155200A1 (en) Surveillance system
US10983515B2 (en) Driving information display device, driving information display method, and method of controlling driving speed of working vehicle
McNeil et al. Robotic fire suppression through autonomous feedback control
KR20120081496A (ko) 열화상 온도분석을 통한 산불 발생 감지 방법
JP7128577B2 (ja) 監視装置
FR2989456A1 (fr) Systeme teleopere de traitement de cibles
KR20190109644A (ko) 온실 데이터 수집 이상 감지 장치 및 그 방법
EP3086300B1 (de) Wärmebildsystem und verfahren zur erzeugung eines wärmebildes
KR101824042B1 (ko) 카메라 일체형 레이저 검지 장치 및 그의 동작 방법
US20190025543A1 (en) Method for producing a photo- or video-image of at least one object to be recorded
KR101558981B1 (ko) 카메라의 자동 초점 조절 장치
US20230360211A1 (en) Systems, apparatuses, and methods for detecting early drought stress in plants

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

17P Request for examination filed

Effective date: 20110614

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G08B 17/12 20060101AFI20111104BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20120802

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120930

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120831

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121001

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20130101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120910

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130101

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

26N No opposition filed

Effective date: 20130301

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120730

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100611

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140611

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20240521

Year of fee payment: 15