EP2264677B1 - Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant - Google Patents

Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant Download PDF

Info

Publication number
EP2264677B1
EP2264677B1 EP10165726A EP10165726A EP2264677B1 EP 2264677 B1 EP2264677 B1 EP 2264677B1 EP 10165726 A EP10165726 A EP 10165726A EP 10165726 A EP10165726 A EP 10165726A EP 2264677 B1 EP2264677 B1 EP 2264677B1
Authority
EP
European Patent Office
Prior art keywords
detection means
video camera
video cameras
control unit
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10165726A
Other languages
German (de)
English (en)
Other versions
EP2264677A1 (fr
Inventor
Giorgio Pelosio
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Teletron Euroricherche SRL
Original Assignee
Teletron Euroricherche SRL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Teletron Euroricherche SRL filed Critical Teletron Euroricherche SRL
Publication of EP2264677A1 publication Critical patent/EP2264677A1/fr
Application granted granted Critical
Publication of EP2264677B1 publication Critical patent/EP2264677B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke

Definitions

  • the present invention relates to a method for fire prevention and/or detection according to the preamble of claim 1. Such method is disclosed in US 2007 000317 .
  • the present invention also relates to a monitoring system and a computer product adapted to implement said method.
  • the electromagnetic spectrum (or EM spectrum) is the interval of all possible frequencies of radiations, which are electromagnetic waves characterized by a wavelength and a frequency; since wavelength and frequency of a radiation are inversely proportional to each other, the shorter the wavelength the higher the frequency, and thus the energy.
  • Shorter wavelengths correspond to ultraviolet rays, X-rays and gamma rays, all of which have frequencies higher than visible light, and therefore more energy than the latter.
  • the wavelengths of radio waves, microwaves and infrared radiations are longer than visible light, and therefore they carry less energy.
  • Monitoring systems for fire prevention and/or detection are known in the art which comprise automatic panoramic shooting means, thus acquiring images supplied by a plurality of video cameras and assembling said images together in order to immediately provide the operator with a clear global view of the monitored scenario.
  • the fire prevention monitoring systems known in the art employ a plurality of video cameras, which in particular include:
  • Said first and second video cameras usually perform a 360° rotation in order to attain a global view of the area to be monitored.
  • fire prevention monitoring systems known in the art comprise:
  • the fire prevention monitoring systems known in the art are not suited to detecting a fire in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
  • a further drawback suffered by the fire prevention monitoring systems known in the art is that they cannot monitor in a detailed manner the state of the vegetation in the monitored area.
  • the present invention also relates to a fire prevention monitoring system as well as to a computer product which can be loaded into a memory of a control unit of the monitoring system, comprising software code portions for implementing said method when the product is executed in the control unit.
  • reference numeral 1 designates as a whole a fire prevention monitoring system according to the present invention.
  • the monitoring system 1 comprises a plurality of video cameras, indicated as a whole by reference numeral 10.
  • said plurality of video cameras 10 is of the Pan Tilt Zoom (PTZ) type and performs a non-continuous 360° rotation.
  • PTZ Pan Tilt Zoom
  • said plurality of video cameras 10 comprises:
  • the monitoring system 1 comprises:
  • control unit 30 implements the fire prevention and/or detection method according to the present invention by carrying out the following steps:
  • the monitoring system 1 allows to carry out an analysis of the territory within different ranges of the electromagnetic spectrum, so that said analysis can be adapted to the different climatic conditions of the area to be monitored.
  • the infrared range analysis varies much depending on the degree of humidity in the monitored area, i.e. of the degree of transparency of the air in said area.
  • the air transparency degree is strongly affected by climatic conditions (in particular, degree of humidity and temperature).
  • the quality of the area analysis performed by using a video camera operating in a certain wavelength may vary considerably; for example, ultraviolet analyses (10 nm - 0.4 ⁇ m) are more detailed, but at the same time they are more sensitive to transparency than near IR analyses (0.7 - 1.3 ⁇ m), which may be more accurate in the presence of greater atmospheric opacity.
  • said step b) of selecting a video camera 11, 12, 13 is implemented according to a choice made within a database 31 stored in a memory 32 of said control unit 30, said database 31 concerning the existing relationship between the entropy of the images of said video cameras 11, 12, 13 and the data detected by said detection means 20.
  • entropy is that parameter which estimates the quantity of information contained in a certain image. The less significant data is present in an image, the closer to zero is the maximum entropy value obtained therefrom; on the contrary, the higher the quantity of significant data contained in an image, the higher the entropy value thereof.
  • the method according to the present invention comprises a self-calibration step for automatically adapting to the environmental conditions detected by the detection means 20.
  • control unit 30 implements the following steps at each traverse for positioning said plurality of video cameras 10:
  • the system adapts itself automatically to the environmental conditions without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13.
  • control unit 30 directly uses the image received from said video cameras 11, 12, 13 by associating the data detected by said detection means 20 with the corresponding entropy value; this association is especially quick and advantageous, in that both the data detected by said detection means 20 and the corresponding entropy values have been stored in said database 31 during the self-calibration step.
  • the monitoring system 1 also provides the user with a global view of the monitored area through images supplied by a fourth video camera 14 operating within the visible light range, in particular by associating the images supplied by said fourth video camera 14 with those supplied by a video camera 11, 12, 13 selected among said first 11, second 12 and third 13 video cameras.
  • Fig. 2 shows a block diagram of the method for fire prevention and/or detection according to the present invention.
  • control unit 30 carries out the following steps:
  • the indication relating to which video camera 11, 12, 13 must be selected in the presence of the data detected by the detection means 20 is only stored into the database when an image type (NIR, FIR, UV) having a maximum entropy value (equivalent to the relative number of occurrences R si ) is received for a determined number of times (equivalent to the maximum number of occurrences R max set in the system 1).
  • NIR image type
  • FIR FIR
  • UV maximum entropy value
  • said detection means 20 mainly detect data corresponding to a temperature T i and a degree of humidity H i at a certain time instant i.
  • the detection means 20 may also detect additional data, such as data pertaining to wind intensity, time of detection, and so on.
  • the control unit 30 may increment the maximum number of occurrences R max in order to adapt the self-calibration step to the increase in the quantity of data to be taken into account; this is essentially equal to saying that the control unit 30 increments the number of times that the picking up of an image type (NIR, FIR, UV) having a maximum entropy value is to be repeated in the presence of said additional data detected by the detection means 20.
  • NIR image type
  • control unit 30 may send the data to a remote centre 40, e.g. via an Internet connection, thus allowing an appropriate fire fighting strategy to be planned.
  • such advantages consist in that the method for fire prevention and/or detection according to the present invention, as well as the monitoring system thereof, allow a high analysis quality to be preserved as the climatic conditions in the surrounding scenario and in the monitored area change.
  • the monitoring system 1 allows to perform an analysis of the territory within different ranges of the electromagnetic spectrum as a function of the data detected by the detection means 20, said data pertaining to temperature, humidity, wind intensity, time of detection, and so on.
  • the method for fire prevention and/or detection according to the present invention uses that video camera 11, 12, 13 which is most suitable for operating in certain environmental conditions on the basis of the data detected by said detection means 20; this ensures optimization of the fire prevention and detection process whatever the environmental condition in the monitored area.
  • the method and system according to the present invention are suited to detecting a fire even in the presence of critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc., as well as to monitoring in a detailed manner the state of the vegetation in the surrounding scenario.
  • a further advantage of the method and system according to the present invention lies in the fact that, thanks to the execution of a self-calibration step, the method and system according to the present invention adapt themselves automatically to the actual environmental conditions, without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13; as a consequence, the monitoring system 1 can directly use the image having the highest entropy, thus reacting very quickly and bringing an unquestionable advantage in terms of fire detection rapidity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Fire-Detection Mechanisms (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Fire-Extinguishing By Fire Departments, And Fire-Extinguishing Equipment And Control Thereof (AREA)
  • Alarm Systems (AREA)

Claims (12)

  1. Procédé destiné à la prévention et/ou à la détection d'incendies par l'intermédiaire d'un système de surveillance (1) comportant :
    - une pluralité de caméras vidéo (10) ;
    - des moyens de détection environnementaux (20) pour détecter quelques paramètres concernant la zone à surveiller ;
    - une unité de commande (30) adaptée pour recevoir et analyser les données provenant de ladite pluralité de caméras vidéo (10) et desdits moyens de détection environnementaux (20),
    caractérisé en ce que
    ladite unité de commande (30) met en oeuvre les étapes suivantes :
    a) elle commande le déplacement permettant de positionner ladite pluralité de caméras vidéo (10), ladite pluralité de caméras vidéo (10) comprenant au moins une première caméra vidéo (11) opérant dans le domaine du proche infrarouge (NIR), au moins une seconde caméra vidéo (12) opérant dans le domaine de l'infrarouge thermique (FIR) et au moins une troisième caméra vidéo (13) opérant dans le domaine de l'ultraviolet (UV) ;
    b) elle sélectionne la caméra vidéo donnant la meilleure performance (11, 12, 13) parmi ladite pluralité des caméras vidéo (10) sur la base de la valeur d'entropie d'une image obtenue par chaque caméra vidéo (11, 12, 13) et en fonction des données détectées par lesdits moyens de détection (20) ;
    c) elle détecte et/ou empêche les incendies en utilisant ladite caméra vidéo sélectionnée (11, 12, 13).
  2. Procédé selon la revendication 1, caractérisé en ce que ladite étape b) de sélection d'une caméra vidéo (11, 12, 13) est mise en oeuvre selon un choix effectué à l'intérieur d'une base de données (31) stockées dans une mémoire (32) de ladite unité de commande (30), ladite base de données (31) concernant la relation existant entre l'entropie des images desdites caméras vidéo (11, 12, 13) et les données détectées par lesdits moyens de détection (20).
  3. Procédé selon la revendication 1, caractérisé par le fait de comporter une étape d'auto-calibrage destinée à s'adapter automatiquement aux conditions environnementales détectées par les moyens de détection (20).
  4. Procédé selon la revendication 3, caractérisé en ce que, pendant ladite étape d'auto-calibrage, l'unité de commande (30) met en oeuvre les étapes suivantes au niveau de chaque déplacement en vue de positionner ladite pluralité de caméras vidéo (10) :
    d) elle calcule une valeur d'entropie pour chaque image (NIR, FIR, UV) reçue à partir desdites caméras vidéo (11, 12, 13) en fonction des données détectées par lesdits moyens de détection (20) ;
    e) elle indique quel type d'image reçue (NIR, FIR, UV) à partir desdites caméras vidéo (11, 12, 13) présente la valeur d'entropie la plus élevée en fonction desdites données détectées par lesdits moyens de détection (20) ;
    f) elle stocke dans ladite base de données (31) une indication concernant la caméra vidéo (11, 12, 13) qui doit être sélectionnée parmi ladite pluralité de caméras vidéo (10) en présence desdites données détectées par les moyens de détection (20).
  5. Procédé selon la revendication 4, caractérisé en ce que, à ladite étape e) de stockage dans ladite base de données (31) l'indication de la caméra vidéo (11, 12, 13) à sélectionner se produit seulement lorsque ladite étape d) de choix du type d'image (NIR, FIR, UV) présentant la valeur d'entropie la plus élevée a été répétée durant un nombre de fois prédéterminé.
  6. Procédé selon la revendication 1, caractérisé en ce que lesdits moyens de détection (20) détectent des données correspondant à une température (Ti) et à un degré d'humidité (Hi) à un certain instant (i).
  7. Procédé selon la revendication 1, caractérisé en ce que lesdits moyens de détection (20) détectent également des données supplémentaires, se rapportant, en particulier, à la force du vent et à l'heure de la détection.
  8. Procédé selon les revendications 5 et 7, caractérisé en ce que ladite unité de commande (30) augmente le nombre de fois que l'étape d) de choix du type d'image (NIR, FIR, UV) présentant la valeur d'entropie la plus élevée doit être répétée en présente desdites données supplémentaires détectées par les moyens de détection (20).
  9. Procédé selon la revendication 1, caractérisé par le fait de fournir une vue globale de la zone surveillée par l'intermédiaire des images fournies par une quatrième caméra vidéo (14) opérant dans le domaine de la lumière visible, en particulier en associant les images fournies par ladite quatrième caméra vidéo (14) à celles fournies par cette caméra vidéo (11, 12, 13) qui a été sélectionnée parmi lesdites première (11), deuxième (12) et troisième (13) caméras vidéo.
  10. Procédé selon la revendication 1, caractérisé en ce que l'unité de commande (30) transmet les données à un centre à distance (40) afin de permettre l'organisation d'une stratégie adéquate de lutte contre les incendies.
  11. Système de surveillance (1) adapté pour mettre en oeuvre le procédé selon l'une quelconque des revendications 1 à 10.
  12. Produit informatique qui peut être chargé dans une mémoire (32) d'une unité de commande (30) d'un système de surveillance (1), comportant des parties de code logiciel permettant de mettre en oeuvre le procédé selon l'une quelconque des revendications 1 à 10 lorsque le produit est exécuté dans l'unité de commande (30).
EP10165726A 2009-06-17 2010-06-11 Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant Active EP2264677B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
ITTO2009A000459A IT1394450B1 (it) 2009-06-17 2009-06-17 Metodo di prevenzione e/o di rilevazione di un incendio, e relativi sistema di controllo e prodotto informatico

Publications (2)

Publication Number Publication Date
EP2264677A1 EP2264677A1 (fr) 2010-12-22
EP2264677B1 true EP2264677B1 (fr) 2012-05-30

Family

ID=41314542

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10165726A Active EP2264677B1 (fr) 2009-06-17 2010-06-11 Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant

Country Status (2)

Country Link
EP (1) EP2264677B1 (fr)
IT (1) IT1394450B1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108806165A (zh) * 2018-08-15 2018-11-13 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN108961647A (zh) * 2018-08-15 2018-12-07 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN108986379A (zh) * 2018-08-15 2018-12-11 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN110097732A (zh) * 2019-05-08 2019-08-06 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015092692A1 (fr) 2013-12-17 2015-06-25 Tyco Fire & Security Gmbh Système et procédé de surveillance et de suppression d'incendie
CN103903020B (zh) * 2014-04-22 2017-10-27 天津市协力自动化工程有限公司 一种基于CodeBook 的火灾图像识别方法及装置
CN112013250A (zh) * 2020-07-13 2020-12-01 安徽建筑大学 一种红外与视频分析技术结合的室内火灾报警器

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5959589A (en) * 1997-07-02 1999-09-28 Waveband Corporation Remote fire detection method and implementation thereof
JP2005539287A (ja) * 2002-07-16 2005-12-22 ジエッセ ジェスティオーネ スィステミ エッセ．エッレ．エッレ． 地域熱監視のためのシステム及び方法

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108806165A (zh) * 2018-08-15 2018-11-13 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN108961647A (zh) * 2018-08-15 2018-12-07 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN108986379A (zh) * 2018-08-15 2018-12-11 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN108806165B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN108986379B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN108961647B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN110097732A (zh) * 2019-05-08 2019-08-06 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法
CN110097732B (zh) * 2019-05-08 2021-07-20 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法

Also Published As

Publication number Publication date
ITTO20090459A1 (it) 2010-12-18
EP2264677A1 (fr) 2010-12-22
IT1394450B1 (it) 2012-06-15

Similar Documents

Publication Publication Date Title
EP2264677B1 (fr) Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant
US11467098B2 (en) Systems and methods for monitoring remote installations
AU2021202136B2 (en) Object tracking system optimization and optimizers
JP7040443B2 (ja) ガス検知システム
CN110602943B (zh) 监测作物的系统和方法
EP3621850B1 (fr) Caméra à infrarouge lointain (fir) sans obturateur pour systèmes de conduite et de sécurité automobiles
JP6557225B2 (ja) プロセス品質を保証し向上させるためのシステム及び方法
KR101533905B1 (ko) 비행장 내의 이물질, 파편 또는 손상 검출 감시 시스템 및 방법
US9000371B2 (en) Camera, computer program and method for measuring thermal radiation and thermal rates of change
US11393102B2 (en) Autonomous camera-to-camera change detection system
US8115655B2 (en) Method and system for monitoring of the temperature of the surface of an aircraft
CN104902858A (zh) 用于检测弧数据的焊接面罩
US10397565B2 (en) Imaging device with alignment analysis
WO2012155200A1 (fr) Système de surveillance
KR101672501B1 (ko) 광 조건들을 변경하는 것으로 인한 픽셀 밀도 요건에서의 변화에 대한 필요를 결정하는 방법 및 장치
McNeil et al. Robotic fire suppression through autonomous feedback control
JP7128577B2 (ja) 監視装置
KR20190109644A (ko) 온실 데이터 수집 이상 감지 장치 및 그 방법
EP3086300B1 (fr) Système et procédé d'imagerie thermique permettant de créer une image thermique
US20190025543A1 (en) Method for producing a photo- or video-image of at least one object to be recorded
US20230360211A1 (en) Systems, apparatuses, and methods for detecting early drought stress in plants
KR101918761B1 (ko) 적외선 열상 검출기의 불량 화소 처리 방법 및 장치
JP2019512944A5 (fr)
CN118869954A (zh) 一种基于色彩量化的建筑施工安全检测系统

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

17P Request for examination filed

Effective date: 20110614

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G08B 17/12 20060101AFI20111104BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20120802

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120930

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120831

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121001

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20130101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120910

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130101

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

26N No opposition filed

Effective date: 20130301

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120730

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100611

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140611

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20240521

Year of fee payment: 15