EP2264677A1 - Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant - Google Patents

Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant Download PDF

Info

Publication number
EP2264677A1
EP2264677A1 EP10165726A EP10165726A EP2264677A1 EP 2264677 A1 EP2264677 A1 EP 2264677A1 EP 10165726 A EP10165726 A EP 10165726A EP 10165726 A EP10165726 A EP 10165726A EP 2264677 A1 EP2264677 A1 EP 2264677A1
Authority
EP
European Patent Office
Prior art keywords
detection means
video camera
video cameras
control unit
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP10165726A
Other languages
German (de)
English (en)
Other versions
EP2264677B1 (fr
Inventor
Giorgio Pelosio
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Teletron Euroricherche SRL
Original Assignee
Teletron Euroricherche SRL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Teletron Euroricherche SRL filed Critical Teletron Euroricherche SRL
Publication of EP2264677A1 publication Critical patent/EP2264677A1/fr
Application granted granted Critical
Publication of EP2264677B1 publication Critical patent/EP2264677B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke

Definitions

  • the present invention relates to a method for fire prevention and/or detection according to the preamble of claim 1.
  • the present invention also relates to a monitoring system and a computer product adapted to implement said method.
  • the electromagnetic spectrum (or EM spectrum) is the interval of all possible frequencies of radiations, which are electromagnetic waves characterized by a wavelength and a frequency; since wavelength and frequency of a radiation are inversely proportional to each other, the shorter the wavelength the higher the frequency, and thus the energy.
  • Shorter wavelengths correspond to ultraviolet rays, X-rays and gamma rays, all of which have frequencies higher than visible light, and therefore more energy than the latter.
  • the wavelengths of radio waves, microwaves and infrared radiations are longer than visible light, and therefore they carry less energy.
  • Monitoring systems for fire prevention and/or detection are known in the art which comprise automatic panoramic shooting means, thus acquiring images supplied by a plurality of video cameras and assembling said images together in order to immediately provide the operator with a clear global view of the monitored scenario.
  • the fire prevention monitoring systems known in the art employ a plurality of video cameras, which in particular include:
  • Said first and second video cameras usually perform a 360° rotation in order to attain a global view of the area to be monitored.
  • fire prevention monitoring systems known in the art comprise:
  • the fire prevention monitoring systems known in the art are not suited to detecting a fire in critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc.
  • a further drawback suffered by the fire prevention monitoring systems known in the art is that they cannot monitor in a detailed manner the state of the vegetation in the monitored area.
  • the present invention also relates to a fire prevention monitoring system as well as to a computer product which can be loaded into a memory of a control unit of the monitoring system, comprising software code portions for implementing said method when the product is executed in the control unit.
  • reference numeral 1 designates as a whole a fire prevention monitoring system according to the present invention.
  • the monitoring system 1 comprises a plurality of video cameras, indicated as a whole by reference numeral 10.
  • said plurality of video cameras 10 is of the Pan Tilt Zoom (PTZ) type and performs a non-continuous 360° rotation.
  • PTZ Pan Tilt Zoom
  • said plurality of video cameras 10 comprises:
  • the monitoring system 1 comprises:
  • control unit 30 implements the fire prevention and/or detection method according to the present invention by carrying out the following steps:
  • the monitoring system 1 allows to carry out an analysis of the territory within different ranges of the electromagnetic spectrum, so that said analysis can be adapted to the different climatic conditions of the area to be monitored.
  • the infrared range analysis varies much depending on the degree of humidity in the monitored area, i.e. of the degree of transparency of the air in said area.
  • the air transparency degree is strongly affected by climatic conditions (in particular, degree of humidity and temperature).
  • the quality of the area analysis performed by using a video camera operating in a certain wavelength may vary considerably; for example, ultraviolet analyses (10 nm - 0.4 ⁇ m) are more detailed, but at the same time they are more sensitive to transparency than near IR analyses (0.7 - 1.3 ⁇ m), which may be more accurate in the presence of greater atmospheric opacity.
  • said step b) of selecting a video camera 11, 12, 13 is implemented according to a choice made within a database 31 stored in a memory 32 of said control unit 30, said database 31 concerning the existing relationship between the entropy of the images of said video cameras 11, 12, 13 and the data detected by said detection means 20.
  • entropy is that parameter which estimates the quantity of information contained in a certain image. The less significant data is present in an image, the closer to zero is the maximum entropy value obtained therefrom; on the contrary, the higher the quantity of significant data contained in an image, the higher the entropy value thereof.
  • the method according to the present invention comprises a self-calibration step for automatically adapting to the environmental conditions detected by the detection means 20.
  • control unit 30 implements the following steps at each traverse for positioning said plurality of video cameras 10:
  • the system adapts itself automatically to the environmental conditions without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13.
  • control unit 30 directly uses the image received from said video cameras 11, 12, 13 by associating the data detected by said detection means 20 with the corresponding entropy value; this association is especially quick and advantageous, in that both the data detected by said detection means 20 and the corresponding entropy values have been stored in said database 31 during the self-calibration step.
  • the monitoring system 1 also provides the user with a global view of the monitored area through images supplied by a fourth video camera 14 operating within the visible light range, in particular by associating the images supplied by said fourth video camera 14 with those supplied by a video camera 11, 12, 13 selected among said first 11, second 12 and third 13 video cameras.
  • Fig. 2 shows a block diagram of the method for fire prevention and/or detection according to the present invention.
  • control unit 30 carries out the following steps:
  • the indication relating to which video camera 11, 12, 13 must be selected in the presence of the data detected by the detection means 20 is only stored into the database when an image type (NIR, FIR, UV) having a maximum entropy value (equivalent to the relative number of occurrences R si ) is received for a determined number of times (equivalent to the maximum number of occurrences R max set in the system 1).
  • NIR image type
  • FIR FIR
  • UV maximum entropy value
  • said detection means 20 mainly detect data corresponding to a temperature T i and a degree of humidity H i at a certain time instant i.
  • the detection means 20 may also detect additional data, such as data pertaining to wind intensity, time of detection, and so on.
  • the control unit 30 may increment the maximum number of occurrences R max in order to adapt the self-calibration step to the increase in the quantity of data to be taken into account; this is essentially equal to saying that the control unit 30 increments the number of times that the picking up of an image type (NIR, FIR, UV) having a maximum entropy value is to be repeated in the presence of said additional data detected by the detection means 20.
  • NIR image type
  • control unit 30 may send the data to a remote centre 40, e.g. via an Internet connection, thus allowing an appropriate fire fighting strategy to be planned.
  • such advantages consist in that the method for fire prevention and/or detection according to the present invention, as well as the monitoring system thereof, allow a high analysis quality to be preserved as the climatic conditions in the surrounding scenario and in the monitored area change.
  • the monitoring system 1 allows to perform an analysis of the territory within different ranges of the electromagnetic spectrum as a function of the data detected by the detection means 20, said data pertaining to temperature, humidity, wind intensity, time of detection, and so on.
  • the method for fire prevention and/or detection according to the present invention uses that video camera 11, 12, 13 which is most suitable for operating in certain environmental conditions on the basis of the data detected by said detection means 20; this ensures optimization of the fire prevention and detection process whatever the environmental condition in the monitored area.
  • the method and system according to the present invention are suited to detecting a fire even in the presence of critical visibility conditions, e.g. when it is dark, rainy, hazy, foggy, etc., as well as to monitoring in a detailed manner the state of the vegetation in the surrounding scenario.
  • a further advantage of the method and system according to the present invention lies in the fact that, thanks to the execution of a self-calibration step, the method and system according to the present invention adapt themselves automatically to the actual environmental conditions, without having to calculate an entropy value for each image (NIR, FIR, UV) received from said video cameras 11, 12, 13; as a consequence, the monitoring system 1 can directly use the image having the highest entropy, thus reacting very quickly and bringing an unquestionable advantage in terms of fire detection rapidity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Fire-Detection Mechanisms (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Fire-Extinguishing By Fire Departments, And Fire-Extinguishing Equipment And Control Thereof (AREA)
  • Alarm Systems (AREA)
EP10165726A 2009-06-17 2010-06-11 Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant Active EP2264677B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
ITTO2009A000459A IT1394450B1 (it) 2009-06-17 2009-06-17 Metodo di prevenzione e/o di rilevazione di un incendio, e relativi sistema di controllo e prodotto informatico

Publications (2)

Publication Number Publication Date
EP2264677A1 true EP2264677A1 (fr) 2010-12-22
EP2264677B1 EP2264677B1 (fr) 2012-05-30

Family

ID=41314542

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10165726A Active EP2264677B1 (fr) 2009-06-17 2010-06-11 Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant

Country Status (2)

Country Link
EP (1) EP2264677B1 (fr)
IT (1) IT1394450B1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103903020A (zh) * 2014-04-22 2014-07-02 天津市协力自动化工程有限公司 一种基于CodeBook的火灾图像识别方法及装置
WO2015092693A1 (fr) * 2013-12-17 2015-06-25 Tyco Fire & Security Gmbh Système et procédé pour détecter et supprimer une incendie en utilisant des informations de vent
CN112013250A (zh) * 2020-07-13 2020-12-01 安徽建筑大学 一种红外与视频分析技术结合的室内火灾报警器

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986379B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 带红外拍照的火焰探测器及其控制方法
CN108961647B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 拍照式火焰探测器及其控制方法
CN108806165B (zh) * 2018-08-15 2020-09-08 重庆英卡电子有限公司 拍照式火焰探测系统及其控制方法
CN110097732B (zh) * 2019-05-08 2021-07-20 江西省天眼科技有限公司 一种火焰探测监控装置及其处理方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5959589A (en) * 1997-07-02 1999-09-28 Waveband Corporation Remote fire detection method and implementation thereof
US20070000317A1 (en) * 2002-07-16 2007-01-04 Umberto Berti System and method for territory thermal monitoring

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5959589A (en) * 1997-07-02 1999-09-28 Waveband Corporation Remote fire detection method and implementation thereof
US20070000317A1 (en) * 2002-07-16 2007-01-04 Umberto Berti System and method for territory thermal monitoring

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015092693A1 (fr) * 2013-12-17 2015-06-25 Tyco Fire & Security Gmbh Système et procédé pour détecter et supprimer une incendie en utilisant des informations de vent
US9990825B2 (en) 2013-12-17 2018-06-05 Tyco Fire & Security Gmbh System and method for detecting and suppressing fire using wind information
US9990824B2 (en) 2013-12-17 2018-06-05 Tyco Fire & Security Gmbh System and method for detecting fire location
US10497243B2 (en) 2013-12-17 2019-12-03 Tyco Fire Products System and method for detecting fire location
US10573145B2 (en) 2013-12-17 2020-02-25 Tyco Fire Products System and method for detecting and suppressing fire using wind information
US11257341B2 (en) 2013-12-17 2022-02-22 Tyco Fire Products System and method for monitoring and suppressing fire
CN103903020A (zh) * 2014-04-22 2014-07-02 天津市协力自动化工程有限公司 一种基于CodeBook的火灾图像识别方法及装置
CN103903020B (zh) * 2014-04-22 2017-10-27 天津市协力自动化工程有限公司 一种基于CodeBook 的火灾图像识别方法及装置
CN112013250A (zh) * 2020-07-13 2020-12-01 安徽建筑大学 一种红外与视频分析技术结合的室内火灾报警器

Also Published As

Publication number Publication date
IT1394450B1 (it) 2012-06-15
EP2264677B1 (fr) 2012-05-30
ITTO20090459A1 (it) 2010-12-18

Similar Documents

Publication Publication Date Title
EP2264677B1 (fr) Procédé pour la détection et la prévention d'incendies, système de surveillance et produit informatique correspondant
US11467098B2 (en) Systems and methods for monitoring remote installations
EP3557972B1 (fr) Système et procédé de surveillance de récoltes
EP3621850B1 (fr) Caméra à infrarouge lointain (fir) sans obturateur pour systèmes de conduite et de sécurité automobiles
JP6557225B2 (ja) プロセス品質を保証し向上させるためのシステム及び方法
US8374438B1 (en) Visual template-based thermal inspection system
JP7040443B2 (ja) ガス検知システム
US9000371B2 (en) Camera, computer program and method for measuring thermal radiation and thermal rates of change
AU2019229392A1 (en) Self-configurable tracking tags and methods of use
US11393102B2 (en) Autonomous camera-to-camera change detection system
KR20140029394A (ko) 비행장 내의 이물질, 파편 또는 손상 검출 감시 시스템 및 방법
EP2186059A1 (fr) Système et méthode de surveillance d'une piste
US8115655B2 (en) Method and system for monitoring of the temperature of the surface of an aircraft
KR101672501B1 (ko) 광 조건들을 변경하는 것으로 인한 픽셀 밀도 요건에서의 변화에 대한 필요를 결정하는 방법 및 장치
WO2006071536A1 (fr) Methode et appareil pour imager une cible au moyen d'une prediction et d'une detection d'obscurcissement nuageux
EP3340603B1 (fr) Mise au point d'une caméra de surveillance d'une scène
US10983515B2 (en) Driving information display device, driving information display method, and method of controlling driving speed of working vehicle
KR20120081496A (ko) 열화상 온도분석을 통한 산불 발생 감지 방법
US20140036092A1 (en) Automatic Exposure Calibration And Compensation For Machine Vision
McNeil et al. Robotic fire suppression through autonomous feedback control
CN107864375A (zh) 带对准分析的成像设备
KR20210118749A (ko) 장면의 온도 캘리브레이션 및 온도의 결정을 위한 방법, 디바이스 및 시스템
US20190020791A1 (en) Techniques for correcting oversaturated pixels in shutterless fir cameras
KR101534046B1 (ko) 환경에 따른 자동 필터체인지 카메라
EP2505975A1 (fr) Dispositif et procédé pour positionner de manière séquentielle des indicateurs sur une image

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME RS

17P Request for examination filed

Effective date: 20110614

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G08B 17/12 20060101AFI20111104BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20120802

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120530

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120930

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 560371

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120831

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121001

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602010001751

Country of ref document: DE

Effective date: 20130101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120910

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130101

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

26N No opposition filed

Effective date: 20130301

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130426

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120830

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120730

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120530

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20100611

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20140611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140611

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230524

Year of fee payment: 14