EP1287509B1 - Systeme de surveillance - Google Patents

Systeme de surveillance Download PDF

Info

Publication number
EP1287509B1
EP1287509B1 EP01916017A EP01916017A EP1287509B1 EP 1287509 B1 EP1287509 B1 EP 1287509B1 EP 01916017 A EP01916017 A EP 01916017A EP 01916017 A EP01916017 A EP 01916017A EP 1287509 B1 EP1287509 B1 EP 1287509B1
Authority
EP
European Patent Office
Prior art keywords
coordinate value
marking means
digital representation
monitoring system
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP01916017A
Other languages
German (de)
English (en)
Other versions
EP1287509A1 (fr
Inventor
Karl-Erik Morander
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sequr SA
Original Assignee
Sequr S A
Sequr SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE0000925A external-priority patent/SE524332C2/sv
Application filed by Sequr S A, Sequr SA filed Critical Sequr S A
Publication of EP1287509A1 publication Critical patent/EP1287509A1/fr
Application granted granted Critical
Publication of EP1287509B1 publication Critical patent/EP1287509B1/fr
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639—Details of the system layout
    • G08B13/19652—Systems using zones in a single scene defined for different treatment, e.g. outer zone gives pre-alarm, inner zone gives alarm
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19697—Arrangements wherein non-video detectors generate an alarm themselves
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00—Fire alarms; Alarms responsive to explosion
    • G08B17/12—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125—Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke

Definitions

  • the present invention relates to a monitoring system for monitoring at least a fixed but displaceable object in a volume, which object is provided with at least one marking means in form of a light generating or light reflecting device, which system comprises at least one optical recording unit for recording an image of at least a part of the volume comprising said object provided with the marking means, device for transforming said image to a digital representation of the same image, means for comparison of the digital representation with a stored data-set, and device for generating a signal at the presence of a deviation at comparison of the digital representation with the stored information quantity.
  • each object is provided with active or passive sensors, which can alarm when a guarded point is trespassed.
  • active or passive sensors which can alarm when a guarded point is trespassed.
  • the disadvantage of such systems is that damage on an alarmed object cannot be detected immediately, which among others can result in time for manipulation of the alarm sensors.
  • transponders attached to the object to be guarded.
  • the transponders are continuously or periodically in radio communication with a controlling unit, which generates an alarm when a boarder is trespassed or an attempt is made to manipulate the transponder.
  • the drawbacks of such systems are that they are usually expensive, for instance because the transponders, complicated monitoring algorithms for several transponders, they do not detect displacements within the controlled area, the need of frequency band for operation and risk of radio interferences.
  • JP 11 003 474 relates to deciding the changes of the image of a monitored object by means of a reflected laser light from the monitored object and generating an alarm. Accordingly, a pattern corresponded to the incoming image, is compared with a stored pattern.
  • JP 11185175 it is decided whether the image of a marker has been changed or not, whereby an inputted image is compared to a stored image.
  • EP 393 807 relates to image processing, see for instance claim 1. An image of a marker is compared to a stored image and variations in the image edge are registered.
  • EP 984 412 signals from an image, or parts of an image, are continuously compared to a stored reference image, whereby correlation analysis is used. When differences are detected in the correlated signal a warning or alarm is generated.
  • WO 98/56182, US 4,160,998, US 5,880,775, DE 4417128 and DE 38 42 356 relate to image processing, where alarm is generated when frequent differences in the form of the images are detected.
  • the present invention relates to monitoring of a position of a marker, particularly its coordinates in two dimensions, and registering the deviation from a stationary position coordinate.
  • the changes of the form of the marker and the appearance are unimportant, since the coordinates are decided by means of a center of gravity or center point.
  • FR 2759541 mentions the use of coordinates.
  • the system relates to motion analysis, in which the motion of the markers are analyzed and if its motion pattern deviates from a motion-determined pattern, an alarm is generated.
  • the object of the present invention is to provide a system for substantially automatically, contactless and optical monitoring of a volume and/or a number of objects in a volume by means of simple means, substantially in real time without the need for complicated modifications within the volume or the object.
  • Another object of the present invention is to provide a simple but yet efficient thief-proof protection system.
  • Yet, another object of the invention is to provide a smoke detection system.
  • the stored data set comprises at least a two dimensional stationary coordinate value for the initial position of the marking means.
  • the system comprise means for extraction of at least one stationary coordinate value, which is at least a two-dimensional coordinate value, out of the digital representation for the marking means, whereby said comparison means compares said extracted two dimensional coordinate value to the stored stationary coordinate value.
  • a number of objects are provided with said marking means, where the objects are monitored for uncontrolled displacement.
  • each object is provided with a reflecting mark.
  • a part of the object can be used as a marking means.
  • several marking means are arranged on the same object.
  • the digital representation contains coordinate values for the marking means and that the stored data set comprises an initial position for the coordinate values of the marking means.
  • the light intensity of the marking means is measured and the data set stored comprises an initial light intensity.
  • the system comprises a heat detector.
  • the invention also relates to a method for monitoring an object in a volume provided with the steps included in claim 10.
  • the data comprises the value of the light intensity for said marking means.
  • the monitoring system consists of a measuring camera system, for instance such a system that can be used for motion analysis.
  • the system 10 which is shown in Fig. 1, comprises at least one camera 11, for monitoring of a number of objects 12 provided with markers 13.
  • the camera 11 is provided with means, such as a light flash, a lamp or another light source for sending out light, preferably (but not restricted to) infrared light or the like in form of short light flashes. If required, a continuous illumination can be used.
  • the markers 13 comprise a retro reflective tape or a body provided with a reflecting surface, which reflects the light back to the camera.
  • Active or passive markers may comprise illumination devices such as light diodes, which are activated by the camera or another control unit can be used.
  • a computer unit 14 for receiving image data from the camera, which as a rule is arranged with a CCD-unit (CCD: Charge Coupled Device) or another optical sensor.
  • CCD-unit Charge Coupled Device
  • the data from the sensor unit is preferably obtained in form of digital signals. Recording by means of the sensor, and converting the signal to digital or video signals, are assumed to be well known for a man skilled in the art, and will not be described further herein.
  • the computer unit 14 evaluates the image of each marker in the field of vision, substantially in real time (image speed 50-240 images/sec) and calculates the coordinates of the markers, preferably to its center (its center of gravity). Preferably, the coordinates are calculated with regard to an interior coordinate system.
  • the coordinate values can have a resolution of 1/50.000 of the field of vision.
  • the coordinates are continuously transferred, via for instance a serial interface, to a monitoring computer 15.
  • a memory unit 16 in the computer the original positions of the markers are stored. All uncontrolled deviation from the original coordinate value of a marker can initiate an alarm.
  • the original positions are registered, for instance by giving a particular command when the objects and the markers have been located on its correct position. If the position is changed, the new positions can be registered in the computer as new original positions.
  • the number of cameras in the room are chosen so that each marker in the monitored volume is seen by at least one camera.
  • the markers are arranged on objects to be protected and other points of interest in the room (doors, windows, etc).
  • all the coordinates are stored in the memory unit of the computer 16, which then continuously monitors every change of the coordinates.
  • a camera having a field of vision of approx 5 m detects a displacement of approx. 0.1 mm. Since the system is passive and has high resolution, it is not possible to interfere the system. Every attempt to manipulate a marker results in that the coordinate values of the marker are changed, which may lead to an alarm. Theoretically, a marker can be displaced from its location in direction towards the camera without the coordinate value is changed, but in practice, this should not be possible to perform. Moreover, several cameras can see a marker and even then, it is not theoretically possible to displace a mark. Of course, the system can be arranged so that it measures the distance between the camera and the mark, such as described in the Swedish patent No. 9700066-5.
  • the reliability of the system can be improved by providing a protected object in the system with two or more markers 13a-13c, which allows preventing false alarm if one of the markers is hidden, disturbed or is invisible for a camera, the remaining markers can be discovered.
  • the system according to the invention can be made completely self-calibrating and very easy to install.
  • the system can be arranged so that it indicates that if the markers are shown with sufficient intensity in itself.
  • the influence of operation on the measuring values can be easily eliminated in the monitoring computer, since all the markers are moved in the same way.
  • the markers are preferably comprised of recessed or punched parts of self-adhering reflex tape to a low cost. However, the markers can be replaced by reflections 13d from the surfaces of the objects if a fixed or defined illumination is arranged.
  • a tolerance area is defined in the monitoring computer, so that no alarm is generated as long as the object is within the tolerance area.
  • False markers can eventually appear if there are many bright objects in an image, which the camera apprehends as a reflex mark. False markers can be filtrated in most of the cases by means of that the measuring system contains information concerning the shape of each mark. The false markers. which eventually remain after the filtration, are no problem since they are in fact stationary. Varying strong sunlight may cause problem through dazzling the system, but by means of appropriate camera location, such problems can be eliminated.
  • the system also provides possibility for protecting encased objects in, for instance in transparent spaces such as display cabinets or the like, without the need for wire laying in the space etcetera.
  • the camera 21 also measures, in addition to the position of the marker, the light intensity received from the marker 22.
  • a disturbance in the measurement for instance because of a cloud of smoke 26 can be detected by the computer as the light intensity becomes weaker.
  • the clouds of smoke are detected, for instance a fire alarm may be generated.
  • the system can use coordinate values for detecting the marker and calculating its light intensity.
  • the system may also comprise communication means 15, 25, which in alarm mode sends a message to an alarm central or predetermined receivers.
  • the system can also be connected to a network, such as Internet, for remote control and remote monitoring.
  • system according to the invention may be completed with a sensor 30 for heat detection.

Claims (11)

  1. Système de surveillance (10, 20) pour surveiller au moins un objet fixe mais déplaçable dans un volume, lequel objet est muni d'au moins un moyen de marquage (13, 13a-13d, 23) sous la forme d'un dispositif de génération ou de représentation de lumière, lequel système comprend au moins une unité d'enregistrement optique (11, 21) pour enregistrer une image d'au moins une partie du volume comprenant ledit objet muni du moyen de marquage (13, 13a-13d, 23), dispositif pour transférer ladite image vers une représentation numérique de la même image, des moyens (14) pour la comparaison de la représentation numérique avec un ensemble de données enregistré, et dispositif pour générer un signal en présence d'un écart à la comparaison de la représentation numérique avec un ensemble de données enregistré, où
    ledit ensemble de données enregistré est obtenu par un processus d'auto-étalonnage, comprenant, dans une première étape, l'enregistrement d'une valeur de coordonnées stationnaires au moins bidimensionnelle pour la position du moyen de marquage (13, 13a-13d, 23), le système comprend des moyens pour extraire au moins une valeur de coordonnées stationnaires, qui est au moins une valeur de coordonnées bidimensionnelle, à partir de la représentation numérique du moyen de marquage pendant un mode de surveillance, à l'occasion de quoi lesdits moyens de comparaison (14) comparent ladite valeur de coordonnées bidimensionnelle extraite avec la valeur de coordonnées stationnaires enregistrée, et génère une alarme si le résultat de la comparaison varie.
  2. Système de surveillance (10) selon la revendication 1,
    caractérisé en ce que
    ledit objet fait l'objet d'une surveillance de déplacement incontrôlé.
  3. Système de surveillance (10) selon la revendication 1 et 2,
    caractérisé en ce que
    l'objet est muni d'un marqueur réfléchissant.
  4. Système de surveillance (10) selon la revendication 2 et 3,
    caractérisé en ce qu'une partie de l'objet est utilisée comme moyen de marquage.
  5. Système de surveillance (10) selon les revendications 1 - 4,
    caractérisé en ce que plusieurs moyens de marquage sont agencés sur le même objet.
  6. Système de surveillance (20) selon la revendication 1,
    caractérisé en ce que l'intensité lumineuse du moyen de marquage est également mesurée.
  7. Système de surveillance (20) selon la revendication 6,
    caractérisé en ce que l'ensemble de données enregistré comprend une intensité lumineuse initiale.
  8. Système de surveillance (20) selon la revendication 6 ou 7,
    caractérisé en ce que le système est prévu comme une alarme incendie.
  9. Système de surveillance (20) selon l'une quelconque des revendications précédentes,
    caractérisé en ce que le système comprend en plus un détecteur de chaleur.
  10. Procédé de surveillance d'un objet dans un volume, muni d'au moins un moyen de marquage (13, 13a-13d, 23) sous forme d'un dispositif de génération ou de réflexion de lumière, à l'occasion de quoi le procédé comprend les étapes consistant à :
    agencer au moins une unité de capteur optique (11, 21) pour enregistrer une image d'au moins une partie du volume comprenant ledit moyen de marquage (13, 13a-13d, 23),
    transformer ladite image en une représentation numérique de la même image,
    comparer la représentation numérique avec un ensemble de données enregistré,
    extraire au moins une valeur de coordonnées, qui est au moins une valeur de coordonnées bidimensionnelle à partir de la représentation numérique du moyen de marquage,
    comparer ladite valeur de coordonnées bidimensionnelle extraite avec une valeur de coordonnées stationnaires enregistrée obtenue par un processus d'auto-étalonnage comprenant une première étape consistant à enregistrer ladite valeur de coordonnées stationnaire pour ledit moyen de marquage au moyen desdits moyens de comparaison (14), et
    générer une alarme en présence d'un écart à la comparaison de la valeur de coordonnées extraite avec la valeur de coordonnées enregistrée.
  11. Procédé selon la revendication 10,
    caractérisé en ce que
    les données comprennent une valeur d'intensité lumineuse pour ledit moyen de marquage également.
EP01916017A 2000-03-20 2001-03-20 Systeme de surveillance Expired - Lifetime EP1287509B1 (fr)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US19067900P 2000-03-20 2000-03-20
SE0000925 2000-03-20
US190679P 2000-03-20
SE0000925A SE524332C2 (sv) 2000-03-20 2000-03-20 System och metod för optisk övervakning av en volym
PCT/SE2001/000587 WO2001071688A1 (fr) 2000-03-20 2001-03-20 Systeme de surveillance

Publications (2)

Publication Number Publication Date
EP1287509A1 EP1287509A1 (fr) 2003-03-05
EP1287509B1 true EP1287509B1 (fr) 2004-10-13

Family

ID=26655028

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01916017A Expired - Lifetime EP1287509B1 (fr) 2000-03-20 2001-03-20 Systeme de surveillance

Country Status (5)

Country Link
EP (1) EP1287509B1 (fr)
AT (1) ATE279762T1 (fr)
AU (1) AU2001242960A1 (fr)
DE (1) DE60106434T8 (fr)
WO (1) WO2001071688A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7302080B2 (en) * 2001-09-28 2007-11-27 Secumanagement B.V. System for installation
SE523456C2 (sv) * 2001-09-28 2004-04-20 Wespot Ab System, anordning och förfarande för inställning av en övervakningsenhet
DE102006053546B4 (de) * 2006-11-14 2009-04-02 Leuze Lumiflex Gmbh + Co. Kg Optischer Sensor

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4894716A (en) * 1989-04-20 1990-01-16 Burle Technologies, Inc. T.V. motion detector with false alarm immunity
US5880775A (en) * 1993-08-16 1999-03-09 Videofaxx, Inc. Method and apparatus for detecting changes in a video display
WO1996006368A1 (fr) * 1994-08-24 1996-02-29 Sq Services Ag Systeme et procede d'evaluation d'images
FR2759541B1 (fr) * 1997-02-18 1999-04-23 Visio Systemes Procede et installation de teledetection automatique de l'activite d'animaux en stabulation libre
NO982640L (no) * 1998-06-08 1999-12-09 Nyfotek As Fremgangsmåte og system for overvåking av et område

Also Published As

Publication number Publication date
AU2001242960A1 (en) 2001-10-03
WO2001071688A1 (fr) 2001-09-27
DE60106434D1 (de) 2004-11-18
DE60106434T8 (de) 2006-03-23
ATE279762T1 (de) 2004-10-15
EP1287509A1 (fr) 2003-03-05
DE60106434T2 (de) 2005-10-13

Similar Documents

Publication Publication Date Title
EP3671261A1 (fr) Système de surveillance 3d comprenant un lidar et imagerie multispectrale de classification d'objets
US5966074A (en) Intruder alarm with trajectory display
JP2003515811A (ja) 映像危機管理カーテン
US20040175040A1 (en) Process and device for detecting fires bases on image analysis
EP1969436B1 (fr) Localisation de dispositif mobile
US6469734B1 (en) Video safety detector with shadow elimination
US6829371B1 (en) Auto-setup of a video safety curtain system
US7167575B1 (en) Video safety detector with projected pattern
JP6859446B2 (ja) 物体捜索システム、物体捜索装置、及び物体捜索方法
EP3452848B1 (fr) Procédé de surveillance faisant appel à un système de caméra avec détection de mouvement de zone
KR20010113663A (ko) 물체 인식 및 추적 시스템
CN103852754A (zh) 飞行时间(tof)测量系统中的干扰抑制的方法
KR101754407B1 (ko) 주차장 차량 출입 관리시스템
EP0368995A1 (fr) Dispositif de detection d'intrusions
RU2268497C2 (ru) Система и способ автоматизированного видеонаблюдения и распознавания объектов и ситуаций
US7768658B2 (en) Anomaly detection system and method
CN1613020A (zh) 用于测量距离的激光光栅
WO2006030444A2 (fr) Systeme d'identification et de positionnement fonde sur l'imagerie
US20030146972A1 (en) Monitoring system
EP1287509B1 (fr) Systeme de surveillance
JP7128577B2 (ja) 監視装置
KR101046819B1 (ko) 소프트웨어 휀스에 의한 침입감시방법 및 침입감시시스템
JP7176868B2 (ja) 監視装置
JPH0962842A (ja) 駐車場管理システム
JP7141842B2 (ja) 監視装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20021018

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17Q First examination report despatched

Effective date: 20030424

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MORANDER, KARL-ERIK

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MORANDER, KARL-ERIK

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SEQUR S.A.

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MORANDER, KARL-ERIK

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20041013

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60106434

Country of ref document: DE

Date of ref document: 20041118

Kind code of ref document: P

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050113

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050113

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050113

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050320

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050320

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050321

LTIE Lt: invalidation of european patent or patent extension

Effective date: 20041013

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050331

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20050714

ET Fr: translation filed
REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20050313

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20090820 AND 20090826

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20100323

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20100322

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20100415

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20100323

Year of fee payment: 10

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20110320

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20111130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110331

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111001

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60106434

Country of ref document: DE

Effective date: 20111001

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110320

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110320