EP1262933B1 - Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem - Google Patents

Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem Download PDF

Info

Publication number
EP1262933B1
EP1262933B1 EP00987649A EP00987649A EP1262933B1 EP 1262933 B1 EP1262933 B1 EP 1262933B1 EP 00987649 A EP00987649 A EP 00987649A EP 00987649 A EP00987649 A EP 00987649A EP 1262933 B1 EP1262933 B1 EP 1262933B1
Authority
EP
European Patent Office
Prior art keywords
image
images
road
image processing
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP00987649A
Other languages
English (en)
French (fr)
Other versions
EP1262933A4 (de
EP1262933A1 (de
Inventor
Takeshi Sumitomo Electric Ind. Ltd. IWAMOTO
Kunio Sakai
Kunihiko Suzuki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sumitomo Electric Industries Ltd
Original Assignee
Sumitomo Electric Industries Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sumitomo Electric Industries Ltd filed Critical Sumitomo Electric Industries Ltd
Publication of EP1262933A1 publication Critical patent/EP1262933A1/de
Publication of EP1262933A4 publication Critical patent/EP1262933A4/de
Application granted granted Critical
Publication of EP1262933B1 publication Critical patent/EP1262933B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/01—Detecting movement of traffic to be counted or controlled
    • G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors

Definitions

  • the present invention relates to an image processing apparatus, image processing method, and vehicle monitoring system used for, e.g., monitoring of vehicles.
  • CCTV Cell-Circuit TeleVision
  • a large number of cameras are installed to avoid monitoring dead angles.
  • Output images from these cameras are transmitted to a highway control center, displayed on monitors, and monitored by observers.
  • the above traffic monitoring method has the problem that the detection of a traffic abnormality is delayed. That is, since camera images are displayed on each monitor as they are switched, camera images which are not displayed exist. This may delay the detection of a traffic abnormality. Also, frequently switching camera images increases the fatigue of observers and makes them overlook traffic abnormalities.
  • the present invention has been made to solve the above problems, and has as its object to provide an image processing apparatus, image processing method, and vehicle monitoring system capable of improving the accuracy of traffic abnormality detection.
  • US-A-5862508 discloses a traffic monitoring system in which moving objects are detected from a movie/video.
  • a spatial-temporal display is produced by reproducing successive slit images from the movie/video along a horizontal time axis, so that stationary features in the image appear as horizontal lines, whereas moving objects appear as images along the time axis. If the slit image is taken at an oblique angle to the traffic direction, the moving object appears in the spatial-temporal image to be inclined forward or backward providing an indication of direction of travel and velocity.
  • EP-A-0403193 discloses a traffic monitoring system in which first and second traffic scene images are video processed to form an edge image and to determine the location of traffic in the scene. Movement is detected from a difference image and the edge and difference images are divided into an array of image cells, in each of which the presence or absence of traffic and the presence or absence of movement is determined. Image cells are.further analysed to detect traffic objects such as blocks, platoons or queues. The detected traffic objects are displayed and objects from several cameras are combined to represent the state of the whole road.
  • an image processing apparatus and method are provided as set out in Claims 1 and 3 respectively.
  • the image processing apparatus may further comprise storage means for storing the composite image as image data.
  • the image processing method may further comprise the storage step of storing the composite image as image data.
  • a vehicle monitoring system is also contemplated as set out in Claim 5.
  • the image sensing means may each have a wide angle lens in an image sensing optical system thereof, and said correcting means may be operative to correct distortion, caused by the wide angle lens, of each digital image.
  • the display means may be a projector having a display area which is relatively long from side to side.
  • the whole of the road as an object of traffic monitoring can be displayed on a single screen. Accordingly, the entire road can be monitored without switching images to be displayed. Since there is no area which cannot be monitored owing to image switching, therefore, it is possible to prevent a delay of traffic abnormality detection and increase the speed of traffic abnormality detection.
  • traffic abnormalities can be detected on the basis of changes in an image. This facilitates visual traffic abnormality detection and reduces the monitoring load.
  • corrected composited image data is stored, after a traffic abnormality occurs it is possible to analyze the abnormality by checking this composite image.
  • Fig. 1 is a view for explaining a vehicle monitoring system. As shown in Fig. 1, this vehicle monitoring system monitors the state of traffic on a highway, e.g., detects traffic abnormalities in a tunnel 1.
  • the vehicle monitoring system includes a plurality of monitor cameras 2.
  • These monitor cameras 2 are image sensing means for sensing an image of a vehicle 11 traveling on a road in the tunnel 1, and are installed at predetermined intervals in the tunnel 1.
  • the installation interval of the monitor cameras 2 is, e.g., about 200 m.
  • the image sensing direction of the monitor camera 2 is a direction in which an image of the front or rear of the vehicle 11 traveling on a road 10 is sensed.
  • Each monitor camera 2 is connected to a distributor 3 which is installed in an institution 4 built near the tunnel 1. This distributor 3 receives sensed images from the monitor cameras 2 and outputs these images to an image processing apparatus 5.
  • the image processing apparatus 5 is an image processing means for receiving images from the monitor cameras 2, processing these images, and transmitting the processed images to a control center 6.
  • This image processing apparatus 5 comprises, e.g., an A/D converter, video frame memory, image processor, and signal output interface.
  • the A/D converter A/D-converts an input analog video signal into a digital signal.
  • a video A-D converter is used as this A/D converter.
  • the video frame memory stores converted digital video signals as image data.
  • This image data is an aggregate of pixels having tone values at individual coordinate runs on the x and y axes.
  • the pixel tone has, e.g., 8-bit 256 gray levels.
  • the image processor processes the image data stored in the video frame memory.
  • the signal output interface outputs the processed image to the outside in accordance with a command from the image processor.
  • the image transmitted from the image processing apparatus is input to a monitor 61, and this monitor 61 displays the image sensed in the tunnel 1. Through this image, a supervisor can visually monitor the traveling states of vehicles in the tunnel 1.
  • the monitor 61 is an image display means, for example, a projector is used as this monitor 61.
  • the monitor cameras 2 sense images of the vehicle 11 traveling on the road 10 and input video signals to the distributor 3.
  • the distributor 3 suitably transfers these video signals from the monitor cameras 2 to the image processing apparatus 5.
  • the image processing apparatus 5 processes the video signals.
  • Fig. 2 is a flow chart of this image processing performed by the image processing apparatus 5.
  • an input video signal to the image processing apparatus 5 is A/D-converted.
  • This A/D conversion is the process of converting an analog video signal into a digital video signal.
  • the converted digital image is stored as image data into the video frame memory.
  • This image correction is the process of correcting the image data such that the road 10 shown in the A/D-converted digital image runs in the longitudinal or lateral direction of the image.
  • a digital image shown in Fig. 3 is corrected into a corrected image shown in Fig. 4.
  • the road 10 is so displayed in a digital image 20 as to go away from the lower right portion to the upper left portion.
  • this digital image 20 is corrected such that the road 10 runs in the lateral direction of the image.
  • This correcting process forms a corrected image 21.
  • the vehicle 11 traveling on the road 10 is also processed in accordance with the correction.
  • This image composition is the process of combining corrected images subjected to the image correction. For example, corrected images 21 pertaining to video signals obtained by the monitor cameras 2 at the same time are combined into one image. This combining process is performed such that the roads 11 shown in the individual corrected images 21 appear to continue. Also, the combining is so performed that more than one image of the same vehicle 11 will not be displayed.
  • Fig. 5 shows a composite image 22 subjected to the combining process.
  • the composite image 22 is transmitted to the control center 6.
  • the whole of this composite image 22 is displayed on the monitor 61 in the control center 6.
  • the image processing apparatus, image processing method, and vehicle monitoring system can display, on a single screen, the whole of the road 10 as an object of traffic monitoring. Accordingly, the entire road can be monitored without switching images to be displayed.
  • the composite image 22 is transmitted to the control center 6.
  • the image processing apparatus, image processing method, and vehicle monitoring system according to the present invention are not limited to this embodiment.
  • the control center 6 can also perform all the image processing operations (A/D conversion, image correction, and image combining).
  • the image processing apparatus, image processing method, and vehicle monitoring system relate to vehicle monitoring on a road in the tunnel 1.
  • the image processing apparatus, image processing method, and vehicle monitoring system are not restricted to this embodiment.
  • the image processing apparatus, image processing method, and vehicle monitoring system can also be used for vehicle monitoring on roads in other places.
  • the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment have the same configurations as the image processing apparatus, image processing method, and vehicle monitoring system according to the first embodiment, except that a monitor camera 2 as an image sensing means includes an image sensing optical system having a wide angle lens, and that an image processing apparatus 5 as an image processing means corrects image distortion caused by this wide angle lens.
  • Fig. 6 is a view for explaining the monitor cameras in the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment.
  • the monitor cameras 2 are so arranged as to sense images of vehicles 11 traveling on a road 10 from the side of the road 10.
  • Each monitor camera 2 has a wide angle lens in its image sensing optical system and can sense images over a wide view angle.
  • a fish-eye lens is preferably used as this wide angle lens.
  • a "wide angle lens" herein mentioned means a lens having a view angle wider than that of a standard lens, e.g., a view angle of 60° or more.
  • the monitor cameras 2 sense images of the vehicles 11 traveling on the road 10 and input video signals to a distributor 3.
  • This distributor 3 properly inputs these video signals from the monitor cameras 2 to the image processing apparatus 5.
  • the image processing apparatus 5 processes these video signals.
  • A/D conversion is performed as in the first embodiment.
  • correction for removing distortion of the image sensed through the wide angle lens is performed.
  • an A/D-converted digital image 30 has barrel-shaped form distortion because the image is sensed through the wide angle lens.
  • a corrected image 31 from which the distortion is removed is obtained.
  • an image combining process combines the corrected images 31 pertaining to the video signals obtained at the same time by the monitor cameras 2 into a single composite image 32.
  • this image combining process is performed such that the roads 10 shown in the individual corrected images 21 appear to continue. Also, the combining is so performed that more than one image of the same vehicle 11 will not be displayed.
  • Fig. 9 shows a composite image 32 subjected to the combining process.
  • the composite image 32 is transmitted to a control center 6.
  • the whole of this composite image 32 is displayed on a monitor 61 in the control center 6.
  • the image processing apparatus, image processing method, and vehicle monitoring system can display, on a single screen, the whole of the road 10 as an object of traffic monitoring, similar to the image processing apparatus, image processing method, and vehicle monitoring system according to the first embodiment. Accordingly, the entire road can be monitored without switching images to be displayed. Since there is no area which cannot be monitored owing to image switching, therefore, it is possible to prevent a delay of traffic abnormality detection and increase the speed of traffic abnormality detection. Also, since no image switching is performed, traffic abnormalities can be detected on the basis of changes in an image. This facilitates visual traffic abnormality detection and reduces the monitoring load.
  • a wide angle lens is used in the image sensing optical system of the monitor camera 2. Since this allows each monitor camera 2 to monitor a wide range, the number of the monitor cameras 2 to be installed can be reduced.
  • the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment have the same configurations as the image processing apparatuses, image processing methods, and vehicle monitoring systems according to the first and second embodiments, except that image storage is performed after image combining in an image processing means and in an image processing step.
  • Fig. 10 is a flow chart of image processing performed in the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment.
  • image storage is performed. This image storage is done by storing a composite image 22 or 32 subjected to image composition into a storage device such as a memory. Since the composite image 22 or 32 is thus stored, after a traffic abnormality occurs it is possible to analyze the abnormality by checking this composite image.
  • the whole of a road as an object of traffic monitoring can be displayed on a single screen. Accordingly, the entire road can be monitored without switching images to be displayed. Since there is no area which cannot be monitored owing to image switching, therefore, it is possible to prevent a delay of traffic abnormality detection and increase the speed of traffic abnormality detection.
  • traffic abnormalities can be detected on the basis of changes in an image. This facilitates visual traffic abnormality detection and reduces the monitoring load.
  • corrected composited image data is stored, after a traffic abnormality occurs it is possible to analyze the abnormality by checking this composite image.
  • the image processing apparatus, image processing method, and vehicle monitoring system of the present invention are useful in monitoring traffic of vehicles traveling on a road.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Burglar Alarm Systems (AREA)
  • Image Processing (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Controls And Circuits For Display Device (AREA)

Claims (7)

  1. Bildverarbeitungsvorrichtung, die umfasst
    eine Umwandlungseinrichtung (2, 3, 5, S100), die eine Vielzahl von Videosignalen empfängt, die durch das Erfassen von Bildern gewonnen werden, die an verschiedenen Positionen entlang einer Straße (10) gemacht werden, und A/D-Wandlung der Videosignale in digitale Bilder durchführt;
    eine Korrektureinrichtung (5, S200), die die digitalen Bilder so korrigiert, dass die Straße auf jedem Bild parallel zu der Längs- oder Querachse des Bildes verläuft; und
    eine Bildzusammensetzeinrichtung (5, S300), die eine Vielzahl korrigierter Bilder, die durch die Korrektureinrichtung gewonnen werden, zu einem zusammengesetzten Bild so zusammensetzt, dass die auf den korrigierten Bildern dargestellten Straßen als eine durchgehende Straße erscheinen.
  2. Vorrichtung nach Anspruch 1, dadurch gekennzeichnet, dass sie des Weiteren eine Speichereinrichtung (S400) umfasst, die das zusammengesetzte Bild als Bilddaten speichert.
  3. Bildverarbeitungsverfahren, das umfasst:
    den Umwandlungsschritt des Empfangens einer Vielzahl von Videosignalen, die durch das Erfassen von Bildern gewonnen werden, die an verschiedenen Positionen entlang einer Straße gemacht werden, und des A/D-Wandelns der Videosignale in digitale Bilder;
    den Korrekturschritt des Korrigierens der digitalen Bilder, so dass die Straße auf jedem Bild parallel zu der Längs- oder der Querachse jedes digitalen Bildes verläuft; und
    den Bildzusammensetzschritt des Zusammensetzens einer Vielzahl korrigierter Bilder, die in dem Korrekturschritt gewonnen werden, so dass die auf den korrigierten Bildern gezeigten Straßen als eine durchgehende Straße erscheinen.
  4. Verfahren nach Anspruch 3, dadurch gekennzeichnet, dass es des Weiteren den Speicherschritt des Speichems der zusammengesetzten Bilder als Bilddaten umfasst.
  5. Fahrzeugüberwachungssystem, das umfasst:
    eine Vielzahl von Bilderfassungseinrichtungen, die entlang einer zu überwachenden Straße angeordnet sind, um Bilder von Fahrzeugen zu erfassen, die auf der Straße fahren;
    eine Bildverarbeitungsvorrichtung nach Anspruch 1, die Videosignale empfängt, die durch die Bilderfassungseinrichtungen gewonnen werden, und
    eine Anzeigeeinrichtung, die die zusammengesetzten Bilder anzeigt, die durch die Bildverarbeitungsvorrichtung verarbeitet werden.
  6. Fahrzeugüberwachungssystem nach Anspruch 5, wobei die Bilderfassungseinrichtungen jeweils ein Weitwinkelobjektiv in einem optischen Bilderfassungssystem haben; und
    die Korrektureinrichtung so arbeitet, dass sie durch das Weitwinkelobjektiv verursachte Verzeichnung jedes digitalen Bildes korrigiert.
  7. System nach einem der Ansprüche 5 bis 6, dadurch gekennzeichnet, dass die Bildverarbeitungseinrichtung das zusammengesetzte Bild als Bilddaten speichert.
EP00987649A 1999-12-27 2000-12-20 Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem Expired - Lifetime EP1262933B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP37029899 1999-12-27
JP37029899A JP3601392B2 (ja) 1999-12-27 1999-12-27 画像処理装置、画像処理方法及び車両監視システム
PCT/JP2000/009025 WO2001048724A1 (fr) 1999-12-27 2000-12-20 Appareil de traitement d'images, procédé de traitement d'images et système de surveillance de véhicule

Publications (3)

Publication Number Publication Date
EP1262933A1 EP1262933A1 (de) 2002-12-04
EP1262933A4 EP1262933A4 (de) 2004-03-31
EP1262933B1 true EP1262933B1 (de) 2005-04-27

Family

ID=18496557

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00987649A Expired - Lifetime EP1262933B1 (de) 1999-12-27 2000-12-20 Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem

Country Status (7)

Country Link
EP (1) EP1262933B1 (de)
JP (1) JP3601392B2 (de)
AT (1) ATE294434T1 (de)
DE (1) DE60019813T2 (de)
ES (1) ES2237485T3 (de)
HK (1) HK1047814B (de)
WO (1) WO2001048724A1 (de)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10239026B4 (de) * 2002-08-21 2008-04-03 Deutsches Zentrum für Luft- und Raumfahrt e.V. Verfahren und Vorrichtung zur Verkehrsüberwachung
US8823797B2 (en) * 2010-06-03 2014-09-02 Microsoft Corporation Simulated video with extra viewpoints and enhanced resolution for traffic cameras
CN101976341B (zh) * 2010-08-27 2013-08-07 中国科学院自动化研究所 一种从交通图像中检测车辆位置、姿态和三维轮廓的方法
EP2733677A1 (de) * 2012-11-19 2014-05-21 Kapsch TrafficCom AB Vorrichtung für Maut- oder Telematiksysteme
FR3080701B1 (fr) * 2018-04-26 2020-05-15 Transdev Group Systeme de surveillance de la circulation routiere avec affichage d'une image virtuelle d'objets mobiles evoluant dans une portion d'infrastructure routiere
CN111935451A (zh) * 2020-07-16 2020-11-13 中国铁道科学研究院集团有限公司电子计算技术研究所 铁路安全监测装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8913946D0 (en) * 1989-06-16 1989-08-02 Univ London Method and apparatus for traffic monitoring
US5682198A (en) * 1993-06-28 1997-10-28 Canon Kabushiki Kaisha Double eye image pickup apparatus
FR2714502A1 (fr) * 1993-12-29 1995-06-30 Philips Laboratoire Electroniq Procédé et dispositif de traitement d'image pour construire à partir d'une image source une image cible avec changement de perspective.
JP3569992B2 (ja) * 1995-02-17 2004-09-29 株式会社日立製作所 移動体検出・抽出装置、移動体検出・抽出方法及び移動体監視システム
JP3577895B2 (ja) * 1997-06-19 2004-10-20 松下電器産業株式会社 広域監視装置及び広域監視システム
JPH1139589A (ja) * 1997-07-18 1999-02-12 Fuji Electric Co Ltd 交通監視装置および交通監視方法
JPH1196494A (ja) * 1997-09-22 1999-04-09 Hitachi Ltd 交通流監視方法および装置
JP2000331279A (ja) * 1999-05-25 2000-11-30 Oki Electric Ind Co Ltd 広域監視装置

Also Published As

Publication number Publication date
JP3601392B2 (ja) 2004-12-15
EP1262933A4 (de) 2004-03-31
EP1262933A1 (de) 2002-12-04
WO2001048724A1 (fr) 2001-07-05
HK1047814B (zh) 2005-06-24
DE60019813T2 (de) 2005-10-06
HK1047814A1 (en) 2003-03-07
DE60019813D1 (de) 2005-06-02
JP2001184586A (ja) 2001-07-06
ATE294434T1 (de) 2005-05-15
ES2237485T3 (es) 2005-08-01

Similar Documents

Publication Publication Date Title
US7082209B2 (en) Object detecting method and object detecting apparatus and intruding object monitoring apparatus employing the object detecting method
US7557691B2 (en) Obstacle detector for vehicle
EP1895766B1 (de) Kamera mit zwei oder mehr Sichtwinkeln
JP2000090277A (ja) 基準背景画像更新方法及び侵入物体検出方法並びに侵入物体検出装置
JP3847547B2 (ja) 車両周辺監視支援装置
JP2008060650A (ja) 車載用撮像装置および車載用撮像装置の撮像方法
EP1262933B1 (de) Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem
JP3788400B2 (ja) 画像処理装置、画像処理方法及び車両監視システム
JPH10105863A (ja) 走行路情報収集装置
JP2004312402A (ja) 道路監視システム，道路監視装置
JP3467774B2 (ja) 画像処理装置、画像処理方法及び車両監視システム
JP3354626B2 (ja) 移動体検出方法
JPH10151991A (ja) 車両の後方監視装置
JPH10322684A (ja) カメラ装置
JP2006197614A (ja) 画像処理装置、画像処理方法及び車両監視システム
JP2001216598A (ja) 交通流計測装置
JPH11339177A (ja) 道路監視装置
EP4258653A1 (de) Bildverarbeitungsvorrichtung zur messung des abstands zu einem objekt, bewegliche vorrichtung, bildverarbeitungsverfahren und speichermedium
JP2735033B2 (ja) 車線変更検出装置および方法
JPH11288495A (ja) 交通異常検出装置
JPH0636031A (ja) コンピュータ利用の移動物体追跡システム
CN116828168A (zh) 视频信号处理装置
KR100285814B1 (ko) 피사체추적이가능한감시용카메라의제어장치및그방법
JP2004343642A (ja) 車両用スーパーインポーズ装置
WO2004051595A1 (ja) 移動物体の解析方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20020722

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

A4 Supplementary search report drawn up and despatched

Effective date: 20040212

RIC1 Information provided on ipc code assigned before grant

Ipc: 7G 08G 1/01 B

Ipc: 7G 08G 1/04 A

17Q First examination report despatched

Effective date: 20040301

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050427

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050427

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050427

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60019813

Country of ref document: DE

Date of ref document: 20050602

Kind code of ref document: P

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1047814

Country of ref document: HK

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: BOVARD AG PATENTANWAELTE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050727

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050727

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20050727

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2237485

Country of ref document: ES

Kind code of ref document: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20051010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20051220

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20051220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20051231

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

ET Fr: translation filed
26N No opposition filed

Effective date: 20060130

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: GB

Ref legal event code: 746

Effective date: 20100330

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20101129

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: LU

Payment date: 20110118

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20101215

Year of fee payment: 11

Ref country code: IT

Payment date: 20101224

Year of fee payment: 11

REG Reference to a national code

Ref country code: CH

Ref legal event code: PFA

Owner name: SUMITOMO ELECTRIC INDUSTRIES, LTD.

Free format text: SUMITOMO ELECTRIC INDUSTRIES, LTD.#5-33, KITAHAMA 4-CHOME CHUO-KU#OSAKA-SHI, OSAKA 541-0041 (JP) -TRANSFER TO- SUMITOMO ELECTRIC INDUSTRIES, LTD.#5-33, KITAHAMA 4-CHOME CHUO-KU#OSAKA-SHI, OSAKA 541-0041 (JP)

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20111213

Year of fee payment: 12

Ref country code: NL

Payment date: 20111221

Year of fee payment: 12

Ref country code: ES

Payment date: 20111228

Year of fee payment: 12

Ref country code: FR

Payment date: 20111219

Year of fee payment: 12

REG Reference to a national code

Ref country code: NL

Ref legal event code: V1

Effective date: 20130701

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 294434

Country of ref document: AT

Kind code of ref document: T

Effective date: 20121220

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20121220

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20130830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130701

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121231

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121220

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130102

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121220

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121220

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20140306

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121221

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121220

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20151215

Year of fee payment: 16

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60019813

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170701