EP1262933A1 - Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem - Google Patents
Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem Download PDFInfo
- Publication number
- EP1262933A1 EP1262933A1 EP00987649A EP00987649A EP1262933A1 EP 1262933 A1 EP1262933 A1 EP 1262933A1 EP 00987649 A EP00987649 A EP 00987649A EP 00987649 A EP00987649 A EP 00987649A EP 1262933 A1 EP1262933 A1 EP 1262933A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- images
- image processing
- road
- digital
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
Definitions
- the present invention relates to an image processing apparatus, image processing method, and vehicle monitoring system used for, e.g., monitoring of vehicles.
- CCTV Cell-Circuit TeleVision
- a large number of cameras are installed to avoid monitoring dead angles.
- Output images from these cameras are transmitted to a highway control center, displayed on monitors, and monitored by observers.
- the above traffic monitoring method has the problem that the detection of a traffic abnormality is delayed. That is, since camera images are displayed on each monitor as they are switched, camera images which are not displayed exist. This may delay the detection of a traffic abnormality. Also, frequently switching camera images increases the fatigue of observers and makes them overlook traffic abnormalities.
- the present invention has been made to solve the above problems, and has as its object to provide an image processing apparatus, image processing method, and vehicle monitoring system capable of improving the accuracy of traffic abnormality detection.
- an image processing apparatus comprises converting means for receiving a plurality of video signals obtained by sensing images of a road, and A/D-converting the video signals into digital images, correcting means for correcting the digital images such that the road runs in the longitudinal or lateral direction of each digital image, and image compositing means for compositing a plurality of corrected images obtained by the correcting means, such that the roads shown in the corrected images continue.
- the image processing apparatus is characterized by further comprising storage means for storing the composite image as image data.
- An image processing method comprises the conversion step of receiving a plurality of video signals obtained by sensing images of a road, and A/D-converting the video signals into digital images, the correction step of correcting the digital images such that the road runs in the longitudinal direction or lateral direction of each digital image, and the image composition step of compositing a plurality of corrected images obtained in the correction step, such that the roads shown in the corrected images continue.
- the image processing method according to the present invention is characterized by further comprising the storage step of storing the composite image as image data.
- a vehicle monitoring system comprises a plurality of image sensing means arranged along a road to be monitored to sense images of vehicles traveling on the road, image processing means for receiving video signals obtained by the image sensing means, A/D-converting the video signals into digital images, correcting the digital images such that the road runs in the longitudinal direction or lateral direction of each digital image, and compositing the corrected digital images such that the roads shown in the digital images continue, and display means for displaying the image processed by the image processing means.
- a vehicle monitoring system comprises a plurality of image sensing means arranged along a road to be monitored to sense images of vehicles traveling on the road, each of the image sensing means having a wide angle lens in an image sensing optical system thereof, image processing means for receiving video signals obtained by the image sensing means, A/D-converting the video signals into digital images, correcting distortion, caused by the wide angle lens, of each digital image, and compositing the corrected digital images such that the roads shown in the digital images continue, and display means for displaying the image processed by the image processing means.
- the vehicle monitoring system according to the present invention is characterized in that the display means is a projector having a display area long from side to side.
- the image processing system according to the present invention is characterized in that the image processing means stores the composite image as image data.
- the whole of the road as an object of traffic monitoring can be displayed on a single screen. Accordingly, the entire road can be monitored without switching images to be displayed. Since there is no area which cannot be monitored owing to image switching, therefore, it is possible to prevent a delay of traffic abnormality detection and increase the speed of traffic abnormality detection.
- traffic abnormalities can be detected on the basis of changes in an image. This facilitates visual traffic abnormality detection and reduces the monitoring load.
- corrected composited image data is stored, after a traffic abnormality occurs it is possible to analyze the abnormality by checking this composite image.
- Fig. 1 is a view for explaining a vehicle monitoring system. As shown in Fig. 1, this vehicle monitoring system monitors the state of traffic on a highway, e.g., detects traffic abnormalities in a tunnel 1.
- the vehicle monitoring system includes a plurality of monitor cameras 2.
- These monitor cameras 2 are image sensing means for sensing an image of a vehicle 11 traveling on a road in the tunnel 1, and are installed at predetermined intervals in the tunnel 1.
- the installation interval of the monitor cameras 2 is, e.g., about 200 m.
- the image sensing direction of the monitor camera 2 is a direction in which an image of the front or rear of the vehicle 11 traveling on a road 10 is sensed.
- Each monitor camera 2 is connected to a distributor 3 which is installed in an institution 4 built near the tunnel 1. This distributor 3 receives sensed images from the monitor cameras 2 and outputs these images to an image processing apparatus 5.
- the image processing apparatus 5 is an image processing means for receiving images from the monitor cameras 2, processing these images, and transmitting the processed images to a control center 6.
- This image processing apparatus 5 comprises, e.g., an A/D converter, video frame memory, image processor, and signal output interface.
- the A/D converter A/D-converts an input analog video signal into a digital signal.
- a video A-D converter is used as this A/D converter.
- the video frame memory stores converted digital video signals as image data.
- This image data is an aggregate of pixels having tone values at individual coordinate runs on the x and y axes.
- the pixel tone has, e.g., 8-bit 256 gray levels.
- the image processor processes the image data stored in the video frame memory.
- the signal output interface outputs the processed image to the outside in accordance with a command from the image processor.
- the image transmitted from the image processing apparatus is input to a monitor 61, and this monitor 61 displays the image sensed in the tunnel 1. Through this image, a supervisor can visually monitor the traveling states of vehicles in the tunnel 1.
- the monitor 61 is an image display means and desirably has a display area long from side to side. For example, a projector is used as this monitor 61.
- the monitor cameras 2 sense images of the vehicle 11 traveling on the road 10 and input video signals to the distributor 3.
- the distributor 3 suitably transfers these video signals from the monitor cameras 2 to the image processing apparatus 5.
- the image processing apparatus 5 processes the video signals.
- Fig. 2 is a flow chart of this image processing performed by the image processing apparatus 5.
- an input video signal to the image processing apparatus 5 is A/D-converted.
- This A/D conversion is the process of converting an analog video signal into a digital video signal.
- the converted digital image is stored as image data into the video frame memory.
- This image correction is the process of correcting the image data such that the road 10 shown in the A/D-converted digital image runs in the longitudinal or lateral direction of the image.
- a digital image shown in Fig. 3 is corrected into a corrected image shown in Fig. 4.
- the road 10 is so displayed in a digital image 20 as to go away from the lower right portion to the upper left portion.
- this digital image 20 is corrected such that the road 10 runs in the lateral direction of the image.
- This correcting process forms a corrected image 21.
- the vehicle 11 traveling on the road 10 is also processed in accordance with the correction.
- This image composition is the process of compositing corrected images subjected to the image correction.
- corrected images 21 pertaining to video signals obtained by the monitor cameras 2 at the same time are composited into one image.
- This compositing process is performed such that the roads 11 shown in the individual corrected images 21 continue.
- the composition is so performed that more than one image of the same vehicle 11 will not be displayed.
- Fig. 5 shows a composite image 22 subjected to the compositing process.
- the composite image 22 is transmitted to the control center 6.
- the whole of this composite image 22 is displayed on the monitor 61 in the control center 6.
- the image processing apparatus, image processing method, and vehicle monitoring system can display, on a single screen, the whole of the road 10 as an object of traffic monitoring. Accordingly, the entire road can be monitored without switching images to be displayed.
- the composite image 22 is transmitted to the control center 6.
- the image processing apparatus, image processing method, and vehicle monitoring system according to the present invention are not limited to this embodiment.
- the control center 6 can also perform all the image processing operations (A/D conversion, image correction, and image composition).
- the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment relate to vehicle monitoring on a road in the tunnel 1.
- the image processing apparatus, image processing method, and vehicle monitoring system according to the present invention are not restricted to this embodiment.
- the image processing apparatus, image processing method, and vehicle monitoring system according to the present invention can also be used for vehicle monitoring on roads in other places.
- the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment have the same configurations as the image processing apparatus, image processing method, and vehicle monitoring system according to the first embodiment, except that a monitor camera 2 as an image sensing means includes an image sensing optical system having a wide angle lens, and that an image processing apparatus 5 as an image processing means corrects image distortion caused by this wide angle lens.
- Fig. 6 is a view for explaining the monitor cameras in the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment.
- the monitor cameras 2 are so arranged as to sense images of vehicles 11 traveling on a road 10 from the side of the road 10.
- Each monitor camera 2 has a wide angle lens in its image sensing optical system and can sense images over a wide view angle.
- a fish-eye lens is preferably used as this wide angle lens.
- a "wide angle lens" herein mentioned means a lens having a view angle wider than that of a standard lens, e.g., a view angle of 60° or more.
- the monitor cameras 2 sense images of the vehicles 11 traveling on the road 10 and input video signals to a distributor 3.
- This distributor 3 properly inputs these video signals from the monitor cameras 2 to the image processing apparatus 5.
- the image processing apparatus 5 processes these video signals.
- A/D conversion is performed as in the first embodiment.
- correction for removing distortion of the image sensed through the wide angle lens is performed.
- an A/D-converted digital image 30 has barrel-shaped form distortion because the image is sensed through the wide angle lens.
- a corrected image 31 from which the distortion is removed is obtained.
- an image compositing process composites the corrected images 31 pertaining to the video signals obtained at the same time by the monitor cameras 2 into a single composite image 32.
- this image compositing process is performed such that the roads 10 shown in the individual corrected images 21 continue. Also, the composition is so performed that more than one image of the same vehicle 11 will not be displayed.
- Fig. 9 shows a composite image 32 subjected to the compositing process.
- the composite image 32 is transmitted to a control center 6.
- the whole of this composite image 32 is displayed on a monitor 61 in the control center 6.
- the image processing apparatus, image processing method, and vehicle monitoring system can display, on a single screen, the whole of the road 10 as an object of traffic monitoring, similar to the image processing apparatus, image processing method, and vehicle monitoring system according to the first embodiment. Accordingly, the entire road can be monitored without switching images to be displayed. Since there is no area which cannot be monitored owing to image switching, therefore, it is possible to prevent a delay of traffic abnormality detection and increase the speed of traffic abnormality detection. Also, since no image switching is performed, traffic abnormalities can be detected on the basis of changes in an image. This facilitates visual traffic abnormality detection and reduces the monitoring load.
- a wide angle lens is used in the image sensing optical system of the monitor camera 2. Since this allows each monitor camera 2 to monitor a wide range, the number of the monitor cameras 2 to be installed can be reduced.
- the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment have the same configurations as the image processing apparatuses, image processing methods, and vehicle monitoring systems according to the first and second embodiments, except that image storage is performed after image composition in an image processing means and in an image processing step.
- Fig. 10 is a flow chart of image processing performed in the image processing apparatus, image processing method, and vehicle monitoring system according to this embodiment.
- image storage is performed. This image storage is done by storing a composite image 22 or 32 subjected to image composition into a storage device such as a memory. Since the composite image 22 or 32 is thus stored, after a traffic abnormality occurs it is possible to analyze the abnormality by checking this composite image.
- the whole of a road as an object of traffic monitoring can be displayed on a single screen. Accordingly, the entire road can be monitored without switching images to be displayed. Since there is no area which cannot be monitored owing to image switching, therefore, it is possible to prevent a delay of traffic abnormality detection and increase the speed of traffic abnormality detection.
- traffic abnormalities can be detected on the basis of changes in an image. This facilitates visual traffic abnormality detection and reduces the monitoring load.
- corrected composited image data is stored, after a traffic abnormality occurs it is possible to analyze the abnormality by checking this composite image.
- the image processing apparatus, image processing method, and vehicle monitoring system of the present invention are useful in monitoring traffic of vehicles traveling on a road.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
- Closed-Circuit Television Systems (AREA)
- Burglar Alarm Systems (AREA)
- Image Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- Editing Of Facsimile Originals (AREA)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP37029899A JP3601392B2 (ja) | 1999-12-27 | 1999-12-27 | 画像処理装置、画像処理方法及び車両監視システム |
JP37029899 | 1999-12-27 | ||
PCT/JP2000/009025 WO2001048724A1 (fr) | 1999-12-27 | 2000-12-20 | Appareil de traitement d'images, procédé de traitement d'images et système de surveillance de véhicule |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1262933A1 true EP1262933A1 (de) | 2002-12-04 |
EP1262933A4 EP1262933A4 (de) | 2004-03-31 |
EP1262933B1 EP1262933B1 (de) | 2005-04-27 |
Family
ID=18496557
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP00987649A Expired - Lifetime EP1262933B1 (de) | 1999-12-27 | 2000-12-20 | Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem |
Country Status (7)
Country | Link |
---|---|
EP (1) | EP1262933B1 (de) |
JP (1) | JP3601392B2 (de) |
AT (1) | ATE294434T1 (de) |
DE (1) | DE60019813T2 (de) |
ES (1) | ES2237485T3 (de) |
HK (1) | HK1047814B (de) |
WO (1) | WO2001048724A1 (de) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2733677A1 (de) * | 2012-11-19 | 2014-05-21 | Kapsch TrafficCom AB | Vorrichtung für Maut- oder Telematiksysteme |
EP2577958A4 (de) * | 2010-06-03 | 2014-09-17 | Microsoft Corp | Simuliertes video mit extra-sichtpunkten und erweiterter auflösung für verkehrskameras |
EP3561791A1 (de) * | 2018-04-26 | 2019-10-30 | Transdev Group | Überwachungssystem des strassenverkehrs mit anzeige eines virtuellen bildes von sich bewegenden objekten in einem abschnitt der strasseninfrastruktur |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10239026B4 (de) * | 2002-08-21 | 2008-04-03 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Verfahren und Vorrichtung zur Verkehrsüberwachung |
CN101976341B (zh) * | 2010-08-27 | 2013-08-07 | 中国科学院自动化研究所 | 一种从交通图像中检测车辆位置、姿态和三维轮廓的方法 |
CN111935451A (zh) * | 2020-07-16 | 2020-11-13 | 中国铁道科学研究院集团有限公司电子计算技术研究所 | 铁路安全监测装置 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0403193A2 (de) * | 1989-06-16 | 1990-12-19 | University College London | Verkehrsüberwachungsverfahren und -vorrichtung |
US5586231A (en) * | 1993-12-29 | 1996-12-17 | U.S. Philips Corporation | Method and device for processing an image in order to construct from a source image a target image with charge of perspective |
US5682198A (en) * | 1993-06-28 | 1997-10-28 | Canon Kabushiki Kaisha | Double eye image pickup apparatus |
US5862508A (en) * | 1995-02-17 | 1999-01-19 | Hitachi, Ltd. | Moving object detection apparatus |
JPH1139589A (ja) * | 1997-07-18 | 1999-02-12 | Fuji Electric Co Ltd | 交通監視装置および交通監視方法 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3577895B2 (ja) * | 1997-06-19 | 2004-10-20 | 松下電器産業株式会社 | 広域監視装置及び広域監視システム |
JPH1196494A (ja) * | 1997-09-22 | 1999-04-09 | Hitachi Ltd | 交通流監視方法および装置 |
JP2000331279A (ja) * | 1999-05-25 | 2000-11-30 | Oki Electric Ind Co Ltd | 広域監視装置 |
-
1999
- 1999-12-27 JP JP37029899A patent/JP3601392B2/ja not_active Expired - Fee Related
-
2000
- 2000-12-20 EP EP00987649A patent/EP1262933B1/de not_active Expired - Lifetime
- 2000-12-20 ES ES00987649T patent/ES2237485T3/es not_active Expired - Lifetime
- 2000-12-20 AT AT00987649T patent/ATE294434T1/de active
- 2000-12-20 WO PCT/JP2000/009025 patent/WO2001048724A1/ja active IP Right Grant
- 2000-12-20 DE DE60019813T patent/DE60019813T2/de not_active Expired - Lifetime
-
2002
- 2002-12-23 HK HK02109276.4A patent/HK1047814B/zh not_active IP Right Cessation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0403193A2 (de) * | 1989-06-16 | 1990-12-19 | University College London | Verkehrsüberwachungsverfahren und -vorrichtung |
US5682198A (en) * | 1993-06-28 | 1997-10-28 | Canon Kabushiki Kaisha | Double eye image pickup apparatus |
US5586231A (en) * | 1993-12-29 | 1996-12-17 | U.S. Philips Corporation | Method and device for processing an image in order to construct from a source image a target image with charge of perspective |
US5862508A (en) * | 1995-02-17 | 1999-01-19 | Hitachi, Ltd. | Moving object detection apparatus |
JPH1139589A (ja) * | 1997-07-18 | 1999-02-12 | Fuji Electric Co Ltd | 交通監視装置および交通監視方法 |
Non-Patent Citations (2)
Title |
---|
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 05, 31 May 1999 (1999-05-31) -& JP 11 039589 A (FUJI ELECTRIC CO LTD;F F C:KK), 12 February 1999 (1999-02-12) * |
See also references of WO0148724A1 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2577958A4 (de) * | 2010-06-03 | 2014-09-17 | Microsoft Corp | Simuliertes video mit extra-sichtpunkten und erweiterter auflösung für verkehrskameras |
EP2733677A1 (de) * | 2012-11-19 | 2014-05-21 | Kapsch TrafficCom AB | Vorrichtung für Maut- oder Telematiksysteme |
WO2014076300A1 (en) * | 2012-11-19 | 2014-05-22 | Kapsch Trafficcom Ab | Device for tolling or telematics systems |
US20160247398A1 (en) * | 2012-11-19 | 2016-08-25 | Kapsch Trafficcom Ab | Device for tolling or telematics systems |
EP3182380A1 (de) * | 2012-11-19 | 2017-06-21 | Kapsch TrafficCom AB | Vorrichtung für maut- oder telematiksysteme |
AU2017279793B2 (en) * | 2012-11-19 | 2019-08-22 | Kapsch Trafficcom Ab | Device for tolling or telematics systems |
US10777075B2 (en) * | 2012-11-19 | 2020-09-15 | Kapsch Trafficcom Ab | Device for tolling or telematics systems |
EP3561791A1 (de) * | 2018-04-26 | 2019-10-30 | Transdev Group | Überwachungssystem des strassenverkehrs mit anzeige eines virtuellen bildes von sich bewegenden objekten in einem abschnitt der strasseninfrastruktur |
FR3080701A1 (fr) * | 2018-04-26 | 2019-11-01 | Transdev Group | Systeme de surveillance de la circulation routiere avec affichage d'une image virtuelle d'objets mobiles evoluant dans une portion d'infrastructure routiere |
US10885778B2 (en) | 2018-04-26 | 2021-01-05 | Transdev Group | Traffic monitoring system with display of a virtual image of moving objects in a portion of roadway infrastructure |
Also Published As
Publication number | Publication date |
---|---|
JP2001184586A (ja) | 2001-07-06 |
DE60019813T2 (de) | 2005-10-06 |
JP3601392B2 (ja) | 2004-12-15 |
ES2237485T3 (es) | 2005-08-01 |
HK1047814A1 (en) | 2003-03-07 |
HK1047814B (zh) | 2005-06-24 |
EP1262933A4 (de) | 2004-03-31 |
WO2001048724A1 (fr) | 2001-07-05 |
DE60019813D1 (de) | 2005-06-02 |
EP1262933B1 (de) | 2005-04-27 |
ATE294434T1 (de) | 2005-05-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7082209B2 (en) | Object detecting method and object detecting apparatus and intruding object monitoring apparatus employing the object detecting method | |
KR100939761B1 (ko) | 차량 장착용 카메라 유닛, 차량 외부 디스플레이 방법 및 드라이빙 코리더 마커 생성 시스템 | |
EP2434759B1 (de) | Überwachungsgerät | |
EP2410740A1 (de) | Umgebungsbereichsüberwachungsvorrichtung für fahrzeuge und umgebungsbereichsüberwachungsverfahren für fahrzeuge | |
US7173666B1 (en) | System and method for displaying a non-standard aspect ratio image on a standard aspect ratio monitor | |
EP1262933A1 (de) | Bildverarbeitungsvorrichtung, bildverarbeitungsverfahren und fahrzeugüberwachungssystem | |
US10889958B2 (en) | Display system for machine | |
JP3788400B2 (ja) | 画像処理装置、画像処理方法及び車両監視システム | |
JP3467774B2 (ja) | 画像処理装置、画像処理方法及び車両監視システム | |
JP2002158999A (ja) | 物体検出方法及び物体検出装置並びに侵入物体監視装置 | |
JPH10105863A (ja) | 走行路情報収集装置 | |
JP3354626B2 (ja) | 移動体検出方法 | |
JP2008059513A (ja) | 車両の底面を監視する装置、及び同方法 | |
US20070217655A1 (en) | Image detection device | |
JPH10322684A (ja) | カメラ装置 | |
KR20120046836A (ko) | 차량용 영상 전처리기 및 이를 이용한 영상 전처리 방법 | |
JP3824344B2 (ja) | 固体撮像装置 | |
JP2022035319A (ja) | ドライバ支援システム | |
JP2006197614A (ja) | 画像処理装置、画像処理方法及び車両監視システム | |
JPH11339177A (ja) | 道路監視装置 | |
JP2001216598A (ja) | 交通流計測装置 | |
JP5606774B2 (ja) | 映像表示装置及び映像表示方法 | |
EP4258653A1 (de) | Bildverarbeitungsvorrichtung zur messung des abstands zu einem objekt, bewegliche vorrichtung, bildverarbeitungsverfahren und speichermedium | |
JP2004220102A (ja) | 画像処理装置、画像処理方法及び車両監視システム | |
JPH11288495A (ja) | 交通異常検出装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20020722 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20040212 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: 7G 08G 1/01 B Ipc: 7G 08G 1/04 A |
|
17Q | First examination report despatched |
Effective date: 20040301 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050427 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050427 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050427 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 60019813 Country of ref document: DE Date of ref document: 20050602 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: GR Ref document number: 1047814 Country of ref document: HK |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: BOVARD AG PATENTANWAELTE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050727 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050727 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20050727 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2237485 Country of ref document: ES Kind code of ref document: T3 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20051010 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20051220 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20051220 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20051231 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
ET | Fr: translation filed | ||
26N | No opposition filed |
Effective date: 20060130 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 746 Effective date: 20100330 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20101129 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: LU Payment date: 20110118 Year of fee payment: 11 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20101215 Year of fee payment: 11 Ref country code: IT Payment date: 20101224 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PFA Owner name: SUMITOMO ELECTRIC INDUSTRIES, LTD. Free format text: SUMITOMO ELECTRIC INDUSTRIES, LTD.#5-33, KITAHAMA 4-CHOME CHUO-KU#OSAKA-SHI, OSAKA 541-0041 (JP) -TRANSFER TO- SUMITOMO ELECTRIC INDUSTRIES, LTD.#5-33, KITAHAMA 4-CHOME CHUO-KU#OSAKA-SHI, OSAKA 541-0041 (JP) |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20111213 Year of fee payment: 12 Ref country code: NL Payment date: 20111221 Year of fee payment: 12 Ref country code: ES Payment date: 20111228 Year of fee payment: 12 Ref country code: FR Payment date: 20111219 Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: V1 Effective date: 20130701 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 294434 Country of ref document: AT Kind code of ref document: T Effective date: 20121220 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20121220 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20130830 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130701 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121231 Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121220 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130102 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121220 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121220 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20140306 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121221 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20121220 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20151215 Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 60019813 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170701 |