EP1972496B8 - Vehicle outside display system and display control apparatus - Google Patents

Vehicle outside display system and display control apparatus Download PDF

Info

Publication number
EP1972496B8
EP1972496B8 EP08003199A EP08003199A EP1972496B8 EP 1972496 B8 EP1972496 B8 EP 1972496B8 EP 08003199 A EP08003199 A EP 08003199A EP 08003199 A EP08003199 A EP 08003199A EP 1972496 B8 EP1972496 B8 EP 1972496B8
Authority
EP
European Patent Office
Prior art keywords
control apparatus
vehicle outside
display control
display system
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP08003199A
Other languages
German (de)
French (fr)
Other versions
EP1972496A2 (en
EP1972496B1 (en
EP1972496A3 (en
Inventor
Muneaki Matsumoto
Yoshihisa Sato
Hiroaki Shimizu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Publication of EP1972496A2 publication Critical patent/EP1972496A2/en
Publication of EP1972496A3 publication Critical patent/EP1972496A3/en
Publication of EP1972496B1 publication Critical patent/EP1972496B1/en
Application granted granted Critical
Publication of EP1972496B8 publication Critical patent/EP1972496B8/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/86—Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88—Sonar systems specially adapted for specific applications
    • G01S15/93—Sonar systems specially adapted for specific applications for anti-collision purposes
    • G01S15/931—Sonar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/301—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/307—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing virtually distinguishing relevant parts of a scene from the background of the scene
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/602—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective with an adjustable viewpoint
    • B60R2300/605—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective with an adjustable viewpoint the adjustment being automatic
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/70—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/87—Combinations of sonar systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Mechanical Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
EP08003199A 2007-03-22 2008-02-21 Vehicle outside display system and display control apparatus Active EP1972496B8 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007074796A JP4404103B2 (en) 2007-03-22 2007-03-22 Vehicle external photographing display system and image display control device

Publications (4)

Publication Number Publication Date
EP1972496A2 EP1972496A2 (en) 2008-09-24
EP1972496A3 EP1972496A3 (en) 2009-12-23
EP1972496B1 EP1972496B1 (en) 2012-07-04
EP1972496B8 true EP1972496B8 (en) 2012-08-08

Family

ID=39591192

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08003199A Active EP1972496B8 (en) 2007-03-22 2008-02-21 Vehicle outside display system and display control apparatus

Country Status (4)

Country Link
US (1) US20080231702A1 (en)
EP (1) EP1972496B8 (en)
JP (1) JP4404103B2 (en)
CN (1) CN101269644B (en)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006052779A1 (en) * 2006-11-09 2008-05-15 Bayerische Motoren Werke Ag Method for generating an overall image of the surroundings of a motor vehicle
JP5053043B2 (en) * 2007-11-09 2012-10-17 アルパイン株式会社 Vehicle peripheral image generation device and vehicle peripheral image distortion correction method
JP2010064725A (en) * 2008-09-15 2010-03-25 Denso Corp On-vehicle captured image display controller, program for on-vehicle captured image display controller, and on-vehicle captured image display system
JP5099451B2 (en) * 2008-12-01 2012-12-19 アイシン精機株式会社 Vehicle periphery confirmation device
DE102009000401A1 (en) * 2009-01-26 2010-07-29 Robert Bosch Gmbh Motor vehicle driver assistance system, especially for parking, has an ultrasonic and an optic system to register an object in relation to the vehicle to prevent a collision
JP5439890B2 (en) 2009-03-25 2014-03-12 富士通株式会社 Image processing method, image processing apparatus, and program
JP4737317B2 (en) 2009-04-14 2011-07-27 株式会社デンソー Vehicle periphery shooting display system
DE102009035422B4 (en) * 2009-07-31 2021-06-17 Bayerische Motoren Werke Aktiengesellschaft Method for geometrical image transformation
JP5282730B2 (en) * 2009-12-15 2013-09-04 トヨタ自動車株式会社 Driving assistance device
JP5071743B2 (en) * 2010-01-19 2012-11-14 アイシン精機株式会社 Vehicle periphery monitoring device
JP2011205513A (en) * 2010-03-26 2011-10-13 Aisin Seiki Co Ltd Vehicle periphery monitoring device
JP5560852B2 (en) * 2010-03-31 2014-07-30 株式会社デンソー Outside camera image display system
WO2011145141A1 (en) * 2010-05-19 2011-11-24 三菱電機株式会社 Vehicle rear-view observation device
CN102259618B (en) * 2010-05-25 2015-04-22 德尔福(中国)科技研发中心有限公司 Warning treatment method for fusion of vehicle backward ultrasonic and camera
JP5052707B2 (en) * 2010-06-15 2012-10-17 三菱電機株式会社 Vehicle periphery monitoring device
EP2570556B1 (en) * 2010-06-18 2021-04-28 Hitachi Construction Machinery Co., Ltd. Device for monitoring area around work machine
EP2511137B1 (en) * 2011-04-14 2019-03-27 Harman Becker Automotive Systems GmbH Vehicle Surround View System
US9691125B2 (en) 2011-12-20 2017-06-27 Hewlett-Packard Development Company L.P. Transformation of image data based on user position
JP5629740B2 (en) * 2012-09-21 2014-11-26 株式会社小松製作所 Work vehicle periphery monitoring system and work vehicle
JP2014089513A (en) * 2012-10-29 2014-05-15 Denso Corp Image generation apparatus and image generation program
KR101438921B1 (en) * 2012-11-16 2014-09-11 현대자동차주식회사 Apparatus and method for alerting moving-object of surrounding of vehicle
DE102013200793A1 (en) * 2013-01-18 2014-07-24 Robert Bosch Gmbh Driver assistance system
CN103863192B (en) * 2014-04-03 2017-04-12 深圳市德赛微电子技术有限公司 Method and system for vehicle-mounted panoramic imaging assistance
JP6262068B2 (en) * 2014-04-25 2018-01-17 日立建機株式会社 Near-body obstacle notification system
DE102014107235A1 (en) * 2014-05-22 2015-11-26 Dr. Ing. H.C. F. Porsche Aktiengesellschaft A method of displaying a vehicle environment on a display device; a display device; a system of a plurality of image capture units and a display device; a computer program
JP2016013793A (en) * 2014-07-03 2016-01-28 株式会社デンソー Image display device and image display method
CN104494597A (en) * 2014-12-10 2015-04-08 浙江吉利汽车研究院有限公司 Self-adapted cruising control system
US20160176340A1 (en) * 2014-12-17 2016-06-23 Continental Automotive Systems, Inc. Perspective shifting parking camera system
JP6439436B2 (en) * 2014-12-19 2018-12-19 株式会社デンソー Video processing apparatus and in-vehicle video processing system
JP2016184251A (en) * 2015-03-26 2016-10-20 株式会社Ｊｖｃケンウッド Vehicle monitoring system, vehicle monitoring method, and vehicle monitoring program
US11214248B2 (en) 2017-05-11 2022-01-04 Mitsubishi Electric Corporation In-vehicle monitoring camera device
JP2019080238A (en) * 2017-10-26 2019-05-23 シャープ株式会社 Vehicle driving support device and vehicle driving support program
KR102441079B1 (en) * 2017-11-30 2022-09-06 현대자동차주식회사 Apparatus and method for controlling display of vehicle
EP3502744B1 (en) * 2017-12-20 2020-04-22 Leica Geosystems AG Near-field pulse detection
JP2019151304A (en) * 2018-03-06 2019-09-12 アイシン精機株式会社 Periphery monitoring device
JP7006460B2 (en) * 2018-04-02 2022-01-24 株式会社Ｊｖｃケンウッド Vehicle display control device, vehicle display system, vehicle display control method, and program
JP6575668B2 (en) * 2018-11-19 2019-09-18 株式会社デンソー Video processing device
JP7565677B2 (en) * 2019-06-27 2024-10-11 株式会社クボタ Obstacle detection system for agricultural vehicles
CN112208438B (en) * 2019-07-10 2022-07-29 台湾中华汽车工业股份有限公司 Driving auxiliary image generation method and system
US11733369B2 (en) * 2021-02-11 2023-08-22 Waymo Llc Methods and systems for three dimensional object detection and localization
JP2024124080A (en) * 2023-03-02 2024-09-12 キヤノン株式会社 Imaging system, vehicle, imaging system control method, and program

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3855552B2 (en) * 1999-08-26 2006-12-13 松下電工株式会社 Obstacle monitoring device around the vehicle
EP1083076A3 (en) * 1999-09-07 2005-01-12 Mazda Motor Corporation Display apparatus for vehicle
JP3608527B2 (en) * 2001-05-15 2005-01-12 株式会社豊田中央研究所 Peripheral status display device
JP2003264835A (en) 2002-03-08 2003-09-19 Nippon Telegr & Teleph Corp <Ntt> Digital signal compression method and circuit, and digital signal expansion method and circuit
EP1263239A3 (en) 2001-05-30 2005-02-09 Nippon Telegraph and Telephone Corporation Image compression system
DE10236879B4 (en) * 2001-08-14 2013-10-24 Denso Corporation Obstacle detection device and related communication device
US7221777B2 (en) * 2002-07-02 2007-05-22 Honda Giken Kogyo Kabushiki Kaisha Image analysis device
DE10321228B4 (en) * 2003-04-22 2007-01-11 Valeo Schalter Und Sensoren Gmbh Optical detection system for vehicles
JP4766841B2 (en) * 2003-09-08 2011-09-07 株式会社オートネットワーク技術研究所 Camera device and vehicle periphery monitoring device mounted on vehicle
TWM253059U (en) * 2003-11-05 2004-12-11 Arima Optoelectronics Corp Full-color light emitting diode formed by overlapping three primary colors
DE102005015088B4 (en) * 2004-04-02 2015-06-18 Denso Corporation Vehicle environment monitoring system
JP4590962B2 (en) * 2004-07-21 2010-12-01 日産自動車株式会社 Vehicle periphery monitoring device
US7106183B2 (en) * 2004-08-26 2006-09-12 Nesa International Incorporated Rearview camera and sensor system for vehicles
JP3977368B2 (en) * 2004-09-30 2007-09-19 クラリオン株式会社 Parking assistance system
US7881496B2 (en) * 2004-09-30 2011-02-01 Donnelly Corporation Vision system for vehicle
US7599521B2 (en) * 2004-11-30 2009-10-06 Honda Motor Co., Ltd. Vehicle vicinity monitoring apparatus
JP4654723B2 (en) 2005-03-22 2011-03-23 日産自動車株式会社 Video display device and video display method
JP4353162B2 (en) * 2005-09-26 2009-10-28 トヨタ自動車株式会社 Vehicle surrounding information display device
JP4760272B2 (en) * 2005-09-30 2011-08-31 アイシン精機株式会社 Vehicle periphery monitoring device and sensor unit

Also Published As

Publication number Publication date
CN101269644B (en) 2012-06-20
EP1972496A2 (en) 2008-09-24
JP2008230476A (en) 2008-10-02
CN101269644A (en) 2008-09-24
US20080231702A1 (en) 2008-09-25
EP1972496B1 (en) 2012-07-04
EP1972496A3 (en) 2009-12-23
JP4404103B2 (en) 2010-01-27

Similar Documents

Publication Publication Date Title
EP1972496B8 (en) Vehicle outside display system and display control apparatus
EP2168819A4 (en) Vehicle-mounted device control system
EP1965366B8 (en) Driving assist system and vehicle-mounted apparatus
EP1999739A4 (en) Display apparatus and display system
EP2191292B8 (en) Imaging system and method
EP2245616A4 (en) Data control and display system
EP1914493B8 (en) Air-conditioning apparatus
EP2183913A4 (en) Display device and speaker system for the display device
EP1969709A4 (en) Vehicle panel control system
EP2178295A4 (en) Display system and display apparatus
TWI372350B (en) Image display systems and display device control methods
EP2213860A4 (en) Vehicle control device
EP2296229A4 (en) Radio-on-fiber unit and radio-on-fiber system
EP2353921A4 (en) Vehicle control device and control method
EP2297551A4 (en) On vehicle display device
EP2095637A4 (en) System for displaying image and method for controlling the same
EP2093405A4 (en) Vehicle control method and vehicle control device
GB2461004B (en) Control and display apparatus
ZA200808499B (en) Vehicle display system
TWI340953B (en) Systems for displaying images and control methods thereof
TWI346313B (en) Display control system and method thereof
AU2006901574A0 (en) Display Control System and Method
AU2006903269A0 (en) Microtunnelling system and apparatus
AU2006903264A0 (en) Microtunnelling system and apparatus
AU2007901490A0 (en) Display system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

17P Request for examination filed

Effective date: 20100623

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: CH

Ref legal event code: PK

Free format text: DIE BENENNUNG CH/LI WURDE VOR DER ERTEILUNG ZURUECKGENOMMEN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 565027

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120715

RBV Designated contracting states (corrected)

Designated state(s): DE FR

REG Reference to a national code

Ref country code: NL

Ref legal event code: XEP

Effective date: 20120622

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008016930

Country of ref document: DE

Effective date: 20120830

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 565027

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120704

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 602008016930

Country of ref document: DE

Effective date: 20130225

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130405

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008016930

Country of ref document: DE

Effective date: 20130405

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230220

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230216

Year of fee payment: 16