EP2091261A3 - White balance calibration for digital camera device - Google Patents

White balance calibration for digital camera device Download PDF

Info

Publication number
EP2091261A3
EP2091261A3 EP08006441.3A EP08006441A EP2091261A3 EP 2091261 A3 EP2091261 A3 EP 2091261A3 EP 08006441 A EP08006441 A EP 08006441A EP 2091261 A3 EP2091261 A3 EP 2091261A3
Authority
EP
European Patent Office
Prior art keywords
digital camera
camera device
cct
white balance
calibration procedure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP08006441.3A
Other languages
German (de)
French (fr)
Other versions
EP2091261A2 (en
EP2091261B1 (en
Inventor
Szepo Robert c/o QUALCOMM Incorporated Hung
Jingqiang c/o QUALCOMM Incorporated Li
Ruben M. c/o QUALCOMM Incorporated Velarde
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of EP2091261A2 publication Critical patent/EP2091261A2/en
Publication of EP2091261A3 publication Critical patent/EP2091261A3/en
Application granted granted Critical
Publication of EP2091261B1 publication Critical patent/EP2091261B1/en
Priority to CY20151100856T priority Critical patent/CY1117040T1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control

Abstract

This disclosure describes automatic self-calibration techniques for digital camera devices. In one aspect, a method for performing a calibration procedure in a digital camera device comprises initiating the calibration procedure when a camera sensor of the digital camera device is operating, accumulating data for the calibration procedure, the data comprising one or more averages of correlated color temperature (CCT) associated with information captured by the camera sensor, calculating one or more CCT vectors based on the one or more averages of CCT, and generating gray point correction factors based on the one or more CCT vectors.
EP08006441.3A 2008-02-13 2008-03-31 White balance calibration for digital camera device Not-in-force EP2091261B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CY20151100856T CY1117040T1 (en) 2008-02-13 2015-09-28 WHITE BALANCE CALIBRATION FOR DIGITAL CAMERA DEVICE

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/030,814 US8004566B2 (en) 2008-02-13 2008-02-13 Self calibration of white balance for a digital camera device using correlated color temperature data

Publications (3)

Publication Number Publication Date
EP2091261A2 EP2091261A2 (en) 2009-08-19
EP2091261A3 true EP2091261A3 (en) 2014-07-02
EP2091261B1 EP2091261B1 (en) 2015-07-29

Family

ID=40635866

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08006441.3A Not-in-force EP2091261B1 (en) 2008-02-13 2008-03-31 White balance calibration for digital camera device

Country Status (8)

Country Link
US (1) US8004566B2 (en)
EP (1) EP2091261B1 (en)
JP (2) JP5512550B2 (en)
KR (1) KR101154136B1 (en)
CN (1) CN101911715B (en)
CY (1) CY1117040T1 (en)
TW (1) TW200952502A (en)
WO (1) WO2009102998A1 (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100271489A1 (en) * 2009-04-23 2010-10-28 Nokia Corporation Imaging unit, apparatus comprising an imaging unit, a system, and methods for calibrating an imaging apparatus
US8462227B2 (en) * 2009-04-24 2013-06-11 Ati Technologies Ulc Digital camera module white balance calibration method and apparatus using only single illumination source data
KR101245199B1 (en) * 2011-04-20 2013-03-19 (주)아크로엠 Color balance control device and control method for camera
WO2012170718A1 (en) * 2011-06-08 2012-12-13 Apple Inc. Camera test and calibration based on spectral monitoring of light
WO2014057588A1 (en) * 2012-10-12 2014-04-17 Necディスプレイソリューションズ株式会社 Brightness calibrator, program, and brightness calibration method
US8854709B1 (en) * 2013-05-08 2014-10-07 Omnivision Technologies, Inc. Automatic white balance based on dynamic mapping
CN103338383B (en) * 2013-06-25 2016-12-28 努比亚技术有限公司 The method and device of white balance calibration
CN103963453B (en) * 2014-04-21 2016-07-06 杭州电子科技大学 A kind of printing grey balance pre-setting method
US9386289B2 (en) * 2014-04-29 2016-07-05 Intel Corporation Automatic white balancing with chromaticity measure of raw image data
CN105578166B (en) * 2016-01-08 2018-06-05 浙江宇视科技有限公司 A kind of colour temperature determines method and device
CN106791758B (en) * 2016-12-07 2018-07-06 浙江大华技术股份有限公司 The judgment method and device of natural light mixing colour temperature in a kind of image
US10805588B2 (en) 2016-04-25 2020-10-13 Zhejiang Dahua Technology Co., Ltd. Methods, systems, and media for image white balance adjustment
CN105872513A (en) * 2016-06-17 2016-08-17 刘华英 White balance method based on environment characteristic value and white balance device based on environment characteristic value
US10420186B2 (en) * 2017-05-31 2019-09-17 Nbcuniversal Media, Llc Color tunable light with zone control
US10932340B2 (en) 2018-04-13 2021-02-23 Nbcuniversal Media, Llc Digitally adjustable focused beam lighting system
US10863059B2 (en) * 2018-06-26 2020-12-08 Microsoft Technology Licensing, Llc Environmental-based spatial color uniformity correction by using statistical distribution of camera modules
US10791310B2 (en) * 2018-10-02 2020-09-29 Intel Corporation Method and system of deep learning-based automatic white balancing
US11333342B2 (en) 2019-05-29 2022-05-17 Nbcuniversal Media, Llc Light emitting diode cooling systems and methods
US11047560B2 (en) 2019-05-29 2021-06-29 Nbcuniversal Media, Llc Light emitting diode cooling systems and methods
CN112950635A (en) * 2021-04-26 2021-06-11 Oppo广东移动通信有限公司 Gray dot detection method, gray dot detection device, electronic device, and storage medium
KR20230023498A (en) 2021-08-10 2023-02-17 삼성전자주식회사 Electronic device includind under display camera and operating method thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1311111A2 (en) * 2001-11-08 2003-05-14 Fuji Photo Film Co., Ltd. Method and apparatus for correcting white balance, method for correcting density and program recording medium
US6654493B1 (en) * 1998-11-13 2003-11-25 Lightsurf Technologies, Inc. Charactering and calibrating an image capture device

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS612487A (en) * 1984-06-14 1986-01-08 Sony Corp Automatic white balance adjusting method of color video camera
JP2776437B2 (en) * 1987-02-18 1998-07-16 ミノルタ株式会社 Automatic white balance adjustment device
JPH05300525A (en) * 1991-04-19 1993-11-12 Hitachi Ltd White balance controller
US5821993A (en) 1996-01-25 1998-10-13 Medar, Inc. Method and system for automatically calibrating a color camera in a machine vision system
US5995142A (en) 1996-02-04 1999-11-30 Sony Corporation Automatic white balance control system for a color video camera
US6023264A (en) * 1998-04-24 2000-02-08 Adobe Systems Incorporated Method to estimate the white point on a display device
KR100304663B1 (en) * 1998-12-04 2001-09-29 윤종용 Color illumination color temperature detecting device and method thereof
JP2001275122A (en) * 2000-03-27 2001-10-05 Minolta Co Ltd Digital camera
US6947079B2 (en) * 2000-12-22 2005-09-20 Eastman Kodak Company Camera having verification display with reverse white balanced viewer adaptation compensation and method
US7084907B2 (en) * 2001-01-15 2006-08-01 Nikon Corporation Image-capturing device
JP4059708B2 (en) 2001-06-01 2008-03-12 オリンパス株式会社 Digital camera and white balance adjustment method
US7184080B2 (en) * 2001-06-25 2007-02-27 Texas Instruments Incorporated Automatic white balancing via illuminant scoring
US7218344B2 (en) * 2001-08-15 2007-05-15 Sony Corporation System and method for efficiently performing a white balance operation
JP3719424B2 (en) * 2002-05-09 2005-11-24 セイコーエプソン株式会社 Image processing system, projector, image processing method, program, and information storage medium
US7218358B2 (en) * 2004-06-15 2007-05-15 Coretronic Corporation Method and apparatus for calibrating color temperature of color display devices
JP2006279459A (en) * 2005-03-29 2006-10-12 Seiko Epson Corp Device, method and program for image photography, and recording medium
JP4539432B2 (en) * 2005-05-16 2010-09-08 ソニー株式会社 Image processing apparatus and imaging apparatus
US7912279B2 (en) * 2006-10-26 2011-03-22 Qualcomm Incorporated Automatic white balance statistics collection
US8049789B2 (en) * 2006-12-15 2011-11-01 ON Semiconductor Trading, Ltd White balance correction using illuminant estimation

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6654493B1 (en) * 1998-11-13 2003-11-25 Lightsurf Technologies, Inc. Charactering and calibrating an image capture device
EP1311111A2 (en) * 2001-11-08 2003-05-14 Fuji Photo Film Co., Ltd. Method and apparatus for correcting white balance, method for correcting density and program recording medium

Also Published As

Publication number Publication date
US8004566B2 (en) 2011-08-23
EP2091261A2 (en) 2009-08-19
JP2011512112A (en) 2011-04-14
JP2014042272A (en) 2014-03-06
CN101911715A (en) 2010-12-08
EP2091261B1 (en) 2015-07-29
KR101154136B1 (en) 2012-06-13
TW200952502A (en) 2009-12-16
KR20100121665A (en) 2010-11-18
WO2009102998A1 (en) 2009-08-20
US20090201374A1 (en) 2009-08-13
JP5512550B2 (en) 2014-06-04
CN101911715B (en) 2012-12-05
CY1117040T1 (en) 2017-04-05

Similar Documents

Publication Publication Date Title
EP2091261A3 (en) White balance calibration for digital camera device
EP1985981A3 (en) Information processing apparatus and method
EP2076054A3 (en) White balance control device and white balance control method
EP1596329A3 (en) Marker placement information estimating method and information processing device
EP1944732A3 (en) Apparatus and method for blur detection, and apparatus and method for blur correction
EP1689170A3 (en) Method and apparatus for expressing amount of camera motion
EP2112467A3 (en) Method and device for fluorescent immersion range scanning
EP1857976A3 (en) Histogram adjustment for high dynamic range image mapping
EP1857975A3 (en) Histogram adjustment for high dynamic range image mapping
EP2160020A3 (en) Image processing apparatus for performing gradation correction on subject image
WO2009134292A3 (en) Recognizing image environment from image and position
EP1612545A3 (en) Optically-augmented microwave imaging system and method
EP2173086A3 (en) Image processing apparatus, color processing method and printer apparatus
EP2610784A3 (en) Image processing system and image processing method
EP2230828A3 (en) Adding glossmarks or correlation marks to images in dependence on the compatability thereof with the images
EP3800543A3 (en) Device and method of improving the perceptual luminance nonlinearity-based image data exchange across different display capabilities
WO2009131350A3 (en) Selecting best image
EP2237187A3 (en) Information processing apparatus, authentication device, and recording medium
EP2202407A3 (en) Wind turbine yaw bearing determination
EP2180428A3 (en) System and method for automatic detection of anatomical features on 3D ear impressions
EP1898246A3 (en) Microscope apparatus control method and microscope apparatus
EP1860869A4 (en) Digital camera
EP2138903A3 (en) Condition determining system, method of detecting abnormality of condition determination system image forming apparatus
EP1884798A3 (en) Method for measuring distance to object
EP1898356A3 (en) Device and method for image color determination

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 17/00 20060101AFI20140526BHEP

Ipc: H04N 9/73 20060101ALI20140526BHEP

17P Request for examination filed

Effective date: 20140818

RBV Designated contracting states (corrected)

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 9/73 20060101ALI20141010BHEP

Ipc: H04N 17/00 20060101AFI20141010BHEP

INTG Intention to grant announced

Effective date: 20141106

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

INTG Intention to grant announced

Effective date: 20150218

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 740055

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150815

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008039196

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 740055

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150729

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151029

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151030

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151130

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151129

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008039196

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160502

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160331

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20161130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20080331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150729

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CY

Payment date: 20210216

Year of fee payment: 14

Ref country code: MC

Payment date: 20210224

Year of fee payment: 14

Ref country code: LT

Payment date: 20210317

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20210210

Year of fee payment: 14

Ref country code: GB

Payment date: 20210311

Year of fee payment: 14

Ref country code: LV

Payment date: 20210210

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602008039196

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MM4D

Effective date: 20220331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220331

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220331

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220331

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220331

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221001