EP2477176A1 - Approximation de tableau de compensation de rétroéclairage pour affichages - Google Patents

Approximation de tableau de compensation de rétroéclairage pour affichages Download PDF

Info

Publication number
EP2477176A1
EP2477176A1 EP12151013A EP12151013A EP2477176A1 EP 2477176 A1 EP2477176 A1 EP 2477176A1 EP 12151013 A EP12151013 A EP 12151013A EP 12151013 A EP12151013 A EP 12151013A EP 2477176 A1 EP2477176 A1 EP 2477176A1
Authority
EP
European Patent Office
Prior art keywords
matrix
display
backlight
size
approximation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP12151013A
Other languages
German (de)
English (en)
Other versions
EP2477176B1 (fr
Inventor
Emrah Tasli
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vestel Elektronik Sanayi ve Ticaret AS
Original Assignee
Vestel Elektronik Sanayi ve Ticaret AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vestel Elektronik Sanayi ve Ticaret AS filed Critical Vestel Elektronik Sanayi ve Ticaret AS
Publication of EP2477176A1 publication Critical patent/EP2477176A1/fr
Application granted granted Critical
Publication of EP2477176B1 publication Critical patent/EP2477176B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G09G3/342—Control of illumination source using several illumination sources separately controlled corresponding to different display panel areas, e.g. along one dimension such as lines
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/3406—Control of illumination source
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0233—Improving the luminance or brightness uniformity across the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0285—Improving the quality of display appearance using tables for spatial correction of display data

Definitions

  • the present invention is related to a backlight compensation table approximation method and system for displays.
  • LCDs Liquid Crystal Displays
  • Backlights may be positioned both under the thin film layer of the display, which is called as direct-lit displays, or along the edges of the display, which is called as edge-lit displays.
  • the direct-lit displays employ uniformly distributed light elements along the display. Hence, the display is uniformly illuminated by the backlight.
  • the edge-lit displays employ a limited number of backlights, which are positioned along the edges of the display. Since the light intensity has maximum value at a zero distance to the source and decreases as the distance increases, the display cannot be illuminated uniformly.
  • edge-lit displays Another drawback with the edge-lit displays are that since the backlight cannot be used for illumination of a definite region of the display, it is not possible to use local dimming methods as in the direct-lit displays. Instead, a combined illumination of backlights should be considered and to obtain uniformity, again complex operations and large memory space is required.
  • edge-lit displays For the stated drawbacks of the edge-lit displays, the market is focused on direct-lit displays, which serves for quality picture but the production cost is relatively much higher than edge-lit displays.
  • WO 2007/027539 A1 patent document discloses another solution for backlight compensation in which a concave transflective panel to distribute emitted light uniformly is utilized. This method is well known and widely used in edge-lit displays. However the fact that the invention can be used with only one backlight source limits the scope of the solution. Furthermore it is known that trans-reflective panels do not provide a complete solution for uniformity since a perfectly light distribution surface cannot be obtained.
  • US 7717602 B2 patent document discloses another solution for backlight non-uniformity compensation. Stated solution comprises utilizing extra backlight elements in the display and controlling these backlight elements to compensate backlight non-uniformities.
  • all backlight sources known in the prior art provide a point spread light beam, extra backlight sources add new non-uniformities and it is not possible to fully compensate non-uniformities using the solution of this patent document.
  • Present invention comprises a backlight compensation table approximation method by utilizing singular value decomposition of a matrix and approximation of matrix via determining a rank number and reducing matrix sizes using this rank number.
  • the invention also discloses utilization of this approximation in displays to obtain backlight uniformity along the whole display.
  • the approximation value is utilized to adjust transmission values of display pixels and compensate backlight deviation all over the display.
  • a backlight compensation table approximation method for a display which comprises at least one backlight source and pixels of m rows and n columns and wherein a compensation table of said backlight source with respect to m rows and n columns of pixels as a table M is known, said method comprising the steps of;
  • a backlight compensation method for a display which comprises at least one backlight source and pixels of m rows and n columns the method comprising the steps of;
  • a local dimming method for a display which comprises a plurality of backlight sources and pixels of m rows and n columns, the method comprising the steps of;
  • a display comprising at least which comprises at least one backlight source and pixels of m rows and n columns, further comprising;
  • a display which comprises at least one backlight source and pixels of m rows and n columns, further comprising;
  • the object of the invention is to provide a backlight compensation table approximation method for displays.
  • Another object of the invention is to provide a backlight compensation method and system for compensation of backlight non-uniformity on a display.
  • Another object of the invention is to provide a backlight compensation method and system which reduces the required memory for a compensation table.
  • Another object of the invention is to provide a backlight compensation method and system which enables utilization of local dimming in edge-lit displays.
  • Edge-lit displays suffer from backlight intensity non-uniformity, which degrades perceived image quality on the display.
  • the solution of the state of the art is to compensate non-uniformity by adjusting display thin film layer by utilizing a compensation table.
  • the aim of the method and system of present invention is to reduce the memory required by approximation of the compensation table by singular value decomposition and a mean square error (MSE) criterion.
  • MSE mean square error
  • a matrix M having a size of m x n can be represented using singular value decomposition as shown in the equation (1).
  • M U ⁇ V *
  • U is an m x m unitary matrix
  • ⁇ is an m x n diagonal matrix with nonnegative real numbers on the diagonal
  • V* denotes the conjugate transpose of V, which is an n x n unitary matrix.
  • V can be assumed real and hence conjugate can be replaced by transpose.
  • Equation (1) can be decomposed into two equations (2, 3) to realize the point spread function.
  • the method of the present invention utilizes an approximate model matrix M' for matrix M using an R th order approximation.
  • the approximation is based on minimizing the frobenius norm of the difference between the matrix M and M'.
  • ⁇ ' is obtained by leaving the largest R values of the matrix ⁇ and setting all other values to zero. This reduces the size of matrices which are composed to determine M'.
  • Figure 1 shows light intensity of a point light source (e.g. light emitting diode - LED) with respect to horizontal position.
  • Figure 2 shows light intensity of the same source with respect to vertical position.
  • the highly correlation characteristic of intensity distribution enables approximation of the compensation table easily.
  • the rank number R is determined by comparing approximate and real values using mean square error (MSE) criterion.
  • MSE criterion gives true information of a practical perception error.
  • Figure 3 shows MSE of approximation of present invention with respect to rank number R. As it can be seen on the figure, the MSE of the approximation decreases exponentially with the increasing rank number. Determination of rank number by means of visual observation as well as mathematical results is also important. Application of method and visual observation states similar results with mathematical results and those clearly state that, a rank number 5 is high enough to approximate compensation table adequately and no visual difference can be observed in visual observation.
  • the method of the present invention comprises the steps of;
  • the approximation technique of present invention can be used for backlight compensation in a display device comprising at least a backlight source and pixels of m rows and n columns. Said method comprises the steps of;
  • Present invention further comprises a display having a display resolution m x n, utilizing the method of the invention in determining backlight compensation to obtain uniformity.
  • the display comprises
  • the display of the present invention utilizes the approximation method of the invention and adjusts pixels of the display by calculating a compensation value for each light source of the display. As a result, the whole display is compensated regarding light intensity non-uniformity.
  • the compensation value may be calculated for each refresh of the pixels of the display. If the display device has adequate temporary memory to store the whole approximate matrix, the calculated compensation values may be stored in the temporary memory to avoid repeated compensation calculations. As long as light intensity parameters are not changed by means of other parameters of the display, for instance a brightness adjustment by the user, it may not be necessary to calculate compensation values repeatedly.
  • backlight control based enhancements are possible since it is possible to determine uniformity around the whole display.
  • backlight control based enhancements such as local dimming or boosting backlight to increase contrast and picture dynamics can be only applied in devices with direct-lit displays.
  • local dimming or boosting backlight to increase contrast and picture dynamics
  • the compensation method of the present invention is applied for each backlight source of the display, it is merely a matter of calculation and prediction to use local dimming since the result of a combination of different illumination levels on any pixel can be calculated and a desired local dimming can be determined in accordance with compensation calculations.
  • the rest of the display is also affected since no locality exists.
  • the applicability of local dimming using the method of the invention enables utilization of local dimming in not only direct-lit displays but also in edge-lit displays.
  • the method can be used in direct-lit displays to reduce the number of backlight sources but maintain the effectiveness of local dimming.
  • Present invention further comprises a display device comprising a plurality of backlight sources and a plurality of predefined regions on the display comprising;
  • the approximation technique reduces the required memory size significantly, it is possible to store the matrices used for approximation separately for each backlight source. However, if the backlight sources have equivalent light intensity characteristics, it is possible to use same matrices for approximation of these equivalent backlight sources.
  • Basic matrix operations are useful such as exchanging row indexes and column indexes, moving row indexes and column indexes, reversal of row indexes and/or column indexes, and limitation of row index and/or column index.
  • Present invention enables illumination uniformity and fully illumination control in both direct-lit and edge-lit displays independently from the number and positions of the backlight sources.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Liquid Crystal (AREA)
EP12151013.5A 2011-01-14 2012-01-13 Approximation de tableau de compensation de rétroéclairage pour affichages Active EP2477176B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TR2011/00389A TR201100389A2 (tr) 2011-01-14 2011-01-14 Ekranlar için arka ışık dengeleme tablosu kestirimi

Publications (2)

Publication Number Publication Date
EP2477176A1 true EP2477176A1 (fr) 2012-07-18
EP2477176B1 EP2477176B1 (fr) 2015-06-03

Family

ID=45557860

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12151013.5A Active EP2477176B1 (fr) 2011-01-14 2012-01-13 Approximation de tableau de compensation de rétroéclairage pour affichages

Country Status (3)

Country Link
EP (1) EP2477176B1 (fr)
ES (1) ES2546520T3 (fr)
TR (1) TR201100389A2 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103871373A (zh) * 2014-04-01 2014-06-18 合肥工业大学 用于侧入式led背光液晶显示的区域动态调光方法
CN110599965A (zh) * 2019-08-09 2019-12-20 深圳市美芒科技有限公司 图像显示方法、图像显示装置、终端设备及可读存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007027539A1 (fr) 2005-08-27 2007-03-08 3M Innovative Properties Company Panneau lumineux a eclairage lateral possedant une cavite de recyclage de la lumiere pourvue d'un transflecteur concave
EP2154674A1 (fr) * 2008-08-14 2010-02-17 Samsung Electronics Co., Ltd. Appareil d'affichage et procédé de correction de la luminosité
US7717602B2 (en) 2004-12-13 2010-05-18 Lg Display Co., Ltd. External electrode fluorescent lamp, method of fabricating the same and liquid crystal display device having the same
WO2010096269A1 (fr) 2009-02-19 2010-08-26 Zoran Corporation Systèmes et procédés de compensation d'éclairage par l'arrière d'un dispositif d'affichage²

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7717602B2 (en) 2004-12-13 2010-05-18 Lg Display Co., Ltd. External electrode fluorescent lamp, method of fabricating the same and liquid crystal display device having the same
WO2007027539A1 (fr) 2005-08-27 2007-03-08 3M Innovative Properties Company Panneau lumineux a eclairage lateral possedant une cavite de recyclage de la lumiere pourvue d'un transflecteur concave
EP2154674A1 (fr) * 2008-08-14 2010-02-17 Samsung Electronics Co., Ltd. Appareil d'affichage et procédé de correction de la luminosité
WO2010096269A1 (fr) 2009-02-19 2010-08-26 Zoran Corporation Systèmes et procédés de compensation d'éclairage par l'arrière d'un dispositif d'affichage²

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Singular value decomposition", 10 January 2011 (2011-01-10), XP002671786, Retrieved from the Internet <URL:http://en.wikipedia.org/w/index.php?title=Singular_value_decomposition&oldid=407097783> [retrieved on 20120319] *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103871373A (zh) * 2014-04-01 2014-06-18 合肥工业大学 用于侧入式led背光液晶显示的区域动态调光方法
CN103871373B (zh) * 2014-04-01 2015-12-09 合肥工业大学 用于侧入式led背光液晶显示的区域动态调光方法
CN110599965A (zh) * 2019-08-09 2019-12-20 深圳市美芒科技有限公司 图像显示方法、图像显示装置、终端设备及可读存储介质

Also Published As

Publication number Publication date
EP2477176B1 (fr) 2015-06-03
TR201100389A2 (tr) 2012-08-22
ES2546520T3 (es) 2015-09-24

Similar Documents

Publication Publication Date Title
US9489725B2 (en) Method and device for expanding a dynamic range of display device
CN109064979B (zh) 图像显示处理方法及装置、显示装置及存储介质
US10571762B2 (en) High dynamic range displays using filterless LCD(s) for increasing contrast and resolution
US9135864B2 (en) Systems and methods for accurately representing high contrast imagery on high dynamic range display systems
US9418600B2 (en) Apparatus for controlling a display and method thereof
US8400392B2 (en) Apparatus and method for controlling backlight and liquid crystal display
US9772530B2 (en) High dynamic range displays using filterless LCD(s) for increasing contrast and resolution
US9595229B2 (en) Local dimming method and liquid crystal display
CN102165513B (zh) 用于在高亮度和高动态范围的显示器的图像处理中应用自适应伽玛的系统和方法
CN102314844B (zh) 液晶显示装置及局部调光驱动该液晶显示装置的方法
CN109887468B (zh) 一种基于图像局部特征的液晶显示动态调光方法
EP2126787B1 (fr) Afficheurs à modulateurs multiples et procédés associés
US20140049571A1 (en) Dual LCD Display with Color Correction to Compensate for Varying Achromatic LCD Panel Drive Conditions
CN101286300A (zh) 显示设备以及用于调节其亮度的方法
JP2010049125A (ja) 画像表示装置
US20110115829A1 (en) Image display apparatus and control apparatus thereof
US9047828B2 (en) Liquid crystal display device including signal controllers for driving panel areas and method for driving thereof
EP2477176B1 (fr) Approximation de tableau de compensation de rétroéclairage pour affichages
US8564528B1 (en) LCD image compensation for LED backlighting
US20120056905A1 (en) Image display apparatus and information processing apparatus
KR20160092125A (ko) 표시 장치
CN114420059B (zh) 背光控制方法、装置及显示设备
US9001021B2 (en) Display device and driving method thereof
KR101779294B1 (ko) 이미지의 특성에 따른 백라이트 부스팅 방법과 그 방법을 위한 장치
KR101076449B1 (ko) 글로벌 백라이트 디밍 방법과 이를 이용한 액정표시장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20130107

17Q First examination report despatched

Effective date: 20140721

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150211

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 730273

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150715

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012007661

Country of ref document: DE

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2546520

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20150924

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 730273

Country of ref document: AT

Kind code of ref document: T

Effective date: 20150603

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150903

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20150603

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150904

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150903

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151006

Ref country code: RO

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150603

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151003

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012007661

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

26N No opposition filed

Effective date: 20160304

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160131

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160113

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160131

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160131

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160113

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20120113

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150603

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20210122

Year of fee payment: 10

Ref country code: IT

Payment date: 20210121

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20210120

Year of fee payment: 10

Ref country code: ES

Payment date: 20210326

Year of fee payment: 10

Ref country code: GB

Payment date: 20210121

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20220107

Year of fee payment: 11

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602012007661

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220113

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220113

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220802

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220113

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220114