EP3345388A4 - System and method for real-time tone-mapping - Google Patents

System and method for real-time tone-mapping Download PDF

Info

Publication number
EP3345388A4
EP3345388A4 EP16840480.4A EP16840480A EP3345388A4 EP 3345388 A4 EP3345388 A4 EP 3345388A4 EP 16840480 A EP16840480 A EP 16840480A EP 3345388 A4 EP3345388 A4 EP 3345388A4
Authority
EP
European Patent Office
Prior art keywords
mapping
real
time tone
tone
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP16840480.4A
Other languages
German (de)
French (fr)
Other versions
EP3345388A1 (en
EP3345388B1 (en
Inventor
Jonas UNGER
Gabriel EILERTSEN
Rafal Mantiuk
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faurecia Irystec Inc
Original Assignee
Irystec Software Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Irystec Software Inc filed Critical Irystec Software Inc
Priority to EP21196068.7A priority Critical patent/EP3944615A1/en
Publication of EP3345388A1 publication Critical patent/EP3345388A1/en
Publication of EP3345388A4 publication Critical patent/EP3345388A4/en
Application granted granted Critical
Publication of EP3345388B1 publication Critical patent/EP3345388B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G06T5/92—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40—Picture signal circuits
    • H04N1/407—Control or modification of tonal gradation or of extreme levels, e.g. background level
    • H04N1/4072—Control or modification of tonal gradation or of extreme levels, e.g. background level dependent on the contents of the original
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/6027—Correction or control of colour gradation or colour contrast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20208—High dynamic range [HDR] image processing
EP16840480.4A 2015-09-02 2016-09-02 System and method for real-time tone-mapping Active EP3345388B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21196068.7A EP3944615A1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562213290P 2015-09-02 2015-09-02
PCT/CA2016/051043 WO2017035661A1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP21196068.7A Division EP3944615A1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping
EP21196068.7A Division-Into EP3944615A1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping

Publications (3)

Publication Number Publication Date
EP3345388A1 EP3345388A1 (en) 2018-07-11
EP3345388A4 true EP3345388A4 (en) 2019-07-24
EP3345388B1 EP3345388B1 (en) 2021-11-24

Family

ID=58186398

Family Applications (2)

Application Number Title Priority Date Filing Date
EP16840480.4A Active EP3345388B1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping
EP21196068.7A Pending EP3944615A1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP21196068.7A Pending EP3944615A1 (en) 2015-09-02 2016-09-02 System and method for real-time tone-mapping

Country Status (6)

Country Link
US (3) US11107204B2 (en)
EP (2) EP3345388B1 (en)
JP (2) JP7008621B2 (en)
CN (1) CN108702496B (en)
CA (1) CA2997118A1 (en)
WO (1) WO2017035661A1 (en)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9955084B1 (en) * 2013-05-23 2018-04-24 Oliver Markus Haynold HDR video camera
EP3345388B1 (en) * 2015-09-02 2021-11-24 Faurecia Irystec Inc. System and method for real-time tone-mapping
US10755392B2 (en) * 2017-07-13 2020-08-25 Mediatek Inc. High-dynamic-range video tone mapping
CN108550158B (en) * 2018-04-16 2021-12-17 Tcl华星光电技术有限公司 Image edge processing method, electronic device and computer readable storage medium
JP6725733B2 (en) 2018-07-31 2020-07-22 ソニーセミコンダクタソリューションズ株式会社 Solid-state imaging device and electronic device
EP3867860A1 (en) * 2018-10-19 2021-08-25 GoPro, Inc. Tone mapping and tone control integrations for image processing
US11910105B2 (en) * 2019-03-29 2024-02-20 Sony Group Corporation Video processing using a blended tone curve characteristic
CN110223256A (en) * 2019-06-10 2019-09-10 北京大学深圳研究生院 A kind of inverse tone mapping (ITM) method, apparatus and electronic equipment
CN110445986B (en) * 2019-07-30 2021-03-23 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
US11473971B2 (en) * 2019-09-27 2022-10-18 Apple Inc. Ambient headroom adaptation
CN110737440B (en) * 2019-10-22 2023-03-14 吉林工程技术师范学院 Programming method based on DaVinci nostalgic color series digital color correction plug-in
CN110866860B (en) * 2019-11-01 2023-12-26 上海菲戈恩微电子科技有限公司 Image processing method of CIS chip for biological feature recognition
US11790950B2 (en) * 2020-01-14 2023-10-17 Robert Salem Abraham Film-making using style transfer
CN113630563B (en) * 2020-05-08 2022-07-22 华为技术有限公司 Processing method, encoding device and decoding device for high dynamic range HDR video
CN114359058A (en) * 2020-10-13 2022-04-15 影石创新科技股份有限公司 Image toning method based on deep learning and computer readable storage medium
CN112819736B (en) * 2021-01-13 2023-08-29 浙江理工大学 Workpiece character image local detail enhancement fusion method based on multiple exposure
KR20220102450A (en) * 2021-01-13 2022-07-20 삼성전자주식회사 Method for generating image filter effect and electronic device thereof
US11810274B2 (en) * 2021-03-04 2023-11-07 Nvidia Corporation Tone management using tone gain functions for high dynamic range imaging applications
US11606544B2 (en) * 2021-06-08 2023-03-14 Black Sesame Technologies Inc. Neural network based auto-white-balancing
WO2023038307A1 (en) * 2021-09-09 2023-03-16 Samsung Electronics Co., Ltd. Image generation using non-linear scaling and tone-mapping based on cubic spline curves
US20230127327A1 (en) * 2021-10-22 2023-04-27 Samsung Electronics Co., Ltd. System and method for learning tone curves for local image enhancement
WO2022036338A2 (en) * 2021-11-09 2022-02-17 Futurewei Technologies, Inc. System and methods for depth-aware video processing and depth perception enhancement
US11734806B2 (en) 2021-11-24 2023-08-22 Roku, Inc. Dynamic tone mapping
KR20230105042A (en) * 2022-01-03 2023-07-11 엘지전자 주식회사 Display device
CN115018707B (en) * 2022-06-16 2023-07-18 山东工商学院 Image amplification method and device based on bicubic fitting of nine curved surface pieces
CN116109513B (en) * 2023-02-27 2023-08-04 南京林业大学 Image defogging method based on local ambient light projection constant priori

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130121572A1 (en) * 2010-01-27 2013-05-16 Sylvain Paris Methods and Apparatus for Tone Mapping High Dynamic Range Images

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7020352B2 (en) * 2001-05-25 2006-03-28 Seiko Epson Corporation Photo extraction techniques
US8120570B2 (en) * 2004-12-02 2012-02-21 Sharp Laboratories Of America, Inc. Systems and methods for tone curve generation, selection and application
WO2006117919A1 (en) 2005-04-28 2006-11-09 Konica Minolta Holdings, Inc. Image processing method, image processing device and image processing program
US8330768B2 (en) 2007-07-27 2012-12-11 Sharp Laboratories Of America, Inc. Apparatus and method for rendering high dynamic range images for standard dynamic range display
US9177509B2 (en) * 2007-11-30 2015-11-03 Sharp Laboratories Of America, Inc. Methods and systems for backlight modulation with scene-cut detection
TWI352315B (en) * 2008-01-21 2011-11-11 Univ Nat Taiwan Method and system for image enhancement under low
WO2010088465A1 (en) * 2009-02-02 2010-08-05 Gentex Corporation Improved digital image processing and systems incorporating the same
WO2011091079A1 (en) * 2010-01-19 2011-07-28 Pixar Selective diffusion of filtered edges in images
US9230312B2 (en) * 2010-01-27 2016-01-05 Adobe Systems Incorporated Methods and apparatus for performing tone mapping on high dynamic range images
US9692991B2 (en) * 2011-11-04 2017-06-27 Qualcomm Incorporated Multispectral imaging system
US9129445B2 (en) 2012-03-14 2015-09-08 Dolby Laboratories Licensing Corporation Efficient tone-mapping of high-bit-depth video to low-bit-depth display
CN102722868B (en) * 2012-05-23 2014-08-20 西安理工大学 Tone mapping method for high dynamic range image
US8917336B2 (en) * 2012-05-31 2014-12-23 Apple Inc. Image signal processing involving geometric distortion correction
US8965141B2 (en) * 2012-08-17 2015-02-24 Thomson Licensing Image filtering based on structural information
US9412155B2 (en) * 2012-12-31 2016-08-09 Karl Storz Imaging, Inc. Video system with dynamic contrast and detail enhancement
US9275445B2 (en) * 2013-08-26 2016-03-01 Disney Enterprises, Inc. High dynamic range and tone mapping imaging techniques
US8958658B1 (en) 2013-09-10 2015-02-17 Apple Inc. Image tone adjustment using local tone curve computation
US9697593B2 (en) 2014-01-28 2017-07-04 Ittiam Systems (P) Ltd. System and method for tone mapping on high dynamic range images
GB201410635D0 (en) * 2014-06-13 2014-07-30 Univ Bangor Improvements in and relating to the display of images
US9361679B2 (en) * 2014-07-28 2016-06-07 Disney Enterprises, Inc. Temporally coherent local tone mapping of HDR video
US9378543B2 (en) * 2014-07-28 2016-06-28 Disney Enterprises, Inc. Temporally coherent local tone mapping of high dynamic range video
CN104408752B (en) * 2014-12-11 2017-07-04 西安电子科技大学 A kind of high dynamic range images compression method based on mixed shades mapping algorithm
US9742963B2 (en) * 2015-05-08 2017-08-22 Adobe Systems Incorporated Color rendering on a hue plane
EP3345388B1 (en) * 2015-09-02 2021-11-24 Faurecia Irystec Inc. System and method for real-time tone-mapping
US9857953B2 (en) * 2015-11-17 2018-01-02 Adobe Systems Incorporated Image color and tone style transfer
US10547871B2 (en) * 2017-05-05 2020-01-28 Disney Enterprises, Inc. Edge-aware spatio-temporal filtering and optical flow estimation in real time
US11276369B2 (en) * 2017-09-08 2022-03-15 Apple Inc. Electronic display burn-in detection and mitigation
US10692191B2 (en) * 2018-08-10 2020-06-23 Apple Inc. Per-pixel photometric contrast enhancement with noise control

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130121572A1 (en) * 2010-01-27 2013-05-16 Sylvain Paris Methods and Apparatus for Tone Mapping High Dynamic Range Images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
RAFAŁ MANTIUK ET AL: "Display adaptive tone mapping", ACM TRANSACTIONS ON GRAPHICS (TOG), vol. 27, no. 3, 1 August 2008 (2008-08-01), US, pages 68.1 - 68.10, XP055365416, ISSN: 0730-0301, DOI: 10.1145/1360612.1360667 *

Also Published As

Publication number Publication date
US11756174B2 (en) 2023-09-12
JP7008621B2 (en) 2022-01-25
US20210272251A1 (en) 2021-09-02
JP2021077420A (en) 2021-05-20
CA2997118A1 (en) 2017-03-09
US20230419463A1 (en) 2023-12-28
WO2017035661A1 (en) 2017-03-09
US20200286213A1 (en) 2020-09-10
EP3944615A1 (en) 2022-01-26
CN108702496A (en) 2018-10-23
EP3345388A1 (en) 2018-07-11
JP7152540B2 (en) 2022-10-12
CN108702496B (en) 2021-09-14
EP3345388B1 (en) 2021-11-24
JP2018531447A (en) 2018-10-25
US11107204B2 (en) 2021-08-31

Similar Documents

Publication Publication Date Title
EP3345388A4 (en) System and method for real-time tone-mapping
EP3443376A4 (en) System and method for establishing real-time location
EP3358430A4 (en) Management system and management method
EP3365800A4 (en) Automated patient chart review system and method
EP3257266A4 (en) System and method for improving hearing
EP3470880A4 (en) Ranging system and ranging method
EP3167568A4 (en) System and method for secure real-time cloud services
EP3260813A4 (en) Ranging system and ranging method
EP3328273A4 (en) Method and system for monitoring and improving attention
EP3542289A4 (en) Systems and methods for real-time imaging
EP3323096A4 (en) System and method for facilitating refunds
EP3550499A4 (en) Prediction system and prediction method
EP3273648A4 (en) System and method
EP3422939A4 (en) Method and system for imaging
EP3311524A4 (en) System and method for coverage enhancement
EP3347877A4 (en) Modelling method and system
EP3105965A4 (en) System and method for connection rehoming
SG10201509171SA (en) System and method for facilitating loans
EP3596424A4 (en) Ptychography based system and method
EP3395461A4 (en) Straightening system and straightening method
EP3327402A4 (en) Inspection system and inspection method
EP3464673A4 (en) Shadow-mask-deposition system and method therefor
EP3437079A4 (en) Method and system for monitoring
EP3125280A4 (en) Die mounting system and die mounting method
EP3347829A4 (en) Method and system for providing organized content

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180329

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 9/64 20060101AFI20190311BHEP

A4 Supplementary search report drawn up and despatched

Effective date: 20190625

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 9/64 20060101AFI20190618BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210614

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: FAURECIA IRYSTEC INC.

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016066648

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1450777

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20211124

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1450777

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220224

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220324

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220324

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220224

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220225

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016066648

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

26N No opposition filed

Effective date: 20220825

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220902

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211124

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230523

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220902

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220930

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220902

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220902

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20230822

Year of fee payment: 8

Ref country code: FR

Payment date: 20230822

Year of fee payment: 8

Ref country code: DE

Payment date: 20230822

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20160902