EP2022263A4 - Object-based 3-dimensional audio service system using preset audio scenes - Google Patents

Object-based 3-dimensional audio service system using preset audio scenes

Info

Publication number
EP2022263A4
EP2022263A4 EP07746543A EP07746543A EP2022263A4 EP 2022263 A4 EP2022263 A4 EP 2022263A4 EP 07746543 A EP07746543 A EP 07746543A EP 07746543 A EP07746543 A EP 07746543A EP 2022263 A4 EP2022263 A4 EP 2022263A4
Authority
EP
European Patent Office
Prior art keywords
service system
audio
scenes
dimensional
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP07746543A
Other languages
German (de)
French (fr)
Other versions
EP2022263A1 (en
EP2022263B1 (en
Inventor
Yong-Ju Lee
Tae-Jin Lee
Jae-Hyoun Yoo
Kyeong-Ok Kang
Jin-Woo Hong
In-Seon Jang
Jeong-Il Seo
Dae-Young Jang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Original Assignee
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020060045184A external-priority patent/KR100802179B1/en
Application filed by Electronics and Telecommunications Research Institute ETRI filed Critical Electronics and Telecommunications Research Institute ETRI
Priority to EP12171933.0A priority Critical patent/EP2501128B1/en
Priority to EP11159156.6A priority patent/EP2369836B1/en
Publication of EP2022263A1 publication Critical patent/EP2022263A1/en
Publication of EP2022263A4 publication Critical patent/EP2022263A4/en
Application granted granted Critical
Publication of EP2022263B1 publication Critical patent/EP2022263B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/86—Arrangements characterised by the broadcast information itself
    • H04H20/88—Stereophonic broadcast systems
    • H04H20/89—Stereophonic broadcast systems using three or more audio channels, e.g. triphonic or quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Stereophonic System (AREA)
  • Stereo-Broadcasting Methods (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
EP07746543A 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes Active EP2022263B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP12171933.0A EP2501128B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes
EP11159156.6A EP2369836B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020060045184A KR100802179B1 (en) 2005-12-08 2006-05-19 Object-based 3-dimensional audio service system using preset audio scenes and its method
PCT/KR2007/002395 WO2007136187A1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes

Related Child Applications (4)

Application Number Title Priority Date Filing Date
EP12171933.0A Division EP2501128B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes
EP11159156.6A Division EP2369836B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes
EP11159156.6 Division-Into 2011-03-22
EP12171933.0 Division-Into 2012-06-14

Publications (3)

Publication Number Publication Date
EP2022263A1 EP2022263A1 (en) 2009-02-11
EP2022263A4 true EP2022263A4 (en) 2010-06-02
EP2022263B1 EP2022263B1 (en) 2012-08-01

Family

ID=40210572

Family Applications (3)

Application Number Title Priority Date Filing Date
EP07746543A Active EP2022263B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes
EP11159156.6A Active EP2369836B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes
EP12171933.0A Active EP2501128B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP11159156.6A Active EP2369836B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes
EP12171933.0A Active EP2501128B1 (en) 2006-05-19 2007-05-16 Object-based 3-dimensional audio service system using preset audio scenes

Country Status (3)

Country Link
EP (3) EP2022263B1 (en)
JP (2) JP5586950B2 (en)
WO (1) WO2007136187A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009093867A2 (en) 2008-01-23 2009-07-30 Lg Electronics Inc. A method and an apparatus for processing audio signal
WO2009093866A2 (en) 2008-01-23 2009-07-30 Lg Electronics Inc. A method and an apparatus for processing an audio signal
KR100998913B1 (en) * 2008-01-23 2010-12-08 엘지전자 주식회사 A method and an apparatus for processing an audio signal
EP2094032A1 (en) * 2008-02-19 2009-08-26 Deutsche Thomson OHG Audio signal, method and apparatus for encoding or transmitting the same and method and apparatus for processing the same
EP2111060B1 (en) * 2008-04-16 2014-12-03 LG Electronics Inc. A method and an apparatus for processing an audio signal
CN102007533B (en) * 2008-04-16 2012-12-12 Lg电子株式会社 A method and an apparatus for processing an audio signal
KR102149019B1 (en) * 2008-04-23 2020-08-28 한국전자통신연구원 Method for generating and playing object-based audio contents and computer readable recordoing medium for recoding data having file format structure for object-based audio service
KR101596504B1 (en) * 2008-04-23 2016-02-23 한국전자통신연구원 / method for generating and playing object-based audio contents and computer readable recordoing medium for recoding data having file format structure for object-based audio service
EP2149878A3 (en) * 2008-07-29 2014-06-11 LG Electronics Inc. A method and an apparatus for processing an audio signal
ES2793958T3 (en) 2009-08-14 2020-11-17 Dts Llc System to adaptively transmit audio objects
CN103460285B (en) 2010-12-03 2018-01-12 弗劳恩霍夫应用研究促进协会 Device and method for the spatial audio coding based on geometry
WO2012122397A1 (en) 2011-03-09 2012-09-13 Srs Labs, Inc. System for dynamically creating and rendering audio objects
JP5798247B2 (en) * 2011-07-01 2015-10-21 ドルビー ラボラトリーズ ライセンシング コーポレイション Systems and tools for improved 3D audio creation and presentation
EP2600343A1 (en) 2011-12-02 2013-06-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for merging geometry - based spatial audio coding streams
WO2013181272A2 (en) 2012-05-31 2013-12-05 Dts Llc Object-based audio system using vector base amplitude panning
WO2014165806A1 (en) 2013-04-05 2014-10-09 Dts Llc Layered audio coding and transmission
WO2016052191A1 (en) * 2014-09-30 2016-04-07 ソニー株式会社 Transmitting device, transmission method, receiving device, and receiving method
WO2016171002A1 (en) * 2015-04-24 2016-10-27 ソニー株式会社 Transmission device, transmission method, reception device, and reception method

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5590207A (en) * 1993-12-14 1996-12-31 Taylor Group Of Companies, Inc. Sound reproducing array processor system
JP3593883B2 (en) 1998-05-15 2004-11-24 株式会社日立製作所 Video stream transmission / reception system
JP2000358294A (en) * 1999-06-15 2000-12-26 Yamaha Corp Audio device
JP2002236499A (en) * 2000-12-06 2002-08-23 Matsushita Electric Ind Co Ltd Music signal compressor, music signal compander and music signal preprocessing controller
CN1830026B (en) * 2001-01-30 2011-06-15 汤姆森特许公司 Geometric source preparation signal processing technique
JP2003299044A (en) * 2002-03-29 2003-10-17 Mitsubishi Electric Corp Multimedia information transmitter-receiver, multimedia information transmitter-receiver system and service charging server
US8437868B2 (en) * 2002-10-14 2013-05-07 Thomson Licensing Method for coding and decoding the wideness of a sound source in an audio scene
KR100542129B1 (en) * 2002-10-28 2006-01-11 한국전자통신연구원 Object-based three dimensional audio system and control method
US9002716B2 (en) * 2002-12-02 2015-04-07 Thomson Licensing Method for describing the composition of audio signals
JP2005293623A (en) * 2004-03-31 2005-10-20 Clarion Co Ltd Onboard acoustic apparatus, onboard acoustic system, and music data recording program

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
"Information technology â Coding of audio-visual objects â Part 20 : LASeR (Lightweight Applications Scene Representation)", 3GPP DRAFT; 29N66983, 3RD GENERATION PARTNERSHIP PROJECT (3GPP), MOBILE COMPETENCE CENTRE ; 650, ROUTE DES LUCIOLES ; F-06921 SOPHIA-ANTIPOLIS CEDEX ; FRANCE, vol. SA WG4, no. San Diego, USA; 20050429, 29 April 2005 (2005-04-29), XP050287655 *
AVARO O ET AL: "The MPEG-4 systems and description languages: A way ahead in audio visual information representation", SIGNAL PROCESSING. IMAGE COMMUNICATION, ELSEVIER SCIENCE PUBLISHERS, AMSTERDAM, NL LNKD- DOI:10.1016/S0923-5965(97)00027-1, vol. 9, no. 4, 1 May 1997 (1997-05-01), pages 385 - 431, XP004075337, ISSN: 0923-5965 *
KALVA H ET AL: "DELIVERING OBJECT-BASED AUDIO-VISUAL SERVICES", IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, IEEE SERVICE CENTER, NEW YORK, NY, US LNKD- DOI:10.1109/30.809189, vol. 45, no. 4, 1 November 1999 (1999-11-01), pages 1108 - 1111, XP000928095, ISSN: 0098-3063 *
See also references of WO2007136187A1 *
TAEJIN LEE, GI YOON PARK, INSEON JANG, KYEONGOK KANG: "An Object-based 3D Audio Broadcasting System for Interactive Service.", CONVENTION PAPER 6384 118TH CONVENTION AUDIO ENGINEERING SOCIETY, 31 May 2005 (2005-05-31), XP002577516, Retrieved from the Internet <URL:http://www.aes.org/tmpFiles/elib/20100413/13100.pdf> [retrieved on 20100412] *

Also Published As

Publication number Publication date
EP2022263A1 (en) 2009-02-11
JP2009537876A (en) 2009-10-29
EP2369836A2 (en) 2011-09-28
EP2501128B1 (en) 2014-11-12
EP2501128A1 (en) 2012-09-19
JP2014013400A (en) 2014-01-23
EP2022263B1 (en) 2012-08-01
JP5586950B2 (en) 2014-09-10
WO2007136187A1 (en) 2007-11-29
EP2369836A3 (en) 2011-12-14
WO2007136187A9 (en) 2008-11-27
EP2369836B1 (en) 2014-04-23

Similar Documents

Publication Publication Date Title
EP2022263A4 (en) Object-based 3-dimensional audio service system using preset audio scenes
GB2431813B (en) Audio system
GB2439424B (en) Video distribution system
HK1117324A1 (en) Conference audio system
EP2178287A4 (en) Audio conference system
EP2043390A4 (en) Loudspeaker system
TWI340342B (en) Interactive multimedia system
EP2003924A4 (en) Speaker system
EP2165531A4 (en) An audio animation system
EP2096880A4 (en) Speaker system
EP2076176A4 (en) Stereoscopic x-ray system and method
SG134224A1 (en) Vacuum sewer system
GB0709411D0 (en) Methods and systems for stereoscopic imaging
SG123647A1 (en) Vehicle stereo system
EP2022675A4 (en) Audio playback system
GB2421140B (en) Stereo speaker system
EP2046036A4 (en) Broadcast viewing system
GB0601522D0 (en) An Interactive Voice System
HK1102179A1 (en) Naming service method
EP2041903A4 (en) Service system
GB0600696D0 (en) Vacuum system
GB2425675B (en) Audio system
GB2430855B (en) 3-Dimensional cad system
HK1108244A1 (en) An audio data rerouting system
GB0518291D0 (en) Stereo viewer

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20081124

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

A4 Supplementary search report drawn up and despatched

Effective date: 20100506

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20110819

RIC1 Information provided on ipc code assigned before grant

Ipc: H04S 7/00 20060101ALI20111220BHEP

Ipc: H04N 7/00 20110101AFI20111220BHEP

Ipc: H04H 20/89 20080101ALI20111220BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 569183

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120815

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602007024352

Country of ref document: DE

Effective date: 20120927

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120801

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 569183

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120801

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121201

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121102

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121203

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121112

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121101

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602007024352

Country of ref document: DE

Effective date: 20130503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130531

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130516

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120801

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130516

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20070516

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230625

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231206

Year of fee payment: 18

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240422

Year of fee payment: 18

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231205

Year of fee payment: 18