EP3466110A4 - Procédé, appareil, et média lisible par ordinateur destinés à se focaliser sur des signaux audios dans un espace 3d partagé - Google Patents

Procédé, appareil, et média lisible par ordinateur destinés à se focaliser sur des signaux audios dans un espace 3d partagé Download PDF

Info

Publication number
EP3466110A4
EP3466110A4 EP17805437.5A EP17805437A EP3466110A4 EP 3466110 A4 EP3466110 A4 EP 3466110A4 EP 17805437 A EP17805437 A EP 17805437A EP 3466110 A4 EP3466110 A4 EP 3466110A4
Authority
EP
European Patent Office
Prior art keywords
shared
computer
space
readable media
sound signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP17805437.5A
Other languages
German (de)
English (en)
Other versions
EP3466110A1 (fr
EP3466110B1 (fr
Inventor
Grant Howard Mcgibney
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nureva Inc
Original Assignee
Nureva Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nureva Inc filed Critical Nureva Inc
Priority to EP21204322.8A priority Critical patent/EP3968656A1/fr
Publication of EP3466110A1 publication Critical patent/EP3466110A1/fr
Publication of EP3466110A4 publication Critical patent/EP3466110A4/fr
Application granted granted Critical
Publication of EP3466110B1 publication Critical patent/EP3466110B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00—Monitoring arrangements; Testing arrangements
    • H04R29/004—Monitoring arrangements; Testing arrangements for microphones
    • H04R29/005—Microphone arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00—Monitoring arrangements; Testing arrangements
    • H04R29/004—Monitoring arrangements; Testing arrangements for microphones
    • H04R29/005—Microphone arrays
    • H04R29/006—Microphone matching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction

Landscapes

  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
EP17805437.5A 2016-05-31 2017-05-26 Procédé, appareil, et média lisible par ordinateur destinés à se focaliser sur des signaux audios dans un espace 3d partagé Active EP3466110B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21204322.8A EP3968656A1 (fr) 2016-05-31 2017-05-26 Procédé, appareil et support lisible par ordinateur de focalisation de signaux sonores dans un espace 3d partagé

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662343512P 2016-05-31 2016-05-31
PCT/CA2017/050642 WO2017205966A1 (fr) 2016-05-31 2017-05-26 Procédé, appareil, et média lisible par ordinateur destinés à se focaliser sur des signaux audios dans un espace 3d partagé

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP21204322.8A Division-Into EP3968656A1 (fr) 2016-05-31 2017-05-26 Procédé, appareil et support lisible par ordinateur de focalisation de signaux sonores dans un espace 3d partagé
EP21204322.8A Division EP3968656A1 (fr) 2016-05-31 2017-05-26 Procédé, appareil et support lisible par ordinateur de focalisation de signaux sonores dans un espace 3d partagé

Publications (3)

Publication Number Publication Date
EP3466110A1 EP3466110A1 (fr) 2019-04-10
EP3466110A4 true EP3466110A4 (fr) 2019-06-05
EP3466110B1 EP3466110B1 (fr) 2021-12-15

Family

ID=60418993

Family Applications (2)

Application Number Title Priority Date Filing Date
EP21204322.8A Pending EP3968656A1 (fr) 2016-05-31 2017-05-26 Procédé, appareil et support lisible par ordinateur de focalisation de signaux sonores dans un espace 3d partagé
EP17805437.5A Active EP3466110B1 (fr) 2016-05-31 2017-05-26 Procédé, appareil, et média lisible par ordinateur destinés à se focaliser sur des signaux audios dans un espace 3d partagé

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP21204322.8A Pending EP3968656A1 (fr) 2016-05-31 2017-05-26 Procédé, appareil et support lisible par ordinateur de focalisation de signaux sonores dans un espace 3d partagé

Country Status (4)

Country Link
US (4) US10063987B2 (fr)
EP (2) EP3968656A1 (fr)
ES (1) ES2903553T3 (fr)
WO (1) WO2017205966A1 (fr)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10063987B2 (en) 2016-05-31 2018-08-28 Nureva Inc. Method, apparatus, and computer-readable media for focussing sound signals in a shared 3D space
JP6788272B2 (ja) * 2017-02-21 2020-11-25 オンフューチャー株式会社 音源の検出方法及びその検出装置
US10334360B2 (en) * 2017-06-12 2019-06-25 Revolabs, Inc Method for accurately calculating the direction of arrival of sound at a microphone array
GB2565097B (en) * 2017-08-01 2022-02-23 Xmos Ltd Processing echoes received at a directional microphone unit
WO2019222856A1 (fr) 2018-05-24 2019-11-28 Nureva Inc. Procédé, appareil et supports lisibles par ordinateur pour gérer des sources sonores semi-constantes (persistantes) dans des zones de capture/foyer de microphones
US11483646B1 (en) * 2018-06-01 2022-10-25 Amazon Technologies, Inc. Beamforming using filter coefficients corresponding to virtual microphones
EP3870991A4 (fr) 2018-10-24 2022-08-17 Otto Engineering Inc. Système de communication audio à sensibilité directionnelle
US11190871B2 (en) 2019-01-29 2021-11-30 Nureva, Inc. Method, apparatus and computer-readable media to create audio focus regions dissociated from the microphone system for the purpose of optimizing audio processing at precise spatial locations in a 3D space
CN110392334B (zh) * 2019-07-03 2021-06-08 北京小米移动软件有限公司 一种麦克风阵列音频信号自适应处理方法、装置及介质
US11341952B2 (en) 2019-08-06 2022-05-24 Insoundz, Ltd. System and method for generating audio featuring spatial representations of sound sources
US20220360895A1 (en) * 2021-05-10 2022-11-10 Nureva, Inc. System and method utilizing discrete microphones and virtual microphones to simultaneously provide in-room amplification and remote communication during a collaboration session

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3154468B2 (ja) * 1996-03-19 2001-04-09 日本電信電話株式会社 受音方法及びその装置
US20140098964A1 (en) * 2012-10-04 2014-04-10 Siemens Corporation Method and Apparatus for Acoustic Area Monitoring by Exploiting Ultra Large Scale Arrays of Microphones

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4536887A (en) 1982-10-18 1985-08-20 Nippon Telegraph & Telephone Public Corporation Microphone-array apparatus and method for extracting desired signal
DE4316196C2 (de) 1993-05-14 1994-07-28 Guenter Dr Vos Verfahren und Vorrichtung zur Gasanalyse
US5778082A (en) 1996-06-14 1998-07-07 Picturetel Corporation Method and apparatus for localization of an acoustic source
US6593956B1 (en) 1998-05-15 2003-07-15 Polycom, Inc. Locating an audio source
US6469732B1 (en) 1998-11-06 2002-10-22 Vtel Corporation Acoustic source location using a microphone array
AUPR647501A0 (en) 2001-07-19 2001-08-09 Vast Audio Pty Ltd Recording a three dimensional auditory scene and reproducing it for the individual listener
US6912178B2 (en) 2002-04-15 2005-06-28 Polycom, Inc. System and method for computing a location of an acoustic source
US6999593B2 (en) 2003-05-28 2006-02-14 Microsoft Corporation System and process for robust sound source localization
US20050280701A1 (en) * 2004-06-14 2005-12-22 Wardell Patrick J Method and system for associating positional audio to positional video
WO2007052726A1 (fr) * 2005-11-02 2007-05-10 Yamaha Corporation Dispositif pour teleconference
KR101524463B1 (ko) 2007-12-04 2015-06-01 삼성전자주식회사 어레이 스피커를 통해 음향을 포커싱하는 방법 및 장치
GB0906269D0 (en) 2009-04-09 2009-05-20 Ntnu Technology Transfer As Optimal modal beamformer for sensor arrays
EP2600637A1 (fr) 2011-12-02 2013-06-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Appareil et procédé pour le positionnement de microphone en fonction de la densité spatiale de puissance
DE102013201043B4 (de) 2012-08-17 2016-03-17 Sivantos Pte. Ltd. Verfahren und Vorrichtung zum Bestimmen eines Verstärkungsfaktors eines Hörhilfegeräts
US9615172B2 (en) * 2012-10-04 2017-04-04 Siemens Aktiengesellschaft Broadband sensor location selection using convex optimization in very large scale arrays
US9648439B2 (en) * 2013-03-12 2017-05-09 Dolby Laboratories Licensing Corporation Method of rendering one or more captured audio soundfields to a listener
US9560451B2 (en) 2014-02-10 2017-01-31 Bose Corporation Conversation assistance system
US10063987B2 (en) * 2016-05-31 2018-08-28 Nureva Inc. Method, apparatus, and computer-readable media for focussing sound signals in a shared 3D space
US10045120B2 (en) * 2016-06-20 2018-08-07 Gopro, Inc. Associating audio with three-dimensional objects in videos
ITUA20164622A1 (it) * 2016-06-23 2017-12-23 St Microelectronics Srl Procedimento di beamforming basato su matrici di microfoni e relativo apparato
US10972835B2 (en) * 2018-11-01 2021-04-06 Sennheiser Electronic Gmbh & Co. Kg Conference system with a microphone array system and a method of speech acquisition in a conference system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3154468B2 (ja) * 1996-03-19 2001-04-09 日本電信電話株式会社 受音方法及びその装置
US20140098964A1 (en) * 2012-10-04 2014-04-10 Siemens Corporation Method and Apparatus for Acoustic Area Monitoring by Exploiting Ultra Large Scale Arrays of Microphones

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2017205966A1 *

Also Published As

Publication number Publication date
US20180367938A1 (en) 2018-12-20
US20200154228A1 (en) 2020-05-14
ES2903553T3 (es) 2022-04-04
US10397726B2 (en) 2019-08-27
EP3466110A1 (fr) 2019-04-10
US20210195359A1 (en) 2021-06-24
US10848896B2 (en) 2020-11-24
WO2017205966A1 (fr) 2017-12-07
US10063987B2 (en) 2018-08-28
US11197116B2 (en) 2021-12-07
US20170347217A1 (en) 2017-11-30
EP3466110B1 (fr) 2021-12-15
EP3968656A1 (fr) 2022-03-16

Similar Documents

Publication Publication Date Title
EP3466110A4 (fr) Procédé, appareil, et média lisible par ordinateur destinés à se focaliser sur des signaux audios dans un espace 3d partagé
EP3555231A4 (fr) Procédé et appareil de production de biocarburant
EP3422955A4 (fr) Système et procédé de balayage 3d assisté
EP3506238A4 (fr) Procédé de traitement d'informations tridimensionnelles et appareil de traitement d'informations tridimensionnelles
EP3515690A4 (fr) Procédé et appareil pour impression 3d
EP3558498A4 (fr) Appareil et procédé de photo-électrodialyse tridimensionnelle
EP3319800A4 (fr) Procédé et appareil d'impression tridimensionnelle
EP3350659A4 (fr) Système, appareil et procédé de génération de son
EP3079379A4 (fr) Procédé et appareil de reproduction d'un contenu audio tridimensionnel
EP3125240A4 (fr) Procédé et appareil de rendu de signal acoustique, et support d'enregistrement lisible par ordinateur
EP3110150A4 (fr) Procédé et appareil de traitement de signaux de diffusion 3d
EP3577416A4 (fr) Système et procédé de balayage 3d
EP3175445B8 (fr) Appareil et procédé permettant d'améliorer un signal audio et système d'amélioration sonore
EP3406442A4 (fr) Stratifié et son procédé de production
EP3131313A4 (fr) Procédé et appareil permettant de représenter un signal sonore, et support d'enregistrement lisible par ordinateur
EP3535109A4 (fr) Procédé et appareil d'impression 3d
EP3403717A4 (fr) Appareil de production de liquide d'alimentation et procédé de production de liquide d'alimentation
EP3110177A4 (fr) Procédé et appareil pour restituer un signal acoustique, et support lisible par ordinateur
EP3133833A4 (fr) Appareil, procédé et programme de reproduction de champ sonore
EP3327677B8 (fr) Appareil pour audio spatiale et procédé associé
EP3505038A4 (fr) Feuille désintégrable dans l'eau et procédé de production de feuille pouvant se désintégrer dans l'eau
EP3310943A4 (fr) Appareil et procédé permettant de former des objets en 3d
EP3313662A4 (fr) Procédé et appareil d'impression 3d
EP3146594A4 (fr) Système et procédé d'orientation de faisceau à mode de phase 2d simple activé
EP3225039B8 (fr) Système et procédé pour produire un audio tridimensionnel (3d) externalisé sur la tête par l'intermédiaire de casques d'écoute

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20181221

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20190507

RIC1 Information provided on ipc code assigned before grant

Ipc: H04R 3/00 20060101ALI20190429BHEP

Ipc: H04R 29/00 20060101ALI20190429BHEP

Ipc: H04R 1/40 20060101AFI20190429BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200217

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40004670

Country of ref document: HK

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: NUREVA INC.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210407

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

INTC Intention to grant announced (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210701

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602017051031

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1456381

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220115

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2903553

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20220404

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220315

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1456381

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211215

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220315

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220418

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602017051031

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220415

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

26N No opposition filed

Effective date: 20220916

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220526

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220531

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230506

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230412

Year of fee payment: 7

Ref country code: FR

Payment date: 20230411

Year of fee payment: 7

Ref country code: ES

Payment date: 20230605

Year of fee payment: 7

Ref country code: DE

Payment date: 20230331

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230406

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20170526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IE

Payment date: 20240312

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211215

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20240415

Year of fee payment: 8