EP3007461B1 - Mikrofonanordnung - Google Patents

Mikrofonanordnung Download PDF

Info

Publication number
EP3007461B1
EP3007461B1 EP14188463.5A EP14188463A EP3007461B1 EP 3007461 B1 EP3007461 B1 EP 3007461B1 EP 14188463 A EP14188463 A EP 14188463A EP 3007461 B1 EP3007461 B1 EP 3007461B1
Authority
EP
European Patent Office
Prior art keywords
microphone
sound
microphones
differential
indentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP14188463.5A
Other languages
English (en)
French (fr)
Other versions
EP3007461A1 (de
Inventor
Markus Christoph
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harman Becker Automotive Systems GmbH
Original Assignee
Harman Becker Automotive Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harman Becker Automotive Systems GmbH filed Critical Harman Becker Automotive Systems GmbH
Priority to EP14188463.5A priority Critical patent/EP3007461B1/de
Priority to EP19157791.5A priority patent/EP3506650B1/de
Publication of EP3007461A1 publication Critical patent/EP3007461A1/de
Application granted granted Critical
Publication of EP3007461B1 publication Critical patent/EP3007461B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/027—Spatial or constructional arrangements of microphones, e.g. in dummy heads
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/34—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by using a single transducer with sound reflecting, diffracting, directing or guiding means
    • H04R1/38—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by using a single transducer with sound reflecting, diffracting, directing or guiding means in which sound waves act upon both sides of a diaphragm and incorporating acoustic phase-shifting means, e.g. pressure-gradient microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones

Definitions

  • the disclosure relates to a microphone array, in particular to a spherical microphone array for use in a modal beamforming system.
  • a microphone-array-based modal beamforming system commonly comprises a spherical microphone array of a multiplicity of microphones equally distributed over the surface of a solid or virtual sphere to convert sounds into electrical audio signals and a modal beamformer that combines the audio signals generated by the microphones to form an auditory scene representative of at least a portion of an acoustic sound field.
  • This combination enables the reception of acoustic signals dependent on their direction of propagation.
  • microphone arrays are also sometimes referred to as spatial filters.
  • Spherical microphone arrays exhibit low- and high-frequency limitations so that the sound field can only be accurately described over a limited frequency range.
  • Low-frequency limitations essentially result when the directivity of the particular microphones of the array is poor compared to the wavelength and the high amplification necessary in this frequency range; this leads to high amplification of (self) noise and thus to the need to limit the usable frequency range up to a maximum lower frequency.
  • High-frequency issues can be explained by spatial aliasing effects. Similar to temporal aliasing, spatial aliasing occurs when a spatial function (e.g., the spherical harmonics) is under-sampled. For example, at least 16 microphones are needed to distinguish 16 harmonics. In addition, the positions and, depending on the type of sphere used, the directivity of the microphones are important.
  • a spatial aliasing frequency characterizes the upper critical frequency of the frequency range in which the spherical microphone array can be employed without generating any significant artifacts.
  • EP 1 737 268 A1 discloses the use of directional microphones which are not-flush mounted in a rigid structure.
  • a sound field microphone comprising at least four individual pressure-gradient microphones, called capsules, whose back sides are arranged in space on tangential surfaces of an imaginary sphere with the largest possible symmetry, i.e. on the surfaces of a virtual essentially regular polyhedron.
  • a solid body is arranged, whose volume is greater than 1% of the volume of virtual polyhedron.
  • EP 0 869 697 A2 discloses flush mounting of omnidirectional microphones in a rigid structure.
  • the document discloses a first-order differential microphone array with a fully steerable and variable responsive pattern that comprises 6 small pressure-sensitive omnidirectional microphones flush-mounted on the surface of a 3/4" diameter rigid nylon sphere.
  • the microphones are advantageously located on the surface at points where included octahedron vertices contact the spherical surface.
  • a general first-order differential microphone beam (or a plurality of beams) is realized which can be directed to any angle (or angles) in three-dimensional space.
  • EP 0 664 071 B1 discloses a hearing aid apparatus that employs both an omnidirectional microphone and at least one directional microphone of at least the first order.
  • a switching circuit accepts the signals output from both the omnidirectional microphone and the directional microphone. The switching circuit connects the signal from the omnidirectional microphone to an input of a hearing aid amplifier when the switching circuit is in a first switching state, and connects the output of the equalization circuit to the hearing aid amplifier input when the switching circuit is in a second switching state.
  • EP 2 262 277 A1 discloses an arrangement with multiple pressure gradient transducers in a common housing.
  • the document discloses a microphone arrangement, comprising at least two pressure gradient transducers, having a first sound inlet opening, which leads to the front, and a second sound inlet opening that leads to the back.
  • the directional characteristic of each transducer comprises an omni portion and a figure-of-eight portion and has a direction of maximum sensitivity, the main direction.
  • a boundary is provided, at which the pressure gradient transducers are arranged, that the main directions of the transducers are inclined relative to each other, and that the acoustic centers of the transducers lie within an sphere whose radius corresponds to the double of the largest dimension of the diaphragms of said transducers.
  • EP 2 773 131 A1 discloses disposing a single omnidirectional microphone at the end of a cavity in a sound diffracting structure.
  • a spherical microphone array with improved frequency range for use in a modal beamformer system that comprises a sound-diffracting structure, e.g. a rigid sphere with cavities in the perimeter of the diffracting structure and a microphone located in or at the ends of said cavities respectively, where the cavities are shaped to form both a spatial low-pass filter, e.g. exhibiting a wide opening, and a concave focusing element so that sound entering the cavities in a direction perpendicular to the perimeter of the diffracting structure converges to the microphones, e.g. by providing a parabolic surface, in order to minimize spatial aliasing.
  • a microphone array may include a sound-diffracting structure that has a closed three-dimensional shape with an indentation in a perimeter of the sound-diffracting structure and with a surface surrounding the shape and a differential microphone that comprises two omnidirectional microphones and a beamforming circuit.
  • the sound-diffracting structure is a rigid sphere.
  • the two omnidirectional microphones are mounted flush on the surface of the sound-diffracting structure, and the two omnidirectional microphones and the beamforming circuit are configured to provide a differential microphone output signal.
  • FIG. 1 A schematic illustration of a six-element 3D microphone array 100 mounted in rigid sphere 101, which forms a sound-diffracting structure, is shown in Figure 1 . Note that only three of the six microphone elements can be seen in the figure (i.e., microphones 102, 103 and 104), with the remaining three microphone elements being hidden on the back side of sphere 100. All six microphone elements are mounted flush on the surface of sphere 100 at points where an inscribed regular octahedron's vertices would contact the spherical surface.
  • the individual microphone elements are differential microphone elements such as those shown in and described below in connection with Figures 8-12 . In other exemplary microphone arrays, other conventional differential microphone elements may be used.
  • FIG. 2 shows a perspective view of a 3D microphone array 200 that has the polyhedral shape of a 60-sided pentakis dodecahedron.
  • microphone array 200 of Figure 2 has a plurality of individual flush-mounted microphone elements, analogous to elements 102, 103 and 104 of Figure 1 , distributed around and integrated into different rigid triangular sections 201 of sphere 200, where zero, one or more microphone elements are mounted flush onto the surface of each different triangular section 201.
  • the microphone elements may be distributed uniformly or non-uniformly around the polyhedron, with each triangular section 201 having the same number of microphone elements or different triangular sections 201having different numbers of microphone elements, including some triangular sections 201 that have no microphone elements.
  • Figure 3 illustrates a 3D microphone array 300 that has a spherical sound-diffracting structure 301 with microphones 302 embedded in cavities whose dimensions and shapes are optimized to tailor the directivity pattern.
  • Figure 3 shows a circular conical cavity; however, a sectoral cavity or any other appropriately shaped cavity may alternatively be used to form an indentation of the spherical surface.
  • the truncated conical shape of microphone array 300 is designed to increase directivity on both horizontal and vertical planes, whereas a sectoral cavity provides higher directivity on the horizontal plane.
  • the cavity shape can be tailored and optimized to give the best compromise in terms of vertical and horizontal directivity. Directivity is achieved in sound-diffracting structure 301 of Figure 3 due to a combination of obstacle size and cavity design.
  • a person of ordinary skill in the art will appreciate that there are a large variety of shapes of indentations that can be designed.
  • the microphone elements in the examples presented in Figures 1-3 are mounted flush on the surface of the sound-diffracting structure (e.g., rigid spheres with or without indentations) as shown in Figures 4-6 .
  • Flush-mounted microphone elements are microphone elements that are mounted or integrated into the structure in such a way that there is substantially no protrusion from the surface.
  • Figure 4 shows details of rigid sphere 400, which has no indentations, in which differential microphone element 401 is mounted flush on surface 402 of rigid sphere 400.
  • Figure 5 shows details of rigid sphere 500, which has indentation 503, in which differential microphone element 501 is mounted flush on surface 502 of indentation 503 and thus of rigid sphere 500.
  • Figure 6 shows details of rigid sphere 600, which has indentation 603, in which two differential microphone elements 601 and 604 are mounted flush on surface 602 of indentation 603 and thus of rigid sphere 600.
  • Omnidirectional microphone elements can also be used instead of two differential microphone elements if their omnidirectional behavior is transformed into differential behavior by a corresponding electronic circuit or by software.
  • the indentations may be shaped, for example, as inverse spherical caps or inverse circular paraboloids.
  • differential microphone elements also known as pressure gradient microphones
  • the directivity is independent of spherical elevation angle ⁇ due to an assumption of symmetrical rotation.
  • the magnitude of Equation (1) is the parametric expression of the "limaquaint of Pascal" algebraic curve, familiar to those skilled in the art.
  • Equation (1) The two terms in Equation (1) can be seen to be the sum of an omnidirectional sensor (i.e., the first term) and a first-order dipole sensor (i.e., the second term), which is the general form of the first-order array.
  • a microphone with this type of directivity is typically referred to as a sub-cardioid microphone.
  • the parametric algebraic equation has a specific form, which is referred to as a cardioid.
  • ⁇ null cos ⁇ 1 ⁇ / ⁇ ⁇ 1 .
  • differential microphone element 900 may have directivity in the approximate shape of a cardioid.
  • Differential microphone element 900 may be a tube-like member (e.g., a substantially u-curved tube 901) with two open ends, also herein referred to as sound inlet ports 902 and 903, and omnidirectional microphone 904 disposed in tube 901 between sound inlet ports 902 and 903 of the tube-like member.
  • Sound inlet ports 902 and 903 are spaced at distance d apart and are defined by juxtaposed end sections of tube 901 that communicate with diaphragm 905 of microphone 904.
  • the two sides 905a and 905b of microphone diaphragm 905 receive sound from the two respective inlet ports 902 and 903.
  • the sound pressure driving the rear of the diaphragm travels through a resistive damping material 906, which is designed to provide a time delay (also referred to as acoustic delay).
  • the dissipative, resistive damping material 906 may be designed to create a proper time delay in order for the net pressure to have the desired directivity.
  • Equation (3) Since time delay ⁇ and distance d between ports 12 and 14 are quite small, the argument of the exponential is small and allows Equation (3) to be approximated by: p net ⁇ P j ⁇ t + d c ⁇ cos ⁇ e j ⁇ t .
  • the net pressure on the directional microphone is proportional to ⁇ and thus has a 6 dB per octave slope.
  • the net pressure is also diminished in proportion to distance d between the ports. Reducing the overall size of the sensor thus results in a proportional loss of sensitivity.
  • Differential microphone element 1000 may comprise a substantially u-curved tube 1001, with two sound inlet ports 1002 and 1003, and an omnidirectional microphone 1004 disposed in tube 1001 between sound inlet ports 1002 and 1003 of the tube-like member.
  • Sound inlet ports 1002 and 1003 are spaced at distance d apart, and are defined by juxtaposed end sections of tube 1001 that communicate with diaphragm 1005 of microphone 1004.
  • the two sides 1005a and 1005b of microphone diaphragm 1005 receive sound from the two respective inlet ports 1002 and 1003.
  • the sound pressure driving rear side 1005b of the diaphragm travels a longer way compared to front side 1005a and thus provides a time delay relative to front side 1005a.
  • an electro-acoustic first-order differential microphone element 1100 may include acoustics part 1101 and electronics part 1102. Acoustics part 1101 features two omnidirectional microphones 1103 and 1104 arranged at distance d from each other. Within electronics part 1102, the outputs of omnidirectional microphones 1003 and 1104 are subtracted from each other by differencing amplifier 1105. Before this subtraction, the output of omnidirectional microphone 1104 is passed through delay element 1106 to delay the outputs of the two omnidirectional microphones 1103 and 1104 relative to each other. This element may be, for example, an all-pass filter or time delay circuit. The output of differencing amplifier 1105 is passed through equalizing filter 1107 to compensate for frequency-dependent gain values of the circuit.
  • Figure 12 shows a schematic diagram of another first-order full-band differential microphone element 1200 based on an adaptive back-to-back cardioid system.
  • differential microphone element 1200 signals from two microphones 1201 and 1202 are delayed by time delay T at delay elements 1203 and 1204, respectively.
  • the delayed signal from microphone 1201 is subtracted from the undelayed signal from microphone 1202 at subtraction element 1205 to form a forward-facing cardioid signal.
  • the delayed signal from microphone 1202 is subtracted from the undelayed signal from microphone 1201 at subtraction element 1206 to form a backward-facing cardioid signal.

Landscapes

  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)

Claims (3)

  1. Mikrofonanordnung, umfassend:
    eine schallbeugende Struktur (600), die eine geschlossene dreidimensionale Form mit einer Vertiefung (603) in einem Umkreis der schallbeugenden Struktur (600) aufweist, und mit einer Oberfläche (602) die die Form umgibt, wobei die schallbeugende Struktur (600) eine biegesteife Sphäre ist;
    und
    ein Differentialmikrofon, umfassend zwei omnidirektionale Mikrofone (601, 604) und einen Strahlformungsschaltkreis (1100, 1203-1206); wobei
    die zwei omnidirektionalen Mikrofone (601, 604) auf der Oberfläche (602) in der Vertiefung (603) der schallbeugenden Struktur (600) bündig angebracht sind; und
    die zwei omnidirektionalen Mikrofone (601, 604) und der Strahlformungsschaltkreis (1100, 1203-1206) konfiguriert sind, um ein Differentialmikrofonausgangssignal (1107, 1205, 1206) bereitzustellen.
  2. Mikrofonanordnung nach Anspruch 1, wobei die Vertiefung (603) als eine inverse Kalotte oder ein inverses kreisförmiges Paraboloid geformt ist.
  3. Mikrofonanordnung nach einem der Ansprüche 1 oder 2, wobei Wände der Vertiefung (603) schallreflektierend sind.
EP14188463.5A 2014-10-10 2014-10-10 Mikrofonanordnung Active EP3007461B1 (de)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP14188463.5A EP3007461B1 (de) 2014-10-10 2014-10-10 Mikrofonanordnung
EP19157791.5A EP3506650B1 (de) 2014-10-10 2014-10-10 Mikrophonanordnung

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14188463.5A EP3007461B1 (de) 2014-10-10 2014-10-10 Mikrofonanordnung

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP19157791.5A Division EP3506650B1 (de) 2014-10-10 2014-10-10 Mikrophonanordnung

Publications (2)

Publication Number Publication Date
EP3007461A1 EP3007461A1 (de) 2016-04-13
EP3007461B1 true EP3007461B1 (de) 2019-02-27

Family

ID=51663104

Family Applications (2)

Application Number Title Priority Date Filing Date
EP14188463.5A Active EP3007461B1 (de) 2014-10-10 2014-10-10 Mikrofonanordnung
EP19157791.5A Active EP3506650B1 (de) 2014-10-10 2014-10-10 Mikrophonanordnung

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP19157791.5A Active EP3506650B1 (de) 2014-10-10 2014-10-10 Mikrophonanordnung

Country Status (1)

Country Link
EP (2) EP3007461B1 (de)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7389036B2 (ja) * 2018-08-08 2023-11-29 日本電信電話株式会社 集音装置
WO2020186434A1 (en) * 2019-03-19 2020-09-24 Northwestern Polytechnical University Flexible differential microphone arrays with fractional order

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2262277A1 (de) * 2007-11-13 2010-12-15 AKG Acoustics GmbH Verfahren zum Erzeugen eines Mikrofonsignals

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5524056A (en) * 1993-04-13 1996-06-04 Etymotic Research, Inc. Hearing aid having plural microphones and a microphone switching system
US5878147A (en) * 1996-12-31 1999-03-02 Etymotic Research, Inc. Directional microphone assembly
US6041127A (en) * 1997-04-03 2000-03-21 Lucent Technologies Inc. Steerable and variable first-order differential microphone array
WO2004016041A1 (en) * 2002-08-07 2004-02-19 State University Of Ny Binghamton Differential microphone
GB0315426D0 (en) * 2003-07-01 2003-08-06 Mitel Networks Corp Microphone array with physical beamforming using omnidirectional microphones
ATE545286T1 (de) 2005-06-23 2012-02-15 Akg Acoustics Gmbh Schallfeldmikrophon
EP2773131B1 (de) 2013-02-27 2020-04-01 Harman Becker Automotive Systems GmbH Kugelförmiges Mikrofonarray
US9197962B2 (en) * 2013-03-15 2015-11-24 Mh Acoustics Llc Polyhedral audio system based on at least second-order eigenbeams

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2262277A1 (de) * 2007-11-13 2010-12-15 AKG Acoustics GmbH Verfahren zum Erzeugen eines Mikrofonsignals

Also Published As

Publication number Publication date
EP3506650A1 (de) 2019-07-03
EP3007461A1 (de) 2016-04-13
EP3506650B1 (de) 2020-04-01

Similar Documents

Publication Publication Date Title
EP2773131B1 (de) Kugelförmiges Mikrofonarray
US9936291B2 (en) Spherical microphone array including a sound diffracting structure with cavity
EP0869697B1 (de) Steuerbare und variable Differentialmikrofonsanordnung erster Ordnung
US9445198B2 (en) Polyhedral audio system based on at least second-order eigenbeams
EP3466109B1 (de) Mikrofonanordnungen für verbesserte horizontale richtwirkung
US8472639B2 (en) Microphone arrangement having more than one pressure gradient transducer
EP1466498B1 (de) Audiosystem auf der basis von eigenstrahlen mindestens zweiter ordnung
US7366310B2 (en) Microphone array diffracting structure
US20150055796A1 (en) Acoustic source separation
KR20010100991A (ko) 고 지향성을 가진 마이크로폰 어레이
US20090190775A1 (en) Microphone arrangement comprising pressure gradient transducers
Gálvez et al. Personal audio loudspeaker array as a complementary TV sound system for the hard of hearing
EP3007461B1 (de) Mikrofonanordnung
Huang et al. On the design of robust steerable frequency-invariant beampatterns with concentric circular microphone arrays
EP3001697B1 (de) Tonaufnahmesystem
EP3515091B1 (de) Lautsprecher-hornarray
Lewis Microphone array beamforming
CN108476371A (zh) 声波场生成
EP1432280B1 (de) Verfahren zur Erweiterung des Frequenzbereichs eines Beamformers ohne räumliches Aliasing
Taguchi et al. Investigation on optimal microphone arrangement of spherical microphone array to achieve shape beamforming
Moazzen et al. A nested microphone array for broadband audio signal processing
US11558690B2 (en) Audio systems, devices, and methods
WO2022172401A1 (ja) 設計装置、設計方法、およびプログラム
Gillett Head mounted microphone arrays
WO2020011962A1 (en) A microphone system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20161011

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20171005

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20181012

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1103103

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190315

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014041709

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190227

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190627

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190527

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190527

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190528

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190627

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1103103

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014041709

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20191128

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191010

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20141010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190227

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230920

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230920

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20230920

Year of fee payment: 10