EP3178184A2 - Procédé servant à abaisser l'intelligibilité de signaux vocaux et composant de séparation servant à influencer la transmission de sons - Google Patents

Procédé servant à abaisser l'intelligibilité de signaux vocaux et composant de séparation servant à influencer la transmission de sons

Info

Publication number
EP3178184A2
EP3178184A2 EP15750979.5A EP15750979A EP3178184A2 EP 3178184 A2 EP3178184 A2 EP 3178184A2 EP 15750979 A EP15750979 A EP 15750979A EP 3178184 A2 EP3178184 A2 EP 3178184A2
Authority
EP
European Patent Office
Prior art keywords
sound
speech signal
separating component
masking sound
masking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15750979.5A
Other languages
German (de)
English (en)
Other versions
EP3178184B1 (fr
Inventor
Philip Leistner
Horst Drotleff
Andreas Liebl
Xiaoru Zhou
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Publication of EP3178184A2 publication Critical patent/EP3178184A2/fr
Application granted granted Critical
Publication of EP3178184B1 publication Critical patent/EP3178184B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04K—SECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K3/00—Jamming of communication; Counter-measures
    • H04K3/80—Jamming or countermeasure characterized by its function
    • H04K3/82—Jamming or countermeasure characterized by its function related to preventing surveillance, interception or detection
    • H04K3/825—Jamming or countermeasure characterized by its function related to preventing surveillance, interception or detection by jamming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04K—SECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K3/00—Jamming of communication; Counter-measures
    • H04K3/40—Jamming having variable characteristics
    • H04K3/45—Jamming having variable characteristics characterized by including monitoring of the target or target signal, e.g. in reactive jammers or follower jammers for example by means of an alternation of jamming phases and monitoring phases, called "look-through mode"
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04K—SECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K2203/00—Jamming of communication; Countermeasures
    • H04K2203/10—Jamming or countermeasure used for a particular application
    • H04K2203/12—Jamming or countermeasure used for a particular application for acoustic communication

Definitions

  • Patent application Method for reducing the intelligibility of speech signals and separating component for influencing the sound transmission
  • the invention relates to a method for reducing the intelligibility of speech signals and a separating component for influencing the sound transmission. It should serve to avoid disturbances and fend off eavesdropping attacks. State of the art
  • Sound attenuation a low volume level can be achieved in open-plan offices, the distraction is relevant by a voice signal.
  • One approach is to superimpose the speech signal with a noise signal, making it incomprehensible
  • Overlay sound is created.
  • the disadvantage of this is that the overlay sound has a comparatively high noise level.
  • interceptibility includes, for example, the omission of windows, a complete solid construction, protection against structure-borne sound propagation and absolutely unadorned spaces
  • Vibration damping or superposition done. It proves to be particularly valuable at low frequencies, because in this area the sound insulation of all walls, Ceiling etc. total or partially resonance-like low. However, the frequency range of intelligible speech is at medium and high frequencies, where an increased sound attenuation with active systems is not or hardly achievable.
  • one approach to reducing the ability to intercept is to overlay speech with masking signals so that a sound may be heard or detected but its content is incomprehensible.
  • these masking systems must alienate the outgoing voice content so that it can not be decrypted. Both the word and the sentence intelligibility must therefore be reduced to a semantically unconstructable measure.
  • no noticeable acoustic disturbance (annoyance) may occur in the room or outside, since this depends on the acceptance by the users. An all-drowning noise is therefore not an acceptable solution as it would have to significantly exceed the speech signal level.
  • the coherent speech signal is at least partially extracted from the incoherent noise
  • a method is known from US 3,213, 199 A in which sound is recorded in a room with a microphone
  • Neighboring room is bugged, a speaker is provided, which depends on the frequency and the amplitude of the sound recorded in the room at any time
  • Neighborhood generates a masking sound.
  • Masking sound with a variety of microphones and a speaker known. Speech signals and ambient signals are recorded. Depending on this, a masking sound is generated.
  • WO2004 / 107806 A1 discloses a system with which sound can be masked.
  • US 2005/0065778 A1 discloses an apparatus and a method for masking speech sound.
  • Masking signal can be varied in certain periods of time.
  • the time periods may have a fixed, variable or random length.
  • a so-called “babble generator” a speech-like signal, an artificial voice is generated as a masking signal, and then the artificial speech signal generated in the "babble generator” is superimposed on the masking signal with the actual speech signal.
  • Masking systems for a room thus consist both in minimizing speech intelligibility and preventing reconstructability of the outwardly-urging speech signal as well as in a minimized acoustic disturbance potential for the users of the adjoining rooms.
  • the object of the invention is therefore to provide a method with which a speech signal can be made incomprehensible in an improved manner. It is also a task Improved privacy from rooms where confidential discussions are conducted.
  • the solution is given in the independent claims.
  • the dependent claims teach advantageous embodiments.
  • the description and the drawings give further explanation.
  • Speech signal is so dependent that arises by superimposition of the speech signal with the masking sound an incomprehensible overlay sound, wherein the
  • the core idea is therefore that the masking sound depends in a differentiated manner on the speech signal whose intelligibility it is to be lowered, and is specifically adapted to the speech signal.
  • the prior art is that a masking sound with a higher
  • volume is provided when the speech signal is louder.
  • the invention uses a masking sound which is matched to the speech signal and, in addition to the amplitude, also takes account of the time and frequency of the speech signal, can already be superposed with a volume in the range of the volume of the speech signal to form an incomprehensible overlay sound. So it is possible that the
  • Overlay sound does not have a much higher volume than the voice signal.
  • the masking sound itself can be a more or less understandable speech sound.
  • In the prior art is due to non-specific noise, which louder than that
  • Speech signal is, the speech signal simply drowned out, so that the overlay sound is not understandable.
  • the masking sound could also be quieter than the voice signal.
  • the overlay sound is a bit louder than the voice signal, but not significantly louder.
  • Masking sounds are therefore eliminated.
  • the detection of the speech signal, the generation of the masking sound and the consequent superimposition take place at different locations.
  • the speech signal has a certain duration, until it comes to the superposition with the masking sound. This time can be used to create the masking sound.
  • the speech signal is split into intervals.
  • the masking sound is formed by temporal inversion of the short intervals.
  • a new signal is generated from the amplitude and the frequency of the primary signal, that is to say of the detected speech signal.
  • the generation of the masking sound is subject to a random change. It is understood that this random change must remain within a framework that ensures that the overlay sound remains incomprehensible.
  • the lowering of the intelligibility of a speech signal can also serve the eavesdropping of a Prevent conversation.
  • a generation of the masking sound according to an always unchanged method, according to the invention the change in the masking results not from the change in the masking rule but from the variation of the interval length, cause the process is detected by the eavesdropper and thus a reconstruction of the speech signal would be possible.
  • the time intervals are changed randomly in a range of 20 ms to 200 ms, in particular in a range of 50 ms to 100 ms.
  • an insulation and / or attenuation of the speech signal is taken into account in the generation of the masking sound, wherein in particular a
  • Masking sound is provided at low volume, when the overlay sound from the superposition of the masking sound with the insulated and / or attenuated speech signal. It will be possible in many cases to insulate or dampen the speech signal before it enters an area in which a disturbance or a bugging attack is to be fought off. Thus, a masking sound with lower volume is sufficient. Accordingly, the overlay sound is also less loud, so that possible disturbances are further lowered. As far as above a comparison between the volume of the masking sound, the overlay sound and the
  • Speech signal is made, it is useful to turn off the speech signal after an eventual insulation or damping. As mentioned above, it is particularly important to increase the privacy of rooms.
  • the invention therefore also relates to a separating component for separating a room from a room environment.
  • the separating component contains sensors, actuators and a signal processing unit for influencing the sound transmission.
  • the separating component is characterized by the following components:
  • the masking sound depends on the amplitude, time and frequency of the speech signal. As already explained above, it is not enough to the volume alone
  • a signal processing unit which can process the signals detected by the sensors so that the
  • Actuators can generate such a masking that an incomprehensible overlay sound is created by superimposing the masking sound with the speech signal in the room environment, without the overlay sound must have a much higher volume than the speech signal.
  • the masking sound itself has about the volume of the speech signal in the room environment, but can also be quieter.
  • the sensors and the actuators are spaced in a defined manner, so that the speech signal has a certain transit time until it comes to superimposing with the masking sound.
  • the sensors and actuators are also spaced. As has been recognized in the context of the present invention, the distance can not be considered or even used.
  • the speech signal In a microphone as a sensor in the middle of the room, as shown in FIG. 1 of US Pat. No. 3,211,399 A, the speech signal has arrived faster from a speaker near the dividing wall at the dividing wall than at the microphone. For a speaker sitting away from the partition, the voice signal is more likely to be on the microphone than on the partition.
  • the signal processing unit is designed to delay the masking sound with respect to the speech signal in time to run times of the speech signal in
  • the duration of the electrical signal from the sensors and the signal processing unit to the actuators is usually much shorter than the duration of the sound in the separation component. If the sensors in the area of the side of the separating component facing the room and the actuators in the region of the side of the separating component facing the room environment are now to be taken into account, this duration of the sound from the sensors to the actuators must be considered.
  • This transit time is advantageously used according to the invention in that the time delay resulting from the signal propagation time is sufficiently designed such that the signal processing unit transmits the masking sound directly, i. generate in real time and provide for the overlay.
  • the separation component is designed so that the generation of the masking sound is subject to a random change.
  • the generation of the masking sound can be reproduced, if at all, only with great difficulty. This prevents the speech signal from being reconstructed.
  • the change must be within limits that allow the generation of incomprehensible overlay sound.
  • the separating component is designed so that the method described above can be carried out with all its advantages.
  • the separating component is designed to be multi-layered or multi-shelled. Such structures are common and readily available. In addition, gaps are realized, so that there about the signal processing unit can be accommodated well.
  • the separating component is set up in such a way that the masking sound is superposed with the speech signal within the separating component. It can thus be achieved that in a region of the room environment facing the room environment
  • Separating component forms a structure-borne sound that radiates incomprehensible overlay sound into the room environment.
  • the separating component is set up so that in the room environment, a superposition of the passing through the separating member portion of the speech signal with the masking sound. This is especially the case when the actuators for generating the masking sound are located on the side of the separating component facing the room environment. In this case, a portion of the speech signal greatly reduced by the separating component passes through the
  • Room environment facing region of the separation component forms a structure-borne sound that radiates incomprehensible overlay sound into the room environment, a wiretapping attack should be even more difficult. A tapping the structure-borne sound on the room environment facing side is no longer possible.
  • the sensors are designed as vibroacoustic sensors. Vibroacoustic sensors are suitable for the accurate detection of a speech signal.
  • Speech signal attached to the room-facing side of the separating member or in this area.
  • the speech signal has the highest intensity, so that sensors there can capture the speech signal well.
  • the actuators for generating the masking sound on the room environment facing side of the separating member or in this area are attached. The masking sound is in the
  • FIG. 1 which shows a schematic representation of a double-shell partition wall with a vibroacoustic system integrated according to the invention for masking the speech sound transmission between two rooms, will be described below
  • a vibroacoustic speech signal masking system comprises (vibro-) acoustic sensors 4 and actuators 5 and a signal processing module 6, which are integrated into the multi-shell separating component 1.
  • a modified speech signal 9 serving as a masking sound is generated in real time from the primary speech signal 8 detected on the room side 7 of the separating component 1, which is fed by means of the actuators 5 into the multi-layered separating component 1 or, preferably, its outer side 1 0 Sound emission stimulates.
  • the type, number and distribution of the sensors 4, actuators 5, etc. depends, inter alia, on the construction of the separating component 1.
  • the superimposed radiation of both signals ie the insulated primary sound signal 1 1 and the modified voice or masking signal 9, on the outside 10 leads to a quiet and incomprehensible overlay sound 1 2.
  • the above-mentioned generation of the modified speech signal 9 in Real time should simply mean that the superposition of the primary speech signal 8 and the modified speech signal 9 to the overlay sound in the external environment 3 must be done simultaneously.
  • the primary speech signal 8 needs from the vibrating acoustic sensors 4 to the Actuators 5 a certain duration. This is advantageous in that the generation of the modified speech signal 9 takes some time.
  • junction boxes for electrical power or data networks to be integrated directly into the component.
  • the component room side can also be provided with a header shell, for ceilings z. B. also in the form of a floating screed, the
  • Voice masking system finds its place in the gap between header shell and solid component.
  • the attachment shell generally does not serve sound-insulating purposes, but can also act as a sound absorber in room 2 to improve room acoustics.
  • the Mehrschaltechnik or multi-layer offers the advantage that the emitted from the outside 10 of the separating component 1 masking sound 9, the space 2 is not or only weakly achieved space and thus is not perceived as disturbing.
  • an asymmetrical structure of the separating component 1 is of particular importance.
  • the algorithm for generating the modified speech signal 9 accesses the detected primary speech signal 8. The detection is followed by filtering, time delay and temporal inversion of separate signal sections.
  • the known sound transmission properties level, phase and
  • Original speech signal achieves a significantly higher masking effect, as the superposition with the known, usually differently filtered noise signals. This realization was created in the context of language masks between workplaces in open-plan offices in order to reduce the disruptive effect of intelligible main language.
  • the speech masking according to the invention depends on the language prevailing in the application, since the speech patterns differ. Although nothing changes at the basic manipulation steps, some details, e.g.
  • Speech recognition can be integrated in two main ways. On the one hand, it distinguishes speech from other non-speech sounds. Such algorithms already exist. On the other hand, it recognizes the language family.
  • a supplemental feature is a type of feedback structure that allows the success and level of speech intelligibility to be checked in near real-time to then adjust the parameters of the masking sound to be generated.
  • flanking components e.g. on walls that are perpendicular to the actual separation component 1 and allow longitudinal sound transmission between rooms. Analogously, the flanking applies
  • the application of the vibroacoustic system and method according to the invention for speech masking is not limited to buildings, but can also be applied in

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Transmitters (AREA)

Abstract

L'invention concerne un procédé servant à abaisser l'intelligibilité d'un signal vocal. Ledit procédé comprend les étapes qui suivent consistant à : a) détecter l'amplitude, la durée et la fréquence du signal vocal (8) ; b) produire un son de masquage (9), qui dépend de l'amplitude, de la durée et de la fréquence du signal vocal (8) de manière à produire un son de superposition (12) inintelligible par superposition du signal vocal (8) et du son de masquage (9). Le son de superposition (12) ne présente pas un volume sensiblement plus élevé que le signal vocal. La production du son de masque (9) est soumise à une variation aléatoire. Le signal vocal (8) est décomposé en intervalles. Selon l'invention, la longueur des intervalles varie de manière aléatoire selon une fonction aléatoire. L'invention concerne de la même manière un composant de séparation servant à séparer un espace (2) d'un environnement (3) avec des capteurs (4), des actionneurs (5) et une unité de traitement de signal (6), servant à influencer la transmission des sons. Selon l'invention, le composant de séparation (1) comporte les composants qui suivent : des capteurs (4) servant à détecter le signal vocal (8) provenant de l'espace (2) ; des actionneurs (5) servant à produire un son de masquage, qui dépend de l'amplitude, de la durée et de la fréquence du signal vocal (8). Les capteurs (4) et les actionneurs (5) sont espacés de sorte que le signal vocal (8) présente un certain temps de propagation jusqu'à la superposition avec le son de masquage (9) afin de tenir compte des temps de propagation du signal vocal (8) dans le composant de séparation (1).
EP15750979.5A 2014-08-08 2015-08-07 Composant de séparation servant à influencer la transmission de sons Active EP3178184B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102014111365.9A DE102014111365A1 (de) 2014-08-08 2014-08-08 Verfahren zur Senkung der Verständlichkeit von Sprachsignalen und Trennbauteil zur Beeinflussung der Schallübertragung
PCT/EP2015/068222 WO2016020511A2 (fr) 2014-08-08 2015-08-07 Procédé servant à abaisser l'intelligibilité de signaux vocaux et composant de séparation servant à influencer la transmission de sons

Publications (2)

Publication Number Publication Date
EP3178184A2 true EP3178184A2 (fr) 2017-06-14
EP3178184B1 EP3178184B1 (fr) 2021-04-28

Family

ID=53879488

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15750979.5A Active EP3178184B1 (fr) 2014-08-08 2015-08-07 Composant de séparation servant à influencer la transmission de sons

Country Status (3)

Country Link
EP (1) EP3178184B1 (fr)
DE (1) DE102014111365A1 (fr)
WO (1) WO2016020511A2 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10134379B2 (en) 2016-03-01 2018-11-20 Guardian Glass, LLC Acoustic wall assembly having double-wall configuration and passive noise-disruptive properties, and/or method of making and/or using the same
US10354638B2 (en) 2016-03-01 2019-07-16 Guardian Glass, LLC Acoustic wall assembly having active noise-disruptive properties, and/or method of making and/or using the same
US20170256251A1 (en) * 2016-03-01 2017-09-07 Guardian Industries Corp. Acoustic wall assembly having double-wall configuration and active noise-disruptive properties, and/or method of making and/or using the same
US20180268840A1 (en) * 2017-03-15 2018-09-20 Guardian Glass, LLC Speech privacy system and/or associated method
US10373626B2 (en) 2017-03-15 2019-08-06 Guardian Glass, LLC Speech privacy system and/or associated method
US10304473B2 (en) 2017-03-15 2019-05-28 Guardian Glass, LLC Speech privacy system and/or associated method
US10726855B2 (en) 2017-03-15 2020-07-28 Guardian Glass, Llc. Speech privacy system and/or associated method
CN114474393B (zh) * 2021-12-31 2024-01-19 三一汽车制造有限公司 料仓料位监控方法、装置及搅拌站

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3213199A (en) * 1962-01-02 1965-10-19 Bissett Berman Corp System for masking information
FR2726115B1 (fr) * 1994-10-20 1996-12-06 Comptoir De La Technologie Dispositif actif d'attenuation de l'intensite sonore
DE19826171C1 (de) 1998-06-13 1999-10-28 Daimler Chrysler Ag Verfahren und Vorrichtung zur aktiven Beeinflussung von von Fensterscheiben stammenden Geräuschen
GB9927131D0 (en) * 1999-11-16 2000-01-12 Royal College Of Art Apparatus for acoustically improving an environment and related method
WO2004107806A1 (fr) * 2003-06-02 2004-12-09 Feonic Plc Systeme audio
US20050065778A1 (en) * 2003-09-24 2005-03-24 Mastrianni Steven J. Secure speech
CA2461148A1 (fr) * 2004-01-27 2005-07-27 Rafik Goubran Systeme et methode d'embrouillage acoustique adaptatif
WO2006076217A2 (fr) * 2005-01-10 2006-07-20 Herman Miller, Inc. Procede et appareil de confidentialite
DE102005044448B3 (de) 2005-09-09 2006-12-21 Universität Stuttgart Einrichtung zur aktiven und/oder passiven Schwingungsbeeinflussung eines transparenten, dünnwandigen Elements und deren Verwendung
US8620003B2 (en) * 2008-01-07 2013-12-31 Robert Katz Embedded audio system in distributed acoustic sources
US8045725B2 (en) * 2009-04-16 2011-10-25 GM Global Technology Operations LLC Vehicle interior active noise cancellation
US8972251B2 (en) * 2011-06-07 2015-03-03 Qualcomm Incorporated Generating a masking signal on an electronic device

Also Published As

Publication number Publication date
WO2016020511A2 (fr) 2016-02-11
DE102014111365A1 (de) 2016-02-11
EP3178184B1 (fr) 2021-04-28
WO2016020511A3 (fr) 2016-04-07

Similar Documents

Publication Publication Date Title
EP3178184B1 (fr) Composant de séparation servant à influencer la transmission de sons
DE3611214C1 (de) Gegen Abhoeren von aussen gesicherte Verglasung
DE112018001393B4 (de) Sprachvertraulichkeitssystem, zugehöriges verfahren und akustikwand
DE112018001396T5 (de) Sprachverschlüsselungssystem und/oder dazugehöriges Verfahren
EP2546830A2 (fr) Procédé et dispositif de masquage actif du son
EP2208197A2 (fr) Masquage sonore
US10354638B2 (en) Acoustic wall assembly having active noise-disruptive properties, and/or method of making and/or using the same
DE112018001333T5 (de) Sprachverschlüsselungssystem und/oder dazugehöriges verfahren
EP2226795A1 (fr) Dispositif auditif et procédé de réduction d'un bruit parasite pour un dispositif auditif
EP3793209A1 (fr) Appareil auditif avec annulation active du bruit et procédé de fonctionnement de lequel
DE102016007873A1 (de) Vorrichtung und Verfahren zur Erzeugung von akustischen Signalen
WO2014138758A2 (fr) Procédé d'amélioration de l'intelligibilité de la parole
DE102023109647A1 (de) Arbeitsbereich mit verbesserter vertraulichkeit in einem kraftfahrzeug
WO2008015215A2 (fr) Arrangement avec un système de réduction de bruit actif
DE3025391C2 (fr)
DE10052093B4 (de) Verwendung von Schallerzeugern in Fensterrahmen zur Schalldämmung
US20180268840A1 (en) Speech privacy system and/or associated method
JP2019512727A (ja) 二重壁構造と能動的なノイズ妨害特性とを有する音響壁アセンブリ、及び／又はこれを製造及び／又は使用する方法
EP1273204B1 (fr) Transducteur acoustique pour haut-parleur large bande ou ecouteur
DE102013221127A1 (de) Betrieb einer Kommunikationsanlage in einem Kraftfahrzeug
DE112019005697T5 (de) Verfahren zur Bereitstellung von Dienstleistungen unter Verwendung eines Ohrbügels
WO2007009505A1 (fr) Protection de la sphere privee lors d'emissions acoustiques par haut-parleurs
DE102021103310B4 (de) Verfahren und vorrichtung zur verbesserung der sprachverständlichkeit in einem raum
WO2018188762A1 (fr) Système amortisseur de bruit à coulisse muni de faces frontales absorbant le bruit
DE102020100959A1 (de) Aktives Schalldämpfungssystem und Verfahren zur aktiven Dämpfung eines Störschalls

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170206

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20191023

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20201013

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

INTG Intention to grant announced

Effective date: 20210316

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1388342

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210515

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502015014636

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210728

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210830

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210728

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210828

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210729

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20210428

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502015014636

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

26N No opposition filed

Effective date: 20220131

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210828

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210807

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210807

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1388342

Country of ref document: AT

Kind code of ref document: T

Effective date: 20210807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150807

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230824

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230822

Year of fee payment: 9

Ref country code: DE

Payment date: 20230822

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210428