EP2816557B1 - Identifying spurious signals in audio signals - Google Patents

Identifying spurious signals in audio signals Download PDF

Info

Publication number
EP2816557B1
EP2816557B1 EP13173079.8A EP13173079A EP2816557B1 EP 2816557 B1 EP2816557 B1 EP 2816557B1 EP 13173079 A EP13173079 A EP 13173079A EP 2816557 B1 EP2816557 B1 EP 2816557B1
Authority
EP
European Patent Office
Prior art keywords
signal
audio signal
level
audio
predetermined frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13173079.8A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2816557A1 (en
Inventor
Karl-Anton Becker
Christoph Benz
Frieder Otto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harman Becker Automotive Systems GmbH
Original Assignee
Harman Becker Automotive Systems GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harman Becker Automotive Systems GmbH filed Critical Harman Becker Automotive Systems GmbH
Priority to EP13173079.8A priority Critical patent/EP2816557B1/en
Priority to KR1020140068176A priority patent/KR102180656B1/ko
Publication of EP2816557A1 publication Critical patent/EP2816557A1/en
Application granted granted Critical
Publication of EP2816557B1 publication Critical patent/EP2816557B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering

Definitions

  • the disclosure relates to a system and method (generally referred to as a "system") for processing signals, in particular for identifying spurious signals in audio signals.
  • system a system and method for processing signals, in particular for identifying spurious signals in audio signals.
  • An audio signal may be a composite signal containing features that are attributable to noise and features that are attributable to the desired signal.
  • the features of the composite signal that are noise may be distinguished from the features of the composite signal that are attributable to the desired signal.
  • Features that have been identified as noise can then be removed or reduced from the composite signal.
  • noise may be relatively constant background noise and spurious signals, for example in a high frequency portion of the audio frequency spectrum.
  • spurious signals may be generated internally by an audio reception system that may employ demodulation of a high-frequency carrier and decoding of the demodulated signals.
  • These spurious internal signals are commonly referred to as birdies.
  • Common approaches for detecting and overriding birdies in digital audio signal transmission includes attenuating demodulated and decoded audio signals in a frequency selective manner and superimposing substitute signals on the audio signals in frequency selective manner as a function of the data error statistics of the digital signal in order to improve the subjective auditory perception of the audio signal.
  • a method for identifying a spurious signal in an audio signal includes: receiving at least one audio signal having a frequency spectrum, the at least one audio signal being derived from at least one digital signal; spectrally analyzing the at least one audio signal; determining the presence of a spurious signal, if a rate of increase of the audio level in a predetermined frequency region of the frequency spectrum exceeds a predetermined value and if a threshold value of the audio level is exceeded; and providing a trigger signal for attenuating the predetermined frequency portion of the at least one audio signal in which the presence of a spurious signal is determined if the presence of a spurious signal is determined.
  • a system for identifying a spurious signal in an audio signal which is derived from a digital signal includes: a receiver block configured to receive at least one audio signal having a frequency spectrum, the at least one audio signal being derived from at least one digital signal; a analyzing block configured to spectrally analyze the reproduced audio signal; a detector block configured to determine the presence of a spurious signal, if a rate of increase of the audio level in a predetermined frequency region of the frequency spectrum exceeds a predetermined value and if a threshold value of the audio level is exceeded, and to provide a trigger signal for attenuating the predetermined frequency portion of the at least one audio signal in which the presence of a spurious signal is determined if the presence of a spurious signal is determined.
  • FIG. 1 illustrates a digital audio broadcast receiver system 10 that allows for reducing noise in demodulated and decoded digital audio signals.
  • System 10 comprises an antenna 11 for receiving a frequency carrier that is modulated with a coded digital audio signal.
  • Antenna 11 is coupled to a front end receiver block 12, which is configured to derive by way of demodulation an intermediate signal from the received modulated high-frequency signal, which is modulated and coded according to a digital audio broadcast (DAB) standard in this particular exemplary system 10.
  • Front end receiver block 12 is coupled to a DAB decoder block 13 which is configured to decode the reproduced audio signal and provide the left (L) and right (R) signals of a stereo audio signal on lines 14 and 15.
  • DAB digital audio broadcast
  • System 10 further comprises a noise (birdie) detection block 20 which is coupled to lines 14 and 15 so as to receive one or both of the demodulated signals of the stereo signals on lines 14, 15.
  • Noise detection block 20 further receives a signal from the front-end receiver block 12 on line 21 indicative of the reception quality of the high-frequency signal.
  • Noise detection block 20 controls via line 22 an attenuation block 16, which is coupled to line 14 of audio signal decoder block 13 and a loudspeaker 18 for the left stereo audio signal L.
  • Noise reduction block 20 controls, via line 22, an attenuation block 17, which is coupled to line 15 of audio block 13 and a loudspeaker 19 for the right stereo audio signal R.
  • Attenuation blocks 16 and 17 may provide frequency-dependent attenuation, which may be achieved, e.g., with a controllable cut-off frequency.
  • the lowpass filter's cut-off frequency may be switched between 18kHz (less attenuation in the range 16-18kHz) and 16kHz (more attenuation in the range 16-18kHz).
  • Noise detection block 20 is illustrated in more detail in FIG. 2 .
  • Lines 14 and 15 are coupled to an adder 23, which adds left audio signal L on line 14 and right audio signal R on line 15 to generate an input signal to a high pass filter 25 and a band-pass filter 24.
  • the inputs of two level detectors 27 and 28, which have different averaging time constants t 27 and t 28 , respectively, are connected to the output of high pass filter 25; their outputs provide an input into comparator 29, which provides an input into comparator 30 indicative of which output level of level detectors 27 and 28 is higher.
  • Comparator 30 further receives input from level detector 26 having an averaging time constant t 26 , whose value may be (approximately) the same as that of time constant t 27 (t 26 ⁇ t 27 ).
  • a controllable gate 31 is connected downstream of comparator 30 and receives from front-end block 12 signal 21, which is indicative of the reception quality and which controls gate 31. Gate 31 lets the output signal of comparator 30, also called trigger signal 22, pass if the reception quality is below a certain level or otherwise blocks trigger signal 22.
  • the averaging time constant of level detector 27 may be small, e.g., ⁇ 10ms, so that short impulses are detected by comparing the output signal of detector 27 with the output signal of level detector 28, whose averaging time constant is large, e.g., > 100 ms.
  • FIG. 3 illustrates an exemplary signal flow structure of level detectors 26, 27 and 28.
  • the respective input signal is rectified or its absolute value is determined in a absolute value calculating block 32.
  • the absolute value is then averaged in an appropriate way, e.g., by way of an RC element.
  • the RC element may include a resistor 33 in a series arm and a resistor 34 and a capacitor 35 in a shunt arm of the RC element.
  • the averaging time constants can be adjusted by adequately dimensioning resistors 33 and 34 and capacitor 35, whereby resistor 33 may include zero Ohms and resistor 34 infinite Ohms.
  • the system described above in connection with FIGS. 1-3 may employ a method for identifying a spurious signal in the demodulated and decoded audio signal derived from the modulated and coded digital signal received by antenna 11.
  • the reproduced audio signals provided by DAB decoder block 13 are spectrally analyzed by noise (birdie) detector block 20. If a rate of increase of the audio level in a predetermined frequency region of the frequency spectrum exceeds a predetermined value and if a threshold value of the audio signal is exceeded, then the presence of a spurious signal is determined at comparator 30.
  • the reception quality can also be taken into account when determining if a signal is spurious. If the reception quality exceeds a threshold value, i.e.
  • the predetermined region may be a high-frequency region of the audio frequency spectrum, e.g., 16-18kHz, and is selected by high-pass filter 25.
  • the rate of increase in this particular frequency range is detected by level detectors 27 and 28 in combination with comparator 29. Threshold value detection of the audio signal is performed by comparator 30 in connection with band-pass filter 24 and level detector 26.
  • the predetermined portion of the frequency spectrum in which the presence of a spurious signal is determined may be attenuated by muting the audio signal during the time period of the spurious signal (frequency independent attenuation) or by reducing the frequencies of low pass filters 16 and 17 (frequency-dependent attenuation).
  • the system described above in connection with FIGS. 1-3 may be realized in analog, digital or mixed analog-digital circuitry.
  • the digital circuitry may be controlled by adequate software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Noise Elimination (AREA)
EP13173079.8A 2013-06-20 2013-06-20 Identifying spurious signals in audio signals Active EP2816557B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13173079.8A EP2816557B1 (en) 2013-06-20 2013-06-20 Identifying spurious signals in audio signals
KR1020140068176A KR102180656B1 (ko) 2013-06-20 2014-06-05 오디오 신호에서 스퓨리어스 신호의 식별

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP13173079.8A EP2816557B1 (en) 2013-06-20 2013-06-20 Identifying spurious signals in audio signals

Publications (2)

Publication Number Publication Date
EP2816557A1 EP2816557A1 (en) 2014-12-24
EP2816557B1 true EP2816557B1 (en) 2015-11-04

Family

ID=48628572

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13173079.8A Active EP2816557B1 (en) 2013-06-20 2013-06-20 Identifying spurious signals in audio signals

Country Status (2)

Country Link
EP (1) EP2816557B1 (ko)
KR (1) KR102180656B1 (ko)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9763006B2 (en) * 2015-03-26 2017-09-12 International Business Machines Corporation Noise reduction in a microphone using vowel detection

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2231107A1 (en) * 1995-09-14 1997-03-20 Ericsson, Inc. System for adaptively filtering audio signals to enhance speech intelligibility in noisy environmental conditions
US8269480B2 (en) * 2007-07-09 2012-09-18 Ltx-Credence Corporation Method and apparatus for identifying and reducing spurious frequency components
US8015002B2 (en) * 2007-10-24 2011-09-06 Qnx Software Systems Co. Dynamic noise reduction using linear model fitting
JP5071346B2 (ja) * 2008-10-24 2012-11-14 ヤマハ株式会社 雑音抑圧装置及び雑音抑圧方法
JP2013527491A (ja) * 2010-04-09 2013-06-27 ディーティーエス・インコーポレイテッド オーディオ再生のための適応的環境ノイズ補償

Also Published As

Publication number Publication date
KR102180656B1 (ko) 2020-11-19
EP2816557A1 (en) 2014-12-24
KR20140147687A (ko) 2014-12-30

Similar Documents

Publication Publication Date Title
EP0792017B1 (en) High-frequency radio signal receiving apparatus for digital communication
US8792543B2 (en) Impulse noise mitigation under out-of-band interference conditions
US5036543A (en) Noise suppression apparatus for FM receiver
US9129592B2 (en) Signal artifact detection and elimination for audio output
JP4922678B2 (ja) ノイズキャンセラ及びこれを用いた受信装置
KR100824201B1 (ko) 멀티패스 노이즈 검출 장치 및 ｆｍ 수신 장치
US5432854A (en) Stereo FM receiver, noise control circuit therefor
JP3389341B2 (ja) Ｆｍ受信機
EP2816557B1 (en) Identifying spurious signals in audio signals
US20090275303A1 (en) Receiving Apparatus
US5734975A (en) Direct-coupled signaling receiver with PL/DPL detector
EP1983646A1 (en) Noise blanker circuit and method for removing noise and correcting a signal
JPH06311121A (ja) 音声信号内のパルス状妨害信号の検出方法および装置
JP3567928B2 (ja) ノイズ抑圧装置
US7133478B2 (en) Device and method for detecting and suppressing noise
US20070004356A1 (en) Noise suppression in an fm receiver
JPH11163748A (ja) トーン信号検出回路
JPH0879203A (ja) 雑音抑圧装置
JPH08508143A (ja) オーディオ信号のマスキングのための信号の導出用回路装置
US7133468B2 (en) Concurrent FM signal receiver
US20170041163A1 (en) Receiving device
CN110447173B (zh) 用于减弱互调产物所产生的干扰的方法
US20050079840A1 (en) Method for controlling the selectivity of a tuner in a variable bandwidth system
US9143774B2 (en) Method and apparatus for television band pilot sensing
JPS58147256A (ja) Ｆｍ受信機

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130916

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20150611

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 759683

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013003719

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20151104

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 759683

Country of ref document: AT

Kind code of ref document: T

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160304

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160204

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160304

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013003719

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20160805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20170228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160620

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130620

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160620

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20151104

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240521

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240521

Year of fee payment: 12