EP2042000A2 - Method and device for diagnosing the operating state of a sound system - Google Patents
Method and device for diagnosing the operating state of a sound systemInfo
- Publication number
- EP2042000A2 EP2042000A2 EP07803779A EP07803779A EP2042000A2 EP 2042000 A2 EP2042000 A2 EP 2042000A2 EP 07803779 A EP07803779 A EP 07803779A EP 07803779 A EP07803779 A EP 07803779A EP 2042000 A2 EP2042000 A2 EP 2042000A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- response signal
- loudspeaker
- signal
- energy distribution
- operating state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/007—Monitoring arrangements; Testing arrangements for public address systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/03—Synergistic effects of band splitting and sub-band processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/001—Monitoring arrangements; Testing arrangements for loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/07—Synergistic effects of band splitting and sub-band processing
Definitions
- the present invention relates to a method and a device for diagnosing, in situ, the operating state of a sound system.
- a sound system In public spaces, especially in public transport facilities, it is necessary to ensure that current information (disturbed traffic, train announcements, etc.) and warning messages (evacuation of premises, implementation of guard, etc.) are understood by all users.
- current information disurbed traffic, train announcements, etc.
- warning messages evacuation of premises, implementation of guard, etc.
- it is known to control the proper functioning of the sound systems by broadcasting messages of the "sound test" type.
- An operating agent listens to the answer given by all speakers in the PA system and determines whether the PA system is working or not.
- this type of control does not make it possible to quantitatively judge the performance of the sound system (distortion, sound recovery, intelligibility, etc.).
- the aim of the invention is to propose a method of diagnosing, in situ, the operating state of a sound system making it possible to give a clear diagnosis of the causes of speaker malfunction, which can be used by non-specialized persons. in acoustics.
- the subject of the invention is a method for diagnosing the operating state of a sound system comprising at least one speaker capable of being connected to an audio player and arranged in an at least partially closed space , characterized in that it comprises the following steps:
- the method comprises one or more of the following characteristics:
- test signal comprises a defined number of sequences of a pseudo-random signal
- processing step comprises the following steps:
- the sound system comprises several loudspeakers, and the step of processing the digital response signal further comprises a step of determining the slices of the impulse response signal, each slice of the impulse response signal being representative of the acoustic waves broadcast. by a single speaker in said space;
- the step of determining the energy distribution coefficients comprises a step of filtering the or each slice of the impulse response signal
- the step of determining the energy distribution coefficients comprises a step of calculating energy distribution coefficients per third of an octave in a Wigner-Ville distribution, from the or each slice of the signal of impulse response;
- the step of determining the energy distribution coefficients comprises a step of calculating energy distribution coefficients per unit of frequency and per unit of time in a so-called Friedmann distribution, from the or each portion of the impulse response signal;
- the diagnostic method comprises, prior to the step of determining the energy distribution coefficients, the following steps:
- - R represents the yield
- - Nr represents the sound level received by the acoustic wave acquisition means (s)
- - represents the sound level emitted by the speaker (s);
- D represents the distance or the average distance between the acoustic wave acquisition means (s) and the loudspeaker (s); the comparison step is preceded by a step of selecting discriminant coefficients from among said energy distribution coefficients, and the comparison step is performed using at least one binary decision tree containing said discriminant coefficients; ; and
- the operating state of the sound system determined by said method comprises a sound speaker operating state, a perforated membrane speaker operating state and a degraded loudspeaker operating state.
- the invention also relates to a device for diagnosing the operating state of a sound system arranged in an at least partially closed space and comprising at least one loudspeaker, characterized in that it comprises:
- a metrological quality audio player capable of being connected to each loudspeaker and able to read a test signal
- each acquisition means being adapted to transform said acoustic waves into a digital response signal
- FIG. 1 is a simplified diagram of the diagnostic device according to the invention
- FIG. 2 is a diagram illustrating the main steps of the diagnostic method according to the invention
- FIG. 3 is a graph representing a test signal St (t) comprising three sequences of a pseudo periodic random signal
- FIG. 4 is a graph representing the digital response signal Sr (t);
- FIG. 5 is a graph representing the digital response signal Sr (t) cut into three sequences
- FIG. 6 represents a sequence Ss (t) of the digital response signal obtained by calculating the mean of the three sequences represented in FIG. 5;
- FIG. 7 is a graph representing a sequence Si (t) of the digital impulse response signal
- FIG. 8 is a diagram representing three slices Ti6 (t), Ti8 (t), ThO (t) of the sequence Si (t) of the digital impulse response signal;
- FIG. 9 is a simplified diagram showing a binary decision tree.
- the diagnostic device 2 of a sound system 4 according to the invention is illustrated in FIG.
- the sound system 4 conventionally comprises a set of several loudspeakers 6, 8, 10, mounted in a space 12.
- the diagnostic device 2 is able to differentiate different types of faults of the sound system 4 and in particular to classify each speaker either in a so-called healthy operating state "S", or in the operating states said phase “DEPH” or “OFF”, in a state of perforated membrane "MP” in which all or part of the suspension of the membrane is separated from the rest of the coil, or in a state said degraded "DE” revealing environmental damage such as excessive particle dust in the loudspeaker enclosure.
- the space 12 is a public space generally large, semi-closed, such as for example a subway station or a station hall.
- the diagnostic device 2 according to the invention comprises an audio player
- a microcomputer 20 a sound card 18, a conditioner 16 connected to one or more acoustic wave transformers in a digital response signal Sr (t), connected to the conditioner 16 to amplify the digital response signal resulting.
- the audio player 13 is a metrological quality reader of high precision, for example DAT type (in English: Digital Audio Tape). This reader
- test signal St (t) recorded on a metrological quality recording medium without offset or temporal distortion of this test signal St (t).
- the apparatus for transforming acoustic waves into a digital signal is a microphone 14.
- the sound card 18 has an input connected to the conditioner 16 and an output connected to the microcomputer 20.
- the microcomputer 20 comprises a storage memory 22, a central unit 24 and a display screen 26.
- the device 2 also comprises a device 28 for measuring distance, of high precision, for example of the infrared type.
- This device is connected to the microcomputer 20 or is used as a free unit and must be able to measure the distances d1, d2, d3 between the loudspeakers 6, 8 and 10 and the microphone 14.
- the method for diagnosing the operating state of the sound system 4 is illustrated in FIG. 2.
- the method starts with a prior calibration step 30 of the microphone 14, using a calibrator.
- the audio player 13 transmits to the speakers 6, 8, 10 a test signal St (t) previously recorded on the metrological quality recording medium.
- test signal St (t) is a periodic pseudo random signal composed of n sequences Ss (t) said to be of maximum length (in English MLS:
- Each sequence is composed of a series of binary pulses.
- the number n is any integer. In the example shown in FIG. 3, the number n is equal to three.
- the loudspeakers 6, 8, 10 diffuse into the space 12 acoustic waves representative of the test signal St (t) transmitted by the reader 13.
- the microphone 14 acquires acoustic waves representative of the waves diffused by the loudspeakers in the space 12.
- the microphone 14 converts the waves received into a digital response signal Sr (t), such that shown in Figure 4.
- step 36 of processing the digital signal Sr (t) response it is amplified by the conditioner 16, digitized by an analog / digital converter contained in the sound card 18 and transmitted to the central unit 24 .
- the apparatus 28 measures the distances d1, d2, d3 between each loudspeaker 6, 8, 10 and the microphone 14 and transmits a signal containing information on these distances d1, d2, d3 to the central unit 24.
- the central unit 24 calculates the efficiency R of the sound system 4 from the following formula:
- D represents the average distance between the microphone 14 and the loudspeakers 6, 8, 10, calculated from the measured distances d1, d2 and d3;
- Ne represents the sound level received by the microphone 14.
- the sound level represents the level of a logarithmic scale for measuring intensities or sound powers.
- the central unit 24 compares the value of the efficiency R calculated during step 40 with a predefined threshold value prerecorded in the memory 22 and modifiable by the user according to the level of yield required for the diagnostic process. If this efficiency value R is less than the predefined threshold value, the efficiency value R is displayed on the screen 26 during a step 43 and the diagnostic process stops during a step 44.
- the digital response signal Sr (t) is analyzed more finely to define whether one or more of the loudspeakers have a failure during a period of time. step 45.
- the response signal Sr (t) processed in step 36 is first averaged during a step 46.
- the response signal Sr (t) acquired in response to the diffusion of the three sequences of the test signal St (t), is divided or temporally partitioned into three sequences Ss (t).
- each Ss (t) sequence of the response signal has a time length equal to the time length of a sequence of the test signal St (t). Then, the central unit 24 determines the average value of these three sequences Ss (t) of the point-to-point addition response signal of each digitized amplitude of a sequence Ss (t) of the response signal and by division of these amplitudes. by the number of summed sequences, namely three in the example described above. During a step 48, the central unit 24 calculates the sequence S1 (t) of the impulse response signal from the Sm (t) sequence of the average response signal using, for example, a Hadamard transform. .
- the Hadamard transform is known per se.
- This separation is performed, for example, by a spatio-temporal knife from distances d1, d2, d3 measured by the device 28.
- the space-time knife is a method that includes the steps described below:
- the time-space knife method comprises a step of searching for the time t0 corresponding to the first pulse of the sequence of the impulse response signal Si (t). then a step of performing a first separation into three slices Ti6 (t), Ti8 (t), Ti10 (t) from time to and distances d1, d2, d3.
- the bistouri-spatio-temporal method comprises a step of searching for the peaks of the sequence Si (t) of the impulse response signal, for example by calculating the second derivatives.
- FIG. 8 represents three slices Ti6 (t), Ti8 (t), Ti10 (t) of the impulse response signal Si (t) corresponding to the three loudspeakers 6, 8 and 10.
- the acoustic wave energy distribution coefficients generated by each loudspeaker 6, 8, 10 are calculated at 7 001067
- v is the frequency
- ⁇ is the sampling period of the signal
- x * is the complex conjugate of the signal x.
- the Wigner Ville distribution allows to represent in a three-dimensional space the energy distribution of a slice Ti6 (t), Ti8 (t), Ti10 (t) of the impulse response signal as a function of time and frequency.
- the MATLAB software can, for example, be used to realize the representation of this distribution.
- the central unit 24 calculates a summation energy distribution coefficient on a frequency band with a width corresponding to one-third of an octave, the energy of a slice Ti6 (t). the impulse response signal.
- A6 (a1 / 36, a2 / 36, a3 / 36, a4 / 36, etc.)
- the central unit 24 also calculates the sum of the energy per unit of time and per unit of frequency in the Wigner Ville distribution space. To this end, the Wigner Ville space is divided on the one hand into a frequency band of equal width and on the other hand into a time band of equal width.
- B6 (b16, b26, b36, b46, etc.).
- the central unit 24 calculates a Friedman probability distribution from a formula known per se and described in the document: DH Friedman, "Instantaneous Frenquency vs Time: An Interpretation of the Phase Structure of Speech, Proc. IEEE ICASSP, pp. 29.10 1-4, Tampa, 1985.
- the series A8, B8, C8, D8 and A10, B10, C10, D10 of the energy distribution coefficients of the slices Ti8 (t) and Ti10 (t) of the impulse response signal corresponding to the loudspeakers 8 and 10 are also calculated from their Wigner Ville distribution graph.
- A8 (a1 / 38, a2 / 38, a3 / 38, a4 / 38, etc);
- A10 (a1 / 310, a2 / 310, a3 / 310, a4 / 310, etc.)
- the slices Ti6 (t), Ti8 (t), Ti10 (t) of the response signal are filtered.
- the filters are band-pass filters explicitly specified for each operation, namely S, OFF or DEPH, MP perforated membrane, and DE degraded operation, in order to reveal the differences between these operations.
- the filters used have been designed to highlight the characteristic energy of the defect and to eliminate the energy related to the type of loudspeaker used.
- the filters were designed empirically trying to maximize the visual differences between defective and healthy signals.
- these filters highlight mainly low and high frequency bands. These filters can be made by the proprietary utility "MATLAB, SP TOOL”.
- the differentiation of the "OFF" fault on the loudspeakers is achieved by means of a simple comparison of one of the metrics to a fixed threshold
- the discriminant coefficients are introduced into three decision trees 57 containing predetermined threshold ranges.
- a decision tree is a sequence of binary decisions that causes the affection of the tested speaker to a certain state among the predefined operating states namely a healthy state S, a perforated membrane state
- FIG. 9 An example of a decision tree 57 is shown in FIG. 9.
- the three decision trees each assign a state of operation to each speaker 6, 8, 10.
- these three assignments are introduced in a last decision tree that provides by the same routing process binary, a definitive diagnosis describing for each loudspeaker 6, 8, 10 of the sound system its operating state.
- the central unit 24 displays a diagnosis on the screen 26 and the process stops during a step 64.
- the method according to the invention provides a diagnosis relating to the operation of each speaker in a single measurement. It avoids the intervention of an operator on each loudspeaker.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Circuit For Audible Band Transducer (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0606431A FR2903853B1 (en) | 2006-07-13 | 2006-07-13 | METHOD AND DEVICE FOR DIAGNOSING THE OPERATING STATE OF A SOUND SYSTEM |
PCT/FR2007/001067 WO2008006952A2 (en) | 2006-07-13 | 2007-06-26 | Method and device for diagnosing the operating state of a sound system |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2042000A2 true EP2042000A2 (en) | 2009-04-01 |
EP2042000B1 EP2042000B1 (en) | 2016-08-10 |
Family
ID=37671353
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07803779.3A Active EP2042000B1 (en) | 2006-07-13 | 2007-06-26 | Method and device for diagnosing the operating state of a sound system |
Country Status (5)
Country | Link |
---|---|
US (1) | US20090304195A1 (en) |
EP (1) | EP2042000B1 (en) |
CA (1) | CA2657450A1 (en) |
FR (1) | FR2903853B1 (en) |
WO (1) | WO2008006952A2 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102009033614B4 (en) * | 2009-07-17 | 2020-01-23 | Wolfgang Klippel | Arrangement and method for the detection, location and classification of defects |
JP5197853B2 (en) * | 2009-09-28 | 2013-05-15 | 株式会社東芝 | Monitoring device |
EP2375779A3 (en) | 2010-03-31 | 2012-01-18 | Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. | Apparatus and method for measuring a plurality of loudspeakers and microphone array |
CN105472525B (en) | 2011-07-01 | 2018-11-13 | 杜比实验室特许公司 | Audio playback system monitors |
CN103512650A (en) * | 2012-06-21 | 2014-01-15 | 鸿富锦精密工业(深圳)有限公司 | Buzzer testing circuit |
WO2018070046A1 (en) * | 2016-10-14 | 2018-04-19 | ヤマハ株式会社 | Failure detection apparatus, audio input/output module, emergency notification module, and failure detection method |
US10547940B1 (en) * | 2018-10-23 | 2020-01-28 | Unlimiter Mfa Co., Ltd. | Sound collection equipment and method for detecting the operation status of the sound collection equipment |
US11153043B2 (en) | 2019-10-24 | 2021-10-19 | Roku, Inc. | Measuring and evaluating a test signal generated by a device under test (DUT) |
US11115766B1 (en) * | 2020-05-28 | 2021-09-07 | Zebra Technologies Corporation | Automated audio assembly performance assessment |
US11202146B1 (en) * | 2020-09-03 | 2021-12-14 | Algo Communication Products Ltd. | IP speaker system |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3437303C2 (en) * | 1984-10-11 | 1987-03-05 | Licentia Patent-Verwaltungs-Gmbh, 6000 Frankfurt | Method for measuring distortion effects on an electroacoustic transducer, in particular loudspeakers or headphones |
IL134979A (en) * | 2000-03-09 | 2004-02-19 | Be4 Ltd | System and method for optimization of three-dimensional audio |
DE10214407C1 (en) * | 2002-03-30 | 2003-06-18 | Klippel Gmbh | Measuring, evaluating and noise recognition device for signal transmission or storage systems, has estimator which supplies estimated parameter to model system whose output indicates instantaneous noise and distortion |
-
2006
- 2006-07-13 FR FR0606431A patent/FR2903853B1/en active Active
-
2007
- 2007-06-26 WO PCT/FR2007/001067 patent/WO2008006952A2/en active Application Filing
- 2007-06-26 US US12/373,371 patent/US20090304195A1/en not_active Abandoned
- 2007-06-26 EP EP07803779.3A patent/EP2042000B1/en active Active
- 2007-06-26 CA CA002657450A patent/CA2657450A1/en not_active Abandoned
Non-Patent Citations (1)
Title |
---|
See references of WO2008006952A2 * |
Also Published As
Publication number | Publication date |
---|---|
FR2903853B1 (en) | 2008-10-17 |
WO2008006952A3 (en) | 2008-02-28 |
CA2657450A1 (en) | 2008-01-12 |
WO2008006952A2 (en) | 2008-01-17 |
EP2042000B1 (en) | 2016-08-10 |
FR2903853A1 (en) | 2008-01-18 |
US20090304195A1 (en) | 2009-12-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2042000B1 (en) | Method and device for diagnosing the operating state of a sound system | |
EP2898707B1 (en) | Optimized calibration of a multi-loudspeaker sound restitution system | |
Rempel et al. | Comparison of audio recording system performance for detecting and monitoring songbirds | |
EP0790753B1 (en) | System for sound spatial effect and method therefor | |
US8706276B2 (en) | Systems, methods, and media for identifying matching audio | |
CN103165136A (en) | Audio processing method and audio processing device | |
FR2997257A1 (en) | Audio equipment e.g. loudspeaker, testing method for car, involves comparing characteristic of measurement signal with reference signal so as to detect failure in audio equipment when characteristic of measurement signal is different | |
EP3807669A1 (en) | Location of sound sources in a given acoustic environment | |
EP3635718B1 (en) | Processing of sound data for separating sound sources in a multichannel signal | |
KR20110110800A (en) | Distributed sensing of signals linked by sparse filtering | |
CN104937955B (en) | Automatic loud speaker Check up polarity | |
FR2932920A1 (en) | METHOD AND APPARATUS FOR MEASURING THE INTELLIGIBILITY OF A SOUND DIFFUSION DEVICE | |
CN105516876A (en) | Spectrum entropy based howling detection method | |
WO2019130788A1 (en) | Sound volume control device, sound volume control method, and sound volume control system | |
CN105188008B (en) | A kind of method and device of testing audio output unit | |
Supreeth et al. | Identification of Ambulance Siren sound and Analysis of the signal using statistical method | |
EP3232212B1 (en) | System and method for detecting an electric arc | |
FR3112017A1 (en) | Electronic equipment including a distortion simulator | |
CN114627897A (en) | Audio signal abnormality monitoring method, apparatus, device, medium, and program product | |
FR3054339A1 (en) | CORRECTION METHOD WITHOUT CALIBRATING A DEFECT INTRODUCED BY A SCANNING SYSTEM AND ASSOCIATED DEVICES | |
FR3003114A1 (en) | METHOD AND SYSTEM FOR TESTING AUDIO DEVICE | |
CN111314536B (en) | Method and equipment for detecting listening module of terminal equipment | |
JP6370725B2 (en) | Waveform data collection device, water leakage determination device, water leakage determination system, and program for water leakage determination | |
FR3087076A1 (en) | METHOD AND DEVICE FOR CONTROLLING THE DISTORTION OF A SPEAKER SYSTEM ON-VEHICLE | |
CN114705286B (en) | Machine jolt detection method, device, computer and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20081219 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK RS |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20150624 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602007047405 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: H04R0029000000 Ipc: H04S0007000000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04R 29/00 20060101ALI20160108BHEP Ipc: H04S 7/00 20060101AFI20160108BHEP |
|
INTG | Intention to grant announced |
Effective date: 20160201 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 820018 Country of ref document: AT Kind code of ref document: T Effective date: 20160815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602007047405 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160810 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 820018 Country of ref document: AT Kind code of ref document: T Effective date: 20160810 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161210 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161212 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161111 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602007047405 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161110 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20170511 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170630 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170626 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170630 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170626 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20070626 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160810 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160810 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230509 Year of fee payment: 17 Ref country code: DE Payment date: 20230613 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230620 Year of fee payment: 17 |