EP2987339A1 - Verfahren zur wiedergabe des klangs eines digitalen audiosignals - Google Patents
Verfahren zur wiedergabe des klangs eines digitalen audiosignalsInfo
- Publication number
- EP2987339A1 EP2987339A1 EP14721466.2A EP14721466A EP2987339A1 EP 2987339 A1 EP2987339 A1 EP 2987339A1 EP 14721466 A EP14721466 A EP 14721466A EP 2987339 A1 EP2987339 A1 EP 2987339A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sound
- frequency
- digital
- sampled
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2205/00—Details of stereophonic arrangements covered by H04R5/00 but not provided for in any of its subgroups
- H04R2205/021—Aspects relating to docking-station type assemblies to obtain an acoustical effect, e.g. the type of connection to external loudspeakers or housings, frequency improvement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/05—Generation or adaptation of centre channel in multi-channel audio systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/07—Generation or adaptation of the Low Frequency Effect [LFE] channel, e.g. distribution or signal processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
- H04S7/304—For headphones
Definitions
- the present invention relates to the field of audio signal processing for improving perception during sound reproduction.
- the international patent application WO2012088336 describes a method of processing an audio sound source to create four dimensions of spatialized sound.
- a virtual sound source can be moved along a path in a three-dimensional space over a specified period of time to obtain the location of the four-dimensional sound.
- the various embodiments described herein provide methods and systems for the existing mono, 2-channel and / or multi-channel conversion of audio signals into spatialized audio signals having two or more audio channels.
- the various embodiments also describe methods, systems, and apparatus for producing low frequency effects and center channel signals from incoming audio signals having one or more channels.
- Patent application WO9914983 discloses a device making it possible to create and use a pair of opposite loudspeakers of a headset, the feeling of a sound source being remote from the zone situated between said loudspeakers. .
- the device comprises:
- a first mixing matrix connected to the audio inputs and to a series of return inputs, which produces a predetermined combination of said audio inputs constituting intermediate output signals
- a filter system which filters said intermediate output signals and produces filtered intermediate output signals and the series of return inputs, and which comprises separate filters for filtering the forward response and the fast response and an approximation of the reverberated response, and to filter the return response so as to produce the return entries;
- a second mixing matrix which combines the filtered intermediate output signals to produce stereo right channel and left channel stereo outputs.
- European Patent EP2119306 discloses apparatus for processing an audio sound source to create four dimensions of spatialized sound.
- a virtual sound source can be moved along a path in a three-dimensional space over a specified period of time to obtain the location of the four-dimensional sound.
- a binaural filter for a desired spatial point is applied to the audio waveform to produce a spatialized waveform that, when the spatialized waveform is played from a pair of speakers, the sound appears to come from the chosen point space instead of speakers.
- a binaural filter for a point in space is simulated by interpolation of the nearest neighbor binaural filters selected from a plurality of predefined binaural filters.
- the audio waveform can be processed numerically by overlapping the data blocks with a short Fourier transform time.
- Localized sound can be processed later for Doppler shift and chamber simulation.
- the present invention relates to a method for processing an original audio signal of Nx channels, N being greater than 1 and x being greater than or equal to 0, comprising a multichannel processing step of said input audio signal by a multichannel convolution with a predefined imprint, said imprint being elaborated by the capture of a reference sound by a set of speakers arranged in a reference space characterized in that it comprises an additional step of selecting at least one of a plurality of fingerprints previously developed in different sound contexts.
- the patent application WO2012172264 describes a method of processing an original audio signal of Nx channels, N being greater than 1 and x being greater than or equal to 0, comprising a multichannel processing step of said input audio signal by a multichannel convolution with a predefined imprint, said imprint being elaborated by the capture of a reference sound by a set of speakers arranged in a reference space characterized in that it comprises an additional step of selecting at least one of a plurality of markings fingerprints previously developed in different sound contexts.
- Patent Application WO9725834 proposes another method and device for processing multichannel audio signals, each channel corresponding to a loudspeaker arranged at a particular point in a room so as to give, via headphones, the impression that multiples of 'Ghost' speakers are spread throughout the room.
- Heading Transfer Functions are selected by taking into consideration the height and azimuth of each speaker in relation to the listener.
- Each channel is HRTF filtered so that when these channels are combined in the left and right channels and output by headphones, the listener feels that the sound actually comes from ghost speakers distributed in the virtual room.
- HRTF coefficient sets entered in base data from a large number of individuals and the use of an optimal HRTF game for the listener provides listening impressions similar to those of an isolated listener listening to multiple high speakers distributed in the volume of a room.
- Applying an HRTF function to the output of the right and left channels allows, in the case of listening to the headphones, to give the impression of listening without headphones.
- the object of the present invention is to improve the perceived quality and in particular the extent of the spatialization, including with means of reproduction of average quality, such as docking stations of tablets or mobile phones ("docks"). ).
- the invention relates, in its most general sense, to a method of sound reproduction of a digital audio signal, characterized in that an oversampling step consisting in producing from a sampled signal at a first time is carried out.
- frequency F a signal sampled at a frequency NxF, where N corresponds to an integer greater than 1, and then to applying a convolution process on a first digital file sampled at a frequency NxF corresponding to the acquisition of the sound environment of a reference sound space, a second digital file sampled at an NxF frequency corresponding to the acquisition of the soundprint of a reference playback equipment, and third file digital sample sampled at an NxF frequency corresponding to the acquisition of an equalizer's audio fingerprint and a fourth file corresponding to said oversampled audio file, the resulting digital packets being then digitally converted to a digital sampling frequency F / M corresponding to the working frequency of the listening equipment.
- the processing is based on a mathematical convolution operation, and uses several prerecorded audio samples of the impulse response of the modeled space as well as an equalizer and playback equipment.
- the method comprises an additional step of recalculating the file corresponding to said sound footprint of the reference sound space, in order to modify the balance between the spatial channels of said sound footprint.
- FIG. 1 represents a schematic view of signal processing according to the invention.
- the treatment method according to the invention consists in producing different acoustic impressions of a sound source, with a view to convolving these different sound tracks.
- convolutions are a known technique of user capture, then the reproduction of the acoustic behavior of a place or an apparatus.
- convolution reverbs allow to propose to use the acoustics of many real places, famous concert halls or others: these acoustics, previously sampled, likely to be reused at will within the program.
- the principle is then to sample the acoustics of the sets in which the scenes of the film have been shot, in order to be able to easily apply this acoustics to the elements recorded a posteriori so that they integrate perfectly with the sounds from the direct catches. .
- the Impulse Response sensor to obtain the impulse response of a material or room constituting the sound footprint is based on the "deconvolution". It uses the excitation of the system by a known signal (here called f (t)). This signal is such that if we apply a transform (deconvolution function), the result is the Dirac function.
- the deconvolution function is chosen such that for the excitation signal f (t) and any function h (t):
- the types of signals used to capture impulse responses look like a Gaussian noise or a "white noise”.
- the excitation sequences are generated by a deterministic algorithm and are periodic (periods of the order of a few seconds or tens of seconds for our application) and constitute a pseudo-random signal. These sequences are created by linear feedback shift registers (LFSRs). This register structure, whose order is determined by the number of registers, is such that over its period it will produce the set of possible binary values for its order (if order 4 structure, there are 2 n possible values) .
- MLS Maximum Length Sequence
- the initial popularity of MLS stems from the ease of the deconvolution process.
- the signal MLS is such that for its deconvolution, one can use a transform called Hadamard transform, which simplifies the calculations and has the advantage of being computationally computationally using few resources.
- the first uses the passage in the frequency domain to make the calculations before returning to time.
- the second consists in non-periodically convolving the recorded signal with the excitation signal returned temporally:
- the method supports slight desynchronization: you can broadcast the sweep from one device and record with another without these two machines are synchronized by a clock.
- a sound impression of a listening medium for example a helmet
- Each of these impulse responses is captured from a reference signal at a high sampling rate, which is higher than the nominal sampling frequency of the playback equipment.
- the hallmark (3) is acquired from a white noise producing a file of 6 Mbytes per speaker, for a long time greater than 500 milliseconds, preferably between one and two seconds.
- the file corresponding to the impulse response is then compressed without loss (ZIP compression for example) and encrypted.
- the footprint of the headphones (1) is acquired in the same way with a white or pink signal of a duration of about 200 milliseconds, preferably between 100 and 500 milliseconds.
- the imprint of the equalizer (2) is acquired in the same way with a white or pink signal with a duration of about 200 milliseconds, advantageously between 100 and 500 milliseconds for each of the equalizer settings.
- a step (6) is performed to dynamically recalculate the left and right footprints according to the particularities of the playback equipment and, if appropriate, the sensory peculiarities of the listener. It has for example a setting means for changing the virtual spatial position. A modification of this setting controls the calculation of a new pair of fingerprints from the fingerprints initially provided, by morphing ("morphing"):
- This function can be controlled by the gyro sensor to create a dynamic displacement of the sound scene according to the user's movements It allows to center the voice in real time with respect to the head.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1353473A FR3004883B1 (fr) | 2013-04-17 | 2013-04-17 | Procede de restitution sonore d'un signal numerique audio |
PCT/FR2014/050846 WO2014170580A1 (fr) | 2013-04-17 | 2014-04-09 | Procédé de restitution sonore d'un signal numérique audio |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2987339A1 true EP2987339A1 (de) | 2016-02-24 |
EP2987339B1 EP2987339B1 (de) | 2017-07-12 |
Family
ID=48782399
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14721466.2A Not-in-force EP2987339B1 (de) | 2013-04-17 | 2014-04-09 | Verfahren zur akustischen wiedergabe eines numerischen audiosignals |
Country Status (7)
Country | Link |
---|---|
US (1) | US9609454B2 (de) |
EP (1) | EP2987339B1 (de) |
JP (1) | JP6438004B2 (de) |
CN (1) | CN105308989B (de) |
CA (1) | CA2909580A1 (de) |
FR (1) | FR3004883B1 (de) |
WO (1) | WO2014170580A1 (de) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA3007629A1 (en) | 2015-12-14 | 2017-06-22 | Red.Com, Llc | Modular digital camera and cellular phone |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0593228B1 (de) * | 1992-10-13 | 2000-01-05 | Matsushita Electric Industrial Co., Ltd. | Schallumgebungsimulator und Verfahren zur Schallfeldanalyse |
JPH08191225A (ja) * | 1995-01-09 | 1996-07-23 | Matsushita Electric Ind Co Ltd | 音場再生装置 |
AU1527197A (en) | 1996-01-04 | 1997-08-01 | Virtual Listening Systems, Inc. | Method and device for processing a multi-channel signal for use with a headphone |
EP1025743B1 (de) | 1997-09-16 | 2013-06-19 | Dolby Laboratories Licensing Corporation | Verwendung von filter-effekten bei stereo-kopfhörern zur verbesserung der räumlichen wahrnehmung einer schallquelle durch einen hörer |
JP2001224100A (ja) * | 2000-02-14 | 2001-08-17 | Pioneer Electronic Corp | 自動音場補正システム及び音場補正方法 |
JP2005217837A (ja) * | 2004-01-30 | 2005-08-11 | Sony Corp | サンプリングレート変換装置およびその方法、並びに、オーディオ装置 |
GB0419346D0 (en) * | 2004-09-01 | 2004-09-29 | Smyth Stephen M F | Method and apparatus for improved headphone virtualisation |
WO2008106680A2 (en) | 2007-03-01 | 2008-09-04 | Jerry Mahabub | Audio spatialization and environment simulation |
GB2467534B (en) * | 2009-02-04 | 2014-12-24 | Richard Furse | Sound system |
EP2656640A2 (de) | 2010-12-22 | 2013-10-30 | Genaudio, Inc. | Tonspatialisierung und umgebungssimulation |
FR2976759B1 (fr) | 2011-06-16 | 2013-08-09 | Jean Luc Haurais | Procede de traitement d'un signal audio pour une restitution amelioree. |
-
2013
- 2013-04-17 FR FR1353473A patent/FR3004883B1/fr not_active Expired - Fee Related
-
2014
- 2014-04-09 CA CA2909580A patent/CA2909580A1/fr not_active Abandoned
- 2014-04-09 WO PCT/FR2014/050846 patent/WO2014170580A1/fr active Application Filing
- 2014-04-09 JP JP2016508209A patent/JP6438004B2/ja active Active
- 2014-04-09 US US14/785,061 patent/US9609454B2/en not_active Expired - Fee Related
- 2014-04-09 EP EP14721466.2A patent/EP2987339B1/de not_active Not-in-force
- 2014-04-09 CN CN201480029770.7A patent/CN105308989B/zh not_active Expired - Fee Related
Non-Patent Citations (1)
Title |
---|
See references of WO2014170580A1 * |
Also Published As
Publication number | Publication date |
---|---|
US9609454B2 (en) | 2017-03-28 |
CN105308989B (zh) | 2017-06-20 |
US20160080882A1 (en) | 2016-03-17 |
FR3004883B1 (fr) | 2015-04-03 |
FR3004883A1 (fr) | 2014-10-24 |
EP2987339B1 (de) | 2017-07-12 |
CA2909580A1 (fr) | 2014-10-23 |
JP6438004B2 (ja) | 2018-12-12 |
JP2016519526A (ja) | 2016-06-30 |
CN105308989A (zh) | 2016-02-03 |
WO2014170580A1 (fr) | 2014-10-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1563485B1 (de) | Verfahren zur verarbeitung von audiodateien und erfassungsvorrichtung zur anwendung davon | |
EP2000002B1 (de) | Verfahren und einrichtung zur effizienten binauralen raumklangerzeugung im transformierten bereich | |
EP2042001B1 (de) | Binaurale spatialisierung kompressionsverschlüsselter tondaten | |
FR2852779A1 (fr) | Procede pour traiter un signal electrique de son | |
EP1999998A1 (de) | Verfahren zur kunstkopf-synthese unter berücksichtigung eines theatereffekts | |
WO2006075077A2 (fr) | Procede et dispositif d’individualisation de hrtfs par modelisation | |
JP2012509632A (ja) | オーディオ信号を変換するためのコンバータ及び方法。 | |
EP2009891B1 (de) | Übertragung eines Audiosignals in einem immersiven Audiokonferenzsystem | |
FR3065137A1 (fr) | Procede de spatialisation sonore | |
JP2005198251A (ja) | 球体を用いた3次元オーディオ信号処理システム及びその方法 | |
EP2987339B1 (de) | Verfahren zur akustischen wiedergabe eines numerischen audiosignals | |
WO2012172264A1 (fr) | Procede de traitement d'un signal audio pour une restitution amelioree | |
JPWO2020036077A1 (ja) | 信号処理装置、信号処理方法、およびプログラム | |
WO2023156578A1 (fr) | Procédé de traitement d'un signal sonore numérique pour émulation de disques vinyle | |
EP2815589B1 (de) | Transaurales syntheseverfahren zur schallspatialisierung | |
FR3069693B1 (fr) | Procede et systeme de traitement d'un signal audio incluant un encodage au format ambisonique | |
FR2967861A1 (fr) | Systeme electroacoustique pour une salle de spectacle | |
EP3449643B1 (de) | Verfahren und system zum senden eines 360°-audiosignals | |
TW437256B (en) | Apparatus and method for virtual sound enhancement | |
FR2943867A1 (fr) | Traitement d'egalisation de composantes spatiales d'un signal audio 3d | |
Bejoy | Virtual surround sound implementation using deccorrelation filters and HRTF |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20151007 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20170102 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 909362 Country of ref document: AT Kind code of ref document: T Effective date: 20170715 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014011727 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: ABREMA AGENCE BREVET ET MARQUES, GANGUILLET, CH |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 909362 Country of ref document: AT Kind code of ref document: T Effective date: 20170712 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171012 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171013 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171012 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171112 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602014011727 Country of ref document: DE Representative=s name: KOENIG SZYNKA TILMANN VON RENESSE PATENTANWAEL, DE Ref country code: DE Ref legal event code: R081 Ref document number: 602014011727 Country of ref document: DE Owner name: A3D TECHNOLOGIES LLC, LOS ANGELES, US Free format text: FORMER OWNERS: HAURAIS, JEAN-LUC, PARIS, FR; ROSSET, FRANCK, BRUXELLES, BE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014011727 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Owner name: A3D TECHNOLOGIES LLC, US Effective date: 20180412 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
26N | No opposition filed |
Effective date: 20180413 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20180709 AND 20180711 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: PD Owner name: A3D TECHNOLOGIES LLC; US Free format text: DETAILS ASSIGNMENT: CHANGE OF OWNER(S), ASSIGNMENT; FORMER OWNER NAME: ROSSET, FRANCK Effective date: 20180703 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180430 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180409 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180430 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180409 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20190325 Year of fee payment: 6 Ref country code: CH Payment date: 20190326 Year of fee payment: 6 Ref country code: IT Payment date: 20190321 Year of fee payment: 6 Ref country code: FR Payment date: 20190325 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20190327 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20190220 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170712 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20140409 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20170712 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PFUS Owner name: A3D TECHNOLOGIES LLC, US Free format text: FORMER OWNER: A3D TECHNOLOGIES LLC, US |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602014011727 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20200501 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201103 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200430 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200430 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200430 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20200409 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200501 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200409 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200409 |