EP2489039A1 - Optimized low-throughput parametric coding/decoding - Google Patents
Optimized low-throughput parametric coding/decodingInfo
- Publication number
- EP2489039A1 EP2489039A1 EP10785120A EP10785120A EP2489039A1 EP 2489039 A1 EP2489039 A1 EP 2489039A1 EP 10785120 A EP10785120 A EP 10785120A EP 10785120 A EP10785120 A EP 10785120A EP 2489039 A1 EP2489039 A1 EP 2489039A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- parameters
- signal
- coding
- spatial information
- decoded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 53
- 230000009467 reduction Effects 0.000 claims abstract description 13
- 230000005236 sound signal Effects 0.000 claims abstract description 11
- 238000013139 quantization Methods 0.000 claims description 21
- 238000001228 spectrum Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 11
- 239000011159 matrix material Substances 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 8
- 230000009466 transformation Effects 0.000 claims description 3
- 230000015654 memory Effects 0.000 description 9
- 230000015572 biosynthetic process Effects 0.000 description 5
- 238000003786 synthesis reaction Methods 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000000513 principal component analysis Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000003936 working memory Effects 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/03—Application of parametric coding in stereophonic audio systems
Definitions
- the present invention relates to the field of coding / decoding of digital signals.
- the coding and decoding according to the invention is particularly suitable for the transmission and / or storage of digital signals such as audio-frequency signals (speech, music or other).
- the present invention relates to the parametric encoding / decoding of multichannel audio signals.
- This type of coding / decoding is based on the extraction of spatial information parameters so that at decoding, these spatial characteristics can be reconstructed for the listener.
- This type of parametric encoding applies in particular for a stereo signal.
- a coding / decoding technique is for example described in the document by Breebaart, J. and van de Par, S and Kohlrausch, A. and Schuijers, titled "Parametric Coding of Stereo Audio” in EURASIP Journal on Applied Signal Processing 2005: 9, 1305-1322. This example is repeated with reference to FIGS. 1 and 2 respectively describing an encoder and a parametric stereo decoder.
- FIG. 1 describes an encoder receiving two audio channels, a left channel (denoted L for Left in English) and a right channel (denoted R for Right in English).
- the channels L (n) and R (n) are processed by the blocks 101, 102 and 103, 104 respectively which perform a short-term Fourier analysis.
- the transformed signals L [jJ and R [j] are thus obtained.
- the block 105 performs a channel reduction matrix or "Downmix” in English to obtain from the left and right signals, a sum signal, a mono signal in this case, in the frequency domain.
- ICLD InterChannel Level Difference
- interchannel intensity differences characterize the energy ratios per frequency subband between the left and right channels.
- L [j] and R [j] correspond to the spectral (complex) coefficients of the L and R channels
- the values B [k] and B [k + 1], for each frequency band k define the sub-division.
- spectrum band and the symbol * indicates the complex conjugate.
- a parameter of ICPD type (for "InterChannel Phase Difference” in English) also called phase difference by frequency subband, is defined according to the following relation:
- An interchannel time lag called ICTD (for "interchannel time difference") can also be defined equivalent to ICPD.
- An interchannel coherence parameter ICC (for "InterChannel Cohêt" in English) represents inter-channel correlation.
- the mono signal is passed in the time domain (blocks 106 to 108) after short-term Fourier synthesis (inverse FFT, windowing and OverLap-Add or OLA) and a mono coding (block 109) is realized. .
- the stereo parameters are quantized and coded in block 110.
- the spectrum of the signals (L [y], /? []) Is divided according to a nonlinear frequency scale of the ERB (Rectangular Bandwidth Equivalent) or Bark type, with a number of subbands typically ranging from 20 to 34. This scale defines the values of B (k) and B (k + 1) for each subband k.
- the settings (ICLD, ICPD, ICC) are encoded by scalar quantization possibly followed by entropy coding or differential coding.
- the ICLD is encoded by a non-uniform quantizer (ranging from -50 to +50 dB) with differential coding; the non-uniform quantization step exploits the fact that the higher the value of the ICLD, the lower the auditory sensitivity to variations of this parameter.
- a non-uniform quantizer ranging from -50 to +50 dB
- the mono signal is decoded (block 201), a de-correlator is used (block 202) to produce two versions M (n) and M '(n) of the decoded mono signal. These two signals passed in the frequency domain (blocks 203 to 206) and the decoded stereo parameters (block 207) are used by the stereo synthesis (block 208) to reconstruct the left and right channels in the frequency domain. These channels are finally reconstructed in the time domain (blocks 209 to 214).
- a stereo intensity coding technique (Intensity Stereo Coding) consists of coding the sum (M) channel as well as the ICLD energy ratios as defined above.
- Stereo intensity coding exploits the fact that the perception of high frequency components is mainly related to the temporal (energy) envelopes of the signal.
- MIC Coded Pulse Modulation
- ADPCM Adaptive Differential Coded Pulse Modulation
- ITU-T Recommendation G.722 which uses ADAPM for Adaptive Differential Pulse Code Modulation (ADPCM).
- ADPCM Adaptive Differential Pulse Code Modulation
- the input signal of a G.722-type encoder is in an expanded band with a minimum bandwidth of [50-7000 Hz] with a sampling frequency of 16 kHz.
- This signal is decomposed into two sub-bands [0-4000 Hz] and [4000-8000 Hz] obtained by decomposition of the signal by so-called quadrature mirror filters.
- Quadrature Mirror Filters (QMF) in English then each of the subbands is separately encoded by an ADPCM encoder.
- the low band is coded by a 6, 5 and 4 bit nested code ADPCM coding while the high band is coded by a 2 bit ADPCM coder per sample.
- the total bit rate is 64, 56 or 48 bit / s depending on the number of bits used for decoding the low band.
- Recommendation G.722 was first used in the Integrated Services Digital Network (ISDN) and then in the enhanced HD voice telephony (HD) or HD voice enhanced telephony applications in English.
- ISDN Integrated Services Digital Network
- HD enhanced HD voice telephony
- HD voice enhanced telephony applications in English.
- a quantized signal frame according to the G.722 standard consists of 6, 5 or 4 bit low band (0-4000 Hz) and 2 high band (4000-8000 Hz) coded quantization indices. Since the transmission frequency of the scalar indices is 8 kHz in each subband, the bit rate is 64, 56 or 48 kbit / s. In the G.722 standard, the 8 bits are distributed as follows: 2 bits for the high band, 6 bits for the low band. The last or last two bits of the low band can be "stolen" or replaced by data.
- G.722- SWB a standardization activity called G.722- SWB (as part of the Q.10 / 16 question described for example in document ITU-T: Annex Q10.J Terms of Reference ( ITU-T G.722 and ITU-T G.711WB, January 2009, WD04_G722G71 1SWBToRr3.doc) Extending the G.722 Recommendation in two ways:
- SWB Superwideband
- This stereo extension can extend wide-band mono coding or super-wide band mono coding.
- G.722 coding operates with short 5 ms frames. We are particularly interested here in the stereo extension of the G.722 broadband coding
- the spatial information represented by the ICLD or other parameters requires a bit rate (additional stereo extension) all the more important as the coding frames are short.
- This example thus illustrates the difficulty of performing a stereo extension of an encoder such as G.722 with short frames (of 5 ms).
- Direct encoding of the ICLD gives an additional bit rate (stereo extension) around 16 kbit / s which is already the maximum possible bit rate for the G.722 extension.
- a parametric encoding method of a multichannel digital audio signal comprising a coding step (G.722 Cod) of a signal resulting from a channel reduction matrix for the multichannel signal.
- the method is such that it further comprises the following steps:
- the spatial information parameters are divided into several blocks, coded over several frames.
- the coding rate is therefore spread over several frames, the coding of this information is therefore at a lower rate.
- the spatial information parameters are obtained by the following steps:
- FFT Frequency transformation
- the division of spatial information parameters is performed according to the frequency sub-bands obtained by cutting.
- This block distribution is performed according to the defined frequency subbands, so as to optimize the use of these parameters and minimize the impact on the multichannel signal quality.
- said spatial information parameters are defined as the energy ratio between the channels of the multichannel signal.
- the coding of a block of spatial information parameters is performed by non-uniform scalar quantization.
- This quantization is adapted to use a minimum of additional bit rate to a multichannel extension of the coding.
- the parameter division step makes it possible to obtain two blocks, a first block corresponding to the parameters of the first frequency sub-bands and a second block corresponding to the parameters of the last frequency sub-bands obtained by cutting.
- the step of dividing the parameters makes it possible to obtain two blocks interleaving the parameters of the different frequency sub-bands.
- the coding of the first block and the second block is performed according to whether the frame to be coded is of even index or odd index.
- the refreshing of the parameters is carried out according to a short rhythm, which makes it possible not to bring about perceptual degradation during the decoding.
- the method further includes a main component analysis step for obtaining the spatial information parameters including a rotation angle parameter and an energy ratio between a main component and a signal of a component. atmosphere.
- the invention also applies to a parametric decoding method of a multichannel digital audio signal comprising a step of decoding (G.722 Dec) a signal resulting from a channel reduction matrix for the multichannel signal.
- the method is such that it further comprises the following steps:
- the spatial information parameters are received on several successive frames and are decoded successively without requiring too much extra bitrate.
- the decoded and stored parameters of a preceding frame correspond to the parameters of the first frequency sub-bands of the decoding frequency band and the decoded parameters of the current frame correspond to the parameters of the last sub-bands of frequencies obtained by cutting or vice versa.
- the invention also relates to an encoder implementing the coding method comprising a coding module (304) of a signal resulting from a channel reduction matrix for the multichannel signal.
- the encoder is such that it further comprises:
- a module for selecting a parameter block according to the index of the current frame an encoding module of the parameter block selected for the current frame.
- the invention also relates to a decoder implementing the decoding method and comprising a module for decoding a signal from a channel reduction matrix for the multichannel signal.
- the decoder further comprises:
- a spatial information parameter decoding module received for a current frame of predetermined length of decoded signal
- a module for obtaining the decoded and stored parameters of at least one preceding frame and for associating these parameters with those decoded for the current frame;
- a module for reconstructing the multichannel signal from the decoded signal and the combination of parameters obtained for the current frame a module for reconstructing the multichannel signal from the decoded signal and the combination of parameters obtained for the current frame.
- It also relates to a computer program comprising code instructions for implementing the steps of the encoding method as described and to a computer program comprising code instructions for implementing the steps of a decoding method. as described, when these are executed by a processor.
- the invention finally relates to a storage means readable by a processor storing a computer program as described.
- FIG. 1 illustrates an encoder implementing a parametric coding known from the state of the art and previously described
- FIG. 2 illustrates a decoder implementing a parametric decoding known from the state of the art and previously described
- FIG. 3 illustrates an encoder according to one embodiment of the invention, implementing a coding method according to one embodiment of the invention
- FIG. 4 illustrates a decoder according to one embodiment of the invention, implementing a decoding method according to one embodiment of the invention
- FIG. 5 illustrates the division of a digital audio signal into frames in an encoder implementing a coding method according to one embodiment of the invention
- FIG. 6 illustrates a coding method and an encoder according to another embodiment of the invention.
- FIGS. 7a and 7b respectively illustrate a device able to implement the coding method and the decoding method according to one embodiment of the invention.
- This parametric stereo encoder operates in wideband with stereo signals sampled at 16 kHz with 5 ms frames.
- Each channel (L and R) is first pre-filtered by a high pass filter (HPF) eliminating the components below 50 Hz (blocks 301 and 302).
- HPF high pass filter
- M mono signal
- This signal is encoded (block 304) by a G.722 type encoder, as described, for example, in ITU-T Recommendation G.722, 7 kHz audio-coding within 64 kbit / s, Nov. 1988.
- the delay introduced in the G.722 type coding is 22 samples at 16 kHz.
- FIG. 5 The division of the signal into frames is defined with reference to FIG. 5.
- This figure illustrates the fact that the analysis window (solid line) of 10 ms covers the current frame of index t and the future frame of index t. +1 and the fact that a 50% overlap is used between the window of the current frame and the window (dotted line) of the previous frame.
- the block 31 1 for extracting spatial information parameters is now detailed.
- the latter comprises, in the case of the processing in the frequency domain, a first module 313 for cutting the spectra L [t, j] and? [, ./ ' ] in a predetermined number of frequency subbands, for example here in 20 subbands according to the scale defined below:
- This scale delimits (in number of Fourier coefficients) the frequency subbands of index k - 0 to 19.
- the module 314 comprises means for obtaining the spatial information parameters of the stereo signal.
- the parameters obtained are the interchannel intensity difference parameters, ICLD.
- al [t, k] and a R 2 [t, k ⁇ represent the energy of the left channel respectively
- these energies are calculated as follows:
- This formula amounts to combining the energy of two successive frames, which corresponds to a temporal support of 10 ms (15 ms if we count the effective temporal support of two successive windows).
- the module 314 therefore produces a series of ICLD parameters defined previously.
- ICLD parameters are divided into the division module 315, into several blocks.
- the parameters are divided into two blocks according to the following two parts: ⁇ 1CLD i, fcl] and ⁇ ICLD [f, A: 1]
- the module 316 then makes a selection (St.) of a block to be encoded according to the index of the current frame to be coded.
- the coding of these blocks at 312 is carried out for example by non-uniform scalar quantization.
- the coding of an ICLD block is achieved with: • 5 bits for the first ICLD parameter,
- This bit rate is therefore not too great and is sufficient to efficiently transmit the stereo parameters.
- Two successive frames suffice in this embodiment to obtain the spatial information parameters of the multichannel signal, the length of two frames being most often the length of an analysis window for a 50% overlap frequency transformation. .
- a shorter recovery window could be used to reduce the delay introduced.
- the coder described with reference to FIG. 3 implements a method of parametric encoding of a multichannel digital audio signal comprising a coding step (G.722 Cod) of a signal resulting from a channel reduction mastering of the channel. multichannel signal.
- the method further comprises the following steps:
- the encoder may operate at other frequencies (such as 32 kHz) and with different subband cutting.
- 37 bits are used for frames of even t-index and 40 bits for frames of odd t-indexes.
- the coding method thus described is easily generalized in the case where the parameters are divided into more than 2 blocks.
- the ICLD parameters are divided into 4 blocks:
- the coding of the ICLD parameters is then distributed over 4 successive frames with storage of the parameters decoded in the previous frames during the decoding.
- the calculation of the ICLD must then be modified to include more than 2 frames in the calculation of the energies [t, k].
- the coding of the ICLD parameters can then use the following allocation:
- this variant may however introduce audible spatialization defects.
- the encoding method thus described applies to the encoding of other parameters than the ICLD parameter.
- the coherence parameter (ICC) can be calculated and transmitted selectively in a manner similar to the ICLD.
- the two parameters can also be calculated and coded according to the coding method described above.
- FIG. 4 illustrates a decoder in one embodiment of the invention as well as the decoding method that it implements.
- the portion of bit stream scalable and received from the G.722 encoder is demultiplexed and decoded by a G.722 type decoder (block 401) in 56 or 64 kbit / s mode.
- the synthesized signal obtained corresponds to the mono signal M (n) in the absence of transmission errors.
- the part of the bit stream associated with the stereo extension is also demultiplexed at block 404.
- lCLD q [f, *]] 9 is decoded in the module 404 and these decoded parameters are stored in the module 412.
- tab_ild_q5 [31] ⁇ -50, -45, -40, -35, -30, -25, -22, -19, -16, -13, -10, -8, -6, -4, -2 , 0, 2, 4, 6, 8, 10, 13, 16, 19, 22, 25, 30, 35, 40, 45, 50) the decoding of a 5-bit index is to synthesize the parameter ICLD 4 [ t, k
- tab_ild_q4 [15] ⁇ - 16, -13, -10, -8, -6, -4, -2, 0, 2, 4, 6, 8, 10, 13, 16 ⁇ the decoding of an index i to 4 bits is to synthesize the ICLD parameter q [t, k] as
- the missing part of the parameters is used in the module, the stored values jlCLD q [t -
- the parameters for each of the frequency bands are thus obtained.
- the spectra of the left and right channels are reconstructed by the synthesis module 414 by applying the parameters jlCLD q [/ - l, *] J thus decoded by subband. This synthesis is carried out for example as follows:
- the left and right channels L (n) and R (n) are reconstructed by inverse discrete Fourier transform (blocks 406 and 409) of the respective spectra L [j] and R [j] and addition-overlap (blocks 408 and 411) with sinusoidal windowing (blocks 407 and 410).
- the method further comprises the following steps:
- Memorization of the decoded parameters for the current frame
- the bit rate of the stereo extension is therefore reduced and obtaining these parameters makes it possible to reconstruct a stereo signal of good quality.
- This module in this embodiment makes it possible to obtain other stereo parameters by applying a principal component analysis (PCA) such as that described in the article by Manuel Briand, David Virette and Nadine Martin entitled “Parametric coding of stereo audio based principal component analysis "published in the DAFX conference, 1991.
- PCA principal component analysis
- a principal component analysis is performed by subbands.
- the left and right channels thus analyzed are then rotated to obtain a main component and a qualified environment sub component.
- the stereo analysis produces, for each subband, a rotation angle parameter ( ⁇ ) and an energy ratio between the main component and the ambient signal ⁇ PCAR which stands for Principal Component to Ambience energy Ratio).
- the stereo parameters then consist of the angle of rotation parameter and the energy ratio ( ⁇ and PCAR).
- FIG. 6 illustrates another embodiment of an encoder according to the invention.
- the block 303 for stamping or "downmix" Compared to the encoder of FIG. 3, it is here the block 303 for stamping or "downmix" that differs.
- the "downmix" operation has the advantage of being instantaneous and of minimal complexity.
- the "downmix” operation here consists of the blocks 603a, 603b, 603c and 603d for the passage in the frequency domain.
- Blocks 603f, 603g and 603h make it possible to bring the mono signal back into the time domain in order to be coded by block 304 as for the encoder illustrated in FIG.
- This offset makes it possible to synchronize the time frames of the left / right channels and those of the decoded mono signal.
- the invention has been described here in the case of a G.722 encoder / decoder. it can obviously apply in the case of a modified G.722 encoder, for example including mechanisms of noise reduction ("noise feedback" in English) or including a scalable extension of G.722 with additional information.
- the invention can also be applied in the case of another mono encoder than the G.722 type such as for example a G.711.1 type encoder. In the latter case, the delay T must be adjusted to take into account the delay of the G.711.1 encoder.
- time-frequency analysis of the embodiment described with reference to FIG. 3 could be replaced according to different variants:
- MDCT modified discrete cosine transform
- the embodiment of the invention also extends to the more general case of the coding of multichannel signals (with more than 2 audio channels) starting from a mono or even stereo downmix.
- the coding of spatial information involves the coding and transmission of spatial information parameters. This is for example the case of 5.1 channel signals including a left channel (L), right (R), center (C), left rear (Ls for Left surround), right rear (Rs for Right surround), and subwoofer (LFE for Low Frequency Effects).
- the spatial information parameters of the multichannel signal then take into account the differences or the coherences between the different channels.
- the encoders and decoders as described with reference to FIGS. 3, 4 and 6 may be integrated in a multimedia equipment of the living room decoder type, computer or communication equipment such as a mobile telephone or personal electronic organizer.
- FIG. 7a represents an example of such multimedia equipment or coding device comprising an encoder according to the invention.
- This device comprises a PROC processor cooperating with a memory block BM having a storage and / or working memory MEM.
- the memory block may advantageously comprise a computer program comprising code instructions for implementing the steps of the coding method within the meaning of the invention, when these instructions are executed by the processor PROC, and in particular the steps:
- FIG. 3 shows the steps of an algorithm of such a computer program.
- the computer program can also be stored on a memory medium readable by a reader of the device or downloadable in the memory space of the equipment.
- the device comprises an input module adapted to receive a multichannel signal S m representing a sound scene, either by a communication network, or by reading a content stored on a storage medium.
- This multimedia equipment may also include means for capturing such a multichannel signal.
- the device comprises an output module capable of transmitting the coded spatial information parameters P c and a sum signal Ss resulting from the coding of the multichannel signal.
- FIG. 7b illustrates an example of multimedia equipment or decoding device comprising a decoder according to the invention.
- This device comprises a PROC processor cooperating with a memory block BM having a storage and / or working memory MEM.
- the memory block may advantageously comprise a computer program comprising code instructions for implementing the steps of the decoding method in the sense of the invention, when these instructions are executed by the processor PROC, and in particular the steps of:
- FIG. 4 repeats the steps of an algorithm of such a computer program.
- the computer program can also be stored on a memory medium readable by a reader of the device or downloadable in the memory space of the equipment.
- the device comprises an input module able to receive the coded spatial information parameters P c and a sum signal S s originating, for example, from a communication network. These input signals can come from a reading on a storage medium.
- the device comprises an output module capable of transmitting a multichannel signal decoded by the decoding method implemented by the equipment.
- This multimedia equipment may also include speaker-type reproduction means or communication means capable of transmitting this multi-channel signal.
- Such multimedia equipment may include both the encoder and the decoder according to the invention.
- the input signal then being the original multichannel signal and the output signal, the decoded multichannel signal.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0957254 | 2009-10-15 | ||
PCT/FR2010/052192 WO2011045548A1 (en) | 2009-10-15 | 2010-10-15 | Optimized low-throughput parametric coding/decoding |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2489039A1 true EP2489039A1 (en) | 2012-08-22 |
EP2489039B1 EP2489039B1 (en) | 2015-08-12 |
Family
ID=42109842
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10785120.6A Active EP2489039B1 (en) | 2009-10-15 | 2010-10-15 | Optimized low-throughput parametric coding/decoding |
Country Status (7)
Country | Link |
---|---|
US (1) | US9167367B2 (en) |
EP (1) | EP2489039B1 (en) |
JP (1) | JP5752134B2 (en) |
KR (1) | KR101646650B1 (en) |
CN (1) | CN102656628B (en) |
BR (1) | BR112012008793B1 (en) |
WO (1) | WO2011045548A1 (en) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120265542A1 (en) * | 2009-10-16 | 2012-10-18 | France Telecom | Optimized parametric stereo decoding |
CN103854650A (en) * | 2012-11-30 | 2014-06-11 | 中兴通讯股份有限公司 | Stereo audio coding method and device |
WO2014108738A1 (en) | 2013-01-08 | 2014-07-17 | Nokia Corporation | Audio signal multi-channel parameter encoder |
EP2976768A4 (en) * | 2013-03-20 | 2016-11-09 | Nokia Technologies Oy | Audio signal encoder comprising a multi-channel parameter selector |
CN105474308A (en) * | 2013-05-28 | 2016-04-06 | 诺基亚技术有限公司 | Audio signal encoder |
US9911423B2 (en) | 2014-01-13 | 2018-03-06 | Nokia Technologies Oy | Multi-channel audio signal classifier |
EP3067885A1 (en) * | 2015-03-09 | 2016-09-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for encoding or decoding a multi-channel signal |
FR3048808A1 (en) * | 2016-03-10 | 2017-09-15 | Orange | OPTIMIZED ENCODING AND DECODING OF SPATIALIZATION INFORMATION FOR PARAMETRIC CODING AND DECODING OF A MULTICANAL AUDIO SIGNAL |
CN105898669B (en) * | 2016-03-18 | 2017-10-20 | 南京青衿信息科技有限公司 | A kind of coding method of target voice |
CN105895106B (en) * | 2016-03-18 | 2020-01-24 | 南京青衿信息科技有限公司 | Panoramic sound coding method |
CN105895108B (en) * | 2016-03-18 | 2020-01-24 | 南京青衿信息科技有限公司 | Panoramic sound processing method |
CN107452387B (en) * | 2016-05-31 | 2019-11-12 | 华为技术有限公司 | A kind of extracting method and device of interchannel phase differences parameter |
US20180213340A1 (en) * | 2017-01-26 | 2018-07-26 | W. L. Gore & Associates, Inc. | High throughput acoustic vent structure test apparatus |
EP3706119A1 (en) * | 2019-03-05 | 2020-09-09 | Orange | Spatialised audio encoding with interpolation and quantifying of rotations |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10340099A (en) * | 1997-04-11 | 1998-12-22 | Matsushita Electric Ind Co Ltd | Audio decoder device and signal processor |
US7006555B1 (en) * | 1998-07-16 | 2006-02-28 | Nielsen Media Research, Inc. | Spectral audio encoding |
JP4387001B2 (en) * | 1999-08-27 | 2009-12-16 | 三菱電機株式会社 | Mobile station and communication method |
WO2003065353A1 (en) * | 2002-01-30 | 2003-08-07 | Matsushita Electric Industrial Co., Ltd. | Audio encoding and decoding device and methods thereof |
US7644001B2 (en) * | 2002-11-28 | 2010-01-05 | Koninklijke Philips Electronics N.V. | Differentially coding an audio signal |
JP2006259291A (en) * | 2005-03-17 | 2006-09-28 | Matsushita Electric Ind Co Ltd | Audio encoder |
US7991610B2 (en) * | 2005-04-13 | 2011-08-02 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Adaptive grouping of parameters for enhanced coding efficiency |
PL1754222T3 (en) * | 2005-04-19 | 2008-04-30 | Dolby Int Ab | Energy dependent quantization for efficient coding of spatial audio parameters |
EP1899960A2 (en) * | 2005-05-26 | 2008-03-19 | LG Electronics Inc. | Method of encoding and decoding an audio signal |
TWI396188B (en) * | 2005-08-02 | 2013-05-11 | Dolby Lab Licensing Corp | Controlling spatial audio coding parameters as a function of auditory events |
WO2007040349A1 (en) | 2005-10-05 | 2007-04-12 | Lg Electronics Inc. | Method and apparatus for signal processing |
CN101390443B (en) * | 2006-02-21 | 2010-12-01 | 皇家飞利浦电子股份有限公司 | Audio encoding and decoding |
CN101188878B (en) * | 2007-12-05 | 2010-06-02 | 武汉大学 | A space parameter quantification and entropy coding method for 3D audio signals and its system architecture |
-
2010
- 2010-10-15 KR KR1020127012552A patent/KR101646650B1/en active IP Right Grant
- 2010-10-15 BR BR112012008793-2A patent/BR112012008793B1/en active IP Right Grant
- 2010-10-15 US US13/502,316 patent/US9167367B2/en active Active
- 2010-10-15 JP JP2012533682A patent/JP5752134B2/en active Active
- 2010-10-15 WO PCT/FR2010/052192 patent/WO2011045548A1/en active Application Filing
- 2010-10-15 EP EP10785120.6A patent/EP2489039B1/en active Active
- 2010-10-15 CN CN201080056964.8A patent/CN102656628B/en active Active
Non-Patent Citations (1)
Title |
---|
See references of WO2011045548A1 * |
Also Published As
Publication number | Publication date |
---|---|
US9167367B2 (en) | 2015-10-20 |
JP2013508743A (en) | 2013-03-07 |
CN102656628B (en) | 2014-08-13 |
BR112012008793B1 (en) | 2021-02-23 |
US20120207311A1 (en) | 2012-08-16 |
KR101646650B1 (en) | 2016-08-08 |
JP5752134B2 (en) | 2015-07-22 |
CN102656628A (en) | 2012-09-05 |
EP2489039B1 (en) | 2015-08-12 |
WO2011045548A1 (en) | 2011-04-21 |
KR20120095920A (en) | 2012-08-29 |
BR112012008793A2 (en) | 2020-09-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2489039B1 (en) | Optimized low-throughput parametric coding/decoding | |
EP2374123B1 (en) | Improved encoding of multichannel digital audio signals | |
EP2374124B1 (en) | Advanced encoding of multi-channel digital audio signals | |
EP1600042B1 (en) | Method for the treatment of compressed sound data for spatialization | |
EP3427260B1 (en) | Optimized coding and decoding of spatialization information for the parametric coding and decoding of a multichannel audio signal | |
EP2691952B1 (en) | Allocation, by sub-bands, of bits for quantifying spatial information parameters for parametric encoding | |
EP2002424B1 (en) | Device and method for scalable encoding of a multichannel audio signal based on a principal component analysis | |
WO2012052676A1 (en) | Improved stereo parametric encoding/decoding for channels in phase opposition | |
EP2042001B1 (en) | Binaural spatialization of compression-encoded sound data | |
EP2319037B1 (en) | Reconstruction of multi-channel audio data | |
EP3391370A1 (en) | Adaptive channel-reduction processing for encoding a multi-channel audio signal | |
EP3014611A1 (en) | Improved frequency band extension in an audio signal decoder | |
EP2979266B1 (en) | Optimized partial mixing of audio streams encoded by sub-band encoding | |
WO2011073600A1 (en) | Parametric stereo encoding/decoding having downmix optimisation | |
EP2126905B1 (en) | Methods and devices for audio signals encoding and decoding, encoded audio signal | |
EP2489040A1 (en) | Optimized parametric stereo decoding | |
WO2023165946A1 (en) | Optimised encoding and decoding of an audio signal using a neural network-based autoencoder | |
FR2980620A1 (en) | Method for processing decoded audio frequency signal, e.g. coded voice signal including music, involves performing spectral attenuation of residue, and combining residue and attenuated signal from spectrum of tonal components |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20120507 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: HOANG, THI MINH NGUYET Inventor name: RAGOT, STEPHANE Inventor name: KOVESI, BALAZS |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ORANGE |
|
17Q | First examination report despatched |
Effective date: 20130909 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602010026664 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019000000 Ipc: G10L0019008000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/16 20130101ALN20150309BHEP Ipc: G10L 19/008 20130101AFI20150309BHEP Ipc: H04S 3/00 20060101ALI20150309BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150325 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 742758 Country of ref document: AT Kind code of ref document: T Effective date: 20150815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602010026664 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 6 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 742758 Country of ref document: AT Kind code of ref document: T Effective date: 20150812 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20150812 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151113 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151112 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151214 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151212 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602010026664 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151015 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
26N | No opposition filed |
Effective date: 20160513 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151031 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151015 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20101015 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150812 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230920 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230920 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230920 Year of fee payment: 14 |