EP3874771A1 - Détermination de codage et de décodage associé de paramètre audio spatial - Google Patents

Détermination de codage et de décodage associé de paramètre audio spatial

Info

Publication number
EP3874771A1
EP3874771A1 EP19879837.3A EP19879837A EP3874771A1 EP 3874771 A1 EP3874771 A1 EP 3874771A1 EP 19879837 A EP19879837 A EP 19879837A EP 3874771 A1 EP3874771 A1 EP 3874771A1
Authority
EP
European Patent Office
Prior art keywords
value
primary
directional
partition section
partitioning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19879837.3A
Other languages
German (de)
English (en)
Other versions
EP3874771A4 (fr
Inventor
Adriana Vasilache
Kari Järvinen
Jussi LEPPÄNEN
Tapani PIHLAJAKUJA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of EP3874771A1 publication Critical patent/EP3874771A1/fr
Publication of EP3874771A4 publication Critical patent/EP3874771A4/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field

Definitions

  • the present application relates to apparatus and methods for sound-field related parameter encoding, but not exclusively for time-frequency domain direction related parameter encoding for an audio encoder and decoder.
  • Parametric spatial audio processing is a field of audio signal processing where the spatial aspect of the sound is described using a set of parameters.
  • parameters such as directions of the sound in frequency bands, and the ratios between the directional and non-directional parts of the captured sound in frequency bands.
  • These parameters are known to well describe the perceptual spatial properties of the captured sound at the position of the microphone array.
  • These parameters can be utilized in synthesis of the spatial sound accordingly, for headphones binaurally, for loudspeakers, or to other formats, such as Ambisonics.
  • the directions and direct-to-total energy ratios in frequency bands are thus a parameterization that is particularly effective for spatial audio capture.
  • a parameter set consisting of a direction parameter in frequency bands and an energy ratio parameter in frequency bands (indicating the directionality of the sound) can be also utilized as the spatial metadata (which may also include other parameters such as coherence, spread coherence, number of directions, distance etc) for an audio codec.
  • these parameters can be estimated from microphone-array captured audio signals, and for example a stereo signal can be generated from the microphone array signals to be conveyed with the spatial metadata.
  • the stereo signal could be encoded, for example, with an AAC encoder.
  • a decoder can decode the audio signals into PCM signals, and process the sound in frequency bands (using the spatial metadata) to obtain the spatial output, for example a binaural output.
  • the aforementioned solution is particularly suitable for encoding captured spatial sound from microphone arrays (e.g., in mobile phones, VR cameras, stand- alone microphone arrays).
  • microphone arrays e.g., in mobile phones, VR cameras, stand- alone microphone arrays.
  • the directional components of the metadata which may comprise an elevation, azimuth (and energy ratio which is 1 -diffuseness) of a resulting direction, for each considered time/frequency subband. Quantization of these directional components is a current research topic.
  • an apparatus comprising means for: receiving values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determining a primary index value associated with the identified primary partition section; identifying at least one further partition section based on at least one further partitioning of the primary partition section; determining at least one further index value associated with the identified further partition section; combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • the means for identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may be further for: partitioning the range of the at least one directional value into quarters of hemispheres; and identifying through which of the quarters of hemispheres the at least one directional value passes.
  • the means for determining a primary index value associated with the identified primary partition section may be further for determining a three bit value associated with the identified quarter of the hemisphere through which the at least one directional value passes.
  • the means for identifying at least one further partition section based on at least one further partitioning of the primary partition section may be further for: recursively partitioning an identified section through which the at least one directional value passes into four further sections; and identifying which of the four further sections the at least one directional value passes.
  • the means for recursively partitioning an identified section through which the at least one directional value passes into four further sections, wherein the identified section has a pseudo-triangle surface may be further for: calculating angle coordinates of corners of a current pseudo-triangle; calculating angle coordinates of the mid vertex points of the current pseudo-triangle; and calculating angle coordinates of centres of each of the four further sections.
  • the means for calculating angle coordinates of centres of each of the four further sections may be further for employing a look-up table for calculating angle coordinates of centres of each of the four further sections.
  • the means for identifying which of the four further sections the at least one directional value passes may be for: determining distances between angle coordinates of centres of each of the four further sections and the at least one directional value; and selecting one of the four further sections based on the smallest absolute distances.
  • the means for determining at least one further index value associated with the identified further partition section may be further for determining a two bit value associated with the identified further partition section from the four further sections for each recursive partitioning.
  • the means for combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value may be further for juxtaposing the primary index value and at least one further index value bits.
  • the means for identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may be further for at least one of: rotating the at least one directional value before identifying a primary partition section based on a primary partitioning of a range of the at least one directional value; and determining a reference orientation for the partitioning the range of the at least one directional value into quarters of hemispheres based on the at least one directional value.
  • an apparatus comprising means for: receiving encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub-band; identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determining at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • the means for identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value may be further for identifying through which of partitioning of a sphere into quarters of hemispheres the at least one directional value passes.
  • the means for identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value may be further for identifying which of a recursively partitioned four further sections the at least one directional value passes based on the at least one further index value.
  • a method comprising: receiving values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determining a primary index value associated with the identified primary partition section; identifying at least one further partition section based on at least one further partitioning of the primary partition section; determining at least one further index value associated with the identified further partition section; combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • Identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may comprise: partitioning the range of the at least one directional value into quarters of hemispheres; and identifying through which of the quarters of hemispheres the at least one directional value passes.
  • Determining a primary index value associated with the identified primary partition section may further comprise determining a three bit value associated with the identified quarter of the hemisphere through which the at least one directional value passes.
  • Identifying at least one further partition section based on at least one further partitioning of the primary partition section may further comprise: recursively partitioning an identified section through which the at least one directional value passes into four further sections; and identifying which of the four further sections the at least one directional value passes.
  • Recursively partitioning an identified section through which the at least one directional value passes into four further sections, wherein the identified section has a pseudo-triangle surface may further comprise: calculating angle coordinates of corners of a current pseudo-triangle; calculating angle coordinates of the mid vertex points of the current pseudo-triangle; and calculating angle coordinates of centres of each of the four further sections.
  • Determining at least one further index value associated with the identified further partition section may further comprise determining a two bit value associated with the identified further partition section from the four further sections for each recursive partitioning.
  • Combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value may further comprise juxtaposing the primary index value and at least one further index value bits.
  • Identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may further comprise at least one of: rotating the at least one directional value before identifying a primary partition section based on a primary partitioning of a range of the at least one directional value; and determining a reference orientation for the partitioning the range of the at least one directional value into quarters of hemispheres based on the at least one directional value.
  • a method comprising: receiving encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub-band; identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determining at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • Identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value may further comprise identifying through which of partitioning of a sphere into quarters of hemispheres the at least one directional value passes.
  • Identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value may further comprise identifying which of a recursively partitioned four further sections the at least one directional value passes based on the at least one further index value.
  • an apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, be caused to at least to: receive values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; identify a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determine a primary index value associated with the identified primary partition section; identify at least one further partition section based on at least one further partitioning of the primary partition section; determine at least one further index value associated with the identified further partition section; combine the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • the apparatus caused to identify a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may further be caused to: partition the range of the at least one directional value into quarters of hemispheres; and identify through which of the quarters of hemispheres the at least one directional value passes.
  • the apparatus caused to determine a primary index value associated with the identified primary partition section may further be caused to determine a three bit value associated with the identified quarter of the hemisphere through which the at least one directional value passes.
  • the apparatus caused to identify at least one further partition section based on at least one further partitioning of the primary partition section may further be caused to: recursively partition an identified section through which the at least one directional value passes into four further sections; and identify which of the four further sections the at least one directional value passes.
  • the apparatus caused to recursively partition an identified section through which the at least one directional value passes into four further sections, wherein the identified section has a pseudo-triangle surface may further be caused to: calculate angle coordinates of corners of a current pseudo-triangle; calculate angle coordinates of the mid vertex points of the current pseudo-triangle; and calculate angle coordinates of centres of each of the four further sections.
  • the apparatus caused to calculate angle coordinates of centres of each of the four further sections may further be caused to employ a look-up table to calculate angle coordinates of centres of each of the four further sections.
  • the apparatus caused to identify which of the four further sections the at least one directional value passes may further be caused to: determine distances between angle coordinates of centres of each of the four further sections and the at least one directional value; and select one of the four further sections based on the smallest absolute distances.
  • the apparatus caused to determine at least one further index value associated with the identified further partition section may further be caused to determine a two bit value associated with the identified further partition section from the four further sections for each recursive partitioning.
  • the apparatus caused to combine the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value may further be caused to juxtapose the primary index value and at least one further index value bits.
  • the apparatus caused to identify a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may further be caused to perform at least one of: rotate the at least one directional value before identifying a primary partition section based on a primary partitioning of a range of the at least one directional value; and determine a reference orientation for the partitioning the range of the at least one directional value into quarters of hemispheres based on the at least one directional value.
  • an apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: receive encoded values for sub- bands of a frame, the values comprising a primary index and at least one further index for each sub-band; identify a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identify at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determine at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • the apparatus caused to identify a primary partition section partitioning of a range of the at least one directional value based on a primary index value may further be caused to identify through which of partitioning of a sphere into quarters of hemispheres the at least one directional value passes.
  • the apparatus caused to identify at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value may further be caused to identify which of a recursively partitioned four further sections the at least one directional value passes based on the at least one further index value.
  • an apparatus comprising: means for receiving values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; means for identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; means for determining a primary index value associated with the identified primary partition section; identifying at least one further partition section based on at least one further partitioning of the primary partition section; means for determining at least one further index value associated with the identified further partition section; means for combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • the means for identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may comprise: means for partitioning the range of the at least one directional value into quarters of hemispheres; and means for identifying through which of the quarters of hemispheres the at least one directional value passes.
  • the means for determining a primary index value associated with the identified primary partition section may further comprise means for determining a three bit value associated with the identified quarter of the hemisphere through which the at least one directional value passes.
  • the means for identifying at least one further partition section based on at least one further partitioning of the primary partition section may further comprise: means for recursively partitioning an identified section through which the at least one directional value passes into four further sections; and means for identifying which of the four further sections the at least one directional value passes.
  • the means for recursively partitioning an identified section through which the at least one directional value passes into four further sections, wherein the identified section has a pseudo-triangle surface may further comprise: means for calculating angle coordinates of corners of a current pseudo-triangle; means for calculating angle coordinates of the mid vertex points of the current pseudo-triangle; and means for calculating angle coordinates of centres of each of the four further sections.
  • the means for calculating angle coordinates of centres of each of the four further sections may further comprise means for employing a look-up table for calculating angle coordinates of centres of each of the four further sections.
  • the means for identifying which of the four further sections the at least one directional value passes may further comprise: means for determining distances between angle coordinates of centres of each of the four further sections and the at least one directional value; and means for selecting one of the four further sections based on the smallest absolute distances.
  • the means for determining at least one further index value associated with the identified further partition section may further comprise means for determining a two bit value associated with the identified further partition section from the four further sections for each recursive partitioning.
  • the means for combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value may further comprise means for juxtaposing the primary index value and at least one further index value bits.
  • the means for identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value may further comprise at least one of: means for rotating the at least one directional value before identifying a primary partition section based on a primary partitioning of a range of the at least one directional value; and means for determining a reference orientation for the partitioning the range of the at least one directional value into quarters of hemispheres based on the at least one directional value.
  • an apparatus comprising: means for receiving encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub-band; means for identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value; means for identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; means for determining at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • the means for identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value may further comprise means for identifying through which of partitioning of a sphere into quarters of hemispheres the at least one directional value passes.
  • the means for identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value may further comprise means for identifying which of a recursively partitioned four further sections the at least one directional value passes based on the at least one further index value.
  • a computer program comprising instructions [or a computer readable medium comprising program instructions] for causing an apparatus to perform at least the following: receiving values for sub- bands of a frame, the values comprising at least one directional value for each sub- band, each directional value comprising an azimuth value and an elevation value; identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determining a primary index value associated with the identified primary partition section; identifying at least one further partition section based on at least one further partitioning of the primary partition section; determining at least one further index value associated with the identified further partition section; combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • a computer program comprising instructions [or a computer readable medium comprising program instructions] for causing an apparatus to perform at least the following receiving encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub-band; identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determining at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • a non-transitory computer readable medium comprising program instructions for causing an apparatus to perform at least the following: receiving values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determining a primary index value associated with the identified primary partition section; identifying at least one further partition section based on at least one further partitioning of the primary partition section; determining at least one further index value associated with the identified further partition section; combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • a non-transitory computer readable medium comprising program instructions for causing an apparatus to perform at least the following: receiving encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub- band; identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determining at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • an apparatus comprising: receiving circuitry configured to receive values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; identifying circuitry configured to identify a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determining circuitry configured to determine a primary index value associated with the identified primary partition section; identifying circuitry configured to identify at least one further partition section based on at least one further partitioning of the primary partition section; determining circuitry configured to determine at least one further index value associated with the identified further partition section; combining circuitry configured to combine the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • an apparatus comprising: receiving circuitry configured to receive encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub- band; identifying circuitry configured to identify a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identifying circuitry configured to identify at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determining circuitry configured to determine at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • a computer readable medium comprising program instructions for causing an apparatus to perform at least the following: receiving values for sub-bands of a frame, the values comprising at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value; identifying a primary partition section based on a primary partitioning of a range of the at least one directional value and the at least one directional value; determining a primary index value associated with the identified primary partition section; identifying at least one further partition section based on at least one further partitioning of the primary partition section; determining at least one further index value associated with the identified further partition section; combining the primary index value and the at least one further index value to generate an embedded index value associated with the at least one directional value.
  • a computer readable medium comprising program instructions for causing an apparatus to perform at least the following: receiving encoded values for sub-bands of a frame, the values comprising a primary index and at least one further index for each sub-band; identifying a primary partition section partitioning of a range of the at least one directional value based on a primary index value; identifying at least one further partition section based on at least one further partitioning of the primary partition section based on at least one further index value; determining at least one directional value for each sub-band, each directional value comprising an azimuth value and an elevation value based on the identified at least one further partition section.
  • An apparatus comprising means for performing the actions of the method as described above.
  • An apparatus configured to perform the actions of the method as described above.
  • a computer program comprising program instructions for causing a computer to perform the method as described above.
  • a computer program product stored on a medium may cause an apparatus to perform the method as described herein.
  • An electronic device may comprise apparatus as described herein.
  • a chipset may comprise apparatus as described herein.
  • Embodiments of the present application aim to address problems associated with the state of the art.
  • Figure 1 shows schematically a system of apparatus suitable for implementing some embodiments
  • Figure 2 shows schematically the metadata encoder according to some embodiments
  • Figure 3 shows schematically the embedded index metadata encoder according to some embodiments
  • Figure 4 shows a flow diagram of the operation of the embedded index metadata encoder as shown in Figure 3 according to some embodiments
  • Figure 5 shows schematically the embedded index metadata decoder according to some embodiments
  • Figure 6 shows a flow diagram of the operation of the embedded index metadata decoder as shown in Figure 5 according to some embodiments
  • Figure 7a shows an example sphere and initial (primary) portioning of a directional sphere
  • Figure 7b shows an rotated or transformed further example sphere and initial (primary) portioning of a directional sphere
  • Figure 8 shows an example sphere section OABC and example divisions of an external surface of the sphere section OABC
  • Figure 9 shows an example sphere section OABC and example spherical section partitioning
  • Figure 10 shows an example Type I pseudo-triangle ABC, followed by subsequent division of the triangles of type II III, and IV;
  • Figure 1 1 a and 1 1 b shows an example quantization index assignment for two pseudo triangle orientations (basis down, and basis up);
  • Figure 12 shows schematically an example device suitable for implementing the apparatus shown.
  • the input format may be any suitable input format, such as multi-channel loudspeaker, ambisonic (FOA/FIOA) etc. It is understood that in some embodiments the channel location is based on a location of the microphone or is a virtual location or direction.
  • the output of the example system is a multi-channel loudspeaker arrangement. However it is understood that the output may be rendered to the user via means other than loudspeakers.
  • the multi- channel loudspeaker signals may be generalised to be two or more playback audio signals.
  • the metadata consists at least of elevation, azimuth and the energy ratio of a resulting direction, for each considered time/frequency subband.
  • other metadata parameters which may be obtained or determined are spread coherence, surround coherence, and distance.
  • the direction parameter components, the azimuth and the elevation are extracted from the audio data and then quantized to a given quantization resolution.
  • the resulting indexes may then be further compressed for efficient transmission.
  • the concept as discussed hereafter employs an embedded indexing of the directional information such that by dropping bits from the original indexes, the directional data can be obtained at a desired lower resolution, without having to recompile the quantization process.
  • the implementation of the embedded indexing is enabled by a proposed partitioning of the directional range sphere.
  • the use of the embedded indexing allows reading a reduced number of bits and form a reconstructed directional vector without requiring a requantization of the angles to a lower resolution quantizer.
  • the system 100 is shown with an ‘analysis’ part 121 and a‘synthesis’ part 131 .
  • The‘analysis’ part 121 is the part from receiving the multi-channel loudspeaker signals up to an encoding of the metadata and downmix signal and the‘synthesis’ part 131 is the part from a decoding of the encoded metadata and downmix signal to the presentation of the re-generated signal (for example in multi-channel loudspeaker form).
  • the input to the system 100 and the‘analysis’ part 121 is the multi-channel signals 102.
  • Any suitable input (or synthetic multi-channel) format may be received or obtained.
  • the input may be multichannel loudspeaker audio signals, microphone array audio signals, audio object signals.
  • the input can be audio objects (comprising one or more audio channels) and associated metadata, immersive multichannel signals, or Higher Order Ambisonics (HOA) signals.
  • HOA Higher Order Ambisonics
  • the multi-channel signals are passed to a transport signal generator 103 and to an analysis processor 105.
  • the transport signal generator 103 is configured to downmix or otherwise select or combine, for example, by beamforming techniques the input audio signals to a determined number of channels and output these as transport signals.
  • the analysis processor is configured to generate a 2 audio channel output. The determined number of channels may be two or any suitable number of channels.
  • the analysis processor is configured to create transport signals for each of different types of input audio signals, the created transport signals for each of different types of input audio signals differing in their number of channels.
  • the analysis part 121 is configured to pass the received input audio signals 102 unprocessed to an encoder in the same manner as the transport signals. In some embodiments the analysis part 121 is configured to select one or more of the input channel audio signals and output the selection as the transport signals 104.
  • the analysis processor 105 is also configured to receive the multi-channel signals and analyse the signals to produce metadata 106 associated with the multi-channel signals and thus associated with the transport signals 104.
  • the analysis processor 105 is configured to generate the metadata which may comprise, for each time-frequency analysis interval, a direction parameter 108 and an energy ratio parameter 1 10 (and in some embodiments a coherence parameter, and a diffuseness parameter).
  • the direction and energy ratio may in some embodiments be considered to be spatial audio parameters.
  • the spatial audio parameters comprise parameters which aim to characterize the sound-field created by the multi-channel signals (or two or more playback audio signals in general).
  • the parameters generated may differ from frequency band to frequency band.
  • band X all of the parameters are generated and transmitted, whereas in band Y only one of the parameters is generated and transmitted, and furthermore in band Z no parameters are generated or transmitted.
  • band Z no parameters are generated or transmitted.
  • a practical example of this may be that for some frequency bands such as the highest band some of the parameters are not required for perceptual reasons.
  • the downmix signals 104 and the metadata 106 may be passed to an encoder 107.
  • the encoder 107 may comprise an audio encoder core 109 which is configured to receive the downmix (or otherwise) signals 104 and generate a suitable encoding of these audio signals.
  • the encoder 107 can in some embodiments be a computer (running suitable software stored on memory and on at least one processor), or alternatively a specific device utilizing, for example, FPGAs or ASICs.
  • the encoding may be implemented using any suitable scheme.
  • the encoder 107 may furthermore comprise a metadata encoder/quantizer 1 1 1 which is configured to receive the metadata and output an encoded or compressed form of the information.
  • the encoder 107 may further interleave, multiplex to a single data stream or embed the metadata within encoded downmix signals before transmission or storage shown in Figure 1 by the dashed line.
  • the multiplexing may be implemented using any suitable scheme.
  • the received or retrieved data may be received by a decoder/demultiplexer 133.
  • the decoder/demultiplexer 133 may demultiplex the encoded streams and pass the audio encoded stream to a transport signal extractor 135 which is configured to decode the audio signals to obtain the transport signals.
  • the decoder/demultiplexer 133 may comprise a metadata extractor 137 which is configured to receive the encoded metadata and generate metadata.
  • the decoder/demultiplexer 133 can in some embodiments be a computer (running suitable software stored on memory and on at least one processor), or alternatively a specific device utilizing, for example, FPGAs or ASICs.
  • the decoded metadata and transport audio signals may be passed to a synthesis processor 139.
  • the system 100‘synthesis’ part 131 further shows a synthesis processor 139 configured to receive the transport signals and the metadata and re-create in any suitable format a synthesized spatial audio in the form of multi-channel signals 1 10 (these may be multichannel loudspeaker format or in some embodiments any suitable output format such as binaural or Ambisonics signals, depending on the use case) based on the downmix signals and the metadata.
  • the system (analysis part) is configured to receive multi-channel audio signals.
  • the system (analysis part) is configured to generate a suitable transport audio signal (for example by selecting some of the audio signal channels).
  • Suitable metadata may then be obtained, for example by analysis of the multi-channel audio signals (or by signal extraction of suitable metadata from the input).
  • the system is then configured to encode for storage/transmission the transport audio signal and the metadata.
  • the system may store/transmit the encoded transport and metadata.
  • the system may retrieve/receive the encoded transport audio signals and metadata.
  • the system is configured to extract the transport audio signals and metadata from encoded transport audio signals and metadata parameters, for example demultiplex and decode the encoded transport audio signals and metadata parameters.
  • the system (synthesis part) is configured to synthesize an output multi- channel audio signal based on extracted transport audio signals of multi-channel audio signals and metadata.
  • the analysis processor 105 in some embodiments comprises a time- frequency domain transformer 201 .
  • the time-frequency domain transformer 201 is configured to receive the multi-channel signals 102 and apply a suitable time to frequency domain transform such as a Short Time Fourier Transform (STFT) in order to convert the input time domain signals into a suitable time-frequency signals.
  • STFT Short Time Fourier Transform
  • These time-frequency signals may be passed to a spatial analyser 203.
  • the time-frequency signals 202 may be represented in the time-frequency domain representation by
  • n can be considered as a time index with a lower sampling rate than that of the original time-domain signals.
  • Each subband k has a lowest bin b k low and a highest bin b k high , and the subband contains all bins from b k low to b k high .
  • the widths of the subbands can approximate any suitable distribution. For example the Equivalent rectangular bandwidth (ERB) scale or the Bark scale.
  • the analysis processor 105 comprises a spatial analyser 203.
  • the spatial analyser 203 may be configured to receive the time- frequency signals 202 and based on these signals estimate direction parameters 108.
  • the direction parameters may be determined based on any audio based ‘direction’ determination.
  • the spatial analyser 203 is configured to estimate the direction with two or more signal inputs. This represents the simplest configuration to estimate a‘direction’, more complex processing may be performed with even more signals.
  • the spatial analyser 203 may thus be configured to provide at least one azimuth and elevation for each frequency band and temporal time block within a frame, denoted as azimuth (p(k,n) and elevation 0(k,n).
  • the direction parameters 108 may be also be passed to a direction index generator 205.
  • the spatial analyser 203 may also be configured to determine an energy ratio parameter 1 10.
  • the energy ratio may be considered to be a determination of the energy of the audio signal which can be considered to arrive from a direction.
  • the direct-to-total energy ratio r(k,n) can be estimated, e.g., using a stability measure of the directional estimate, or using any correlation measure, or any other suitable method to obtain a ratio parameter.
  • the energy ratio may be passed to an energy ratio encoder 227.
  • the spatial analyser 203 may also be configured to determine other parameters such as spread coherence, surround coherence, and distance.
  • the analysis processor is configured to receive time domain multichannel or other format such as microphone audio signals.
  • the parameters may be combined over several time indices. Same applies for the frequency axis, as has been expressed, the direction of several frequency bins b could be expressed by one direction parameter in band k consisting of several frequency bins b. The same applies for all of the discussed spatial parameters herein.
  • the metadata encoder/quantizer 1 1 1 may comprise a direction index generator 205 (or directional quantizer).
  • the direction index generator 205 is configured to receive the direction parameters (such as the azimuth (p(k, n) and elevation 0(k, n) 108 and from this generate a quantized output in the form of an index 206 to a combiner 207.
  • the metadata encoder/quantizer 1 1 1 may comprise an energy ratio encoder 223 which is configured to apply any suitable encoding and/or compression on the energy ratios and pass these to the combiner 207 is configured to receive the direction index values 206 (and other parameters such as energy ratios) and further encode them.
  • the combiner 207 is configured to receive an expected bit allocation and modify the direction index values based on the expected bit allocation.
  • the combiner 207 is configured to receive the compressed energy ratios and direction indices and combine these to generate the compressed metadata stream for storing/transmitting.
  • direction index generator 205 With respect to Figure 3 is shown an example direction index generator 205.
  • the direction parameters 300 are received and passed to a primary index generator 301 and a further index generator 303.
  • the primary index generator 301 in some embodiments is configured to receive the direction parameters as the azimuth (p(k, n) and elevation 0(k, n).
  • the primary index generator 301 is configured to perform a rough partitioning of the sphere.
  • the rough portioning may be a portioning of the sphere (within which the directional parameter range exists) into 8 equivalent regions. These regions may be shown for example by Figure 7 where the 8 regions are defined by OABC, OACY, OAYZ, OAZB (which defines the four‘northern’ hemisphere regions where the elevation is >0) and OXBC, OXCY, OXYZ, OXZB (which defines the four ‘southern’ hemisphere regions where the elevation is >0).
  • Each sphere section has a representative direction situated for instance in the centre of the section’s exterior surface. Since in this example there are 8 sphere sections, they can be represented by 3 bits.
  • the primary index generator 301 may therefore be configured to determine within which section the direction parameter is within and generate (or lookup) a first three bits for direction index (in other words generate a primary index l_0 representing the section within which the direction is.
  • This information may then be passed to a further index generator 303.
  • the further index generator 303 is configured to receive the direction parameter azimuth (p(k, n) and elevation 0(k, n) and furthermore the primary index value. The further index generator 303 may then be configured to perform an iterative process or sub-division of a current section (with for the second index is the division of one of the 8 sphere sections, for the third index is the division of the sub- section of one of the 8 sphere sections and so on). For example in some embodiments each sphere section is further divided in 4 similar parts. For example Figure 8 shows a ‘mapped’ representation of the external surface of the section OABC.
  • the external surface of the section OABC can be divided by point C’ on the vertex midpoint between A and B, B’ on the vertex midpoint between A and C, and A’ on the vertex midpoint between C and B.
  • the surface may be divided into four pseudo triangles, AC’B’ 800, C’BA’ 801 , A’CB’ 802 and A’B’C’ 803 which form 4 small sphere sections given by the centres of the formed“pseudo-triangles”.
  • the further index generator 303 can use two more bits to represent or identify which of the 4 sub-sections has the direction given by its centre closest to the direction to be encoded.
  • each“pseudo-triangle” is further divided into 4 similar parts and two more bits used to define which sub-division has the direction given by its centre closest to the direction to be encoded and so on.
  • the partitioning schematically represented in the 2D plane in Figure 8 corresponds to the 3D partitioning of the sphere section like presented in Figure 9.
  • the obtained 4 pseudo-triangles are similar to one another, but they can be divided into 4 types of pseudo-triangles, based on their orientation with respect to the spherical coordinates:
  • Type I gives type I, II, III, and IV II.
  • Type II gives 3 type-ll and one reversed type II (rll) where reversed means here reflected with respect to a vertical axis and then with respect to a horizontal axis
  • Type III gives 3 type III and one reversed type III (rill)
  • Type IV gives 3 type IV and one reversed type IV (rIV).
  • Reversed II gives 3 reversed II type and 1 type II.
  • Reversed III gives 3 reversed III type and 1 type III.
  • Reversed IV gives 3 reversed IV type and one type IV.
  • I pseudo triangle ABC generates the Type I upper corner-right isosceles pseudo- triangle AC’B’, L-right pseudo triangle C’BA’, R-right pseudo triangle B’A’C and isosceles pseudo-triangle C’A’B’.
  • Type IV isosceles pseudo-triangle C’A’B’ produces 3 type IV C’GE, GB’H, A ⁇ H and one reversed type IV (rIV) GEH.
  • q , q 2 and f , f 2 are the limits from lower to higher and from left to right of the elevation and azimuth angles of a pseudo-triangle, respectively.
  • the index is from 0 to 3 and it corresponds to one of (Voronoi) regions as drawn in Figure 8.
  • the secondary index generator may implement a look-up table which determines what pseudo- triangle shape is obtained as (Voronoi) region based on the quantization index and the pseudo-triangle shape that is partitioned.
  • Figure 11 a shows the example shown in Figure 8 where the index values 0 to 3 are assigned to the sub-divisions.
  • Figure 11 b shows the example shown in Figure 11a where the triangle C’B’A is further divided and the quantization index vales 0 to 3 are assigned to these sub- divisions.
  • the secondary index generator 303 may then output the index values to an index combiner 305.
  • the index combiner 305 is configured to receive the primary and further indices and generate a concatenated or otherwise combined index bitstream to the encoder.
  • the first operation is receiving the input direction defined by ( q , f) as shown in Figure 4 by step 401.
  • the following operation is to determine to which of the 8 spherical sections the input direction belongs to and save the associated primary (3bit) index l_0 as shown in Figure 4 by step 403.
  • the next operation is to determine the absolute value of Q and consider the corresponding spherical section from the“north hemisphere”.
  • the information about the elevation being negative is contained in the index l_0. This is shown in Figure 4 by step 405.
  • the squared brackets signify an integer part.
  • the first bit of the index l_0 corresponds to the sign of Q, 0 if North hemisphere, 1 if South hemisphere. Under these assumptions the indexes l_0 from 0 to 3 three correspond to the regions in the North hemisphere and the indexes from 4 to 7 to the regions in the South hemisphere.
  • the angle coordinates are decided based on which pseudo-triangle from the 4 available at each step has been selected.
  • the calculation of the angle coordinates of the corners is shown in Figure 4 by step 41 1 .
  • the angle coordinates of the mid vertexes points of the pseudo-triangle are calculated as shown in Figure 4 by step 413.
  • the angle coordinates of the mid vertexes are obtained as averages of the angle coordinates of the extreme points of each vertex.
  • angle coordinates of the centres of each of the 4 partitions can be calculated (for example using the table shown above) as shown in Figure 4 by step 415.
  • step 417 generated based on the input data with each of the 4 centers and select the one nearest to the input (based on the shortest distance) as shown in Figure 4 by step 417.
  • index value is determined associated with the nearest one to generate a 2 bit index l_k and based on the index l_k determine the type of the current pseudo-triangle as shown in Figure 4 by step 419.
  • an embedded index can be obtained by juxtaposing the bits of l_0, l_1 , l_2, l_3, l_4, l_5, l_6 and so on as shown in Figure 4 by step 423.
  • the initial or further sectioning of the sphere may differ.
  • the sphere should be rotated first.
  • the direction D in terms of elevation and azimuth is used to define the initial hemisphere sectioning by orienting the sphere such that it is rotated 90 degrees around ZC (from Figure 7) such that B is the top of the sphere (North pole) and then orienting the sphere by a rotation 45 degrees around AX such that B drops to the right.
  • the circle that passes through A, X and the intersection point of OD and the sphere is located in the Equator position.
  • rotations or transforms there may be two ways to perform the encoding.
  • a first implementation is to rotate the input direction according to the described rotations, then perform the search in a manner described above, and then inverse rotate the final representation of the direction to get back in the original space.
  • a further implementation may be transform according to these two rotations the initial search in the first 8 sub-sections and as well as the formulas for the angles and the definitions of the pseudo-triangles. For example as shown in the example shown in Figure 7b an initial search within the 8 initial subsections may be depicted in the thick dashed line shown.
  • the decoded directional parameter bitstream 500 is passed to a bit counter/index splitter 501 .
  • the direction parameter bitstream is the juxtaposition of indices l_0, M , I _ 2, l_3, I _ 4, I _ 5, l_6, and l_7.
  • the bit counter/index splitter 501 is configured to determine the number of indices 502 per parameter by counting the number of bits used to store the parameter. Furthermore in some embodiments this information (in the form of a suitable signal 502) is passed to a primary index decoder 503 and to a further index decoder 505.
  • this information in the form of a suitable signal 502
  • the number of bits used according the example shown in Figures 3 and 4 will be 3 (for only the primary index), 5 (primary index and one further index), 7 (primary index and two further indices), 9 (primary index and three further indices), 1 1 (primary index and four further indices), 13 (primary index and five further indices), 15 (primary index and six further indices), or 17 (primary index and seven further indices).
  • bit counter/index splitter 501 is furthermore configured to split the index values 504 such that the first index bits are passed to the primary index decoder 503 and the further index bits are passed to the further index decoder 505.
  • the primary index decoder 503 is configured to receive the first index bits and determine which section from the initial partition the direction is. For example in some embodiments where the index value is ⁇ 4 ⁇ 0:3 ⁇ then the directional elevation is >0 and otherwise is less than 0.
  • the primary index decoder furthermore may also determine a first set of limit angle coordinates based on the primary index value. For example in some embodiments this may be calculated as:
  • the primary index decoder is configured to set the current triangle type to a Type I triangle.
  • the current triangle type and the limit angle coordinates may then be passed to the further index decoder 505.
  • the further index decoder 505 may be configured to receive the current triangle type (CTT) value and the limit angle coordinates based on the primary index decoding from the primary index decoder 503 and furthermore receive the indication of how many further indices are to be decoded and the further index values from the bit counter/index splitter 501.
  • CTT current triangle type
  • the further index decoder 505 may then be configured to recursively use the further index values to generate further current triangle types values and limit angle coordinates.
  • the further index decoder 505 may then output the codevector direction 508.
  • the metadata extractor is configured to receive the embedded index bits N as shown in Figure 6 in step 601.
  • Flaving received the bits the number of indices, n, is determined as shown in Figure 6 by step 603.
  • the first three bits are read to determine the primary index l_0 as shown in Figure 6 by step 605.
  • step 609 This, in the example shown, is a Type I triangle.
  • next 2 bits are read to determine the first or next further index l_i as shown in Figure 6 by step 613. Based on the value of l_i and using a suitable determination (for example the look-up table defined above) the value of the current pseudo triangle type CTT is determined as shown in Figure 6 by step 615.
  • limit angle coordinates are updated as a function of l_i and CCT and set them as current limit angle coordinates as shown in Figure 6 by step 617.
  • step 61 1 the operation passes back to step 61 1 and a further loop started.
  • the direction is output based on the current limit angle coordinates as shown in Figure 6 by step 621 .
  • the device may be any suitable electronics device or apparatus.
  • the device 1400 is a mobile device, user equipment, tablet computer, computer, audio playback apparatus, etc.
  • the device 1400 comprises at least one processor or central processing unit 1407.
  • the processor 1407 can be configured to execute various program codes such as the methods such as described herein.
  • the device 1400 comprises a memory 141 1 .
  • the at least one processor 1407 is coupled to the memory 141 1 .
  • the memory 141 1 can be any suitable storage means.
  • the memory 141 1 comprises a program code section for storing program codes implementable upon the processor 1407.
  • the memory 141 1 can further comprise a stored data section for storing data, for example data that has been processed or to be processed in accordance with the embodiments as described herein.
  • the implemented program code stored within the program code section and the data stored within the stored data section can be retrieved by the processor 1407 whenever needed via the memory-processor coupling.
  • the device 1400 comprises a user interface 1405.
  • the user interface 1405 can be coupled in some embodiments to the processor 1407.
  • the processor 1407 can control the operation of the user interface 1405 and receive inputs from the user interface 1405.
  • the user interface 1405 can enable a user to input commands to the device 1400, for example via a keypad.
  • the user interface 1405 can enable the user to obtain information from the device 1400.
  • the user interface 1405 may comprise a display configured to display information from the device 1400 to the user.
  • the user interface 1405 can in some embodiments comprise a touch screen or touch interface capable of both enabling information to be entered to the device 1400 and further displaying information to the user of the device 1400.
  • the user interface 1405 may be the user interface for communicating with the position determiner as described herein.
  • the device 1400 comprises an input/output port 1409.
  • the input/output port 1409 in some embodiments comprises a transceiver.
  • the transceiver in such embodiments can be coupled to the processor 1407 and configured to enable a communication with other apparatus or electronic devices, for example via a wireless communications network.
  • the transceiver or any suitable transceiver or transmitter and/or receiver means can in some embodiments be configured to communicate with other electronic devices or apparatus via a wire or wired coupling.
  • the transceiver can communicate with further apparatus by any suitable known communications protocol.
  • the transceiver can use a suitable universal mobile telecommunications system (UMTS) protocol, a wireless local area network (WLAN) protocol such as for example IEEE 802.X, a suitable short-range radio frequency communication protocol such as Bluetooth, or infrared data communication pathway (IRDA).
  • UMTS universal mobile telecommunications system
  • WLAN wireless local area network
  • IRDA infrared data communication pathway
  • the transceiver input/output port 1409 may be configured to receive the signals and in some embodiments determine the parameters as described herein by using the processor 1407 executing suitable code. Furthermore the device may generate a suitable downmix signal and parameter output to be transmitted to the synthesis device.
  • the device 1400 may be employed as at least part of the synthesis device.
  • the input/output port 1409 may be configured to receive the downmix signals and in some embodiments the parameters determined at the capture device or processing device as described herein, and generate a suitable audio signal format output by using the processor 1407 executing suitable code.
  • the input/output port 1409 may be coupled to any suitable audio output for example to a multichannel speaker system and/or headphones or similar.
  • the various embodiments of the invention may be implemented in hardware or special purpose circuits, software, logic or any combination thereof.
  • some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto.
  • firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto.
  • While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
  • the embodiments of this invention may be implemented by computer software executable by a data processor of the mobile device, such as in the processor entity, or by hardware, or by a combination of software and hardware.
  • any blocks of the logic flow as in the Figures may represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions.
  • the software may be stored on such physical media as memory chips, or memory blocks implemented within the processor, magnetic media such as hard disk or floppy disks, and optical media such as for example DVD and the data variants thereof, CD.
  • the memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory.
  • the data processors may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASIC), gate level circuits and processors based on multi-core processor architecture, as non-limiting examples.
  • Embodiments of the inventions may be practiced in various components such as integrated circuit modules.
  • the design of integrated circuits is by and large a highly automated process.
  • Complex and powerful software tools are available for converting a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate.
  • California and Cadence Design of San Jose, California automatically route conductors and locate components on a semiconductor chip using well established rules of design as well as libraries of pre-stored design modules.
  • the resultant design in a standardized electronic format (e.g., Opus, GDSII, or the like) may be transmitted to a semiconductor fabrication facility or "fab" for fabrication.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

L'invention concerne un appareil comprenant des moyens destinés à recevoir des valeurs de sous-bandes d'une trame, les valeurs comprenant au moins une valeur directionnelle de chaque sous-bande, chaque valeur directionnelle comprenant une valeur d'azimut et une valeur d'élévation ; à identifier une section de partition primaire sur la base d'un partitionnement primaire d'une plage de ladite valeur directionnelle et de ladite valeur directionnelle ; à déterminer une valeur d'index primaire associée à la section de partition primaire identifiée ; à identifier au moins une autre section de partition sur la base d'au moins un autre partitionnement de la section de partition primaire ; à déterminer au moins une autre valeur d'index associée à l'autre section de partition identifiée ; à combiner la valeur d'index primaire et ladite autre valeur d'index pour générer une valeur d'index intégrée associée à ladite valeur directionnelle.
EP19879837.3A 2018-10-31 2019-10-01 Détermination de codage et de décodage associé de paramètre audio spatial Pending EP3874771A4 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1817809.5A GB2578604A (en) 2018-10-31 2018-10-31 Determination of spatial audio parameter encoding and associated decoding
PCT/FI2019/050703 WO2020089509A1 (fr) 2018-10-31 2019-10-01 Détermination de codage et de décodage associé de paramètre audio spatial

Publications (2)

Publication Number Publication Date
EP3874771A1 true EP3874771A1 (fr) 2021-09-08
EP3874771A4 EP3874771A4 (fr) 2022-08-17

Family

ID=64655560

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19879837.3A Pending EP3874771A4 (fr) 2018-10-31 2019-10-01 Détermination de codage et de décodage associé de paramètre audio spatial

Country Status (3)

Country Link
EP (1) EP3874771A4 (fr)
GB (1) GB2578604A (fr)
WO (1) WO2020089509A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023088560A1 (fr) * 2021-11-18 2023-05-25 Nokia Technologies Oy Traitement de métadonnées pour ambiophonie de premier ordre

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004272590A (ja) * 2003-03-07 2004-09-30 Sony Corp データ符号化装置及びデータ符号化方法、並びにコンピュータ・プログラム
US20060245601A1 (en) * 2005-04-27 2006-11-02 Francois Michaud Robust localization and tracking of simultaneously moving sound sources using beamforming and particle filtering
US7933770B2 (en) * 2006-07-14 2011-04-26 Siemens Audiologische Technik Gmbh Method and device for coding audio data based on vector quantisation
WO2013181272A2 (fr) * 2012-05-31 2013-12-05 Dts Llc Système audio orienté objet utilisant un panoramique d'amplitude sur une base de vecteurs
EP2860728A1 (fr) * 2013-10-09 2015-04-15 Thomson Licensing Procédé et appareil de codage et de décodage d'informations secondaires directionnelles
CA2835490A1 (fr) * 2013-11-27 2015-05-27 Akademia Gorniczo-Hutnicza Im. Stanislawa Staszica W Krakowie Systeme et procede permettant de determiner un ensemble approximatif d'objets visibles en matiere de tracage par faisceau

Also Published As

Publication number Publication date
EP3874771A4 (fr) 2022-08-17
GB2578604A (en) 2020-05-20
GB201817809D0 (en) 2018-12-19
WO2020089509A1 (fr) 2020-05-07

Similar Documents

Publication Publication Date Title
EP3861548B1 (fr) Sélection de schémas de quantification pour un codage de paramètre audio spatial
EP3732678B1 (fr) Détermination de codage de paramètre audio spatial et décodage associé
CN112639966A (zh) 空间音频参数编码和关联解码的确定
EP3707706B1 (fr) Détermination d'un codage de paramètre audio spatial et décodage associé
JP7213364B2 (ja) 空間オーディオパラメータの符号化及び対応する復号の決定
KR20220043159A (ko) 공간 오디오 방향 파라미터의 양자화
WO2020016479A1 (fr) Quantification éparse de paramètres audio spatiaux
KR102593235B1 (ko) 공간 오디오 파라미터의 양자화
EP3991170A1 (fr) Détermination de codage de paramètre audio spatial et décodage associé
KR20220047821A (ko) 공간 오디오 방향 파라미터의 양자화
EP3874771A1 (fr) Détermination de codage et de décodage associé de paramètre audio spatial
JPWO2020089510A5 (fr)
WO2019243670A1 (fr) Détermination d'un codage de paramètre audio spatial et décodage associé
US20240079014A1 (en) Transforming spatial audio parameters
CA3237983A1 (fr) Decodage de parametre audio spatial

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210531

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04S0003000000

Ipc: G10L0019008000

A4 Supplementary search report drawn up and despatched

Effective date: 20220715

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 19/02 20130101ALN20220711BHEP

Ipc: G10L 19/008 20130101AFI20220711BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240620

17Q First examination report despatched

Effective date: 20240626