EP2541547A1 - Procédé et appareil pour modifier les positions relatives d'objets de son contenu dans une représentation ambisonique d'ordre supérieur - Google Patents

Procédé et appareil pour modifier les positions relatives d'objets de son contenu dans une représentation ambisonique d'ordre supérieur Download PDF

Info

Publication number
EP2541547A1
EP2541547A1 EP11305845A EP11305845A EP2541547A1 EP 2541547 A1 EP2541547 A1 EP 2541547A1 EP 11305845 A EP11305845 A EP 11305845A EP 11305845 A EP11305845 A EP 11305845A EP 2541547 A1 EP2541547 A1 EP 2541547A1
Authority
EP
European Patent Office
Prior art keywords
warping
coefficients
order
vector
matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11305845A
Other languages
German (de)
English (en)
Inventor
Peter Jax
Johann-Markus Batke
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Priority to EP11305845A priority Critical patent/EP2541547A1/fr
Priority to CN201280032460.1A priority patent/CN103635964B/zh
Priority to PCT/EP2012/061477 priority patent/WO2013000740A1/fr
Priority to HUE12729512A priority patent/HUE051678T2/hu
Priority to KR1020147002760A priority patent/KR102012988B1/ko
Priority to EP12729512.9A priority patent/EP2727109B1/fr
Priority to AU2012278094A priority patent/AU2012278094B2/en
Priority to US14/130,074 priority patent/US9338574B2/en
Priority to JP2014517583A priority patent/JP5921678B2/ja
Priority to DK12729512.9T priority patent/DK2727109T3/da
Priority to BR112013032878-9A priority patent/BR112013032878B1/pt
Priority to TW101122126A priority patent/TWI526088B/zh
Publication of EP2541547A1 publication Critical patent/EP2541547A1/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2205/00—Details of stereophonic arrangements covered by H04R5/00 but not provided for in any of its subgroups
    • H04R2205/024—Positioning of loudspeaker enclosures for spatial sound reproduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/11—Application of ambisonics in stereophonic audio systems

Definitions

  • the invention relates to a method and to an apparatus for changing the relative positions of sound objects contained within a two-dimensional or a three-dimensional Higher-Order Ambisonics representation of an audio scene.
  • HOA Higher-order Ambisonics
  • space warping For manipulating or modifying a scene's contents, space warping has been proposed, including rotation and mirroring of HOA sound fields, and modifying the dominance of specific directions:
  • a problem to be solved by the invention is to facilitate the change of relative positions of sound objects contained within a HOA-based audio scene, without the need for analysing the composition of the scene. This problem is solved by the method disclosed in claim 1. An apparatus that utilises this method is disclosed in claim 2.
  • the invention uses space warping for modifying the spatial content and/or the reproduction of sound-field information that has been captured or produced as a higher-order Ambisonics representation.
  • Spatial warping in HOA domain represents both, a multi-step approach or, more computationally efficient, a single-step linear matrix multiplication. Different warping characteristics are feasible for 2D and 3D sound fields.
  • the warping is performed in space domain without performing scene analysis or decomposition.
  • Input HOA coefficients with a given order are decoded to the weights or input signals of regularly positioned (virtual) loudspeakers.
  • the inventive method is suited for changing the relative positions of sound objects contained within a two-dimensional or a three-dimensional Higher-Order Ambisonics HOA representation of an audio scene, wherein an input vector A in with dimension O in determines the coefficients of a Fourier series of the input signal and an output vector A out with dimension O out determines the coefficients of a Fourier series of the correspondingly changed output signal, said method including the steps:
  • the inventive apparatus is suited for changing the relative positions of sound objects contained within a two-dimensional or a three-dimensional Higher-Order Ambisonics HOA representation of an audio scene, wherein an input vector A in with dimension O in determines the coefficients of a Fourier series of the input signal and an output vector A out with dimension O out determines the coefficients of a Fourier series of the correspondingly changed output signal, said apparatus including:
  • the HOA 'signal' comprises a vector A of Ambisonics coefficients for each time instant.
  • a 2 ⁇ D A N - N ⁇ A N - 1 - N + 1 ... A 1 - 1 ⁇ A 0 0 ⁇ A 1 1 ... A N N T .
  • a 3 ⁇ D A 0 0 ⁇ A 1 - 1 ⁇ A 1 0 ⁇ A 1 1 ⁇ A 2 - 2 ... A N N T .
  • HOA representations behaves in a linear way and therefore the HOA coefficients for multiple, separate sound objects can be summed up in order to derive the HOA coefficients of the resulting sound field.
  • Plain encoding of multiple sound objects from several directions can be accomplished straight-forwardly in vector algebra.
  • encoding of a HOA representation can be interpreted as a space-frequency transformation because the input signals (sound objects) are spatially distributed.
  • the conditions for reversibility are that the mode matrix ⁇ must be square ( 0 ⁇ 0 ) and invertible.
  • the driver signals of real or virtual loudspeakers are derived that have to be applied in order to precisely play back the desired sound field as described by the input HOA coefficients.
  • Such decoding depends on the number M and positions of loudspeakers.
  • the three following important cases have to be distinguished (remark: these cases are simplified in the sense that they are defined via the 'number of loudspeakers', assuming that these are set up in a geometrically reasonable manner. More precisely, the definition should be done via the rank of the mode matrix of the targeted loudspeaker setup).
  • the mode matching decoding principle is applied, but other decoding principles can be utilised which may lead to different decoding rules for the three scenarios.
  • Fig. 1a The principle of the inventive space warping is illustrated in Fig. 1a .
  • the warping is performed in space domain. Therefore, first the input HOA coefficients A in with order N in and dimension 0 in are decoded in step/stage 12 to the weights or input signals s in for regularly positioned (virtual) loudspeakers.
  • a determined decoder i.e. one for which the number O warp of virtual loudspeakers is equal to or larger than the number of HOA coefficients O in .
  • the order or dimension of the vector A in of HOA coefficients can easily be extended by adding in step/stage 11 zero coefficients for higher orders.
  • the dimension of the target vector s in will be denoted by O warp in the sequel.
  • the positions of the virtual loudspeakers are modified in the 'warp' processing according to the desired warping characteristics. That warp processing is in step/stage 14 combined with encoding the target vector s in (or s out , respectively) using mode matrix ⁇ 2 , resulting in vector A out of warped HOA coefficients with dimension O warp or, following a further processing step described below, with dimension O out .
  • this (virtual) re-orientation can be compared to physically moving the loudspeakers to new positions.
  • the aforementioned modification of the loudspeaker density can be countered by applying a gain function g ( ⁇ ) to the virtual loudspeaker output signals s in in weighting step/stage 13, resulting in signal s out .
  • any weighting function g ( ⁇ ) can be specified.
  • weighting function can be used, e.g. in order to obtain an equal power per opening angle.
  • step/stage 14 the weighted virtual loudspeaker signals are warped and encoded again with the mode matrix ⁇ 2 by performing ⁇ 2 s out .
  • ⁇ 2 comprises different mode vectors than ⁇ 1 , according to the warping function ⁇ ( ⁇ ).
  • the result is an O warp -dimension HOA representation of the warped sound field.
  • this stripping operation can be described by a windowing operation: the encoded vector ⁇ 2 s out is multiplied with a window vector w which comprises zero coefficients for the highest orders that shall be removed, which multiplication can be considered as representing a further weighting.
  • a rectangular window can be applied, however, more sophisticated windows can be used as described in section 3 of M.A.
  • the space warping is performed as a function of the azimuth ⁇ only. This case is quite similar to the two-dimensional case introduced above.
  • Space warping has its maximum impact for sound objects on the equator, while it has the lowest impact to sound objects at the poles of the sphere.
  • a free orientation of the specific warping characteristics in space is feasible by (virtually) rotating the sphere before applying the warping and reversely rotating afterwards.
  • This formula can be applied in order to derive the angular distance between a point in space and another point that is by a small azimuth angle ⁇ ⁇ apart.
  • ⁇ Small' means as small as feasible in practical applications but not zero, in theory the limiting value ⁇ ⁇ ⁇ 0.
  • the two adaptions of orders within the multi-step approach i.e. the extension of the order preceding the decoder and the stripping of HOA coefficients after encoding, can also be integrated into the transformation matrix T by removing the corresponding columns and/or lines.
  • a matrix of the size O out ⁇ O in is derived which directly can be applied to the input HOA vectors.
  • the computational complexity required for performing the single-step processing according to Fig. 1b is significantly lower than that required for the multi-step approach of Fig. 1a , although the single-step processing delivers perfectly identical results. In particular, it avoids distortions that could arise if the multi-step processing is performed with a lower order N warp of its interim signals (see the below section How to set the HOA orders for details).
  • Rotations and mirroring of a sound field can be considered as 'simple' sub-categories of space warping.
  • the special characteristic of these transforms is that the relative position of sound objects with respect to each other is not modified. This means, a sound object that has been located e.g. 30° to the right of another sound object in the original sound scene will stay 30° to right of the same sound object in the rotated sound scene. For mirroring, only the sign changes but the angular distances remain the same. Algorithms and applications for rotation and mirroring of sound field information have been explored and described e.g. in the above mentioned Barton/Gerzon and J.Daniel articles, and in M. Noisternig, A. Sontacchi, Th. Musil, R.
  • all warping matrices for rotation and/or mirroring operations have the special characteristics that only coefficients of the same order n are affecting each other. Therefore these warping matrices are very sparsely populated, and the output N out can be equal to the input order N in without loosing any spatial information.
  • Fig. 2 illustrates an example of space warping in the two-dimensional (circular) case.
  • the warping function is shown in Fig. 2a .
  • This particular warping function ⁇ ( ⁇ ) has been selected because it guarantees a 2 ⁇ -periodic warping function while it allows to modify the amount of spatial distortion with a single parameter a.
  • Fig. 2c depicts the 7x25 single-step transformation warping matrix T .
  • the logarithmic absolute values of individual coefficients of the matrix are indicated by the gray scale or shading types according to the attached gray scale or shading bar.
  • a very useful characteristic of this particular warping matrix is that large portions of it are zero. This allows to save a lot of computational power when implementing this operation, but it is not a general rule that certain portions of a single-step transformation matrix are zero.
  • Fig. 2e shows the amplitude distributions for the same sound objects, but after the warping operation has been performed.
  • the beam patterns have become asymetric due to the large gradient of the Fig. 2b weighting function g( ⁇ ) for these angles.
  • the warping steps introduced above are rather generic and very flexible. At least the following basic operations can be accomplished: rotation and/or mirroring along arbitrary axes and/or planes, spatial distortion with a continuous warping function, and weighting of specific directions (spatial beamforming).
  • This property is essential because it allows to handle complex sound field information that comprises simultaneous contributions from different sound sources.
  • the space warping transformation is not space-invariant. This means that the operation behaves differently for sound objects that are originally located at different positions on the hemisphere.
  • this property is the result of the non-linearity of the warping function f( ⁇ ) , i.e. f ( ⁇ + ⁇ ) ⁇ f ( ⁇ ) + ⁇ (30) for at least some arbitrary angles ⁇ ⁇ ]0 ...2 ⁇ [.
  • the transformation matrix T cannot be simply reversed by mathematical inversion.
  • T normally is not square. Even a square space warping matrix will not be reversible because information that is typically spread from lower-order coefficients to higher-order coefficients will be lost (compare section How to set the HOA or ders and the example in section Example), and loosing information in an operation means that the operation cannot be reversed.
  • HOA orders An important aspect to be taken into account when designing a space warping transformation are HOA orders. While, normally, the order N in of the input vectors A in are predefined by external constraints, both the order N out of the output vectors A out and the 'inner' order N warp of the actual non-linear warping operation can be assigned more or less arbitrarily. However, that both orders N in and N warp have to be chosen with care as explained below.
  • the 'inner' order N warp defines the precision of the actual decoding, warping and encoding steps in the multi-step space warping processing described above.
  • the order N warp should be considerably larger than both the input order N in and the output order N out . The reason for this requirement is that otherwise distortions and artifacts will be produced because the warping operation is, in general, a non-linear operation.
  • FIG. 3 shows an example of the full warping matrix for the same warping function as used for the example from Fig. 2 .
  • Figures 3a, 3c and 3e depict the warping functions f 1 ( ⁇ ), f 2 ( ⁇ ) and f 3 ( ⁇ ) , respectively.
  • Figures 3b, 3d and 3f depict the warping matrices T 1 (dB), T 2 (dB) and T 3 (dB), respectively.
  • these warping matrices have not been clipped in order to determine the warping matrix for a specific input order N in or output order N out .
  • the dotted lines of the centred box within figures 3b, 3d and 3f depict the target size N out x N in of the final resulting, i.e. clipped transformation matrix. In this way the impact of non-linear distortions to the warping matrix is clearly visible.
  • FIG. 3d Another scenario is shown in Fig. 3d .
  • the figure shows that the extension of the distortions scales linearly with the inner order.
  • the result is that the higher-order coefficients of the output of the transformation is polluted by distortion products.
  • the advantage of such scaling property is that it seems possible to avoid these kind of non-linear distortions by increasing the inner order N warp accordingly.
  • the reduction of the inner order N warp to the output order N out can be done by mere dropping of higher-order coefficients. This corresponds to applying a rectangular window to the HOA output vectors.
  • more sophisticated bandwidth reduction techniques can be applied like those discussed in the above-mentioned M.A. Poletti article or in the above-mentioned J. Daniel article. Thereby, even more information is likely to be lost than with rectangular windowing, but superior directivity patterns can be accomplished.
  • the invention can be used in different parts of an audio processing chain, e.g. recording, post production, transmission, playback.
EP11305845A 2011-06-30 2011-06-30 Procédé et appareil pour modifier les positions relatives d'objets de son contenu dans une représentation ambisonique d'ordre supérieur Withdrawn EP2541547A1 (fr)

Priority Applications (12)

Application Number Priority Date Filing Date Title
EP11305845A EP2541547A1 (fr) 2011-06-30 2011-06-30 Procédé et appareil pour modifier les positions relatives d'objets de son contenu dans une représentation ambisonique d'ordre supérieur
CN201280032460.1A CN103635964B (zh) 2011-06-30 2012-06-15 改变包含在高阶高保真度立体声响复制表示中声音对象相对位置的方法以及装置
PCT/EP2012/061477 WO2013000740A1 (fr) 2011-06-30 2012-06-15 Procédé et appareil permettant de modifier les positions relatives d'objets sonores contenus dans une représentation d'ambiophonie d'ordre supérieur
HUE12729512A HUE051678T2 (hu) 2011-06-30 2012-06-15 Eljárás és berendezés hangobjektumok relatív helyeinek megváltoztatására magasabb rendû ambiszonikus reprezentációban
KR1020147002760A KR102012988B1 (ko) 2011-06-30 2012-06-15 고차 앰비소닉스 표현 내에 포함된 사운드 오브젝트들의 상대적인 위치들을 변경하는 방법 및 장치
EP12729512.9A EP2727109B1 (fr) 2011-06-30 2012-06-15 Procédé et appareil permettant de modifier les positions relatives d'objets sonores contenus dans une représentation d'ambiophonie d'ordre supérieur
AU2012278094A AU2012278094B2 (en) 2011-06-30 2012-06-15 Method and apparatus for changing the relative positions of sound objects contained within a higher-order ambisonics representation
US14/130,074 US9338574B2 (en) 2011-06-30 2012-06-15 Method and apparatus for changing the relative positions of sound objects contained within a Higher-Order Ambisonics representation
JP2014517583A JP5921678B2 (ja) 2011-06-30 2012-06-15 高次Ａｍｂｉｓｏｎｉｃｓ表現に含まれるサウンドオブジェクトの相対位置を変更する方法と装置
DK12729512.9T DK2727109T3 (da) 2011-06-30 2012-06-15 Fremgangsmåde og apparat til ændring af de relative positioner af lydobjekter indeholdt i en højer-ordens-ambisonics-gengivelse
BR112013032878-9A BR112013032878B1 (pt) 2011-06-30 2012-06-15 Método e aparelho para mudar as posições relativas de objetos de som contidos dentro de uma representação ambisônica de ordem superior
TW101122126A TWI526088B (zh) 2011-06-30 2012-06-21 聲訊場景二維或三維高階保真立體音響呈現所含聲音客體相對位置之改變方法和裝置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP11305845A EP2541547A1 (fr) 2011-06-30 2011-06-30 Procédé et appareil pour modifier les positions relatives d'objets de son contenu dans une représentation ambisonique d'ordre supérieur

Publications (1)

Publication Number Publication Date
EP2541547A1 true EP2541547A1 (fr) 2013-01-02

Family

ID=46354265

Family Applications (2)

Application Number Title Priority Date Filing Date
EP11305845A Withdrawn EP2541547A1 (fr) 2011-06-30 2011-06-30 Procédé et appareil pour modifier les positions relatives d'objets de son contenu dans une représentation ambisonique d'ordre supérieur
EP12729512.9A Active EP2727109B1 (fr) 2011-06-30 2012-06-15 Procédé et appareil permettant de modifier les positions relatives d'objets sonores contenus dans une représentation d'ambiophonie d'ordre supérieur

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP12729512.9A Active EP2727109B1 (fr) 2011-06-30 2012-06-15 Procédé et appareil permettant de modifier les positions relatives d'objets sonores contenus dans une représentation d'ambiophonie d'ordre supérieur

Country Status (11)

Country Link
US (1) US9338574B2 (fr)
EP (2) EP2541547A1 (fr)
JP (1) JP5921678B2 (fr)
KR (1) KR102012988B1 (fr)
CN (1) CN103635964B (fr)
AU (1) AU2012278094B2 (fr)
BR (1) BR112013032878B1 (fr)
DK (1) DK2727109T3 (fr)
HU (1) HUE051678T2 (fr)
TW (1) TWI526088B (fr)
WO (1) WO2013000740A1 (fr)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140219455A1 (en) * 2013-02-07 2014-08-07 Qualcomm Incorporated Mapping virtual speakers to physical speakers
WO2015147435A1 (fr) * 2014-03-25 2015-10-01 인텔렉추얼디스커버리 주식회사 Système et procédé de traitement de signal audio
JP2016508343A (ja) * 2013-01-16 2016-03-17 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ Ｈｏａラウドネスレベルを測定する方法及びｈｏａラウドネスレベルを測定する装置
WO2016057935A1 (fr) * 2014-10-10 2016-04-14 Qualcomm Incorporated Adaptation d'un contenu de hoa en fonction d'un écran
US9451363B2 (en) 2012-03-06 2016-09-20 Dolby Laboratories Licensing Corporation Method and apparatus for playback of a higher-order ambisonics audio signal
WO2017066300A3 (fr) * 2015-10-14 2017-05-18 Qualcomm Incorporated Adaptation écran de contenu ambisonique d'ordre supérieur
US9685163B2 (en) 2013-03-01 2017-06-20 Qualcomm Incorporated Transforming spherical harmonic coefficients
CN105340008B (zh) * 2013-05-29 2019-06-14 高通股份有限公司 声场的经分解表示的压缩
US10499176B2 (en) 2013-05-29 2019-12-03 Qualcomm Incorporated Identifying codebooks to use when coding spatial components of a sound field
US10770087B2 (en) 2014-05-16 2020-09-08 Qualcomm Incorporated Selecting codebooks for coding vectors decomposed from higher-order ambisonic audio signals
CN113793617A (zh) * 2014-06-27 2021-12-14 杜比国际公司 针对hoa数据帧表示的压缩确定表示非差分增益值所需的最小整数比特数的方法

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2665208A1 (fr) 2012-05-14 2013-11-20 Thomson Licensing Procédé et appareil de compression et de décompression d'une représentation de signaux d'ambiophonie d'ordre supérieur
US9288603B2 (en) 2012-07-15 2016-03-15 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for backward-compatible audio coding
US9473870B2 (en) 2012-07-16 2016-10-18 Qualcomm Incorporated Loudspeaker position compensation with 3D-audio hierarchical coding
US9460729B2 (en) * 2012-09-21 2016-10-04 Dolby Laboratories Licensing Corporation Layered approach to spatial audio coding
US10178489B2 (en) * 2013-02-08 2019-01-08 Qualcomm Incorporated Signaling audio rendering information in a bitstream
US9609452B2 (en) 2013-02-08 2017-03-28 Qualcomm Incorporated Obtaining sparseness information for higher order ambisonic audio renderers
US9883310B2 (en) 2013-02-08 2018-01-30 Qualcomm Incorporated Obtaining symmetry information for higher order ambisonic audio renderers
EP2765791A1 (fr) * 2013-02-08 2014-08-13 Thomson Licensing Procédé et appareil pour déterminer des directions de sources sonores non corrélées dans une représentation d'ambiophonie d'ordre supérieur d'un champ sonore
US9466305B2 (en) 2013-05-29 2016-10-11 Qualcomm Incorporated Performing positional analysis to code spherical harmonic coefficients
EP2824661A1 (fr) * 2013-07-11 2015-01-14 Thomson Licensing Procédé et appareil de génération à partir d'une représentation dans le domaine des coefficients de signaux HOA et représentation dans un domaine mixte spatial/coefficient de ces signaux HOA
US9712939B2 (en) 2013-07-30 2017-07-18 Dolby Laboratories Licensing Corporation Panning of audio objects to arbitrary speaker layouts
EP2866475A1 (fr) * 2013-10-23 2015-04-29 Thomson Licensing Procédé et appareil pour décoder une représentation du champ acoustique audio pour lecture audio utilisant des configurations 2D
US9813837B2 (en) 2013-11-14 2017-11-07 Dolby Laboratories Licensing Corporation Screen-relative rendering of audio and encoding and decoding of audio for such rendering
CN111179955B (zh) 2014-01-08 2024-04-09 杜比国际公司 包括编码hoa表示的位流的解码方法和装置、以及介质
US9502045B2 (en) 2014-01-30 2016-11-22 Qualcomm Incorporated Coding independent frames of ambient higher-order ambisonic coefficients
US9922656B2 (en) * 2014-01-30 2018-03-20 Qualcomm Incorporated Transitioning of ambient higher-order ambisonic coefficients
EP4089674A1 (fr) 2014-03-21 2022-11-16 Dolby International AB Procédé de décompression d'un signal hoa comprimé et appareil de décompression d'un signal hoa comprimé
EP2922057A1 (fr) * 2014-03-21 2015-09-23 Thomson Licensing Procédé de compression d'un signal d'ordre supérieur ambisonique (HOA), procédé de décompression d'un signal HOA comprimé, appareil permettant de comprimer un signal HO et appareil de décompression d'un signal HOA comprimé
AU2015238448B2 (en) * 2014-03-24 2019-04-18 Dolby International Ab Method and device for applying Dynamic Range Compression to a Higher Order Ambisonics signal
US9620137B2 (en) 2014-05-16 2017-04-11 Qualcomm Incorporated Determining between scalar and vector quantization in higher order ambisonic coefficients
US9852737B2 (en) 2014-05-16 2017-12-26 Qualcomm Incorporated Coding vectors decomposed from higher-order ambisonics audio signals
WO2015197517A1 (fr) * 2014-06-27 2015-12-30 Thomson Licensing Représentation de trames de données hoa codées qui comprend des valeurs de gain non différentielles associées à des signaux de canaux de trames spécifiques parmi les trames de données d'une représentation de trames de données hoa
EP3162086B1 (fr) * 2014-06-27 2021-04-07 Dolby International AB Appareil pour déterminer, pour la compression d'une représentation de trame de données hoa, un nombre entier le plus petit de bits requis pour représenter des valeurs de gain non différentielles
EP2960903A1 (fr) 2014-06-27 2015-12-30 Thomson Licensing Procédé et appareil de détermination de la compression d'une représentation d'une trame de données HOA du plus petit nombre entier de bits nécessaires pour représenter des valeurs de gain non différentielles
US9747910B2 (en) 2014-09-26 2017-08-29 Qualcomm Incorporated Switching between predictive and non-predictive quantization techniques in a higher order ambisonics (HOA) framework
KR102605480B1 (ko) * 2014-11-28 2023-11-24 소니그룹주식회사 송신 장치, 송신 방법, 수신 장치 및 수신 방법
WO2016182184A1 (fr) * 2015-05-08 2016-11-17 삼성전자 주식회사 Dispositif et procédé de restitution sonore tridimensionnelle
WO2017118551A1 (fr) * 2016-01-04 2017-07-13 Harman Becker Automotive Systems Gmbh Génération de champ d'onde acoustique
EP3188504B1 (fr) 2016-01-04 2020-07-29 Harman Becker Automotive Systems GmbH Reproduction multimédia pour une pluralité de destinataires
EP3209036A1 (fr) 2016-02-19 2017-08-23 Thomson Licensing Procédé, support de stockage lisible par ordinateur et appareil pour determiner une scène sonore cible à une position cible de deux ou plusieurs scènes sonores source
US10210660B2 (en) * 2016-04-06 2019-02-19 Facebook, Inc. Removing occlusion in camera views
KR102230645B1 (ko) * 2016-09-14 2021-03-19 매직 립, 인코포레이티드 공간화 오디오를 갖는 가상 현실, 증강 현실 및 혼합 현실 시스템들
MC200186B1 (fr) * 2016-09-30 2017-10-18 Coronal Encoding Procédé de conversion, d'encodage stéréophonique, de décodage et de transcodage d'un signal audio tridimensionnel
US10721578B2 (en) 2017-01-06 2020-07-21 Microsoft Technology Licensing, Llc Spatial audio warp compensator
AR112504A1 (es) 2017-07-14 2019-11-06 Fraunhofer Ges Forschung Concepto para generar una descripción mejorada de campo de sonido o un campo de sonido modificado utilizando una descripción multi-capa
RU2736418C1 (ru) * 2017-07-14 2020-11-17 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Принцип формирования улучшенного описания звукового поля или модифицированного описания звукового поля с использованием многоточечного описания звукового поля

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2073556B (en) 1980-02-23 1984-02-22 Nat Res Dev Sound reproduction systems
DE69839212T2 (de) * 1997-06-17 2009-03-19 British Telecommunications P.L.C. Raumklangwiedergabe
JP2001084000A (ja) * 1999-09-08 2001-03-30 Roland Corp 波形再生装置
AU2002359445A1 (en) 2001-11-21 2004-07-14 Aliphcom Method and apparatus for removing noise from electronic signals
FR2836571B1 (fr) * 2002-02-28 2004-07-09 Remy Henri Denis Bruno Procede et dispositif de pilotage d'un ensemble de restitution d'un champ acoustique
FR2847376B1 (fr) 2002-11-19 2005-02-04 France Telecom Procede de traitement de donnees sonores et dispositif d'acquisition sonore mettant en oeuvre ce procede
JP2006516548A (ja) 2002-12-30 2006-07-06 アンジオテック インターナショナル アクツィエン ゲゼルシャフト 迅速ゲル化ポリマー組成物からの薬物送達法
CN1226718C (zh) * 2003-03-04 2005-11-09 无敌科技股份有限公司 语音速度调整方法
GB2410164A (en) * 2004-01-16 2005-07-20 Anthony John Andrews Sound feature positioner
EP1779385B1 (fr) * 2004-07-09 2010-09-22 Electronics and Telecommunications Research Institute Procede et dispositif destines a coder et decoder un signal audio multicanal au moyen d'informations d'emplacement de source virtuelle
JP2010514696A (ja) 2006-12-21 2010-05-06 ギリアード・パロ・アルト・インコーポレイテッド 心血管症状の低減
JP5302190B2 (ja) * 2007-05-24 2013-10-02 パナソニック株式会社 オーディオ復号装置、オーディオ復号方法、プログラム及び集積回路
GB2467534B (en) * 2009-02-04 2014-12-24 Richard Furse Sound system
JP2010252220A (ja) * 2009-04-20 2010-11-04 Nippon Hoso Kyokai <Nhk> ３次元音響パンニング装置およびそのプログラム
US9113281B2 (en) 2009-10-07 2015-08-18 The University Of Sydney Reconstruction of a recorded sound field
EP2346028A1 (fr) * 2009-12-17 2011-07-20 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Appareil et procédé de conversion d'un premier signal audio spatial paramétrique en un second signal audio spatial paramétrique
AU2011231565B2 (en) 2010-03-26 2014-08-28 Dolby International Ab Method and device for decoding an audio soundfield representation for audio playback

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
H. POMBERGER, F. ZOTTER: "1st Ambisonics Symposium", 2009, article "An Ambisonics Format for Flexible Playback Layouts"
HANNES POMBERGER ET AL: "Warping of 3D Ambisonic Recordings", AMBISONICS SYMPOSIUM 2011, 2 June 2011 (2011-06-02) - 3 June 2011 (2011-06-03), Lexington, pages 1 - 8, XP055014360 *
I.N. BRONSTEIN, K.A. SEMENDJAJEW, G. MUSIOL, H. MÜHLIG: "Taschenbuch der Mathematik", 2000, VERLAG HARRI DEUTSCH
M. KAP- PELAN: "PhD thesis", 1998, AACHEN UNIVERSITY, article "Eigenschaften von Allpass-Ketten und ihre Anwendung bei der nicht-äquidistanten spektralen Analyse und Syn- these"
M. NOISTERNIG, A. SONTACCHI, TH. MUSIL, R. HÖLDRICH: "A 3D Ambisonic Based Binaural Sound Reproduction System", PROC. OF THE AES 24TH INTL. CONF. ON MULTICHANNEL AUDIO, BANFF, 2003
M.A. POLETTI: "A Unified Theory of Horizontal Holographic Sound Systems", JOURNAL OF THE AUDIO ENGINEERING SOCIETY, vol. 48, no. 12, 2000, pages 1155 - 1182, XP001177696
MICHAEL CHAPMAN ET AL: "TOWARDS A COMPREHENSIVE ACCOUNT OF VALID AMBISONIC TRANSFORMATIONS", AMBISONICS SYMPOSIUM 2009, 25 June 2009 (2009-06-25), Graz, XP055014363 *
POLETTI ET AL: "Three-Dimensional Surround Sound Systems Based on Spherical Harmonics", JAES, AES, 60 EAST 42ND STREET, ROOM 2520 NEW YORK 10165-2520, USA, vol. 53, no. 11, 1 November 2005 (2005-11-01), pages 1004 - 1025, XP040507486 *

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10771912B2 (en) 2012-03-06 2020-09-08 Dolby Laboratories Licensing Corporation Method and apparatus for screen related adaptation of a higher-order ambisonics audio signal
US11228856B2 (en) 2012-03-06 2022-01-18 Dolby Laboratories Licensing Corporation Method and apparatus for screen related adaptation of a higher-order ambisonics audio signal
US10299062B2 (en) 2012-03-06 2019-05-21 Dolby Laboratories Licensing Corporation Method and apparatus for playback of a higher-order ambisonics audio signal
US11895482B2 (en) 2012-03-06 2024-02-06 Dolby Laboratories Licensing Corporation Method and apparatus for screen related adaptation of a Higher-Order Ambisonics audio signal
US11570566B2 (en) 2012-03-06 2023-01-31 Dolby Laboratories Licensing Corporation Method and apparatus for screen related adaptation of a Higher-Order Ambisonics audio signal
US9451363B2 (en) 2012-03-06 2016-09-20 Dolby Laboratories Licensing Corporation Method and apparatus for playback of a higher-order ambisonics audio signal
JP2016508343A (ja) * 2013-01-16 2016-03-17 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ Ｈｏａラウドネスレベルを測定する方法及びｈｏａラウドネスレベルを測定する装置
US9736609B2 (en) 2013-02-07 2017-08-15 Qualcomm Incorporated Determining renderers for spherical harmonic coefficients
TWI611706B (zh) * 2013-02-07 2018-01-11 高通公司 將虛擬揚聲器映射至實體揚聲器
US9913064B2 (en) * 2013-02-07 2018-03-06 Qualcomm Incorporated Mapping virtual speakers to physical speakers
JP2016509820A (ja) * 2013-02-07 2016-03-31 クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ 仮想スピーカーを物理スピーカーにマッピングすること
US20140219455A1 (en) * 2013-02-07 2014-08-07 Qualcomm Incorporated Mapping virtual speakers to physical speakers
WO2014124268A1 (fr) * 2013-02-07 2014-08-14 Qualcomm Incorporated Mise en correspondance de haut-parleurs virtuels avec des haut-parleurs physiques
US9685163B2 (en) 2013-03-01 2017-06-20 Qualcomm Incorporated Transforming spherical harmonic coefficients
US9959875B2 (en) 2013-03-01 2018-05-01 Qualcomm Incorporated Specifying spherical harmonic and/or higher order ambisonics coefficients in bitstreams
US11146903B2 (en) 2013-05-29 2021-10-12 Qualcomm Incorporated Compression of decomposed representations of a sound field
US11962990B2 (en) 2013-05-29 2024-04-16 Qualcomm Incorporated Reordering of foreground audio objects in the ambisonics domain
CN105340008B (zh) * 2013-05-29 2019-06-14 高通股份有限公司 声场的经分解表示的压缩
US10499176B2 (en) 2013-05-29 2019-12-03 Qualcomm Incorporated Identifying codebooks to use when coding spatial components of a sound field
WO2015147435A1 (fr) * 2014-03-25 2015-10-01 인텔렉추얼디스커버리 주식회사 Système et procédé de traitement de signal audio
US10770087B2 (en) 2014-05-16 2020-09-08 Qualcomm Incorporated Selecting codebooks for coding vectors decomposed from higher-order ambisonic audio signals
CN113793617A (zh) * 2014-06-27 2021-12-14 杜比国际公司 针对hoa数据帧表示的压缩确定表示非差分增益值所需的最小整数比特数的方法
WO2016057935A1 (fr) * 2014-10-10 2016-04-14 Qualcomm Incorporated Adaptation d'un contenu de hoa en fonction d'un écran
US9940937B2 (en) 2014-10-10 2018-04-10 Qualcomm Incorporated Screen related adaptation of HOA content
WO2017066300A3 (fr) * 2015-10-14 2017-05-18 Qualcomm Incorporated Adaptation écran de contenu ambisonique d'ordre supérieur
US10070094B2 (en) 2015-10-14 2018-09-04 Qualcomm Incorporated Screen related adaptation of higher order ambisonic (HOA) content

Also Published As

Publication number Publication date
AU2012278094B2 (en) 2017-07-27
AU2012278094A1 (en) 2014-01-16
US9338574B2 (en) 2016-05-10
TWI526088B (zh) 2016-03-11
CN103635964B (zh) 2016-05-04
EP2727109A1 (fr) 2014-05-07
EP2727109B1 (fr) 2020-08-05
WO2013000740A1 (fr) 2013-01-03
JP2014523172A (ja) 2014-09-08
BR112013032878A2 (pt) 2017-01-24
CN103635964A (zh) 2014-03-12
BR112013032878B1 (pt) 2021-04-13
HUE051678T2 (hu) 2021-03-29
US20140133660A1 (en) 2014-05-15
TW201301911A (zh) 2013-01-01
KR102012988B1 (ko) 2019-08-21
JP5921678B2 (ja) 2016-05-24
DK2727109T3 (da) 2020-08-31
KR20140051927A (ko) 2014-05-02

Similar Documents

Publication Publication Date Title
EP2727109B1 (fr) Procédé et appareil permettant de modifier les positions relatives d&#39;objets sonores contenus dans une représentation d&#39;ambiophonie d&#39;ordre supérieur
JP7368563B2 (ja) オーディオ再生のためのオーディオ音場表現をレンダリングするための方法および装置
McCormack et al. SPARTA & COMPASS: Real-time implementations of linear and parametric spatial audio reproduction and processing methods
US10515645B2 (en) Method and apparatus for transforming an HOA signal representation
JP2022546926A (ja) 空間変換領域における音場表現を処理するための装置、方法、またはコンピュータプログラム
Lecomte et al. On the use of a Lebedev grid for Ambisonics
US20210390964A1 (en) Method and apparatus for encoding and decoding an hoa representation
McCormack et al. Convention e-Brief 111

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20130703