WO2013121136A1 - Procédé de synthèse transaurale pour la spatialisation sonore - Google Patents

Procédé de synthèse transaurale pour la spatialisation sonore Download PDF

Info

Publication number
WO2013121136A1
WO2013121136A1 PCT/FR2013/050278 FR2013050278W WO2013121136A1 WO 2013121136 A1 WO2013121136 A1 WO 2013121136A1 FR 2013050278 W FR2013050278 W FR 2013050278W WO 2013121136 A1 WO2013121136 A1 WO 2013121136A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
sound
signals
channels
stereo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/FR2013/050278
Other languages
English (en)
French (fr)
Inventor
Franck Rosset
Jean-Luc HAURAIS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to RU2014133066A priority Critical patent/RU2639955C2/ru
Priority to HK15104520.4A priority patent/HK1204188B/xx
Priority to JP2014556128A priority patent/JP6421385B2/ja
Priority to KR20147024937A priority patent/KR20140128412A/ko
Priority to EP13710449.3A priority patent/EP2815589B1/fr
Priority to US14/377,935 priority patent/US20150036827A1/en
Priority to IN6776DEN2014 priority patent/IN2014DN06776A/en
Priority to CN201380009062.2A priority patent/CN104160722B/zh
Application filed by Individual filed Critical Individual
Priority to BR112014019926A priority patent/BR112014019926A2/pt
Publication of WO2013121136A1 publication Critical patent/WO2013121136A1/fr
Anticipated expiration legal-status Critical
Priority to US15/373,617 priority patent/US10321252B2/en
Priority to US16/436,798 priority patent/US20190394596A1/en
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the present invention relates to the field of spacialized sound spatialization of sound signals, integrating in particular a room effect, particularly in the field of transaural techniques.
  • the term "binaural” refers to the reproduction on a stereophonic headphones, or a pair of headphones or a pair of speakers, a sound signal with nevertheless spatialization effects.
  • the invention is however not limited to the aforementioned technique and applies, in particular, to techniques derived from "binaural” such as "transaural" (commercial name) restitution techniques, that is to say on remote loudspeakers, installed for example in a concert hall or cinema with a multi-point sound system.
  • a specific application of the invention is, for example, the enrichment of audio content broadcast by a pair of speakers to immerse a listener in a spatialized sound scene, including in particular a room effect or outdoor space.
  • the state of the art defines a transfer function, or filter, of a sound signal between a position of a sound source in the space and the two ears of a listener.
  • the acoustic transfer function of the aforementioned head is designated HRTF for "IHead Related Transfer Function” in English in its form. frequency and HRIR for "JHead Related Impulse Response” in English in its temporal form.
  • HRTF for one direction of space, we finally get two HRTFs: one for the right ear and one for the left ear.
  • the binaural technique consists in applying such acoustic transfer functions of the head to monophonic audio signals, in order to obtain a stereophonic signal which makes it possible, when listening to headphones, to have the feeling that the sources sounds come from a particular direction of space.
  • the signal from the right ear is obtained by filtering the monophonic signal by the HRTF of the right ear and the left ear signal is obtained by filtering the same monophonic signal by the HRTF of the left ear.
  • FIG. 1 represents a general block diagram of the installation intended for the phase of constructing the pulse signal database.
  • FIG. 2 represents a schematic view of the installation for acquiring pulse signals
  • the method according to the invention comprises a first processing (1) of producing a database of pulse signals from the acquisition of acoustic signals in a plurality of physical spaces, by
  • the method consists in applying a succession of
  • the method comprises a preliminary stage (2) of constructing a signal N.i from the stereo signal
  • This stereo signal can then be broadcast by a pair of standard loudspeakers, to restore a spatialized sound environment corresponding to the space that has been used to produce the impulse response signals or a combination of such spaces.
  • This step is replicated a plurality of times.
  • impulses to be arranged in a physical space such as a concert hall, an open or closed place, a given room, a series of known loudspeakers (5 to 11; 17) associated with an amplifier (14), preference of recognized quality, as well as a microphone pair (12, 13) whose position relative to the speaker series (5 to 11; 17) is fixed for the series being acquired.
  • Each of the speakers (5 to 11) is then successively applied to an original multifrequency signal using the amplifier (14).
  • This original signal is for example a sequence of a duration of between 10 and 90 seconds, with a frequency variation in the sound spectrum.
  • This signal is for example a linear variation between 20 Hz and 20 kHz, or any signal covering the entire spectrum of the enclosure.
  • the sound signal produced by the active speaker is picked up by the microphone torque (12, 13) and produces a recorded stereo signal. From this signal, 96 kHz sampling is carried out in a known manner and at a
  • This step is reproduced for each of the speakers (5 to 11) of the series, then for different physical spaces where a series of identical or identical speakers is re-inserted.
  • This first step leads to the construction of a database of stereo impulse responses.
  • This step makes it possible to construct a spatial stereo audio signal from a multichannel signal N.i
  • This step consists in selecting in the database formed during the initial step N + i impulse responses.
  • the selection will consist in associating with each of the N + 1 signals one of the impulse responses of said database, ensuring that the acquisition position in the space of the impulse response corresponds to the position in the space of the channel with which it is associated.
  • a convolution processing is applied to calculate a stereo spatialized signal cut S sG and S sD .
  • channel equalization is performed to improve the dynamics of the signals.
  • the final step is to recombine the signals to build a right and left signal pair
  • the channels are equalized to improve the dynamics of the two channels.
  • Case of a stereo start signal increasing the number of channels and creating intermediate channels
  • the signal to be spatialized is not of the Ni type but simply a stereo signal
  • a step is taken intermediate consisting of building a signal Ni by phase extraction treatments between the left and right track, to build different new signals.
  • This extraction by phase consists in producing a signal corresponding to a reconstructed central channel, by a processing consisting in adding the signal of the left channel with a signal of the straight line which is out of phase, for example in phase opposition.
  • the left and right tracks are phase-shifted, with different phase-shift angles, and the out-of-phase signal pairs are added, with determined weights.
  • frequency filters are applied to right and left signals when creating "reconstructed" channels, in order to increase signal dynamics and maintain high fidelity sound quality.
  • FIG. 3 represents a schematic view of the reproduction installation, from a pair of actual speakers (17, 18).
  • This pair of speakers (17, 18) receives a signal for simulating calculated speakers (20 to 27 and 30 to 37).
  • the effective number of calculated speakers (20 to 27) corresponds to the number of physical speakers (5 to 11; 17) used for the production of the pulse signal database, or to the number of virtual speakers reconstructed by the method referred to above.
  • Virtual speakers (30 to 37) are also created which produce a perception in the sound space of a combination of real neighboring speakers, to fill the sound holes.
  • These virtual speakers are created by a modification of the signal supplying the neighboring real speakers.
  • the signals are distributed according to their right, left or central component to produce a left signal (17) for the left speaker, and a right signal for the right speaker (18):
  • the "right” signal corresponds to the addition of the calculated “right” signals (21, 22, 23) and virtual “right” signals (30, 31, 32), as well as the "central” signals calculated (20, 27) and virtual (33) with an amplitude weighting of 50%
  • the "left" signal corresponds to the addition of the left calculated signals (24, 25, 26) and the left virtual signals (34, 35, 36), as well as the calculated central (20, 27) and virtual (33 ) with an amplitude weighting of 50%.
  • This stereo signal is then applied to a conventional audio equipment, connected to a pair of speakers (18, 19), which will reproduce a spatialized sound environment corresponding to the sound environment of the installation that was used to build the base impulse signals, or a virtual sound environment corresponding to the combination of several original atmospheres, where appropriate enriched with virtual atmospheres.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Stereophonic System (AREA)
PCT/FR2013/050278 2012-02-13 2013-02-11 Procédé de synthèse transaurale pour la spatialisation sonore Ceased WO2013121136A1 (fr)

Priority Applications (11)

Application Number Priority Date Filing Date Title
IN6776DEN2014 IN2014DN06776A (cg-RX-API-DMAC7.html) 2012-02-13 2013-02-11
JP2014556128A JP6421385B2 (ja) 2012-02-13 2013-02-11 サウンド立体化のためのトランスオーラル合成方法
KR20147024937A KR20140128412A (ko) 2012-02-13 2013-02-11 사운드 공간화를 위한 트랜스오럴 합성 방법
EP13710449.3A EP2815589B1 (fr) 2012-02-13 2013-02-11 Procédé de synthèse transaurale pour la spatialisation sonore
US14/377,935 US20150036827A1 (en) 2012-02-13 2013-02-11 Transaural Synthesis Method for Sound Spatialization
RU2014133066A RU2639955C2 (ru) 2012-02-13 2013-02-11 Способ трансаурального синтеза для придания звуку пространственной формы
HK15104520.4A HK1204188B (en) 2012-02-13 2013-02-11 Transaural synthesis method for sound spatialization
CN201380009062.2A CN104160722B (zh) 2012-02-13 2013-02-11 用于声音空间化的听觉传输合成方法
BR112014019926A BR112014019926A2 (pt) 2012-02-13 2013-02-11 método de síntese transaural para espacialização de som
US15/373,617 US10321252B2 (en) 2012-02-13 2016-12-09 Transaural synthesis method for sound spatialization
US16/436,798 US20190394596A1 (en) 2012-02-13 2019-06-10 Transaural synthesis method for sound spatialization

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1251328 2012-02-13
FR1251328A FR2986932B1 (fr) 2012-02-13 2012-02-13 Procede de synthese transaurale pour la spatialisation sonore

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/377,935 A-371-Of-International US20150036827A1 (en) 2012-02-13 2013-02-11 Transaural Synthesis Method for Sound Spatialization
US15/373,617 Continuation-In-Part US10321252B2 (en) 2012-02-13 2016-12-09 Transaural synthesis method for sound spatialization

Publications (1)

Publication Number Publication Date
WO2013121136A1 true WO2013121136A1 (fr) 2013-08-22

Family

ID=47901163

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/FR2013/050278 Ceased WO2013121136A1 (fr) 2012-02-13 2013-02-11 Procédé de synthèse transaurale pour la spatialisation sonore

Country Status (9)

Country Link
EP (1) EP2815589B1 (cg-RX-API-DMAC7.html)
JP (1) JP6421385B2 (cg-RX-API-DMAC7.html)
KR (1) KR20140128412A (cg-RX-API-DMAC7.html)
CN (1) CN104160722B (cg-RX-API-DMAC7.html)
BR (1) BR112014019926A2 (cg-RX-API-DMAC7.html)
FR (1) FR2986932B1 (cg-RX-API-DMAC7.html)
IN (1) IN2014DN06776A (cg-RX-API-DMAC7.html)
RU (1) RU2639955C2 (cg-RX-API-DMAC7.html)
WO (1) WO2013121136A1 (cg-RX-API-DMAC7.html)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3065137B1 (fr) 2017-04-07 2020-02-28 Axd Technologies, Llc Procede de spatialisation sonore

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1545154A2 (en) * 2003-12-17 2005-06-22 Samsung Electronics Co., Ltd. A virtual surround sound device
US20070011025A1 (en) 2005-07-08 2007-01-11 American Express Company Facilitating Payments to Health Care Providers
MX2008011994A (es) * 2006-03-24 2008-11-27 Dolby Sweden Ab Generacion de mezclas descendentes espaciales a partir de representaciones parametricas de señales de multicanal.

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020133327A1 (en) * 1998-03-31 2002-09-19 Mcgrath David Stanley Acoustic response simulation system
US20030035553A1 (en) * 2001-08-10 2003-02-20 Frank Baumgarte Backwards-compatible perceptual coding of spatial cues
JP4062959B2 (ja) * 2002-04-26 2008-03-19 ヤマハ株式会社 残響付与装置、残響付与方法、インパルス応答生成装置、インパルス応答生成方法、残響付与プログラム、インパルス応答生成プログラムおよび記録媒体
US6937737B2 (en) * 2003-10-27 2005-08-30 Britannia Investment Corporation Multi-channel audio surround sound from front located loudspeakers
JP2005252332A (ja) * 2004-03-01 2005-09-15 Clarion Co Ltd 音場再生装置及びその制御方法
WO2006126161A2 (en) * 2005-05-26 2006-11-30 Bang & Olufsen A/S Recording, synthesis and reproduction of sound fields in an enclosure
JP2006339694A (ja) * 2005-05-31 2006-12-14 D & M Holdings Inc オーディオ信号出力装置
KR100619082B1 (ko) * 2005-07-20 2006-09-05 삼성전자주식회사 와이드 모노 사운드 재생 방법 및 시스템
TWI396188B (zh) * 2005-08-02 2013-05-11 Dolby Lab Licensing Corp 依聆聽事件之函數控制空間音訊編碼參數的技術
RU2407226C2 (ru) * 2006-03-24 2010-12-20 Долби Свидн Аб Генерация пространственных сигналов понижающего микширования из параметрических представлений мультиканальных сигналов
JP2008301427A (ja) * 2007-06-04 2008-12-11 Onkyo Corp マルチチャンネル音声再生装置
RU2437247C1 (ru) * 2008-01-01 2011-12-20 ЭлДжи ЭЛЕКТРОНИКС ИНК. Способ и устройство для обработки звукового сигнала
JP5341919B2 (ja) * 2008-02-14 2013-11-13 ドルビー ラボラトリーズ ライセンシング コーポレイション ステレオ音響の拡幅
UA101542C2 (ru) * 2008-12-15 2013-04-10 Долби Лабораторис Лайсензин Корпорейшн Виртуализатор окружающего звука с динамическим сжатием диапазона и способ
KR101764175B1 (ko) * 2010-05-04 2017-08-14 삼성전자주식회사 입체 음향 재생 방법 및 장치

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1545154A2 (en) * 2003-12-17 2005-06-22 Samsung Electronics Co., Ltd. A virtual surround sound device
US20070011025A1 (en) 2005-07-08 2007-01-11 American Express Company Facilitating Payments to Health Care Providers
MX2008011994A (es) * 2006-03-24 2008-11-27 Dolby Sweden Ab Generacion de mezclas descendentes espaciales a partir de representaciones parametricas de señales de multicanal.

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PLOGSTIES J ET AL: "MPEG Sorround binaural rendering - Sorround sound for mobile devices (Binaurale Wiedergabe mit MPEG Sorround - Sorround sound fuer mobile Geraete)", TONMEISTERTAGUNG. INTERNATIONALER KONGRESS, XX, XX, no. 24th, November 2006 (2006-11-01), pages 1 - 19, XP007902572 *

Also Published As

Publication number Publication date
CN104160722B (zh) 2018-01-12
RU2639955C2 (ru) 2017-12-25
RU2014133066A (ru) 2016-04-10
KR20140128412A (ko) 2014-11-05
BR112014019926A2 (pt) 2017-07-04
CN104160722A (zh) 2014-11-19
JP2015510348A (ja) 2015-04-02
JP6421385B2 (ja) 2018-11-14
HK1204188A1 (en) 2015-11-06
IN2014DN06776A (cg-RX-API-DMAC7.html) 2015-05-22
EP2815589B1 (fr) 2017-04-05
FR2986932B1 (fr) 2014-03-07
EP2815589A1 (fr) 2014-12-24
FR2986932A1 (fr) 2013-08-16

Similar Documents

Publication Publication Date Title
Rafaely et al. Spatial audio signal processing for binaural reproduction of recorded acoustic scenes–review and challenges
KR100626233B1 (ko) 스테레오 확장 네트워크에서의 출력의 등화
Algazi et al. Headphone-based spatial sound
WO2007110520A1 (fr) Procede de synthese binaurale prenant en compte un effet de salle
KR20080060640A (ko) 개인 청각 특성을 고려한 2채널 입체 음향 재생 방법 및장치
US20200059750A1 (en) Sound spatialization method
US20190394596A1 (en) Transaural synthesis method for sound spatialization
EP2009891B1 (fr) Transmission de signal audio dans un système de conférence audio immersive
JP2019041405A (ja) 改良された復元のために音声信号を処理するための方法
EP2815589B1 (fr) Procédé de synthèse transaurale pour la spatialisation sonore
US20190246230A1 (en) Virtual localization of sound
US12413922B1 (en) Method and system for processing head-related transfer functions
US9609454B2 (en) Method for playing back the sound of a digital audio signal
US20150036827A1 (en) Transaural Synthesis Method for Sound Spatialization
CN1141007C (zh) 针对多个收听者的三维声音再生设备及其方法
KR100275779B1 (ko) 5채널 오디오 데이터를 2채널로 변환하여 헤드폰으로 재생하는 장치 및 방법
Gamper et al. Spatialisation in audio augmented reality using finger snaps
Gamper et al. Instant BRIR acquisition for auditory events in audio augmented reality using finger snaps
Tsakostas Binaural Simulation applied to standard stereo audio signals aiming to the enhancement of the listening experience
HK1204188B (en) Transaural synthesis method for sound spatialization
KR20050069859A (ko) 구체를 이용한 3차원 오디오 신호 처리 시스템 및 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13710449

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2013710449

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2013710449

Country of ref document: EP

Ref document number: 14377935

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2014556128

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20147024937

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2014133066

Country of ref document: RU

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112014019926

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112014019926

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20140812