EP2721841A1 - Procede de traitement d'un signal audio pour une restitution amelioree - Google Patents

Procede de traitement d'un signal audio pour une restitution amelioree

Info

Publication number
EP2721841A1
EP2721841A1 EP12738497.2A EP12738497A EP2721841A1 EP 2721841 A1 EP2721841 A1 EP 2721841A1 EP 12738497 A EP12738497 A EP 12738497A EP 2721841 A1 EP2721841 A1 EP 2721841A1
Authority
EP
European Patent Office
Prior art keywords
processing
sound
audio signal
signal
channels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP12738497.2A
Other languages
German (de)
English (en)
French (fr)
Inventor
Jean-Luc HAURAIS
Franck Rosset
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AXD Technologies LLC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP2721841A1 publication Critical patent/EP2721841A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H04S3/004For headphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S1/00Two-channel systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/03Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/05Generation or adaptation of centre channel in multi-channel audio systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other

Definitions

  • a method of processing an audio signal for improved playback A method of processing an audio signal for improved playback.
  • the present invention relates to the field of the processing of audio signals for the creation of an improved acoustic environment, in particular for listening to the headphones.
  • the present invention aims to provide a solution to this problem.
  • the method that is the subject of the invention makes it possible to transform its 2D into 3D sound either from a stereo file or from multichannel files, in order to generate 3D stereo audio by virtualization, with the possibility of choosing a context particular sound.
  • the invention relates, according to its more general meaning, to a process for processing an original audio signal of Nx channels, N being greater than 1 and x being greater than or equal to 0, comprising a multichannel processing step of said signal.
  • input audio by a multichannel convolution with a predefined imprint said imprint being elaborated by the capture of a reference sound by a set of speakers arranged in a reference space characterized in that it comprises an additional selection step at least one of a plurality of fingerprints previously developed in different sound contexts.
  • This solution based on a frequency filter, differential between left channel and right channel to form a central channel, and a phase differentiation makes it possible to create from a stereo signal a multitude of stereo channels where each virtual speaker is a stereo file.
  • the method according to the invention comprises a step of creating a new fingerprint by processing at least one previously developed fingerprint.
  • the method further comprises a step of recombining the N x channels thus treated to produce an output signal of M. y channels, with Nx different from M. y, M being greater than 1 and y greater than or equal to 0 .
  • the creation of a sound footprint consists in arranging in a defined environment, for example a room in concert, a hall, or even a natural space (a cave, an open space, ...) a set of acoustic speakers organized in NxM sound points. For example, a simple pair of "right-left” speakers, or a set of 5.1 or 7.1 or 11.1 speakers reproducing a reference sound signal in a known manner.
  • microphones for example an artificial head, or multidirectional capture microphones HRTF, capturing the reproduction of the speakers in the environment.
  • the signals produced by the microphone torque are recorded after sampling at a high frequency, for example 192 Khz, 24 bits.
  • This digital recording makes it possible to capture a signal representative of a given sound environment.
  • This step is not limited to capturing a sound signal produced by speakers.
  • the capture can also be performed from the signal produced by a helmet, which is placed on an artificial head. This variant will recreate the sound of a given helmet, when restitution on another helmet.
  • This signal is then subjected to a treatment of applying a differential between the reference signal applied to the speakers, digitized under the same conditions, and the signal picked up by the microphones.
  • This differential is realized by a computer receiving as input the .vaw or audio files respectively of the reference signal applied to each of the speakers on the one hand, and the signal picked up on the other hand, to produce a signal of the "IR-Impulse" type. response "for each of the speakers used to generate the reference signal.
  • This treatment is applied to each of the input signals of each of the captured speakers.
  • This process produces a set of files, each corresponding to the footprint of one of the speakers in the defined environment.
  • the aforementioned step is reproduced for different sound environments and / or different speaker locations.
  • an acquisition and processing step is performed to produce a new series of fingerprints representative of the new sound environment.
  • a library of series of sound tracks representative of specific and known sound environments is thus constructed.
  • the aforementioned library is used to produce a new series of fingerprints, representative of a virtual environment, by combining several sets of fingerprints and adding the files corresponding to the selected fingerprints so as to reduce the areas where the sound environment was devoid of speakers during the aforementioned acquisition step.
  • This step of creating a virtual environment makes it possible to improve the coherence and the dynamics of the sound resulting from the application to a given recording, in particular by a better three-dimensional occupancy of the sound space. This amounts to using a simulated environment of a very large number of speakers.
  • the result of this step is a new virtualized room footprint, which can be applied to any sound sequence, to improve rendering.
  • the virtualized fingerprint is adapted to reduce the frequency and sampling to those of the audio signal to be processed.
  • the known signal is for example a stereo signal. It is the subject of a frequency division and a division based on the phase shift between the right signal and the left signal.
  • N tracks are extracted by applying to combinations of these divisions one of the virtualized fingerprints.
  • NxM tracks N and M not being necessarily the number of channels used during the step of creating the footprint.
  • N and M not being necessarily the number of channels used during the step of creating the footprint.
  • N and M not being necessarily the number of channels used during the step of creating the footprint.
  • the result of this step is a succession of audio signals that are then transformed into a conventional stereo signal to be compatible with playback on standard equipment.
  • the step of processing a sound sequence can be performed in deferred mode, to produce recordings broadcast at any time.
  • This variant can also be performed in real time so as to process an audio stream at the time of its production.
  • This variant is particularly adapted to the real-time transformation of a sound acquired in streaming into a sound enriched audio for a restitution with a better dynamic.
  • the treatment makes it possible to produce a signal producing a raising of doubt of a central sound signal, which the human brain can "imagine” by mistake at the back while it is a question of signal before. For this, one proceeds to a horizontal displacement to allow a registration of the brain, then a refocusing. This step is to slightly increase the level of presence of a virtual speaker before center.
  • This step is applied whenever the audio signal is mainly centered, which is often the case for the "voice" part of a music recording.
  • This transient enhancement processing is applied transiently, preferably upon the occurrence of a centered audio sequence.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
EP12738497.2A 2011-06-16 2012-06-15 Procede de traitement d'un signal audio pour une restitution amelioree Withdrawn EP2721841A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1101882A FR2976759B1 (fr) 2011-06-16 2011-06-16 Procede de traitement d'un signal audio pour une restitution amelioree.
PCT/FR2012/051345 WO2012172264A1 (fr) 2011-06-16 2012-06-15 Procede de traitement d'un signal audio pour une restitution amelioree

Publications (1)

Publication Number Publication Date
EP2721841A1 true EP2721841A1 (fr) 2014-04-23

Family

ID=46579158

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12738497.2A Withdrawn EP2721841A1 (fr) 2011-06-16 2012-06-15 Procede de traitement d'un signal audio pour une restitution amelioree

Country Status (9)

Country Link
US (2) US10171927B2 (ko)
EP (1) EP2721841A1 (ko)
JP (3) JP2014519784A (ko)
KR (1) KR101914209B1 (ko)
CN (1) CN103636237B (ko)
BR (1) BR112013031808A2 (ko)
FR (1) FR2976759B1 (ko)
RU (1) RU2616161C2 (ko)
WO (1) WO2012172264A1 (ko)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3004883B1 (fr) 2013-04-17 2015-04-03 Jean-Luc Haurais Procede de restitution sonore d'un signal numerique audio
CN104135709A (zh) * 2013-04-30 2014-11-05 深圳富泰宏精密工业有限公司 音频处理系统及方法
CA3007629A1 (en) 2015-12-14 2017-06-22 Red.Com, Llc Modular digital camera and cellular phone
CA3043444A1 (en) 2016-10-19 2018-04-26 Audible Reality Inc. System for and method of generating an audio image
US11606663B2 (en) 2018-08-29 2023-03-14 Audible Reality Inc. System for and method of controlling a three-dimensional audio engine

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0747039Y2 (ja) * 1989-05-16 1995-10-25 ヤマハ株式会社 ヘッドホン受聴補正装置
JPH05168097A (ja) * 1991-12-16 1993-07-02 Nippon Telegr & Teleph Corp <Ntt> 頭外音像定位ステレオ受聴器受聴方法
WO1997025834A2 (en) * 1996-01-04 1997-07-17 Virtual Listening Systems, Inc. Method and device for processing a multi-channel signal for use with a headphone
KR20010030608A (ko) * 1997-09-16 2001-04-16 레이크 테크놀로지 리미티드 청취자 주변의 음원의 공간화를 향상시키기 위한 스테레오헤드폰 디바이스에서의 필터링 효과의 이용
DE19902317C1 (de) * 1999-01-21 2000-01-13 Fraunhofer Ges Forschung Vorrichtung und Verfahren zur Qualitätsbeurteilung von mehrkanaligen Audiosignalen
JP2000324600A (ja) * 1999-05-07 2000-11-24 Matsushita Electric Ind Co Ltd 音像定位装置
JP2002152897A (ja) * 2000-11-14 2002-05-24 Sony Corp 音声信号処理方法、音声信号処理装置
JP2003084790A (ja) * 2001-09-17 2003-03-19 Matsushita Electric Ind Co Ltd 台詞成分強調装置
KR100542129B1 (ko) * 2002-10-28 2006-01-11 한국전자통신연구원 객체기반 3차원 오디오 시스템 및 그 제어 방법
EP1570703A2 (en) * 2002-12-06 2005-09-07 Koninklijke Philips Electronics N.V. Personalized surround sound headphone system
US20040264704A1 (en) * 2003-06-13 2004-12-30 Camille Huin Graphical user interface for determining speaker spatialization parameters
KR20050060789A (ko) * 2003-12-17 2005-06-22 삼성전자주식회사 가상 음향 재생 방법 및 그 장치
GB0419346D0 (en) * 2004-09-01 2004-09-29 Smyth Stephen M F Method and apparatus for improved headphone virtualisation
US7184557B2 (en) * 2005-03-03 2007-02-27 William Berson Methods and apparatuses for recording and playing back audio signals
DE102005010057A1 (de) * 2005-03-04 2006-09-07 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Erzeugen eines codierten Stereo-Signals eines Audiostücks oder Audiodatenstroms
CN101263741B (zh) * 2005-09-13 2013-10-30 皇家飞利浦电子股份有限公司 产生和处理表示hrtf的参数的方法和设备
EP1927266B1 (en) * 2005-09-13 2014-05-14 Koninklijke Philips N.V. Audio coding
JP2007142875A (ja) * 2005-11-18 2007-06-07 Sony Corp 音響特性補正装置
CN101390443B (zh) * 2006-02-21 2010-12-01 皇家飞利浦电子股份有限公司 音频编码和解码
US8374365B2 (en) * 2006-05-17 2013-02-12 Creative Technology Ltd Spatial audio analysis and synthesis for binaural reproduction and format conversion
WO2008035227A2 (en) * 2006-09-14 2008-03-27 Lg Electronics Inc. Dialogue enhancement techniques
US8270616B2 (en) * 2007-02-02 2012-09-18 Logitech Europe S.A. Virtual surround for headphones and earbuds headphone externalization system
JP5114981B2 (ja) * 2007-03-15 2013-01-09 沖電気工業株式会社 音像定位処理装置、方法及びプログラム
JP4866301B2 (ja) * 2007-06-18 2012-02-01 日本放送協会 頭部伝達関数補間装置
JP2009027331A (ja) * 2007-07-18 2009-02-05 Clarion Co Ltd 音場再現システム
EP2056627A1 (en) * 2007-10-30 2009-05-06 SonicEmotion AG Method and device for improved sound field rendering accuracy within a preferred listening area
JP4780119B2 (ja) * 2008-02-15 2011-09-28 ソニー株式会社 頭部伝達関数測定方法、頭部伝達関数畳み込み方法および頭部伝達関数畳み込み装置
US8885834B2 (en) * 2008-03-07 2014-11-11 Sennheiser Electronic Gmbh & Co. Kg Methods and devices for reproducing surround audio signals
TWI475896B (zh) * 2008-09-25 2015-03-01 Dolby Lab Licensing Corp 單音相容性及揚聲器相容性之立體聲濾波器
US8213637B2 (en) * 2009-05-28 2012-07-03 Dirac Research Ab Sound field control in multiple listening regions
GB2471089A (en) 2009-06-16 2010-12-22 Focusrite Audio Engineering Ltd Audio processing device using a library of virtual environment effects
US20140328505A1 (en) * 2013-05-02 2014-11-06 Microsoft Corporation Sound field adaptation based upon user tracking

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2012172264A1 *

Also Published As

Publication number Publication date
BR112013031808A2 (pt) 2018-06-26
KR101914209B1 (ko) 2018-11-01
US10171927B2 (en) 2019-01-01
JP6361000B2 (ja) 2018-07-25
WO2012172264A1 (fr) 2012-12-20
FR2976759A1 (fr) 2012-12-21
JP2014519784A (ja) 2014-08-14
FR2976759B1 (fr) 2013-08-09
JP2019041405A (ja) 2019-03-14
US20190208346A1 (en) 2019-07-04
KR20140036232A (ko) 2014-03-25
US20140185844A1 (en) 2014-07-03
CN103636237A (zh) 2014-03-12
RU2616161C2 (ru) 2017-04-12
RU2013153734A (ru) 2015-07-27
JP2017055431A (ja) 2017-03-16
CN103636237B (zh) 2017-05-03

Similar Documents

Publication Publication Date Title
EP1999998B1 (fr) Procede de synthese binaurale prenant en compte un effet de salle
EP2000002B1 (fr) Procede et dispositif de spatialisation sonore binaurale efficace dans le domaine transforme
EP2539892B1 (fr) Compression de flux audio multicanal
FR2942096A1 (fr) Procede pour positionner un objet sonore dans un environnement sonore 3d, support audio mettant en oeuvre le procede, et plate-forme de test associe
EP2721841A1 (fr) Procede de traitement d&#39;un signal audio pour une restitution amelioree
WO2007101958A2 (fr) Optimisation d&#39;une spatialisation sonore binaurale a partir d&#39;un encodage multicanal
WO2005069272A1 (fr) Procede de synthese et de spatialisation sonores
JP2022551873A (ja) スペクトル直交オーディオ成分を用いたサブバンド空間処理およびクロストーク処理
EP3400599B1 (fr) Encodeur ambisonique ameliore d&#39;une source sonore a pluralite de reflexions
RU2017134688A (ru) Устройство и способ обработки стереофонических сигналов для воспроизведения в автомобилях для достижения отдельного трехмерного звука посредством передних громкоговорителей
EP1994526B1 (fr) Synthese et spatialisation sonores conjointes
FR3065137A1 (fr) Procede de spatialisation sonore
EP2815589B1 (fr) Procédé de synthèse transaurale pour la spatialisation sonore
EP2987339B1 (fr) Procédé de restitution sonore d&#39;un signal numérique audio
WO2023156578A1 (fr) Procédé de traitement d&#39;un signal sonore numérique pour émulation de disques vinyle
EP3108670B1 (fr) Procédé et dispositif de restitution d&#39;un signal audio multicanal dans une zone d&#39;écoute
Hitchcock Morphing aural spaces in 7.1 music
WO2006097633A1 (fr) Procede et systeme de spatialisation d&#39;un signal sonore en fonction des qualites intrinseques de ce dernier

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20131211

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: HAURAIS, JEAN-LUC

Owner name: ROSSET, FRANCK

RIN1 Information on inventor provided before grant (corrected)

Inventor name: ROSSET, FRANCK

Inventor name: HAURAIS, JEAN-LUC

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: A3D TECHNOLOGIES LLC

17Q First examination report despatched

Effective date: 20181018

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20200303