JP6466968B2 - インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法 - Google Patents

インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法 Download PDF

Info

Publication number
JP6466968B2
JP6466968B2 JP2016564300A JP2016564300A JP6466968B2 JP 6466968 B2 JP6466968 B2 JP 6466968B2 JP 2016564300 A JP2016564300 A JP 2016564300A JP 2016564300 A JP2016564300 A JP 2016564300A JP 6466968 B2 JP6466968 B2 JP 6466968B2
Authority
JP
Japan
Prior art keywords
signal
straight
audio output
function
gain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016564300A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017517947A (ja
JP2017517947A5 (https=
Inventor
エマヌエル ハベツ
エマヌエル ハベツ
オリヴァー ティールガルト
オリヴァー ティールガルト
コンラート コヴァルチク
コンラート コヴァルチク
Original Assignee
フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ
フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ, フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ filed Critical フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ
Publication of JP2017517947A publication Critical patent/JP2017517947A/ja
Publication of JP2017517947A5 publication Critical patent/JP2017517947A5/ja
Application granted granted Critical
Publication of JP6466968B2 publication Critical patent/JP6466968B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/005—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo five- or more-channel type, e.g. virtual surround
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Electric hearing aids
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Electric hearing aids
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/307—Frequency adjustment, e.g. tone control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Electric hearing aids
    • H04R25/55—Electric hearing aids using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
JP2016564300A 2014-05-05 2015-04-23 インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法 Active JP6466968B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP14167053.9 2014-05-05
EP14167053 2014-05-05
EP14183855.7 2014-09-05
EP14183855.7A EP2942982A1 (en) 2014-05-05 2014-09-05 System, apparatus and method for consistent acoustic scene reproduction based on informed spatial filtering
PCT/EP2015/058859 WO2015169618A1 (en) 2014-05-05 2015-04-23 System, apparatus and method for consistent acoustic scene reproduction based on informed spatial filtering

Publications (3)

Publication Number Publication Date
JP2017517947A JP2017517947A (ja) 2017-06-29
JP2017517947A5 JP2017517947A5 (https=) 2018-08-16
JP6466968B2 true JP6466968B2 (ja) 2019-02-06

Family

ID=51485417

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2016564300A Active JP6466968B2 (ja) 2014-05-05 2015-04-23 インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法
JP2016564335A Active JP6466969B2 (ja) 2014-05-05 2015-04-23 適応性のある関数に基づく矛盾しない音響場面再生のためのシステムおよび装置および方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2016564335A Active JP6466969B2 (ja) 2014-05-05 2015-04-23 適応性のある関数に基づく矛盾しない音響場面再生のためのシステムおよび装置および方法

Country Status (7)

Country Link
US (2) US10015613B2 (https=)
EP (4) EP2942981A1 (https=)
JP (2) JP6466968B2 (https=)
CN (2) CN106664485B (https=)
BR (2) BR112016025767B1 (https=)
RU (2) RU2665280C2 (https=)
WO (2) WO2015169618A1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3335218B1 (en) * 2016-03-16 2019-06-05 Huawei Technologies Co., Ltd. An audio signal processing apparatus and method for processing an input audio signal
US10187740B2 (en) * 2016-09-23 2019-01-22 Apple Inc. Producing headphone driver signals in a digital audio signal processing binaural rendering environment
WO2018140618A1 (en) 2017-01-27 2018-08-02 Shure Acquisiton Holdings, Inc. Array microphone module and system
US10219098B2 (en) * 2017-03-03 2019-02-26 GM Global Technology Operations LLC Location estimation of active speaker
JP6472824B2 (ja) * 2017-03-21 2019-02-20 株式会社東芝 信号処理装置、信号処理方法および音声の対応づけ提示装置
US9820073B1 (en) 2017-05-10 2017-11-14 Tls Corp. Extracting a common signal from multiple audio signals
GB2563606A (en) 2017-06-20 2018-12-26 Nokia Technologies Oy Spatial audio processing
CN109857360B (zh) * 2017-11-30 2022-06-17 长城汽车股份有限公司 车内音频设备音量控制系统及控制方法
GB2571949A (en) 2018-03-13 2019-09-18 Nokia Technologies Oy Temporal spatial audio parameter smoothing
WO2019246562A1 (en) * 2018-06-21 2019-12-26 Magic Leap, Inc. Wearable system speech processing
WO2020037555A1 (zh) * 2018-08-22 2020-02-27 深圳市汇顶科技股份有限公司 评估麦克风阵列一致性的方法、设备、装置和系统
CN112740324B (zh) * 2018-09-18 2024-07-05 华为技术有限公司 用于使虚拟3d音频适应现实房间的设备和方法
CN117809663A (zh) 2018-12-07 2024-04-02 弗劳恩霍夫应用研究促进协会 从包括至少两个声道的信号产生声场描述的装置、方法
WO2020180719A1 (en) 2019-03-01 2020-09-10 Magic Leap, Inc. Determining input for speech processing engine
US12327573B2 (en) 2019-04-19 2025-06-10 Magic Leap, Inc. Identifying input for speech recognition engine
EP3912365A1 (en) * 2019-04-30 2021-11-24 Huawei Technologies Co., Ltd. Device and method for rendering a binaural audio signal
CN116828383A (zh) 2019-05-15 2023-09-29 苹果公司 音频处理
US11328740B2 (en) 2019-08-07 2022-05-10 Magic Leap, Inc. Voice onset detection
WO2021086624A1 (en) * 2019-10-29 2021-05-06 Qsinx Management Llc Audio encoding with compressed ambience
WO2021113781A1 (en) * 2019-12-06 2021-06-10 Magic Leap, Inc. Environment acoustics persistence
EP3849202B1 (en) * 2020-01-10 2023-02-08 Nokia Technologies Oy Audio and video processing
US11917384B2 (en) 2020-03-27 2024-02-27 Magic Leap, Inc. Method of waking a device using spoken voice commands
US12417766B2 (en) 2020-09-30 2025-09-16 Magic Leap, Inc. Voice user interface using non-linguistic input
CN112527108A (zh) * 2020-12-03 2021-03-19 歌尔光学科技有限公司 一种虚拟场景回放方法、装置、电子设备及存储介质
CN116615919A (zh) * 2020-12-17 2023-08-18 杜比实验室特许公司 双耳信号的后处理
US11595775B2 (en) * 2021-04-06 2023-02-28 Meta Platforms Technologies, Llc Discrete binaural spatialization of sound sources on two audio channels
CN113889140B (zh) * 2021-09-24 2025-07-22 北京有竹居网络技术有限公司 音频信号播放方法、装置和电子设备
US20250240592A1 (en) * 2021-10-22 2025-07-24 Magic Leap, Inc. Voice analysis driven audio parameter modifications
CN114268883B (zh) * 2021-11-29 2025-06-13 苏州君林智能科技有限公司 一种选择麦克风布放位置的方法与系统
WO2023118078A1 (en) 2021-12-20 2023-06-29 Dirac Research Ab Multi channel audio processing for upmixing/remixing/downmixing applications
EP4530822A4 (en) * 2022-09-23 2025-08-27 Samsung Electronics Co Ltd ELECTRONIC DEVICE AND METHOD FOR CHANGING AUDIO SIGNAL BASED ON INFORMATION RELATING TO A VISUAL OBJECT

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7583805B2 (en) * 2004-02-12 2009-09-01 Agere Systems Inc. Late reverberation-based synthesis of auditory scenes
US7644003B2 (en) * 2001-05-04 2010-01-05 Agere Systems Inc. Cue-based audio coding/decoding
BR0305434A (pt) 2002-07-12 2004-09-28 Koninkl Philips Electronics Nv Métodos e arranjos para codificar e para decodificar um sinal de áudio multicanal, aparelhos para fornecer um sinal de áudio codificado e um sinal de áudio decodificado, sinal de áudio multicanal codificado, e, meio de armazenagem
WO2007127757A2 (en) * 2006-04-28 2007-11-08 Cirrus Logic, Inc. Method and system for surround sound beam-forming using the overlapping portion of driver frequency ranges
US20080232601A1 (en) * 2007-03-21 2008-09-25 Ville Pulkki Method and apparatus for enhancement of audio reconstruction
US9015051B2 (en) 2007-03-21 2015-04-21 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reconstruction of audio channels with direction parameters indicating direction of origin
US8180062B2 (en) * 2007-05-30 2012-05-15 Nokia Corporation Spatial sound zooming
US8064624B2 (en) * 2007-07-19 2011-11-22 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Method and apparatus for generating a stereo signal with enhanced perceptual quality
EP2154911A1 (en) * 2008-08-13 2010-02-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. An apparatus for determining a spatial output multi-channel audio signal
EP2346028A1 (en) * 2009-12-17 2011-07-20 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. An apparatus and a method for converting a first parametric spatial audio signal into a second parametric spatial audio signal
CN102859590B (zh) * 2010-02-24 2015-08-19 弗劳恩霍夫应用研究促进协会 产生增强下混频信号的装置、产生增强下混频信号的方法以及计算机程序
US8908874B2 (en) * 2010-09-08 2014-12-09 Dts, Inc. Spatial audio encoding and reproduction
EP2464145A1 (en) * 2010-12-10 2012-06-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for decomposing an input signal using a downmixer
EP2600343A1 (en) * 2011-12-02 2013-06-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for merging geometry - based spatial audio coding streams

Also Published As

Publication number Publication date
CN106664501A (zh) 2017-05-10
BR112016025767A2 (https=) 2017-08-15
RU2016146936A (ru) 2018-06-06
JP2017517947A (ja) 2017-06-29
EP2942981A1 (en) 2015-11-11
CN106664485A (zh) 2017-05-10
US10015613B2 (en) 2018-07-03
CN106664485B (zh) 2019-12-13
WO2015169618A1 (en) 2015-11-12
BR112016025771A2 (https=) 2017-08-15
EP3141001B1 (en) 2022-05-18
BR112016025767B1 (pt) 2022-08-23
RU2665280C2 (ru) 2018-08-28
EP3141001A1 (en) 2017-03-15
RU2016147370A3 (https=) 2018-06-06
RU2663343C2 (ru) 2018-08-03
WO2015169617A1 (en) 2015-11-12
US20170078819A1 (en) 2017-03-16
RU2016147370A (ru) 2018-06-06
US20170078818A1 (en) 2017-03-16
EP2942982A1 (en) 2015-11-11
EP3141000B1 (en) 2020-06-17
EP3141000A1 (en) 2017-03-15
JP6466969B2 (ja) 2019-02-06
RU2016146936A3 (https=) 2018-06-06
US9936323B2 (en) 2018-04-03
JP2017517948A (ja) 2017-06-29
CN106664501B (zh) 2019-02-15
BR112016025771B1 (pt) 2022-08-23

Similar Documents

Publication Publication Date Title
JP6466968B2 (ja) インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法
CN107925815B (zh) 空间音频处理装置
JP6703525B2 (ja) 音源を強調するための方法及び機器
JP2017517947A5 (https=)
JP2017517948A5 (https=)
KR20130116271A (ko) 다중 마이크에 의한 3차원 사운드 포착 및 재생
WO2017064368A1 (en) Distributed audio capture and mixing
JP7378575B2 (ja) 空間変換領域における音場表現を処理するための装置、方法、またはコンピュータプログラム
JP6404354B2 (ja) 多くの拡声器信号を生成するための装置及び方法、並びにコンピュータ・プログラム
WO2018234624A1 (en) Recording and rendering audio signals
JP2013110633A (ja) トランスオーラルシステム
Thiergart et al. An acoustical zoom based on informed spatial filtering
US10602297B2 (en) Processing audio signals
TW202446056A (zh) 視聽信號的產生
WO2025166300A1 (en) Method for generating an audio-visual media stream

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20161220

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161220

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180109

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180406

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20180705

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20181211

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190110

R150 Certificate of patent or registration of utility model

Ref document number: 6466968

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250