JP6466968B2 - インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法 - Google Patents

インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法 Download PDF

Info

Publication number
JP6466968B2
JP6466968B2 JP2016564300A JP2016564300A JP6466968B2 JP 6466968 B2 JP6466968 B2 JP 6466968B2 JP 2016564300 A JP2016564300 A JP 2016564300A JP 2016564300 A JP2016564300 A JP 2016564300A JP 6466968 B2 JP6466968 B2 JP 6466968B2
Authority
JP
Japan
Prior art keywords
signal
straight
audio output
function
gain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016564300A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017517947A5 (enExample
JP2017517947A (ja
Inventor
エマヌエル ハベツ
エマヌエル ハベツ
オリヴァー ティールガルト
オリヴァー ティールガルト
コンラート コヴァルチク
コンラート コヴァルチク
Original Assignee
フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ
フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ, フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ filed Critical フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ
Publication of JP2017517947A publication Critical patent/JP2017517947A/ja
Publication of JP2017517947A5 publication Critical patent/JP2017517947A5/ja
Application granted granted Critical
Publication of JP6466968B2 publication Critical patent/JP6466968B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/005—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo five- or more-channel type, e.g. virtual surround
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/40—Arrangements for obtaining a desired directivity characteristic
    • H04R25/407—Circuits for combining signals of a plurality of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/307—Frequency adjustment, e.g. tone control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R25/00—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception
    • H04R25/55—Deaf-aid sets, i.e. electro-acoustic or electro-mechanical hearing aids; Electric tinnitus maskers providing an auditory perception using an external connection, either wireless or wired
    • H04R25/552—Binaural
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Neurosurgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
JP2016564300A 2014-05-05 2015-04-23 インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法 Active JP6466968B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP14167053 2014-05-05
EP14167053.9 2014-05-05
EP14183855.7 2014-09-05
EP14183855.7A EP2942982A1 (en) 2014-05-05 2014-09-05 System, apparatus and method for consistent acoustic scene reproduction based on informed spatial filtering
PCT/EP2015/058859 WO2015169618A1 (en) 2014-05-05 2015-04-23 System, apparatus and method for consistent acoustic scene reproduction based on informed spatial filtering

Publications (3)

Publication Number Publication Date
JP2017517947A JP2017517947A (ja) 2017-06-29
JP2017517947A5 JP2017517947A5 (enExample) 2018-08-16
JP6466968B2 true JP6466968B2 (ja) 2019-02-06

Family

ID=51485417

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2016564300A Active JP6466968B2 (ja) 2014-05-05 2015-04-23 インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法
JP2016564335A Active JP6466969B2 (ja) 2014-05-05 2015-04-23 適応性のある関数に基づく矛盾しない音響場面再生のためのシステムおよび装置および方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2016564335A Active JP6466969B2 (ja) 2014-05-05 2015-04-23 適応性のある関数に基づく矛盾しない音響場面再生のためのシステムおよび装置および方法

Country Status (7)

Country Link
US (2) US10015613B2 (enExample)
EP (4) EP2942981A1 (enExample)
JP (2) JP6466968B2 (enExample)
CN (2) CN106664501B (enExample)
BR (2) BR112016025771B1 (enExample)
RU (2) RU2663343C2 (enExample)
WO (2) WO2015169617A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108604454B (zh) * 2016-03-16 2020-12-15 华为技术有限公司 音频信号处理装置和输入音频信号处理方法
US10187740B2 (en) * 2016-09-23 2019-01-22 Apple Inc. Producing headphone driver signals in a digital audio signal processing binaural rendering environment
WO2018140618A1 (en) * 2017-01-27 2018-08-02 Shure Acquisiton Holdings, Inc. Array microphone module and system
US10219098B2 (en) * 2017-03-03 2019-02-26 GM Global Technology Operations LLC Location estimation of active speaker
JP6472824B2 (ja) * 2017-03-21 2019-02-20 株式会社東芝 信号処理装置、信号処理方法および音声の対応づけ提示装置
US9820073B1 (en) 2017-05-10 2017-11-14 Tls Corp. Extracting a common signal from multiple audio signals
GB2563606A (en) 2017-06-20 2018-12-26 Nokia Technologies Oy Spatial audio processing
GB2567244A (en) * 2017-10-09 2019-04-10 Nokia Technologies Oy Spatial audio signal processing
CN109857360B (zh) * 2017-11-30 2022-06-17 长城汽车股份有限公司 车内音频设备音量控制系统及控制方法
GB2571949A (en) 2018-03-13 2019-09-18 Nokia Technologies Oy Temporal spatial audio parameter smoothing
EP3811360A4 (en) 2018-06-21 2021-11-24 Magic Leap, Inc. PORTABLE SYSTEM VOICE PROCESSING
CN116437280A (zh) * 2018-08-22 2023-07-14 深圳市汇顶科技股份有限公司 评估麦克风阵列一致性的方法、设备、装置和系统
CA3113275A1 (en) * 2018-09-18 2020-03-26 Huawei Technologies Co., Ltd. Device and method for adaptation of virtual 3d audio to a real room
KR102824806B1 (ko) 2018-12-07 2025-06-25 프라운호퍼-게젤샤프트 추르 푀르데룽 데어 안제반텐 포르슝 에 파우 방향 컴포넌트 보상을 사용하는 DirAC 기반 공간 오디오 코딩과 관련된 인코딩, 디코딩, 장면 처리 및 기타 절차를 위한 장치, 방법 및 컴퓨터 프로그램
JP7580383B2 (ja) 2019-03-01 2024-11-11 マジック リープ， インコーポレイテッド 発話処理エンジンのための入力の決定
CN113994424B (zh) 2019-04-19 2025-04-15 奇跃公司 识别语音识别引擎的输入
WO2020221431A1 (en) * 2019-04-30 2020-11-05 Huawei Technologies Co., Ltd. Device and method for rendering a binaural audio signal
WO2020231884A1 (en) 2019-05-15 2020-11-19 Ocelot Laboratories Llc Audio processing
US11328740B2 (en) 2019-08-07 2022-05-10 Magic Leap, Inc. Voice onset detection
CN113519023A (zh) * 2019-10-29 2021-10-19 苹果公司 具有压缩环境的音频编码
US11627430B2 (en) 2019-12-06 2023-04-11 Magic Leap, Inc. Environment acoustics persistence
EP3849202B1 (en) * 2020-01-10 2023-02-08 Nokia Technologies Oy Audio and video processing
US11917384B2 (en) 2020-03-27 2024-02-27 Magic Leap, Inc. Method of waking a device using spoken voice commands
WO2022072752A1 (en) 2020-09-30 2022-04-07 Magic Leap, Inc. Voice user interface using non-linguistic input
CN112527108A (zh) * 2020-12-03 2021-03-19 歌尔光学科技有限公司 一种虚拟场景回放方法、装置、电子设备及存储介质
US11595775B2 (en) * 2021-04-06 2023-02-28 Meta Platforms Technologies, Llc Discrete binaural spatialization of sound sources on two audio channels
CN113889140B (zh) * 2021-09-24 2025-07-22 北京有竹居网络技术有限公司 音频信号播放方法、装置和电子设备
EP4420366A4 (en) * 2021-10-22 2025-06-11 Magic Leap, Inc. Voice analysis driven audio parameter modifications
CN114268883B (zh) * 2021-11-29 2025-06-13 苏州君林智能科技有限公司 一种选择麦克风布放位置的方法与系统
EP4454298A1 (en) 2021-12-20 2024-10-30 Dirac Research AB Multi channel audio processing for upmixing/remixing/downmixing applications
EP4530822A4 (en) * 2022-09-23 2025-08-27 Samsung Electronics Co Ltd ELECTRONIC DEVICE AND METHOD FOR CHANGING AUDIO SIGNAL BASED ON INFORMATION RELATING TO A VISUAL OBJECT

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7583805B2 (en) * 2004-02-12 2009-09-01 Agere Systems Inc. Late reverberation-based synthesis of auditory scenes
US7644003B2 (en) * 2001-05-04 2010-01-05 Agere Systems Inc. Cue-based audio coding/decoding
ES2294300T3 (es) * 2002-07-12 2008-04-01 Koninklijke Philips Electronics N.V. Codificacion de audio.
WO2007127757A2 (en) * 2006-04-28 2007-11-08 Cirrus Logic, Inc. Method and system for surround sound beam-forming using the overlapping portion of driver frequency ranges
US20080232601A1 (en) * 2007-03-21 2008-09-25 Ville Pulkki Method and apparatus for enhancement of audio reconstruction
US9015051B2 (en) * 2007-03-21 2015-04-21 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reconstruction of audio channels with direction parameters indicating direction of origin
US8180062B2 (en) * 2007-05-30 2012-05-15 Nokia Corporation Spatial sound zooming
US8064624B2 (en) * 2007-07-19 2011-11-22 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Method and apparatus for generating a stereo signal with enhanced perceptual quality
EP2154911A1 (en) * 2008-08-13 2010-02-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. An apparatus for determining a spatial output multi-channel audio signal
EP2346028A1 (en) * 2009-12-17 2011-07-20 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. An apparatus and a method for converting a first parametric spatial audio signal into a second parametric spatial audio signal
JP5508550B2 (ja) * 2010-02-24 2014-06-04 フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン 拡張ダウンミックス信号を発生するための装置、拡張ダウンミックス信号を発生するための方法及びコンピュータプログラム
US8908874B2 (en) * 2010-09-08 2014-12-09 Dts, Inc. Spatial audio encoding and reproduction
EP2464146A1 (en) * 2010-12-10 2012-06-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for decomposing an input signal using a pre-calculated reference curve
EP2600343A1 (en) * 2011-12-02 2013-06-05 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for merging geometry - based spatial audio coding streams

Also Published As

Publication number Publication date
RU2016146936A (ru) 2018-06-06
EP2942982A1 (en) 2015-11-11
BR112016025771A2 (enExample) 2017-08-15
EP3141000A1 (en) 2017-03-15
RU2016146936A3 (enExample) 2018-06-06
US9936323B2 (en) 2018-04-03
BR112016025771B1 (pt) 2022-08-23
EP3141001A1 (en) 2017-03-15
CN106664485B (zh) 2019-12-13
WO2015169618A1 (en) 2015-11-12
EP2942981A1 (en) 2015-11-11
BR112016025767A2 (enExample) 2017-08-15
EP3141000B1 (en) 2020-06-17
BR112016025767B1 (pt) 2022-08-23
RU2016147370A3 (enExample) 2018-06-06
CN106664485A (zh) 2017-05-10
US10015613B2 (en) 2018-07-03
RU2016147370A (ru) 2018-06-06
US20170078819A1 (en) 2017-03-16
EP3141001B1 (en) 2022-05-18
CN106664501A (zh) 2017-05-10
US20170078818A1 (en) 2017-03-16
JP2017517947A (ja) 2017-06-29
CN106664501B (zh) 2019-02-15
WO2015169617A1 (en) 2015-11-12
RU2665280C2 (ru) 2018-08-28
RU2663343C2 (ru) 2018-08-03
JP6466969B2 (ja) 2019-02-06
JP2017517948A (ja) 2017-06-29

Similar Documents

Publication Publication Date Title
JP6466968B2 (ja) インフォームド空間のフィルタリングに基づく矛盾しない音響場面再生のためのシステムおよび装置および方法
CN107925815B (zh) 空间音频处理装置
JP6703525B2 (ja) 音源を強調するための方法及び機器
JP2017517947A5 (enExample)
JP2017517948A5 (enExample)
KR20130116271A (ko) 다중 마이크에 의한 3차원 사운드 포착 및 재생
WO2017064368A1 (en) Distributed audio capture and mixing
JP7378575B2 (ja) 空間変換領域における音場表現を処理するための装置、方法、またはコンピュータプログラム
JP6404354B2 (ja) 多くの拡声器信号を生成するための装置及び方法、並びにコンピュータ・プログラム
WO2018234624A1 (en) Recording and rendering audio signals
JP2013110633A (ja) トランスオーラルシステム
Thiergart et al. An acoustical zoom based on informed spatial filtering
US10602297B2 (en) Processing audio signals
TW202446056A (zh) 視聽信號的產生
WO2025166300A1 (en) Method for generating an audio-visual media stream

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20161220

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161220

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20180109

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180406

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20180705

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20181211

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190110

R150 Certificate of patent or registration of utility model

Ref document number: 6466968

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250