RU2640742C1 - Извлечение реверберирующего звука с использованием микрофонных массивов - Google Patents

Извлечение реверберирующего звука с использованием микрофонных массивов Download PDF

Info

Publication number
RU2640742C1
RU2640742C1 RU2016127191A RU2016127191A RU2640742C1 RU 2640742 C1 RU2640742 C1 RU 2640742C1 RU 2016127191 A RU2016127191 A RU 2016127191A RU 2016127191 A RU2016127191 A RU 2016127191A RU 2640742 C1 RU2640742 C1 RU 2640742C1
Authority
RU
Russia
Prior art keywords
sound
microphone
filter
scattered
signal
Prior art date
Application number
RU2016127191A
Other languages
English (en)
Russian (ru)
Inventor
Оливер ТИРГАРТ
Эмануэль ХАБЕТС
Original Assignee
Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. filed Critical Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф.
Application granted granted Critical
Publication of RU2640742C1 publication Critical patent/RU2640742C1/ru

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0264—Noise filtering characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/26—Pre-filtering or post-filtering
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/027—Spatial or constructional arrangements of microphones, e.g. in dummy heads
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • G11B2020/10537—Audio or video recording
    • G11B2020/10592—Audio or video recording specifically adapted for recording or reproducing multichannel signals
    • G11B2020/10601—Audio or video recording specifically adapted for recording or reproducing multichannel signals surround sound signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
RU2016127191A 2013-12-11 2014-12-02 Извлечение реверберирующего звука с использованием микрофонных массивов RU2640742C1 (ru)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP13196672.3 2013-12-11
EP13196672 2013-12-11
EP14156014.4A EP2884491A1 (en) 2013-12-11 2014-02-20 Extraction of reverberant sound using microphone arrays
EP14156014.4 2014-02-20
PCT/EP2014/076252 WO2015086377A1 (en) 2013-12-11 2014-12-02 Extraction of reverberant sound using microphone arrays

Publications (1)

Publication Number Publication Date
RU2640742C1 true RU2640742C1 (ru) 2018-01-11

Family

ID=50230835

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2016127191A RU2640742C1 (ru) 2013-12-11 2014-12-02 Извлечение реверберирующего звука с использованием микрофонных массивов

Country Status (7)

Country Link
US (1) US9984702B2 (enExample)
EP (2) EP2884491A1 (enExample)
JP (1) JP6389259B2 (enExample)
CN (1) CN105981404B (enExample)
BR (1) BR112016013366B1 (enExample)
RU (1) RU2640742C1 (enExample)
WO (1) WO2015086377A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2805124C1 (ru) * 2020-06-11 2023-10-11 Долби Лэборетериз Лайсенсинг Корпорейшн Отделение панорамированных источников от обобщенных стереофонов с использованием минимального обучения
US12367887B2 (en) 2020-06-11 2025-07-22 Dolby Laboratories Licensing Corporation Separation of panned sources from generalized stereo backgrounds using minimal training

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2521649B (en) * 2013-12-27 2018-12-12 Nokia Technologies Oy Method, apparatus, computer program code and storage medium for processing audio signals
CN106031196B (zh) * 2014-02-28 2018-12-07 日本电信电话株式会社 信号处理装置、方法以及程序
US10923132B2 (en) 2016-02-19 2021-02-16 Dolby Laboratories Licensing Corporation Diffusivity based sound processing method and apparatus
EP3338462B1 (en) 2016-03-15 2019-08-28 Fraunhofer Gesellschaft zur Förderung der Angewand Apparatus, method or computer program for generating a sound field description
CN105869651B (zh) * 2016-03-23 2019-05-31 北京大学深圳研究生院 基于噪声混合相干性的双通道波束形成语音增强方法
WO2018053050A1 (en) * 2016-09-13 2018-03-22 VisiSonics Corporation Audio signal processor and generator
US10187740B2 (en) * 2016-09-23 2019-01-22 Apple Inc. Producing headphone driver signals in a digital audio signal processing binaural rendering environment
US11528556B2 (en) 2016-10-14 2022-12-13 Nokia Technologies Oy Method and apparatus for output signal equalization between microphones
US9813833B1 (en) * 2016-10-14 2017-11-07 Nokia Technologies Oy Method and apparatus for output signal equalization between microphones
US10056091B2 (en) * 2017-01-06 2018-08-21 Bose Corporation Microphone array beamforming
US10219098B2 (en) * 2017-03-03 2019-02-26 GM Global Technology Operations LLC Location estimation of active speaker
CN106960672B (zh) * 2017-03-30 2020-08-21 国家计算机网络与信息安全管理中心 一种立体声音频的带宽扩展方法与装置
GB2562518A (en) 2017-05-18 2018-11-21 Nokia Technologies Oy Spatial audio processing
KR102654507B1 (ko) * 2017-07-14 2024-04-05 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. 다중-지점 음장 묘사를 이용하여 증강된 음장 묘사 또는 수정된 음장 묘사를 생성하기 위한 개념
EP3573058B1 (en) * 2018-05-23 2021-02-24 Harman Becker Automotive Systems GmbH Dry sound and ambient sound separation
WO2021024474A1 (ja) * 2019-08-08 2021-02-11 日本電信電話株式会社 Ｐｓｄ最適化装置、ｐｓｄ最適化方法、プログラム
WO2021024475A1 (ja) * 2019-08-08 2021-02-11 日本電信電話株式会社 Ｐｓｄ最適化装置、ｐｓｄ最適化方法、プログラム
CN113963712B (zh) * 2020-07-21 2025-07-25 华为技术有限公司 滤除回声的方法、电子设备和计算机可读存储介质
CN112017684B (zh) * 2020-08-27 2022-06-24 北京计算机技术及应用研究所 一种基于麦克风阵列的密闭空间混响消除方法
CN113257270B (zh) * 2021-05-10 2022-07-15 中国科学技术大学 一种基于参考麦克风优化的多通道语音增强方法
CN115862665B (zh) * 2023-02-27 2023-06-16 广州市迪声音响有限公司 一种回声混响效果参数的可视化曲线界面系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080069366A1 (en) * 2006-09-20 2008-03-20 Gilbert Arthur Joseph Soulodre Method and apparatus for extracting and changing the reveberant content of an input signal
RU2343562C1 (ru) * 2007-04-23 2009-01-10 Федеральное государственное образовательное учреждение высшего профессионального образования "Санкт-Петербургский государственный университет кино и телевидения" "СПбГУКиТ" Способ и электронное устройство оптимизации времени реверберации при передаче звуковых сигналов
US20090252355A1 (en) * 2008-04-07 2009-10-08 Sony Computer Entertainment Inc. Targeted sound detection and generation for audio headset
US20090299742A1 (en) * 2008-05-29 2009-12-03 Qualcomm Incorporated Systems, methods, apparatus, and computer program products for spectral contrast enhancement
US20120128160A1 (en) * 2010-10-25 2012-05-24 Qualcomm Incorporated Three-dimensional sound capturing and reproducing with multi-microphones

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100493172B1 (ko) * 2003-03-06 2005-06-02 삼성전자주식회사 마이크로폰 어레이 구조, 이를 이용한 일정한 지향성을갖는 빔 형성방법 및 장치와 음원방향 추정방법 및 장치
GB0321722D0 (en) * 2003-09-16 2003-10-15 Mitel Networks Corp A method for optimal microphone array design under uniform acoustic coupling constraints
GB0405455D0 (en) * 2004-03-11 2004-04-21 Mitel Networks Corp High precision beamsteerer based on fixed beamforming approach beampatterns
JP4177413B2 (ja) * 2004-07-20 2008-11-05 パイオニア株式会社 音響再生装置および音響再生システム
US9015051B2 (en) * 2007-03-21 2015-04-21 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reconstruction of audio channels with direction parameters indicating direction of origin
MX2012009785A (es) * 2010-02-24 2012-11-23 Fraunhofer Ges Forschung Aparato para generar señal de mezcla descendente mejorada, metodo para generar señal de mezcla descendente mejorada y programa de computadora.
EP2375410B1 (en) * 2010-03-29 2017-11-22 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. A spatial audio processor and a method for providing spatial parameters based on an acoustic input signal
CN102859591B (zh) * 2010-04-12 2015-02-18 瑞典爱立信有限公司 用于语音编码器中的噪声消除的方法和装置
US9100734B2 (en) * 2010-10-22 2015-08-04 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for far-field multi-source tracking and separation
EP2444967A1 (en) * 2010-10-25 2012-04-25 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Echo suppression comprising modeling of late reverberation components
EP2708043B1 (en) * 2011-05-11 2020-06-03 Sennheiser Electronic GmbH & Co. KG Method for efficient sound field control of a compact loudspeaker array
JP5817366B2 (ja) * 2011-09-12 2015-11-18 沖電気工業株式会社 音声信号処理装置、方法及びプログラム
JP5897343B2 (ja) 2012-02-17 2016-03-30 株式会社日立製作所 残響除去パラメータ推定装置及び方法、残響・エコー除去パラメータ推定装置、残響除去装置、残響・エコー除去装置、並びに、残響除去装置オンライン会議システム
JP5738218B2 (ja) * 2012-02-28 2015-06-17 日本電信電話株式会社 音響信号強調装置、遠近判定装置、それらの方法、及びプログラム
US9495591B2 (en) * 2012-04-13 2016-11-15 Qualcomm Incorporated Object recognition using multi-modal matching scheme

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080069366A1 (en) * 2006-09-20 2008-03-20 Gilbert Arthur Joseph Soulodre Method and apparatus for extracting and changing the reveberant content of an input signal
WO2008034221A1 (en) * 2006-09-20 2008-03-27 Harman International Industries, Incorporated Method and apparatus for extracting and changing the reverberant content of an input signal
US20120063608A1 (en) * 2006-09-20 2012-03-15 Harman International Industries, Incorporated System for extraction of reverberant content of an audio signal
RU2343562C1 (ru) * 2007-04-23 2009-01-10 Федеральное государственное образовательное учреждение высшего профессионального образования "Санкт-Петербургский государственный университет кино и телевидения" "СПбГУКиТ" Способ и электронное устройство оптимизации времени реверберации при передаче звуковых сигналов
US20090252355A1 (en) * 2008-04-07 2009-10-08 Sony Computer Entertainment Inc. Targeted sound detection and generation for audio headset
US20090299742A1 (en) * 2008-05-29 2009-12-03 Qualcomm Incorporated Systems, methods, apparatus, and computer program products for spectral contrast enhancement
US20120128160A1 (en) * 2010-10-25 2012-05-24 Qualcomm Incorporated Three-dimensional sound capturing and reproducing with multi-microphones

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2805124C1 (ru) * 2020-06-11 2023-10-11 Долби Лэборетериз Лайсенсинг Корпорейшн Отделение панорамированных источников от обобщенных стереофонов с использованием минимального обучения
US12367887B2 (en) 2020-06-11 2025-07-22 Dolby Laboratories Licensing Corporation Separation of panned sources from generalized stereo backgrounds using minimal training

Also Published As

Publication number Publication date
BR112016013366A2 (pt) 2017-08-08
BR112016013366B1 (pt) 2021-12-28
CN105981404A (zh) 2016-09-28
JP6389259B2 (ja) 2018-09-12
US9984702B2 (en) 2018-05-29
US20160293179A1 (en) 2016-10-06
CN105981404B (zh) 2019-06-04
EP3080806A1 (en) 2016-10-19
EP2884491A1 (en) 2015-06-17
WO2015086377A1 (en) 2015-06-18
EP3080806B1 (en) 2021-07-28
JP2017503388A (ja) 2017-01-26

Similar Documents

Publication Publication Date Title
RU2640742C1 (ru) Извлечение реверберирующего звука с использованием микрофонных массивов
RU2570359C2 (ru) Прием звука посредством выделения геометрической информации из оценок направления его поступления
TWI558228B (zh) 依據空間能量密度定位麥克風之設備及方法
RU2596592C2 (ru) Пространственный аудио процессор и способ обеспечения пространственных параметров на основе акустического входного сигнала
Braun et al. A multichannel diffuse power estimator for dereverberation in the presence of multiple sources
Götz et al. Analysis of multi-exponential and anisotropic sound energy decay
Gerlach et al. Joint estimation of pitch and direction of arrival: improving robustness and accuracy for multi-speaker scenarios
Kavruk Two stage blind dereverberation based on stochastic models of speech and reverberation
HK1190490B (en) Sound acquisition via the extraction of geometrical information from direction of arrival estimates
HK1202746B (en) Apparatus and method for microphone positioning based on a spatial power density