CN114025301B - 用于回放多个音频源的双声道渲染装置和方法 - Google Patents
用于回放多个音频源的双声道渲染装置和方法 Download PDFInfo
- Publication number
- CN114025301B CN114025301B CN202111170487.4A CN202111170487A CN114025301B CN 114025301 B CN114025301 B CN 114025301B CN 202111170487 A CN202111170487 A CN 202111170487A CN 114025301 B CN114025301 B CN 114025301B
- Authority
- CN
- China
- Prior art keywords
- source
- brir
- binaural
- frame
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 32
- 238000000034 method Methods 0.000 title description 40
- 239000000203 mixture Substances 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 31
- 238000009792 diffusion process Methods 0.000 claims description 10
- 238000012935 Averaging Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000010354 integration Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- NRNCYVBFPDDJNE-UHFFFAOYSA-N pemoline Chemical compound O1C(N)=NC(=O)C1C1=CC=CC=C1 NRNCYVBFPDDJNE-UHFFFAOYSA-N 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000001208 nuclear magnetic resonance pulse sequence Methods 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000011524 similarity measure Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
- H04S7/304—For headphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
- H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
- H04S1/005—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Stereophonic System (AREA)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111170487.4A CN114025301B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016211803 | 2016-10-28 | ||
| JP2016-211803 | 2016-10-28 | ||
| CN201780059396.9A CN109792582B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
| PCT/JP2017/036738 WO2018079254A1 (en) | 2016-10-28 | 2017-10-11 | Binaural rendering apparatus and method for playing back of multiple audio sources |
| CN202111170487.4A CN114025301B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780059396.9A Division CN109792582B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114025301A CN114025301A (zh) | 2022-02-08 |
| CN114025301B true CN114025301B (zh) | 2024-07-30 |
Family
ID=62024946
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111170487.4A Active CN114025301B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
| CN201780059396.9A Active CN109792582B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780059396.9A Active CN109792582B (zh) | 2016-10-28 | 2017-10-11 | 用于回放多个音频源的双声道渲染装置和方法 |
Country Status (5)
| Country | Link |
|---|---|
| US (5) | US10555107B2 (https=) |
| EP (2) | EP3822968B1 (https=) |
| JP (2) | JP6977030B2 (https=) |
| CN (2) | CN114025301B (https=) |
| WO (1) | WO2018079254A1 (https=) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3619922B1 (en) | 2017-05-04 | 2022-06-29 | Dolby International AB | Rendering audio objects having apparent size |
| WO2019004524A1 (ko) * | 2017-06-27 | 2019-01-03 | 엘지전자 주식회사 | 6자유도 환경에서 오디오 재생 방법 및 오디오 재생 장치 |
| ES2954317T3 (es) * | 2018-03-28 | 2023-11-21 | Fund Eurecat | Técnica de reverberación para audio 3D |
| US11068668B2 (en) * | 2018-10-25 | 2021-07-20 | Facebook Technologies, Llc | Natural language translation in augmented reality(AR) |
| GB2593419A (en) * | 2019-10-11 | 2021-09-29 | Nokia Technologies Oy | Spatial audio representation and rendering |
| US11967329B2 (en) * | 2020-02-20 | 2024-04-23 | Qualcomm Incorporated | Signaling for rendering tools |
| CN111918176B (zh) | 2020-07-31 | 2025-07-04 | 北京全景声信息科技有限公司 | 音频处理方法、装置、无线耳机以及存储介质 |
| EP4164254A1 (en) | 2021-10-06 | 2023-04-12 | Nokia Technologies Oy | Rendering spatial audio content |
| CN116939474A (zh) | 2022-04-12 | 2023-10-24 | 北京荣耀终端有限公司 | 一种音频信号处理方法及电子设备 |
| WO2024253691A1 (en) * | 2023-06-08 | 2024-12-12 | Google Llc | Performing common audio convolutions using iso-trajectories in three dimensional (3d) space |
| US12408001B2 (en) | 2023-06-16 | 2025-09-02 | Harman International Industries, Incorporated | Rendering of audio signals using virtualized reverberation |
| US20250024219A1 (en) * | 2023-07-12 | 2025-01-16 | Qualcomm Incorporated | Sound field adjustment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2806658A1 (en) * | 2013-05-24 | 2014-11-26 | Iosono GmbH | Arrangement and method for reproducing audio data of an acoustic scene |
| WO2015102920A1 (en) * | 2014-01-03 | 2015-07-09 | Dolby Laboratories Licensing Corporation | Generating binaural audio in response to multi-channel audio using at least one feedback delay network |
Family Cites Families (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000013900A (ja) * | 1998-06-25 | 2000-01-14 | Matsushita Electric Ind Co Ltd | 音再生装置 |
| WO2007052612A1 (ja) * | 2005-10-31 | 2007-05-10 | Matsushita Electric Industrial Co., Ltd. | ステレオ符号化装置およびステレオ信号予測方法 |
| JP2007135077A (ja) * | 2005-11-11 | 2007-05-31 | Kyocera Corp | 携帯端末装置、音響出力装置、音響装置及びその音響出力制御方法 |
| US8682679B2 (en) | 2007-06-26 | 2014-03-25 | Koninklijke Philips N.V. | Binaural object-oriented audio decoder |
| CN101458942B (zh) * | 2007-12-14 | 2012-07-18 | 鸿富锦精密工业（深圳）有限公司 | 音视频装置及控制方法 |
| EP2175670A1 (en) | 2008-10-07 | 2010-04-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Binaural rendering of a multi-channel audio signal |
| US7769641B2 (en) * | 2008-11-18 | 2010-08-03 | Cisco Technology, Inc. | Sharing media content assets between users of a web-based service |
| KR101646540B1 (ko) * | 2008-11-21 | 2016-08-08 | 아우로 테크놀로지스 | 오디오 신호를 변환하는 컨버터 및 방법 |
| CN102414743A (zh) | 2009-04-21 | 2012-04-11 | 皇家飞利浦电子股份有限公司 | 音频信号合成 |
| US8396577B2 (en) * | 2009-08-14 | 2013-03-12 | Dts Llc | System for creating audio objects for streaming |
| US9819987B2 (en) * | 2010-11-17 | 2017-11-14 | Verizon Patent And Licensing Inc. | Content entitlement determinations for playback of video streams on portable devices |
| EP2503800B1 (en) * | 2011-03-24 | 2018-09-19 | Harman Becker Automotive Systems GmbH | Spatially constant surround sound |
| US9043435B2 (en) * | 2011-10-24 | 2015-05-26 | International Business Machines Corporation | Distributing licensed content across multiple devices |
| JP5754595B2 (ja) * | 2011-11-22 | 2015-07-29 | 日本電信電話株式会社 | トランスオーラルシステム |
| US9761229B2 (en) * | 2012-07-20 | 2017-09-12 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for audio object clustering |
| US9479886B2 (en) * | 2012-07-20 | 2016-10-25 | Qualcomm Incorporated | Scalable downmix design with feedback for object-based surround codec |
| CN107454511B (zh) * | 2012-08-31 | 2024-04-05 | 杜比实验室特许公司 | 用于使声音从观看屏幕或显示表面反射的扬声器 |
| TWI530941B (zh) * | 2013-04-03 | 2016-04-21 | 杜比實驗室特許公司 | 用於基於物件音頻之互動成像的方法與系統 |
| CN104982042B (zh) * | 2013-04-19 | 2018-06-08 | 韩国电子通信研究院 | 多信道音频信号处理装置及方法 |
| US9420393B2 (en) * | 2013-05-29 | 2016-08-16 | Qualcomm Incorporated | Binaural rendering of spherical harmonic coefficients |
| EP2830043A3 (en) * | 2013-07-22 | 2015-02-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method for Processing an Audio Signal in accordance with a Room Impulse Response, Signal Processing Unit, Audio Encoder, Audio Decoder, and Binaural Renderer |
| EP2840811A1 (en) * | 2013-07-22 | 2015-02-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method for processing an audio signal; signal processing unit, binaural renderer, audio encoder and audio decoder |
| KR102007991B1 (ko) * | 2013-07-25 | 2019-08-06 | 한국전자통신연구원 | 다채널 오디오 신호의 바이노럴 렌더링 방법 및 장치 |
| CN105900455B (zh) * | 2013-10-22 | 2018-04-06 | 延世大学工业学术合作社 | 用于处理音频信号的方法和设备 |
| EP4421617A3 (en) * | 2013-10-31 | 2024-11-06 | Dolby Laboratories Licensing Corporation | Binaural rendering for headphones using metadata processing |
| WO2015103024A1 (en) * | 2014-01-03 | 2015-07-09 | Dolby Laboratories Licensing Corporation | Methods and systems for designing and applying numerically optimized binaural room impulse responses |
| BR112016021565B1 (pt) * | 2014-03-21 | 2021-11-30 | Huawei Technologies Co., Ltd | Aparelho e método para estimar um tempo de mistura geral com base em uma pluralidade de pares de respostas impulsivas de sala, e decodificador de áudio |
| KR102216801B1 (ko) * | 2014-04-02 | 2021-02-17 | 주식회사 윌러스표준기술연구소 | 오디오 신호 처리 방법 및 장치 |
| US9432778B2 (en) * | 2014-04-04 | 2016-08-30 | Gn Resound A/S | Hearing aid with improved localization of a monaural signal source |
| CN104240712B (zh) * | 2014-09-30 | 2018-02-02 | 武汉大学深圳研究院 | 一种三维音频多声道分组聚类编码方法及系统 |
-
2017
- 2017-10-11 WO PCT/JP2017/036738 patent/WO2018079254A1/en not_active Ceased
- 2017-10-11 EP EP20209677.2A patent/EP3822968B1/en active Active
- 2017-10-11 JP JP2019518124A patent/JP6977030B2/ja active Active
- 2017-10-11 US US16/341,861 patent/US10555107B2/en active Active
- 2017-10-11 CN CN202111170487.4A patent/CN114025301B/zh active Active
- 2017-10-11 EP EP17865085.9A patent/EP3533242B1/en active Active
- 2017-10-11 CN CN201780059396.9A patent/CN109792582B/zh active Active
-
2019
- 2019-12-23 US US16/724,921 patent/US10735886B2/en active Active
-
2020
- 2020-06-26 US US16/913,034 patent/US10873826B2/en active Active
- 2020-11-13 US US17/097,829 patent/US11337026B2/en active Active
-
2021
- 2021-11-09 JP JP2021182510A patent/JP7222054B2/ja active Active
-
2022
- 2022-04-20 US US17/725,097 patent/US11653171B2/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2806658A1 (en) * | 2013-05-24 | 2014-11-26 | Iosono GmbH | Arrangement and method for reproducing audio data of an acoustic scene |
| WO2015102920A1 (en) * | 2014-01-03 | 2015-07-09 | Dolby Laboratories Licensing Corporation | Generating binaural audio in response to multi-channel audio using at least one feedback delay network |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3533242A1 (en) | 2019-09-04 |
| JP7222054B2 (ja) | 2023-02-14 |
| US11653171B2 (en) | 2023-05-16 |
| CN109792582A (zh) | 2019-05-21 |
| EP3822968A1 (en) | 2021-05-19 |
| CN114025301A (zh) | 2022-02-08 |
| JP2019532579A (ja) | 2019-11-07 |
| US10555107B2 (en) | 2020-02-04 |
| US20190246236A1 (en) | 2019-08-08 |
| JP6977030B2 (ja) | 2021-12-08 |
| EP3533242B1 (en) | 2021-01-20 |
| CN109792582B (zh) | 2021-10-22 |
| US20220248163A1 (en) | 2022-08-04 |
| US20200128351A1 (en) | 2020-04-23 |
| US10735886B2 (en) | 2020-08-04 |
| WO2018079254A1 (en) | 2018-05-03 |
| US10873826B2 (en) | 2020-12-22 |
| US11337026B2 (en) | 2022-05-17 |
| JP2022010174A (ja) | 2022-01-14 |
| EP3533242A4 (en) | 2019-10-30 |
| US20200329332A1 (en) | 2020-10-15 |
| EP3822968B1 (en) | 2023-09-06 |
| US20210067897A1 (en) | 2021-03-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114025301B (zh) | 用于回放多个音频源的双声道渲染装置和方法 | |
| KR102653560B1 (ko) | 다채널 오디오 신호 처리 장치 및 방법 | |
| US10555104B2 (en) | Binaural decoder to output spatial stereo sound and a decoding method thereof | |
| US9351070B2 (en) | Positional disambiguation in spatial audio | |
| CN113038354B (zh) | 用于参数化双耳输出系统和方法的头部跟踪 | |
| EP3444815B1 (en) | Multiplet-based matrix mixing for high-channel count multichannel audio | |
| EP2870603B1 (en) | Encoding and decoding of audio signals | |
| KR20190028706A (ko) | 근거리/원거리 렌더링을 사용한 거리 패닝 | |
| EP3409029B1 (en) | Binaural dialogue enhancement | |
| CN108141685A (zh) | 使用呈现变换参数的音频编码和解码 | |
| US10375472B2 (en) | Determining azimuth and elevation angles from stereo recordings | |
| US11032639B2 (en) | Determining azimuth and elevation angles from stereo recordings | |
| CN116615919A (zh) | 双耳信号的后处理 | |
| HK1255002B (en) | Determining azimuth and elevation angles from stereo recordings |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |