JP6977030B2 - 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 - Google Patents
複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 Download PDFInfo
- Publication number
- JP6977030B2 JP6977030B2 JP2019518124A JP2019518124A JP6977030B2 JP 6977030 B2 JP6977030 B2 JP 6977030B2 JP 2019518124 A JP2019518124 A JP 2019518124A JP 2019518124 A JP2019518124 A JP 2019518124A JP 6977030 B2 JP6977030 B2 JP 6977030B2
- Authority
- JP
- Japan
- Prior art keywords
- brir
- frame
- audio source
- binaural
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 36
- 238000009877 rendering Methods 0.000 title claims description 36
- 238000009792 diffusion process Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 10
- 239000000203 mixture Substances 0.000 claims description 5
- 238000002372 labelling Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000010354 integration Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000002747 voluntary effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
- H04S7/303—Tracking of listener position or orientation
- H04S7/304—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
- H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
- H04S1/005—For headphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Stereophonic System (AREA)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2021182510A JP7222054B2 (ja) | 2016-10-28 | 2021-11-09 | 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016211803 | 2016-10-28 | ||
| JP2016211803 | 2016-10-28 | ||
| PCT/JP2017/036738 WO2018079254A1 (en) | 2016-10-28 | 2017-10-11 | Binaural rendering apparatus and method for playing back of multiple audio sources |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2021182510A Division JP7222054B2 (ja) | 2016-10-28 | 2021-11-09 | 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2019532579A JP2019532579A (ja) | 2019-11-07 |
| JP2019532579A5 JP2019532579A5 (https=) | 2021-01-21 |
| JP6977030B2 true JP6977030B2 (ja) | 2021-12-08 |
Family
ID=62024946
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2019518124A Active JP6977030B2 (ja) | 2016-10-28 | 2017-10-11 | 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 |
| JP2021182510A Active JP7222054B2 (ja) | 2016-10-28 | 2021-11-09 | 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2021182510A Active JP7222054B2 (ja) | 2016-10-28 | 2021-11-09 | 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 |
Country Status (5)
| Country | Link |
|---|---|
| US (5) | US10555107B2 (https=) |
| EP (2) | EP3822968B1 (https=) |
| JP (2) | JP6977030B2 (https=) |
| CN (2) | CN114025301B (https=) |
| WO (1) | WO2018079254A1 (https=) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3619922B1 (en) | 2017-05-04 | 2022-06-29 | Dolby International AB | Rendering audio objects having apparent size |
| WO2019004524A1 (ko) * | 2017-06-27 | 2019-01-03 | 엘지전자 주식회사 | 6자유도 환경에서 오디오 재생 방법 및 오디오 재생 장치 |
| ES2954317T3 (es) * | 2018-03-28 | 2023-11-21 | Fund Eurecat | Técnica de reverberación para audio 3D |
| US11068668B2 (en) * | 2018-10-25 | 2021-07-20 | Facebook Technologies, Llc | Natural language translation in augmented reality(AR) |
| GB2593419A (en) * | 2019-10-11 | 2021-09-29 | Nokia Technologies Oy | Spatial audio representation and rendering |
| US11967329B2 (en) * | 2020-02-20 | 2024-04-23 | Qualcomm Incorporated | Signaling for rendering tools |
| CN111918176B (zh) | 2020-07-31 | 2025-07-04 | 北京全景声信息科技有限公司 | 音频处理方法、装置、无线耳机以及存储介质 |
| EP4164254A1 (en) | 2021-10-06 | 2023-04-12 | Nokia Technologies Oy | Rendering spatial audio content |
| CN116939474A (zh) | 2022-04-12 | 2023-10-24 | 北京荣耀终端有限公司 | 一种音频信号处理方法及电子设备 |
| WO2024253691A1 (en) * | 2023-06-08 | 2024-12-12 | Google Llc | Performing common audio convolutions using iso-trajectories in three dimensional (3d) space |
| US12408001B2 (en) | 2023-06-16 | 2025-09-02 | Harman International Industries, Incorporated | Rendering of audio signals using virtualized reverberation |
| US20250024219A1 (en) * | 2023-07-12 | 2025-01-16 | Qualcomm Incorporated | Sound field adjustment |
Family Cites Families (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000013900A (ja) * | 1998-06-25 | 2000-01-14 | Matsushita Electric Ind Co Ltd | 音再生装置 |
| WO2007052612A1 (ja) * | 2005-10-31 | 2007-05-10 | Matsushita Electric Industrial Co., Ltd. | ステレオ符号化装置およびステレオ信号予測方法 |
| JP2007135077A (ja) * | 2005-11-11 | 2007-05-31 | Kyocera Corp | 携帯端末装置、音響出力装置、音響装置及びその音響出力制御方法 |
| US8682679B2 (en) | 2007-06-26 | 2014-03-25 | Koninklijke Philips N.V. | Binaural object-oriented audio decoder |
| CN101458942B (zh) * | 2007-12-14 | 2012-07-18 | 鸿富锦精密工业(深圳)有限公司 | 音视频装置及控制方法 |
| EP2175670A1 (en) | 2008-10-07 | 2010-04-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Binaural rendering of a multi-channel audio signal |
| US7769641B2 (en) * | 2008-11-18 | 2010-08-03 | Cisco Technology, Inc. | Sharing media content assets between users of a web-based service |
| KR101646540B1 (ko) * | 2008-11-21 | 2016-08-08 | 아우로 테크놀로지스 | 오디오 신호를 변환하는 컨버터 및 방법 |
| CN102414743A (zh) | 2009-04-21 | 2012-04-11 | 皇家飞利浦电子股份有限公司 | 音频信号合成 |
| US8396577B2 (en) * | 2009-08-14 | 2013-03-12 | Dts Llc | System for creating audio objects for streaming |
| US9819987B2 (en) * | 2010-11-17 | 2017-11-14 | Verizon Patent And Licensing Inc. | Content entitlement determinations for playback of video streams on portable devices |
| EP2503800B1 (en) * | 2011-03-24 | 2018-09-19 | Harman Becker Automotive Systems GmbH | Spatially constant surround sound |
| US9043435B2 (en) * | 2011-10-24 | 2015-05-26 | International Business Machines Corporation | Distributing licensed content across multiple devices |
| JP5754595B2 (ja) * | 2011-11-22 | 2015-07-29 | 日本電信電話株式会社 | トランスオーラルシステム |
| US9761229B2 (en) * | 2012-07-20 | 2017-09-12 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for audio object clustering |
| US9479886B2 (en) * | 2012-07-20 | 2016-10-25 | Qualcomm Incorporated | Scalable downmix design with feedback for object-based surround codec |
| CN107454511B (zh) * | 2012-08-31 | 2024-04-05 | 杜比实验室特许公司 | 用于使声音从观看屏幕或显示表面反射的扬声器 |
| TWI530941B (zh) * | 2013-04-03 | 2016-04-21 | 杜比實驗室特許公司 | 用於基於物件音頻之互動成像的方法與系統 |
| CN104982042B (zh) * | 2013-04-19 | 2018-06-08 | 韩国电子通信研究院 | 多信道音频信号处理装置及方法 |
| EP2806658B1 (en) * | 2013-05-24 | 2017-09-27 | Barco N.V. | Arrangement and method for reproducing audio data of an acoustic scene |
| US9420393B2 (en) * | 2013-05-29 | 2016-08-16 | Qualcomm Incorporated | Binaural rendering of spherical harmonic coefficients |
| EP2830043A3 (en) * | 2013-07-22 | 2015-02-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method for Processing an Audio Signal in accordance with a Room Impulse Response, Signal Processing Unit, Audio Encoder, Audio Decoder, and Binaural Renderer |
| EP2840811A1 (en) * | 2013-07-22 | 2015-02-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method for processing an audio signal; signal processing unit, binaural renderer, audio encoder and audio decoder |
| KR102007991B1 (ko) * | 2013-07-25 | 2019-08-06 | 한국전자통신연구원 | 다채널 오디오 신호의 바이노럴 렌더링 방법 및 장치 |
| CN105900455B (zh) * | 2013-10-22 | 2018-04-06 | 延世大学工业学术合作社 | 用于处理音频信号的方法和设备 |
| EP4421617A3 (en) * | 2013-10-31 | 2024-11-06 | Dolby Laboratories Licensing Corporation | Binaural rendering for headphones using metadata processing |
| WO2015103024A1 (en) * | 2014-01-03 | 2015-07-09 | Dolby Laboratories Licensing Corporation | Methods and systems for designing and applying numerically optimized binaural room impulse responses |
| WO2015102920A1 (en) * | 2014-01-03 | 2015-07-09 | Dolby Laboratories Licensing Corporation | Generating binaural audio in response to multi-channel audio using at least one feedback delay network |
| BR112016021565B1 (pt) * | 2014-03-21 | 2021-11-30 | Huawei Technologies Co., Ltd | Aparelho e método para estimar um tempo de mistura geral com base em uma pluralidade de pares de respostas impulsivas de sala, e decodificador de áudio |
| KR102216801B1 (ko) * | 2014-04-02 | 2021-02-17 | 주식회사 윌러스표준기술연구소 | 오디오 신호 처리 방법 및 장치 |
| US9432778B2 (en) * | 2014-04-04 | 2016-08-30 | Gn Resound A/S | Hearing aid with improved localization of a monaural signal source |
| CN104240712B (zh) * | 2014-09-30 | 2018-02-02 | 武汉大学深圳研究院 | 一种三维音频多声道分组聚类编码方法及系统 |
-
2017
- 2017-10-11 WO PCT/JP2017/036738 patent/WO2018079254A1/en not_active Ceased
- 2017-10-11 EP EP20209677.2A patent/EP3822968B1/en active Active
- 2017-10-11 JP JP2019518124A patent/JP6977030B2/ja active Active
- 2017-10-11 US US16/341,861 patent/US10555107B2/en active Active
- 2017-10-11 CN CN202111170487.4A patent/CN114025301B/zh active Active
- 2017-10-11 EP EP17865085.9A patent/EP3533242B1/en active Active
- 2017-10-11 CN CN201780059396.9A patent/CN109792582B/zh active Active
-
2019
- 2019-12-23 US US16/724,921 patent/US10735886B2/en active Active
-
2020
- 2020-06-26 US US16/913,034 patent/US10873826B2/en active Active
- 2020-11-13 US US17/097,829 patent/US11337026B2/en active Active
-
2021
- 2021-11-09 JP JP2021182510A patent/JP7222054B2/ja active Active
-
2022
- 2022-04-20 US US17/725,097 patent/US11653171B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| EP3533242A1 (en) | 2019-09-04 |
| JP7222054B2 (ja) | 2023-02-14 |
| US11653171B2 (en) | 2023-05-16 |
| CN109792582A (zh) | 2019-05-21 |
| CN114025301B (zh) | 2024-07-30 |
| EP3822968A1 (en) | 2021-05-19 |
| CN114025301A (zh) | 2022-02-08 |
| JP2019532579A (ja) | 2019-11-07 |
| US10555107B2 (en) | 2020-02-04 |
| US20190246236A1 (en) | 2019-08-08 |
| EP3533242B1 (en) | 2021-01-20 |
| CN109792582B (zh) | 2021-10-22 |
| US20220248163A1 (en) | 2022-08-04 |
| US20200128351A1 (en) | 2020-04-23 |
| US10735886B2 (en) | 2020-08-04 |
| WO2018079254A1 (en) | 2018-05-03 |
| US10873826B2 (en) | 2020-12-22 |
| US11337026B2 (en) | 2022-05-17 |
| JP2022010174A (ja) | 2022-01-14 |
| EP3533242A4 (en) | 2019-10-30 |
| US20200329332A1 (en) | 2020-10-15 |
| EP3822968B1 (en) | 2023-09-06 |
| US20210067897A1 (en) | 2021-03-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7222054B2 (ja) | 複数のオーディオソースの再生のためのバイノーラルレンダリング装置および方法 | |
| US9712939B2 (en) | Panning of audio objects to arbitrary speaker layouts | |
| JP6284955B2 (ja) | 仮想スピーカーを物理スピーカーにマッピングすること | |
| EP2870603B1 (en) | Encoding and decoding of audio signals | |
| CN108476367A (zh) | 用于沉浸式音频回放的信号的合成 | |
| JP2023527432A (ja) | 音声レンダリング方法および装置 | |
| JP2026035652A (ja) | バイノーラル信号の後処理 | |
| EP4454298A1 (en) | Multi channel audio processing for upmixing/remixing/downmixing applications | |
| US11032639B2 (en) | Determining azimuth and elevation angles from stereo recordings | |
| WO2025036543A1 (en) | Devices and methods for binaural audio rendering | |
| CN115836535A (zh) | 信号处理装置、方法和程序 | |
| HK1255002B (en) | Determining azimuth and elevation angles from stereo recordings |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| RD02 | Notification of acceptance of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7422 Effective date: 20190717 |
|
| RD04 | Notification of resignation of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7424 Effective date: 20191114 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20200904 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201204 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20210727 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20210917 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20211012 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20211110 |
|
| R150 | Certificate of patent or registration of utility model |
Ref document number: 6977030 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |