CN116320907B - 近场音频渲染 - Google Patents

近场音频渲染

Info

Publication number
CN116320907B
CN116320907B CN202310249063.XA CN202310249063A CN116320907B CN 116320907 B CN116320907 B CN 116320907B CN 202310249063 A CN202310249063 A CN 202310249063A CN 116320907 B CN116320907 B CN 116320907B
Authority
CN
China
Prior art keywords
audio signal
user
determining
head
virtual speaker
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310249063.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN116320907A (zh
Inventor
R·S·奥德弗雷
J-M·约特
S·C·迪克尔
M·B·赫腾施泰因尔
J·D·马修
A·A·塔吉克
N·J·拉马尔蒂纳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN116320907A publication Critical patent/CN116320907A/zh
Application granted granted Critical
Publication of CN116320907B publication Critical patent/CN116320907B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Stereophonic System (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)
CN202310249063.XA 2018-10-05 2019-10-04 近场音频渲染 Active CN116320907B (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201862741677P 2018-10-05 2018-10-05
US62/741,677 2018-10-05
US201962812734P 2019-03-01 2019-03-01
US62/812,734 2019-03-01
CN201980080065.2A CN113170272B (zh) 2018-10-05 2019-10-04 近场音频渲染
PCT/US2019/054893 WO2020073023A1 (en) 2018-10-05 2019-10-04 Near-field audio rendering

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201980080065.2A Division CN113170272B (zh) 2018-10-05 2019-10-04 近场音频渲染

Publications (2)

Publication Number Publication Date
CN116320907A CN116320907A (zh) 2023-06-23
CN116320907B true CN116320907B (zh) 2026-02-06

Family

ID=70051410

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202310249063.XA Active CN116320907B (zh) 2018-10-05 2019-10-04 近场音频渲染
CN201980080065.2A Active CN113170272B (zh) 2018-10-05 2019-10-04 近场音频渲染

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201980080065.2A Active CN113170272B (zh) 2018-10-05 2019-10-04 近场音频渲染

Country Status (5)

Country Link
US (6) US11122383B2 (https=)
EP (2) EP4672786A3 (https=)
JP (4) JP7194271B2 (https=)
CN (2) CN116320907B (https=)
WO (1) WO2020073023A1 (https=)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111713121B (zh) 2018-02-15 2022-04-12 奇跃公司 用于混合现实的双听者位置
CN112119646B (zh) * 2018-05-22 2022-09-06 索尼公司 信息处理装置、信息处理方法以及计算机可读存储介质
US11122383B2 (en) 2018-10-05 2021-09-14 Magic Leap, Inc. Near-field audio rendering
US12185080B2 (en) * 2019-12-19 2024-12-31 Telefonaktiebolaget Lm Ericsson (Publ) Audio rendering of audio sources
CN113035164B (zh) * 2021-02-24 2024-07-12 腾讯音乐娱乐科技（深圳）有限公司 歌声生成方法和装置、电子设备及存储介质
US20240292171A1 (en) * 2021-09-15 2024-08-29 University Of Louisville Research Foundation, Inc. Systems and methods for efficient and accurate virtual accoustic rendering
CN113810817B (zh) * 2021-09-23 2023-11-24 科大讯飞股份有限公司 无线耳机的音量控制方法、装置以及无线耳机
WO2023183053A1 (en) * 2022-03-25 2023-09-28 Magic Leap, Inc. Optimized virtual speaker array
CN117476015A (zh) * 2022-07-22 2024-01-30 北京字跳网络技术有限公司 音频处理方法、装置、设备及存储介质
US12248633B2 (en) 2022-10-17 2025-03-11 Samsung Electronics Co., Ltd. Method for providing vibration and wearable electronic device supporting the same

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9992602B1 (en) * 2017-01-12 2018-06-05 Google Llc Decoupled binaural rendering

Family Cites Families (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
JP3409364B2 (ja) * 1993-05-14 2003-05-26 ヤマハ株式会社 音像定位制御装置
US5596644A (en) * 1994-10-27 1997-01-21 Aureal Semiconductor Inc. Method and apparatus for efficient presentation of high-quality three-dimensional audio
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6546105B1 (en) 1998-10-30 2003-04-08 Matsushita Electric Industrial Co., Ltd. Sound image localization device and sound image localization method
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
JP2001057699A (ja) * 1999-06-11 2001-02-27 Pioneer Electronic Corp オーディオ装置
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
US6819762B2 (en) 2001-03-16 2004-11-16 Aura Communications, Inc. In-the-ear headset
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
JP3823847B2 (ja) * 2002-02-27 2006-09-20 ヤマハ株式会社 音制御装置、音制御方法、プログラムおよび記録媒体
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
MXPA06011168A (es) 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
JP4019095B2 (ja) 2005-12-28 2007-12-05 株式会社コナミデジタルエンタテインメント 音声処理装置、音声処理方法、ならびに、プログラム
CN103716748A (zh) * 2007-03-01 2014-04-09 杰里·马哈布比 音频空间化及环境模拟
JP5114981B2 (ja) * 2007-03-15 2013-01-09 沖電気工業株式会社 音像定位処理装置、方法及びプログラム
US8204240B2 (en) 2007-06-30 2012-06-19 Neunaber Brian C Apparatus and method for artificial reverberation
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US8767968B2 (en) 2010-10-13 2014-07-01 Microsoft Corporation System and method for high-precision 3-dimensional audio for augmented reality
US9122053B2 (en) 2010-10-15 2015-09-01 Microsoft Technology Licensing, Llc Realistic occlusion for a head mounted augmented reality display
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
US9323325B2 (en) 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
US20130077147A1 (en) 2011-09-22 2013-03-28 Los Alamos National Security, Llc Method for producing a partially coherent beam with fast pattern update rates
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US9311883B2 (en) 2011-11-11 2016-04-12 Microsoft Technology Licensing, Llc Recalibration of a flexible mixed reality device
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US8831255B2 (en) 2012-03-08 2014-09-09 Disney Enterprises, Inc. Augmented reality (AR) audio with position and action triggered virtual sound effects
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
CN104903818B (zh) 2012-12-06 2018-12-14 谷歌有限责任公司 眼睛跟踪佩戴式设备和使用方法
JP2014127936A (ja) 2012-12-27 2014-07-07 Denso Corp 音像定位装置、及び、プログラム
CA2896985A1 (en) 2013-01-03 2014-07-10 Meta Company Extramissive spatial imaging digital eye glass for virtual or augmediated vision
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
CN104010265A (zh) * 2013-02-22 2014-08-27 杜比实验室特许公司 音频空间渲染设备及方法
US9443354B2 (en) 2013-04-29 2016-09-13 Microsoft Technology Licensing, Llc Mixed reality interactions
JP2015076797A (ja) 2013-10-10 2015-04-20 富士通株式会社 空間情報提示装置、空間情報提示方法及び空間情報提示用コンピュータプログラム
JP2017016166A (ja) 2013-11-12 2017-01-19 Ｎｅｃソリューションイノベータ株式会社 画像処理装置及び画像処理方法
US9648436B2 (en) 2014-04-08 2017-05-09 Doppler Labs, Inc. Augmented reality sound system
AU2015274283B2 (en) 2014-06-14 2020-09-10 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
WO2016001909A1 (en) 2014-07-03 2016-01-07 Imagine Mobile Augmented Reality Ltd Audiovisual surround augmented reality (asar)
US10451875B2 (en) 2014-07-25 2019-10-22 Microsoft Technology Licensing, Llc Smart transparency for virtual objects
WO2016023581A1 (en) * 2014-08-13 2016-02-18 Huawei Technologies Co.,Ltd An audio signal processing apparatus
US10063989B2 (en) 2014-11-11 2018-08-28 Google Llc Virtual sound systems and methods
WO2016077514A1 (en) * 2014-11-14 2016-05-19 Dolby Laboratories Licensing Corporation Ear centered head related transfer function system and method
US9881422B2 (en) 2014-12-04 2018-01-30 Htc Corporation Virtual reality system and method for controlling operation modes of virtual reality system
US9602947B2 (en) 2015-01-30 2017-03-21 Gaudi Audio Lab, Inc. Apparatus and a method for processing audio signal to perform binaural rendering
GB2536020A (en) 2015-03-04 2016-09-07 Sony Computer Entertainment Europe Ltd System and method of virtual reality feedback
KR102642275B1 (ko) 2016-02-02 2024-02-28 디티에스, 인코포레이티드 증강 현실 헤드폰 환경 렌더링
CN109074681B (zh) 2016-04-18 2023-03-21 索尼公司 信息处理装置、信息处理方法和程序
CN106060758B (zh) * 2016-06-03 2018-03-23 北京时代拓灵科技有限公司 虚拟现实声场元数据的处理方法
JP6374908B2 (ja) 2016-06-17 2018-08-15 株式会社カプコン ゲームプログラムおよびゲームシステム
US10753906B2 (en) 2016-08-15 2020-08-25 Pcms Holdings, Inc. System and method using sound signal for material and texture identification for augmented reality
US10896544B2 (en) 2016-10-07 2021-01-19 Htc Corporation System and method for providing simulated environment
US9980078B2 (en) 2016-10-14 2018-05-22 Nokia Technologies Oy Audio object modification in free-viewpoint rendering
US20180206038A1 (en) * 2017-01-13 2018-07-19 Bose Corporation Real-time processing of audio data captured using a microphone array
CN110476139B (zh) 2017-03-28 2024-01-02 奇跃公司 具有关联到用户操纵的虚拟对象的空间化音频的增强现实系统
US10871934B2 (en) 2017-05-04 2020-12-22 Microsoft Technology Licensing, Llc Virtual content displayed with shared anchor
US20180341455A1 (en) 2017-05-25 2018-11-29 Motorola Mobility Llc Method and Device for Processing Audio in a Captured Scene Including an Image and Spatially Localizable Audio
US9955281B1 (en) * 2017-12-02 2018-04-24 Philip Scott Lyren Headphones with a digital signal processor (DSP) and error correction
CN111713121B (zh) 2018-02-15 2022-04-12 奇跃公司 用于混合现实的双听者位置
US20190313201A1 (en) * 2018-04-04 2019-10-10 Bose Corporation Systems and methods for sound externalization over headphones
US11122383B2 (en) 2018-10-05 2021-09-14 Magic Leap, Inc. Near-field audio rendering

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9992602B1 (en) * 2017-01-12 2018-06-05 Google Llc Decoupled binaural rendering

Also Published As

Publication number Publication date
JP7416901B2 (ja) 2024-01-17
US11778411B2 (en) 2023-10-03
JP2022504283A (ja) 2022-01-13
JP7657349B2 (ja) 2025-04-04
JP2023022312A (ja) 2023-02-14
US20220038840A1 (en) 2022-02-03
JP2024069398A (ja) 2024-05-21
US12342158B2 (en) 2025-06-24
US12063497B2 (en) 2024-08-13
US20230094733A1 (en) 2023-03-30
CN113170272A (zh) 2021-07-23
WO2020073023A1 (en) 2020-04-09
EP3861767A1 (en) 2021-08-11
US11122383B2 (en) 2021-09-14
US20250287173A1 (en) 2025-09-11
EP3861767B1 (en) 2025-11-26
CN116320907A (zh) 2023-06-23
CN113170272B (zh) 2023-04-04
EP4672786A2 (en) 2025-12-31
US20240357311A1 (en) 2024-10-24
EP3861767A4 (en) 2021-12-15
JP2022180616A (ja) 2022-12-06
US11546716B2 (en) 2023-01-03
US20230396947A1 (en) 2023-12-07
JP7194271B2 (ja) 2022-12-21
EP4672786A3 (en) 2026-03-18
JP7455173B2 (ja) 2024-03-25
US20200112815A1 (en) 2020-04-09

Similar Documents

Publication Publication Date Title
CN116320907B (zh) 近场音频渲染
US20250048054A1 (en) Spatial audio for interactive audio environments
CN113170253B (zh) 用于音频空间化的加重
US20250247666A1 (en) Optimized virtual speaker array
WO2022220182A1 (ja) 情報処理方法、プログラム、及び情報処理システム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant