CN115398936A - 多应用音频渲染 - Google Patents

多应用音频渲染 Download PDF

Info

Publication number
CN115398936A
CN115398936A CN202180027939.5A CN202180027939A CN115398936A CN 115398936 A CN115398936 A CN 115398936A CN 202180027939 A CN202180027939 A CN 202180027939A CN 115398936 A CN115398936 A CN 115398936A
Authority
CN
China
Prior art keywords
audio
model
virtual
rendering
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180027939.5A
Other languages
English (en)
Chinese (zh)
Inventor
R·S·奥德弗雷
M·B·赫腾施泰因尔
S·C·迪克尔
B·I·伍德
M·Z·兰德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN115398936A publication Critical patent/CN115398936A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Stereophonic System (AREA)
  • User Interface Of Digital Computer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
CN202180027939.5A 2020-02-14 2021-02-11 多应用音频渲染 Pending CN115398936A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062976569P 2020-02-14 2020-02-14
US62/976,569 2020-02-14
PCT/US2021/017728 WO2021163382A1 (en) 2020-02-14 2021-02-11 Multi-application audio rendering

Publications (1)

Publication Number Publication Date
CN115398936A true CN115398936A (zh) 2022-11-25

Family

ID=77273547

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180027939.5A Pending CN115398936A (zh) 2020-02-14 2021-02-11 多应用音频渲染

Country Status (5)

Country Link
US (2) US11910183B2 (cg-RX-API-DMAC7.html)
EP (1) EP4104456A4 (cg-RX-API-DMAC7.html)
JP (2) JP7748955B2 (cg-RX-API-DMAC7.html)
CN (1) CN115398936A (cg-RX-API-DMAC7.html)
WO (1) WO2021163382A1 (cg-RX-API-DMAC7.html)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11451922B1 (en) * 2020-06-15 2022-09-20 Amazon Technologies, Inc. Head-mounted speaker array
WO2023183054A1 (en) * 2022-03-25 2023-09-28 Magic Leap, Inc. Optimized mixed reality audio rendering
US12495267B2 (en) * 2022-04-22 2025-12-09 Electronics And Telecommunications Research Institute Method of rendering object-based audio and electronic device for performing the method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019002668A1 (en) * 2017-06-30 2019-01-03 Nokia Technologies Oy METHODS, APPARATUS, SYSTEMS AND COMPUTER PROGRAM PRODUCTS FOR PERMITTING THE USE OF MEDIATED REALITY VIRTUAL CONTENT
US20190180499A1 (en) * 2016-08-19 2019-06-13 Movidius Ltd. Rendering operations using sparse volumetric data

Family Cites Families (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6647119B1 (en) * 1998-06-29 2003-11-11 Microsoft Corporation Spacialization of audio with visual cues
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
MXPA06011168A (es) 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
US8627213B1 (en) * 2004-08-10 2014-01-07 Hewlett-Packard Development Company, L.P. Chat room system to provide binaural sound at a user location
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
CN101573991B (zh) * 2006-11-08 2011-08-03 杜比实验室特许公司 用于创建音频场景的设备和方法
WO2010136634A1 (en) * 2009-05-27 2010-12-02 Nokia Corporation Spatial audio mixing arrangement
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US8767968B2 (en) * 2010-10-13 2014-07-01 Microsoft Corporation System and method for high-precision 3-dimensional audio for augmented reality
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
CN103649706B (zh) 2011-03-16 2015-11-25 Dts(英属维尔京群岛)有限公司 三维音频音轨的编码及再现
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
WO2014089542A1 (en) 2012-12-06 2014-06-12 Eyefluence, Inc. Eye tracking wearable devices and methods for use
JP2016509292A (ja) 2013-01-03 2016-03-24 メタ カンパニー エクストラミッシブ空間撮像デジタル眼鏡装置または拡張介在ビジョン
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
CN109068263B (zh) * 2013-10-31 2021-08-24 杜比实验室特许公司 使用元数据处理的耳机的双耳呈现
JP2015166890A (ja) * 2014-03-03 2015-09-24 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
KR102642275B1 (ko) * 2016-02-02 2024-02-28 디티에스, 인코포레이티드 증강 현실 헤드폰 환경 렌더링
US9906885B2 (en) * 2016-07-15 2018-02-27 Qualcomm Incorporated Methods and systems for inserting virtual sounds into an environment
WO2018182274A1 (ko) * 2017-03-27 2018-10-04 가우디오디오랩 주식회사 오디오 신호 처리 방법 및 장치
US10555103B2 (en) 2017-03-31 2020-02-04 Lg Electronics Inc. Method for outputting audio signal using scene orientation information in an audio decoder, and apparatus for outputting audio signal using the same
US10694311B2 (en) * 2018-03-15 2020-06-23 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation
EP3617871A1 (en) * 2018-08-28 2020-03-04 Koninklijke Philips N.V. Audio apparatus and method of audio processing
US10757240B1 (en) * 2019-07-09 2020-08-25 Cisco Technology, Inc. Headset-enabled ad-hoc communication
US11228857B2 (en) * 2019-09-28 2022-01-18 Facebook Technologies, Llc Dynamic customization of head related transfer functions for presentation of audio content

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190180499A1 (en) * 2016-08-19 2019-06-13 Movidius Ltd. Rendering operations using sparse volumetric data
WO2019002668A1 (en) * 2017-06-30 2019-01-03 Nokia Technologies Oy METHODS, APPARATUS, SYSTEMS AND COMPUTER PROGRAM PRODUCTS FOR PERMITTING THE USE OF MEDIATED REALITY VIRTUAL CONTENT

Also Published As

Publication number Publication date
JP2025113285A (ja) 2025-08-01
US20210258715A1 (en) 2021-08-19
US11910183B2 (en) 2024-02-20
US20240155305A1 (en) 2024-05-09
EP4104456A1 (en) 2022-12-21
WO2021163382A1 (en) 2021-08-19
EP4104456A4 (en) 2023-07-19
JP7748955B2 (ja) 2025-10-03
JP2023513746A (ja) 2023-04-03

Similar Documents

Publication Publication Date Title
JP7642701B2 (ja) 複合現実仮想反響音
US11800313B2 (en) Immersive audio platform
CN115398316B (zh) 3d对象注释
US20240087261A1 (en) Session manager
JP7656754B2 (ja) 環境音響持続性
US20240420718A1 (en) Voice processing for mixed reality
US20240155305A1 (en) Multi-application audio rendering
US20210258713A1 (en) Delayed audio following
US20230020792A1 (en) Delayed audio following
US20250205597A1 (en) Optimized mixed reality audio rendering
CN115398935A (zh) 延迟音频跟随

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination