CN115398936A - 多应用音频渲染 - Google Patents

多应用音频渲染 Download PDF

Info

Publication number
CN115398936A
CN115398936A CN202180027939.5A CN202180027939A CN115398936A CN 115398936 A CN115398936 A CN 115398936A CN 202180027939 A CN202180027939 A CN 202180027939A CN 115398936 A CN115398936 A CN 115398936A
Authority
CN
China
Prior art keywords
audio
model
virtual
rendering
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180027939.5A
Other languages
English (en)
Chinese (zh)
Inventor
R·S·奥德弗雷
M·B·赫腾施泰因尔
S·C·迪克尔
B·I·伍德
M·Z·兰德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN115398936A publication Critical patent/CN115398936A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Stereophonic System (AREA)
  • User Interface Of Digital Computer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
CN202180027939.5A 2020-02-14 2021-02-11 多应用音频渲染 Pending CN115398936A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062976569P 2020-02-14 2020-02-14
US62/976,569 2020-02-14
PCT/US2021/017728 WO2021163382A1 (en) 2020-02-14 2021-02-11 Multi-application audio rendering

Publications (1)

Publication Number Publication Date
CN115398936A true CN115398936A (zh) 2022-11-25

Family

ID=77273547

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180027939.5A Pending CN115398936A (zh) 2020-02-14 2021-02-11 多应用音频渲染

Country Status (5)

Country Link
US (2) US11910183B2 (enExample)
EP (1) EP4104456A4 (enExample)
JP (2) JP7748955B2 (enExample)
CN (1) CN115398936A (enExample)
WO (1) WO2021163382A1 (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11451922B1 (en) * 2020-06-15 2022-09-20 Amazon Technologies, Inc. Head-mounted speaker array
US20250205597A1 (en) * 2022-03-25 2025-06-26 Magic Leap, Inc. Optimized mixed reality audio rendering
US12495267B2 (en) * 2022-04-22 2025-12-09 Electronics And Telecommunications Research Institute Method of rendering object-based audio and electronic device for performing the method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019002668A1 (en) * 2017-06-30 2019-01-03 Nokia Technologies Oy METHODS, APPARATUS, SYSTEMS AND COMPUTER PROGRAM PRODUCTS FOR PERMITTING THE USE OF MEDIATED REALITY VIRTUAL CONTENT
US20190180499A1 (en) * 2016-08-19 2019-06-13 Movidius Ltd. Rendering operations using sparse volumetric data

Family Cites Families (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6647119B1 (en) * 1998-06-29 2003-11-11 Microsoft Corporation Spacialization of audio with visual cues
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
CA2561287C (en) 2004-04-01 2017-07-11 William C. Torch Biosensors, communicators, and controllers monitoring eye movement and methods for using them
US8627213B1 (en) * 2004-08-10 2014-01-07 Hewlett-Packard Development Company, L.P. Chat room system to provide binaural sound at a user location
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
WO2008055305A1 (en) 2006-11-08 2008-05-15 Dolby Laboratories Licensing Corporation Apparatuses and methods for use in creating an audio scene
EP2436176A4 (en) * 2009-05-27 2012-11-28 Nokia Corp ARRANGEMENT FOR SPATIAL AUDIO MIXING
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US8767968B2 (en) * 2010-10-13 2014-07-01 Microsoft Corporation System and method for high-precision 3-dimensional audio for augmented reality
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
CN103649706B (zh) * 2011-03-16 2015-11-25 Dts（英属维尔京群岛）有限公司 三维音频音轨的编码及再现
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
EP2929413B1 (en) 2012-12-06 2020-06-03 Google LLC Eye tracking wearable devices and methods for use
KR20150103723A (ko) 2013-01-03 2015-09-11 메타 컴퍼니 가상 또는 증강매개된 비전을 위한 엑스트라미시브 공간 이미징 디지털 아이 글래스
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
EP4421617A3 (en) 2013-10-31 2024-11-06 Dolby Laboratories Licensing Corporation Binaural rendering for headphones using metadata processing
JP2015166890A (ja) 2014-03-03 2015-09-24 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
WO2017136573A1 (en) * 2016-02-02 2017-08-10 Dts, Inc. Augmented reality headphone environment rendering
US9906885B2 (en) * 2016-07-15 2018-02-27 Qualcomm Incorporated Methods and systems for inserting virtual sounds into an environment
KR102502383B1 (ko) 2017-03-27 2023-02-23 가우디오랩 주식회사 오디오 신호 처리 방법 및 장치
US10555103B2 (en) 2017-03-31 2020-02-04 Lg Electronics Inc. Method for outputting audio signal using scene orientation information in an audio decoder, and apparatus for outputting audio signal using the same
US10694311B2 (en) 2018-03-15 2020-06-23 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation
EP3617871A1 (en) * 2018-08-28 2020-03-04 Koninklijke Philips N.V. Audio apparatus and method of audio processing
US10757240B1 (en) * 2019-07-09 2020-08-25 Cisco Technology, Inc. Headset-enabled ad-hoc communication
US11228857B2 (en) * 2019-09-28 2022-01-18 Facebook Technologies, Llc Dynamic customization of head related transfer functions for presentation of audio content

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190180499A1 (en) * 2016-08-19 2019-06-13 Movidius Ltd. Rendering operations using sparse volumetric data
WO2019002668A1 (en) * 2017-06-30 2019-01-03 Nokia Technologies Oy METHODS, APPARATUS, SYSTEMS AND COMPUTER PROGRAM PRODUCTS FOR PERMITTING THE USE OF MEDIATED REALITY VIRTUAL CONTENT

Also Published As

Publication number Publication date
US20240155305A1 (en) 2024-05-09
US20210258715A1 (en) 2021-08-19
JP2023513746A (ja) 2023-04-03
EP4104456A1 (en) 2022-12-21
EP4104456A4 (en) 2023-07-19
JP7748955B2 (ja) 2025-10-03
JP2025113285A (ja) 2025-08-01
US11910183B2 (en) 2024-02-20
WO2021163382A1 (en) 2021-08-19

Similar Documents

Publication Publication Date Title
JP7642701B2 (ja) 複合現実仮想反響音
US11800313B2 (en) Immersive audio platform
CN115398316B (zh) 3d对象注释
JP2023514572A (ja) セッションマネージャ
JP7656754B2 (ja) 環境音響持続性
US20240420718A1 (en) Voice processing for mixed reality
US20240155305A1 (en) Multi-application audio rendering
US20210258713A1 (en) Delayed audio following
US20230020792A1 (en) Delayed audio following
US20250205597A1 (en) Optimized mixed reality audio rendering
CN115398935A (zh) 延迟音频跟随

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination