JP7748955B2 - マルチアプリケーションオーディオレンダリング - Google Patents

マルチアプリケーションオーディオレンダリング

Info

Publication number
JP7748955B2
JP7748955B2 JP2022548901A JP2022548901A JP7748955B2 JP 7748955 B2 JP7748955 B2 JP 7748955B2 JP 2022548901 A JP2022548901 A JP 2022548901A JP 2022548901 A JP2022548901 A JP 2022548901A JP 7748955 B2 JP7748955 B2 JP 7748955B2
Authority
JP
Japan
Prior art keywords
audio
model component
model
virtual
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022548901A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023513746A5 (cg-RX-API-DMAC7.html
JP2023513746A (ja
Inventor
レミ サミュエル オードフレイ,
マーク ブランドン ハーテンスタイナー,
サミュエル チャールズ ディッカー,
ブレイン イヴィン ウッド,
マイケル ゼット. ランド,
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023513746A publication Critical patent/JP2023513746A/ja
Publication of JP2023513746A5 publication Critical patent/JP2023513746A5/ja
Priority to JP2025081001A priority Critical patent/JP2025113285A/ja
Application granted granted Critical
Publication of JP7748955B2 publication Critical patent/JP7748955B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Stereophonic System (AREA)
  • User Interface Of Digital Computer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
JP2022548901A 2020-02-14 2021-02-11 マルチアプリケーションオーディオレンダリング Active JP7748955B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025081001A JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062976569P 2020-02-14 2020-02-14
US62/976,569 2020-02-14
PCT/US2021/017728 WO2021163382A1 (en) 2020-02-14 2021-02-11 Multi-application audio rendering

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025081001A Division JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Publications (3)

Publication Number Publication Date
JP2023513746A JP2023513746A (ja) 2023-04-03
JP2023513746A5 JP2023513746A5 (cg-RX-API-DMAC7.html) 2024-02-20
JP7748955B2 true JP7748955B2 (ja) 2025-10-03

Family

ID=77273547

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022548901A Active JP7748955B2 (ja) 2020-02-14 2021-02-11 マルチアプリケーションオーディオレンダリング
JP2025081001A Pending JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025081001A Pending JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Country Status (5)

Country Link
US (2) US11910183B2 (cg-RX-API-DMAC7.html)
EP (1) EP4104456A4 (cg-RX-API-DMAC7.html)
JP (2) JP7748955B2 (cg-RX-API-DMAC7.html)
CN (1) CN115398936A (cg-RX-API-DMAC7.html)
WO (1) WO2021163382A1 (cg-RX-API-DMAC7.html)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11451922B1 (en) * 2020-06-15 2022-09-20 Amazon Technologies, Inc. Head-mounted speaker array
WO2023183054A1 (en) * 2022-03-25 2023-09-28 Magic Leap, Inc. Optimized mixed reality audio rendering
US12495267B2 (en) * 2022-04-22 2025-12-09 Electronics And Telecommunications Research Institute Method of rendering object-based audio and electronic device for performing the method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012196465A (ja) 2006-11-08 2012-10-18 Dolby Lab Licensing Corp オーディオシーン作成用装置および方法
JP2015166890A (ja) 2014-03-03 2015-09-24 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
US20190289417A1 (en) 2018-03-15 2019-09-19 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation
US20200037091A1 (en) 2017-03-27 2020-01-30 Gaudio Lab, Inc. Audio signal processing method and device

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6647119B1 (en) * 1998-06-29 2003-11-11 Microsoft Corporation Spacialization of audio with visual cues
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
MXPA06011168A (es) 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
US8627213B1 (en) * 2004-08-10 2014-01-07 Hewlett-Packard Development Company, L.P. Chat room system to provide binaural sound at a user location
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
WO2010136634A1 (en) * 2009-05-27 2010-12-02 Nokia Corporation Spatial audio mixing arrangement
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US8767968B2 (en) * 2010-10-13 2014-07-01 Microsoft Corporation System and method for high-precision 3-dimensional audio for augmented reality
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
CN103649706B (zh) 2011-03-16 2015-11-25 Dts(英属维尔京群岛)有限公司 三维音频音轨的编码及再现
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
WO2014089542A1 (en) 2012-12-06 2014-06-12 Eyefluence, Inc. Eye tracking wearable devices and methods for use
JP2016509292A (ja) 2013-01-03 2016-03-24 メタ カンパニー エクストラミッシブ空間撮像デジタル眼鏡装置または拡張介在ビジョン
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
CN109068263B (zh) * 2013-10-31 2021-08-24 杜比实验室特许公司 使用元数据处理的耳机的双耳呈现
KR102642275B1 (ko) * 2016-02-02 2024-02-28 디티에스, 인코포레이티드 증강 현실 헤드폰 환경 렌더링
US9906885B2 (en) * 2016-07-15 2018-02-27 Qualcomm Incorporated Methods and systems for inserting virtual sounds into an environment
CN110494895B (zh) * 2016-08-19 2023-09-19 莫维迪厄斯有限公司 使用稀疏体积数据的渲染操作
US10555103B2 (en) 2017-03-31 2020-02-04 Lg Electronics Inc. Method for outputting audio signal using scene orientation information in an audio decoder, and apparatus for outputting audio signal using the same
EP3422149B1 (en) * 2017-06-30 2023-03-01 Nokia Technologies Oy Methods, apparatus, systems, computer programs for enabling consumption of virtual content for mediated reality
EP3617871A1 (en) * 2018-08-28 2020-03-04 Koninklijke Philips N.V. Audio apparatus and method of audio processing
US10757240B1 (en) * 2019-07-09 2020-08-25 Cisco Technology, Inc. Headset-enabled ad-hoc communication
US11228857B2 (en) * 2019-09-28 2022-01-18 Facebook Technologies, Llc Dynamic customization of head related transfer functions for presentation of audio content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012196465A (ja) 2006-11-08 2012-10-18 Dolby Lab Licensing Corp オーディオシーン作成用装置および方法
JP2015166890A (ja) 2014-03-03 2015-09-24 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
US20200037091A1 (en) 2017-03-27 2020-01-30 Gaudio Lab, Inc. Audio signal processing method and device
US20190289417A1 (en) 2018-03-15 2019-09-19 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation

Also Published As

Publication number Publication date
JP2025113285A (ja) 2025-08-01
US20210258715A1 (en) 2021-08-19
US11910183B2 (en) 2024-02-20
US20240155305A1 (en) 2024-05-09
CN115398936A (zh) 2022-11-25
EP4104456A1 (en) 2022-12-21
WO2021163382A1 (en) 2021-08-19
EP4104456A4 (en) 2023-07-19
JP2023513746A (ja) 2023-04-03

Similar Documents

Publication Publication Date Title
JP7642701B2 (ja) 複合現実仮想反響音
JP7629975B2 (ja) 反響フィンガプリント推定
JP7673309B2 (ja) 複合現実のための二重聴取者位置
US20250071502A1 (en) Immersive audio platform
JP7656754B2 (ja) 環境音響持続性
JP2023513747A (ja) 3dオブジェクト注釈
JP2023514572A (ja) セッションマネージャ
US20240155305A1 (en) Multi-application audio rendering
US20240420718A1 (en) Voice processing for mixed reality
US11477599B2 (en) Delayed audio following
US20240414494A1 (en) Delayed audio following
US20250205597A1 (en) Optimized mixed reality audio rendering
JP7635249B2 (ja) 遅延オーディオ追従
JP7812195B2 (ja) フィルタパラメータに関するインデックススキーミング

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240209

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240209

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20241212

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250203

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20250502

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250514

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250828

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250922

R150 Certificate of patent or registration of utility model

Ref document number: 7748955

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150