JP7748955B2 - マルチアプリケーションオーディオレンダリング - Google Patents

マルチアプリケーションオーディオレンダリング

Info

Publication number
JP7748955B2
JP7748955B2 JP2022548901A JP2022548901A JP7748955B2 JP 7748955 B2 JP7748955 B2 JP 7748955B2 JP 2022548901 A JP2022548901 A JP 2022548901A JP 2022548901 A JP2022548901 A JP 2022548901A JP 7748955 B2 JP7748955 B2 JP 7748955B2
Authority
JP
Japan
Prior art keywords
audio
model component
model
virtual
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022548901A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023513746A (ja
JP2023513746A5 (enExample
Inventor
レミ サミュエル オードフレイ，
マーク ブランドン ハーテンスタイナー，
サミュエル チャールズ ディッカー，
ブレイン イヴィン ウッド，
マイケル ゼット． ランド，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023513746A publication Critical patent/JP2023513746A/ja
Publication of JP2023513746A5 publication Critical patent/JP2023513746A5/ja
Priority to JP2025081001A priority Critical patent/JP2025113285A/ja
Application granted granted Critical
Publication of JP7748955B2 publication Critical patent/JP7748955B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Stereophonic System (AREA)
  • User Interface Of Digital Computer (AREA)
  • Details Of Audible-Bandwidth Transducers (AREA)
JP2022548901A 2020-02-14 2021-02-11 マルチアプリケーションオーディオレンダリング Active JP7748955B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025081001A JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062976569P 2020-02-14 2020-02-14
US62/976,569 2020-02-14
PCT/US2021/017728 WO2021163382A1 (en) 2020-02-14 2021-02-11 Multi-application audio rendering

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025081001A Division JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Publications (3)

Publication Number Publication Date
JP2023513746A JP2023513746A (ja) 2023-04-03
JP2023513746A5 JP2023513746A5 (enExample) 2024-02-20
JP7748955B2 true JP7748955B2 (ja) 2025-10-03

Family

ID=77273547

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022548901A Active JP7748955B2 (ja) 2020-02-14 2021-02-11 マルチアプリケーションオーディオレンダリング
JP2025081001A Pending JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025081001A Pending JP2025113285A (ja) 2020-02-14 2025-05-14 マルチアプリケーションオーディオレンダリング

Country Status (5)

Country Link
US (2) US11910183B2 (enExample)
EP (1) EP4104456A4 (enExample)
JP (2) JP7748955B2 (enExample)
CN (1) CN115398936A (enExample)
WO (1) WO2021163382A1 (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11451922B1 (en) * 2020-06-15 2022-09-20 Amazon Technologies, Inc. Head-mounted speaker array
US20250205597A1 (en) * 2022-03-25 2025-06-26 Magic Leap, Inc. Optimized mixed reality audio rendering
US12495267B2 (en) * 2022-04-22 2025-12-09 Electronics And Telecommunications Research Institute Method of rendering object-based audio and electronic device for performing the method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012196465A (ja) 2006-11-08 2012-10-18 Dolby Lab Licensing Corp オーディオシーン作成用装置および方法
JP2015166890A (ja) 2014-03-03 2015-09-24 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
US20190289417A1 (en) 2018-03-15 2019-09-19 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation
US20200037091A1 (en) 2017-03-27 2020-01-30 Gaudio Lab, Inc. Audio signal processing method and device

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6647119B1 (en) * 1998-06-29 2003-11-11 Microsoft Corporation Spacialization of audio with visual cues
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
CA2561287C (en) 2004-04-01 2017-07-11 William C. Torch Biosensors, communicators, and controllers monitoring eye movement and methods for using them
US8627213B1 (en) * 2004-08-10 2014-01-07 Hewlett-Packard Development Company, L.P. Chat room system to provide binaural sound at a user location
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
EP2436176A4 (en) * 2009-05-27 2012-11-28 Nokia Corp ARRANGEMENT FOR SPATIAL AUDIO MIXING
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US8767968B2 (en) * 2010-10-13 2014-07-01 Microsoft Corporation System and method for high-precision 3-dimensional audio for augmented reality
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
CN103649706B (zh) * 2011-03-16 2015-11-25 Dts（英属维尔京群岛）有限公司 三维音频音轨的编码及再现
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
EP2929413B1 (en) 2012-12-06 2020-06-03 Google LLC Eye tracking wearable devices and methods for use
KR20150103723A (ko) 2013-01-03 2015-09-11 메타 컴퍼니 가상 또는 증강매개된 비전을 위한 엑스트라미시브 공간 이미징 디지털 아이 글래스
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
EP4421617A3 (en) 2013-10-31 2024-11-06 Dolby Laboratories Licensing Corporation Binaural rendering for headphones using metadata processing
WO2017136573A1 (en) * 2016-02-02 2017-08-10 Dts, Inc. Augmented reality headphone environment rendering
US9906885B2 (en) * 2016-07-15 2018-02-27 Qualcomm Incorporated Methods and systems for inserting virtual sounds into an environment
CN119251375A (zh) * 2016-08-19 2025-01-03 莫维迪厄斯有限公司 矩阵操作的动态剔除
US10555103B2 (en) 2017-03-31 2020-02-04 Lg Electronics Inc. Method for outputting audio signal using scene orientation information in an audio decoder, and apparatus for outputting audio signal using the same
EP3422149B1 (en) * 2017-06-30 2023-03-01 Nokia Technologies Oy Methods, apparatus, systems, computer programs for enabling consumption of virtual content for mediated reality
EP3617871A1 (en) * 2018-08-28 2020-03-04 Koninklijke Philips N.V. Audio apparatus and method of audio processing
US10757240B1 (en) * 2019-07-09 2020-08-25 Cisco Technology, Inc. Headset-enabled ad-hoc communication
US11228857B2 (en) * 2019-09-28 2022-01-18 Facebook Technologies, Llc Dynamic customization of head related transfer functions for presentation of audio content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012196465A (ja) 2006-11-08 2012-10-18 Dolby Lab Licensing Corp オーディオシーン作成用装置および方法
JP2015166890A (ja) 2014-03-03 2015-09-24 ソニー株式会社 情報処理装置、情報処理システム、情報処理方法及びプログラム
US20200037091A1 (en) 2017-03-27 2020-01-30 Gaudio Lab, Inc. Audio signal processing method and device
US20190289417A1 (en) 2018-03-15 2019-09-19 Microsoft Technology Licensing, Llc Synchronized spatial audio presentation

Also Published As

Publication number Publication date
US20240155305A1 (en) 2024-05-09
US20210258715A1 (en) 2021-08-19
JP2023513746A (ja) 2023-04-03
CN115398936A (zh) 2022-11-25
EP4104456A1 (en) 2022-12-21
EP4104456A4 (en) 2023-07-19
JP2025113285A (ja) 2025-08-01
US11910183B2 (en) 2024-02-20
WO2021163382A1 (en) 2021-08-19

Similar Documents

Publication Publication Date Title
JP7642701B2 (ja) 複合現実仮想反響音
JP7629975B2 (ja) 反響フィンガプリント推定
JP7673309B2 (ja) 複合現実のための二重聴取者位置
JP7681609B2 (ja) ３ｄオブジェクト注釈
US20250071502A1 (en) Immersive audio platform
JP2023514572A (ja) セッションマネージャ
JP7656754B2 (ja) 環境音響持続性
US20240155305A1 (en) Multi-application audio rendering
US11477599B2 (en) Delayed audio following
WO2023064870A1 (en) Voice processing for mixed reality
US20240414494A1 (en) Delayed audio following
US20250205597A1 (en) Optimized mixed reality audio rendering
JP7635249B2 (ja) 遅延オーディオ追従

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240209

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240209

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20241212

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250203

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20250502

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250514

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250828

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250922

R150 Certificate of patent or registration of utility model

Ref document number: 7748955

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150