JP2021528001A - 双方向オーディオ環境のための空間オーディオ - Google Patents

双方向オーディオ環境のための空間オーディオ Download PDF

Info

Publication number
JP2021528001A
JP2021528001A JP2020570498A JP2020570498A JP2021528001A JP 2021528001 A JP2021528001 A JP 2021528001A JP 2020570498 A JP2020570498 A JP 2020570498A JP 2020570498 A JP2020570498 A JP 2020570498A JP 2021528001 A JP2021528001 A JP 2021528001A
Authority
JP
Japan
Prior art keywords
individual
audio signal
bus
virtual environment
intermediate audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2020570498A
Other languages
English (en)
Japanese (ja)
Inventor
レミ サミュエル オードフレイ，
ジャン−マルク ジョット，
サミュエル チャールズ ディッカー，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2021528001A publication Critical patent/JP2021528001A/ja
Priority to JP2023136239A priority Critical patent/JP7700185B2/ja
Priority to JP2025070411A priority patent/JP2025105765A/ja
Priority to JP2025104736A priority patent/JP2025134882A/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/02—Spatial or constructional arrangements of loudspeakers
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00—Acoustics not otherwise provided for
    • G10K15/08—Arrangements for producing a reverberation or echo sound
    • G10K15/10—Arrangements for producing a reverberation or echo sound using time-delay networks comprising electromechanical or electro-acoustic devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/04—Circuits for transducers for correcting frequency response
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/12—Circuits for transducers for distributing signals to two or more loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/11—Application of ambisonics in stereophonic audio systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Health & Medical Sciences (AREA)
  • Stereophonic System (AREA)
  • Stereophonic Arrangements (AREA)
  • Circuit For Audible Band Transducer (AREA)
JP2020570498A 2018-06-18 2019-06-18 双方向オーディオ環境のための空間オーディオ Pending JP2021528001A (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2023136239A JP7700185B2 (ja) 2018-06-18 2023-08-24 双方向オーディオ環境のための空間オーディオ
JP2025070411A JP2025105765A (ja) 2018-06-18 2025-04-22 双方向オーディオ環境のための空間オーディオ
JP2025104736A JP2025134882A (ja) 2018-06-18 2025-06-20 双方向オーディオ環境のための空間オーディオ

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201862686655P 2018-06-18 2018-06-18
US201862686665P 2018-06-18 2018-06-18
US62/686,665 2018-06-18
US62/686,655 2018-06-18
PCT/US2019/037813 WO2019246159A1 (en) 2018-06-18 2019-06-18 Spatial audio for interactive audio environments

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023136239A Division JP7700185B2 (ja) 2018-06-18 2023-08-24 双方向オーディオ環境のための空間オーディオ

Publications (1)

Publication Number Publication Date
JP2021528001A true JP2021528001A (ja) 2021-10-14

Family

ID=68840595

Family Applications (7)

Application Number Title Priority Date Filing Date
JP2020570498A Pending JP2021528001A (ja) 2018-06-18 2019-06-18 双方向オーディオ環境のための空間オーディオ
JP2020570493A Pending JP2021528000A (ja) 2018-06-18 2019-06-18 双方向オーディオ環境のための空間オーディオ
JP2023136239A Active JP7700185B2 (ja) 2018-06-18 2023-08-24 双方向オーディオ環境のための空間オーディオ
JP2023143435A Active JP7715771B2 (ja) 2018-06-18 2023-09-05 双方向オーディオ環境のための空間オーディオ
JP2024209956A Active JP7839859B2 (ja) 2018-06-18 2024-12-03 双方向オーディオ環境のための空間オーディオ
JP2025070411A Pending JP2025105765A (ja) 2018-06-18 2025-04-22 双方向オーディオ環境のための空間オーディオ
JP2025104736A Pending JP2025134882A (ja) 2018-06-18 2025-06-20 双方向オーディオ環境のための空間オーディオ

Family Applications After (6)

Application Number Title Priority Date Filing Date
JP2020570493A Pending JP2021528000A (ja) 2018-06-18 2019-06-18 双方向オーディオ環境のための空間オーディオ
JP2023136239A Active JP7700185B2 (ja) 2018-06-18 2023-08-24 双方向オーディオ環境のための空間オーディオ
JP2023143435A Active JP7715771B2 (ja) 2018-06-18 2023-09-05 双方向オーディオ環境のための空間オーディオ
JP2024209956A Active JP7839859B2 (ja) 2018-06-18 2024-12-03 双方向オーディオ環境のための空間オーディオ
JP2025070411A Pending JP2025105765A (ja) 2018-06-18 2025-04-22 双方向オーディオ環境のための空間オーディオ
JP2025104736A Pending JP2025134882A (ja) 2018-06-18 2025-06-20 双方向オーディオ環境のための空間オーディオ

Country Status (5)

Country Link
US (10) US10863300B2 (https=)
EP (2) EP3808108A4 (https=)
JP (7) JP2021528001A (https=)
CN (4) CN116156411A (https=)
WO (2) WO2019246164A1 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023083250A (ja) * 2021-12-03 2023-06-15 ノキア テクノロジーズ オサケユイチア 音源の指向性に基づく残響器の調整
US20240379089A1 (en) * 2023-05-08 2024-11-14 Nokia Technologies Oy Rendering of Reverberation with Startup Control
WO2025095544A1 (ko) * 2023-11-02 2025-05-08 삼성전자 주식회사 분산 렌더링을 지원하는 무선 통신 시스템에서 몰입형 오디오 미디어의 송수신을 위한 방법 및 장치

Families Citing this family (79)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
DE112014000709B4 (de) 2013-02-07 2021-12-30 Apple Inc. Verfahren und vorrichtung zum betrieb eines sprachtriggers für einen digitalen assistenten
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US12197817B2 (en) 2016-06-11 2025-01-14 Apple Inc. Intelligent device arbitration and control
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770428A1 (en) 2017-05-12 2019-02-18 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK201770411A1 (en) 2017-05-15 2018-12-20 Apple Inc. Multi-modal interfaces
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
KR102785218B1 (ko) 2017-10-17 2025-03-21 매직 립, 인코포레이티드 혼합 현실 공간 오디오
CN116781827A (zh) 2018-02-15 2023-09-19 奇跃公司 混合现实虚拟混响
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. VIRTUAL ASSISTANT OPERATION IN MULTI-DEVICE ENVIRONMENTS
CN119864004A (zh) 2018-06-14 2025-04-22 奇跃公司 混响增益归一化
US10863300B2 (en) 2018-06-18 2020-12-08 Magic Leap, Inc. Spatial audio for interactive audio environments
US11816886B1 (en) * 2018-06-28 2023-11-14 Meta Platforms Technologies, Llc Apparatus, system, and method for machine perception
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11019449B2 (en) * 2018-10-06 2021-05-25 Qualcomm Incorporated Six degrees of freedom and three degrees of freedom backward compatibility
CN109660911A (zh) * 2018-11-27 2019-04-19 Oppo广东移动通信有限公司 录音音效处理方法、装置、移动终端及存储介质
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US10897672B2 (en) * 2019-03-18 2021-01-19 Facebook, Inc. Speaker beam-steering based on microphone array and depth camera assembly input
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11227599B2 (en) 2019-06-01 2022-01-18 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US10721521B1 (en) * 2019-06-24 2020-07-21 Facebook Technologies, Llc Determination of spatialized virtual acoustic scenes from legacy audiovisual media
US10880668B1 (en) * 2019-09-13 2020-12-29 Facebook Technologies, Llc Scaling of virtual audio content using reverberent energy
US11202162B2 (en) 2019-10-18 2021-12-14 Msg Entertainment Group, Llc Synthesizing audio of a venue
US12058510B2 (en) * 2019-10-18 2024-08-06 Sphere Entertainment Group, Llc Mapping audio to visual images on a display device having a curved screen
EP4049466B1 (en) 2019-10-25 2025-04-30 Magic Leap, Inc. Methods and systems for determining and processing audio information in a mixed reality environment
CN111372167B (zh) 2020-02-24 2021-10-26 Oppo广东移动通信有限公司 音效优化方法及装置、电子设备、存储介质
US11290834B2 (en) * 2020-03-04 2022-03-29 Apple Inc. Determining head pose based on room reverberation
GB2593170A (en) * 2020-03-16 2021-09-22 Nokia Technologies Oy Rendering reverberation
US12301635B2 (en) 2020-05-11 2025-05-13 Apple Inc. Digital assistant hardware abstraction
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones
WO2022031418A1 (en) * 2020-07-31 2022-02-10 Sterling Labs Llc. Sound rendering for a shared point of view
US11750745B2 (en) 2020-11-18 2023-09-05 Kelly Properties, Llc Processing and distribution of audio signals in a multi-party conferencing environment
CN116802594A (zh) * 2021-01-29 2023-09-22 索尼集团公司 信息处理装置、信息处理方法和程序
US11470162B2 (en) * 2021-01-30 2022-10-11 Zoom Video Communications, Inc. Intelligent configuration of personal endpoint devices
JP7753649B2 (ja) * 2021-03-19 2025-10-15 ヤマハ株式会社 音信号処理方法および音信号処理装置
US11595775B2 (en) * 2021-04-06 2023-02-28 Meta Platforms Technologies, Llc Discrete binaural spatialization of sound sources on two audio channels
US12283265B1 (en) * 2021-04-09 2025-04-22 Apple Inc. Own voice reverberation reconstruction
JP7032837B1 (ja) * 2021-06-18 2022-03-09 シンメトリー・ディメンションズ・インク 音波伝播シミュレーションシステム
CN117581297B (zh) * 2021-07-02 2025-04-25 北京字跳网络技术有限公司 音频信号的渲染方法、装置和电子设备
JP7637412B2 (ja) * 2021-09-03 2025-02-28 株式会社Gatari 情報処理システム、情報処理方法および情報処理プログラム
US11878246B1 (en) 2021-09-27 2024-01-23 Electronic Arts Inc. Live reverb metrics system
EP4174846A1 (en) * 2021-10-26 2023-05-03 Koninklijke Philips N.V. An audio apparatus and method of operation therefor
CN118511548A (zh) * 2021-11-09 2024-08-16 弗劳恩霍夫应用研究促进协会 使用早期反射模式的用于可听化的概念
CN114307157B (zh) * 2021-11-30 2025-06-13 腾讯科技（深圳）有限公司 虚拟场景中的声音处理方法、装置、设备及存储介质
US20230368812A1 (en) 2022-05-13 2023-11-16 Apple Inc. Determining whether speech input is intended for a digital assistant
CN115118880A (zh) * 2022-06-24 2022-09-27 中广建融合(北京)科技有限公司 一种基于沉浸式视频终端搭建的xr虚拟拍摄系统
CN115334366A (zh) * 2022-08-16 2022-11-11 中国传媒大学 一种交互沉浸式声场漫游的建模方法
CN115440244A (zh) * 2022-08-23 2022-12-06 咪咕文化科技有限公司 音频生成方法、装置、电子设备及计算机可读存储介质
GB202215617D0 (en) * 2022-10-21 2022-12-07 Nokia Technologies Oy Generating parametric spatial audio representations
JP2025541122A (ja) 2022-12-07 2025-12-18 ドルビー ラボラトリーズ ライセンシング コーポレイション バイノーラルレンダリング
CN116132905A (zh) * 2022-12-09 2023-05-16 杭州灵伴科技有限公司 音频播放方法和头戴式显示设备
US12567415B2 (en) 2023-05-09 2026-03-03 Apple Inc. Providing and controlling immersive three-dimensional environments
GB2634268A (en) * 2023-10-04 2025-04-09 Sony Interactive Entertainment Europe Ltd Simulating audio signals
CN119375833B (zh) * 2024-12-30 2025-02-28 北京通用人工智能研究院 一种虚拟环境中的声源定位系统及方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7099482B1 (en) * 2001-03-09 2006-08-29 Creative Technology Ltd Method and apparatus for the simulation of complex audio environments
US20170345216A1 (en) * 2016-05-28 2017-11-30 Acoustic Knowledge, LLC Digital camera with audio, visual and motion analysis
WO2018026828A1 (en) * 2016-08-01 2018-02-08 Magic Leap, Inc. Mixed reality system with spatialized audio
WO2018053047A1 (en) * 2016-09-14 2018-03-22 Magic Leap, Inc. Virtual reality, augmented reality, and mixed reality systems with spatialized audio

Family Cites Families (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
US5436975A (en) * 1994-02-02 1995-07-25 Qsound Ltd. Apparatus for cross fading out of the head sound locations
JP2900985B2 (ja) * 1994-05-31 1999-06-02 日本ビクター株式会社 ヘッドホン再生装置
FR2738099B1 (fr) 1995-08-25 1997-10-24 France Telecom Procede de simulation de la qualite acoustique d'une salle et processeur audio-numerique associe
JPH09160549A (ja) * 1995-12-04 1997-06-20 Hitachi Ltd 三次元音響提示方法および装置
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6188769B1 (en) * 1998-11-13 2001-02-13 Creative Technology Ltd. Environmental reverberation processor
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US8019121B2 (en) * 2002-07-27 2011-09-13 Sony Computer Entertainment Inc. Method and system for processing intensity from input devices for interfacing with a computer program
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
CA2561287C (en) 2004-04-01 2017-07-11 William C. Torch Biosensors, communicators, and controllers monitoring eye movement and methods for using them
US7634092B2 (en) * 2004-10-14 2009-12-15 Dolby Laboratories Licensing Corporation Head related transfer functions for panned stereo audio content
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US20080298610A1 (en) * 2007-05-30 2008-12-04 Nokia Corporation Parameter Space Re-Panning for Spatial Audio
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US8767968B2 (en) * 2010-10-13 2014-07-01 Microsoft Corporation System and method for high-precision 3-dimensional audio for augmented reality
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
WO2012093352A1 (en) * 2011-01-05 2012-07-12 Koninklijke Philips Electronics N.V. An audio system and method of operation therefor
CN103649706B (zh) * 2011-03-16 2015-11-25 Dts（英属维尔京群岛）有限公司 三维音频音轨的编码及再现
US9118991B2 (en) * 2011-06-09 2015-08-25 Sony Corporation Reducing head-related transfer function data volume
US9323325B2 (en) 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
US20130077147A1 (en) 2011-09-22 2013-03-28 Los Alamos National Security, Llc Method for producing a partially coherent beam with fast pattern update rates
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
GB201211512D0 (en) * 2012-06-28 2012-08-08 Provost Fellows Foundation Scholars And The Other Members Of Board Of The Method and apparatus for generating an audio output comprising spartial information
EP2929413B1 (en) 2012-12-06 2020-06-03 Google LLC Eye tracking wearable devices and methods for use
KR20150103723A (ko) 2013-01-03 2015-09-11 메타 컴퍼니 가상 또는 증강매개된 비전을 위한 엑스트라미시브 공간 이미징 디지털 아이 글래스
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
US9478224B2 (en) 2013-04-05 2016-10-25 Dolby International Ab Audio processing system
JP6179194B2 (ja) 2013-05-31 2017-08-16 富士通株式会社 音源管理装置、音源管理方法、および音源管理システム
DE102014210215A1 (de) 2014-05-28 2015-12-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Ermittlung und Nutzung hörraumoptimierter Übertragungsfunktionen
US20170208415A1 (en) * 2014-07-23 2017-07-20 Pcms Holdings, Inc. System and method for determining audio context in augmented-reality applications
EP3018918A1 (en) * 2014-11-07 2016-05-11 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating output signals based on an audio source signal, sound reproduction system and loudspeaker signal
US9787846B2 (en) 2015-01-21 2017-10-10 Microsoft Technology Licensing, Llc Spatial audio signal processing for objects with associated audio content
US9854376B2 (en) 2015-07-06 2017-12-26 Bose Corporation Simulating acoustic output at a location corresponding to source position data
US9749766B2 (en) 2015-12-27 2017-08-29 Philip Scott Lyren Switching binaural sound
WO2017136573A1 (en) * 2016-02-02 2017-08-10 Dts, Inc. Augmented reality headphone environment rendering
US9906885B2 (en) * 2016-07-15 2018-02-27 Qualcomm Incorporated Methods and systems for inserting virtual sounds into an environment
US9998847B2 (en) * 2016-11-17 2018-06-12 Glen A. Norris Localizing binaural sound to objects
US10531220B2 (en) * 2016-12-05 2020-01-07 Magic Leap, Inc. Distributed audio capturing techniques for virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems
US11032662B2 (en) * 2018-05-30 2021-06-08 Qualcomm Incorporated Adjusting audio characteristics for augmented reality
US10863300B2 (en) 2018-06-18 2020-12-08 Magic Leap, Inc. Spatial audio for interactive audio environments

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7099482B1 (en) * 2001-03-09 2006-08-29 Creative Technology Ltd Method and apparatus for the simulation of complex audio environments
US20170345216A1 (en) * 2016-05-28 2017-11-30 Acoustic Knowledge, LLC Digital camera with audio, visual and motion analysis
WO2018026828A1 (en) * 2016-08-01 2018-02-08 Magic Leap, Inc. Mixed reality system with spatialized audio
WO2018053047A1 (en) * 2016-09-14 2018-03-22 Magic Leap, Inc. Virtual reality, augmented reality, and mixed reality systems with spatialized audio

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JOT, JEAN-MARC: "Interactive 3D Audio Rendering in Flexible Playback Configurations", PROCEEDINGS OF THE 2012 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSSOCIATION ANNUAL SUMMIT AN, JPN6023024705, 3 December 2012 (2012-12-03), pages 1 - 9, ISSN: 0005188737 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023083250A (ja) * 2021-12-03 2023-06-15 ノキア テクノロジーズ オサケユイチア 音源の指向性に基づく残響器の調整
JP7708733B2 (ja) 2021-12-03 2025-07-15 ノキア テクノロジーズ オサケユイチア 音源の指向性に基づく残響器の調整
US12407999B2 (en) 2021-12-03 2025-09-02 Nokia Technologies Oy Adjustment of reverberator based on source directivity
US20240379089A1 (en) * 2023-05-08 2024-11-14 Nokia Technologies Oy Rendering of Reverberation with Startup Control
WO2025095544A1 (ko) * 2023-11-02 2025-05-08 삼성전자 주식회사 분산 렌더링을 지원하는 무선 통신 시스템에서 몰입형 오디오 미디어의 송수신을 위한 방법 및 장치

Also Published As

Publication number Publication date
US20230121353A1 (en) 2023-04-20
JP7839859B2 (ja) 2026-04-02
JP7715771B2 (ja) 2025-07-30
US20200322749A1 (en) 2020-10-08
US20190387352A1 (en) 2019-12-19
EP3808107A4 (en) 2022-03-16
CN112567767B (zh) 2023-01-03
CN116156411A (zh) 2023-05-23
US12294852B2 (en) 2025-05-06
US20210243546A1 (en) 2021-08-05
WO2019246159A1 (en) 2019-12-26
US10863300B2 (en) 2020-12-08
US11770671B2 (en) 2023-09-26
JP2025134882A (ja) 2025-09-17
US20190387350A1 (en) 2019-12-19
US20210152970A1 (en) 2021-05-20
US10952010B2 (en) 2021-03-16
US20230413007A1 (en) 2023-12-21
CN112567767A (zh) 2021-03-26
US20250203313A1 (en) 2025-06-19
JP2021528000A (ja) 2021-10-14
JP2025023214A (ja) 2025-02-14
US11792598B2 (en) 2023-10-17
EP3808108A4 (en) 2022-04-13
JP2023158059A (ja) 2023-10-26
CN112567768B (zh) 2022-11-15
JP7700185B2 (ja) 2025-06-30
US11570570B2 (en) 2023-01-31
JP2025105765A (ja) 2025-07-10
CN116156410A (zh) 2023-05-23
EP3808108A1 (en) 2021-04-21
US10735884B2 (en) 2020-08-04
WO2019246164A1 (en) 2019-12-26
US20230388736A1 (en) 2023-11-30
EP3808107A1 (en) 2021-04-21
CN112567768A (zh) 2021-03-26
US12156016B2 (en) 2024-11-26
JP2023153358A (ja) 2023-10-17
US20250048054A1 (en) 2025-02-06

Similar Documents

Publication Publication Date Title
JP7700185B2 (ja) 双方向オーディオ環境のための空間オーディオ
CN112534498B (zh) 混响增益归一化
JP2023168544A (ja) 低周波数チャネル間コヒーレンス制御

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220525

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230615

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230824

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231102

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240123

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20240315