BR112019000398A8 - Realidade virtual, aumentada e mista - Google Patents

Realidade virtual, aumentada e mista

Info

Publication number
BR112019000398A8
BR112019000398A8 BR112019000398A BR112019000398A BR112019000398A8 BR 112019000398 A8 BR112019000398 A8 BR 112019000398A8 BR 112019000398 A BR112019000398 A BR 112019000398A BR 112019000398 A BR112019000398 A BR 112019000398A BR 112019000398 A8 BR112019000398 A8 BR 112019000398A8
Authority
BR
Brazil
Prior art keywords
virtual
augmented
sound
mixed reality
audio signal
Prior art date
Application number
BR112019000398A
Other languages
English (en)
Other versions
BR112019000398A2 (pt
Inventor
Visser Erik
Kim Lae-Hoon
Peri Raghuveer
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of BR112019000398A2 publication Critical patent/BR112019000398A2/pt
Publication of BR112019000398A8 publication Critical patent/BR112019000398A8/pt

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • H04S7/306—For headphones
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)

Abstract

Um método para emitir som virtual inclui detectar um sinal de áudio em um ambiente em um ou mais microfones. O método também inclui determinar, em um processador, uma localização de uma fonte de som do sinal de áudio e estimar uma ou mais características do ambiente com base no sinal de áudio. O método ainda inclui inserir um som virtual no ambiente com base nas uma ou mais características. O som virtual tem uma ou mais propriedades de áudio de um som gerado a partir da localização da fonte de som.
BR112019000398A 2016-07-15 2017-05-25 Realidade virtual, aumentada e mista BR112019000398A8 (pt)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662363104P 2016-07-15 2016-07-15
US15/238,591 US9906885B2 (en) 2016-07-15 2016-08-16 Methods and systems for inserting virtual sounds into an environment
PCT/US2017/034522 WO2018013237A1 (en) 2016-07-15 2017-05-25 Virtual, augmented, and mixed reality

Publications (2)

Publication Number Publication Date
BR112019000398A2 BR112019000398A2 (pt) 2019-04-30
BR112019000398A8 true BR112019000398A8 (pt) 2023-01-31

Family

ID=60940808

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112019000398A BR112019000398A8 (pt) 2016-07-15 2017-05-25 Realidade virtual, aumentada e mista

Country Status (9)

Country Link
US (1) US9906885B2 (pt)
EP (1) EP3485346A1 (pt)
JP (1) JP2019527956A (pt)
KR (1) KR102609668B1 (pt)
CN (1) CN109416585B (pt)
BR (1) BR112019000398A8 (pt)
SG (1) SG11201810874YA (pt)
TW (1) TW201804315A (pt)
WO (1) WO2018013237A1 (pt)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10547947B2 (en) 2016-05-18 2020-01-28 Qualcomm Incorporated Device for generating audio output
US10445936B1 (en) 2016-08-01 2019-10-15 Snap Inc. Audio responsive augmented reality
US10896544B2 (en) * 2016-10-07 2021-01-19 Htc Corporation System and method for providing simulated environment
KR20180090022A (ko) * 2017-02-02 2018-08-10 한국전자통신연구원 다중 전방향 카메라 및 마이크 기반 가상현실 제공 방법 및 가상 현실 제공 방법을 수행하는 음향 신호 처리 장치 및 영상 신호 처리 장치
US11205426B2 (en) * 2017-02-27 2021-12-21 Sony Corporation Information processing device, information processing method, and program
US11361771B2 (en) * 2017-09-22 2022-06-14 Lg Electronics Inc. Method for transmitting/receiving audio data and device therefor
KR102633727B1 (ko) 2017-10-17 2024-02-05 매직 립, 인코포레이티드 혼합 현실 공간 오디오
US10531222B2 (en) * 2017-10-18 2020-01-07 Dolby Laboratories Licensing Corporation Active acoustics control for near- and far-field sounds
US10410432B2 (en) * 2017-10-27 2019-09-10 International Business Machines Corporation Incorporating external sounds in a virtual reality environment
CN109992089A (zh) * 2017-12-29 2019-07-09 索尼公司 电子设备、无线通信系统、方法和计算机可读存储介质
US10500496B2 (en) 2018-01-12 2019-12-10 International Business Machines Corporation Physical obstacle avoidance in a virtual reality environment
US20190221035A1 (en) * 2018-01-12 2019-07-18 International Business Machines Corporation Physical obstacle avoidance in a virtual reality environment
CN111713091A (zh) 2018-02-15 2020-09-25 奇跃公司 混合现实虚拟混响
IL307545A (en) * 2018-02-15 2023-12-01 Magic Leap Inc Dual listening positions for mixed reality
US11617050B2 (en) 2018-04-04 2023-03-28 Bose Corporation Systems and methods for sound source virtualization
US10585641B2 (en) 2018-04-30 2020-03-10 Qualcomm Incorporated Tagging a sound in a virtual environment
WO2019212794A1 (en) 2018-05-03 2019-11-07 Dakiana Research Llc Method and device for sound processing for a synthesized reality setting
CN112205005B (zh) * 2018-05-23 2022-06-24 皇家Kpn公司 使声学渲染适应基于图像的对象
EP3687193B1 (en) * 2018-05-24 2024-03-06 Sony Group Corporation Information processing device and information processing method
US11032664B2 (en) * 2018-05-29 2021-06-08 Staton Techiya, Llc Location based audio signal message processing
US10497161B1 (en) 2018-06-08 2019-12-03 Curious Company, LLC Information display by overlay on an object
WO2019246159A1 (en) * 2018-06-18 2019-12-26 Magic Leap, Inc. Spatial audio for interactive audio environments
EP3584695B1 (en) * 2018-06-20 2022-08-10 Nokia Technologies Oy An apparatus and associated methods for presentation of first and second virtual-or-augmented reality content
EP3595336A1 (en) * 2018-07-09 2020-01-15 Koninklijke Philips N.V. Audio apparatus and method of operation therefor
US10902678B2 (en) 2018-09-06 2021-01-26 Curious Company, LLC Display of hidden information
CN113039815B (zh) * 2018-11-09 2022-11-11 候本株式会社 声音生成方法及执行其的装置
US11055913B2 (en) 2018-12-04 2021-07-06 Curious Company, LLC Directional instructions in an hybrid reality system
US10970935B2 (en) 2018-12-21 2021-04-06 Curious Company, LLC Body pose message system
US10872584B2 (en) 2019-03-14 2020-12-22 Curious Company, LLC Providing positional information using beacon devices
US10674307B1 (en) * 2019-03-27 2020-06-02 Facebook Technologies, Llc Determination of acoustic parameters for a headset using a mapping server
EP3935474A4 (en) 2019-04-05 2022-10-12 Hewlett-Packard Development Company, L.P. MODIFICATION OF AUDIO CONTENT BASED ON PHYSIOLOGICAL OBSERVATIONS
GB2582952B (en) * 2019-04-10 2022-06-15 Sony Interactive Entertainment Inc Audio contribution identification system and method
CN113597777B (zh) * 2019-05-15 2023-07-07 苹果公司 音频处理
US11295754B2 (en) * 2019-07-30 2022-04-05 Apple Inc. Audio bandwidth reduction
CN110716641B (zh) * 2019-08-28 2021-07-23 北京市商汤科技开发有限公司 交互方法、装置、设备以及存储介质
TWI727421B (zh) * 2019-09-16 2021-05-11 藏識科技有限公司 混合實境系統
JP7446420B2 (ja) * 2019-10-25 2024-03-08 マジック リープ， インコーポレイテッド 反響フィンガプリント推定
WO2021086624A1 (en) 2019-10-29 2021-05-06 Qsinx Management Llc Audio encoding with compressed ambience
EP4070284A4 (en) * 2019-12-06 2023-05-24 Magic Leap, Inc. ENVIRONMENTAL ACOUSTIC PERSISTENCE
TWI722738B (zh) * 2019-12-25 2021-03-21 亞達科技股份有限公司 擴增實境裝置與定位方法
EP3859516A1 (en) * 2020-02-03 2021-08-04 Nokia Technologies Oy Virtual scene
WO2021163382A1 (en) * 2020-02-14 2021-08-19 Magic Leap, Inc. Multi-application audio rendering
KR102334091B1 (ko) * 2020-03-20 2021-12-02 주식회사 코클리어닷에이아이 오디오 인식을 수행하는 증강현실 디바이스 및 그의 제어방법
KR20210123198A (ko) 2020-04-02 2021-10-13 주식회사 제이렙 증강 현실 기반의 전기 음향과 건축 음향 통합 시뮬레이션 장치
US20230298357A1 (en) * 2020-05-19 2023-09-21 Sony Group Corporation Information processing device and information processing method
US11246002B1 (en) * 2020-05-22 2022-02-08 Facebook Technologies, Llc Determination of composite acoustic parameter value for presentation of audio content
US11356795B2 (en) 2020-06-17 2022-06-07 Bose Corporation Spatialized audio relative to a peripheral device
US11275629B2 (en) * 2020-06-25 2022-03-15 Microsoft Technology Licensing, Llc Mixed reality complementary systems
CN112071326A (zh) * 2020-09-07 2020-12-11 三星电子（中国）研发中心 音效处理方法和装置
US11615596B2 (en) * 2020-09-24 2023-03-28 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11696084B2 (en) 2020-10-30 2023-07-04 Bose Corporation Systems and methods for providing augmented audio
US11700497B2 (en) 2020-10-30 2023-07-11 Bose Corporation Systems and methods for providing augmented audio
US11856378B2 (en) * 2021-11-26 2023-12-26 Htc Corporation System with sound adjustment capability, method of adjusting sound and non-transitory computer readable storage medium

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI116990B (fi) * 1997-10-20 2006-04-28 Nokia Oyj Menetelmä ja järjestelmä akustisen virtuaaliympäristön käsittelemiseksi
AU2002303082A1 (en) * 2001-01-26 2002-09-12 Zaxel Systems, Inc. Real-time virtual viewpoint in simulated reality environment
JP4708590B2 (ja) 2001-03-13 2011-06-22 キヤノン株式会社 複合現実感システム、ヘッドマウントディスプレイ装置、複合現実感実現方法及びプログラム
JP2003334219A (ja) * 2002-05-21 2003-11-25 Nippon Telegr & Teleph Corp <Ntt> 遠隔地散策装置
JP2005223714A (ja) * 2004-02-06 2005-08-18 Sony Corp 音響収音装置、音響収音方法、記録媒体
WO2005117483A1 (en) * 2004-05-25 2005-12-08 Huonlabs Pty Ltd Audio apparatus and method
KR101431253B1 (ko) * 2007-06-26 2014-08-21 코닌클리케 필립스 엔.브이. 바이노럴 오브젝트―지향 오디오 디코더
US8170222B2 (en) 2008-04-18 2012-05-01 Sony Mobile Communications Ab Augmented reality enhanced audio
US8243970B2 (en) 2008-08-11 2012-08-14 Telefonaktiebolaget L M Ericsson (Publ) Virtual reality sound for advanced multi-media applications
US9037468B2 (en) * 2008-10-27 2015-05-19 Sony Computer Entertainment Inc. Sound localization for user in motion
KR101285391B1 (ko) * 2010-07-28 2013-07-10 주식회사 팬택 음향 객체 정보 융합 장치 및 방법
US20120207308A1 (en) 2011-02-15 2012-08-16 Po-Hsun Sung Interactive sound playback device
US20120239690A1 (en) * 2011-03-16 2012-09-20 Rovi Technologies Corporation Utilizing time-localized metadata
US9131305B2 (en) * 2012-01-17 2015-09-08 LI Creative Technologies, Inc. Configurable three-dimensional sound system
US8831255B2 (en) 2012-03-08 2014-09-09 Disney Enterprises, Inc. Augmented reality (AR) audio with position and action triggered virtual sound effects
US20160088417A1 (en) * 2013-04-30 2016-03-24 Intellectual Discovery Co., Ltd. Head mounted display and method for providing audio content by using same
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
JP6227295B2 (ja) * 2013-06-25 2017-11-08 日本放送協会 空間音響生成装置およびそのプログラム
US9942685B2 (en) 2013-06-28 2018-04-10 Microsoft Technology Licensing, Llc Navigation with three dimensional audio effects
WO2015048551A2 (en) 2013-09-27 2015-04-02 Sony Computer Entertainment Inc. Method of improving externalization of virtual surround sound
EP2863654B1 (en) * 2013-10-17 2018-08-01 Oticon A/s A method for reproducing an acoustical sound field
EP2866217A1 (en) 2013-10-25 2015-04-29 GN Store Nord A/S An audio information system based on zones and contexts
CN104615243A (zh) * 2015-01-15 2015-05-13 深圳市掌网立体时代视讯技术有限公司 一种头戴式多通道交互系统及多通道交互方法
CN105353868B (zh) * 2015-09-24 2019-05-31 联想(北京)有限公司 一种信息处理方法及电子设备
CN105466413A (zh) * 2015-11-10 2016-04-06 上海格虏博运动科技有限公司 一种基于智能移动平台并结合gps的增强现实实景导航技术
CN105657535B (zh) * 2015-12-29 2018-10-30 北京搜狗科技发展有限公司 一种音频识别方法和装置
CN105611481B (zh) * 2015-12-30 2018-04-17 北京时代拓灵科技有限公司 一种基于空间声的人机交互方法和系统
US9881619B2 (en) 2016-03-25 2018-01-30 Qualcomm Incorporated Audio processing for an acoustical environment
US10547947B2 (en) 2016-05-18 2020-01-28 Qualcomm Incorporated Device for generating audio output

Also Published As

Publication number Publication date
CN109416585A (zh) 2019-03-01
CN109416585B (zh) 2022-06-21
KR20190028697A (ko) 2019-03-19
WO2018013237A1 (en) 2018-01-18
US20180020312A1 (en) 2018-01-18
US9906885B2 (en) 2018-02-27
JP2019527956A (ja) 2019-10-03
SG11201810874YA (en) 2019-01-30
TW201804315A (zh) 2018-02-01
KR102609668B1 (ko) 2023-12-04
EP3485346A1 (en) 2019-05-22
BR112019000398A2 (pt) 2019-04-30

Similar Documents

Publication Publication Date Title
BR112019000398A8 (pt) Realidade virtual, aumentada e mista
EP4235391A3 (en) Virtual, augmented, and mixed reality systems and methods
GB2561501A (en) Dynamically updating captcha challenges
BR112018002040A2 (pt) controle de uma nuvem de dispositivo
BR112017018382A2 (pt) distribuição e utilização de informações de antena para operações de determinação de localização
BR112018001496A2 (pt) fornecimento de serviço de assistente pessoal por meio de mensagens
BR112019004408A8 (pt) Sistema e método de interface de dispositivo definido por software
BR112015020950A2 (pt) compartilhamento rápido de fotos
BR112017018347A2 (pt) distribuição e utilização de informações de antena para operações de determinação de localização
BR112014030215A2 (pt) métodos e aparelhos para determinar informação de notações para apresentações de mídia online
BR112015025878A2 (pt) método, cliente, servidor e sistema para interação de áudio e video de múltiplas pessoas
MX2009004903A (es) Analisis y manejo de sistema.
BR112017020517A2 (pt) técnicas para recomendação de produtos, serviços e negócios
MY188092A (en) Method and apparatus for simulating sound in virtual scenario, and terminal
EP3088993A3 (en) Automatic fitting of haptic effects
BR112017022775A2 (pt) dispositivo de controle de oclusão
BR112015021705A2 (pt) sistemas e métodos para descobrir dispositivos em uma rede ciente de vizinhança
SG10201907254XA (en) Text address processing method and apparatus
GB2526495A (en) Systems and methods for identifying and separately presenting different portions of multimedia content
BR112015020150A2 (pt) aparelho para gerar um sinal de fala, e, método para gerar um sinal de fala
BR112015017883A2 (pt) sistema e método para monitoramento de usuário e determinação de intenção
BR112016004509A2 (pt) reatribuição de tarefas a balões em uma rede de balão com base em modos de falha esperados de balões
BR112012017551A2 (pt) Aparelho e método para extrair um sinal direto/ambiente de um sinal downmix e informações paramétricas espaciais
BR112015000104A2 (pt) sistemas e métodos para autenticação de identidade utilizando uma rede social
WO2016109682A3 (en) Broadcast profiling system

Legal Events

Date Code Title Description
B06W Patent application suspended after preliminary examination (for patents with searches from other patent authorities) chapter 6.23 patent gazette]
B15K Others concerning applications: alteration of classification

Free format text: AS CLASSIFICACOES ANTERIORES ERAM: G06F 3/01 , H04S 7/00 , G06F 3/16

Ipc: G06F 3/01 (2006.01), G06F 3/16 (2006.01), H04S 7/0

B08F Application dismissed because of non-payment of annual fees [chapter 8.6 patent gazette]

Free format text: REFERENTE A 6A ANUIDADE.

B08K Patent lapsed as no evidence of payment of the annual fee has been furnished to inpi [chapter 8.11 patent gazette]

Free format text: REFERENTE AO DESPACHO 8.6 PUBLICADO NA RPI 2724 DE 21/03/2023.