IN2014CN04458A - - Google Patents

Download PDF

Info

Publication number
IN2014CN04458A
IN2014CN04458A IN4458CHN2014A IN2014CN04458A IN 2014CN04458 A IN2014CN04458 A IN 2014CN04458A IN 4458CHN2014 A IN4458CHN2014 A IN 4458CHN2014A IN 2014CN04458 A IN2014CN04458 A IN 2014CN04458A
Authority
IN
India
Prior art keywords
mobile device
application
sound
target
virtual object
Prior art date
Application number
Inventor
Kisun You
Taesu Kim
Kyuwoong Hwang
Minho Jin
Hyun Mook Cho
Te Won Lee
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of IN2014CN04458A publication Critical patent/IN2014CN04458A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Stereophonic System (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

A method for responding in an augmented reality (AR) application of a mobile device to an external sound is disclosed. The mobile device detects a target. A virtual object is initiated in the AR application. Further the external sound is received by at least one sound sensor of the mobile device from a sound source. Geometric information between the sound source and the target is determined and at least one response for the virtual object to perform in the AR application is generated based on the geometric information.
IN4458CHN2014 2012-01-12 2012-11-21 IN2014CN04458A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201261585945P 2012-01-12 2012-01-12
US13/585,927 US9563265B2 (en) 2012-01-12 2012-08-15 Augmented reality with sound and geometric analysis
PCT/US2012/066194 WO2013106133A1 (en) 2012-01-12 2012-11-21 Augmented reality with sound and geometric analysis

Publications (1)

Publication Number Publication Date
IN2014CN04458A true IN2014CN04458A (en) 2015-09-04

Family

ID=48779976

Family Applications (1)

Application Number Title Priority Date Filing Date
IN4458CHN2014 IN2014CN04458A (en) 2012-01-12 2012-11-21

Country Status (7)

Country Link
US (1) US9563265B2 (en)
EP (1) EP2802962A1 (en)
JP (1) JP5996669B2 (en)
KR (1) KR102078427B1 (en)
CN (1) CN104054039B (en)
IN (1) IN2014CN04458A (en)
WO (1) WO2013106133A1 (en)

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9206446B2 (en) 2006-05-01 2015-12-08 Board Of Trustees Of Michigan State University Extraction of solubles from plant biomass for use as microbial growth stimulant and methods related thereto
US20130249811A1 (en) * 2012-03-23 2013-09-26 Microsoft Corporation Controlling a device with visible light
US9367870B2 (en) * 2012-10-05 2016-06-14 Sap Se Determining networked mobile device position and orientation for augmented-reality window shopping
EP2908919A1 (en) * 2012-10-22 2015-08-26 Longsand Limited Collaborative augmented reality
ES2893410T3 (en) * 2012-11-29 2022-02-09 Imran Haddish Virtual and augmented reality instruction system
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
JP5884811B2 (en) * 2013-11-18 2016-03-15 コニカミノルタ株式会社 AR display device, AR display control device, printing condition setting system, printing system, printing setting display method and program
US20150187143A1 (en) * 2013-12-26 2015-07-02 Shadi Mere Rendering a virtual representation of a hand
JP2015166890A (en) 2014-03-03 2015-09-24 ソニー株式会社 Information processing apparatus, information processing system, information processing method, and program
US12008697B2 (en) 2014-06-10 2024-06-11 Ripple, Inc. Of Delaware Dynamic location based digital element
US10930038B2 (en) 2014-06-10 2021-02-23 Lab Of Misfits Ar, Inc. Dynamic location based digital element
US10026226B1 (en) * 2014-06-10 2018-07-17 Ripple Inc Rendering an augmented reality object
US9875080B2 (en) 2014-07-17 2018-01-23 Nokia Technologies Oy Method and apparatus for an interactive user interface
JP6344125B2 (en) * 2014-07-31 2018-06-20 セイコーエプソン株式会社 Display device, display device control method, and program
KR102226820B1 (en) * 2014-08-20 2021-03-11 삼성전자주식회사 Method for sharing data and electronic device thereof
CN107148614B (en) * 2014-12-02 2020-09-08 索尼公司 Information processing apparatus, information processing method, and program
US10915161B2 (en) * 2014-12-11 2021-02-09 Intel Corporation Facilitating dynamic non-visual markers for augmented reality on computing devices
US20170367390A1 (en) * 2014-12-19 2017-12-28 Halo Life Science, Llc Use of ellagic acid dihydrate in food products and nutraceuticals
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
US10628114B2 (en) * 2015-09-30 2020-04-21 Sony Corporation Displaying images with integrated information
KR102036545B1 (en) 2016-05-28 2019-10-25 어쿠스틱 날리지, 엘엘씨 Digital camera with audio, visual and motion analysis
RU167769U1 (en) * 2016-06-17 2017-01-10 Виталий Витальевич Аверьянов DEVICE FORMING VIRTUAL ARRIVAL OBJECTS
WO2017217894A1 (en) * 2016-06-17 2017-12-21 Виталий Витальевич АВЕРЬЯНОВ Device for generating virtual augmented-reality objects
WO2017221492A1 (en) * 2016-06-20 2017-12-28 ソニー株式会社 Information processing device, information processing method, and program
US10753906B2 (en) 2016-08-15 2020-08-25 Pcms Holdings, Inc. System and method using sound signal for material and texture identification for augmented reality
US10074205B2 (en) 2016-08-30 2018-09-11 Intel Corporation Machine creation of program with frame analysis method and apparatus
US10359858B2 (en) * 2016-09-07 2019-07-23 Disney Enterprises, Inc. Systems and methods for simulating sounds of a virtual object using procedural audio
DE102016121281A1 (en) * 2016-11-08 2018-05-09 3Dqr Gmbh Method and device for superimposing an image of a real scene with virtual image and audio data and a mobile device
US20180158243A1 (en) * 2016-12-02 2018-06-07 Google Inc. Collaborative manipulation of objects in virtual reality
US10304239B2 (en) 2017-07-20 2019-05-28 Qualcomm Incorporated Extended reality virtual assistant
CN107608519A (en) * 2017-09-26 2018-01-19 深圳传音通讯有限公司 A kind of sound method of adjustment and virtual reality device
CN107678828A (en) * 2017-10-26 2018-02-09 北京易讯理想科技有限公司 A kind of wave volume control method realized based on picture charge pattern technology
CN107885331A (en) * 2017-11-09 2018-04-06 北京易讯理想科技有限公司 A kind of exchange method that Audio conversion is realized based on augmented reality
US20190200154A1 (en) * 2017-12-21 2019-06-27 Facebook, Inc. Systems and methods for audio-based augmented reality
CN108415570B (en) * 2018-03-07 2021-08-24 网易（杭州）网络有限公司 Control selection method and device based on augmented reality
TWI656362B (en) * 2018-03-26 2019-04-11 仁寶電腦工業股份有限公司 Electronic device and object rework method thereof
JP6773074B2 (en) * 2018-05-01 2020-10-21 トヨタ自動車株式会社 Response generation method, response generator and response generation program
CN108769535B (en) * 2018-07-04 2021-08-10 腾讯科技（深圳）有限公司 Image processing method, image processing device, storage medium and computer equipment
CN109065055B (en) * 2018-09-13 2020-12-11 三星电子（中国）研发中心 Method, storage medium, and apparatus for generating AR content based on sound
CN109308179A (en) 2018-09-25 2019-02-05 Oppo广东移动通信有限公司 3D sound effect treatment method and Related product
CN109597481B (en) * 2018-11-16 2021-05-04 Oppo广东移动通信有限公司 AR virtual character drawing method and device, mobile terminal and storage medium
KR102600989B1 (en) * 2019-01-29 2023-11-13 삼성전자주식회사 Display panel and display apparatus having the same
US11071912B2 (en) * 2019-03-11 2021-07-27 International Business Machines Corporation Virtual reality immersion
CN112449210A (en) * 2019-08-28 2021-03-05 北京字节跳动网络技术有限公司 Sound processing method, sound processing device, electronic equipment and computer readable storage medium
WO2021044745A1 (en) * 2019-09-03 2021-03-11 ソニー株式会社 Display processing device, display processing method, and recording medium
US11159766B2 (en) 2019-09-16 2021-10-26 Qualcomm Incorporated Placement of virtual content in environments with a plurality of physical participants
US20220414960A1 (en) * 2019-11-12 2022-12-29 Sony Group Corporation Information processing device, information processing method, and program
WO2022211357A1 (en) 2021-03-30 2022-10-06 Samsung Electronics Co., Ltd. Method and electronic device for automatically animating graphical object
US12020382B2 (en) 2022-03-24 2024-06-25 Kyndryl, Inc. Physical and virtual environment synchronization
US20240094861A1 (en) * 2022-09-20 2024-03-21 Snap Inc. Configuring a 3d model within a virtual conferencing system

Family Cites Families (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030018771A1 (en) * 1997-07-15 2003-01-23 Computer Associates Think, Inc. Method and apparatus for generating and recognizing speech as a user interface element in systems and network management
US6330486B1 (en) 1997-07-16 2001-12-11 Silicon Graphics, Inc. Acoustic perspective in a virtual three-dimensional environment
JPH1165814A (en) 1997-08-26 1999-03-09 Fujitsu Ltd Interactive system and image display method
US6816437B1 (en) 2002-06-03 2004-11-09 Massachusetts Institute Of Technology Method and apparatus for determining orientation
US8947347B2 (en) 2003-08-27 2015-02-03 Sony Computer Entertainment Inc. Controlling actions in a video game unit
US7760248B2 (en) 2002-07-27 2010-07-20 Sony Computer Entertainment Inc. Selective sound source listening in conjunction with computer interactive processing
JP4837917B2 (en) 2002-10-23 2011-12-14 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Device control based on voice
JP5339900B2 (en) 2005-05-05 2013-11-13 株式会社ソニー・コンピュータエンタテインメント Selective sound source listening by computer interactive processing
EP1878013B1 (en) 2005-05-05 2010-12-15 Sony Computer Entertainment Inc. Video game control with joystick
JP4019095B2 (en) * 2005-12-28 2007-12-05 株式会社コナミデジタルエンタテインメント Audio processing apparatus, audio processing method, and program
US20090237492A1 (en) * 2008-03-18 2009-09-24 Invism, Inc. Enhanced stereoscopic immersive video recording and viewing
US8170222B2 (en) * 2008-04-18 2012-05-01 Sony Mobile Communications Ab Augmented reality enhanced audio
KR101576294B1 (en) * 2008-08-14 2015-12-11 삼성전자주식회사 Apparatus and method to perform processing a sound in a virtual reality system
US20120200499A1 (en) * 2010-02-28 2012-08-09 Osterhout Group, Inc. Ar glasses with event, sensor, and user action based control of applications resident on external devices with feedback
US8488246B2 (en) * 2010-02-28 2013-07-16 Osterhout Group, Inc. See-through near-eye display glasses including a curved polarizing film in the image source, a partially reflective, partially transmitting optical element and an optically flat film
US10180572B2 (en) * 2010-02-28 2019-01-15 Microsoft Technology Licensing, Llc AR glasses with event and user action control of external applications
US20120194418A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with user action control and event input based control of eyepiece application
US20120194420A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with event triggered user action control of ar eyepiece facility
US20130314303A1 (en) * 2010-02-28 2013-11-28 Osterhout Group, Inc. Ar glasses with user action control of and between internal and external applications with feedback
US20110214082A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US20120200601A1 (en) * 2010-02-28 2012-08-09 Osterhout Group, Inc. Ar glasses with state triggered eye control interaction with advertising facility
KR20130000401A (en) * 2010-02-28 2013-01-02 오스터하우트 그룹 인코포레이티드 Local advertising content on an interactive head-mounted eyepiece
US20140063054A1 (en) * 2010-02-28 2014-03-06 Osterhout Group, Inc. Ar glasses specific control interface based on a connected external device type
US20110213664A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US20120194553A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with sensor and user action based control of external devices with feedback
US20140063055A1 (en) * 2010-02-28 2014-03-06 Osterhout Group, Inc. Ar glasses specific user interface and control interface based on a connected external device type
US20120206322A1 (en) * 2010-02-28 2012-08-16 Osterhout Group, Inc. Ar glasses with event and sensor input triggered user action capture device control of ar eyepiece facility
US9128281B2 (en) * 2010-09-14 2015-09-08 Microsoft Technology Licensing, Llc Eyepiece with uniformly illuminated reflective display
US20120206485A1 (en) * 2010-02-28 2012-08-16 Osterhout Group, Inc. Ar glasses with event and sensor triggered user movement control of ar eyepiece facilities
US9285589B2 (en) * 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US20120206334A1 (en) * 2010-02-28 2012-08-16 Osterhout Group, Inc. Ar glasses with event and user action capture device control of external applications
US20120194550A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Sensor-based command and control of external devices with feedback from the external device to the ar glasses
US20120194551A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with user-action based command and control of external devices
US20120200488A1 (en) * 2010-02-28 2012-08-09 Osterhout Group, Inc. Ar glasses with sensor and user action based control of eyepiece applications with feedback
US9759917B2 (en) * 2010-02-28 2017-09-12 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered AR eyepiece interface to external devices
US20120194552A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses with predictive control of external device based on event input
US20120194549A1 (en) * 2010-02-28 2012-08-02 Osterhout Group, Inc. Ar glasses specific user interface based on a connected external device type
US20120206335A1 (en) * 2010-02-28 2012-08-16 Osterhout Group, Inc. Ar glasses with event, sensor, and user action based direct control of external devices with feedback
US8610771B2 (en) 2010-03-08 2013-12-17 Empire Technology Development Llc Broadband passive tracking for augmented reality
US9901828B2 (en) * 2010-03-30 2018-02-27 Sony Interactive Entertainment America Llc Method for an augmented reality character to maintain and exhibit awareness of an observer
US8384770B2 (en) * 2010-06-02 2013-02-26 Nintendo Co., Ltd. Image display system, image display apparatus, and image display method
JP4696184B1 (en) 2010-06-02 2011-06-08 任天堂株式会社 Image display system, image display apparatus, and image display method
EP2395769B1 (en) 2010-06-11 2015-03-04 Nintendo Co., Ltd. Image display program, image display system, and image display method
WO2011160114A1 (en) * 2010-06-18 2011-12-22 Minx, Inc. Augmented reality
US8581844B2 (en) * 2010-06-23 2013-11-12 Google Inc. Switching between a first operational mode and a second operational mode using a natural motion gesture
KR101683676B1 (en) * 2010-07-22 2016-12-07 삼성전자 주식회사 Apparatus and method for providing augmented reality service using sound
US8854356B2 (en) * 2010-09-28 2014-10-07 Nintendo Co., Ltd. Storage medium having stored therein image processing program, image processing apparatus, image processing system, and image processing method
US20120207308A1 (en) * 2011-02-15 2012-08-16 Po-Hsun Sung Interactive sound playback device
US20120306850A1 (en) * 2011-06-02 2012-12-06 Microsoft Corporation Distributed asynchronous localization and mapping for augmented reality
US8184069B1 (en) * 2011-06-20 2012-05-22 Google Inc. Systems and methods for adaptive transmission of data
US9973848B2 (en) * 2011-06-21 2018-05-15 Amazon Technologies, Inc. Signal-enhancing beamforming in an augmented reality environment
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
KR20140059213A (en) * 2011-08-30 2014-05-15 마이크로소프트 코포레이션 Head mounted display with iris scan profiling
US9606992B2 (en) * 2011-09-30 2017-03-28 Microsoft Technology Licensing, Llc Personal audio/visual apparatus providing resource management
TW201316328A (en) * 2011-10-14 2013-04-16 Hon Hai Prec Ind Co Ltd Sound feedback device and work method thereof
US9672659B2 (en) * 2011-12-27 2017-06-06 Here Global B.V. Geometrically and semanitically aware proxy for content placement

Also Published As

Publication number Publication date
KR20140117369A (en) 2014-10-07
JP2015510629A (en) 2015-04-09
US20130182858A1 (en) 2013-07-18
CN104054039A (en) 2014-09-17
US9563265B2 (en) 2017-02-07
EP2802962A1 (en) 2014-11-19
JP5996669B2 (en) 2016-09-21
KR102078427B1 (en) 2020-02-17
CN104054039B (en) 2017-04-19
WO2013106133A1 (en) 2013-07-18

Similar Documents

Publication Publication Date Title
IN2014CN04458A (en)
IN2014MN02283A (en)
WO2014118644A9 (en) Banking services experience center
EP3265767A4 (en) Method and sensor for pressure sensing based on electrical signal generated by redistribution of mobile ions in piezoionic layer
WO2013189396A3 (en) Method and system for moving application icon on touchscreen
WO2016051366A3 (en) Switching between the real world and virtual reality
WO2014054210A3 (en) Information processing device, display control method, and program
WO2015193177A3 (en) User-wearable device and system for personal computing
MX363430B (en) Tilting to scroll.
EP2981945A4 (en) Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system
WO2014070312A3 (en) Reference coordinate system determination
WO2015047453A3 (en) Interactions of virtual objects with surfaces
WO2012122172A3 (en) Assessing environmental characteristics in a video stream captured by a mobile device
EP2967322A4 (en) System and method for augmented and virtual reality
EP2973432A4 (en) Method and system for disambiguation of augmented reality tracking databases
EP3059738A4 (en) Intelligent testing method of nondestructive robot testing based on virtual reality technology
FR2971066B1 (en) THREE-DIMENSIONAL MAN-MACHINE INTERFACE.
WO2014031416A3 (en) Hardware implementation of the aggregation/group by operation: hash-table method
GB2504037A (en) Mobile device which offloads requests made by a mobile application to a remote entity for conservation of mobile device and network resources
WO2014140814A3 (en) Proof of presence via tag interactions
WO2012106370A3 (en) Correlating areas on the physical object to areas on the phone screen
MX347508B (en) Methods and apparatus to control and/or monitor a pneumatic actuator.
WO2010091875A3 (en) Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
WO2012074528A8 (en) Augmented reality system
WO2014150250A3 (en) Method and apparatus for substitution scheme for anonymizing personally identifiable information