CN114207559A - 计算设备和扩展现实集成 - Google Patents

计算设备和扩展现实集成 Download PDF

Info

Publication number
CN114207559A
CN114207559A CN202080055441.5A CN202080055441A CN114207559A CN 114207559 A CN114207559 A CN 114207559A CN 202080055441 A CN202080055441 A CN 202080055441A CN 114207559 A CN114207559 A CN 114207559A
Authority
CN
China
Prior art keywords
displayed
content
composite representation
display
virtual reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080055441.5A
Other languages
English (en)
Chinese (zh)
Inventor
D.布雷姆斯
R.塔茨
R.T.奥利弗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN114207559A publication Critical patent/CN114207559A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Telephone Function (AREA)
CN202080055441.5A 2019-08-03 2020-06-15 计算设备和扩展现实集成 Pending CN114207559A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962882488P 2019-08-03 2019-08-03
US62/882,488 2019-08-03
US16/741,617 2020-01-13
US16/741,617 US11231827B2 (en) 2019-08-03 2020-01-13 Computing device and extended reality integration
PCT/US2020/037817 WO2021025787A1 (en) 2019-08-03 2020-06-15 Computing device and extended reality integration

Publications (1)

Publication Number Publication Date
CN114207559A true CN114207559A (zh) 2022-03-18

Family

ID=74258701

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080055441.5A Pending CN114207559A (zh) 2019-08-03 2020-06-15 计算设备和扩展现实集成

Country Status (9)

Country Link
US (1) US11231827B2 (https=)
EP (1) EP4007947A1 (https=)
JP (1) JP7705376B2 (https=)
KR (1) KR102931968B1 (https=)
CN (1) CN114207559A (https=)
BR (1) BR112022001190A2 (https=)
PH (1) PH12021553300A1 (https=)
TW (1) TWI839532B (https=)
WO (1) WO2021025787A1 (https=)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质
CN115967854A (zh) * 2022-12-21 2023-04-14 维沃移动通信有限公司 拍照方法、装置及电子设备
TWI818613B (zh) * 2022-07-01 2023-10-11 國立臺北科技大學 非對稱式ｖｒ遠端醫療協作指導系統及訓練方法
CN119729106A (zh) * 2024-12-16 2025-03-28 咪咕文化科技有限公司 设备控制方法、电子设备及计算机程序产品

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200093922A (ko) * 2019-01-29 2020-08-06 삼성전자주식회사 전자 장치의 외부 전자 장치를 제어하는 방법, 전자 장치 및 저장 매체
US11340756B2 (en) 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11449189B1 (en) * 2019-10-02 2022-09-20 Facebook Technologies, Llc Virtual reality-based augmented reality development system
US12307066B2 (en) * 2020-03-16 2025-05-20 Apple Inc. Devices, methods, and graphical user interfaces for providing computer-generated experiences
KR102717796B1 (ko) 2020-05-08 2024-10-16 삼성전자 주식회사 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
KR102861909B1 (ko) * 2020-07-28 2025-09-19 삼성전자 주식회사 전자 장치 및 오디오 볼륨 제어 방법
US11615596B2 (en) * 2020-09-24 2023-03-28 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11567625B2 (en) 2020-09-24 2023-01-31 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US12028507B2 (en) * 2021-03-11 2024-07-02 Quintar, Inc. Augmented reality system with remote presentation including 3D graphics extending beyond frame
JP7615824B2 (ja) * 2021-03-26 2025-01-17 富士フイルムビジネスイノベーション株式会社 制御装置、表示システム、および、プログラム
US12482145B2 (en) 2021-07-15 2025-11-25 Qualcomm Incorporated Remote landmark rendering for extended reality interfaces
CN113784105B (zh) * 2021-09-10 2024-07-26 上海曼恒数字技术股份有限公司 一种沉浸式vr终端的信息处理方法及系统
US11960652B2 (en) * 2021-10-12 2024-04-16 Qualcomm Incorporated User interactions with remote devices
KR20230067197A (ko) * 2021-11-09 2023-05-16 삼성전자주식회사 전자 장치와 웨어러블 전자 장치 사이에서 증강 현실 서비스에 관련된 컨텐츠를 제공하는 방법 및 장치
CN118215931A (zh) 2021-11-09 2024-06-18 三星电子株式会社 用于在电子装置和可穿戴电子装置之间提供与增强现实服务相关的内容的方法和装置
US12131009B2 (en) * 2022-01-13 2024-10-29 Motorola Mobility Llc Configuring an external presentation device based on user handedness
US11726734B2 (en) 2022-01-13 2023-08-15 Motorola Mobility Llc Configuring an external presentation device based on an impairment of a user
EP4575736A4 (en) * 2022-09-01 2025-12-03 Samsung Electronics Co Ltd METHOD FOR DISPLAYING INFORMATION WHEN WEARING A VISIO-HELMET (HMD), AND ASSOCIATED DEVICE
WO2024080579A1 (ko) * 2022-10-11 2024-04-18 삼성전자주식회사 사용자의 자세를 가이드하기 위한 웨어러블 장치 및 그 방법
WO2024090970A1 (ko) 2022-10-28 2024-05-02 삼성전자 주식회사 메타버스에서 외부 장치를 사용하는 전자 장치 및 이의 제어 방법
CN219266680U (zh) * 2023-03-31 2023-06-27 荆晨 延展现实显示系统
WO2024248856A1 (en) * 2023-05-31 2024-12-05 Google Llc Multi-modal localization of streaming content providers in a virtual environment
US12079903B1 (en) * 2023-06-26 2024-09-03 Google Llc Real screens in extended reality
KR102728699B1 (ko) 2023-09-25 2024-11-13 한국과학기술원 텍스트 읽기가 수반되는 증강현실 작업을 수행하는 증강현실 시스템 및 그 방법
CN119718061B (zh) * 2023-09-27 2025-12-09 珠海莫界科技有限公司 智能穿戴设备与移动终端的交互方法、装置、设备及介质
WO2025131274A1 (en) * 2023-12-20 2025-06-26 Telefonaktiebolaget Lm Ericsson (Publ) Radio relay of physical electronic device communications in extended reality environment
KR102934684B1 (ko) 2024-06-28 2026-03-04 김원빈 니어 휠 구동 시스템

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104423583A (zh) * 2013-09-05 2015-03-18 精工爱普生株式会社 头部佩戴型显示装置、控制头部佩戴型显示装置的方法、图像显示系统及信息处理装置
US20170076502A1 (en) * 2015-09-16 2017-03-16 Google Inc. Touchscreen hover detection in an augmented and/or virtual reality environment
US20170097806A1 (en) * 2015-10-05 2017-04-06 Motorola Mobility Llc Automatic capturing of multi-mode inputs in applications
EP3236423A1 (en) * 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
CN107407965A (zh) * 2015-03-09 2017-11-28 谷歌公司 连接至移动计算设备的虚拟现实头戴设备
US20180095542A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Object Holder for Virtual Reality Interaction
US20190037166A1 (en) * 2015-10-14 2019-01-31 Utility Associates, Inc. Article of clothing with video recording device support
US20190065026A1 (en) * 2017-08-24 2019-02-28 Microsoft Technology Licensing, Llc Virtual reality input

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713886B (zh) * 2012-09-29 2017-11-10 腾讯科技（深圳）有限公司 一种数据处理设备中的提醒装置及其提醒处理方法
TWI530860B (zh) * 2013-03-14 2016-04-21 茱麗安 麥克 爾巴哈 用以擴增實境及虛擬實境之目鏡系統及使用該系統之方法
CN105229720B (zh) * 2013-05-21 2018-05-15 索尼公司 显示控制装置、显示控制方法以及记录介质
KR102243656B1 (ko) * 2014-09-26 2021-04-23 엘지전자 주식회사 모바일 디바이스, hmd 및 시스템
KR102358548B1 (ko) * 2014-10-15 2022-02-04 삼성전자주식회사 디바이스를 이용한 화면 처리 방법 및 장치
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
CN109478344B (zh) * 2016-04-22 2023-05-30 交互数字Ce专利控股公司 用于合成图像的方法和设备
US10692113B2 (en) 2016-06-21 2020-06-23 Htc Corporation Method for providing customized information through advertising in simulation environment, and associated simulation system
US10802787B2 (en) 2016-09-30 2020-10-13 Sony Interactive Entertainment Inc. Integrating audience participation content into virtual reality content
KR102739633B1 (ko) 2016-10-24 2024-12-09 엘지전자 주식회사 Hmd 디바이스
US10595012B2 (en) 2016-12-02 2020-03-17 Google Llc Representations of event notifications in virtual reality
GB2555501B (en) * 2017-05-04 2019-08-28 Sony Interactive Entertainment Europe Ltd Head mounted display and method
EP3682310B1 (en) 2017-09-11 2024-07-17 Google LLC Switchable virtual reality and augmented reality device
JP2019105678A (ja) * 2017-12-11 2019-06-27 京セラドキュメントソリューションズ株式会社 表示装置、及び画像表示方法
US11176956B2 (en) * 2018-03-28 2021-11-16 Qualcomm Incorproated Application directed latency control for wireless audio streaming
US10740924B2 (en) * 2018-04-16 2020-08-11 Microsoft Technology Licensing, Llc Tracking pose of handheld object

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104423583A (zh) * 2013-09-05 2015-03-18 精工爱普生株式会社 头部佩戴型显示装置、控制头部佩戴型显示装置的方法、图像显示系统及信息处理装置
CN107407965A (zh) * 2015-03-09 2017-11-28 谷歌公司 连接至移动计算设备的虚拟现实头戴设备
US20170076502A1 (en) * 2015-09-16 2017-03-16 Google Inc. Touchscreen hover detection in an augmented and/or virtual reality environment
US20170097806A1 (en) * 2015-10-05 2017-04-06 Motorola Mobility Llc Automatic capturing of multi-mode inputs in applications
US20190037166A1 (en) * 2015-10-14 2019-01-31 Utility Associates, Inc. Article of clothing with video recording device support
EP3236423A1 (en) * 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
US20180095542A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Object Holder for Virtual Reality Interaction
US20190065026A1 (en) * 2017-08-24 2019-02-28 Microsoft Technology Licensing, Llc Virtual reality input

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI818613B (zh) * 2022-07-01 2023-10-11 國立臺北科技大學 非對稱式ｖｒ遠端醫療協作指導系統及訓練方法
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质
CN115967854A (zh) * 2022-12-21 2023-04-14 维沃移动通信有限公司 拍照方法、装置及电子设备
CN115967854B (zh) * 2022-12-21 2025-03-11 维沃移动通信有限公司 拍照方法、装置及电子设备
CN119729106A (zh) * 2024-12-16 2025-03-28 咪咕文化科技有限公司 设备控制方法、电子设备及计算机程序产品

Also Published As

Publication number Publication date
BR112022001190A2 (pt) 2022-03-15
JP2022542295A (ja) 2022-09-30
PH12021553300A1 (en) 2022-08-01
US11231827B2 (en) 2022-01-25
EP4007947A1 (en) 2022-06-08
US20210034222A1 (en) 2021-02-04
JP7705376B2 (ja) 2025-07-09
TWI839532B (zh) 2024-04-21
WO2021025787A1 (en) 2021-02-11
TW202107249A (zh) 2021-02-16
KR20220038689A (ko) 2022-03-29
KR102931968B1 (ko) 2026-02-26

Similar Documents

Publication Publication Date Title
JP7705376B2 (ja) コンピューティングデバイスとエクステンデッドリアリティとの統合
US11698680B2 (en) Methods and systems for decoding and rendering a haptic effect associated with a 3D environment
KR102358939B1 (ko) 시선 추적 방법 및 디바이스에서의 시각적 변경의 비시각적 피드백
US10817066B2 (en) Information privacy in virtual reality
JP6612250B2 (ja) 会話検出
KR102085181B1 (ko) 데이터 전송 방법, 데이터 수신 방법, 및 디바이스
US10841534B2 (en) Real-world awareness for virtual reality
CN103812761B (zh) 用于使用增强现实提供社交网络服务的设备和方法
EP4184412A1 (en) Method and apparatus for presenting resources
CN107005739A (zh) 用于基于语音的设备的外部视觉交互
US20250173107A1 (en) Control method and electronic device
CN107209568A (zh) 虚拟现实中的电话控制和存在
CN110825219B (zh) 电子设备、电子设备的控制方法和电子系统
CN119732063A (zh) 用于多个音频流的延迟优化
CN115361566A (zh) 直播观看方法、装置、终端及存储介质
CN114546188A (zh) 基于互动界面的互动方法、装置、设备及可读存储介质
US20250258575A1 (en) Techniques for motion mitigation
WO2025174662A1 (en) Techniques for motion mitigation
WO2026050038A1 (en) Spatial quick-access messaging system for wearable devices
CN119002682A (zh) 基于扩展现实的控制方法、装置、电子设备和存储介质
HK40025595A (en) Information display method and device, apparatus, and storage medium
HK1230299A1 (en) Non-visual feedback of visual change in a gaze tracking method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination