TWI839532B - 計算裝置及延伸實境整合 - Google Patents

計算裝置及延伸實境整合 Download PDF

Info

Publication number
TWI839532B
TWI839532B TW109120251A TW109120251A TWI839532B TW I839532 B TWI839532 B TW I839532B TW 109120251 A TW109120251 A TW 109120251A TW 109120251 A TW109120251 A TW 109120251A TW I839532 B TWI839532 B TW I839532B
Authority
TW
Taiwan
Prior art keywords
displayed
content
display
composite representation
user input
Prior art date
Application number
TW109120251A
Other languages
English (en)
Chinese (zh)
Other versions
TW202107249A (zh
Inventor
道格拉斯 布雷姆斯
羅伯特 塔茲
羅賓 特瑞莎 奧利弗
Original Assignee
美商高通公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商高通公司 filed Critical 美商高通公司
Publication of TW202107249A publication Critical patent/TW202107249A/zh
Application granted granted Critical
Publication of TWI839532B publication Critical patent/TWI839532B/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Telephone Function (AREA)
TW109120251A 2019-08-03 2020-06-16 計算裝置及延伸實境整合 TWI839532B (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201962882488P 2019-08-03 2019-08-03
US62/882,488 2019-08-03
US16/741,617 2020-01-13
US16/741,617 US11231827B2 (en) 2019-08-03 2020-01-13 Computing device and extended reality integration

Publications (2)

Publication Number Publication Date
TW202107249A TW202107249A (zh) 2021-02-16
TWI839532B true TWI839532B (zh) 2024-04-21

Family

ID=74258701

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109120251A TWI839532B (zh) 2019-08-03 2020-06-16 計算裝置及延伸實境整合

Country Status (9)

Country Link
US (1) US11231827B2 (https=)
EP (1) EP4007947A1 (https=)
JP (1) JP7705376B2 (https=)
KR (1) KR102931968B1 (https=)
CN (1) CN114207559A (https=)
BR (1) BR112022001190A2 (https=)
PH (1) PH12021553300A1 (https=)
TW (1) TWI839532B (https=)
WO (1) WO2021025787A1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200093922A (ko) * 2019-01-29 2020-08-06 삼성전자주식회사 전자 장치의 외부 전자 장치를 제어하는 방법, 전자 장치 및 저장 매체
US11340756B2 (en) 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11449189B1 (en) * 2019-10-02 2022-09-20 Facebook Technologies, Llc Virtual reality-based augmented reality development system
US12307066B2 (en) * 2020-03-16 2025-05-20 Apple Inc. Devices, methods, and graphical user interfaces for providing computer-generated experiences
KR102717796B1 (ko) 2020-05-08 2024-10-16 삼성전자 주식회사 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
KR102861909B1 (ko) * 2020-07-28 2025-09-19 삼성전자 주식회사 전자 장치 및 오디오 볼륨 제어 방법
US11615596B2 (en) * 2020-09-24 2023-03-28 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11567625B2 (en) 2020-09-24 2023-01-31 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US12028507B2 (en) * 2021-03-11 2024-07-02 Quintar, Inc. Augmented reality system with remote presentation including 3D graphics extending beyond frame
JP7615824B2 (ja) * 2021-03-26 2025-01-17 富士フイルムビジネスイノベーション株式会社 制御装置、表示システム、および、プログラム
US12482145B2 (en) 2021-07-15 2025-11-25 Qualcomm Incorporated Remote landmark rendering for extended reality interfaces
CN113784105B (zh) * 2021-09-10 2024-07-26 上海曼恒数字技术股份有限公司 一种沉浸式vr终端的信息处理方法及系统
US11960652B2 (en) * 2021-10-12 2024-04-16 Qualcomm Incorporated User interactions with remote devices
KR20230067197A (ko) * 2021-11-09 2023-05-16 삼성전자주식회사 전자 장치와 웨어러블 전자 장치 사이에서 증강 현실 서비스에 관련된 컨텐츠를 제공하는 방법 및 장치
CN118215931A (zh) 2021-11-09 2024-06-18 三星电子株式会社 用于在电子装置和可穿戴电子装置之间提供与增强现实服务相关的内容的方法和装置
US12131009B2 (en) * 2022-01-13 2024-10-29 Motorola Mobility Llc Configuring an external presentation device based on user handedness
US11726734B2 (en) 2022-01-13 2023-08-15 Motorola Mobility Llc Configuring an external presentation device based on an impairment of a user
TWI818613B (zh) * 2022-07-01 2023-10-11 國立臺北科技大學 非對稱式ｖｒ遠端醫療協作指導系統及訓練方法
EP4575736A4 (en) * 2022-09-01 2025-12-03 Samsung Electronics Co Ltd METHOD FOR DISPLAYING INFORMATION WHEN WEARING A VISIO-HELMET (HMD), AND ASSOCIATED DEVICE
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质
WO2024080579A1 (ko) * 2022-10-11 2024-04-18 삼성전자주식회사 사용자의 자세를 가이드하기 위한 웨어러블 장치 및 그 방법
WO2024090970A1 (ko) 2022-10-28 2024-05-02 삼성전자 주식회사 메타버스에서 외부 장치를 사용하는 전자 장치 및 이의 제어 방법
CN115967854B (zh) * 2022-12-21 2025-03-11 维沃移动通信有限公司 拍照方法、装置及电子设备
CN219266680U (zh) * 2023-03-31 2023-06-27 荆晨 延展现实显示系统
WO2024248856A1 (en) * 2023-05-31 2024-12-05 Google Llc Multi-modal localization of streaming content providers in a virtual environment
US12079903B1 (en) * 2023-06-26 2024-09-03 Google Llc Real screens in extended reality
KR102728699B1 (ko) 2023-09-25 2024-11-13 한국과학기술원 텍스트 읽기가 수반되는 증강현실 작업을 수행하는 증강현실 시스템 및 그 방법
CN119718061B (zh) * 2023-09-27 2025-12-09 珠海莫界科技有限公司 智能穿戴设备与移动终端的交互方法、装置、设备及介质
WO2025131274A1 (en) * 2023-12-20 2025-06-26 Telefonaktiebolaget Lm Ericsson (Publ) Radio relay of physical electronic device communications in extended reality environment
KR102934684B1 (ko) 2024-06-28 2026-03-04 김원빈 니어 휠 구동 시스템
CN119729106A (zh) * 2024-12-16 2025-03-28 咪咕文化科技有限公司 设备控制方法、电子设备及计算机程序产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201443760A (zh) * 2013-03-14 2014-11-16 Julian Michael Urbach 用以擴增實境及虛擬實境之目鏡
US20170076502A1 (en) * 2015-09-16 2017-03-16 Google Inc. Touchscreen hover detection in an augmented and/or virtual reality environment
US20180095542A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Object Holder for Virtual Reality Interaction
US20190037166A1 (en) * 2015-10-14 2019-01-31 Utility Associates, Inc. Article of clothing with video recording device support

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713886B (zh) * 2012-09-29 2017-11-10 腾讯科技（深圳）有限公司 一种数据处理设备中的提醒装置及其提醒处理方法
CN105229720B (zh) * 2013-05-21 2018-05-15 索尼公司 显示控制装置、显示控制方法以及记录介质
US20150062164A1 (en) * 2013-09-05 2015-03-05 Seiko Epson Corporation Head mounted display, method of controlling head mounted display, computer program, image display system, and information processing apparatus
KR102243656B1 (ko) * 2014-09-26 2021-04-23 엘지전자 주식회사 모바일 디바이스, hmd 및 시스템
KR102358548B1 (ko) * 2014-10-15 2022-02-04 삼성전자주식회사 디바이스를 이용한 화면 처리 방법 및 장치
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
US10102674B2 (en) * 2015-03-09 2018-10-16 Google Llc Virtual reality headset connected to a mobile computing device
US10157039B2 (en) * 2015-10-05 2018-12-18 Motorola Mobility Llc Automatic capturing of multi-mode inputs in applications
EP3236423A1 (en) 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
CN109478344B (zh) * 2016-04-22 2023-05-30 交互数字Ce专利控股公司 用于合成图像的方法和设备
US10692113B2 (en) 2016-06-21 2020-06-23 Htc Corporation Method for providing customized information through advertising in simulation environment, and associated simulation system
US10802787B2 (en) 2016-09-30 2020-10-13 Sony Interactive Entertainment Inc. Integrating audience participation content into virtual reality content
KR102739633B1 (ko) 2016-10-24 2024-12-09 엘지전자 주식회사 Hmd 디바이스
US10595012B2 (en) 2016-12-02 2020-03-17 Google Llc Representations of event notifications in virtual reality
GB2555501B (en) * 2017-05-04 2019-08-28 Sony Interactive Entertainment Europe Ltd Head mounted display and method
US10754496B2 (en) 2017-08-24 2020-08-25 Microsoft Technology Licensing, Llc Virtual reality input
EP3682310B1 (en) 2017-09-11 2024-07-17 Google LLC Switchable virtual reality and augmented reality device
JP2019105678A (ja) * 2017-12-11 2019-06-27 京セラドキュメントソリューションズ株式会社 表示装置、及び画像表示方法
US11176956B2 (en) * 2018-03-28 2021-11-16 Qualcomm Incorproated Application directed latency control for wireless audio streaming
US10740924B2 (en) * 2018-04-16 2020-08-11 Microsoft Technology Licensing, Llc Tracking pose of handheld object

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201443760A (zh) * 2013-03-14 2014-11-16 Julian Michael Urbach 用以擴增實境及虛擬實境之目鏡
US20170076502A1 (en) * 2015-09-16 2017-03-16 Google Inc. Touchscreen hover detection in an augmented and/or virtual reality environment
US20190037166A1 (en) * 2015-10-14 2019-01-31 Utility Associates, Inc. Article of clothing with video recording device support
US20180095542A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Object Holder for Virtual Reality Interaction

Also Published As

Publication number Publication date
BR112022001190A2 (pt) 2022-03-15
JP2022542295A (ja) 2022-09-30
PH12021553300A1 (en) 2022-08-01
US11231827B2 (en) 2022-01-25
EP4007947A1 (en) 2022-06-08
US20210034222A1 (en) 2021-02-04
JP7705376B2 (ja) 2025-07-09
WO2021025787A1 (en) 2021-02-11
TW202107249A (zh) 2021-02-16
KR20220038689A (ko) 2022-03-29
CN114207559A (zh) 2022-03-18
KR102931968B1 (ko) 2026-02-26

Similar Documents

Publication Publication Date Title
TWI839532B (zh) 計算裝置及延伸實境整合
KR102358939B1 (ko) 시선 추적 방법 및 디바이스에서의 시각적 변경의 비시각적 피드백
CN105009031B (zh) 增强现实设备以及在其上操作用户界面的方法
JP6612250B2 (ja) 会話検出
US10841534B2 (en) Real-world awareness for virtual reality
EP2972559B1 (en) Methods and apparatus for displaying images on a head mounted display
US20180157333A1 (en) Information privacy in virtual reality
CN109407821B (zh) 与虚拟现实视频的协作交互
CN109407822B (zh) 协作虚拟现实的防恶心和视频流式传输技术
EP3400580B1 (en) Method and apparatus for facilitating interaction with virtual reality equipment
CN107005739A (zh) 用于基于语音的设备的外部视觉交互
KR20150047006A (ko) 데이터 전송 방법, 데이터 수신 방법, 및 디바이스
KR20150090162A (ko) 비-접촉 제스처들을 통한 제스처 인식 모드 및 디바이스 페어링 및 공유를 트리거링하기 위한 방법들, 장치들 및 컴퓨터 판독가능 매체
CN110825219B (zh) 电子设备、电子设备的控制方法和电子系统
WO2017215198A1 (zh) 控制工作状态的方法和装置
GB2566142A (en) Collaborative virtual reality anti-nausea and video streaming techniques
WO2025174662A1 (en) Techniques for motion mitigation
WO2026050038A1 (en) Spatial quick-access messaging system for wearable devices
HK1230299A1 (en) Non-visual feedback of visual change in a gaze tracking method and device
HK1230299B (zh) 在凝视跟踪方法和设备中视觉改变的非视觉反馈