JP7705376B2 - コンピューティングデバイスとエクステンデッドリアリティとの統合 - Google Patents

コンピューティングデバイスとエクステンデッドリアリティとの統合 Download PDF

Info

Publication number
JP7705376B2
JP7705376B2 JP2022505614A JP2022505614A JP7705376B2 JP 7705376 B2 JP7705376 B2 JP 7705376B2 JP 2022505614 A JP2022505614 A JP 2022505614A JP 2022505614 A JP2022505614 A JP 2022505614A JP 7705376 B2 JP7705376 B2 JP 7705376B2
Authority
JP
Japan
Prior art keywords
content
display
displayed
virtual reality
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022505614A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022542295A (ja
JP2022542295A5 (https=
Inventor
ブレムス、ダグラス
ターツ、ロバート
オリバー、ロビン・テレサ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2022542295A publication Critical patent/JP2022542295A/ja
Publication of JP2022542295A5 publication Critical patent/JP2022542295A5/ja
Application granted granted Critical
Publication of JP7705376B2 publication Critical patent/JP7705376B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Telephone Function (AREA)
JP2022505614A 2019-08-03 2020-06-15 コンピューティングデバイスとエクステンデッドリアリティとの統合 Active JP7705376B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962882488P 2019-08-03 2019-08-03
US62/882,488 2019-08-03
US16/741,617 2020-01-13
US16/741,617 US11231827B2 (en) 2019-08-03 2020-01-13 Computing device and extended reality integration
PCT/US2020/037817 WO2021025787A1 (en) 2019-08-03 2020-06-15 Computing device and extended reality integration

Publications (3)

Publication Number Publication Date
JP2022542295A JP2022542295A (ja) 2022-09-30
JP2022542295A5 JP2022542295A5 (https=) 2023-05-24
JP7705376B2 true JP7705376B2 (ja) 2025-07-09

Family

ID=74258701

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022505614A Active JP7705376B2 (ja) 2019-08-03 2020-06-15 コンピューティングデバイスとエクステンデッドリアリティとの統合

Country Status (9)

Country Link
US (1) US11231827B2 (https=)
EP (1) EP4007947A1 (https=)
JP (1) JP7705376B2 (https=)
KR (1) KR102931968B1 (https=)
CN (1) CN114207559A (https=)
BR (1) BR112022001190A2 (https=)
PH (1) PH12021553300A1 (https=)
TW (1) TWI839532B (https=)
WO (1) WO2021025787A1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200093922A (ko) * 2019-01-29 2020-08-06 삼성전자주식회사 전자 장치의 외부 전자 장치를 제어하는 방법, 전자 장치 및 저장 매체
US11340756B2 (en) 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11449189B1 (en) * 2019-10-02 2022-09-20 Facebook Technologies, Llc Virtual reality-based augmented reality development system
US12307066B2 (en) * 2020-03-16 2025-05-20 Apple Inc. Devices, methods, and graphical user interfaces for providing computer-generated experiences
KR102717796B1 (ko) 2020-05-08 2024-10-16 삼성전자 주식회사 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
KR102861909B1 (ko) * 2020-07-28 2025-09-19 삼성전자 주식회사 전자 장치 및 오디오 볼륨 제어 방법
US11615596B2 (en) * 2020-09-24 2023-03-28 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11567625B2 (en) 2020-09-24 2023-01-31 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US12028507B2 (en) * 2021-03-11 2024-07-02 Quintar, Inc. Augmented reality system with remote presentation including 3D graphics extending beyond frame
JP7615824B2 (ja) * 2021-03-26 2025-01-17 富士フイルムビジネスイノベーション株式会社 制御装置、表示システム、および、プログラム
US12482145B2 (en) 2021-07-15 2025-11-25 Qualcomm Incorporated Remote landmark rendering for extended reality interfaces
CN113784105B (zh) * 2021-09-10 2024-07-26 上海曼恒数字技术股份有限公司 一种沉浸式vr终端的信息处理方法及系统
US11960652B2 (en) * 2021-10-12 2024-04-16 Qualcomm Incorporated User interactions with remote devices
KR20230067197A (ko) * 2021-11-09 2023-05-16 삼성전자주식회사 전자 장치와 웨어러블 전자 장치 사이에서 증강 현실 서비스에 관련된 컨텐츠를 제공하는 방법 및 장치
CN118215931A (zh) 2021-11-09 2024-06-18 三星电子株式会社 用于在电子装置和可穿戴电子装置之间提供与增强现实服务相关的内容的方法和装置
US12131009B2 (en) * 2022-01-13 2024-10-29 Motorola Mobility Llc Configuring an external presentation device based on user handedness
US11726734B2 (en) 2022-01-13 2023-08-15 Motorola Mobility Llc Configuring an external presentation device based on an impairment of a user
TWI818613B (zh) * 2022-07-01 2023-10-11 國立臺北科技大學 非對稱式ｖｒ遠端醫療協作指導系統及訓練方法
EP4575736A4 (en) * 2022-09-01 2025-12-03 Samsung Electronics Co Ltd METHOD FOR DISPLAYING INFORMATION WHEN WEARING A VISIO-HELMET (HMD), AND ASSOCIATED DEVICE
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质
WO2024080579A1 (ko) * 2022-10-11 2024-04-18 삼성전자주식회사 사용자의 자세를 가이드하기 위한 웨어러블 장치 및 그 방법
WO2024090970A1 (ko) 2022-10-28 2024-05-02 삼성전자 주식회사 메타버스에서 외부 장치를 사용하는 전자 장치 및 이의 제어 방법
CN115967854B (zh) * 2022-12-21 2025-03-11 维沃移动通信有限公司 拍照方法、装置及电子设备
CN219266680U (zh) * 2023-03-31 2023-06-27 荆晨 延展现实显示系统
WO2024248856A1 (en) * 2023-05-31 2024-12-05 Google Llc Multi-modal localization of streaming content providers in a virtual environment
US12079903B1 (en) * 2023-06-26 2024-09-03 Google Llc Real screens in extended reality
KR102728699B1 (ko) 2023-09-25 2024-11-13 한국과학기술원 텍스트 읽기가 수반되는 증강현실 작업을 수행하는 증강현실 시스템 및 그 방법
CN119718061B (zh) * 2023-09-27 2025-12-09 珠海莫界科技有限公司 智能穿戴设备与移动终端的交互方法、装置、设备及介质
WO2025131274A1 (en) * 2023-12-20 2025-06-26 Telefonaktiebolaget Lm Ericsson (Publ) Radio relay of physical electronic device communications in extended reality environment
KR102934684B1 (ko) 2024-06-28 2026-03-04 김원빈 니어 휠 구동 시스템
CN119729106A (zh) * 2024-12-16 2025-03-28 咪咕文化科技有限公司 设备控制方法、电子设备及计算机程序产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3236423A1 (en) 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
JP2018534643A (ja) 2015-09-16 2018-11-22 グーグル エルエルシー 拡張および／または仮想現実環境におけるタッチスクリーンホバーの検出
US20190065026A1 (en) 2017-08-24 2019-02-28 Microsoft Technology Licensing, Llc Virtual reality input
JP2019105678A (ja) 2017-12-11 2019-06-27 京セラドキュメントソリューションズ株式会社 表示装置、及び画像表示方法

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713886B (zh) * 2012-09-29 2017-11-10 腾讯科技（深圳）有限公司 一种数据处理设备中的提醒装置及其提醒处理方法
TWI530860B (zh) * 2013-03-14 2016-04-21 茱麗安 麥克 爾巴哈 用以擴增實境及虛擬實境之目鏡系統及使用該系統之方法
CN105229720B (zh) * 2013-05-21 2018-05-15 索尼公司 显示控制装置、显示控制方法以及记录介质
US20150062164A1 (en) * 2013-09-05 2015-03-05 Seiko Epson Corporation Head mounted display, method of controlling head mounted display, computer program, image display system, and information processing apparatus
KR102243656B1 (ko) * 2014-09-26 2021-04-23 엘지전자 주식회사 모바일 디바이스, hmd 및 시스템
KR102358548B1 (ko) * 2014-10-15 2022-02-04 삼성전자주식회사 디바이스를 이용한 화면 처리 방법 및 장치
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
US10102674B2 (en) * 2015-03-09 2018-10-16 Google Llc Virtual reality headset connected to a mobile computing device
US10157039B2 (en) * 2015-10-05 2018-12-18 Motorola Mobility Llc Automatic capturing of multi-mode inputs in applications
US10812755B2 (en) * 2015-10-14 2020-10-20 Utility Associates, Inc. Article of clothing with video recording device support
CN109478344B (zh) * 2016-04-22 2023-05-30 交互数字Ce专利控股公司 用于合成图像的方法和设备
US10692113B2 (en) 2016-06-21 2020-06-23 Htc Corporation Method for providing customized information through advertising in simulation environment, and associated simulation system
US10802787B2 (en) 2016-09-30 2020-10-13 Sony Interactive Entertainment Inc. Integrating audience participation content into virtual reality content
US20180095542A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Object Holder for Virtual Reality Interaction
KR102739633B1 (ko) 2016-10-24 2024-12-09 엘지전자 주식회사 Hmd 디바이스
US10595012B2 (en) 2016-12-02 2020-03-17 Google Llc Representations of event notifications in virtual reality
GB2555501B (en) * 2017-05-04 2019-08-28 Sony Interactive Entertainment Europe Ltd Head mounted display and method
EP3682310B1 (en) 2017-09-11 2024-07-17 Google LLC Switchable virtual reality and augmented reality device
US11176956B2 (en) * 2018-03-28 2021-11-16 Qualcomm Incorproated Application directed latency control for wireless audio streaming
US10740924B2 (en) * 2018-04-16 2020-08-11 Microsoft Technology Licensing, Llc Tracking pose of handheld object

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018534643A (ja) 2015-09-16 2018-11-22 グーグル エルエルシー 拡張および／または仮想現実環境におけるタッチスクリーンホバーの検出
EP3236423A1 (en) 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
US20190065026A1 (en) 2017-08-24 2019-02-28 Microsoft Technology Licensing, Llc Virtual reality input
JP2019105678A (ja) 2017-12-11 2019-06-27 京セラドキュメントソリューションズ株式会社 表示装置、及び画像表示方法

Also Published As

Publication number Publication date
BR112022001190A2 (pt) 2022-03-15
JP2022542295A (ja) 2022-09-30
PH12021553300A1 (en) 2022-08-01
US11231827B2 (en) 2022-01-25
EP4007947A1 (en) 2022-06-08
US20210034222A1 (en) 2021-02-04
TWI839532B (zh) 2024-04-21
WO2021025787A1 (en) 2021-02-11
TW202107249A (zh) 2021-02-16
KR20220038689A (ko) 2022-03-29
CN114207559A (zh) 2022-03-18
KR102931968B1 (ko) 2026-02-26

Similar Documents

Publication Publication Date Title
JP7705376B2 (ja) コンピューティングデバイスとエクステンデッドリアリティとの統合
US11762529B2 (en) Method for displaying application icon and electronic device
CN108604175B (zh) 装置和关联方法
US10841534B2 (en) Real-world awareness for virtual reality
KR102085181B1 (ko) 데이터 전송 방법, 데이터 수신 방법, 및 디바이스
KR102358939B1 (ko) 시선 추적 방법 및 디바이스에서의 시각적 변경의 비시각적 피드백
EP2972559B1 (en) Methods and apparatus for displaying images on a head mounted display
CN103812761B (zh) 用于使用增强现实提供社交网络服务的设备和方法
WO2020186988A1 (zh) 资讯的展示方法、装置、终端及存储介质
US20250173107A1 (en) Control method and electronic device
CN109407821B (zh) 与虚拟现实视频的协作交互
US20230119849A1 (en) Three-dimensional interface control method and terminal
CN112527222A (zh) 一种信息处理方法及电子设备
CN116490250A (zh) 环境的非对称呈现
EP4325355A1 (en) Dynamic effect calculating method and apparatus
CN112527174A (zh) 一种信息处理方法及电子设备
CN114666433A (zh) 一种终端设备中啸叫处理方法及装置、终端
KR102710460B1 (ko) 전자 장치, 그 제어 방법 및 전자 시스템
CN111064658A (zh) 显示控制方法及电子设备
CN117939255A (zh) 视频生成方法、装置、设备及计算机可读存储介质
CN113342440A (zh) 一种拼屏方法、装置、电子设备和存储介质
US20260064252A1 (en) Spatial quick-access messaging system for wearable devices
JP2026060923A (ja) コントローラ追跡のためのモーションブラー軽減
HK40025595A (en) Information display method and device, apparatus, and storage medium
CN119002682A (zh) 基于扩展现实的控制方法、装置、电子设备和存储介质

Legal Events

Date Code Title Description
RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20230104

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230515

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230515

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240415

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240423

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240606

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20240806

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240920

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20240930

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20241025

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250508

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250627

R150 Certificate of patent or registration of utility model

Ref document number: 7705376

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150