KR102931968B1 - 컴퓨팅 디바이스 및 확장 현실 통합 - Google Patents

컴퓨팅 디바이스 및 확장 현실 통합

Info

Publication number
KR102931968B1
KR102931968B1 KR1020227002997A KR20227002997A KR102931968B1 KR 102931968 B1 KR102931968 B1 KR 102931968B1 KR 1020227002997 A KR1020227002997 A KR 1020227002997A KR 20227002997 A KR20227002997 A KR 20227002997A KR 102931968 B1 KR102931968 B1 KR 102931968B1
Authority
KR
South Korea
Prior art keywords
content
displayed
display
virtual reality
representation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227002997A
Other languages
English (en)
Korean (ko)
Other versions
KR20220038689A (ko
Inventor
더글라스 브렘스
로버트 타르츠
로빈 테레사 올리버
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20220038689A publication Critical patent/KR20220038689A/ko
Application granted granted Critical
Publication of KR102931968B1 publication Critical patent/KR102931968B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Telephone Function (AREA)
KR1020227002997A 2019-08-03 2020-06-15 컴퓨팅 디바이스 및 확장 현실 통합 Active KR102931968B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962882488P 2019-08-03 2019-08-03
US62/882,488 2019-08-03
US16/741,617 2020-01-13
US16/741,617 US11231827B2 (en) 2019-08-03 2020-01-13 Computing device and extended reality integration
PCT/US2020/037817 WO2021025787A1 (en) 2019-08-03 2020-06-15 Computing device and extended reality integration

Publications (2)

Publication Number Publication Date
KR20220038689A KR20220038689A (ko) 2022-03-29
KR102931968B1 true KR102931968B1 (ko) 2026-02-26

Family

ID=74258701

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020227002997A Active KR102931968B1 (ko) 2019-08-03 2020-06-15 컴퓨팅 디바이스 및 확장 현실 통합

Country Status (9)

Country Link
US (1) US11231827B2 (https=)
EP (1) EP4007947A1 (https=)
JP (1) JP7705376B2 (https=)
KR (1) KR102931968B1 (https=)
CN (1) CN114207559A (https=)
BR (1) BR112022001190A2 (https=)
PH (1) PH12021553300A1 (https=)
TW (1) TWI839532B (https=)
WO (1) WO2021025787A1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200093922A (ko) * 2019-01-29 2020-08-06 삼성전자주식회사 전자 장치의 외부 전자 장치를 제어하는 방법, 전자 장치 및 저장 매체
US11340756B2 (en) 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11449189B1 (en) * 2019-10-02 2022-09-20 Facebook Technologies, Llc Virtual reality-based augmented reality development system
US12307066B2 (en) * 2020-03-16 2025-05-20 Apple Inc. Devices, methods, and graphical user interfaces for providing computer-generated experiences
KR102717796B1 (ko) 2020-05-08 2024-10-16 삼성전자 주식회사 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
KR102861909B1 (ko) * 2020-07-28 2025-09-19 삼성전자 주식회사 전자 장치 및 오디오 볼륨 제어 방법
US11615596B2 (en) * 2020-09-24 2023-03-28 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11567625B2 (en) 2020-09-24 2023-01-31 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US12028507B2 (en) * 2021-03-11 2024-07-02 Quintar, Inc. Augmented reality system with remote presentation including 3D graphics extending beyond frame
JP7615824B2 (ja) * 2021-03-26 2025-01-17 富士フイルムビジネスイノベーション株式会社 制御装置、表示システム、および、プログラム
US12482145B2 (en) 2021-07-15 2025-11-25 Qualcomm Incorporated Remote landmark rendering for extended reality interfaces
CN113784105B (zh) * 2021-09-10 2024-07-26 上海曼恒数字技术股份有限公司 一种沉浸式vr终端的信息处理方法及系统
US11960652B2 (en) * 2021-10-12 2024-04-16 Qualcomm Incorporated User interactions with remote devices
KR20230067197A (ko) * 2021-11-09 2023-05-16 삼성전자주식회사 전자 장치와 웨어러블 전자 장치 사이에서 증강 현실 서비스에 관련된 컨텐츠를 제공하는 방법 및 장치
CN118215931A (zh) 2021-11-09 2024-06-18 三星电子株式会社 用于在电子装置和可穿戴电子装置之间提供与增强现实服务相关的内容的方法和装置
US12131009B2 (en) * 2022-01-13 2024-10-29 Motorola Mobility Llc Configuring an external presentation device based on user handedness
US11726734B2 (en) 2022-01-13 2023-08-15 Motorola Mobility Llc Configuring an external presentation device based on an impairment of a user
TWI818613B (zh) * 2022-07-01 2023-10-11 國立臺北科技大學 非對稱式ｖｒ遠端醫療協作指導系統及訓練方法
EP4575736A4 (en) * 2022-09-01 2025-12-03 Samsung Electronics Co Ltd METHOD FOR DISPLAYING INFORMATION WHEN WEARING A VISIO-HELMET (HMD), AND ASSOCIATED DEVICE
CN115407879A (zh) * 2022-09-28 2022-11-29 维沃移动通信有限公司 一种信息显示方法、装置、设备及存储介质
WO2024080579A1 (ko) * 2022-10-11 2024-04-18 삼성전자주식회사 사용자의 자세를 가이드하기 위한 웨어러블 장치 및 그 방법
WO2024090970A1 (ko) 2022-10-28 2024-05-02 삼성전자 주식회사 메타버스에서 외부 장치를 사용하는 전자 장치 및 이의 제어 방법
CN115967854B (zh) * 2022-12-21 2025-03-11 维沃移动通信有限公司 拍照方法、装置及电子设备
CN219266680U (zh) * 2023-03-31 2023-06-27 荆晨 延展现实显示系统
WO2024248856A1 (en) * 2023-05-31 2024-12-05 Google Llc Multi-modal localization of streaming content providers in a virtual environment
US12079903B1 (en) * 2023-06-26 2024-09-03 Google Llc Real screens in extended reality
KR102728699B1 (ko) 2023-09-25 2024-11-13 한국과학기술원 텍스트 읽기가 수반되는 증강현실 작업을 수행하는 증강현실 시스템 및 그 방법
CN119718061B (zh) * 2023-09-27 2025-12-09 珠海莫界科技有限公司 智能穿戴设备与移动终端的交互方法、装置、设备及介质
WO2025131274A1 (en) * 2023-12-20 2025-06-26 Telefonaktiebolaget Lm Ericsson (Publ) Radio relay of physical electronic device communications in extended reality environment
KR102934684B1 (ko) 2024-06-28 2026-03-04 김원빈 니어 휠 구동 시스템
CN119729106A (zh) * 2024-12-16 2025-03-28 咪咕文化科技有限公司 设备控制方法、电子设备及计算机程序产品

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190065026A1 (en) * 2017-08-24 2019-02-28 Microsoft Technology Licensing, Llc Virtual reality input
JP2019105678A (ja) * 2017-12-11 2019-06-27 京セラドキュメントソリューションズ株式会社 表示装置、及び画像表示方法

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713886B (zh) * 2012-09-29 2017-11-10 腾讯科技（深圳）有限公司 一种数据处理设备中的提醒装置及其提醒处理方法
TWI530860B (zh) * 2013-03-14 2016-04-21 茱麗安 麥克 爾巴哈 用以擴增實境及虛擬實境之目鏡系統及使用該系統之方法
CN105229720B (zh) * 2013-05-21 2018-05-15 索尼公司 显示控制装置、显示控制方法以及记录介质
US20150062164A1 (en) * 2013-09-05 2015-03-05 Seiko Epson Corporation Head mounted display, method of controlling head mounted display, computer program, image display system, and information processing apparatus
KR102243656B1 (ko) * 2014-09-26 2021-04-23 엘지전자 주식회사 모바일 디바이스, hmd 및 시스템
KR102358548B1 (ko) * 2014-10-15 2022-02-04 삼성전자주식회사 디바이스를 이용한 화면 처리 방법 및 장치
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
US10102674B2 (en) * 2015-03-09 2018-10-16 Google Llc Virtual reality headset connected to a mobile computing device
US10338673B2 (en) * 2015-09-16 2019-07-02 Google Llc Touchscreen hover detection in an augmented and/or virtual reality environment
US10157039B2 (en) * 2015-10-05 2018-12-18 Motorola Mobility Llc Automatic capturing of multi-mode inputs in applications
US10812755B2 (en) * 2015-10-14 2020-10-20 Utility Associates, Inc. Article of clothing with video recording device support
EP3236423A1 (en) 2016-04-22 2017-10-25 Thomson Licensing Method and device for compositing an image
CN109478344B (zh) * 2016-04-22 2023-05-30 交互数字Ce专利控股公司 用于合成图像的方法和设备
US10692113B2 (en) 2016-06-21 2020-06-23 Htc Corporation Method for providing customized information through advertising in simulation environment, and associated simulation system
US10802787B2 (en) 2016-09-30 2020-10-13 Sony Interactive Entertainment Inc. Integrating audience participation content into virtual reality content
US20180095542A1 (en) * 2016-09-30 2018-04-05 Sony Interactive Entertainment Inc. Object Holder for Virtual Reality Interaction
KR102739633B1 (ko) 2016-10-24 2024-12-09 엘지전자 주식회사 Hmd 디바이스
US10595012B2 (en) 2016-12-02 2020-03-17 Google Llc Representations of event notifications in virtual reality
GB2555501B (en) * 2017-05-04 2019-08-28 Sony Interactive Entertainment Europe Ltd Head mounted display and method
EP3682310B1 (en) 2017-09-11 2024-07-17 Google LLC Switchable virtual reality and augmented reality device
US11176956B2 (en) * 2018-03-28 2021-11-16 Qualcomm Incorproated Application directed latency control for wireless audio streaming
US10740924B2 (en) * 2018-04-16 2020-08-11 Microsoft Technology Licensing, Llc Tracking pose of handheld object

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190065026A1 (en) * 2017-08-24 2019-02-28 Microsoft Technology Licensing, Llc Virtual reality input
JP2019105678A (ja) * 2017-12-11 2019-06-27 京セラドキュメントソリューションズ株式会社 表示装置、及び画像表示方法

Also Published As

Publication number Publication date
BR112022001190A2 (pt) 2022-03-15
JP2022542295A (ja) 2022-09-30
PH12021553300A1 (en) 2022-08-01
US11231827B2 (en) 2022-01-25
EP4007947A1 (en) 2022-06-08
US20210034222A1 (en) 2021-02-04
JP7705376B2 (ja) 2025-07-09
TWI839532B (zh) 2024-04-21
WO2021025787A1 (en) 2021-02-11
TW202107249A (zh) 2021-02-16
KR20220038689A (ko) 2022-03-29
CN114207559A (zh) 2022-03-18

Similar Documents

Publication Publication Date Title
KR102931968B1 (ko) 컴퓨팅 디바이스 및 확장 현실 통합
CN110636324B (zh) 界面显示方法、装置、计算机设备及存储介质
US11698680B2 (en) Methods and systems for decoding and rendering a haptic effect associated with a 3D environment
JP6612250B2 (ja) 会話検出
KR102358939B1 (ko) 시선 추적 방법 및 디바이스에서의 시각적 변경의 비시각적 피드백
US10841534B2 (en) Real-world awareness for virtual reality
KR102085181B1 (ko) 데이터 전송 방법, 데이터 수신 방법, 및 디바이스
CN105009031B (zh) 增强现实设备以及在其上操作用户界面的方法
US20180321798A1 (en) Information processing apparatus and operation reception method
EP2972559B1 (en) Methods and apparatus for displaying images on a head mounted display
CN109407822B (zh) 协作虚拟现实的防恶心和视频流式传输技术
WO2020186988A1 (zh) 资讯的展示方法、装置、终端及存储介质
CN109407821B (zh) 与虚拟现实视频的协作交互
US20250173107A1 (en) Control method and electronic device
CN112612387A (zh) 展示信息的方法、装置、设备及存储介质
CN112910752A (zh) 语音表情显示、语音表情生成方法及装置
EP3465631B1 (en) Capturing and rendering information involving a virtual environment
KR102710460B1 (ko) 전자 장치, 그 제어 방법 및 전자 시스템
CN119732063A (zh) 用于多个音频流的延迟优化
CN114797091A (zh) 云游戏分屏展示方法、装置、设备及存储介质
CN111064658A (zh) 显示控制方法及电子设备
CN114546188A (zh) 基于互动界面的互动方法、装置、设备及可读存储介质
US20260064252A1 (en) Spatial quick-access messaging system for wearable devices
WO2025174662A1 (en) Techniques for motion mitigation
WO2024123505A1 (en) 3d user interface with sliding cylindrical volumes

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

R17-X000 Change to representative recorded

St.27 status event code: A-3-3-R10-R17-oth-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E13 Pre-grant limitation requested

Free format text: ST27 STATUS EVENT CODE: A-2-3-E10-E13-LIM-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D22-EXM-PE0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

F11 Ip right granted following substantive examination

Free format text: ST27 STATUS EVENT CODE: A-2-4-F10-F11-EXM-PR0701 (AS PROVIDED BY THE NATIONAL OFFICE)

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

U12 Designation fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U12-OTH-PR1002 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

Q13 Ip right document published

Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q13-NAP-PG1601 (AS PROVIDED BY THE NATIONAL OFFICE)