KR102733896B1 - 다중 사용자 증강 현실에서 사용자 상호 작용을 표현하기 위한 시스템 및 방법 - Google Patents

다중 사용자 증강 현실에서 사용자 상호 작용을 표현하기 위한 시스템 및 방법 Download PDF

Info

Publication number
KR102733896B1
KR102733896B1 KR1020210083267A KR20210083267A KR102733896B1 KR 102733896 B1 KR102733896 B1 KR 102733896B1 KR 1020210083267 A KR1020210083267 A KR 1020210083267A KR 20210083267 A KR20210083267 A KR 20210083267A KR 102733896 B1 KR102733896 B1 KR 102733896B1
Authority
KR
South Korea
Prior art keywords
user
virtual
content
space
coordinate system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020210083267A
Other languages
English (en)
Korean (ko)
Other versions
KR20220013903A (ko
Inventor
주호 미코 하포자
바이런 레오넬 델가도
스테판 레룩스
다니엘 보샹
Original Assignee
쇼피파이 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 쇼피파이 인크. filed Critical 쇼피파이 인크.
Publication of KR20220013903A publication Critical patent/KR20220013903A/ko
Application granted granted Critical
Publication of KR102733896B1 publication Critical patent/KR102733896B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0633—Managing shopping lists, e.g. compiling or processing purchase lists
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/024—Multi-user, collaborative environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Graphics (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)
  • Processing Or Creating Images (AREA)
KR1020210083267A 2020-07-27 2021-06-25 다중 사용자 증강 현실에서 사용자 상호 작용을 표현하기 위한 시스템 및 방법 Active KR102733896B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16/939,280 US11908159B2 (en) 2020-07-27 2020-07-27 Systems and methods for representing user interactions in multi-user augmented reality
US16/939,280 2020-07-27
EP21168734.8 2021-04-15
EP21168734.8A EP3945486B1 (en) 2020-07-27 2021-04-15 Systems and methods for representing user interactions in multi-user augmented reality

Publications (2)

Publication Number Publication Date
KR20220013903A KR20220013903A (ko) 2022-02-04
KR102733896B1 true KR102733896B1 (ko) 2024-11-25

Family

ID=79551984

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020210083267A Active KR102733896B1 (ko) 2020-07-27 2021-06-25 다중 사용자 증강 현실에서 사용자 상호 작용을 표현하기 위한 시스템 및 방법

Country Status (8)

Country Link
US (1) US11908159B2 (https=)
EP (2) EP3945486B1 (https=)
JP (1) JP2022023789A (https=)
KR (1) KR102733896B1 (https=)
CN (1) CN113986004A (https=)
AU (1) AU2021203479B2 (https=)
CA (1) CA3117878C (https=)
TW (1) TWI853167B (https=)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230401798A1 (en) * 2019-08-26 2023-12-14 Apple Inc. Accessible mixed reality applications
US11527045B2 (en) 2020-07-27 2022-12-13 Shopify Inc. Systems and methods for generating multi-user augmented reality content
US11494153B2 (en) 2020-07-27 2022-11-08 Shopify Inc. Systems and methods for modifying multi-user augmented reality
WO2022067342A2 (en) 2020-09-25 2022-03-31 Apple Inc. Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US11636654B2 (en) 2021-05-19 2023-04-25 Snap Inc. AR-based connected portal shopping
US12062084B2 (en) 2021-05-19 2024-08-13 Snap Inc. Method, system, and machine-readable storage medium for VR-based connected portal shopping
US11580592B2 (en) 2021-05-19 2023-02-14 Snap Inc. Customized virtual store
US11829126B2 (en) * 2021-09-22 2023-11-28 Rockwell Automation Technologies, Inc. Systems and methods for providing context-based data for an industrial automation system based on a virtual coordinate system
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
EP4463754A1 (en) 2022-01-12 2024-11-20 Apple Inc. Methods for displaying, selecting and moving objects and containers in an environment
JP7843357B2 (ja) 2022-01-19 2026-04-09 アップル インコーポレイテッド 環境内にオブジェクトを表示及び再位置決めするための方法
US12462508B1 (en) * 2022-02-02 2025-11-04 Apple Inc. User representation based on an anchored recording
US12541280B2 (en) 2022-02-28 2026-02-03 Apple Inc. System and method of three-dimensional placement and refinement in multi-user communication sessions
CN119404170A (zh) 2022-04-20 2025-02-07 苹果公司 三维环境中的被遮蔽对象
US11894989B2 (en) 2022-04-25 2024-02-06 Snap Inc. Augmented reality experience event metrics system
US12526599B2 (en) * 2022-06-23 2026-01-13 Niantic Spatial, Inc. Localization using audio and visual data
CN115314581A (zh) * 2022-07-01 2022-11-08 珠海市魅族科技有限公司 通知信息提醒方法、装置、设备及可读存储介质
US12175602B2 (en) 2022-08-19 2024-12-24 Meta Platforms Technologies, Llc Method of generating a virtual environment by scanning a real-world environment with a first device and displaying the virtual environment on a second device
US12282604B2 (en) 2022-08-31 2025-04-22 Snap Inc. Touch-based augmented reality experience
US20240071004A1 (en) * 2022-08-31 2024-02-29 Snap Inc. Social memory re-experiencing system
US12267482B2 (en) 2022-08-31 2025-04-01 Snap Inc. Controlling and editing presentation of volumetric content
US12417593B2 (en) 2022-08-31 2025-09-16 Snap Inc. Generating immersive augmented reality experiences from existing images and videos
US12322052B2 (en) 2022-08-31 2025-06-03 Snap Inc. Mixing and matching volumetric contents for new augmented reality experiences
US12449891B2 (en) 2022-08-31 2025-10-21 Snap Inc. Timelapse re-experiencing system
US12519924B2 (en) 2022-08-31 2026-01-06 Snap Inc. Multi-perspective augmented reality experience
US12518307B1 (en) 2022-09-07 2026-01-06 Meta Platforms Technologies, Llc Human body scanning for size recommendation
US12112011B2 (en) 2022-09-16 2024-10-08 Apple Inc. System and method of application-based three-dimensional refinement in multi-user communication sessions
WO2024064950A1 (en) 2022-09-24 2024-03-28 Apple Inc. Methods for time of day adjustments for environments and environment presentation during communication sessions
US20240233288A1 (en) 2022-09-24 2024-07-11 Apple Inc. Methods for controlling and interacting with a three-dimensional environment
US20240103704A1 (en) 2022-09-24 2024-03-28 Apple Inc. Methods for interacting with user interfaces based on attention
CN115657854A (zh) * 2022-11-10 2023-01-31 阿依瓦（北京）技术有限公司 一种基于ar的远程虚拟交互方法及系统
US12430856B2 (en) 2022-12-16 2025-09-30 Lowe's Companies, Inc. Compact augmented reality view experience
CN118283242A (zh) * 2022-12-31 2024-07-02 中兴通讯股份有限公司 虚拟现实显示方法及装置、增强现实光学采集装置、介质
CN120813918A (zh) 2023-01-30 2025-10-17 苹果公司 用于响应于注视和/或手势输入来显示多组控件的设备、方法和图形用户界面
WO2024254096A1 (en) 2023-06-04 2024-12-12 Apple Inc. Methods for managing overlapping windows and applying visual effects
EP4478725A1 (en) * 2023-06-15 2024-12-18 Unvs Unevis Ventures, Lda A system for individual user interaction with a shared streaming instance
KR102618364B1 (ko) * 2023-07-05 2023-12-28 주식회사 디씨엠 온라인 쥬얼리 시착 서비스 제공 시스템
WO2025024476A1 (en) * 2023-07-23 2025-01-30 Apple Inc. Systems, devices, and methods for audio presentation in a three-dimensional environment
US12093995B1 (en) 2023-10-13 2024-09-17 Target Brands, Inc. Card ecosystem guest interface in virtual reality retail environments
US20250377719A1 (en) 2024-06-09 2025-12-11 Apple Inc. Methods of interacting with content in a virtual environment
US20250391123A1 (en) * 2024-06-25 2025-12-25 Verizon Patent And Licensing Inc. Methods and Systems for Presenting Interactive Virtual Representations of Devices

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170140552A1 (en) 2014-06-25 2017-05-18 Korea Advanced Institute Of Science And Technology Apparatus and method for estimating hand position utilizing head mounted color depth camera, and bare hand interaction system using same
US20190065027A1 (en) 2017-08-31 2019-02-28 Apple Inc. Systems, Methods, and Graphical User Interfaces for Interacting with Augmented and Virtual Reality Environments
US20190114802A1 (en) 2017-10-12 2019-04-18 Microsoft Technology Licensing, Llc Peer to peer remote localization for devices

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11237867A (ja) * 1998-02-20 1999-08-31 Shimadzu Corp 仮想空間表示装置
FR2775814B1 (fr) 1998-03-06 2001-01-19 Rasterland Sa Systeme de visualisation d'images tridimensionnelles realistes virtuelles en temps reel
SE521263C2 (sv) 1998-06-22 2003-10-14 Ericsson Telefon Ab L M Anordning och förfarande för att upprätta förbindelse mellan en första och andra abonnent med hjälp av ett publikt register
JP3631151B2 (ja) 2000-11-30 2005-03-23 キヤノン株式会社 情報処理装置、複合現実感提示装置及びその方法並びに記憶媒体
US7136829B2 (en) * 2002-03-08 2006-11-14 America Online, Inc. Method and apparatus for providing a shopping list service
CN201281869Y (zh) 2008-10-21 2009-07-29 蓝劲松 网络商品销售装置
US9348141B2 (en) 2010-10-27 2016-05-24 Microsoft Technology Licensing, Llc Low-latency fusing of virtual and real content
US20120113223A1 (en) 2010-11-05 2012-05-10 Microsoft Corporation User Interaction in Augmented Reality
US20140267234A1 (en) * 2013-03-15 2014-09-18 Anselm Hook Generation and Sharing Coordinate System Between Users on Mobile
US10430018B2 (en) 2013-06-07 2019-10-01 Sony Interactive Entertainment Inc. Systems and methods for providing user tagging of content within a virtual scene
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US10725298B2 (en) 2014-03-26 2020-07-28 Mark D. Wieczorek, P.C. Virtual reality devices and accessories
US10852838B2 (en) 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9645648B2 (en) 2014-09-18 2017-05-09 Mary A. Spio Audio computer system for interacting within a virtual reality environment
US9846972B2 (en) * 2015-04-06 2017-12-19 Scope Technologies Us Inc. Method and apparatus for sharing augmented reality applications to multiple clients
US9898864B2 (en) 2015-05-28 2018-02-20 Microsoft Technology Licensing, Llc Shared tactile interaction and user safety in shared space multi-person immersive virtual reality
JP6725827B2 (ja) * 2015-07-31 2020-07-22 キヤノンマーケティングジャパン株式会社 情報処理装置、情報処理システム、その制御方法及びプログラム
DE102016209671B4 (de) * 2016-06-02 2022-01-05 Adidas Ag Vorrichtung zum Designen eines Musters für einen tragbaren Gegenstand
TWI585617B (zh) 2016-08-31 2017-06-01 宅妝股份有限公司 互動方法及系統
US10769797B2 (en) * 2017-01-05 2020-09-08 Samsung Electronics Co., Ltd. Virtual reality experience sharing
US20200050256A1 (en) 2017-01-25 2020-02-13 Google Llc Techniques to cause changes in both virtual environment and physical environment
US10140773B2 (en) * 2017-02-01 2018-11-27 Accenture Global Solutions Limited Rendering virtual objects in 3D environments
US10773169B2 (en) * 2018-01-22 2020-09-15 Google Llc Providing multiplayer augmented reality experiences
US10438414B2 (en) * 2018-01-26 2019-10-08 Microsoft Technology Licensing, Llc Authoring and presenting 3D presentations in augmented reality
GB2571337B (en) 2018-02-26 2021-03-10 Sony Interactive Entertainment Inc Controlling data processing
ES2974219T3 (es) * 2018-11-13 2024-06-26 Dolby Laboratories Licensing Corp Procesamiento de audio en servicios de audio inversivos
CN110049308A (zh) * 2019-02-28 2019-07-23 努比亚技术有限公司 一种双屏显示的方法、终端及计算机可读存储介质
US11107184B2 (en) * 2019-09-17 2021-08-31 Adobe Inc. Virtual object translation
CN110650368B (zh) * 2019-09-25 2022-04-26 新东方教育科技集团有限公司 视频处理方法、装置和电子设备
US11380069B2 (en) * 2019-10-30 2022-07-05 Purdue Research Foundation System and method for generating asynchronous augmented reality instructions
US11928758B2 (en) 2020-03-06 2024-03-12 Christopher Renwick Alston Technologies for augmented-reality
US11494153B2 (en) 2020-07-27 2022-11-08 Shopify Inc. Systems and methods for modifying multi-user augmented reality
US11527045B2 (en) 2020-07-27 2022-12-13 Shopify Inc. Systems and methods for generating multi-user augmented reality content

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170140552A1 (en) 2014-06-25 2017-05-18 Korea Advanced Institute Of Science And Technology Apparatus and method for estimating hand position utilizing head mounted color depth camera, and bare hand interaction system using same
US20190065027A1 (en) 2017-08-31 2019-02-28 Apple Inc. Systems, Methods, and Graphical User Interfaces for Interacting with Augmented and Virtual Reality Environments
US20190114802A1 (en) 2017-10-12 2019-04-18 Microsoft Technology Licensing, Llc Peer to peer remote localization for devices

Also Published As

Publication number Publication date
US20220028108A1 (en) 2022-01-27
JP2022023789A (ja) 2022-02-08
AU2021203479A1 (en) 2022-02-10
US11908159B2 (en) 2024-02-20
KR20220013903A (ko) 2022-02-04
EP4607437A2 (en) 2025-08-27
TW202205173A (zh) 2022-02-01
EP4607437A3 (en) 2025-11-05
EP3945486A1 (en) 2022-02-02
TWI853167B (zh) 2024-08-21
EP3945486B1 (en) 2025-08-20
CA3117878A1 (en) 2022-01-27
AU2021203479B2 (en) 2025-09-18
CA3117878C (en) 2024-07-02
CN113986004A (zh) 2022-01-28

Similar Documents

Publication Publication Date Title
KR102733896B1 (ko) 다중 사용자 증강 현실에서 사용자 상호 작용을 표현하기 위한 시스템 및 방법
US11494153B2 (en) Systems and methods for modifying multi-user augmented reality
US11847716B2 (en) Systems and methods for generating multi-user augmented reality content
US11568620B2 (en) Augmented reality-assisted methods and apparatus for assessing fit of physical objects in three-dimensional bounded spaces
KR102684040B1 (ko) 물리적 아이템에 대한 증강 현실 장면을 생성하기 위한 시스템 및 방법
US11321768B2 (en) Methods and systems for an e-commerce platform with augmented reality application for display of virtual objects
US11593870B2 (en) Systems and methods for determining positions for three-dimensional models relative to spatial features
KR20210075847A (ko) 2d 이미지 추천을 위한 시스템 및 방법
US11670065B2 (en) Systems and methods for providing augmented media
AU2022457748B2 (en) Systems and methods for interacting with augmented reality content using a dual-interface
US20250391063A1 (en) Systems and methods for overlay of virtual object on proxy object and concealment of proxy object
US20230377027A1 (en) Systems and methods for generating augmented reality within a subspace

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20210625

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20240509

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20210625

Comment text: Patent Application

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20240919

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20241120

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20241120

End annual number: 3

Start annual number: 1

PG1601 Publication of registration