KR102684040B1 - 물리적 아이템에 대한 증강 현실 장면을 생성하기 위한 시스템 및 방법 - Google Patents

물리적 아이템에 대한 증강 현실 장면을 생성하기 위한 시스템 및 방법 Download PDF

Info

Publication number
KR102684040B1
KR102684040B1 KR1020210016855A KR20210016855A KR102684040B1 KR 102684040 B1 KR102684040 B1 KR 102684040B1 KR 1020210016855 A KR1020210016855 A KR 1020210016855A KR 20210016855 A KR20210016855 A KR 20210016855A KR 102684040 B1 KR102684040 B1 KR 102684040B1
Authority
KR
South Korea
Prior art keywords
scene
customer
product
image
physical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020210016855A
Other languages
English (en)
Korean (ko)
Other versions
KR20210100555A (ko
Inventor
조나단 웨이드
주호 미코 하포자
바이런 리오넬 델가도
다니엘 보샹
Original Assignee
쇼피파이 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 쇼피파이 인크. filed Critical 쇼피파이 인크.
Publication of KR20210100555A publication Critical patent/KR20210100555A/ko
Application granted granted Critical
Publication of KR102684040B1 publication Critical patent/KR102684040B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0623—Electronic shopping [e-shopping] by investigating goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Software Systems (AREA)
  • General Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Evolutionary Computation (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Architecture (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
KR1020210016855A 2020-02-06 2021-02-05 물리적 아이템에 대한 증강 현실 장면을 생성하기 위한 시스템 및 방법 Active KR102684040B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16/783,322 US11676200B2 (en) 2020-02-06 2020-02-06 Systems and methods for generating augmented reality scenes for physical items
US16/783,322 2020-02-06
EP20215725.1A EP3862849A1 (en) 2020-02-06 2020-12-18 Systems and methods for generating augmented reality scenes for physical items
EP20215725.1 2020-12-18

Publications (2)

Publication Number Publication Date
KR20210100555A KR20210100555A (ko) 2021-08-17
KR102684040B1 true KR102684040B1 (ko) 2024-07-10

Family

ID=73855946

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020210016855A Active KR102684040B1 (ko) 2020-02-06 2021-02-05 물리적 아이템에 대한 증강 현실 장면을 생성하기 위한 시스템 및 방법

Country Status (9)

Country Link
US (2) US11676200B2 (https=)
EP (1) EP3862849A1 (https=)
JP (1) JP7495034B2 (https=)
KR (1) KR102684040B1 (https=)
CN (1) CN113222683A (https=)
AU (2) AU2021200682A1 (https=)
CA (1) CA3105792A1 (https=)
SG (1) SG10202100198PA (https=)
TW (1) TWI853140B (https=)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10838600B2 (en) 2018-02-12 2020-11-17 Wayfair Llc Systems and methods for providing an extended reality interface
US11557060B2 (en) 2018-11-05 2023-01-17 Wayfair Llc Systems and methods for scanning three-dimensional objects
US20210358294A1 (en) * 2020-05-15 2021-11-18 Microsoft Technology Licensing, Llc Holographic device control
US20240062279A1 (en) * 2020-12-31 2024-02-22 Apple Inc. Method of displaying products in a virtual environment
US11509819B2 (en) * 2021-01-19 2022-11-22 Adobe Inc. Providing contextual augmented reality photo pose guidance
JP6960714B1 (ja) * 2021-03-31 2021-11-05 功憲 末次 表示システム
US12327277B2 (en) * 2021-04-12 2025-06-10 Snap Inc. Home based augmented reality shopping
US12380490B2 (en) * 2021-04-20 2025-08-05 Walmart Apollo, Llc Systems and methods for personalized shopping
US12026763B2 (en) * 2021-05-14 2024-07-02 Inter Ikea Systems B.V. Augmented reality conversion system
US11790558B1 (en) * 2021-06-30 2023-10-17 Amazon Technologies, Inc. Generation of synthetic image data with varied attributes
US11699269B2 (en) * 2021-08-25 2023-07-11 Bank Of America Corporation User interface with augmented work environments
CN113962513A (zh) * 2021-09-08 2022-01-21 昆明埃舍尔科技有限公司 一种基于物联网和ar/mr的产品包装实现方法及装置
CN113836448B (zh) 2021-09-22 2023-10-20 抖音视界有限公司 一种信息展示方法、装置、计算机设备及存储介质
US20230093331A1 (en) * 2021-09-23 2023-03-23 International Business Machines Corporation Shopper-based commerce driven presentation of required-but-missing product related information
US11928783B2 (en) 2021-12-30 2024-03-12 Snap Inc. AR position and orientation along a plane
US12412205B2 (en) 2021-12-30 2025-09-09 Snap Inc. Method, system, and medium for augmented reality product recommendations
US12499626B2 (en) 2021-12-30 2025-12-16 Snap Inc. AR item placement in a video
US20230230152A1 (en) * 2022-01-14 2023-07-20 Shopify Inc. Systems and methods for generating customized augmented reality video
US20230297953A1 (en) * 2022-02-12 2023-09-21 Stan Koch & Sons Trucking, Inc. Devices, systems, and methods for freight logistics and asset management
US20230306689A1 (en) * 2022-03-25 2023-09-28 At&T Intellectual Property I, L.P. Aligning metaverse activities with multiple physical environments
WO2023196395A1 (en) * 2022-04-05 2023-10-12 Wayfair Llc Real-time visualization of a virtual scene controllable through physical objects
US20230341990A1 (en) * 2022-04-20 2023-10-26 Htc Corporation Visual content generating method, host, and computer readable storage medium
CN114742622B (zh) * 2022-04-26 2026-01-30 杭州阿里巴巴海外互联网产业有限公司 订单处理方法、装置、设备和存储介质
US12189915B2 (en) 2022-06-24 2025-01-07 Lowe's Companies, Inc. Simulated environment for presenting virtual objects and virtual resets
US12211161B2 (en) 2022-06-24 2025-01-28 Lowe's Companies, Inc. Reset modeling based on reset and object properties
US12002176B2 (en) 2022-08-03 2024-06-04 Eqpme Inc. Systems and methods for dynamic interaction with an augmented reality environment
US11688149B1 (en) * 2022-08-03 2023-06-27 Eqpme Inc. Systems and methods for dynamic interaction with an augmented reality environment
US12346948B2 (en) 2022-08-05 2025-07-01 Shopify Inc. Systems and methods for modeling real-world objects in virtual scenes
US12322006B2 (en) 2022-08-15 2025-06-03 Disney Enterprises, Inc. Augmented reality enhancement of moving images
US12423924B2 (en) * 2022-09-09 2025-09-23 Shopify Inc. Methods for calibrating augmented reality scenes
US12141929B1 (en) * 2022-12-15 2024-11-12 Amazon Technologies, Inc. Augmented reality furniture layout recommendation
US12430856B2 (en) 2022-12-16 2025-09-30 Lowe's Companies, Inc. Compact augmented reality view experience
KR102712944B1 (ko) * 2023-09-22 2024-10-07 쿠팡 주식회사 상품과 관련된 3차원 가상 오브젝트를 제공하기 위한 전자 장치 및 그의 동작 방법
TWI895000B (zh) * 2024-06-07 2025-08-21 英業達股份有限公司 建立擴增實境的系統及方法與擴增實境的定位引導方法
CN119358581B (zh) * 2024-12-24 2025-05-02 中国电建集团西北勘测设计研究院有限公司 应用于海上光伏项目的物料跟踪方法及装置、设备和产品

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080071559A1 (en) 2006-09-19 2008-03-20 Juha Arrasvuori Augmented reality assisted shopping
US20130293530A1 (en) 2012-05-04 2013-11-07 Kathryn Stone Perez Product augmentation and advertising in see through displays
US20170262154A1 (en) 2013-06-07 2017-09-14 Sony Interactive Entertainment Inc. Systems and methods for providing user tagging of content within a virtual scene
US20210120113A1 (en) 2018-05-29 2021-04-22 Lg Electronics Inc. Mobile terminal

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020010734A1 (en) * 2000-02-03 2002-01-24 Ebersole John Franklin Internetworked augmented reality system and method
US20120120113A1 (en) 2010-11-15 2012-05-17 Eduardo Hueso Method and apparatus for visualizing 2D product images integrated in a real-world environment
US9449342B2 (en) 2011-10-27 2016-09-20 Ebay Inc. System and method for visualization of items in an environment using augmented reality
US9355470B2 (en) * 2011-11-30 2016-05-31 The Board Of Trustees Of The Leland Stanford Junior University Method and system for interactive layout
US20140278274A1 (en) * 2012-07-24 2014-09-18 Stanley J. Osher Automatic optimization of scene configuration
JP2015099545A (ja) 2013-11-20 2015-05-28 株式会社東芝 画像生成システム及び画像生成プログラム
US10467796B2 (en) * 2017-04-17 2019-11-05 Intel Corporation Graphics system with additional context
US11803664B2 (en) * 2018-10-09 2023-10-31 Ebay Inc. Distributed application architectures using blockchain and distributed file systems
US10963952B2 (en) * 2018-12-03 2021-03-30 Sap Se Augmented reality-based real estate property analysis

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080071559A1 (en) 2006-09-19 2008-03-20 Juha Arrasvuori Augmented reality assisted shopping
US20130293530A1 (en) 2012-05-04 2013-11-07 Kathryn Stone Perez Product augmentation and advertising in see through displays
US20170262154A1 (en) 2013-06-07 2017-09-14 Sony Interactive Entertainment Inc. Systems and methods for providing user tagging of content within a virtual scene
US20210120113A1 (en) 2018-05-29 2021-04-22 Lg Electronics Inc. Mobile terminal

Also Published As

Publication number Publication date
KR20210100555A (ko) 2021-08-17
US20210248669A1 (en) 2021-08-12
US11676200B2 (en) 2023-06-13
CA3105792A1 (en) 2021-08-06
CN113222683A (zh) 2021-08-06
EP3862849A1 (en) 2021-08-11
TW202135010A (zh) 2021-09-16
AU2025259871A1 (en) 2025-11-20
JP7495034B2 (ja) 2024-06-04
JP2021125258A (ja) 2021-08-30
SG10202100198PA (en) 2021-09-29
AU2021200682A1 (en) 2021-08-26
TWI853140B (zh) 2024-08-21
US20230260013A1 (en) 2023-08-17

Similar Documents

Publication Publication Date Title
KR102684040B1 (ko) 물리적 아이템에 대한 증강 현실 장면을 생성하기 위한 시스템 및 방법
US11908159B2 (en) Systems and methods for representing user interactions in multi-user augmented reality
US11494153B2 (en) Systems and methods for modifying multi-user augmented reality
US11847716B2 (en) Systems and methods for generating multi-user augmented reality content
US11593870B2 (en) Systems and methods for determining positions for three-dimensional models relative to spatial features
CN113538085A (zh) 用于店内产品推荐的计算机实现的系统和方法
US12086859B2 (en) Systems and methods for recommending a product based on an image of a scene
CA3170178C (en) Systems and methods for training and using a machine learning model for matching objects
US12488384B2 (en) Build and update a virtual store based on a physical store
US20260080461A1 (en) Systems and methods for generating customized augmented reality video
US12198286B2 (en) Systems and methods for providing augmented media
US20220383397A1 (en) Customize a virtual store based on buyer preferences and movement
US20240087267A1 (en) Systems and methods for editing content items in augmented reality
US20240029279A1 (en) Systems and methods for generating augmented reality scenes
US20230377027A1 (en) Systems and methods for generating augmented reality within a subspace

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20210205

PG1501 Laying open of application
A201 Request for examination
A302 Request for accelerated examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20231108

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20210205

Comment text: Patent Application

PA0302 Request for accelerated examination

Patent event date: 20231108

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

Patent event date: 20210205

Patent event code: PA03021R01I

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20240125

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20240531

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20240708

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20240708

End annual number: 3

Start annual number: 1

PG1601 Publication of registration