CA3128767A1 - Systems and methods for generating augmented reality content based on distorted three-dimensional models - Google Patents

Systems and methods for generating augmented reality content based on distorted three-dimensional models Download PDF

Info

Publication number
CA3128767A1
CA3128767A1 CA3128767A CA3128767A CA3128767A1 CA 3128767 A1 CA3128767 A1 CA 3128767A1 CA 3128767 A CA3128767 A CA 3128767A CA 3128767 A CA3128767 A CA 3128767A CA 3128767 A1 CA3128767 A1 CA 3128767A1
Authority
CA
Canada
Prior art keywords
real
item
model
content
points
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3128767A
Other languages
English (en)
French (fr)
Inventor
Juho Mikko Haapoja
Byron Leonel Delgado
Stephan LEROUX
Daniel Beauchamp
Maas Mansoor Ali Lalani
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shopify Inc
Original Assignee
Shopify Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shopify Inc filed Critical Shopify Inc
Publication of CA3128767A1 publication Critical patent/CA3128767A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/16—Cloth
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Processing Or Creating Images (AREA)
CA3128767A 2020-09-23 2021-08-23 Systems and methods for generating augmented reality content based on distorted three-dimensional models Pending CA3128767A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US17/029,463 US11398079B2 (en) 2020-09-23 2020-09-23 Systems and methods for generating augmented reality content based on distorted three-dimensional models
US17/029463 2020-09-23
EP21174376.0 2021-05-18
EP21174376.0A EP3975131A1 (en) 2020-09-23 2021-05-18 Systems and methods for generating augmented reality content based on distorted three-dimensional models

Publications (1)

Publication Number Publication Date
CA3128767A1 true CA3128767A1 (en) 2022-03-23

Family

ID=75977669

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3128767A Pending CA3128767A1 (en) 2020-09-23 2021-08-23 Systems and methods for generating augmented reality content based on distorted three-dimensional models

Country Status (7)

Country Link
US (4) US11398079B2 (https=)
EP (1) EP3975131A1 (https=)
JP (1) JP2022052750A (https=)
CN (1) CN114299264A (https=)
AU (2) AU2021221868B2 (https=)
CA (1) CA3128767A1 (https=)
TW (1) TWI861432B (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12093995B1 (en) 2023-10-13 2024-09-17 Target Brands, Inc. Card ecosystem guest interface in virtual reality retail environments

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11360733B2 (en) 2020-09-10 2022-06-14 Snap Inc. Colocated shared augmented reality without shared backend
US11398079B2 (en) * 2020-09-23 2022-07-26 Shopify Inc. Systems and methods for generating augmented reality content based on distorted three-dimensional models
US12026763B2 (en) * 2021-05-14 2024-07-02 Inter Ikea Systems B.V. Augmented reality conversion system
US12229977B2 (en) * 2021-05-18 2025-02-18 Snap Inc. Augmented reality guided depth estimation
EP4405903A1 (en) * 2021-09-24 2024-07-31 Dolby Laboratories Licensing Corporation Selfie volumetric video
US12266068B2 (en) * 2022-06-14 2025-04-01 Shopify Inc. System and method for updating electronic content by selectively replacing virtual 3D objects
US12284698B2 (en) 2022-07-20 2025-04-22 Snap Inc. Secure peer-to-peer connections between mobile devices
US12472435B2 (en) 2022-08-12 2025-11-18 Snap Inc. External controller for an eyewear device
US12236512B2 (en) 2022-08-23 2025-02-25 Snap Inc. Avatar call on an eyewear device
US20250046017A1 (en) * 2022-08-25 2025-02-06 Nec Corporation Virtual try-on system, virtual try-on method, and recording medium
US12051163B2 (en) 2022-08-25 2024-07-30 Snap Inc. External computer vision for an eyewear device
US12229901B2 (en) * 2022-10-05 2025-02-18 Snap Inc. External screen streaming for an eyewear device
US12540820B2 (en) 2022-10-21 2026-02-03 Rtx Bbn Technologies, Inc. Pose-driven position and navigation
US12417560B2 (en) * 2023-01-20 2025-09-16 Shopify Inc. Systems and methods for overlay of virtual object on proxy object and concealment of proxy object
CN117409160B (zh) * 2023-10-31 2025-07-08 神力视界(深圳)文化科技有限公司 三维建筑模型的生成方法、装置、设备及存储介质
US20250182084A1 (en) * 2023-12-05 2025-06-05 Capital One Services, Llc Augmented reality data capture aid
US20250191308A1 (en) * 2023-12-12 2025-06-12 Sap Se Transition of physical process artifacts for mixed realty interactions
US20250272932A1 (en) * 2024-02-28 2025-08-28 Adeia Guides Inc. Systems and methods for generating overlays of 3d models in 2d content items

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000187683A (ja) 1998-03-11 2000-07-04 Toray Ind Inc 衣料・服飾品の製造方法および衣料・服飾品の製造支援装置
JP4216537B2 (ja) * 2002-08-02 2009-01-28 デジタルファッション株式会社 画像処理装置、画像処理方法、画像処理プログラム及びそのプログラムを記録した記録媒体
JP5210102B2 (ja) * 2008-09-22 2013-06-12 セーレン株式会社 仮想試着装置
GB201102794D0 (en) * 2011-02-17 2011-03-30 Metail Ltd Online retail system
CN102156810A (zh) * 2011-03-30 2011-08-17 北京触角科技有限公司 增强现实实时虚拟试衣系统及方法
JP5786463B2 (ja) * 2011-06-01 2015-09-30 ソニー株式会社 画像処理装置、画像処理方法、およびプログラム
US10607411B1 (en) * 2011-07-15 2020-03-31 Kevin Pezzino Specialized garments for augmented reality and method
JP2013101526A (ja) * 2011-11-09 2013-05-23 Sony Corp 情報処理装置、表示制御方法、およびプログラム
CN109598798B (zh) * 2012-12-14 2023-11-28 韩国电子通信研究院 虚拟物拟合方法及虚拟物拟合服务系统
US9389315B2 (en) * 2012-12-19 2016-07-12 Basf Se Detector comprising a transversal optical sensor for detecting a transversal position of a light beam from an object and a longitudinal optical sensor sensing a beam cross-section of the light beam in a sensor region
US10283162B2 (en) 2014-02-05 2019-05-07 Avatar Merger Sub II, LLC Method for triggering events in a video
JP5605885B1 (ja) * 2014-02-27 2014-10-15 木下 泰男 仮想試着システムおよび仮想試着プログラム
KR101586010B1 (ko) * 2014-04-28 2016-01-15 (주)에프엑스기어 증강 현실 기반 가상 피팅을 위한 의상의 물리적 시뮬레이션 장치 및 방법
AU2015274283B2 (en) * 2014-06-14 2020-09-10 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
JP2016004564A (ja) * 2014-06-19 2016-01-12 大日本印刷株式会社 拡張現実を利用した試着支援システム
US20160133230A1 (en) * 2014-11-11 2016-05-12 Bent Image Lab, Llc Real-time shared augmented reality experience
US10475113B2 (en) * 2014-12-23 2019-11-12 Ebay Inc. Method system and medium for generating virtual contexts from three dimensional models
US20180276882A1 (en) * 2015-01-12 2018-09-27 Pcms Holdings, Inc. Systems and methods for augmented reality art creation
US9779512B2 (en) * 2015-01-29 2017-10-03 Microsoft Technology Licensing, Llc Automatic generation of virtual materials from real-world materials
JP6302132B2 (ja) 2015-03-20 2018-03-28 株式会社東芝 画像処理装置、画像処理システム、画像処理方法及びプログラム
TW201710871A (zh) * 2015-05-28 2017-03-16 少虹 陳 圖形處理數據，特別是通過網格比較處理數據
EP3115971B1 (en) * 2015-06-02 2020-06-03 Samsung Electronics Co., Ltd. Method and apparatus for providing three-dimensional data of cloth
US10430867B2 (en) * 2015-08-07 2019-10-01 SelfieStyler, Inc. Virtual garment carousel
US9905019B2 (en) * 2015-08-07 2018-02-27 Selfiestyler Inc. Virtual apparel fitting systems and methods
GB2543893A (en) 2015-08-14 2017-05-03 Metail Ltd Methods of generating personalized 3D head models or 3D body models
US10176636B1 (en) * 2015-12-11 2019-01-08 A9.Com, Inc. Augmented reality fashion
WO2017203262A2 (en) * 2016-05-25 2017-11-30 Metail Limited Method and system for predicting garment attributes using deep learning
US10573091B2 (en) * 2017-02-22 2020-02-25 Andre R. Vincelette Systems and methods to create a virtual object or avatar
GB201703129D0 (en) * 2017-02-27 2017-04-12 Metail Ltd Quibbler
US20200349758A1 (en) * 2017-05-31 2020-11-05 Ethan Bryce Paulson Method and System for the 3D Design and Calibration of 2D Substrates
US20190088033A1 (en) * 2017-09-20 2019-03-21 Sudhakar Kuchibotla System and method of digitally overlaying clothing on an image of a user
CN116385505A (zh) * 2017-10-20 2023-07-04 阿里巴巴集团控股有限公司 数据处理方法、装置、系统和存储介质
US10339597B1 (en) * 2018-04-09 2019-07-02 Eric Blossey Systems and methods for virtual body measurements and modeling apparel
US10198871B1 (en) 2018-04-27 2019-02-05 Nicholas T. Hariton Systems and methods for generating and facilitating access to a personalized augmented rendering of a user
GB2583687B (en) * 2018-09-12 2022-07-20 Sony Interactive Entertainment Inc Method and system for generating a 3D reconstruction of a human
US11915380B2 (en) * 2018-10-19 2024-02-27 Perfitly, Llc. Method for animating clothes fitting
WO2020131518A1 (en) * 2018-12-19 2020-06-25 Seddi, Inc. Learning-based animation of clothing for virtual try-on
US20220198780A1 (en) * 2019-04-05 2022-06-23 Sony Group Corporation Information processing apparatus, information processing method, and program
CN110363867B (zh) * 2019-07-16 2022-11-29 芋头科技（杭州）有限公司 虚拟装扮系统、方法、设备及介质
US20210097758A1 (en) * 2019-09-26 2021-04-01 Ulsee Inc. 3D Garment Fitting Method
US11080817B2 (en) * 2019-11-04 2021-08-03 Adobe Inc. Cloth warping using multi-scale patch adversarial loss
US20210279967A1 (en) * 2020-03-06 2021-09-09 Apple Inc. Object centric scanning
US11398079B2 (en) 2020-09-23 2022-07-26 Shopify Inc. Systems and methods for generating augmented reality content based on distorted three-dimensional models

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12093995B1 (en) 2023-10-13 2024-09-17 Target Brands, Inc. Card ecosystem guest interface in virtual reality retail environments

Also Published As

Publication number Publication date
AU2021221868B2 (en) 2025-06-26
EP3975131A1 (en) 2022-03-30
JP2022052750A (ja) 2022-04-04
US20220319133A1 (en) 2022-10-06
TW202219904A (zh) 2022-05-16
AU2025203755A1 (en) 2025-06-12
US11398079B2 (en) 2022-07-26
AU2021221868A1 (en) 2022-04-07
US20240071015A1 (en) 2024-02-29
US11836877B2 (en) 2023-12-05
CN114299264A (zh) 2022-04-08
US20220092857A1 (en) 2022-03-24
US20250265793A1 (en) 2025-08-21
US12322055B2 (en) 2025-06-03
TWI861432B (zh) 2024-11-11

Similar Documents

Publication Publication Date Title
US12322055B2 (en) Systems and methods for generating augmented reality content based on distorted three-dimensional models
CA3131389C (en) Augmented reality-assisted methods and apparatus for assessing fit of physical objects in three-dimensional bounded spaces
US20230260013A1 (en) Systems and methods for generating augmented reality scenes for physical items
CA3117878C (en) SYSTEMS AND METHODS FOR REPRESENTING USER INTERACTIONS IN A MULTI-USER AUGMENTED REALITY
US11494153B2 (en) Systems and methods for modifying multi-user augmented reality
US11527045B2 (en) Systems and methods for generating multi-user augmented reality content
CA3096836C (en) Systems and methods for measuring body size
US12423924B2 (en) Methods for calibrating augmented reality scenes

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20220909

MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 3RD ANNIV.) - STANDARD

Year of fee payment: 3

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20240812

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20240812

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20240812

D15 Examination report completed

Free format text: ST27 STATUS EVENT CODE: A-2-2-D10-D15-D126 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: EXAMINER'S REPORT

Effective date: 20250120

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-P100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT RECEIVED - RESPONSE TO EXAMINER'S REQUISITION

Effective date: 20250513

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20250514

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-P102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT DETERMINED COMPLIANT

Effective date: 20250722

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P13-X000 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: APPLICATION AMENDED

Effective date: 20250722

MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 4TH ANNIV.) - STANDARD

Year of fee payment: 4

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250811

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20250902

D22 Grant of ip right intended

Free format text: ST27 STATUS EVENT CODE: A-2-2-D10-D22-D128 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: ALLOWANCE REQUIREMENTS DETERMINED COMPLIANT

Effective date: 20260223

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20260224