WO2022162444A1 - Virtual interface method for the purchase of products - Google Patents

Virtual interface method for the purchase of products Download PDF

Info

Publication number
WO2022162444A1
WO2022162444A1 PCT/IB2021/056847 IB2021056847W WO2022162444A1 WO 2022162444 A1 WO2022162444 A1 WO 2022162444A1 IB 2021056847 W IB2021056847 W IB 2021056847W WO 2022162444 A1 WO2022162444 A1 WO 2022162444A1
Authority
WO
WIPO (PCT)
Prior art keywords
display area
products
product
digital reconstruction
image
Prior art date
Application number
PCT/IB2021/056847
Other languages
English (en)
French (fr)
Inventor
Michele LORENZINI
Alessandro BOSCHIERO
Original Assignee
Sentric S.R.L.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sentric S.R.L. filed Critical Sentric S.R.L.
Publication of WO2022162444A1 publication Critical patent/WO2022162444A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Definitions

  • the present invention relates to a virtual interface method for the purchase of products.
  • these methods provide for the digital reconstruction of the products on sale and of the display area of those products, such as a store or a supermarket, which can be virtually explored by one or more users by means of appropriate interface devices.
  • users are able to explore the virtual environment in first person and interact with its contents, in the present case with the virtual replication of the products on sale.
  • the main aim of the present invention is to devise a virtual interface method for the purchase of products which allows the environments and products of a real business to be digitally replicated quickly and easily.
  • Another object of the present invention is to devise a virtual interface method for the purchase of products which allows for a virtual representation of a display area that substantially mirrors in real time the state of the real display area.
  • Another object of the present invention is to devise a virtual interface method for the purchase of products, which allows overcoming the aforementioned drawbacks of the prior art within a simple, rational, easy and effective to use as well as affordable solution.
  • Figure 1 is a schematic axonometric view of the acquisition, attribution and reconstruction phases of the method according to the invention
  • Figure 2 is a schematic axonometric view of the interaction phase of the method according to the invention.
  • Figure 3 is a schematic axonometric view of the tracing phase of the method according to the invention.
  • reference numeral 12 globally indicates a virtual interface system for the purchase of products.
  • the virtual interface method for the purchase of products comprises at least the phases of: acquiring images of at least one display area 2 and of at least one plurality of products 1 displayed for sale in the display area 2; attribution to the image of each product 1 of at least one position datum defining the position of the same product inside the display area 2; digital reconstruction of the display area 2 and of the products 1 displayed in the display area 2 depending on the acquired images and/or the position data; virtual interaction of at least one user with the digital reconstruction 8a, 8b of the display area 2 and of the products 1 for the inspection and/or the purchase of at least one of the latter.
  • displayed products means any type of products exposed to the view of one or more possible observers, e.g. as shown in Figure 1 where a plurality of products 1 are on display on appropriate shelving.
  • the acquisition phase comprises a step of continuously exposure of at least one of either the display area 2 or the products 1 to image acquisition means 3 configured to continuously acquire images of at least one of either the display area 2 or the products 1 when the step of exposure is carried out.
  • the step of exposure comprises framing in motion at least one of either the display area 2 or the products 1 through the acquisition means 3, used e.g. by a skilled operator and/or a motorized automatic driving vehicle or the like.
  • the step of exposure comprises simultaneously framing the display area 2 and the products 1 contained in the same environment, e.g. on display by means of suitable display means such as shelving or the like.
  • the attribution phase comprises attributing to the image of each product 1 at least one characteristic datum of the product 1 itself.
  • the characteristic datum is selected from the list comprising the trademark, the product category, a descriptive text and a representation of the product 1.
  • the attribution phase comprises attributing to the image of each product 1 a plurality of characteristic data (even of the same type) of the product 1 itself.
  • the phase of digital reconstruction of the display area 2 and of the products 1 on display in the display area 2 is also carried out according to the characteristic data.
  • phase of attribution provides for the attribution to each recognized image at least one of either the position datum or the at least one characteristic datum of the product 1 represented by the image itself.
  • each stored digital image is logically attributed at least one identification datum of the product 1 represented in such an image.
  • the recognized acquired images are attributed the characteristic datum of the corresponding product 1 on display in the display area 2.
  • the phase of attribution provides for the logical attribution to each recognized image the position datum and at least one characteristic datum of the respective product 1.
  • logical attribution relates to a digital link between data, such as e.g. between an image and information relating to the image itself, so that one or more pieces of information/data are automatically accessible starting from an individual datum, in this case an image.
  • the phase of virtual interaction comprises at least one of either: a step of movement inside the digital reconstruction 8b of the display area 2; a step of inspection of at least one digital reconstruction 8a of a product 1 ; a step of viewing of at least one of either the position datum or the at least one characteristic datum of at least one digital reconstruction 8b of a product 1.
  • the phase of virtual interaction allows one or more users to interact with the digital reconstruction 8a of the display area 2 and of the products 1, thus simulating the shopping experience.
  • the method comprises at least one phase of tracing at least one digital reconstruction 8b of a product 1, comprising: at least one step of indicating the at least one characteristic datum of a digital reconstruction 8b of at least one product 1 to be traced; at least one step of viewing the at least one digital graphical indication 11 inside the digital reconstruction 8a of the area 2, the graphical indication 11 guiding at least one user to the digital reconstruction 8b of the searched product 1 depending on its position datum and on its indicated characteristic datum.
  • the method comprises at least the phases of: detection of the removal of at least one product 1 from the display area and/or the placement of at least one product 1 in the display area 2; updating the digital reconstruction 8a, 8b of the display area 2 and of the products 1, the updating phase reproducing or deleting from the digital reconstruction 8a of the display area 2 the digital reconstruction 8b of the product 1 placed or removed from the display area 2.
  • the phase of digital reconstruction is of the type of a 3D digital reconstruction phase.
  • phase of virtual interaction is of the type of a 3D virtual interaction.
  • the present invention also relates to a virtual interface system 12 for the purchase of products for the implementation of the related method for the purchase of products as described above.
  • the virtual interface system 12 for the purchase of products comprises: image acquisition means 3 of at least one display area 2 and of at least one plurality of products 1 displayed for sale in the display area 2; attribution means 6 to the image of each product 1 of at least one position datum defining the position of the same inside the display area 2; digital reconstruction means 9 of the display area 2 and of the products 1 displayed in the display area 2 depending on the acquired images and/or the position data; interface means 7 of at least one user to the digital reconstruction 8a, 8b of the display area 2 and of the products 1 for the inspection and/or the purchase of at least one of the latter.
  • the acquisition means 3 are configured to carry out the phase of acquisition.
  • the acquisition means 3 are configured to continuously frame the display area 2 and the products 1, by acquiring the images thereof.
  • the acquisition means 3 are of the type of an electronic image acquisition device, such as e.g. a PC, smart-phone, tablet, camera, video camera, and the like.
  • the attribution means 6 are configured to carry out the phase of attribution.
  • the attribution means 6 are configured to logically associate the image of each displayed product 1 with at least one corresponding position datum.
  • the attribution means 6 comprise identification means 5 for identifying the position of the displayed products 1 of which at least one image is acquired by the acquisition means 3, in this case of the displayed products 1 framed by the acquisition means 3.
  • the identification means 5 and the attribution means 6 coincide with the acquisition means 3.
  • identification means 5 and the attribution means 6 are separate from the acquisition means 3, e.g. of the type of electronic data processing devices, such as a PC, microcontroller, PLC or the like, operatively connected to the acquisition means 3.
  • the digital reconstruction means 9 are configured to carry out the phase of digital reconstruction.
  • the digital reconstruction means 9 are of the type of electronic computation and computing devices, such as e.g., a PC, microcontroller, PLC, or the like, configured to digitally reconstruct the display area 2 and the products 1 starting from the acquired images thereof.
  • the digital reconstruction means 9 are operationally connected to the acquisition means 3.
  • the interface means 7 are of the type of electronic interface devices of known type, such as any digital content playback device such as a PC, smartphone, tablet, or the like configured to allow a user to interact with the digital reconstruction 8a, 8b.
  • any digital content playback device such as a PC, smartphone, tablet, or the like configured to allow a user to interact with the digital reconstruction 8a, 8b.
  • the system 12 comprises: storage means 10 configured to store at least one digital reference image of each of the products 1, each such image being accompanied by at least one characteristic datum selected from the list comprising the trademark, the product category, a descriptive text and a representation of the product 1 ; image recognition means 4 of the products 1 configured to compare the acquired images with the reference images, the acquired images of the products 1 being recognized when compared with the reference images that are substantially identical to the acquired images of the products 1.
  • the storage means 10 are of the type of electronic data storage devices of known type. Furthermore, the storage means 10 preferably coincide with the image recognition means 4. Further embodiments of the system 12 cannot however be ruled out wherein the storage means are separate from the image recognition means 4.
  • the image recognition means 4 coincide with the acquisition means 3, further embodiments of the method cannot however be ruled out wherein the image recognition means 4 are, e.g., of the type of a PC, PLC, microcontroller and the like, separate from the acquisition means 3, and are operatively connected to the latter.
  • the image recognition means 4 are, e.g., of the type of a PC, PLC, microcontroller and the like, separate from the acquisition means 3, and are operatively connected to the latter.
  • the identification means 5 are configured to identify the position of each product framed by the acquisition means 3 and recognized by the step of comparison.
  • the identification means 5 are of the type of electronic tracing devices, such as e.g. GPS and the like.
  • the system 12 comprises control means 14 configured to allow at least one user to indicate the at least one characteristic datum of at least one of the products 1 to be searched.
  • the interface means 7 are configured to show the user at least one guiding indication to at least one digital reconstruction 8a of a product 1 having the same indicated characteristic datum.
  • control means 14 coincide with the interface means 7.
  • the system 12 comprises: detection means, not shown in the figures, configured to detect the removal of at least one product 1 from the display area and/or the placement of at least one product 1 in the display area 2; updating means 13 of the digital reconstruction 8a, 8b of the display area 2 and of the products 1, configured to reproduce or delete from the digital reconstruction 8a of the display area 2 the digital reconstruction 8b of the product 1 placed or removed from the display area 2.
  • the detection means are of the type of an electronic detection system of the products 1 in the display area 2, preferably such as one or more readers configured to read the inlet/outlet of a product 1 from the display area 2, such as e.g. the barcode readers of the products 1.
  • the updating means 13 coincide with the digital reconstruction means 9. Further embodiments of the system 12 cannot however be ruled out wherein the updating means 13 are separate from the digital reconstruction means 9.
  • the digital reconstruction means 9 are of the type of 3D digital reconstruction means.
  • the interface means 7 are of the type of 3D interface means comprising, e.g., at least one viewer, at least one controller, and at least one audio speaker configured to allow a user to interact with the 3D digital reconstruction 8a, 8b.
  • the phases of detection and updating allow the creation of a virtual representation of a display area which substantially reflects the state of the real display area in real time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Finance (AREA)
  • Human Computer Interaction (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Toys (AREA)
  • Processing Or Creating Images (AREA)
PCT/IB2021/056847 2021-01-27 2021-07-28 Virtual interface method for the purchase of products WO2022162444A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT102021000001610 2021-01-27
IT102021000001610A IT202100001610A1 (it) 2021-01-27 2021-01-27 Metodo di interfaccia virtuale per l’acquisto di prodotti

Publications (1)

Publication Number Publication Date
WO2022162444A1 true WO2022162444A1 (en) 2022-08-04

Family

ID=76269795

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2021/056847 WO2022162444A1 (en) 2021-01-27 2021-07-28 Virtual interface method for the purchase of products

Country Status (2)

Country Link
IT (1) IT202100001610A1 (it)
WO (1) WO2022162444A1 (it)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200401576A1 (en) * 2019-06-18 2020-12-24 Tmrw Foundation Ip & Holding S. À R.L. Interacting with real-world items and corresponding databases through a virtual twin reality

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200401576A1 (en) * 2019-06-18 2020-12-24 Tmrw Foundation Ip & Holding S. À R.L. Interacting with real-world items and corresponding databases through a virtual twin reality

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SERGIO ORTS-ESCOLANO ET AL: "Holoportation", USER INTERFACE SOFTWARE AND TECHNOLOGY, ACM, 2 PENN PLAZA, SUITE 701 NEW YORK NY 10121-0701 USA, 16 October 2016 (2016-10-16), pages 741 - 754, XP058280944, ISBN: 978-1-4503-4189-9, DOI: 10.1145/2984511.2984517 *

Also Published As

Publication number Publication date
IT202100001610A1 (it) 2022-07-27

Similar Documents

Publication Publication Date Title
JP2971381B2 (ja) マルティメディアプログラム編集方法及びマルチメディアプログラム編集システム
Martinez Criteria for defining animation: A revision of the definition of animation in the advent of digital moving images
CN110321868B (zh) 对象识别及显示的方法及系统
CN114442802A (zh) 响应于增强现实图像而显示增强现实
JP2016197342A (ja) 拡張現実プログラム、拡張現実提供方法、拡張現実提供装置、及び情報配信方法
CN103198503A (zh) 数字漫画编辑器及方法
JPWO2018173478A1 (ja) 学習装置、学習方法および学習プログラム
CN110377787A (zh) 一种视频分类方法、装置及计算机可读存储介质
CN103823877A (zh) 实物展示方法、实物展示系统及对应的图片获取装置
KR102007432B1 (ko) 3차원 콘텐츠 영상 생성 및 제공 시스템
CN111683267A (zh) 媒体信息的处理方法、系统、设备及存储介质
CN109151312A (zh) 对焦方法、装置以及视频展台
US20200026737A1 (en) Systems and methods for providing concomitant augmentation via learning interstitials for books using a publishing platform
US11227189B2 (en) Systems and methods for identifying items in a digital image
CN115601672A (zh) 一种基于深度学习的vr智能巡店方法及装置
CN111292153B (zh) 信息推荐方法、装置、系统和存储介质
CN114967914A (zh) 一种虚拟显示方法、装置、设备以及存储介质
WO2022162444A1 (en) Virtual interface method for the purchase of products
US11048975B2 (en) Systems and methods for identifying items in a digital image
CN114786032B (zh) 一种培训视频管理方法及系统
CN113743382B (zh) 一种货架陈列检测方法、装置及系统
JP2012134700A (ja) 軌跡・場所履歴データ作成装置と動画像表示装置と動画像オブジェクト探索システムと、それらの方法とプログラム
CN112784106B (zh) 内容数据的处理方法、报告数据的处理方法、计算机设备、存储介质
KR101623321B1 (ko) 디지털 포렌식에서 대용량 동영상 증거물에 대한 고속 검색 장치 및 방법
KR20230016781A (ko) 메타버스 관련 ar/vr 기술을 활용한 환경 컨텐츠 제작 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21752195

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21752195

Country of ref document: EP

Kind code of ref document: A1