WO2023187555A1

WO2023187555A1 - System and method for retail with smart glasses

Info

Publication number: WO2023187555A1
Application number: PCT/IB2023/052797
Authority: WO
Inventors: Wassim MERHEBY
Original assignee: Verofax Limited
Priority date: 2022-03-27
Filing date: 2023-03-22
Publication date: 2023-10-05

Abstract

A system and method which enables a buyer to view information about a product and/or to purchase the product through smart glasses or other visual augmentation technology, for an augmented and/or automated retail experience. The user views at least a portion of the container with a camera. Upon scanning that portion of the container, for example to scan a QR code, a web page or other user interface appears on a communication device that is in communication with the camera, such as the previously described smartphone or other mobile communication device, and/or smart glasses or other visual augmentation technology. If the user wishes to purchase the product, such a purchase may be effected through the previously described smartphone or other mobile communication device, and/or smart glasses or other visual augmentation technology.

Description

PCT APPLICATION

Title: SYSTEM AND METHOD FOR RETAIL WITH SMART GLASSES

Inventor: Wassim Merheby

FIELD OF THE INVENTION

The present invention is of a system and method for automating and augmenting the retail experience, and in particular, to such a system and method which enables a buyer to view information about a product and/or to purchase the product through smart glasses or other visual augmentation technology.

BACKGROUND OF THE INVENTION

A number of solutions have been proposed for a more streamlined retail experience for physical, “bricks and mortar” stores. For example, Amazon has set up special retail stores with technology that enables automated checkout and payment. However, such technology is difficult to implement in larger stores, and in any case, may not be suitable to retrofit existing retail stores.

Furthermore, physical retail stores also want to offer a more personalized and interesting shopping experience, given the prevalence and ease of online shopping. However, adding new technology to existing physical stores can be difficult and costly.

BRIEF SUMMARY OF THE INVENTION

The present invention overcomes the drawbacks of the background art by providing a system and method for physical store purchases of physical products which provides a streamlined retail experience, by enabling users to purchase products through obtaining an image of the product. Such a system and method further overcomes drawbacks of the background art by enabling existing physical stores to be easily retrofitted for such purchases.

The present invention, in at least some embodiments, is of a system and method which enables a buyer to view information about a product and/or to purchase the product through smart glasses or other visual augmentation technology, for an augmented and/or automated retail experience. The user views at least a portion of the container with a camera, such as for example the camera of a smartphone or other mobile communication device, and/or smart glasses or other visual augmentation technology. Upon scanning that portion of the container, for example to scan a QR code, a web page or other user interface appears on a communication device that is in communication with the camera, such as the previously described smartphone or other mobile communication device, and/or smart glasses or other visual augmentation technology. The user may then interact with the web page or other user interface, for example to receive more information about the product. If the user wishes to purchase the product, such a purchase may be effected through the previously described smartphone or other mobile communication device, and/or smart glasses or other visual augmentation technology. The user may even leave the store with the product upon receiving a confirmation of purchase, such as an exit code for example.

Optionally and preferably information about the product, including but not limited to one or more of a recorded purchase, a question about the product, a reason for rejecting the product (if the user chooses not to buy), or other information about the user-product interaction, is written to a distributed ledger technology (DLT) such as for example the blockchain.

The user interface may support an AR (augmented reality) experience for example. The product may comprise for example any consumable product in a container, including but not limited to food, beverage, medicine, cosmetics, personal care products, household care products, and other consumer products. Optionally, the product may comprise an item not in a container, including but not limited to clothing, fresh fruit and vegetables, furniture, household goods, fashion accessories, shoes and the like. If the item is not in the container, it may be identified through a NFC tag, analysis of an image containing the item, a QR code or other visual marker on the item or associated with the item, and the like.

Each product, type of product, product category or other product-related designation preferably receives a unique code. Such a code may be a QR code or other code. The code is preferably added to the product after being assigned, for example by being printed on the container for the product, added as a sticker or otherwise included with the product.

According to at least some embodiments, the code such as the QR code relates to a unique web address and to a Blockchain based repository for the container. Optionally the code is unique for each individual container, and/or each type of container and so forth. Optionally the blockchain based repository stores a record of one or more data items related to that container, such as for example purchase by a user; inventory ownership by supply chain stakeholder based on validated receipts; certificates that are validated and signed by a trusted party, including but not limited to the manufacturer, a quality assurance body and/or the issuer of certificate; and/or optionally differing content to be shared with each stakeholder based on customized role interactions UI/UX.

The data is preferably stored in public access containers and private access containers, requiring credentials based on role access from the owner of the product that is allowed to grant access (as a non-limiting example, the manufacturer or brand owner).

According to at least some embodiments, there is provided a system and method for supporting an automation solution for a retail store with the application of smart serialization, computer vision, and a web application. Without wishing to be limited by a closed list, such an automation solution may optimize the checkout process, lower freshness cost, and reduce the cost and complexity of replenishment management. Every item available for purchase, described herein also as a “product” or “container”, is preferably serialized on the platform and each item will have a unique identifier generated on the product in the form of a code, such a QR code or an NFC tag. Every serialized item preferably has a unique web address. Product Information is accessed as public and private data fields defined based on the access user has for each item.

The application interface through a device such as a smartphone or smart glasses helps the user to visualize the products. Smart glasses can work even in average brightness, ensuring a vivid and sharp visual display in different lighting conditions. Smart glasses are an assisted reality device that fits onto specially designed frames and uses a micro projector to overlay various kinds of information directly in front of the eyes of the user.

Users can scan the code with smart glasses, which preferably then automatically recognizes the product. The smart glasses may provide different options to the users on the micro projector screen such as learning more about the product, checking for product composition or ingredient list, understanding how to use the product, and then optionally adding it to a cart and completing the checkout process seamlessly. Smart glasses preferably support four different user interactions through touch, voice, head movement, and hand motion, allowing users to have faster and easier access to the information they need. This technology reduces the time customers spend waiting in line at the counter to checkout. As described herein, optionally such smart glasses may be replaced and/or supported by another type of visualization technology, including but not limited to a smartphone or other mobile device, preferably one with a camera.

The system as described herein is preferably able recognize the QR code printed on the container during bulk purchases or when the user is buying more than one of same product. Such recognition may occur through a user app on a smartphone or other mobile device, and/or through smart glasses or other visualization devices, and/or through analysis at a remote server.

When a user is purchasing any product, by viewing the QR code on the product the user can avail himself of any of the user interaction methods mentioned above. When purchasing more than one product, instead of scanning every item separately, an associated app may suggest having the user place the products in stack / position them in such a way, such that the smart glass can scan the QR codes, convert the images into text and recognize all the different QR codes in at once. If any carton or pallet is added to the cart, the application is preferably able to recognize the total number of products that are in the carton and shows to the user. Once products are added to the cart, users are preferably able to validate the product and remove any product that is not required.

Cameras in store are preferably integrated with computer vision to monitor and track the behaviors of each user and validate their purchase. Weight sensors on shelves preferably detect if a user is selecting more of a product or a heavier product than what has been added to the online purchase card. Both computer vision and weight sensors may trigger an alert in case of any issues detected, after which the application preferably guides the user to go to a physical checkout counter. All the alert and notifications are preferably displayed on the micro projector screen of smart glasses or alternatively on a smartphone or other mobile device.

The retailer and the user (customer) optionally and preferably each have a wallet which is used to pay for the items purchased. Every retailer has a wallet which contains the items in store. The user (consumer) also preferably has a wallet and the items purchased by him are added to the wallet where they can complete the payment processing. Once the payment is successful, transfer of ownership of the goods is done from retailer to customer and user receives some type of proof purchase, such as an invoice QR code generated in the platform. The invoice code preferably has at least the following information: items purchased, status of payment and the confirmation code or alert code from the computer vision API integrated in cameras and the sensors on the shelf of retail store, sensors are under the shelf, and it is calculating the weight currently on the shelf and after user has picked up an item and in real time how much was paid for it, the sensor data is constantly sent to retail store backend for validating the purchase The output code from computer vision API will be True or False. The code is True, when the User has exactly picked the items from shelf which he added in the application cart; the items in both Trolley and Application cart are same. If the payment code is identified as false, such that the user has not in fact paid, the user is instructed to go to physical checkout counter to verify the items and check out.

The invoice is sent to the user, for example through their registered email id with Walkthrough QR code which is preferably scanned in the exit gate. The integration with Retailer backend system will verify the code, validate the inventory, and then open the Gate for users to exit the store. In case of any discrepancy, Application guides the customer to go to physical checkout counter for staff to help them and complete the checkout process. Reconciliation of inventory is made easier with a unique item identifier to detect consumer pilferage. It also helps retailers by effective inventory management, increased shopper’s insights by providing customized shopping experiences, lowering the freshness cost, improve their overall merchandising and ranging of the products based on granular analytics they get from the platform.

The application may also allow the user to continue shopping even after the order is completed. If the user has completed the purchase and he/she is still inside the retailer store, the user can continue to do the shopping and the invoice will be updated with the new set of items purchased. The above scenario may be applicable only if the user is still in the retailer store and does not exit the gate. If the user has exited the gate but still wants to purchase more items, it is preferably considered as a new order.

According to at least some embodiments, the system as described herein uses Blockchain technology for product serialization and the transactional data is stored on an immutable blockchain ledger. This provides a secure environment to avoid any fraud during purchase. Each product added to the platform is stored in a blockchain. As a database, blockchain stores information electronically in a digital format. Without wishing to be limited by a closed list, one advantage of blockchain is to allow digital information to be recorded and distributed, but not edited. In this way, blockchain is the foundation for immutable ledgers, or records of transactions that cannot be altered, deleted, or destroyed. Computer vision enables the system to derive information from digital images captured during scanning and take required actions based on that information.

According to at least some embodiments, there is provided a system for automated purchase of a physical product from a retail store, comprising a user computational device for obtaining an image of the physical product contained within the retail store; a server for receiving said image from said user computational device; and a security system in the retail store for securing said physical product against unauthorized removal from the store; each of said server and said user computational device comprising a memory for storing instructions and a processor for executing said instructions; upon execution of instructions by said processor in said user computational device to request a purchase of said physical product, and authorization of said purchase by execution of instructions by said processor in said server, said security system permits removal of said product from the retail store.

Optionally, said processor of said server executes instructions to: identify said container according to an analysis of said image; receive a payment request from said user computational device; and determine whether said payment request is completed, and if so, notifying said security system. Optionally, said user computational device comprises a mobile telephone, said mobile telephone comprising a camera and a mobile app, and said camera of said mobile telephone scans said physical product to obtain said image, such that said mobile app transmits said image to said server. Optionally, said mobile app is in communication with a payment modality and said payment request is performed through said payment modality. Optionally, said user computational device comprises smart glasses, said smart glasses comprising a camera, said camera of said smart glasses scans said physical product to obtain said image. Optionally, said user computational device further comprises said mobile telephone and said image from said smart glasses is sent through said mobile telephone. Optionally, said smart glasses further comprise a communication module and said smart glasses communicate directly with said server. Optionally, said image comprises a code and said server determines that said physical product has been purchased according to said code. Optionally, said code comprises a QR code or an NFC tag.

Optionally, the retail store comprises a secured exit and said security system permits removal of an authorized purchase through said security exit. Optionally, said security system further comprises a security system computational device, a computer vision system and a shelf weight sensor, said security system computational device comprises a memory for storing instructions and a processor for executing said instructions; said computer vision system comprises a plurality of cameras for obtaining images within the retail store in regard to customer behavior and activity; said processor of said security system computational device analyzes video data from said computer vision system and product weight data from said shelf weight sensor to determine if a physical product to be purchased has been correctly selected for purchase through said user computational device. Optionally a user selects a plurality of products and said computer vision system detects said plurality of products and determines whether said plurality of physical products to be purchased has been correctly selected for purchase through said user computational device.

The system of claim 12, said user selects a container with multiple products and wherein said computer vision system detects said multiple products in said container, and determines whether said multiple products to be purchased have been correctly selected for purchase through said user computational device. Optionally additional information about the product is requested through said user computational device and is provided by said server according to said image. Optionally said additional information is stored through distributed ledger technology (DLT) and is read from said DLT by said server. Optionally said additional information comprises one or more of a previously recorded purchase, an answer to a question about the product and a reason for rejecting the product. Optionally said additional information is obtained by providing an image comprising an item selected from the group consisting of a code, an identifier, a product shape and a marker; and wherein said processor of said server executes instructions to cause an interface to be provided to said user computational device; wherein said processor of said user computational device executes instructions to cause a user interface to be displayed. Optionally said user interface comprises a web page, an augmented reality display or a verbal display. Optionally a user interacts with said user interface to obtain more information about said physical product. Optionally said processor of said user computational device executes instructions for displaying a user interface, and wherein a user performs actions to purchase said physical product through said user interface. Optionally said product comprises one or more of food, beverage, medicine, cosmetics, personal care products, household care products, clothing, fresh fruit and vegetables, furniture, household goods, fashion accessories, or shoes. Optionally said DLT comprises a blockchain and wherein said product is associated with a unique web address and to a blockchain based repository for said product. Optionally said product is contained in a container, and wherein a unique identifier is associated with each individual container.

Optionally said unique identifier is associated with said blockchain based repository and wherein said blockchain based repository stores a record of one or more data items related to that container, comprising or more of purchase by a user; inventory ownership by supply chain stakeholder based on validated receipts; certificates that are validated and signed by a trusted party; and content suitable for each stakeholder according to customized role interactions for said stakeholder. Optionally said trusted party comprises one or more of a manufacturer of said product, a quality assurance body for a type of said product; an issuer of certificate associated with said type of said product, or a combination thereof. Optionally said user computational device further comprises access to a wallet for purchasing said physical product, and wherein said security system computational device further comprises access to a wallet for receiving payment for said physical product. Optionally upon a successful purchase of said product, said user computational device receives a receipt, comprising a proof of purchase; and wherein said security system permits said product to be removed from the retail store upon scanning of said receipt. Optionally said receipt further comprises a list of items purchased, status of payment and a confirmation code from said security system, in regard to confirmation of said items purchased. Optionally if a user completes purchase of said product but remains within the retail store, an additional product may be purchased and included within said receipt.

Implementation of the method and system of the present invention involves performing or completing certain selected tasks or steps manually, automatically, or a combination thereof. Moreover, according to actual instrumentation and equipment of preferred embodiments of the method and system of the present invention, several selected steps could be implemented by hardware or by software on any operating system of any firmware or a combination thereof. For example, as hardware, selected steps of the invention could be implemented as a chip or a circuit. As software, selected steps of the invention could be implemented as a plurality of software instructions being executed by a computer using any suitable operating system. In any case, selected steps of the method and system of the invention could be described as being performed by a data processor, such as a computing platform for executing a plurality of instructions. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The materials, methods, and examples provided herein are illustrative only and not intended to be limiting.

An algorithm as described herein may refer to any series of functions, steps, one or more methods or one or more processes, for example for performing data analysis.

Implementation of the apparatuses, devices, methods and systems of the present disclosure involve performing or completing certain selected tasks or steps manually, automatically, or a combination thereof Specifically, several selected steps can be implemented by hardware or by software on an operating system, of a firmware, and/or a combination thereof. For example, as hardware, selected steps of at least some embodiments of the disclosure can be implemented as a chip or circuit (e.g., ASIC). As software, selected steps of at least some embodiments of the disclosure can be implemented as a number of software instructions being executed by a computer (e.g., a processor of the computer) using an operating system. In any case, selected steps of methods of at least some embodiments of the disclosure can be described as being performed by a processor, such as a computing platform for executing a plurality of instructions. The processor is configured to execute a predefined set of operations in response to receiving a corresponding instruction selected from a predefined native instruction set of codes.

Software (e.g., an application, computer instructions) which is configured to perform (or cause to be performed) certain functionality may also be referred to as a “module” for performing that functionality, and also may be referred to a “processor” for performing such functionality. Thus, processor, according to some embodiments, may be a hardware component, or, according to some embodiments, a software component.

Further to this end, in some embodiments: a processor may also be referred to as a module; in some embodiments, a processor may comprise one or more modules; in some embodiments, a module may comprise computer instructions - which can be a set of instructions, an application, software - which are operable on a computational device (e.g., a processor) to cause the computational device to conduct and/or achieve one or more specific functionality.

Some embodiments are described with regard to a "computer," a "computer network," and/or a “computer operational on a computer network.” It is noted that any device featuring a processor (which may be referred to as “data processor”; “pre-processor” may also be referred to as “processor”) and the ability to execute one or more instructions may be described as a computer, a computational device, and a processor (e.g., see above), including but not limited to a personal computer (PC), a server, a cellular telephone, an IP telephone, a smart phone, a PDA (personal digital assistant), a thin client, a mobile communication device, a smart watch, head mounted display or other wearable that is able to communicate externally, a virtual or cloud based processor, a pager, and/or a similar device. Two or more of such devices in communication with each other may be a "computer network."

BRIEF DESCRIPTION OF THE DRAWINGS

The invention is herein described, by way of example only, with reference to the accompanying drawings. With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of the preferred embodiments of the present invention only, and are presented in order to provide what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention. In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understanding of the invention, the description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice. In the drawings:

Figures 1A-1C show non-limiting, exemplary, illustrative systems for supporting augmented retail interactions for a product;

Figure 2 shows a non-limiting, exemplary, illustrative method for interacting with the system of any of Figures 1A-1C;

Figure 3 shows a non-limiting, exemplary, illustrative analysis engine for the system of any of Figures 1A-1C;

Figures 4A-4D show a non-limiting, exemplary flow for interactions with the augmented retail system as described herein;

Figure 5 shows a non-limiting, exemplary set of microservices for supporting the augmented retail system as described herein;

Figure 6 shows another non-limiting, exemplary system for supporting augmented retail interactions for a product;

Figures 7A-7I show another non-limiting, exemplary flow for interactions with the augmented retail system as described herein; and Figures 8A and 8B show yet another non-limiting, exemplary flow for interactions with the augmented retail system as described herein.

DESCRIPTION OF AT LEAST SOME EMBODIMENTS

Any suitable blockchain which involves a distributed ledger, which preferably requires some type of cryptography, more preferably a public/private key encryption system, or hash or digital signatures, may optionally be used. Once a change - such as for example tracking the state of the container and determining an updated state - is made and is written to the distributed ledger, this change is automatically securely, non-falsifiably, that is completely accurately, replicated to all network participants.

The nature of the distributed ledger is such that all parties to a transaction can see the details of the transaction and optionally further requirements for the transaction to be complete.

Such a distributed ledger would also have the advantage of fraud prevention with immutable, append-only Distributed Ledger Technology. For example, users attempting to fraudulently trade cryptocurrency units that they do not possess would be blocked.

A blockchain or blockchain is a distributed database that maintains a list of data records, the security of which is enhanced by the distributed nature of the blockchain. A blockchain typically includes several nodes, which may be one or more systems, machines, computers, databases, data stores or the like operably connected with one another. In some cases, each of the nodes or multiple nodes are maintained by different entities. A blockchain typically works without a central repository or single administrator. One well-known application of a blockchain is the public ledger of transactions for cryptocurrencies such as used in bitcoin. The data records recorded in the blockchain are enforced cryptographically and stored on the nodes of the blockchain.

A blockchain provides numerous advantages over traditional databases. A large number of nodes of a blockchain may reach a consensus regarding the validity of a transaction contained on the transaction ledger. Similarly, when multiple versions of a document or transaction exits on the ledger, multiple nodes can converge on the most up-to- date version of the transaction. For example, in the case of a virtual currency transaction, any node within the blockchain that creates a transaction can determine within a level of certainty whether the transaction can take place and become final by confirming that no conflicting transactions (i.e., the same currency unit has not already been spent) confirmed by the blockchain elsewhere.

The blockchain typically has two primary types of records. The first type is the transaction type, which consists of the actual data stored in the blockchain. The second type is the block type, which are records that confirm when and in what sequence certain transactions became recorded as part of the blockchain. Transactions are created by participants using the blockchain in its normal course of business, for example, when someone sends cryptocurrency to another person), and blocks are created by users known as "miners" who use specialized software/equipment to create blocks. Users of the blockchain create transactions that are passed around to various nodes of the blockchain. A "valid" transaction is one that can be validated based on a set of rules that are defined by the particular system implementing the blockchain. For example, in the case of cryptocurrencies, a valid transaction is one that is digitally signed, spent from a valid digital wallet and, in some cases, that meets other criteria. In some blockchain systems, miners are incentivized to create blocks by a rewards structure that offers a pre-defined per-block reward and/or fees offered within the transactions validated themselves. Thus, when a miner successfully validates a transaction on the blockchain, the miner may receive rewards and/or fees as an incentive to continue creating new blocks.

Preferably the blockchain(s) that is/are implemented are capable of running code, to facilitate the use of smart contracts. Smart contracts are computer processes that facilitate, verify and/or enforce negotiation and/or performance of a contract between parties. One fundamental purpose of smart contracts is to integrate the practice of contract law and related business practices with electronic commerce protocols between people on the Internet. Smart contracts may leverage a user interface that provides one or more parties or administrators access, which may be restricted at varying levels for different people, to the terms and logic of the contract. Smart contracts typically include logic that emulates contractual clauses that are partially or fully self-executing and/or self-enforcing. Examples of smart contracts are digital rights management (DRM) used for protecting copyrighted works, buying or selling goods, whether or virtual or physical, executing transfers of goods or of rights associated with such goods, and the like.

Smart contracts may also be described as pre-written logic (computer code), stored and replicated on a distributed storage platform (e.g. a blockchain), executed/run by a network of computers (which may be the same ones running the blockchain), which can result in ledger updates (transfer of digital rights, etc.). Smart contract infrastructure can be implemented by replicated asset registries and contract execution using cryptographic hash chains and Byzantine fault tolerant replication. For example, each node in a peer-to-peer network or blockchain distributed network may act as a title registry and escrow, thereby executing changes of ownership and implementing sets of predetermined rules that govern transactions on the network. Each node may also check the work of other nodes and in some cases, as noted above, function as miners or validators.

Not all blockchains can execute all types of smart contracts. For example, Bitcoin cannot currently execute smart contracts. Sidechains, i.e. blockchains connected to Bitcoin’s main blockchain could enable smart contract functionality: by having different blockchains running in parallel to Bitcoin, with an ability to jump value between Bitcoin’s main chain and the side chains, side chains could be used to execute logic. Smart contracts that are supported by sidechains are contemplated as being included within the blockchain enabled smart contracts that are described below.

For all of these examples, security for the blockchain may optionally and preferably be provided through cryptography, such as public/private key, hash function or digital signature, as is known in the art.

Turning now to the figures, Figures 1A-1C show non-limiting, exemplary, illustrative systems for supporting augmented retail interactions for a product.

As shown with regard to Figure 1A, a system 100A features a user computational device 102 that communicates with a server gateway 120 through a computer network 160. In this implementation, server gateway 120 supports direct reading information from, and storing information on, a blockchain network 150. Server gateway 120 communicates with a container 152, which may for example contain any suitable product, for example as described herein. Container 152 preferably features a QR code and/or other detectable information on at least a portion thereof. Such information is preferably communicable as an image to server gateway 120. Such communication may be provided through a direct communication channel and/or indirectly. Preferably, such communication is supported by user computational device 102 as described in greater detail below.

Server gateway 120 preferably analyzes such communication and then locates the price and other relevant information about container 152, whether from electronic storage 122 and/or blockchain network 150. Blockchain network 150 may be used for example store product details, including product information, attributes and transactional data. Server gateway 120 may for example read information from and write information to blockchain network 150 through a blockchain node 150A, and/or through a blockchain gateway (not shown). Server gateway 120 may also respond to user computational device 102 regarding container 152, for example to indicate the price of the product or other information about the product contained in container 152. Server gateway 120 may also support provision of a web page or other user interface for an AR (augmented reality) experience, as described for example with regard to Figures 7A-7I.

User computational device 102 optionally includes a user input device 104, the user app interface 112, and user display device 106. User input device 104 may optionally be any type of suitable input device including but not limited to a keyboard, microphone, mouse, or other pointing device and the like. Preferably user input device 104 includes a microphone and a keyboard, mouse, or keyboard mouse combination.

User computational device 102 preferably comprises a camera 114 for obtaining one or more images of at least a portion of container 152. Preferably, user computational device 102 comprises a cellular network communication hardware device, which may for example communicate through the cellular network with a SIM card to send the image or images to server gateway 120. For example, user computational device 102 may comprise or may be a smartphone or other mobile cellular device. An analysis engine 134 on server gateway 120 then analyzes the image(s) to identify the code or other information on container 152, so as to identify the product contained therein.

User computational device 102 also preferably comprises a processor 110 and a memory 111. Functions of processor 110 preferably relate to those performed by any suitable computational processor, which generally refers to a device or combination of devices having circuitry used for implementing the communication and/or logic functions of a particular system. For example, a processor may include a digital signal processor device, a microprocessor device, and various analog-to-digital converters, digital-to-analog converters, and other support circuits and/or combinations of the foregoing. Control and signal processing functions of the system are allocated between these processing devices according to their respective capabilities. The processor may further include functionality to operate one or more software programs based on computer-executable program code thereof, which may be stored in a memory, such as a memory 111 in this non-limiting example. As the phrase is used herein, the processor may be "configured to" perform a certain function in a variety of ways, including, for example, by having one or more general-purpose circuits perform the function by executing particular computer-executable program code embodied in computer- readable medium, and/or by having one or more application-specific circuits perform the function.

Also optionally, memory I l l is configured for storing a defined native instruction set of codes. Processor 110 is configured to perform a defined set of basic operations in response to receiving a corresponding basic instruction selected from the defined native instruction set of codes stored in memory 111. For example and without limitation, memory 111 may store a first set of machine codes selected from the native instruction set for receiving one or more images of at least a portion of container 152 through camera 114, preferably containing a code therein, and a second set of machine codes selected from the native instruction set for transmitting such image(s) to server gateway 120.

Similarly, server gateway 120 preferably comprises processor 130 and memory 131 with machine readable instructions with related or at least similar functions, including without limitation functions of server gateway 120 as described herein. For example and without limitation, memory 131 may store a first set of machine codes selected from the native instruction set for receiving image(s) of container 152 from user computational device 302, a second set of machine codes selected from the native instruction set for executing functions of analysis engine 134, a third set of machine codes selected from the native instruction set for transmitting information about the product contained in container 152 to user computational device 102 according to an analysis of such image(s), and a fourth set of machine codes selected from the native instruction set for storing information about a purchase or other interactions of the user with container 152 on blockchain network 150.

Preferably such interactions, optionally including a purchase by the user, are recorded on a blockchain through a blockchain network 150. Data is stored and managed using blockchain technology, as supported by blockchain network 150. Optionally, the blockchain can run code. As is known in the art, blockchains can perform more complex operations, defined in full-fledged programming languages. However, it is not a requirement for the blockchain to run code in order for the present invention to be implemented. Optionally only a distributed ledger is required, in which information is written that is securely available to all parties through cryptographic access to the distributed ledger.

According to at least some embodiments the blockchain is optionally a public or permissionless blockchain, such as Bitcoin or Ethereum, which is decentralized and which is a blockchain that anyone in the world can read, anyone in the world can send transactions to and expect to see them included if they are valid, and anyone in the world can participate in the consensus process for determining what blocks get added to the chain and what the current state is. As a substitute for centralized or quasi-centralized trust, public or permissionless blockchains are secured by cryptoeconomics - the combination of economic incentives and cryptographic verification using mechanisms such as proof of work or proof of stake.

Alternatively and optionally, the blockchain is a consortium blockchain, such as Hyperledger, where the consensus process is controlled by a pre-selected set of nodes, which for example may optionally be provided or supported by financial institutions and/or by an international consortium of conservation and development organizations. Such a blockchain is partially decentralized.

Optionally, the Hyperledger Fabric blockchain framework implementation is used (details are provided in “Architecture of the Hyperledger Blockchain Fabric” by Christian Cachin, IBM Research - Zurich, July 2016). It is one of the Hyperledger projects hosted by The Linux Foundation. Intended as a foundation for developing applications or solutions with a modular architecture, Hyperledger Fabric allows components, such as consensus and membership services, to be plug-and-play. Hyperledger Fabric leverages container technology to host smart contracts called “chaincode” that comprise the application logic of the system. This framework also includes such features as:

• Channels for sharing confidential information

• Ordering Service delivers transactions consistently to peers in the network

• Endorsement policies for transactions

• CouchDB world state supports wide range of queries

• Bring-your-own Membership Service Provider (MSP)

If the blockchain is private or permissioned - that is, centrally controlled by an operating entity to authorize participation - then optionally all members of the system as described by the present invention which need access are provided with cryptographic access, and become members of the private or permissioned blockchain system, such as Hyperledger.

Hyperledger has its own set of protocols and consensus process, which may optionally be used with smart contracts, to prevent fraud through rewriting information.

One of ordinary skill in the art could easily select a distributed ledger and implement it within various embodiments of the present invention, for example according to information provided in “Blockchain Basics: Introduction To Business Ledgers” by Brakeville and Perepa, IBM, May 9, 2016. For all of these examples, security for the blockchain may optionally and preferably be provided through cryptography, such as public/private key, hash function or digital signature, as is known in the art

Communication with blockchain network 150 may involve execution of one or more smart contracts (not shown). For example a smart contract may execute if the user indicates, through user app interface 112 for example, that the user wishes to purchase the product contained within container 152 or even that exact container 152. Optionally execution of the smart contract causes server gateway 120 to execute an alarm, for example if the user has not indicated a desire to purchase container 152, yet computer vision technology within the store (not shown) indicates that the user has moved container 152 to a shopping cart, bag or other location that is not the originally shelf.

Optionally, alternatively or additionally, the smart contract executes if the state of container 152 stays within one or more permitted boundaries during a specified period, or alternatively fails to stay within these boundaries. For example, such a specified period corresponds to shipment of a product contained within container 152 or alternatively may correspond to location of container 152 on a store shelf. In the former case, the smart contract may execute to indicate that one or more conditions required for successful shipment of container 152 have been fulfilled.

Image recognition, for example of the shape or other visual features of container 152, and/or preferably a code such as a QR code on container 152, may be performed simultaneously or sequentially.

According to at least some embodiments, the code such as the QR code relates to a unique web address and to a repository on blockchain network 150 for container 152. Optionally the code is unique for each individual container 152, and/or each type of container 152 and so forth. Optionally the code is unique for a category or type of product contained within container 152. Optionally blockchain network 150 stores a record of one or more data items related to container 152, such as for example shipping status; freshness; inventory ownership by supply chain stakeholder based on validated receipts; certificates that are validated and signed by a trusted party, including but not limited to the manufacturer, a quality assurance body and/or the issuer of certificate; and/or optionally differing content to be shared with each stakeholder based on customized role interactions with container 152. Figure IB shows a system 100B, which is similar to the system of Figure 1A, except that user computational device 102 has been replaced by smart glasses 162. Components with the same reference number have the same or similar functions. As shown with regard to the flow illustrated in Figures 7A-7I , the user preferably wears smart glasses 162, which then perform the functions described above with regard to a user computational device, such as a smartphone for example. Figures 2 and 7A-7I describe operation of the system when the user is wearing smart glasses 162 in more detail.

Figure 1C shows a system 100C, which is similar to the systems of Figures 1A and IB, except that both user computational device 102 and smart glasses 162 are present. Components with the same reference number have the same or similar functions. In this configuration, the user may scan or view container 152 with smart glasses 162, but display of product information such as price and other details, and/or indication of a desire to purchase the product, may be made through user computational device 102, smart glasses 162, or both.

Figure 2 shows a non-limiting, exemplary, illustrative method for interacting with the system of any of Figures 1A-1C. As shown with regard to a method 200, the process begins at 202, when a product owner or distributor registers the product on the serialization platform. The serialization platform comprises a customizable traceability and serialization engine, which enables product details to be displayed through the smart glasses or other interface. For each product added, the platform preferably generates a digital identity at the item level. Each such identity may for example point to a unique web address so that information may be viewed through a web application for example. Adding such an identity enables traceability of the item throughout the supply chain until purchased by the computer.

At 204, once the products are added, the owner can generate unique identifiers for each item. At 206, the unique identifier is added to each product. For example, a unique QR code may be printed on the product. The code may be unique for that instance of the product, for that type or category of product, for that brand of product, and so forth.

At 208, the buyer (user) preferably scans the product. For example, the user may wear smart glasses and may scan the QR code or other code on the product through these glasses, or through an associated smartphone app. The user may also scan such a code with a smartphone camera. The user then preferably interacts with the product and with information about the product on the corresponding screen, whether the smartphone screen or the smart glasses micro projector screen, at 210. The scanned product is then added to the application cart with a simple user action like touch, voice, head movement, and hand motion, at 212. If the user is purchasing more than one or a whole carton of the same product, preferably the camera on the smart glasses or smartphone, or an in-store computer vision system, is able to recognize all different QR codes on the products at once and adds them to the cart.

Once added to the application cart, the user is able to validate the products as being present in both a physical shopping trolley and also in the application cart. The user then proceeds checkout at 214. At 216, the user pays for the products, for example online. The application generates the invoices in the system backend, which are then preferably sent to the user’s email. At 218, the invoice is preferably sent to the user (buyer), for example by email. The invoice preferably includes a code that enables the user to leave the store with the purchases. At 220, the user is able to scan the walkthrough QR code at the exit gate and leave the store.

Figure 3 shows a non-limiting, exemplary, illustrative analysis engine for the system of any of Figures 1A-1C. As shown, analysis engine 134 preferably features an engine interface 300 for receiving image(s) of a container from the server and transmitting an analysis and/or other signals to the server (not shown). Analysis engine 134 preferably comprises a plurality of processors 302, shown as image processor 302A, QR data processor 302B and policy data processor 302C for the purpose of illustration only and without any intention of being limiting. Engine interface 300 preferably receives the previously described image(s) of the container (not shown), which are then processed by image processor 302A. Engine interface 300 may receive other image(s) from the container (not shown) in regard to a QR code, which are then processed by QR data processor 302B. Policy information may be retrieved from a policy storage 306 and/or may be transmitted through engine interface 300; in either case, the policy information is preferably analyzed by policy data processor 302C. The policy information may for example determine the different types of suitable reactions by analysis engine 134, including without limitation information about the ingredients or materials of the product, its manufacture, any sustainability or carbon footprint information, freshness, expiration date, safety information, price and so forth.

The various types of processed information are preferably then passed to a data analysis engine 304, which analyzes the information to identify the container, determine the product contained therein, the desired request for further information from the user device and so forth. Data analysis engine 304 may also determine which type of reaction is to be returned, for example to user computational device, that are determined according to policy information processed by policy data processor 302C. For example and without limitation, data analysis engine 304 may determine that the container is on sale and hence that a lower price is to be provided.

The determinations of data analysis engine 304 may be stored in a log storage 308 and/or output through a report output engine 310.

Data analysis engine 304 may also comprise an Al model as is known in the art for image processing and analysis, for example. Optionally, additionally or alternatively, Al model may comprise a neural network, implemented as a very simple feedforward network with one hidden layer. It takes the flattened image as input, and predicts the parameters of the bounding box (i.e. the coordinates x and y of the lower left corner, the width w and the height h). During training, a regression of the predicted to the expected bounding boxes may be performed.

Figures 4A-4D show a non-limiting, exemplary flow for interactions with the augmented retail system as described herein, by a retailer for example. Figure 4A shows a dashboard of information related to operation of the system. Such a detailed dashboard is preferably reserved for a retailer. Retailers may see analytics and statistical data on inventory, sales, feedback and so forth. Retailers are also preferably able to see insights on the products like highest sold, highest scanned, inventory of the product, consumer comments on the product and/or the store, and so forth, through such a dashboard. Figure 4B shows how a retailer could use such a dashboard, in combination with a tablet or other device operating an inventory application, to maintain inventory, sufficiently stocked shelves, freshness, attractive product selection and the like.

Figure 4C shows the retail user (employee of the retailer) viewing the inventory receipt for validating the received order. This scan also enables the order details to be entered into the system, for inventory control purposes, reordering purposes and so forth.

Figure 4D shows another example of how a retailer could use such a dashboard, in combination with a tablet or other device operating an inventory application, to maintain inventory, sufficiently stocked shelves, freshness, attractive product selection and the like.

Figure 5 shows a non-limiting, exemplary set of microservices for supporting the augmented retail system as described herein. As shown, smart glasses 1009 are preferably supported by a suite of microservices, operating at a remote server (not shown). These microservices preferably include a B2B web application service 1001, for example to maintain inventory and other information. A B2C mobile app service 1003 supports the previously described user app interface and other user device services. A computer vision service 1004 supports analysis of images obtained through the user device and optionally also through in-store computer vision technology, for example for security.

A payment service 1006 enables the user to pay for products and to receive an invoice, optionally with a code that may be required to exit the physical premise of a store as described herein.

A blockchain service 1007 enables to be written to, and read from, the blockchain as described herein.

An admin application service 1002 supports administration of the system for managing store and their users. The retailer management includes adding users for different branches, and managing products and inventory.

A user management service 1008 enables users to register, for example to provide preferences, user contact information, payment details and so forth, and then manages these users within the system.

A notification service 1005 may notify the retailer, the user or both, for example with regard to a problem in the operation of the system.

Figure 6 shows another non-limiting, exemplary system for supporting augmented retail interactions for a product. Microservices 1000 from Figure 5 are included, and have the same or similar function, in a system 600. Microservices 1000 preferably communicate with a database 1023 and/or locally through a cache 1016, for relevant information that is not stored on a blockchain. The latter data is preferably accessed through communication between blockchain service 1007 and a blockchain server 1011. Blockchain server 1011 may for example comprise a blockchain bridge, to support reading data from and writing data to the blockchain (not shown).

Notification service 1005 optionally communicates with an SMS server 1009, to be able to send and receive SMS (short message service) messages with users of the system. Notification service 1005 optionally also communicates with an email server 1010, to be able to send and receive emails with users of the system.

Computer vision service 1004 preferably communicates with a computer vision API or server 1014 to consume computer vision data, including without limitation image analysis of product images, barcodes, signs, offers and so forth. The analyzed computer vision data may then be used to support the system functions as described herein, for example and without limitation in relation to a request for information from a buyer, a request to purchase a product, transaction information in relation to the product, verification of a physical shopping trolley in comparison to the application cart, and so forth.

Web application services 1001 and mobile app application services 1003 both support payments and transactions, through communication with payment service 1006 and payment gateway 1012. Preferably such services support both retail users and consumers (buyers)

An ID authority API 1024 supports authorization of users, whether retail users or consumers, for the system overall.

An API gateway 1019 may be in contact with microservices container 1000, to provide access to the above servers and/or APIs. For example and without limitation, API gateway 1019 may contain SMS server 1009, email server 1010, blockchain server 1011, payment gateway 1012, computer vision 1014 and/or ID authority API 1024, or a combination thereof.

The user may interact with a mobile app 1021 or with a webapp 1022, which are each supported by a B2B version (for retailers and other commercial users) and a B2C version (for purchasers and consumers). Each of mobile app 1021 and webapp 1022 consumes services through a service registry 1018 and an authorization service 1020, for registering new users and authorizing existing users.

Figures 7A-7I show another non-limiting, exemplary flow for interactions with the augmented retail system as described herein. Figure 7A shows an illustration of a user successfully scanning a code of some type, such as a QR code, through smart glasses and/or a smartphone, to be able to enter a physical retail store.

Figure 7B shows an illustration of a user interacting with the app through the smart glasses. Users may scan a product to see different options like check and trace, offers, learn, view cart, shop and feedback. The check and trace option provides the consumer with information about the origin, provenance, the condition of transport, and different attributes of the product like organic or sustainable or locally produced. Offers are promotional offers that are personalized for that shopper. The learn option enables the user to learn more about the products like its contents, video, infographics, etc., which may be linked to how to use the product to get the best result. View cart enables the user to view the basket of products before they start the checkout process and pay for the goods.

The shop option is invoked when the customer triggers the shopping experience in store, for example to start adding items to their physical shopping trolley and mobile application cart. Feedback enables the consumer to provide feedback upon usage of the product after some time, and/or to provide feedback regarding the condition of the product in the store and/or the store experience. The user is able to select an option through their smart glasses which supports touch, voice, head movement, and hand motion.

Figure 7C shows an illustration of a view through the smart glasses after the user has selected the “learn” option from the previously shown menu. Product information is then shown to the users.

Figure 7D shows an illustration of a view through the smart glasses for a special purchase offer. While shopping, a user may also get personalized recommendations of products based on their interest, purchase history and preferences, which they may wish to buy.

Figure 7E shows the view through the smart glasses for verifying a match between a physical shopping trolley and an application cart. Once the desired products are added into the trolley and application cart, the user is able to confirm payment method and proceed to checkout. Figure 7F shows an illustration of a confirmation message as seen through the smart glasses. Once payment is successful, the user receives a confirmation message and an invoice for the purchase. An invoice is also sent over email as well.

Figure 7G shows an illustration of the user viewing the invoice and walkthrough QR code received over email. The user may then scan the walkthrough QR code with the smart glasses at the exit gate to leave the store. Figure 7H shows the user scanning the QR code at the exit gate with a smart phone alternatively or additionally.

Figure 71 shows an alternative message, indicating that the user needs to complete checkout at a physical checkout counter.

Figures 8A and 8B show yet another non-limiting, exemplary flow for interactions with the augmented retail system as described herein. Turning now to Figure 8A, as shown starting with step 1, the user (retail custom er/consumer) registers and logs in, through the mobile app and the backend web application. At 2, the customer data is stored in the backend. At 3, the mobile app receives notification of a successful login process. Once the user wishes to enter a store and to begin shopping, they scan the retail store QR code of the relevant store and confirm the store location. Other processes may be used to confirm that the correct store is being selected, including using smart glasses, another function of the mobile app and so forth.

At 5, if the user has access to smart glasses and has not done so already, the smart glasses are preferably paired with the mobile app, to provide for communication between the smart glasses and the mobile app. At 6, upon entering the store and viewing the products, the user is now notified that they are able to scan these products, with the mobile app, the smart glasses or a combination thereof. The products preferably have a code which may for example comprise a QR code.

At 7, the user decides to scan a product, for example by scanning the QR code on the product with the mobile app, the smart glasses or a combination thereof. In response, the backend web application preferably returns relevant product information as described herein. The smart glasses may communicate directly with the backend. Alternatively, the smart glasses may communicate through the mobile app, which then communicates with the backend. If only the mobile app is present, preferably it communicates directly with the backend.

At 8, the user may select from a plurality of options in terms of product information, such as the previously described check and trace, feedback, receiving offers, learning more about the product, viewing the user’s cart and so forth. At 9, the user may use a variety of interaction modalities to interact with the product and the provided product information, including without limitation, gestures, touch, option selection and more.

At 10, the user may select adding the product to the cart which is then confirmed. At 11, the product is indicated as being in the user’s mobile app cart, which is also then stored at the backend.

Once the user has finished shopping, then at 12 the user pays and goes through the checking out process. At 13, the store’s inventory system is informed of the inventory change, once the user has paid. At 14, also once the user has paid, the purchase invoice is sent to the mobile app and/or an associated user email address. At 15, an integration with the exit gate and security system of the store preferably enables a code to be generated to allow the user to leave with their purchases. A security system at 16 may monitor the user’s purchasing activity, for example through an integration with shelf weight sensors and/or computer vision, to make certain that the user has selected the correct product in the correct amount through the mobile app as the user has placed in their physical shopping trolley. Assuming that the security system and purchasing system indicate that the user has purchased the correct products in the physical shopping trolley, then an exit code or other confirmation of exit may be generated at 17.

Optionally, throughout the user’s shopping experience, a monitoring process may monitor the products removed from the shelf and placed in the physical shopping trolley, for example through shelf weight monitors and/or computer vision, at 18. Assuming that the purchasing process has been completed successfully, then at 19, the user scans the exit code and is able to exit the store with their purchases at 20. The backend confirms that the purchase was made successful at 21. If any problem is encountered by the user during the purchasing process, then at 22 the user is directed to the human operated checkout counter.

It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination.

Although the invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations that fall within the spirit and broad scope of the appended claims. All publications, patents and patent applications mentioned in this specification are herein incorporated in their entirety by reference into the specification, to the same extent as if each individual publication, patent or patent application was specifically and individually indicated to be incorporated herein by reference. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present invention.

Claims

WHAT IS CLAIMED IS:

1. A system for automated purchase of a physical product from a retail store, comprising a user computational device for obtaining an image of the physical product contained within the retail store; a server for receiving said image from said user computational device; and a security system in the retail store for securing said physical product against unauthorized removal from the store; each of said server and said user computational device comprising a memory for storing instructions and a processor for executing said instructions; wherein upon execution of instructions by said processor in said user computational device to request a purchase of said physical product, and authorization of said purchase by execution of instructions by said processor in said server, said security system permits removal of said product from the retail store.

2. The system of claim 1, wherein said processor of said server executes instructions to: identify said container according to an analysis of said image; receive a payment request from said user computational device; and determine whether said payment request is completed, and if so, notifying said security system.

3. The system of claim 2, wherein said user computational device comprises a mobile telephone, said mobile telephone comprising a camera and a mobile app, and wherein said camera of said mobile telephone scans said physical product to obtain said image, such that said mobile app transmits said image to said server.

4. The system of claim 3, wherein said mobile app is in communication with a payment modality and wherein said payment request is performed through said payment modality.

5. The system of claim 4, wherein said user computational device comprises smart glasses, said smart glasses comprising a camera, wherein said camera of said smart glasses scans said physical product to obtain said image.

6. The system of claim 5, wherein said user computational device further comprises said mobile telephone and said image from said smart glasses is sent through said mobile telephone. The system of claim 5, wherein said smart glasses further comprise a communication module and said smart glasses communicate directly with said server. The system of claim 5, wherein said image comprises a code and wherein said server determines that said physical product has been purchased according to said code. The system of claim 8, wherein said code comprises a QR code or an NFC tag. The system of claim 9, wherein the retail store comprises a secured exit and wherein said security system permits removal of an authorized purchase through said security exit. The system of claim 10, wherein said security system further comprises a security system computational device, a computer vision system and a shelf weight sensor, wherein said security system computational device comprises a memory for storing instructions and a processor for executing said instructions; wherein said computer vision system comprises a plurality of cameras for obtaining images within the retail store in regard to customer behavior and activity; wherein said processor of said security system computational device analyzes video data from said computer vision system and product weight data from said shelf weight sensor to determine if a physical product to be purchased has been correctly selected for purchase through said user computational device. The system of claim 11, wherein a user selects a plurality of products and wherein said computer vision system detects said plurality of products and determines whether said plurality of physical products to be purchased has been correctly selected for purchase through said user computational device. The system of claim 12, wherein said user selects a container with multiple products and wherein said computer vision system detects said multiple products in said container, and determines whether said multiple products to be purchased have been correctly selected for purchase through said user computational device. The system of claim 13, wherein additional information about the product is requested through said user computational device and is provided by said server according to said image. The system of claim 14, wherein said additional information is stored through distributed ledger technology (DLT) and is read from said DLT by said server. The system of claim 15, wherein said additional information comprises one or more of a previously recorded purchase, an answer to a question about the product and a reason for rejecting the product. The system of claim 16 wherein said additional information is obtained by providing an image comprising an item selected from the group consisting of a code, an identifier, a product shape and a marker; and wherein said processor of said server executes instructions to cause an interface to be provided to said user computational device; wherein said processor of said user computational device executes instructions to cause a user interface to be displayed. The system of claim 17, wherein said user interface comprises a web page, an augmented reality display or a verbal display. The system of claim 18, wherein a user interacts with said user interface to obtain more information about said physical product. The system of claim 19, wherein said processor of said user computational device executes instructions for displaying a user interface, and wherein a user performs actions to purchase said physical product through said user interface. The system of claim 20, wherein said product comprises one or more of food, beverage, medicine, cosmetics, personal care products, household care products, clothing, fresh fruit and vegetables, furniture, household goods, fashion accessories, or shoes. The system of claim 21, wherein said DLT comprises a blockchain and wherein said product is associated with a unique web address and to a blockchain based repository for said product. The system of claim 22, wherein said product is contained in a container, and wherein a unique identifier is associated with each individual container. The system of claim 23, wherein said unique identifier is associated with said blockchain based repository and wherein said blockchain based repository stores a record of one or more data items related to that container, comprising or more of purchase by a user; inventory ownership by supply chain stakeholder based on validated receipts; certificates that are validated and signed by a trusted party; and content suitable for each stakeholder according to customized role interactions for said stakeholder. The system of claim 24, wherein said trusted party comprises one or more of a manufacturer of said product, a quality assurance body for a type of said product; an issuer of certificate associated with said type of said product, or a combination thereof. The system of claim 25, wherein said user computational device further comprises access to a wallet for purchasing said physical product, and wherein said security system computational device further comprises access to a wallet for receiving payment for said physical product. The system of claim 26, wherein upon a successful purchase of said product, said user computational device receives a receipt, comprising a proof of purchase; and wherein said security system permits said product to be removed from the retail store upon scanning of said receipt. The system of claim 27, wherein said receipt further comprises a list of items purchased, status of payment and a confirmation code from said security system, in regard to confirmation of said items purchased. The system of claim 28, wherein if a user completes purchase of said product but remains within the retail store, an additional product may be purchased and included within said receipt. A system for automated purchase of a physical product from a retail store, comprising a user computational device for obtaining an image of the physical product contained within the retail store; a server for receiving said image from said user computational device; and a security system in the retail store for securing said physical product against unauthorized removal from the store; each of said server and said user computational device comprising a memory for storing instructions and a processor for executing said instructions; wherein upon execution of instructions by said processor in said user computational device to request a purchase of said physical product, and authorization of said purchase by execution of instructions by said processor in said server, said security system permits removal of said product from the retail store. The system of claim 30, wherein said processor of said server executes instructions to: identify said container according to an analysis of said image; receive a payment request from said user computational device; and determine whether said payment request is completed, and if so, notifying said security system. The system of claims 30 or 31, wherein said user computational device comprises a mobile telephone, said mobile telephone comprising a camera and a mobile app, and wherein said camera of said mobile telephone scans said physical product to obtain said image, such that said mobile app transmits said image to said server. The system of claim 32, wherein said mobile app is in communication with a payment modality and wherein said payment request is performed through said payment modality. The system of any of claims 30-33, wherein said user computational device comprises smart glasses, said smart glasses comprising a camera, wherein said camera of said smart glasses scans said physical product to obtain said image. The system of claim 34, wherein said user computational device further comprises said mobile telephone and said image from said smart glasses is sent through said mobile telephone. The system of claim 34, wherein said smart glasses further comprise a communication module and said smart glasses communicate directly with said server. The system of any of the above claims, wherein said image comprises a code and wherein said server determines that said physical product has been purchased according to said code. The system of claim 37, wherein said code comprises a QR code or an NFC tag. The system of any of the above claims, wherein the retail store comprises a secured exit and wherein said security system permits removal of an authorized purchase through said security exit. The system of any of the above claims, wherein said security system further comprises a security system computational device, a computer vision system and a shelf weight sensor, wherein said security system computational device comprises a memory for storing instructions and a processor for executing said instructions; wherein said computer vision system comprises a plurality of cameras for obtaining images within the retail store in regard to customer behavior and activity; wherein said processor of said security system computational device analyzes video data from said computer vision system and product weight data from said shelf weight sensor to determine if a physical product to be purchased has been correctly selected for purchase through said user computational device. The system of claim 40, wherein a user selects a plurality of products and wherein said computer vision system detects said plurality of products and determines whether said plurality of physical products to be purchased has been correctly selected for purchase through said user computational device. The system of claim 41, wherein said user selects a container with multiple products and wherein said computer vision system detects said multiple products in said container, and determines whether said multiple products to be purchased have been correctly selected for purchase through said user computational device. The system of any of the above claims, wherein additional information about the product is requested through said user computational device and is provided by said server according to said image. The system of claim 43, wherein said additional information is stored through distributed ledger technology (DLT) and is read from said DLT by said server. The system of claims 43 or 44, wherein said additional information comprises one or more of a previously recorded purchase, an answer to a question about the product and a reason for rejecting the product. The system of any of claims 43-45 wherein said additional information is obtained by providing an image comprising an item selected from the group consisting of a code, an identifier, a product shape and a marker; and wherein said processor of said server executes instructions to cause an interface to be provided to said user computational device; wherein said processor of said user computational device executes instructions to cause a user interface to be displayed. The system of claim 46, wherein said user interface comprises a web page, an augmented reality display or a verbal display. The system of claim 47, wherein a user interacts with said user interface to obtain more information about said physical product. The system of any of the above claims, wherein said processor of said user computational device executes instructions for displaying a user interface, and wherein a user performs actions to purchase said physical product through said user interface. The system of any of the above claims, wherein said product comprises one or more of food, beverage, medicine, cosmetics, personal care products, household care products, clothing, fresh fruit and vegetables, furniture, household goods, fashion accessories, or shoes. The system of any of the above claims, wherein said DLT comprises a blockchain and wherein said product is associated with a unique web address and to a blockchain based repository for said product The system of claim 51, wherein said product is contained in a container, and wherein a unique identifier is associated with each individual container. The system of claim 52, wherein said unique identifier is associated with said blockchain based repository and wherein said blockchain based repository stores a record of one or more data items related to that container, comprising or more of purchase by a user; inventory ownership by supply chain stakeholder based on validated receipts; certificates that are validated and signed by a trusted party; and content suitable for each stakeholder according to customized role interactions for said stakeholder. The system of claim 53, wherein said trusted party comprises one or more of a manufacturer of said product, a quality assurance body for a type of said product; an issuer of certificate associated with said type of said product, or a combination thereof. The system of any of the above claims, wherein said user computational device further comprises access to a wallet for purchasing said physical product, and wherein said security system computational device further comprises access to a wallet for receiving payment for said physical product. The system of any of the above claims, wherein upon a successful purchase of said product, said user computational device receives a receipt, comprising a proof of purchase; and wherein said security system permits said product to be removed from the retail store upon scanning of said receipt. The system of claim 56, wherein said receipt further comprises a list of items purchased, status of payment and a confirmation code from said security system, in regard to confirmation of said items purchased.

58. The system of claims 56 or 57, wherein if a user completes purchase of said product but remains within the retail store, an additional product may be purchased and included within said receipt.