CA3133233A1 - Cashier-less shopping method and system and device therefor - Google Patents

Abstract

A method for cashier-less shopping is provided. An anti-theft method for shopping is also pro-vided. Systems and devices for cashier-less shopping is also provided.

Description

Cashier-less Shopping Method and System and Device Therefor TECHNICAL FIELD
[0001] This disclosure generally relates to system and method for shopping in a physical store, and more specifically relates to a system and method for cashier-less shopping in a physical store.
BACKGROUND

[0002] Commonly used cashier-less shopping methods involve the use of barcode, RFID, or artificial intelligence (Al).

[0003] The barcode technique requires a customer to use a scanning device to scan product barcode by themselves. This essentially transfers the work of a cashier to the customer, resulting in an unpleasant customer experience.

[0004] The identification accuracy of the RFID technique is affected by weather and the accu-racy is not satisfactory when RFID is used with liquid or metal. In addition, RFID significantly increases costs to retailers because of the costs of the RFID tags, the costs for installing the RFID
tags, and the high loss rate resulting from the ease of removal of the RFID
tags.

[0005] The Al technique includes two types, with or without a point of sale (POS). The type with a POS typically uses image recognition, but the accuracy is low, especially for fresh food that needs to be weighed, and the rate of loss due to theft and spoilage is high. On the other hand, the type without a POS utilizes imaging recognition, weight sensor, and voice recognition to identify the product purchased, which has low recognition accuracy, especially for fresh food that needs to be weighed. In addition, this type requires high initial investment cost and subse-quent maintenance cost.

[0006] As such, there is a need for a better cashier-less shopping system and method.
SUMMARY

[0007] In one aspect, a method for cashier-less shopping is provided. The method includes picking an item by a customer; identifying the item using an identification system; adding the item to a virtual shopping cart; adding a price of the item to a total price associated with the Date Recue/Date Received 2021-10-04 virtual shopping cart using at least one processor device. If the customer unpicks an item, for ex-ample, by placing it back on the shelf, the information of the unpicked item is removed from the virtual shopping cart and the price of the unpicked item is deducted from the total price using the at least one processor device. These steps are repeated until the customer is ready to check out.
Then a payment is made for the items in the virtual shopping cart.

[0008] In one aspect, a method for cashier-less shopping is provided. The method includes picking an item, identifying the item using an identification system, and paying for the item.

[0009] In some embodiments, the customer is identified before the customer starts picking items in the store. The system and method for identifying the customer is provided, which may utilise an application, a membership token and a corresponding device, or by using facial recog-nition, human body spectrum, or biological characteristics such as a fingerprint.

[0010] In some embodiments, an anti-theft method is provided, which includes obtaining an entrance characteristic and an exit characteristic, and comparing the entrance characteristic and the exit characteristic to obtain an exit difference. If the exit difference is above a predetermined threshold, an alert is provided.

[0011] In one aspect, an identification system for identifying the item is provided, which may include an NFC enabled device for transmitting information with respect to the item, or an image capturing device associated with a database with images of the items in the store pre-stored thereon. The image-capturing device may be a hyperspectral imaging device, a laser imaging capture device, or an infra-red imaging device.

[0012] In one aspect, a device for shopping is provided, which is configured with an infor-mation module for obtaining information of a product; a battery; and a charging module for charging a user device.

[0013] In one aspect, a system for shopping in a store is provided. The system includes a hy-perspectral module to capture a hyperspectral image, which is sent to a server for identification.
The identification is effected by comparing the captured hyperspectral image with the hyperspec-tral images pre-stored in the server.
BRIEF DESCRIPTION OF THE DRAWINGS

Date Recue/Date Received 2021-10-04

[0014] The disclosure will be explained in more detail in the following with reference to em-bodiments and to the drawing in which are shown:

[0015] FIG. 1 is a flow diagram illustrating a method for cashier-less shopping according to some embodiments of the present disclosure.

[0016] FIG. 2 is a flow diagram illustrating a method for cashier-less shopping according to some embodiments of the present disclosure.

[0017] FIG. 3 is a flow diagram illustrating an anti-theft method according to some embodi-ments of the present disclosure.

[0018] FIG. 4A is a functional block diagram illustrating some components of a label system including an NFC module and a display according to some embodiments of the present disclo-sure.

[0019] FIG. 4B illustrates a portion of one embodiment of the of the label system of FIG. 4A
that is visible to a customer.

[0020] FIG. 5A illustrates the front of one embodiment of a portable device configured to re-ceive item information and charge a phone.

[0021] FIG. 5B illustrates the back of the embodiment of FIG. 5A.

[0022] FIG. 6 is a block diagram illustrating some components of a system for identifying an item according to some embodiments of the present disclosure.

[0023] FIG. 7A, 7B, and 7C illustrate one embodiment of a self-checkout shopping cart.

[0024] FIG. 8 shows one embodiment of a self-checkout terminal.

[0025] FIG. 9 shows another embodiment of a self-checkout terminal.

[0026] FIG. 10 shows a portable self-checkout terminal.

[0027] FIG. 11 is a flow diagram illustrating a method for cashier-less shopping according to some embodiments of the present disclosure.
DETAILED DESCRIPTION

[0028] In the following description, numerous specific details are set forth in order to provide a more thorough description of the present disclosure. It will be apparent, however, to one skilled Date Recue/Date Received 2021-10-04 in the art, that the present disclosure may be practiced without these specific details. Other em-bodiments of the disclosure will readily suggest themselves to such skilled persons having the benefit of this disclosure. In some instances, well-known features have not been described in de-tail so as not to obscure the disclosure.

[0029] As used herein, the following terms and variations thereof have the meanings given be-low, unless a different meaning is clearly intended by the contest in which such term is used.

[0030] The terms "a," "an," and "the" and similar referents used herein are to be construed to cover both the singular and the plural unless their usage in context indicates otherwise.

[0031] As used in this disclosure, the term "comprise" and variations of the term, such as "comprising" and "comprises," are not intended to exclude other additives, components, integers ingredients or steps.

[0032] The term "connected," "attached to," or similar expression may indicate that the ele-ments are directly connected to each other or connected through other components.

[0033] Referring first to FIG. 1, which shows a method 100 of cashier-less shopping according to some embodiments of the disclosure.

[0034] When a client or a customer enters a store, the customer is uniquely identified in step 102 and a shopping application is activated in step 104. The client entering the store is defined by the customer passing a certain point in the store, for example, the entrance or a gate.

[0035] In some embodiments, the customer may be carrying a user device such as a mobile computing device, for example a smart watch, smart glasses, or smaiiphone.
When the customer enters the store, the customer may log into an application on the mobile computing device for shopping at the store. The mobile computing device is operatively connected to a customer data-base of the customers associated with the store. For example, the mobile computing device is op-eratively connected to a customer server hosing the customer database through a network, for ex-ample, the internet, by wireless connection such as WIFI or Bluetooth provided in the store or mobile connection such as 4G or 5G. The application then verifies the identity of the customer in the customer database.

[0036] In some embodiments, the customer may be carrying a membership token that includes identification information associated with the customer, for example, a membership card or a gift Date Recue/Date Received 2021-10-04 card that includes a barcode, QR code, a near-field communication (NFC) chip, or the like. A
corresponding device, for example, an optical scanning device, may be used to read the infor-mation form the membership card when the customer enters the store. The corresponding device is operatively connected to the customer database such that the customer is identified in the cus-tomer database. The corresponding device may be associated with the customer.
The correspond-ing device is operatively connected to the membership database, for example, through wireless or wired connection in the store or the internet.

[0037] In some embodiments, the customer is identified by facial recognition, human body spectrum, or other biological characteristics, for example, fingerprint.

[0038] In some embodiments, the shopping application includes the payment information of the customer or be associated with a payment method. In some embodiments, the shopping appli-cation is operatively connected to a payment application.

[0039] The shopping application may be present on a server, the mobile computing device, or the device used for reading the membership token. The shopping application may include a vir-tual shopping cart. In some embodiments, the shopping application is associated with the virtual shopping cart, which may be created in a server and associated with the customer or created in an independent application on the mobile computing device. The server may be the same as or dif-ferent from the server hosting the database of the members.

[0040] The customer then takes a shopping carrier, for example, a shopping cart or a shopping basket, and starts shopping in the store.

[0041] If the customer picks an item in step 106, for example, by removing the item from the shelf or putting the item in the shopping carrier, an attempt is made to identify the item in step 108.

[0042] In some embodiments, the customer carries a device that can receive information trans-milled by labels for the items. For example, the device may be provided with near-field commu-nication (NFC) capabilities. The device may be a portable device provided at the store for the customer to use or integrated in the mobile computing device the customer carries.

[0043] In some embodiments, a label system 400 with NFC capabilities includes a label mod-ule 422 that comprises a display module 402 and an NFC module 404 as shown in FIG. 4A is Date Recue/Date Received 2021-10-04 provided. The display module 402 and the NFC module 404 are operatively connected to a server 408 via network 406, and the server 408 is in turn connected to a display database 410.
The display database 410 includes information about items in the store. By updating the infor-mation, the information displayed by the display module 402 and transmitted by the NFC mod-ule 404 is updated. In some embodiments, the display module 402 displays an optical machine-readable representation associated with the item information.

[0044] The NFC capabilities may be configured to only function within a small distance, for example, within 10cm, 5cm, or 4cm, to reduce the likelihood of erroneously identifying a nearby item.

[0045] In some embodiments, the NFC module 402 provides price information of the item and other information such as the expiration date of the item. When the expiration date is within a predetermined period from the present date, for example, within 60 days, 30 days, 15 days, 7 days, 1 day, or if the expiration date has already passed, the shopping application on the receiv-ing device provides audible or visual alert to the customer.

[0046] In some embodiments, the label module 422 may be disposed in the store at a location proximal the respective item the label module 422 is associated with, for example, above the shelf where the item is disposed. In some embodiments, the label module 422 may be disposed on each item in the store.

[0047] In some embodiments, the label system 400 does not include a display.

[0048] FIG. 4B illustrates one embodiment of the label module 422.

[0049] The display module 402 displays the item information 418, which includes the item name, item price, and item image. In some embodiments, the item information also includes ex-piration date.

[0050] The display module 402 displays an optical machine-readable representation 420 asso-ciated with the item, such as a QR code or barcode, such that that client can use an optical scan-ning device or a user device with optical scanning capability to obtain the item information.

[0051] In some embodiments, the customer carries an optical scanning device, which may be a portable device provided by the store or integrated in the mobile computing device the customer carries. An optical machine-readable representation is associated with each item in the store. The Date Recue/Date Received 2021-10-04 optical scanning device integrated in the mobile computing device may be configured to read the optical machine-readable representation without turning on the display of the mobile computing device. The machine-readable representation may be a barcode or QR code. The optical scanning device is connected to a database of the items in the store such that an item can be identified based on the information provided by the optical scanning device by reading the optical ma-chine-readable representation. The store may be able to update the information, including price, associated with the item. The updated information is associated with the item in the virtual shop-ping cart.

[0052] In some embodiments, the portable device provided by the store is NFC-enabled such that it can receive information from the NFC module 404.

[0053] In some embodiments, the portable device provided by the store includes a rechargea-ble battery and may be used to charge the customer's mobile computing device, for example, by USB cable or wireless charging.

[0054] One embodiment of such a portable device in shown in FIGs. 5A and 5B.
The portable device 500 includes a wireless communication module 502 that is configured to wirelessly com-municate with a user device such as a smartphone or smart watch configured for wireless com-munication. For example, the wireless communication module 502 may be configured for WIFI, Bluetooth, or NFC communication. The portable device 500 also includes a display module 504 for showing item information. In some embodiments, the portal device does not include the wire-less communication module 502 and the display module 504. In some embodiments, the display module 504 is touch-enabled.

[0055] On the front of the device 500 is configured a charge module 506 for charging a user device such as a phone. The charge module 506 includes a receptacle 507 for receiving the user device. A wireless charge module 508 that is compliant with, for example, the Qi standard, is configured in the charge module 506 such that charging of the user device is effected when the user device is disposed in the charge module 506. In some embodiments, wires connection, for example, USB connection, is provided in the charge module 506 such that the user device can be plugged in for charging. A battery 514 is disposed in the device 500 to provide the power to charge the user device.

Date Recue/Date Received 2021-10-04

[0056] On the back of the device 500 is configured an NFC module 510 that is configured to receive information from an NFC-enabled label such as the in the NFC system 400.

[0057] An optical scanning module 512 is configured on the back of the device 500 for read-ing machine-readable representation.

[0058] The device 500 is operatively connected with a server and a database of the items in the store such that an item can be identified based on the information provided by the optical scanning module 512 reading the optical machine-readable representation. The store may be able to update the information, including price, associated with the item.

[0059] In some embodiments, an image of the item is captured and compared with pre-stored images of items in the store to identify the item, for example, by comparing the captured image with the images of the items in the store pre-stored in a server.

[0060] FIG. 6 illustrates one embodiment of the imaging system 600 of for identifying the item. The imaging system 600 includes one or more image capture device 602.
The image cap-ture device 602 is operatively connected to one or more imaging servers 606a, 606b, and 606c (collectively server 606) that in turn are connected to one or more databases (DBs) 608a, 608b, and 608c (collectively database 608). Although the components of the imaging system 600 are discussed herein as if those components were associated with, and located in, a single store, this is for illustrative purposes only. People of ordinary skill in the art will readily appreciate that in some embodiments, only some of the components seen in FIG. 6 are disposed in the store, while other components are located remotely from the store.

[0061] The image capture devices 602 may be provided around the store close to the items, for example, above the shelves, such that images of the items can be captured without requiring the customer to facilitate image capture. In some embodiments, the image capture device 602 is be provided in the shopping carrier. The image of an item is captured when the item is removed from the shelf in the store, or placed in or removed from the shopping carrier. The image is trans-mitted to server 606 via the network 604 and compared with the pre-stored images of items in the database 608 such that the item can be identified. The item is then added to the virtual shop-ping cart.

Date Recue/Date Received 2021-10-04

[0062] The image capture device 602 may be a laser imaging capture device, an infra-red im-aging device, or a hyperspectral imaging device.

[0063] In some embodiments, the imaging system 600 includes artificial intelligence and/or machine learning capabilities to improve the accuracy of identification of the items. For exam-ple, the machine learning capabilities may be incorporated in the server 606.

[0064] When an item is identified in step 108, the item is added to the virtual shopping cart in step 110, and the price of the item is added to the total price of the items to be purchased by the customer in step 112.

[0065] The price may be retrieved from an item information server and an item information database.

[0066] In some embodiments, the devices for identifying the item are operatively connected to an item information server and an item information database from which the price information from which the price of the identified item is retrieved and added to the total price for the cus-tomer.

[0067] In some embodiments, the mobile computing device or the portable device provided in the store may be configured to retrieve the item information from the item information server and the item information database based on the identified item.

[0068] In some embodiments, shopping carriers are provided with weighing devices such as scales to weigh the item placed in the shopping carriers. For example, when the customer places fresh meat or vegetables in a shopping carrier, the weight of the meat or vegetable is measured.
The weight is associated with the item identified by the imaging system.

[0069] For example, FIGs. 7A, 7B, and 7C illustrate a shopping cart 700 with a weight device 701 that is operatively connected by a cable 703 to a processing module 702.

[0070] The weight device 701 is disposed at a bottom portion of the shopping cart 700. One or .. more weight sensors 704a, 704b, and 704c (collectively weight sensor 704).

[0071] The processing module 702 is disposed in a top portion of the shopping cart 700. The processing module 702 includes a wireless communication module 706, which may be config-ured for receive item information from items that are configured for wireless communication such as RFID or NFC. Such an item may be placed close to the wireless communication module Date Recue/Date Received 2021-10-04 706 such that item information is received by the wireless communication module. In some em-bodiments, the item information may be obtained by wireless communication with the wireless communication module 706 in the process of placing an item into the shopping cart.

[0072] In some embodiments, the wireless communication module 706 may be configured to communicate with credit card, for example, by tapping, such that payment can be processed.

[0073] In some embodiments, the wireless communication module 706 may communicate with a user device, such as a smaiiphone, by NFC or Bluetooth, for example, to receive payment information from the user device. The wireless communication module may then be connected with a payment server such that payment can be effected.

[0074] The module 702 also includes one or more imaging modules 708a, 708b, and 708c (collectively imaging module 708). The imaging module may be configured for laser imaging, hyperspectral imaging, and/or infra-red imaging. The module 702 also includes an infra-red module 710. When an item is placed in the shopping cart or being placed in the cart, the item may be identified as discussed above with respect to the imaging system 600.
In some embodi-ments, artificial intelligence is integrated in the shopping cart 700.

[0075] The module 702 further includes a display module 712 for displaying information of the item. In some embodiments, the display module 712 is a touch screen.

[0076] A client identification module 714 is also provided in the module 702.
The module 714 may be configured with optical scanning capabilities such that the module 714 is can read the op-tical machine-readable representation such as a barcode or QR code that is present on a customer identification token such as a membership card. The client identification module 714 is opera-tively connected to the customer database such that the customer is identified in a customer data-base based on the information read by the module 714.

[0077] In some embodiments, the module 714 is configured for facial recognition such that a customer can be identified. For example, the module 714 may include a camera module that takes a picture of the face of a customer, and the picture is compared with pre-existing pictures of the customer in a customer database to identify the customer and associate the customer with pre-stored information, such as membership information and payment information.
Date Recue/Date Received 2021-10-04

[0078] In some embodiments, the modules 701 and 702 wirelessly communicate with each other.

[0079] In some embodiments, a plurality of weighing devices are placed around the store, for example, close to where the items that need to be weighed, for example, fresh meat and vegeta-bles. The imaging system is configured to identify the item, and the weight is associated with the item. The system may be configured to print an optical machine-readable representation, for ex-ample, a barcode or QR code to provide information, including the price, name, etc., of the item.
The item may then be added to the virtual shopping cart in step 110 by reading the optical ma-chine-readable representation with an optical scanning device discussed earlier. In some embodi-ments, a transmitter, for example, an NFC chip, may be connected with the scale such that the price information of the item may be transmitted to a device, for example, the mobile computing device, such that the item can be added to the virtual shopping cart. In some embodiments, the scale may be connected to the virtual shopping cart and the price and item information of the weighed item are added to the virtual shopping cart.

[0080] At least one processor device is provided that to add an item to a virtual shopping cart in step 110 and add the price of the item to the total price in step 112, including calculation based on the unit price and weight of the items where appropriate. In some embodiments, the virtual shopping cart is created when the first item is added.

[0081] If the item is failed to be identified, the identification is retried at step 114, for exam-ple, by trying to receive information from the NFC system, scanning the optical machine-reada-ble representation, or getting a worker at the store to help.

[0082] If the customer unpicks an item in step 116, for example, by removing an item from the shopping cart or placing an item back to the shelf, an attempt is made to identify the item as shown in step 118. The process for identifying the item is as described for item identification at step 108.

[0083] After the item is identified, the item is removed from the virtual shopping cart in step 120, for example, by using the shopping application on the mobile computing device or by the system automatically. For example, the imaging system identifies the item and the server 606 may be operatively connected to the server on which a virtual shopping cart is hosted such that Date Recue/Date Received 2021-10-04 the item may be removed from the virtual shopping cart. The price of the item removed is also removed from the total price for the customer as shown in step 122.

[0084] If the item fails to be identified, further attempt is made to identify the item as shown in step 124, for example, by trying to receive information from the NFC
system, scanning the op-tical machine-readable representation, or getting a worker at the store to help.

[0085] An audio or visual alert may be provided to the customer when an item is added to or removed from the virtual shopping cart. For example, a voice alert or beep sounds may be pro-vided. The voice alert may also provide other information about the item, for example, the price, the number of the item added, the number of items in the virtual shopping cart, and the total price of the items in the virtual shopping cart.

[0086] After the addition and/or removal of an item from the virtual shopping cart and the price is added or deducted as shown in steps 110, 112, 120, and 122, a determination is made whether the customer finishes picking items as shown in step 126. For example, this determina-tion may be made based on an input by the customer or by tracking the customer beyond a cer-tam n exit point in the store.

[0087] If the customer is not finished picking items, the steps beginning from step 106 are re-peated as shown in FIG. 1.

[0088] After the customer finishes picking item in the store as determined in step 126, pay-ment is made in step 128.

[0089] In some embodiments, the mobile computing device or the portable device provided in the store may be associated with a payment method. For example, the payment method may be a wallet application on the mobile computing device the customer carries or accessible from the device provided by the store. The wallet application may include credentials for payment sys-tems such as Google Pay, Apple Pay, Samsung Pay, WeChat Pay, Alipay, PayPal or credit card, gift card, or other payment cards.

[0090] In some embodiments, payment credentials may be stored locally on the device or on a server remotely accessible from the device, for example, the device provided by the store or the mobile computing device carried by the customer. In such embodiments, the customer does not need to be identified in the membership database or initiate the shopping application.

Date Recue/Date Received 2021-10-04

[0091] In some embodiments, credentials for pre-loaded cash associated with the customer may be stored in the mobile computing device or a server connected to the mobile computing de-vice or the portable device provided by the store, which enables payment.

[0092] In some embodiments, the total price of the items that the customer purchases is auto-matically deducted via the selected payment method when it is determined that the customer fin-ishes picking items.

[0093] When a device that is associated with the payment method includes NFC
capability, the payment may be executed via the NFC protocol. With such a device, payment may be made by placing the device close to the NFC-enabled label without turning on the device or entering the application interface.

[0094] In some embodiments, the device may be configured to pay for the whole virtual shop-ping cart when the customer finishes shopping, for example, upon confirmation from the cus-tomer or when the location of the device is shown to be outside of the store.
In some embodi-ments, the device may be connected to the payment method associated with the customer to fa-cilitate payment. In some embodiments, when an item is added to the virtual shopping cart, pay-ment is made for the item.

[0095] In some embodiments, self-checkout terminals are provided in the store.
The terminal may be connected with the virtual shopping cart. When the customer is checking out, the cus-tomer is identified in the membership database using one of the methods described earlier. Infor-mation including, for example, a list of the items in the shopping cart, the price of each item, and the total price of the items, are then displayed from the virtual shopping cart associated with the customer. Upon confirmation by the customer, for example, by confirming on a touchscreen, a mobile computing device carried by the customer, or a portable device provided by the store, the payment is made through a payment associated with the customer. In some embodiments, the customer may make payment using any means accepted by the POS, for example credit card, debit card, gift card, cash, or other physical credentials.

[0096] FIG. 8 shows one embodiment of a self-checkout terminal 800, including legs 803a, 803b, 803c, and 803d (collectively leg 803), a platform 801, and processing module 802.

[0097] When a customer is ready to check out, items are placed on the platform 801.

Date Recue/Date Received 2021-10-04

[0098] The processing module 802 includes a wireless communication module 806, which is generally similar or identical to the wireless communication 706.

[0099] The processing module 802 also includes one or more imaging modules 808a, 808b, 808c (collectively imaging module 808), which is generally similar or identical to the imaging module 708. And an infra-red module 810 is configured in the processing module 802. The infra-red module 810 is generally similar or identical to the infra-red module 710.

[0100] A display module 812 is configured in the processing module 802. The display module 812 is similar or identical to the display module 712.

[0101] A client identification module 814 is configured in the processing module 802. The cli-ent identification module 814 is generally similar or identical to the client identification module 714.

[0102] In some embodiments, one or more weight sensors are configured in the platform 801 such that the weight of the items may be obtained. For example, there may be one sensor, and the items are weighed individually. In some embodiments, there may be multiple sensors such that the multiple items may be weighed at the same time.

[0103] When one or more weight sensors are configured in the platform 801, the terminal 800 may be used as the weighing device placed around the store as discussed elsewhere in this dis-closure.

[0104] FIG. 9 shows another embodiment of a self-checkout terminal 900, including a plat-form 901 and a processing module 902 that are operatively connected to each other.

[0105] The platform 901 is generally similar or identical to the platform 801.
In some embodi-ments, the platform 901 includes one or more weight sensors as discussed with respect to plat-form 801.

[0106] The processing module 902 includes a wireless communication module 906 generally similar or identical to the wireless communication module 806, one or more imaging modules 908a, 908b, and 908c (collectively imaging module 908) that are generally similar or identical to the imaging module 808, infra-red module 910 that is generally similar or identical to the infra-red module 810, a display module 912 that is generally similar or identical to the display module Date Recue/Date Received 2021-10-04 812, and a client identification module 914 that is generally similar or identical to the client iden-tification module 814.

[0107] When one or more weight sensors are configured in the platform 901, the terminal 900 may be used as the weighing device placed around the store as discussed elsewhere in this dis-closure.

[0108] Referring now to FIG. 2, which shows a method 200 for cashier-less shopping in some embodiments of the disclosure.

[0109] When a customer picks an item in step 202, for example, by removing the item from the shelf or putting the item in the shopping carrier, an attempt is made to identify the item in step 204 that is generally similar or identical to the process described above with respect to step 108.

[0110] After the item is identified, the customer pays for the item in step 206.

[0111] In some embodiments, the NFC module 404 of label system 400 is operatively con-nected to a server 414 via a network 412, and the server 414 is in turn operatively to a database 416. The server 414 and the database 416 may be configured such that payment is enabled via the NFC module 404. As such, an NFC communication between the mobile computing device or the portable device carried by the customer may affect a payment by the customer. For example, the customer may make the payment using an NFC-enabled mobile computing device, gift card, or membership card associated with pre-loaded cash or payment credentials, or other NFC-ena-bled direct payment method by positioning such items within a predetermined distance from the NFC module 404.

[0112] In some embodiments, payment may be made via a payment method associated with the customer as discussed earlier, for example, Google Pay, Apple Pay, Samsung Pay, WeChat Pay, Alipay, PayPal or credit card, gift card, or other payment cards.

[0113] If the item is not identified in step 204, further attempts are made to identify the item as illustrated in step 208, for example, by trying to receive information from the NFC system, scan-ning the optical machine-readable representation, or getting a worker at the store to help.

[0114] The steps are repeated until the customer finishes picking item in step 210, which is de-termined as discussed earlier.
Date Recue/Date Received 2021-10-04

[0115] In some embodiments, a portable self-checkout terminal is provided by the store for the customer to use.

[0116] FIG. 10 shows one embodiment of a portable self-checkout terminal 1000, which may be used in the method illustrated in FIG. 2.

[0117] The terminal 1000 includes a wireless communication module 1006, which is generally similar or identical to the wireless communication module 706. When the wireless communica-tion module is enabled for NFC communication, the wireless communication module 1006 may be generally similar or identical to the NFC module in a user device such as a smaiiphone, such that the customer may make payment as discussed in step 206.

[0118] The terminal 1000 also includes a client identification module 1014 that is generally similar or identical to the client identification module 714.

[0119] A display module 1012 is provided in the terminal 1000 and the display module 1012 is generally similar or identical to the display module 712.

[0120] In some embodiments, the display module is touch-enabled to accept client input.

[0121] A button 1016 is provided on the terminal 1000 to receive input by the client. For ex-ample, the button 1016 may be used to activate the terminal 1000 to shopping mode, to confirm prompt on the display module 1012, to request or answer from the shopping system, or to request help from an employee at the store and notify the location of the client.

[0122] Referring to FIG. 3, which illustrates one embodiment of an anti-theft method 300.

[0123] The characteristics of a customer is obtained when the customer is entering the store in step 302, for example, when the customer enters the door of the store or a predetermined point in the store.

[0124] When the customer is exiting the store at step 304, for example, when the customer leaves the store or goes beyond a certain point in the store, characteristics of the customer is ob-tamed.

[0125] The entrance characteristics are then compared to the exit characteristics, and an exit difference between the characteristics is obtained in step 306.

Date Recue/Date Received 2021-10-04

[0126] In step 308, the difference obtained in step 306 is compared with the characteristics of the items that the customer purchased. If the difference is within a predetermined threshold, the customer is allowed to exit the store without interruption in step 310. If the difference is beyond a predetermined threshold, an alarm is triggered and/or the customer is audited in step 312. For example, the alarm an alert may be an audible and/or visual signal or a notice on a display device to workers at the store. The audit may be conducted, for example, by workers at the store.

[0127] In some embodiments, weighing devices are provided at entrances and exits of the store. When a customer enters the store, an entrance weight of the customer is obtained. When the customer exits the store, an exit weight is obtained. The difference between the entrance weight and the exit weight is compared to the weight of the items that the customer paid for. For example, when an item is added to the virtual shopping cart at step 110 or the price of an item is added to the total price for the customer, the weight of the item is added to the total weight of the items purchased by the customer, and the weight is deducted in steps 120 and/or 122. The prede-termined threshold may be that the difference between the entrance weight and the exit weight is within a certain percentage of the total weight of the items purchased by the customer, for exam-ple, 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, or 1% of the total weight of the items purchased by the customer.

[0128] In some embodiments, imaging systems, for example, hyperspectral imaging system or X-Ray systems, are placed at entrances and exits of the store. When the customer enters the store, entrance image data is acquired. When the customer is leaving the store, exit image data is acquired. The entrance image data is compared with the exit image data to obtain the exit differ-ence. The exit difference may be in the form of spectral difference or visual difference. The exit difference is compared with the items in the database to identify the items or the number of items the customer carries when the customer is leaving the store. The identified items or the number of items is compared with the items or the number of items that the customer paid for. When there is a discrepancy, an alert is provided. For example, the alert may be a red light or audible signals.

[0129] The imaging system 600 as illustrated in FIG. 6 may be adapted for obtaining the en-trance and exit characteristics. For example, the imaging capturing device 602 may be disposed close to an entrance of the store to capture an entrance image of the customer when the customer Date Recue/Date Received 2021-10-04 enters the store. Another imaging device 602 may be disposed close to an exit of the store to cap-ture an exit image of the customer when the customer leaves the store. The entrance image and the exit image are compared to obtain an exit difference.

[0130] FIG. 11 illustrates a method 1100 for checking out a customer from store according to one embodiment.

[0131] At step 1102, a client checks into a store, for example, by entering the store.

[0132] The customer is then uniquely identified in step 1104. This can be done by reading a membership card, gift card, or a user device with NFC capabilities for providing information as-sociated with the customer. It may also be done by reading a membership card or gift card with optical machine-readable representation such as QR code, barcode disposed thereon that are as-sociated with the customer. The client may also be identified by any other code, number, or method associated with the client. The client identification can also be done by facial recogni-tion, human body spectrum, or other biological characteristics. At this step, the total weight of the customer may also be obtained with or without the shopping carrier.

[0133] If the client identification fails in step 1104, attempted is made to identify the client by NFC communication with a device capable of providing client information, reading QR code, or human characteristics in step 1106.

[0134] If the client is identified, the client may be associated with previously stored client in-formation such as payment information.

[0135] At step 1108, the client decides whether to pick up a shopping cart at the shop.

[0136] If the client decides not to use a shopping carrier in the shop, the client can start using the client's shopping carrier such as a shopping cart or bag at step 1110. In some embodiments, the client starts using a conventional shopping cart of the store without the capabilities to identify and weigh the item and to make payment therefor.

[0137] At step 1112, When the client picks up an item, the client uses a portable device or a user device, for example, a smaiiphone, with respective capabilities such that the item can be identified by reading optical machine-readable representation such as QR code and barcode, or receiving information from RFID- or NFC-enabled label that corresponds to the item. The item is then placed in the client's shopping carrier.

Date Recue/Date Received 2021-10-04

[0138] At step 1118, the client then makes the payment by an online shopping app. The pay-ment may be made by credit card, debit card, PayPal, Google Pay, Apple Pay, Samsung Pay, WeChat Pay, or Alipay, or any other payment method accepted by the business through the online shopping app.

[0139] At step 1114, the client uses a user device such as a smartphone, a smartwatch, or any other device that is capable of associating with various payment methods, such as Google Pay, Samsung Pay, Apple Pay, NFC-enabled gift card or membership card storing information about pre-loaded cash or any other direct payment method. In some embodiments, when the item is provided with an NFC label system as discussed earlier, the client taps the user device on the NFC label system, whether the NFC module of the label system is disposed on a shelf corre-sponding to the item or on the item, the item is identified. The item is then placed in the user's shopping carrier.

[0140] In step 1120, payment is then made through the NFC-enabled label system which has payment processing feature. In some embodiments, the NFC-enabled system is the label system .. 400 as discussed elsewhere in this disclosure.

[0141] If the client decides to pick up a shopping cart from the shop, the client may utilize the AI-enabled shopping cart at step 1116. In some embodiments, the shopping cart is installed with AI-enabled imaging system, which may have visible light, infra-red, laser, and/or hyperspectral imaging capabilities, and weighing device such as scale that weighs an item when it is placed in or removed from the shopping cart. When an item needs to be weighed, the item is identified us-ing the AI-enabled imaging system and weighed. For example, the item is identified using image and/or spectrum comparison.

[0142] An example of the AI-enabled shopping cart is the shopping cart 700.

[0143] When the client finishes shopping, payment will be processed automatically at step 1122.

[0144] After making the payment, the client checks out at step 1124.

[0145] After check out, one or more anti-theft steps is effected to prevent shop-lifting.

[0146] In step 1126, the weight of the client when the client enters the store is compared with the weight of the client after check out. The difference is compared to the total weight of the Date Recue/Date Received 2021-10-04 items the client paid for. If the difference is not the same as the total weight of the items the cli-ent paid for or the difference differs from the total weight of the items the client paid above a predetermined threshold, an alert is triggered, for example, an audio and/or visual alert.

[0147] In step 1128, images of the client entering the shop and images of the client after checkout are compared to determine whether there is a difference. If there is a difference, the dif-ference is used to identify the quantity of items. The quantity is compared with the number of items that the client purchased. If there is difference, an alert is triggered, for example, an audio and/or visual alert. The images may be laser, infra-red, and/or hyperspectral images.

[0148] In step 1130, images of the client entering the shop and images of the client after checkout are compared to determine whether there is a difference. If there is a difference, the dif-ference is compared to the characteristics of the items the client purchased.
If the difference is different from the characteristics, an alert is triggered, for example, an audio and/or visual alert.
For example, the images may be spectral images and the difference, if there is any, is compared to the spectral images of the items purchased. The spectral images may be laser, infra-red, or hy-perspectral images.

[0149] The preceding discussion provides many exemplary embodiments. Although each em-bodiment represents a combination of elements, other examples may include all suitable combi-nations of the disclosed elements. For example, if one embodiment comprises elements A, B, and C, and a second embodiment comprises elements B and D, other remaining combinations of A, B, C, or D, may also be used.

[0150] Although the disclosure has been provided in some detail for purposes of clarity of understanding, it will be apparent that certain changes and modifications can be practiced within the scope of the appended claims. Accordingly, the present embodiments are merely illustrative and not restrictive, and the disclosure is not to be limited to the details given, but may be modified within the scope and equivalents of the appended claims.
Date Recue/Date Received 2021-10-04

Claims (48)

1. A method for shopping in a physical store, the method comprising:
a) picking an item by a customer;
b) identifying the item using an identification system;
c) adding the item to a virtual shopping cart;
d) adding a price of the item to a total price associated with the virtual shopping cart us-ing at least one processor device;
e) removing information of an unpicked item from the virtual shopping cart and deduct-ing the price of the unpicked item from the total price using the at least one processor device if the customer unpicks the unpicked item;
f) repeating steps a) to e) until the customer is ready to check out; and g) making a payment for items in the virtual shopping cart via a payment system opera-tively connected to the at least one processor device.

2. The method of claim 1, further comprising, before a):
1), identifying the customer and associate the customer with a customer server or the at least one processor device.

3. The method of claim 2, wherein the identification of the customer comprises:
obtaining identification information associated with the customer by a device con-figured to obtain identification information associated with the customer; and transmitting, by the device, to a customer database operatively connected to the device, the customer database including identification information of customers associated with the store; and comparing the identification information associated with the customer with the identification information of the customers associated with the store.

4. The method of claim 3, wherein the device is a user device having an application in-stalled thereon, and the identification information associated with the customer is ob-tained by the customer logging into the application on the user device.

5. The method of claim 3, wherein the identification information associated with the cus-tomer is obtained from a membership token that includes the identification information associated with the customer.

Date Recue/Date Received 2021-10-04

6. The method of claim 3, wherein the identification information associated with the cus-tomer is facial image, human body spectrum, or biological characteristics.

7. The method of claim 7, wherein the biological characteristics comprises a fingerprint.

8. The method of any one of claims 1 to 7, wherein the identification system comprises:
an information receiver device for obtaining information associated with the item;
an information transmitter device for transmitting the information associated with the item.

9. The method of claim 8, wherein the information transmitter device is operatively con-nected to an information database configured to provide the information associated with the item to the information transmitter device.

10. The method of claim 9, wherein the information receiver device and the information transmitter device communicate by near field communication (NFC).

11. The method of any one of claims 9 to 10, wherein the information transmitter device comprises a display module for showing the information associated with the item.

12. The method of any one of claims 8 to 11, wherein the information associated with the item comprises one or more of price information of the item, item description, and expi-ration date of the item.

13. The method of any one of claims 1 to 7, wherein the identification system comprises:
an image capture device configured to capture at least one image of the item;
and an item database operatively connected to the image capture device, the item data-base includes images of items in the physical store such that the at least one image of the item is compared with the images of items in the item database to effect the identification of the item.

14. The method of claim 13, wherein the image capture device is a hyperspectral imaging de-vice, a laser imaging capture device, or an infra-red imaging device.

15. The method of any one of claims 1 to 15, further comprising:
h), verifying the total price paid is the same as a price calculated for the items in the shopping cart.

Date Recue/Date Received 2021-10-04

16. The method of any one of claims 1 to 15, wherein, in step d), the price of the item is ob-tained by obtaining weight of the item and calculating price of the item.

17. The method of any one of claims 1 to 16, further comprising:
step aa) before step a), obtaining an entrance characteristic of the customer;
and after step g):
gl) obtaining an exit characteristic of the customer;
g2) comparing the entrance characteristic and the exit characteristic to identify an exit difference;
g3) providing an alert when the exit difference is above a predetermined thresh-old.

18. The method of claim 17, wherein the entrance characteristic comprises an entrance weight;
the exit characteristic comprises an exit weight; and the exit difference comprises a difference between the entrance weight and the exit weight; and comparing the entrance characteristic and the exit characteristic comprises:
calculating a total weight of the items paid for, and comparing the total weight and the exit difference.

19. The method of claim 18, wherein the predetermined threshold is that the exit difference is within 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, or 1% of the total weight of the items paid for.

20. The method of any one of claims 17 to 19, wherein the entrance characteristic comprises an entrance hyperspectral image of the customer;
the exit characteristic comprises an exit hyperspectral image; and comparing the entrance characteristic and the exit characteristic to identify the exit differ-ence comprises:
identifying exit items or a number of the exit items based on the exit difference;
and comparing the exit items with the items paid for or comparing the number of the exit items with a number of the items paid for.

21. The method of claim 20, wherein Date Recue/Date Received 2021-10-04 the predetermined threshold is that there is a difference between the exit items and the items paid for or between the number of exit items and the number of the items paid form.

22. A device for shopping in a physical store, the device comprising:
a near-field communication (NFC) module for communicating with a user device config-ured for NFC communication;
a display module for displaying information about a respective product;
the NFC module and the display module are operatively connected to a display server that is configured to update the information; and the NFC module is operatively connected to a payment server that is configured to pro-cess a payment by using payment information received by the NFC module from the user device.

23. The device of claim 21, wherein the device is configured to be disposed on a shelf corre-sponding to the respective product.

24. The device of claim 21, wherein the device is configured to be disposed on the product.

25. A system for shopping in a store, the system comprising:
a hyperspectral module configured to obtain a hyperspectral image of an entity; and a hyperspectral server operatively connected to the hyperspectral module, the hyperspec-tral server is configured to identify the entity from the hyperspectral image.

26. The system of claim 24, wherein the hyperspectral server identifies the entity by compar-ing the hyperspectral image of the entity with images stored at a database operatively connected to the hyperspectral server.

27. The system of claim 24 or 25, wherein the hyperspectral module is placed proximal to a shelf in the store such that obtaining the hyperspectral image of the product is effected when the product is removed from the shelf by a customer or replaced on the shelf.

28. The system of claim 24 or 25, wherein the entity is a customer, and the hyperspectral module is placed proximal an entrance of the store such that obtaining the hyperspectral image of the customer is effected when the customer enters the store.

29. A device for shopping in a store, the device comprising:
an information module for obtaining information of a product;
a battery; and Date Recue/Date Received 2021-10-04 a charging module for charging a user device.

30. The device of claim 28, wherein the charging module comprises a receptacle for receiv-ing the user device.

31. The device of claim 28 or 29, wherein the charging module is configured for wireless charging.

32. The device of any one of claims 28 to 30, wherein the user device is a phone.

33. The device of any one of claims 28 to 31, wherein the information module comprises an optical scanning module for reading information from an optical machine-readable repre-sentation.

34. The device of any one of claims 28 to 31, wherein the information module is an NFC-en-abled module for receiving information from an NFC-enabled device.

35. The device of claim 33, wherein the information module is configured for receiving pay-ment information.

36. A method for cashier-less shopping in a physical store, the method comprising:
a) picking an item by a customer;
b) identifying the item using an identification system; and c) paying for the item.

37. The method of claim 35, further comprising, before a):
1), identifying the customer and associate the customer with a customer server or the at least one processor device.

38. The method of claim 35 or 36, wherein the identification of the customer comprises:
obtaining identification information associated with the customer by a device con-figured to obtain identification information associated with the customer; and transmitting, by the device, to a customer database operatively connected to the device, the customer database including identification information of customers associated with the store; and comparing the identification information associated with the customer with the identification information of the customers associated with the store.

39. The method of claim 37, wherein the device is a user device having an application in-stalled thereon, and the identification information associated with the customer is ob-tained by the customer logging into the application on the user device.
Date Recue/Date Received 2021-10-04

40. The method of claim 37, wherein the identification information associated with the cus-tomer is obtained from a membership token that includes the identification information associated with the customer.

41. The method of claim 37, wherein the identification information associated with the cus-tomer is facial image, human body spectrum, or biological characteristics.

42. The method of claim 40, wherein the biological characteristics comprises a fingerprint.

43. The method of any one of claims 35 to 41, wherein the identification system comprises:
an information receiver device for obtaining information associated with the item;
an information transmitter device for transmitting the information associated with the item.

44. The method of claim 42, wherein the information transmitter device is operatively con-nected to an information database configured to provide the information associated with the item to the information transmitter device.

45. The method of claim 42, wherein the information receiver device and the information transmitter device communicate by near field communication (NFC).

46. The method of claim 44, wherein the information transmitter device is configured to re-ceive payment information from the information receiver device such that a payment for the item is effected.

47. The method of any one of claims 43 to 45, wherein the information transmitter device comprises a display module for showing the information associated with the item.

48. The method of any one of claims 42 to 46, wherein the information associated with the item comprises one or more of price information of the item, item description, and expi-ration date of the item.

Date Recue/Date Received 2021-10-04