TWM560067U - Smart shop system - Google Patents

Abstract

A smart store system that includes a recognition entry and exit device, a checkout device, and a host. Consumers can register in advance to store facial features in the host. When the consumer wants to go to the smart store for consumption, the face image can be captured by the recognition and entry device for identification, and after the recognition is successful, the smart store can be entered to purchase the product. After the purchase is completed, the checkout device can be used to checkout at the self-checkout counter, and the payment can be completed from the set payment account by taking a facial image. In this way, consumers can purchase and pay for goods in a smart store even without carrying any mobile device, cash, credit card or stored value card.

Description

Smart store system

The present invention relates to a smart store system and a shopping method using the same, in particular, a smart store system that does not require a store clerk to enter the shopping and checkout by the consumer, and a shopping method using the smart store shopping system.

When you go to the store to buy goods, after the consumers choose the goods they want to buy, they usually use the clerk to operate the point of sale (POS) to check the goods and charge the goods, or wait for the clerk to make coffee or other. Fresh drinks. But with the advancement of technology, there are now a variety of different forms of smart stores that do not require additional staff to checkout.

For example, identification by fingerprint or palm print, or mobile phone member account as an identification mechanism for store access, to understand the consumer information into the store. When the consumer purchases the product, it then checks the account through the self-checkout counter and scans the RFID tag attached to the product.

In an embodiment, the present invention provides a smart store system, including a recognition access device, a checkout device, and a host. The recognition access device captures a first facial image and analyzes the first facial image to obtain and transmit an incoming facial feature data. Subsequently, after receiving a verification success signal, a gate is controlled to be turned on. The checkout device will capture a second facial image and a commercial image. After analyzing the second facial image, a checkout facial feature data is obtained and transmitted, and one of the corresponding checkout facial feature data is received to pay the account data. After analyzing the product image, obtain and display the product information. After receiving a checkout signal, a checkout amount is calculated and the checkout amount is requested based on the payment account information. A checkout completion message is displayed after the payment is completed.

The host communication connection recognizes the entry and exit device and the checkout device, and the host includes a database and a verification module. The database stores a plurality of member profiles, and each member profile includes facial feature data and payment account information. The verification module is connected to the database, and compares the facial feature data of the database when receiving the facial feature data. When the facial feature data is compared in the facial feature data, the verification success signal is transmitted to the identification access device. And comparing the face feature data of the database when receiving the checkout facial feature data. When the face feature data is compared to the checkout face feature data, the payment account data corresponding to the face feature data is transmitted to the checkout device.

In addition, the present invention provides a shopping method, including: a recognition access device captures a first facial image, and analyzes the first facial image to obtain and transmit an incoming facial feature data to a host; Comparing the facial feature data of one of the plurality of member data stored in a database; when comparing the face feature data to the facial feature data, transmitting a verification success signal to the identification access device; and identifying the access device receiving the verification success After the signal, the control gate is opened; a checkout device captures a second facial image, and analyzes the second facial image to obtain and transmit a checkout facial feature data to the host; the host compares the face stored in the database Part characteristic data, when the face feature data is compared to the checkout face feature data, one of the corresponding face feature data is transmitted to pay the account information to the checkout device; the checkout device takes a product image and analyzes the product image to Obtain and display the product information; after receiving the checkout signal, the checkout device calculates a checkout amount and performs the checkout amount according to the payment account information. ; And when done under the checkout device displays a checkout complete information.

Through the above-mentioned smart store system and shopping method, the consumer can register the face feature data in advance, and then the face image can be identified by the face image, and after the recognition is successful, the smart store can be selected for purchase. After the purchase is completed, the checkout device can be used to checkout at the self-checkout counter, and the payment can be completed from the set payment account by taking a facial image. In this way, consumers can purchase and pay for goods in a smart store even without carrying any mobile device, cash, credit card or stored value card.

The detailed features and advantages of the present invention are described in detail in the following detailed description of the embodiments of the present invention. Any related art and related art can easily understand the related purposes and advantages of the present invention.

Please refer to FIG. 1 to FIG. 4 . FIG. 1 is a schematic diagram of a smart store system according to an embodiment of the present invention. FIG. 2 is a block diagram of a smart store system according to an embodiment of the present invention. FIG. 3 is a schematic diagram of the identification and entry device and the registration of the present invention. FIG. 4 is a schematic view of a checkout device according to an embodiment of the present invention. The smart shop system of the present embodiment includes the identification access device 10, the checkout device 20, and the host computer 30. The smart store system can be all set up in a physical store, or the host 30 can be split into the headquarters, and connected to the identification access device 10 and the checkout device 20 installed in the physical store through network communication. In this embodiment, the host 30 is collectively disposed in the physical store, and the host 30 can communicate with the identification access device 10 and the checkout device 20 in a wired or wireless manner for data exchange or signal transmission.

As can be seen from FIG. 1 to FIG. 3, the identification access device 10 includes a first camera 11, a card door 12 and a controller 13. In FIG. 1 of the embodiment, the identification of the access device 10 is exemplified, but in other embodiments, only one set of the identification device 10 or more may be installed depending on the space and the demand of the passenger flow. The access device 10 is identified. The controller 13 connects the first camera 11 and the shutter 12. The first camera 11 captures a first facial image and sends it to the controller 13 for image analysis to obtain a corresponding facial feature data. Subsequently, the controller 13 transmits the incoming facial feature data to the host 30 for verification. Upon receiving the verification success signal from the host 30, the controller 13 controls the trick 12 to be turned on.

For example, when a consumer wants to go to a smart store to purchase a product, if the consumer has already completed the registration in advance, the user can enter the store before entering the store to identify the entry and exit device 10, and in the face recognition manner, enter the wisdom after completing the identification. store. The consumer needs to come to the designated position before the card 12 of the identification access device 10, and then face the face toward the first camera 11. The first camera 11 takes the face image of the consumer as the first face image and transmits it to the controller 13 for analysis to obtain the entry face feature data. Subsequently, the controller 13 transmits the incoming facial feature data to the host 30 for verification. When the host 30 sends a verification success signal, the controller 13 controls the trick 12 to open, allowing the consumer to enter the smart store.

In some embodiments, the identification access device 10 may further include a speaker (not shown). After the verification is successful, the controller 13 may also receive member information (such as a name) corresponding to the facial feature data from the host 30. And when the control trick 12 is turned on, the control speaker sends a welcome statement, such as "Mr. X/Miss, welcome" and the like.

Referring to FIG. 1 , FIG. 2 and FIG. 4 , the checkout device 20 of the embodiment includes a second camera 21 , a third camera 22 , a touch screen 23 , and a processor 24 . The processor 24 is connected to the second camera 21, the third camera 22, and the touch screen 23. The second camera 21 is configured to capture and acquire a second facial image, and the processor 24 analyzes the second facial image to obtain the checkout facial feature data. After obtaining the checkout facial feature data, the processor 24 transmits the checkout facial feature data to the host 30 to receive the payment account data corresponding to the checkout facial feature data.

Subsequently, the product to be purchased is photographed through the third camera 22 and the product image is obtained. The processor 24 receives and analyzes the product image obtained from the third camera 22 to obtain product information, and transmits the product information to the touch screen 23 for display. After the touch screen 23 receives the checkout signal, the processor 24 calculates the checkout amount based on the product information, and performs the payment according to the payment account information. When the processor 24 completes the payment, the touch screen 23 is displayed to display the checkout completion information.

For example, when the consumer enters the store, he or she can purchase the product to be purchased, and after the purchase is completed, the checkout device 20 can perform the checkout. When the bill is to be settled, the consumer may first initiate the checkout by touching the touch screen 23, or may automatically initiate the checkout after the user has sensed that the consumer has stood at a specific location for a certain period of time via the second camera 21. . When the checkout process is initiated, the second camera 21 will capture the face of the consumer to obtain a second facial image. The processor 24 analyzes the second facial image to obtain the checkout facial feature data, and transmits the checkout facial feature data to the host 30 to receive the payment account data corresponding to the checkout facial feature data. After receiving the payment account information, the processor 24 will temporarily store the data for subsequent billing request.

Then, after the face recognition process is completed, the consumer can place the item to be purchased in the checkout scanning area 25, and the third camera 22 will take the checkout scanning area 25 to obtain the product image. The processor 24 receives and analyzes the product image acquired from the third camera 22 to obtain product information, and transmits the product information to the touch screen 23 for display. Consumers can confirm whether the identified product information is correct through the touch screen 23. And if there is a product that does not want to be purchased, the touch screen 23 can also be used to delete the item that is not desired to be purchased, or to increase the quantity of the item to be purchased.

When all the items to be purchased are input, the consumer can input the checkout signal through the touch screen 23. The checkout signal can be clicked by the option button displayed on the touch screen 23. After the consumer enters the checkout signal, the processor 24 will calculate the checkout amount based on the commodity information, and make a payment according to the previously received payment account information. When the processor 24 completes the payment, the touch screen 23 will be displayed to display the checkout completion information.

In this embodiment, the payment account data may be a cloud account data, and the cloud account data may correspond to a financial account, a stored value card account, or a billing account. For example, if the cloud account information is set to correspond to the financial account, the payment request will be sent to the bank account of the financial account when the checkout payment is made, and the payment request is completed after receiving the returned payment success signal. Please pay. If the cloud account data is set to correspond to the stored value card account, when the checkout payment is made, the card server of the stored value card account will be confirmed whether there is enough stored value for the deduction, if any, The card server transmits the request for payment, and upon receiving the successful payment of the payment, the payment is completed.

If the cloud account data is set to correspond to the billing account, the checkout amount will be sent to the server of the billing account when the checkout payment is made. If the checkout amount meets the billing conditions of the server, the server will store the billing amount as a billing amount and transmit the payment success signal to the checkout device 20. When the checkout device 20 receives the returned payment success signal, the payment is completed. Here, the billing account can be set to be linked to the consumer's payroll account, and the server can be set to timed (eg, number 5 per month) to the payroll account to obtain a payment corresponding to the billing amount currently stored in the billing account. And, after confirming the amount of the billing amount, the server resets the billing amount in the billing account to zero.

In other embodiments, the payment account information may also be an action payment information or a credit card information. When the checkout device 20 is to make a payment, the payment is made to the corresponding institution or bank based on the action payment information or credit card information.

Referring to FIG. 2, in the embodiment, the host 30 includes a database 31 and a verification module 32. The database 31 stores a plurality of member materials, and each member data may include a member serial number, a name, a gender, a date of birth, card information, payment account information, facial feature data, and payment account information. The verification module 32 is connected to the database 31. When the consumer wants to enter the smart store and recognizes the entry and exit device 10 for face shooting. When receiving the facial feature data, the host 30 compares the facial feature data of each member data in the database 31. When the same face feature data as the entry face feature data is compared in all facial feature data, the verification is successful. The verification module 32 transmits a verification success signal to the identification access device 10.

At the same time, the host 30 can also store the time corresponding to the member's authentication as the entry time to record the date and time of each member entering the smart store. Further, this can be used as a member's consumption time analysis, and can be further applied. For example, if the consumer purchases the coffee almost at a specific time to the smart store, the coffee-related offers or messages can be presented before the specific time to further increase the consumer's willingness to shop.

When the consumer wants to perform checkout and the face check device 20 performs face shooting, the host 30 compares the facial feature data of each member profile in the database 31 when receiving the checkout face feature data. When the same face feature data as the checkout face feature data is compared in all the face feature data, the member profile corresponding to the face feature data (ie, the member profile of the consumer) can be found. Subsequently, the verification module 32 transmits the payment account information in the member profile to the checkout device 20 for subsequent checkout payment.

Through the above-mentioned smart store system, the consumer can register the face feature data in advance, and then the face image can be identified by the face image, and after the recognition is successful, the smart store can be selected for purchase. After the purchase is completed, the checkout device 20 can perform checkout at the self-checkout counter and complete the payment from the set payment account by taking a facial image. In this way, consumers can purchase and pay for goods in a smart store even without carrying any mobile device, cash, credit card or stored value card.

Referring to FIG. 1 to FIG. 3 again, the smart store system of this embodiment may further include a registration device 40 and a third-party server 50. The registration device 40 is communicatively coupled to the host 30 and the third party server 50. The third party server 50 stores a plurality of accounts and passwords and account data corresponding to each account. Account information can include member ID, name, gender, date of birth, card information, and payment account information. When the consumer has not finished registering, the smart store cannot be accessed via face recognition or the like. At this time, the registration device 40 can be used to register and register the data.

The registration device 40 includes an input device 41, a fourth camera 42, and a login host 43. The registration host 43 connects the input device 41 and the fourth camera 42. After the input device 41 receives a login account and a login password, the login host 43 receives and transmits the login account and the login password to the third party server 50 for verification. When the third-party server 50 compares the received login accounts and finds the corresponding account, and confirms that the password corresponding to the account is the same as the login password, the verification is successful. When the verification is successful, the third party server 50 transmits the account data corresponding to the account to the login host 43.

At the same time, the fourth camera 42 will capture and acquire a facial image. The login host 43 receives the facial image and analyzes and obtains the corresponding facial feature data. Subsequently, the account data is stored corresponding to the facial feature data and transmitted to the host 30 for storage as a new member data. In this way, the consumer's data is stored in the member profile of the host 30, and the consumer can enter the smart store for shopping.

In addition, in this embodiment, if the consumer has been unable to recognize the success through the face recognition method, the card can be used to enter the smart store. Referring to FIG. 1 to FIG. 3 simultaneously, the identification access device 10 may further include a card reader 14 connected to the controller 13. After the consumer's face recognition fails, the registered card can be placed on the card reader 14 to use the card to enter the smart store. After the card reader 14 of the discriminating device 10 recognizes the card and receives an incoming card data, the controller 13 transmits the card data to the host 30 for verification. The verification module 32 of the host 30 compares the card data of each member data in the database 31 when receiving the card data. When the card data identical to the entry card data is compared in all the card materials, the verification success signal is transmitted to the identification access device 10. After the access device 10 is recognized to receive the verification success signal, the control gate 12 is opened. In this way, it is also possible to avoid the problem that the consumer may directly leave because the face recognition fails to enter the store.

Although the present invention is disclosed above in the foregoing embodiments, it is not intended to limit the present invention. Any one skilled in the art can make some modifications and retouchings without departing from the spirit and scope of the present invention. The scope of patent protection shall be subject to the definition of the scope of the patent application attached to this specification.

10‧‧‧ID access device
11‧‧‧First camera
12‧‧‧匣
13‧‧‧ Controller
14‧‧‧ card reader
20‧‧‧Checkout device
21‧‧‧Second camera
22‧‧‧ Third camera
23‧‧‧ Touch screen
24‧‧‧ Processor
25‧‧‧Checkout scanning area
30‧‧‧Host
31‧‧‧Database
32‧‧‧ verification module
40‧‧‧Registered device
41‧‧‧ Input device
42‧‧‧Fourth camera
43‧‧‧Login host
50‧‧‧ Third-party server

1 is a schematic diagram of a smart store system according to an embodiment of the present invention; [FIG. 2] is a block diagram of a smart store system according to an embodiment of the present invention; [FIG. 3] FIG. 3 is a schematic diagram of an identification access device and a registration device according to an embodiment of the present invention; FIG. 4 is a schematic view of a checkout device according to an embodiment of the present invention.

Claims (10)

A smart shop system, comprising: a recognition access device, taking a first facial image, analyzing the first facial image to obtain and transmit an incoming facial feature data, and controlling a gate after receiving a verification success signal Turning on; a checkout device, taking a second facial image and a product image, analyzing the second facial image to obtain and transmit a checkout facial feature data, and receiving payment corresponding to one of the checkout facial feature data Account information, analyzing the product image to obtain and display a product information, after receiving a checkout signal, calculating a checkout amount and performing the settlement amount payment according to the payment account data, and displaying after the payment is completed a checkout completion information; and a host that communicatively connects the identification access device and the checkout device, the host includes: a database storing a plurality of member materials, each of the member materials including a facial feature data and the payment Account data; and a verification module connected to the database, the facial features of the database are compared when receiving the facial feature data And, when the facial feature data is compared in the facial feature data, transmitting the verification success signal to the identification access device, and comparing the data to the database when receiving the checkout facial feature data And the facial feature data is sent to the checkout device when the face feature data is compared to the checkout face feature data. The smart shop system of claim 1, wherein the identification access device comprises: a first camera for capturing the first facial image; the gate; and a controller connecting the first camera And the gate, the controller receives and analyzes the first facial image to obtain the facial facial feature data, and transmits the facial facial feature data, and controls the gate to be opened after receiving the verification success signal. The smart store system of claim 1, wherein the checkout device comprises: a second camera for capturing and acquiring the second facial image; and a third camera for capturing and obtaining the product a touch screen for displaying the product information, receiving the checkout signal, and receiving and displaying the checkout completion information; and a processor connecting the second camera, the third camera, and the touch screen, The processor analyzes the second facial image to obtain the checkout facial feature data, and transmits the checkout facial feature data to the host to receive the payment account data, and the processor receives and analyzes from the second camera The product image is used to obtain the product information, and the product information is transmitted to the touch screen. The processor receives the checkout signal from the touch screen, and calculates the checkout amount according to the product information, and according to the payment account. The data is requested. After the processor completes the payment, the processor controls the touch screen to display the checkout completion information. The smart store system of claim 1, further comprising a registration device and a third-party server, the registration device communicatively connecting the host and the third-party server, the third-party server storing a plurality of accounts and Corresponding to a password corresponding to the account, the registration device includes: an input device that receives a login account and a login password; a fourth camera that captures and obtains a facial image; and a login host that connects the input device and The fourth camera transmits the login account and the login password to the third-party server for verification, and after receiving the verification, receives an account data corresponding to the login account, and the login host receives the facial image and analyzes and obtains the corresponding information. The facial feature data is stored and transmitted to the host corresponding to the facial feature data, and is stored as a new member data, wherein the account information includes the payment account data. The smart store system of claim 4, wherein the account information comprises a card material. The smart store system of claim 1, wherein the payment account data is a cloud account data, and the cloud account data corresponds to a financial account, a stored value card account or a billing account. The smart store system of claim 6, wherein the billing account is linked to a payroll account, and one of the billing accounts periodically waits until the payroll account obtains a billing amount corresponding to the billing account, and After the billing amount is obtained, the billing amount in the billing account is zeroed. The smart store system of claim 1, wherein the payment account information is an action payment information or a credit card data. The smart store system of claim 1, wherein each member data further includes a card data, and the identification access device transmits the admission card data to the host for verification after receiving an admission card data, the host The verification module transmits the verification success signal to the identification access device when comparing the card data of the database with the card data of the database when the card data is received. The identification access device controls the gate to open after receiving the verification success signal. The smart store system of claim 9, wherein the host stores an entry time corresponding to the member data after the verification is successful.