TW202006628A - Smart store shopping system and purchasing method using thereof - Google Patents

Abstract

A smart store shopping system and purchasing method using thereof are disclosed. The smart store shopping system includes an identification access device, a virtual shopping cart module, a tracking device, and a check-out device. When a consumer enters the smart store, a shopping code is created for the consumer to start the virtual shopping cart module. And, using a body image taken during entering the smart store, it is possible to track the movement and moving path of the consumer in the smart store. All products taken by the consumer in the smart store will be automatically identified and added to the virtual shopping cart. After checkout, the check-out device would check whether the physical products at the time of checkout are as the same as the purchased product information recorded in the virtual shopping cart, and the check-out device would mark separately for the products paid and unpaid.

Description

Smart store shopping system and shopping method using the same

The present invention relates to a smart store shopping system and a shopping method using the same, in particular, a smart store shopping system that automatically detects goods selected by consumers, and a shopping method using the smart store shopping system.

When consumers go to the store to buy goods, after selecting the goods they want to buy, they mostly use the clerk to operate the point of sales terminal (POS, Point of Sales) to check out and charge the goods, or wait for the clerk to make coffee or Other freshly brewed drinks. However, with the advancement of technology, various smart stores have emerged that do not require additional staff to check out.

For example, there is a fingerprint or palm print identification, or a mobile member account as a mechanism for identifying the entry and exit of the store, so as to understand the consumer information entering and exiting the store. After consumers purchase the goods, they then check out through the self-checkout counter and scan the RFID tags attached to the goods.

In one embodiment, the present invention provides a smart store shopping system, including an identification access device, a virtual shopping cart module, a dynamic tracking device, and a checkout device. The recognition access device will shoot the face image of the consumer entering the smart store, analyze the face image of the entrance to create and transmit the shopping code. The virtual shopping cart module communicates to identify the access device, and the virtual shopping cart module receives and transmits the shopping code. The dynamic tracking device communicates with the virtual shopping cart module, after receiving the shopping code, photographs and tracks a body image of the consumer corresponding to the shopping code, and detects at least one product purchased by the consumer corresponding to the body image Data, and send the shopping code corresponding to at least one commodity data to the virtual shopping cart module.

The checkout device is communicatively connected to the virtual shopping cart module, the checkout device shoots the checkout facial image and the commodity image, and transmits the checkout facial image to the virtual shopping cart module. Then, the virtual shopping cart module receives at least one item of product information corresponding to the shopping code corresponding to the admission facial image of the checkout facial image. The checkout device will analyze the commodity image to obtain and display the commodity information, and after receiving the checkout signal, calculate the settlement amount of the commodity information. After completing the request, compare the product information and at least one product information of the completed request. In addition, a payment note will be created for at least one product data that corresponds to the product information of the completed request, and an unpaid note will be created for at least one product data that does not correspond to the product information of the completed request, and then the payment note and the unpaid note Send to the virtual shopping cart module.

In addition, the present invention provides a shopping method in one embodiment, including: the recognition entry and exit device captures the entrance facial image of the consumer entering the smart store; the recognition entry and exit device analyzes the entrance facial image to create and transmit the shopping code to the virtual shopping cart Module; after receiving the admission facial image and shopping code, the virtual shopping cart module stores the admission facial image and shopping code, and sends the shopping code to the dynamic tracking device; the dynamic tracking device shoots and tracks the corresponding consumption according to the shopping code One of the body images, and detect at least one commodity data purchased by the consumer corresponding to the body image, and send the shopping code corresponding to the at least one commodity data to the virtual shopping cart module; the checkout device shoots and sends the checkout Facial image to the virtual shopping cart module, and at least one commodity data corresponding to the shopping code corresponding to the admission facial image of the checkout facial image is received from the virtual shopping cart module; the checkout device shoots the commodity image and analyzes it The product image is used to obtain the product information; after receiving the checkout signal, the checkout device calculates the checkout amount of the product information and compares the completed product information and at least one product data after completing the request; and the checkout device will Create a payment note for at least one product data that corresponds to the product information for the completed request, create an unpaid note for at least one product data that does not correspond to the product information for the completed request, and send the payment note and the unpaid note to the virtual Shopping cart module.

Through the above smart store shopping system and shopping method, when consumers enter the smart store, they will create a shopping code for the consumer to activate the virtual shopping cart module, and use the shopping code as the virtual shopping cart consumer code . In addition, the body images taken immediately after entering the store correspond to the shopping code to track the consumer's movements and dynamics in the smart store. After the consumer purchases the product in the smart store, the dynamic tracking device will recognize the information of the purchased product, and send the purchased product information corresponding to the consumer's shopping code to the virtual shopping cart module for storage. In other words, all consumers' purchase behaviors in smart stores will be automatically recognized and added to the virtual shopping cart. Finally, after checkout, it will be checked whether the physical goods at the time of checkout are the same as the information of the purchased goods originally recorded in the virtual shopping cart, and notes are made separately for the checked and unchecked goods.

In this way, consumers can capture facial images to enter the store for consumption, and use tracking body images to record items purchased by consumers. After the purchase is completed, you can check out through the checkout device at the self-checkout counter. Through the captured face and body images, you can record the information of the products purchased by consumers in the store, and store the purchased products. Further, you can also use the captured face and body images to track and analyze the shopping behavior from the time the consumer enters the smart store to leave the smart store to identify whether the consumer has taken the goods when purchasing. Payment, to achieve the function of double comparison.

The following describes in detail the detailed features and advantages of the present invention in the embodiments. The content is sufficient for anyone familiar with the relevant art to understand and implement the technical content of the present invention, and according to the contents disclosed in this specification, the scope of patent application and the drawings Anyone skilled in the relevant art can easily understand the purpose and advantages of the present invention.

Please refer to FIGS. 1 to 2. FIG. 1 is a schematic diagram of a smart store shopping system according to an embodiment of the invention, and FIG. 2 is a block diagram of a smart store shopping system according to an embodiment of the invention. The smart store system of this embodiment includes an identification access device 10, a virtual shopping cart module 20, a dynamic tracking device 30, and a checkout device 40. All modules or devices in the smart store shopping system can process or control data through one host, or multiple modules can be used to execute each module and device. The virtual shopping cart module 20 communicates with and recognizes the access device 10, the dynamic tracking device 30, and the checkout device 40, respectively.

When the consumer wants to enter the smart store 1 for consumption, the identification entry-exit device 10 shoots the entrance facial image of the consumer entering the smart store 1. After analyzing the entrance facial image, a shopping code is created based on the entrance facial image, and the entrance facial image and shopping code are transmitted to the virtual shopping cart module 20. In this embodiment, after acquiring the facial image of the entrance, image analysis technology can be used to distinguish facial images by analyzing and acquiring facial feature data. The used image analysis and recognition technology can be used now, so it will not be repeated here.

In this embodiment, the virtual shopping cart module 20 can be executed in conjunction with the host set in the smart store 1, or can be implemented by a host set separately. The virtual shopping cart module 20 will receive and store the entrance facial image and shopping code from the recognition access device 10. When the virtual shopping cart module 20 receives the admission face image and shopping code, it will create a personal virtual shopping cart for consumers based on the shopping code in the virtual shopping cart module 20, so as to make subsequent purchase records. Subsequently, the shopping code is transmitted to the dynamic tracking device 30 to activate the dynamic tracking device 30 to start tracking and dynamic tracking of consumers.

After receiving the shopping code, the dynamic tracking device 30 will shoot and start tracking the body image of the consumer corresponding to the shopping code, and detect at least one item of goods purchased by the consumer corresponding to the body image. And send at least one commodity data corresponding to the shopping code to the virtual shopping cart module 20.

For example, when a consumer takes a product from the shelf in the smart store 1, the dynamic tracking device 30 will recognize the product information that was taken, and know the consumer’s The shopping code is then associated with the product information and the shopping code and sent to the virtual shopping cart module 20. At this time, in the virtual shopping cart module 20, the consumer's virtual shopping cart will store a piece of purchased product information. If the consumer puts it back on the shelf after picking it up, the dynamic tracking device 30 will also recognize it accordingly, and notify the virtual shopping cart module 20 of this removal information to delete the data of the purchased item originally recorded in the virtual shopping cart. The dynamic tracking device 30 will continue to track all movements and dynamics of the consumer in the smart store 1 until the consumer leaves the smart store 1.

After the consumer completes the purchase, the checkout device 40 can be used for checkout. The consumer uses the checkout device 40 to shoot the checkout face image and the commodity image. At this time, the checkout device 40 transmits the checkout face image to the virtual shopping cart module 20, and receives from the virtual shopping cart module 20 the shopping code corresponding to the entry face image that is the same as the checkout face image At least one product information. Here, the method of comparing whether the images are the same face may be analysis and recognition using facial feature data through image analysis, or various conventional recognition methods, which will not be repeated here.

The checkout device 40 also analyzes the commodity image to obtain and display the commodity information, and after receiving the checkout signal, calculates the settlement amount of the commodity information. After completing the request, compare the product information and at least one product information of the completed request. Create a payment note for at least one product data corresponding to the product information of the completed request, create an unpaid note for at least one product data that does not correspond to the product information for the completed request, and send the payment note and the unpaid note To the virtual shopping cart module 20.

After the consumer uses the checkout device 40 to capture the product image of the purchased product and complete the checkout, the checkout device 40 will compare the checked-out product with the purchased product in the original virtual shopping cart to confirm Which commodities have completed checkout and which commodities have not completed checkout.

In this way, consumers can consume in the store by shooting face images and body images, and after the purchase is completed, they can check out through the checkout device 40 at the self-checkout counter. Through the captured face and body images, you can record the information of the products purchased by consumers in the store, and store the purchased products. Furthermore, the captured facial images and body images can also be used to track and analyze the shopping behavior from the time consumers enter the smart store 1 to leave the smart store 1. In addition, it can also identify whether the goods that consumers have taken when purchasing have been paid, so as to achieve the function of double comparison.

In further applications, the exit-entry device 10 can capture an exiting facial image when the consumer wants to leave the smart store 1 and send the exiting facial image to the virtual shopping cart module 20. The virtual shopping cart module 20 will confirm whether at least one item of product information corresponding to the shopping code corresponding to the entry facial image of the departure facial image has an unpaid note based on the departure facial image, and if so, send unchecked Notification to identify access device. In other words, for the consumer who wants to leave the scene, take the facial image and recognize it, and confirm whether there is a product marked as unchecked in the virtual shopping cart corresponding to this consumer, and if there is, it will be sent unopened Reminder of account notification to the identification access device 10.

After the recognition access device 10 receives this notification, it can use on-screen displays, light warnings, sound warnings, or other various prompting methods to remind consumers that there are products that have not been checked out, please complete the checkout or return the goods to Leave after waiting in place.

Next, the identification access device 10 will be further described. Please refer to FIG. 1 to FIG. 3 at the same time. FIG. 3 is a schematic diagram of an identification access device according to an embodiment of the present invention. The identification access device 10 includes an identification camera 11, a cassette door 12, a display device 13 and a controller 14. In FIGS. 1 and 3 of this embodiment, two sets of identification access devices 10 are taken as an example, but in other embodiments, only one set of identification access devices 10 may be installed depending on space and passenger flow requirements. More identification access devices 10 are installed. Each set of identification access devices 10 includes two identification cameras 11 for capturing facial images during entrance and exit. However, in other embodiments, only one recognition camera 11 may be provided, and the rotating or moving structure may be used so that the recognition camera 11 can capture facial images in different directions.

The controller 14 connects the identification camera 11, the gate 12 and the display device 13. The recognition camera 11 captures the face image of the entrance, and the image is analyzed by the controller 14. Subsequently, the controller 14 will create a shopping code based on the face image of the entrance and send the shopping code to the virtual shopping cart module 20. At the same time, the control gate 12 is opened to allow consumers to enter the smart store for consumption. In this embodiment, identification can also be combined with member data to record consumption data of each member or to perform debit and checkout based on the member's account, which will be described in detail later. However, regardless of whether they are a member or not, they can give a shopping code and create a virtual shopping cart by shooting face images to make purchases in the smart store 1.

When the consumer wants to leave the venue after completing the checkout, the device 10 needs to be identified through the identification. The recognition camera 11 will capture and capture the out-of-field facial image, and the image is analyzed by the controller 14. When the controller 14 receives the departure facial image, it sends the departure facial image to the virtual shopping cart module 20 to perform the aforementioned comparison confirmation. If an unchecked notification is received, the controller 14 will control the display device 13 to display a warning message and control the gate 12 to close. The warning message can be text, patterns, numbers, sound effects, etc. The present invention is not limited to this. For example, it can be displayed on the display device 13 that "you still have xx products that have not been settled, please return the products to their original positions, or proceed to checkout."

Next, we will explain how to proceed for the consumers who have already registered as members. The smart store shopping system of this embodiment may include the member server 50 to identify and enter the device 10 through communication connection. The member server 50 includes a database 51 and a verification module 52. The database 51 stores a plurality of member data. Each member data may include a member number, name, gender, date of birth, card information, facial image, and payment account information. The verification module 52 is connected to the database 51.

When the consumer wants to enter the smart store 1 and the recognition entry-exit device 10 performs face shooting, the recognition entry-exit device 10 may send the entrance facial image to the member server 50. When the member server 50 receives the face image of the admission, it compares the face images of each member's profile in the database 51. When all the face images of the members are compared with the face images of the admission face, the corresponding member information is found. Subsequently, the member server 50 transmits the member number corresponding to the facial image to the recognition access device 10. The identification access device 10 will be able to use the membership number as the shopping code for this consumer.

In this way, for consumers who are already members, they can use member numbers to associate consumption behaviors and records, and even store these records in the database 51 to analyze the consumption habits of members. Even members can review their past consumption content. For example, the member server 50 may store the member data corresponding to the time when the consumer enters the smart store 1 as the entrance time to record the date and time when each member entered the smart store 1 and so on. The member data corresponding to the purchasing process in the smart store 1 (for example, purchasing a moving thread, purchasing items, and originally intended but not yet purchased, etc.) may also be stored in the database 51. In this way, this can be used as a member's consumption time or habits analysis, and can be further applied. For example, if consumers almost always go to the smart store 1 to buy coffee at a specific time, they can prompt coffee-related preferential activities or messages before this specific time. Or for the products that consumers have bought or want to buy, they can also remind consumers of relevant preferential activities when there is a promotion, so as to increase consumers' willingness to come to the store for consumption.

Next, please continue to refer to FIGS. 1 and 2. The dynamic tracking device 30 of this embodiment includes a plurality of cameras 31 and a processor 32. The camera 31 is installed in the smart store 1 and is used to shoot and obtain a consumer's body image and at least one product image purchased. The plural cameras 31 can be installed at any position in the smart store 1, and even the cameras 31 can be installed on the shelves or the like. Thereby, no matter where the consumer walks to any location of the smart store 1, it can be photographed by the camera 31.

The processor 32 is connected to the camera 31. The camera 31 will continue to capture the images in the smart store 1 and send all the images to the processor 32 for analysis and processing. After receiving the image of the camera 31, the processor 32 analyzes the image of the product taken by the consumer in the image to obtain corresponding product information, and according to the body image, transmits the product code corresponding to the consumer's shopping code to the virtual shopping Car module 20. At this time, the consumer's virtual shopping cart will add this product information as a purchased product.

In addition, if the consumer puts the product back on the shelf instead of buying it, the processor 32 analyzes the image captured by the camera 31 to return the product to the shelf, and also analyzes the image of the product returned by the consumer in the image to obtain Corresponding product data, and according to the body image, will delete the information of this product data, corresponding to the consumer's shopping code to the virtual shopping cart module 20. In this way, the product information in the consumer's virtual shopping cart can be updated in real time.

In other embodiments, in addition to using the above-mentioned camera 31 for shooting and image analysis, a weight sensor on the shelf can also be used. When the consumer takes the product, he can sense it due to the weight change. The product at the corresponding location is purchased, and then the product purchased by the consumer is determined. In conjunction with the body image of the consumer captured by the camera 31, the identity of the consumer who purchased the product is determined to increase or decrease the product information on the consumer's virtual shopping cart.

In addition, in this embodiment, a multimedia device 60 may be further provided to communicate with the dynamic tracking device 30. Consumers can use the multimedia device 60 to operate various billing information to be paid, or to purchase various tickets, etc. After the multimedia device 60 receives the payment information (for example, the bill to be paid, the to-be-paid fee of the purchased ticket), it transmits the payment information to the dynamic tracking device 30. The dynamic tracking device 30 transmits the shopping code corresponding to the body image to the virtual shopping cart module 20 according to the body image captured during the operation of the multimedia device 60. In this way, the payment information can be added to the consumer's virtual shopping cart. When the consumer performs the checkout, if he forgets to input the payment information for payment, he can also use the checkout device 40 to remind the consumer that there is information about the payment to be paid, whether to pay the payment, etc.

Next, please refer to FIGS. 1, 2 and 4. FIG. 4 is a schematic diagram of a checkout device according to an embodiment of the present invention. The checkout device 40 of this embodiment includes a first camera 41, a second camera 42, a touch screen 43, and a control module 44. The control module 44 is connected to the first camera 41, the second camera 42 and the touch screen 43. The first camera 41 is used to capture and obtain the checkout facial image, and the control module 44 analyzes the checkout facial image. Subsequently, the control module 44 transmits the checkout facial image to the virtual shopping cart module 20 to perform the aforementioned checkout and compare whether there is any unchecked product data in the virtual shopping cart. If the consumer is not a registered member, he can only use the stored-value card, credit card, etc. to settle the bill. But if you are a member, you can have more payment methods, which will be explained in detail next.

In the case where the consumer is a member, after obtaining the checkout face image, the control module 44 may send it to the member server 50 to confirm whether the consumer who wants to checkout is a member, and if so, receive the corresponding checkout face The payment account information of the member of the video. Here, the checkout facial image is sent to the member server 50 for comparison to confirm whether it is a member. In addition, it can also be received by sending the checkout facial image to the virtual shopping cart module 20. Use the received shopping code to analyze whether it is a member. If yes, go to the member server 50 to obtain the payment account information of the member corresponding to the shopping code (ie, member code).

Subsequently, the product to be purchased is photographed through the second camera 42 and the product image is obtained. The control module 44 receives and analyzes the commodity image obtained from the second camera 42 to obtain commodity information, and transmits the commodity information to the touch screen 43 for display. When the touch screen 43 receives the checkout signal, the control module 44 will calculate the checkout amount based on the commodity information and request payment based on the payment account information. After the control module 44 completes the payment request, it can control the touch screen 43 to display the checkout completion information.

For example, after the consumer enters the store, they can purchase the goods they want to purchase, and after the purchase is completed, they can go to the checkout device 40 for checkout. When checkout is required, the consumer can first activate the checkout by touching the touch screen 43, or the first camera 41 can automatically activate the checkout after a certain period of time after sensing that the consumer is standing at a specific location . When the checkout process is started, the first camera 41 will capture the consumer's face to obtain the checkout facial image. The control module 44 analyzes the checkout facial image and sends the checkout facial image to the member server 50 to receive payment account data corresponding to the checkout facial image. After receiving the payment account data, the control module 44 will temporarily store this data for subsequent checkout and request for payment.

Then, after completing the face recognition process, the consumer can place the product to be purchased in the checkout scanning area 45, and the second camera 42 will shoot the checkout scanning area 45 to obtain the product image. The control module 44 receives and analyzes the product image obtained from the second camera 42 to obtain product information, and sends the product information to the touch screen 43 for display. The consumer can confirm whether the identified product information is correct through the touch screen 43. And if there is a product that you don’t want to buy, you can delete the product you don’t want to buy through the touch screen 43, or increase the number of products you want to buy.

After all the goods to be purchased are input, the consumer can input the checkout signal through the touch screen 43. The checkout signal can be an option button displayed on the touch screen 43 for the consumer to click. After the consumer enters the checkout signal, the control module 44 will calculate the checkout amount based on the commodity information and request the payment based on the previously received payment account data. After the control module 44 completes the payment request, it will control the touch screen 43 to display the checkout completion information.

In some embodiments, when the consumer inputs the checkout signal, the product information to be checked out and the product data received by the virtual shopping cart module 20 can also be compared at the same time. If there is a product that exists in the product data, and there is product information to be checked out, you can also pop up a prompt at this time to remind consumers that there are still some products to be checked out.

In this embodiment, the payment account data in the member data may be a cloud account data, and the cloud account data may correspond to a financial account, a stored-value card account, or a billing account. For example, if the cloud account data is set to correspond to the financial account, when the checkout request is made, a request for payment will be sent to the bank server of the financial account, and it will be completed when the return request successful signal is received Please pay. If the cloud account data is set to correspond to the stored-value card account, when making a checkout request, it will confirm to the card server of the stored-value card account whether there is enough stored-value amount for deduction. The card server sends a request for payment. After receiving the returned successful request signal, the request is completed.

If the cloud account data is set to correspond to the billing account, when the billing request is made, the billing amount will be sent to the server of the billing account. If the checkout amount meets the server's billing conditions, the server will store the billing account as a billing amount and send a payment request success signal to the checkout device 40. When the checkout device 40 receives the returned successful request for payment, the payment is completed. Here, the billing account can be set to link to the consumer's salary account, and the server can be set to schedule (for example, the 5th of each month) to the salary account to obtain payment corresponding to the billing amount currently stored in the billing account. In addition, after confirming the payment for the accounting amount, the server may reset the accounting amount in the accounting account to zero.

In other embodiments, the payment account data may also be a mobile payment information or a credit card information. When the checkout device 40 wants to make a payment, it makes a payment to the corresponding institution or bank based on the mobile payment information or credit card information.

Next, please refer to FIGS. 1 to 5, which are flowcharts of shopping methods executed by a smart store shopping system according to an embodiment of the present invention. The shopping method of this embodiment is applied to the aforementioned smart store shopping system, so the components, structure, and connection relationship of the smart store shopping system will not be repeated here.

When the consumer wants to enter the smart store 1 for consumption, he will first identify the entry-exit device 10 for store entry identification. The consumer will first stand in front of the recognition entry-exit device 10, so that the recognition entry-exit device 10 shoots the face image of the consumer who wants to enter the smart store (step S10). Subsequently, the recognition access device 10 analyzes the face image of the entrance to create and transmit a shopping code to the virtual shopping cart module 20 (step S11). At the same time, the identification access device 10 can control the gate 12 to open, allowing consumers to enter the smart store for consumption.

Next, after receiving the admission facial image and shopping code, the virtual shopping cart module 20 stores the admission facial image and shopping code, and transmits the shopping code to the dynamic tracking device 30 (step S12). When a consumer purchases a product in the store, the dynamic tracking device 30 captures and tracks the body image of the corresponding consumer according to the shopping code, and detects at least one item of data purchased by the consumer corresponding to the body image And send the shopping code corresponding to the at least one commodity data to the virtual shopping cart module 20 (step S13). After the consumer completes the purchase of the goods, he can go to the checkout device 40 to checkout.

The checkout device shoots and transmits the checkout facial image to the virtual shopping cart module, and receives from the virtual shopping cart module at least one product data corresponding to the shopping code corresponding to the admission face image of the checkout facial image (step S14). At the same time, the consumer places the purchased merchandise in the checkout scanning area 45, the checkout device 40 shoots the merchandise image, and analyzes the merchandise image to obtain merchandise information (step S15). After completing the input of all the products to be checked out, the consumer can input the checkout signal through the touch screen 43. After receiving the checkout signal, the checkout device 40 calculates the checkout amount of the commodity information and completes the payment (step S16). After completing the request, compare the product information and at least one product information of the completed request (step S17). The checkout device 40 creates a payment note for at least one product data corresponding to the product information of the completed request, creates an unpaid note for at least one product data that does not correspond to the product information for the completed request, and records the payment note and the unpaid The payment note is transmitted to the virtual shopping cart module 20 (step S18). In this way, the purchase and checkout of the goods purchased by the consumer are completed.

In this way, consumers can consume in the store by shooting facial images, and after the purchase is completed, they can check out through the checkout device 40 at the self-checkout counter. Through the captured face and body images, you can record the information of the products purchased by consumers in the store, and store the purchased products. Furthermore, the captured facial images and body images can also be used to track and analyze the shopping behavior from the time consumers enter the smart store 1 to leave the smart store 1. In addition, it can also identify whether the goods that consumers have taken when purchasing have been paid, so as to achieve the function of double comparison.

Further, when the consumer has purchased the goods to be purchased and completes the checkout to leave the smart store 1, in this embodiment, it is set to still need to leave through the identification access device 10. The identification access device 10 captures the exit facial image when the consumer wants to leave the smart store 1, and transmits the exit facial image to the virtual shopping cart module 20 (step S19). The virtual shopping cart module 20 confirms whether at least one item of product information corresponding to the shopping code corresponding to the entry facial image of the departure facial image has an unpaid note based on the departure facial image (step S20). If so, it sends a notification of non-payment to the identification access device 10 (step S21). After receiving the unchecked notification, the identification access device 10 controls the display device 13 to display a warning message and controls the gate 12 to close (step S21a). If not, the gate 12 is opened to allow the consumer to leave the smart store 1 (step S22).

Next, please refer to FIGS. 1 to 6 at the same time. FIG. 6 is a flowchart of identifying a member in a shopping method according to an embodiment of the present invention. In step S11, the identification and confirmation of whether it is a member can be performed again. After obtaining the consumer's entrance facial image in step S10, the recognition access device 10 transmits the entrance facial image to the member server 50 (step S111). The member server 50 compares the facial images of the plural member data stored in the database 51 (step S112). When the face image in the face image is compared to the entrance face image, the membership number corresponding to the face image is transmitted to the recognition access device 10 (step S113). The identification access device 10 uses the member number as a shopping code, and transmits the shopping code to the virtual shopping cart module 20 (step S114). Then, step S12 is executed successively.

In this way, for the consumers who are already members, they can use the member number to associate with the consumption behavior and records, and even store these records correspondingly in the database 51, so as to analyze the consumption habits of the members. Even members can review their past consumption content. For example, the member server 50 may store the member data corresponding to the time when the consumer enters the smart store 1 as the entrance time to record the date and time when each member entered the smart store 1 and so on. The member data corresponding to the purchasing process in the smart store 1 (for example, purchasing a moving thread, purchasing items, and originally intended but not yet purchased, etc.) may also be stored in the database 51. In this way, this can be used as a member's consumption time or habits analysis, and can be further applied. For example, if consumers almost always go to the smart store 1 to buy coffee at a specific time, they can prompt coffee-related preferential activities or messages before this specific time. Or for the products that consumers have bought or want to buy, they can also remind consumers of relevant preferential activities when there is a promotion, so as to increase consumers' willingness to come to the store for consumption.

In the process of consumers purchasing in the smart store 1, before performing the checkout procedure of step S15, it may further include inputting payment information such as bills or ticket purchases using the multimedia device 60. 7 is a flowchart of inputting payment information on a multimedia device in a shopping method according to an embodiment of the invention. As shown in FIG. 7, between step S13 and step S14, the consumer can use the multimedia device to input payment information such as payment or ticket purchase. The multimedia device 60 receives the payment information and transmits the payment information to the dynamic tracking device 30 (step S30). The dynamic tracking device 30 transmits the payment information corresponding to the shopping code to the virtual shopping cart module 20 according to the body image when operating the multimedia device 60 (step S31).

Please refer to FIG. 8 again. FIG. 8 is a flow chart of member checkout payment in a shopping method according to an embodiment of the present invention. When the consumer is a member and takes the goods to be purchased to the checkout device 40 for checkout, when the consumer touches the touch option on the touch screen 43 (such as checkout), he enters the checkout Account requisition procedures. The foregoing step S16 may include the checkout device 40 transmitting the checkout facial image to the member server 50 (step S16a). The member server 50 compares the facial images stored in the database 51, and when the facial images in the facial images are compared, the payment account data corresponding to the facial images is transmitted to the checkout device 40 (step S16b). After receiving the checkout signal, the checkout device 40 calculates the checkout amount and requests the checkout amount based on the payment account information (step S16c). Then, after completing the payment, the checkout device 40 displays the checkout completion information (step S16d). Then proceed to step S17.

In this way, for the registered members, after the purchase is completed, the checkout can be made through the checkout device 40 at the self-checkout counter, and the payment can be completed from the set payment account by shooting face images. In this way, even if the consumer does not carry any mobile device, cash, credit card or stored-value card, etc., he can purchase and pay for the goods in the smart store 1.

Although the present invention is disclosed as the foregoing embodiments, it is not intended to limit the present invention. Any person familiar with similar technology can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of patent protection shall be determined by the scope of the patent application attached to this specification.

1‧‧‧Smart store 10‧‧‧Identification access device 11‧‧‧Identification camera 12‧‧‧Box door 13‧‧‧Display device 14‧‧‧Controller 20‧‧‧Virtual shopping cart module 30‧‧‧ Dynamic tracking device 31 ‧ ‧ ‧ camera 32 ‧ ‧ ‧ processor 40 ‧ ‧ ‧ checkout device 41 ‧ ‧ ‧ first camera 42 ‧ ‧ ‧ second camera 43 ‧ ‧ ‧ touch screen 44 ‧ ‧ ‧ control module 45 ‧‧‧ Checkout scanning area 50 ‧‧‧ Member server 51 ‧ ‧ ‧ database 52 ‧ ‧ ‧ verification module 60 ‧ ‧ ‧ multimedia device S10 ‧ ‧ ‧ identify the entry and exit device to shoot the entrance of consumers who want to enter the smart store Facial image S11‧‧‧Identify the entry and exit device to analyze the entrance facial image to create and send shopping code to the virtual shopping cart module S12‧‧‧Virtual shopping cart module stores the entrance face after receiving the entrance facial image and shopping code Image and shopping code, and send the shopping code to the dynamic tracking device S13 ‧‧‧ The dynamic tracking device shoots and tracks the body image of the corresponding consumer according to the shopping code, and detects at least the purchase of the consumer corresponding to the body image A commodity data, and the shopping code corresponding to at least one commodity data is sent to the virtual shopping cart module S14 ‧‧‧ checkout device to shoot and send the checkout facial image to the virtual shopping cart module, and received from the virtual shopping cart module At least one product data of the shopping code corresponding to the entrance face image of the checkout face image S15‧‧‧ Checkout device shoots the product image, and analyzes the product image to obtain the product information S16‧‧‧ Checkout device receives After the checkout signal, calculate the checkout amount of the product information and complete the request S16a‧‧‧Checkout device sends the checkout face image to the member server S16b‧‧‧When the face image is compared to the checkout face image When the payment account data corresponding to the facial image is sent to the checkout device S16c ‧‧‧ After the checkout device receives the checkout signal, it calculates the checkout amount and performs the payment request based on the payment account information S16d‧‧‧Complete After payment, the checkout device displays the checkout completion information S17‧‧‧Compared completed product information and at least one product data S18‧‧‧Checkout device will correspond to at least one product data of the completed payment product information Create a payment note, create an unpaid note for at least one product data that does not correspond to the product information of the completed request, and send the payment note and the unpaid note to the virtual shopping cart module S19‧‧‧Identify the entry and exit device to the consumer When leaving the smart store, take the exit facial image and send the exit facial image to the virtual shopping cart module S20 ‧‧‧ The virtual shopping cart module confirms the same entry as the exit facial image according to the exit facial image Whether at least one product data of the shopping code corresponding to the face image has an unpaid note S21‧‧‧ Send an unchecked notification to the identification access device S21a‧‧‧ After the identification input and output device receives the unchecked notification, control the display device to display Warning message and control the gate to close S22‧‧‧Open the gate to let consumers leave the smart store S111‧‧‧Identify the access device Send admission face image to member server S112‧‧‧Member server comparison face image of plural member data stored in database S113‧‧‧When face image is compared to admission face image, send corresponding Member number of the facial image to the identification access device S114‧‧‧The identification access device uses the member number as the shopping code, and sends the shopping code to the virtual shopping cart module S30‧‧‧Multimedia device receives payment information, and sends payment information to Dynamic tracking device S31 ‧‧‧The dynamic tracking device sends the payment code corresponding to the shopping code to the virtual shopping cart module according to the body image when operating the multimedia device

[FIG. 1] is a schematic diagram of a smart store shopping system according to an embodiment of the invention; [FIG. 2] is a block diagram of a smart store shopping system according to an embodiment of the invention; [FIG. 3] is a schematic diagram of an identification access device according to an embodiment of the invention [FIG. 4] is a schematic diagram of a checkout device according to an embodiment of the present invention; [FIG. 5] is a flowchart of a shopping method performed using a smart store shopping system according to an embodiment of the present invention; [FIG. 6] is a present invention. Flowchart for identifying members in a shopping method according to an embodiment; [FIG. 7] is a flowchart of inputting payment information on a multimedia device in a shopping method according to an embodiment of the invention; and [FIG. 8] is a member in a shopping method according to an embodiment of the invention Flow chart of checkout payment.

1‧‧‧Smart Store

10‧‧‧Identify access device

11‧‧‧Identify the camera

12‧‧‧Box door

13‧‧‧Display device

31‧‧‧Camera

40‧‧‧Checkout device

60‧‧‧Multimedia device

Claims (20)

A smart store shopping system, including: an identification access device, shooting a face image of one of the consumers entering a smart store, analyzing the face image of the entrance to create and transmit a shopping code; a virtual shopping cart module, Communicate with the identification access device, the virtual shopping cart module receives and transmits the shopping code; a dynamic tracking device, communicate with the virtual shopping cart module, after receiving the shopping code, photograph and track the corresponding shopping code A body image of the consumer, and detects at least one product data selected by the consumer corresponding to the body image, and transmits the shopping code corresponding to the at least one product data to the virtual shopping cart module; and a The checkout device communicates with the virtual shopping cart module, and the checkout device captures a checkout face image and a commodity image, transmits the checkout face image to the virtual shopping cart module, and purchases from the virtual shopping cart module The car module receives the at least one commodity data corresponding to the shopping code corresponding to the entry facial image of the checkout facial image, analyzes the commodity image to obtain and display a commodity information, and after receiving a checkout signal , Calculate the checkout amount of one of the commodity information and after completing the payment, compare the completed commodity information and the at least one commodity data of the completed payment, which will correspond to the at least one commodity data of the completed commodity information Create a payment note, create an unpaid note on the at least one product data that does not correspond to the product information of the completed request, and send the payment note and the unpaid note to the virtual shopping cart module. The smart store shopping system as described in item 1 of the patent scope, wherein the identification access device takes an exit facial image when the consumer is about to leave the smart store, and transmits the exit facial image to the virtual shopping A vehicle module, the virtual shopping cart module confirms whether the at least one product information of the shopping code corresponding to the entry face image of the departure face image has the unpaid note according to the departure face image , If there is, send an unchecked notification to the identification access device. The smart store shopping system as described in item 2 of the patent application scope, wherein the recognition access device includes: at least one recognition camera for capturing and acquiring the entrance face image and the exit face image; a gate; a display device And a controller connected to the identification camera, the gate and the display device, when the controller receives the entrance facial image, analyzes the entrance facial image to create and transmit the shopping code, and controls the gate to open, When the controller receives the departure facial image, it transmits the departure facial image to the virtual shopping cart module, and after receiving the unchecked notification, controls the display device to display a warning message and controls the gate shut down. The smart store shopping system as described in item 1 of the patent application scope, wherein the dynamic tracking device includes: a plurality of cameras, installed in the smart store, used to capture and obtain the body image of the consumer and the purchased at least A commodity image; and a processor connected to the cameras, the processor receives and analyzes the at least one commodity image to obtain the corresponding at least one commodity information, and according to the body image, the at least one commodity information corresponds to shopping The code is sent to the virtual shopping cart module. The smart store shopping system as described in item 4 of the patent application scope further includes a multimedia device, which is communicatively connected to the dynamic tracking device, and when the multimedia device receives a payment information, transmits the payment information to the dynamic tracking device. The tracking device transmits the payment information corresponding to the shopping code to the virtual shopping cart module according to the body image when the multimedia device is operated. The smart store shopping system as described in item 1 of the scope of the patent application further includes a member server, which is connected to the identification access device in communication, and the member server includes: a database storing multiple member data, each of which is It includes a facial image and a membership number; and a verification module connected to the database, when receiving the entrance facial image from the recognition access device, compared to the facial images of the database, when the When the entrance facial image is compared in the facial image, the membership number corresponding to the facial image is transmitted to the recognition access device, so that the recognition access device uses the membership number as the shopping code. As described in item 6 of the patent application scope, the smart store shopping system, wherein each of the member information further includes a payment account information, the checkout device includes: a first camera, used to capture and obtain the checkout face image; A second camera to capture and obtain the product image; a touch screen to display the product information and receive the checkout signal; and a control module to connect the first camera, the second camera and the touch On the screen, the control module analyzes the checkout facial image and sends the checkout facial image to the member server to receive the payment account data corresponding to the checkout facial image. Two cameras receive and analyze the product image to obtain the product information, and send the product information to the touch screen, the control module receives the checkout signal from the touch screen, and calculates the checkout amount based on the product information , And make a payment based on the payment account data, the control module controls the touch screen to display a checkout completion information after completing the payment. The smart store shopping system as described in item 7 of the patent application scope, wherein the payment account data is a cloud account data, and the cloud account data corresponds to a financial account, a stored value card account, or a billing account. The smart store shopping system as described in item 8 of the patent application scope, wherein the billing account is linked to a payroll account, and a server of the billing account periodically obtains a billing amount stored in the billing account corresponding to the payroll account. The smart store shopping system as described in item 7 of the patent application scope, wherein the payment account information is a mobile payment information or a credit card information. A shopping method includes: a recognition entry and exit device photographing an entrance facial image of one of the consumers entering a smart store; the recognition entry and exit device analyzes the entrance facial image to create and transmit a shopping code to a virtual shopping cart module The virtual shopping cart module, after receiving the admission facial image and the shopping code, stores the admission facial image and the shopping code, and transmits the shopping code to a dynamic tracking device; the dynamic tracking device is based on the shopping code Capture and track a corresponding body image of the consumer, and detect at least one product data purchased by the consumer corresponding to the body image, and send the at least one product data corresponding to the shopping code to the virtual shopping Cart module; a checkout device shoots and transmits a checkout facial image to the virtual shopping cart module, and receives from the virtual shopping cart module the same as the entrance facial image corresponding to the checkout facial image The at least one commodity data of the shopping code; the checkout device shoots a commodity image and analyzes the commodity image to obtain a commodity information; the checkout device calculates a settlement of the commodity information after receiving a checkout signal Account for the amount and complete the payment; compare the product information and the at least one product data with the completed payment; and the checkout device will create a payment note corresponding to the at least one product data with the product information with the completed payment, Create an unpaid note for the at least one product data that does not correspond to the product information of the completed request, and send the payment note and the unpaid note to the virtual shopping cart module. The shopping method as described in item 11 of the patent application scope further includes: the identification access device captures an exit facial image when the consumer is about to leave the smart store, and transmits the exit facial image to the virtual shopping Cart module; the virtual shopping cart module confirms whether the at least one product information of the shopping code corresponding to the entry face image of the exit face image is the unpaid note according to the exit face image ; And if there is, send an unchecked notification to the identification access device. The shopping method as described in item 12 of the patent application scope further includes: after receiving the unchecked notification, the identification access device controls a display device to display a warning message and controls a gate to close. According to the shopping method described in item 12 of the patent application scope, the recognition access device includes: at least one recognition camera for capturing and acquiring the entrance face image and the exit face image; a gate; a display device; and a The controller is connected to the identification camera, the gate and the display device, and when the controller receives the entrance facial image, analyzes the entrance facial image to create and transmit the shopping code, and controls the gate to open when the control When receiving the departure facial image, the device transmits the departure facial image to the virtual shopping cart module, and after receiving the unchecked notification, controls the display device to display a warning message and controls the gate to close. The shopping method as described in item 11 of the patent application scope, wherein the dynamic tracking device includes: a plurality of cameras, installed in the smart store, for shooting and obtaining the body image of the consumer and the at least one product purchased Image; and a processor connected to the cameras, the processor receives and analyzes the at least one product image to obtain the corresponding at least one product information, and according to the body image, the at least one product information corresponding to the shopping code is transmitted To the virtual shopping cart module. According to the shopping method described in item 11 of the patent application scope, before the step of shooting and sending the checkout face image to the virtual shopping cart module by the checkout device, the method further includes: a multimedia device receives a payment information and transmits The payment information is sent to the dynamic tracking device; and the dynamic tracking device sends the payment information corresponding to the shopping code to the virtual shopping cart module according to the body image when the multimedia device is operated. The shopping method as described in item 11 of the patent application scope, wherein the step of the recognition-entry device analyzing the entrance face image to create and transmit the shopping code to the virtual shopping cart module includes: the recognition-entry device transmitting the entrance face Part of the image to a member server; the member server compares a face image of a plurality of member data stored in a database; when the face image is compared to the admission face image in these face images, the corresponding face is sent The member number of the image to the identification access device; and the identification access device uses the member number as the shopping code and transmits the shopping code to the virtual shopping cart module. The shopping method as described in item 17 of the patent application scope, wherein each of the member information further includes a payment account information, and the checkout device includes: a first camera to capture and obtain the face image of the checkout; a first Two cameras to capture and obtain the product image; a touch screen to display the product information and receive the checkout signal; and a control module to connect the first camera, the second camera and the touch screen, The receiving and transmitting the checkout facial image to the member server to receive the payment account data corresponding to the checkout facial image, the control module receives and analyzes the commodity image from the second camera to obtain the commodity Information, and send the product information to the touch screen, the control module receives the checkout signal from the touch screen, calculates the checkout amount based on the product information, and makes a payment based on the payment account data, the After completing the request, the control module controls the touch screen to display a checkout completion message. The shopping method as described in item 18 of the patent application scope, wherein the payment account data is a cloud account data, and the cloud account data corresponds to a financial account, a stored-value card account, or a billing account. The shopping method as described in item 19 of the patent application scope, wherein the billing account is linked to a payroll account, and a server of the billing account periodically obtains a billing amount corresponding to the payroll account from the payroll account.

Images