TWM560634U - Display system with image recognition and combined with multimedia-based shopping - Google Patents

Abstract

The present invention provides a display system with image recognition and multimedia shopping, comprising at least one display stand for placing goods, wherein each display frame comprises: an image capturing device for capturing a facial image of a user a controller electrically connected to the image capturing device, receiving the facial image and performing face recognition, searching for at least one of the plurality of product advertisements corresponding to the facial image according to at least one setting condition; and displaying a screen, The utility model is electrically connected to the controller, and displays a product advertisement corresponding to the facial image and a corresponding product barcode for the user to scan the commodity barcode by using the mobile device for purchase or pre-purchase. Therefore, the user can view the recommended product advertisement in the physical storefront, and scan the barcode displayed on the screen for online order purchase, so that the user can purchase the product at the store.

Description

Display system with image recognition and multimedia shopping

This creation is about a display stand, especially a display system with image recognition and multimedia shopping.

According to changes in consumer habits, people are becoming more accustomed to using e-shopping, such as shopping for goods online at home, or paying for software payments with actions in mobile devices when buying at physical stores.

The advantage of the physical storefront is that you can directly see the real product, but when the same type of goods are numerous, the consumer does not know which one is more suitable. It needs the clerk to recommend or use the mobile phone to query the Internet, but it is a waste of time. In addition, the physical storefront also has the problem that the checkout crowd needs to wait in line for a long time. If you can take the goods in the physical storefront, but directly checkout on the mobile device, it will greatly save the time required for the consumer to checkout, and also reduce the store personnel. The burden of cost.

Therefore, this creation proposes a display system with image recognition and multimedia shopping to effectively solve the above problems. The specific architecture and its implementation will be detailed below:

The main purpose of the present invention is to provide a display system with image recognition and multimedia shopping, which is provided with a display module with image recognition and advertisement push function on the display stand to identify the user's facial features and recommend product advertisements. Increase the user's desire to purchase.

Another object of the present invention is to provide a display system with image recognition and multimedia shopping, which links the product advertisement and product barcode displayed on the shelf with the shopping application in the mobile device, and scans the product barcode with the mobile device. You can make purchases or pre-orders with mobile devices in the store.

To achieve the above objective, the present invention provides a display system with image recognition and multimedia shopping, comprising at least one display stand for placing goods, wherein each display frame comprises an image capturing device, a controller and a Displaying a screen, the image capturing device is configured to capture a facial image of a user; the controller is electrically connected to the image capturing device, receives the facial image and performs face recognition, and searches for the plurality of commercial advertisements according to at least one setting condition. At least one of the matching with the facial image is displayed; the display is electrically connected to the controller, and the product advertisement corresponding to the facial image and the corresponding product barcode are displayed for the user to scan the commodity barcode by using the mobile device for purchase or pre-purchase.

The controller is disposed in the square housing behind the display screen.

The at least one setting condition includes a gender and an age range.

A speaker is arranged on the display screen to play the sound of the product advertisement for promotion and sound guide.

The present invention further includes a checkout host, which is disposed on the display frame, and the signal is connected to at least one backend server. When the user does not carry the mobile device, the user operates the checkout host to purchase or pre-order .

In conclusion, the checkout host is located on the island deck of one of the display stands. The checkout host is a touch-sensitive host or a general computer host.

The checkout host includes a scanner that scans a two-dimensional bar code of the package to be entered into the checkout host. A display device is set on the checkout host to display a checkout amount.

In the present invention, the mobile device is provided with a shopping application, and the bar code scanning function of the shopping application is used to scan the product barcode of the product, and the product is added to the shopping cart of the shopping application. in.

The user selects a payment method in the shopping application of the mobile device, and the payment method includes credit card payment, transfer, cash on delivery, pick up payment, and the like.

The user selects a picking method in the shopping application of the mobile device, and the picking method includes home delivery, mailing, and self-collection.

In an embodiment of the present invention, the commodity barcode is a QR code.

In an embodiment of the present invention, the controller is connected to the at least one back-end server signal through the network, and the feature recognized by the facial image of the user, the at least one product advertisement, and the The user's purchase record is transmitted to the at least one backend server for statistical and big data analysis.

The display screen is a general display or a touch screen. When the display screen is a touch screen, a plurality of function buttons are displayed on the display screen for the user to click.

The image capturing device is a camera, a camera or a webcam.

The present invention provides a display system with image recognition and multimedia shopping. Please refer to FIG. 1 and FIG. 2 simultaneously, which are perspective views and blocks of an embodiment of a display system 10 for image recognition and multimedia shopping. The image recognition and multimedia shopping display system 10 of the present invention includes a display frame 12 for placing merchandise. The display frame 12 includes an image capturing device 14, a controller 16 and a display screen 18, and the image is displayed. The device 14 is a camera, a camera or a webcam (Webcam) for capturing a facial image of a user; the controller 16 is a computer with a computing function and is electrically connected to the image capturing device 14 Receiving the facial image captured by the image capturing device 14 and performing face recognition. In addition, the controller 16 stores a plurality of commercial advertisements, and is configured to have at least one setting condition, such as gender, age interval, etc., different. The gender and age layer will respond to at least one suitable product advertisement, and the controller 16 searches for the at least one product advertisement corresponding to the user's facial image from the product advertisements according to the setting conditions; the display screen 18 is electrically connected. The device 16 displays the product advertisement corresponding to the face image, and also displays the product barcode corresponding to the product advertisement. In one embodiment of the present creation, the product barcode is a graphic Barcode (QR code), for the user using a mobile device (not shown) for later scanned product code or pre-order.

In the present creation, the controller 16 is disposed in the square housing behind the display screen 18. It can also be hidden in the display stand 12 independently of the display screen 18.

A display 19 is disposed on the display screen 18 for playing the sound of the product advertisement for promotion and sound guide. The display screen 18 is a general display or a touch screen, and is arranged in an upright manner in the embodiment of Fig. 1. When the display screen 18 is a touch screen, a plurality of function buttons, such as "popular goods", "student area", "latest pre-order", etc., can be displayed on the display screen 18 for the user to click, when selecting one of them. When the function button is displayed, the related product and its product barcode are displayed on the display screen 18 for the user to scan and purchase.

A shopping application can be installed on the user's mobile device, and a barcode scanning function of the shopping application can be used to scan the product barcode of the product and add the product to the shopping cart of the shopping application. At the final checkout, the user selects the payment method and the pick-up method in the shopping device of the mobile device, and the payment method includes credit card payment, transfer, cash on delivery, pick-up payment, etc., and the pick-up method includes home delivery, mailing, and arrival. Shop to pick up.

FIG. 3 is a flow chart showing an application of an embodiment of a display system for image recognition and multimedia shopping. In step S10, the image capturing device scans the facial image of the user who has passed or stayed in front of the display screen. In step S12, the controller receives the facial image and performs face recognition, for example, finding feature points of the facial image. In the step S14, the controller searches for the product advertisement corresponding to the facial image from the plurality of product advertisements according to the at least one setting condition, and provides the display to the display in step S16. The screen displays the product advertisement corresponding to the facial image and the corresponding product barcode on the display screen; finally, as described in step S18, after the user scans the product barcode by using the mobile device, the purchase or pre-order can be performed on the mobile device. .

For example, if a 23-year-old female user stays in front of the display stand, the image capture device captures her facial image, and after face recognition, it is judged to be a female, and the age falls within the range of 20 to 30 years old. , select the products that match the "female" and "20-30 age layers" from the stored product advertisements, and play the product advertisements for the user to watch. If the user likes the product, the mobile device can be opened. Installed shopping app, scan the product barcode to add the item to the shopping cart. The user can also operate the display screen, such as clicking on the "Popular Goods" function option, or using the query function to find products, and each of the listed items will have a product barcode for scanning. After the user has purchased the purchase, the shopping application will perform the checkout operation on the shopping cart, select the payment method and the pick-up method, and the purchase can be completed in the shopping application regardless of whether the product is in stock or needs to be pre-ordered.

The present invention may include more than one display frame. Please refer to FIG. 4 and FIG. 5, which are respectively a perspective view and a block diagram of another embodiment of the present invention. Each display frame 12 includes an image capturing device 14 respectively. A controller 16 and a display screen 18 are further provided with a mid-island platform 22. The mid-island platform 22 is provided with a checkout host 24, and the checkout host 24 signals are connected to at least one backend server 20.

In the present creation, the user can operate the checkout host 24 to make a purchase or pre-purchase if the user does not carry the mobile device, except that the user can use the flow of the above FIG. The checkout host 24 is a touch-sensitive host or a general computer host, and the checkout host 24 includes a scanner (not shown) for scanning a two-dimensional barcode of the outer package of the commodity to input the checkout host 24 in. A display device 26 is also provided on the checkout host 24 for displaying a checkout amount.

FIG. 6 is a flow chart showing an application of an embodiment of a display system for image recognition and multimedia shopping. Steps S10 to S16 are the same as those in FIG. 3. In step S10, the image capturing device scans the facial image of the user who has passed or stays in front of the display screen. In step S12, the controller receives the facial image and performs the human image. Face recognition, for example, finding a feature point of the face image, determining whether it is a male or female, and which interval the age layer falls in; then, in step S14, the controller searches for the face image from the plurality of product advertisements according to at least one setting condition. The compliant product advertisement is provided to the display screen in step S16, and the product advertisement corresponding to the facial image and the corresponding product barcode are displayed on the display screen.

At this time, if the user does not carry the mobile device or the shopping application is not installed on the mobile device, the flow proceeds to be different from FIG. As described in step S20, the user can take the merchandise to the Nakajima platform 22 and directly operate the checkout host 24 to purchase or pre-purchase. After the user scans the two-dimensional barcode on the outer packaging of the product by using the scanner, the product information is input into the checkout host 24, and the amount of the commodity is displayed on the display device 26, and all the products to be purchased by the user are scanned. After the completion, the checkout is selected, and the checkout amount after the total amount of the commodity is added is displayed on the display device 26. After the user confirms, the payment method and the picking method are also selected on the checkout host 24, regardless of whether the product is in stock or It is pre-purchased and can be purchased or pre-ordered on the checkout host 24.

In one embodiment of the present invention, the controller communicates with the back-end server signal through the network, and transmits information such as features recognized by the user's facial image, matching product advertisements, and user purchase records to Back-end server for statistical and big data analysis.

In summary, the display system with image recognition and multimedia shopping provided by the creation system is provided with a display module controller combining image capturing, image recognition and advertisement pushing functions on the display frame to recognize the user's face. After the feature is selected, product advertisements that meet the user's conditions are recommended to increase the user's desire to purchase. In addition, the product advertisements and product barcodes displayed on the display frame are linked with the shopping application in the mobile device, and the mobile device barcode is scanned by the mobile device, so that the mobile device can be used for shopping or pre-ordering at the store site without going through the store. The clerk checks out.

The above description is only for the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Therefore, any change or modification of the characteristics and spirit described in the scope of this application shall be included in the scope of the patent application for this creation.

10‧‧‧Display system with image recognition and multimedia shopping
12‧‧‧ Display stand
14‧‧‧Image capture device
16‧‧‧ Controller
18‧‧‧ Display screen
19‧‧‧Speakers
20‧‧‧Backend server
22‧‧‧Nakashima Platform
24‧‧‧Checkout Host
26‧‧‧Display device

FIG. 1 is a perspective view of an embodiment of a display system with image recognition and multimedia shopping. Figure 2 is a block diagram of an embodiment of a display system for image recognition and multimedia shopping. FIG. 3 is an application flow chart of an embodiment of a display system for image recognition and multimedia shopping. Figure 4 is a perspective view of another embodiment of a display system for image recognition and multimedia shopping. Figure 5 is a block diagram of another embodiment of a display system for image recognition and multimedia shopping. FIG. 6 is a flow chart of application of another embodiment of a display system for image recognition and multimedia shopping.

Claims (17)

A display system with image recognition and multimedia shopping, comprising: at least one display stand for placing goods, wherein the at least one display frame comprises: an image capturing device for capturing a facial image of a user; a controller electrically connected to the image capturing device, receiving the facial image and performing face recognition, searching for at least one of the plurality of product advertisements corresponding to the facial image according to at least one setting condition; and displaying The screen is electrically connected to the controller, and displays the at least one product advertisement and the corresponding product barcode corresponding to the facial images of the user, so that the user scans the product barcode with a mobile device to purchase Or pre-order. The image recognition and multimedia shopping display system according to claim 1, wherein the controller is disposed in a rear housing of the display screen. The display system of claim 1 and the multimedia shopping display system, wherein the at least one setting condition comprises a gender and an age interval. The display system of claim 1 and the multimedia shopping display system, wherein the display screen is provided with a speaker for playing the sound of the product advertisement for promotion and sound shopping guide. The display system with image recognition and multimedia shopping as described in claim 1 further includes a checkout host, which is disposed on the display frame, and the signal is connected to at least one backend server, when the user does not carry the mobile device. At the time, the user operates the checkout host for purchase or pre-order. The image recognition and multimedia shopping display system according to claim 5, wherein the checkout host is disposed on an island table of one of the display stands. The image recognition and multimedia shopping display system according to claim 5, wherein the checkout host comprises a scanner for scanning a two-dimensional barcode of the product package to be input into the checkout host. The image recognition and multimedia shopping display system according to claim 5, wherein a display device is disposed on the checkout host to display a checkout amount. The display system with image recognition and multimedia shopping as described in claim 5, wherein the checkout host is a touch-sensitive host or a general computer host. The image recognition and multimedia shopping display system according to claim 1, wherein the mobile device is provided with a shopping application, and the bar code scanning function of the shopping application is used to scan the product barcode of the product. And add the item to the shopping cart in one of the shopping apps. The image recognition and multimedia shopping display system of claim 10, wherein the user selects a payment method in the shopping application of the mobile device, the payment method includes credit card payment, transfer, cash on delivery, Pick up payment, etc. The image recognition and multimedia shopping display system according to claim 10, wherein the user selects a picking method in the shopping application of the mobile device, and the picking method includes home delivery, mailing, and shop arrival. Take it. The image recognition and multimedia shopping display system according to claim 1, wherein the product barcode is a QR code. The image recognition and multimedia shopping display system according to claim 1, wherein the controller is connected to the at least one backend server signal through the network to identify the facial image of the user. The at least one product advertisement and the purchase record of the user are transmitted to the at least one backend server for big data analysis. The display system with image recognition and multimedia shopping as described in claim 1, wherein the display screen is a general display or a touch screen. The image recognition and multimedia shopping display system according to claim 15, wherein when the display screen is a touch screen, the plurality of function buttons are displayed on the display screen for the user to click. The image recognition and multimedia shopping display system according to claim 1, wherein the image capturing device is a camera, a camera or a webcam.