TWI382939B - Intelligent trolley - Google Patents

Description

Smart trolley

The present invention relates to a cart apparatus, and more particularly to a smart cart that can perform image recognition and instant analysis to assist a user in shopping.

With the evolution of human society, various types of stores are increasing in the daily life of consumers, such as fresh supermarkets, daily necessities, department stores and large bookstores. And because the store has competitive advantages such as reasonable price and variety, it has gradually replaced the traditional market and retail stores.

When consumers shop in the store, the store usually provides trolleys to facilitate consumers to purchase goods. For example, a consumer can pick up a trolley when entering the store, then push the trolley to pick up the merchandise in the store and place the item to be purchased in the cart first, waiting for the final checkout counter at the store. Checkout. In addition, some of the malls display items that need to be checked out first (such as drugs or appliances), so consumers must check out the specific counters before they can be removed or placed in the cart.

However, today's stores are becoming larger and larger, and the products displayed are becoming more and more numerous. Consumers often have to ask the store service personnel first because they do not know how to choose the right products or do not know how to find the products they want to buy. Going to find it on its own, it wastes precious time and manpower, and the operators of the store are unable to know the preferences of most consumers, so they cannot display goods or set advertisements in the best way. In addition, consumers often park their trolleys in one place in the store and go to another place to pick them up. However, when the selection is over, it is because the size of the store is too large and it is forgotten where the trolleys are parked. , thus causing trouble for consumers. In addition, because there are a large number of consumers in the store, it is easy to accidentally misrecognize the trolley of another person, and it is easy to cause the personal finance (such as a wallet, etc.) that the consumer places in the trolley or the goods that have been checked out first (for example, medicines) Etc.) Theft occurred.

In view of this, how to provide a smart cart for use in a store, in addition to facilitating consumer use, can solve the above-mentioned various shortcomings of the prior art, and is indeed a problem to be solved by all walks of life.

In view of the above-mentioned problems to be solved, the present invention provides a smart cart for use in a store.

The smart trolley includes a trolley body, an image capturing device, a positioning device, a data library, an input device, a processing device, and a feedback device. The image capturing device is disposed on the body of the cart for capturing image information of the user; the positioning device is disposed on the body of the cart to calculate a position information of the body of the cart in the store; The data storage system is disposed on the body of the trolley for storing the layout information of the store; the input device is disposed on the body of the trolley for inputting a command message by the user; the processing device is disposed on the body of the trolley And connecting to the image capturing device, the positioning device, the input device, and the database, for analyzing the image message, the layout message, the location message, and/or the command message to obtain a user The dynamic information, in turn, provides a corresponding service message; and the feedback device is disposed on the body of the trolley to feed back the service information provided by the processing device to the user.

In one embodiment of the invention, the smart cart includes a detection device disposed on the body of the cart and coupled to the processing device. The detecting device is configured to detect the direction and distance of the user relative to the body of the cart, the direction and distance of the user's attendant relative to the cart body, and/or the item that the user has purchased relative to the The direction and distance of the cart body.

In another embodiment of the invention, the smart cart includes a reading device disposed on the body of the cart and coupled to the processing device. The reading device is configured to read the identification barcode of the commodity to obtain the corresponding commodity information.

In still another embodiment of the present invention, the smart cart includes a storage device disposed on the body of the cart and coupled to the processing device for placing a personal item of the user. The usage rights of the storage device are set by the processing device according to the image message and the command message.

In still another embodiment of the present invention, the smart cart includes a power unit disposed on the cart body and coupled to the processing device. The power unit is used to drive or stop the cart body in accordance with intelligent control rules.

In an embodiment of the present invention, the processing device analyzes the health status of the user according to the image information, and performs corresponding processing according to the analyzed health condition. For example, if it is analyzed that the user's health condition is abnormal, the processing device can automatically notify the nearest service personnel to the processing through the communication device according to the location message to provide appropriate care or first aid measures.

In summary, the smart cart of the present invention can accurately grasp various status information of users and stores by using image recognition technology, and notify users of appropriate service messages or warning messages through instant analysis and calculation, not only providing users. A more convenient and safer shopping model also solves the lack of conventional technology.

The embodiments of the present invention are described below by way of specific examples, and those skilled in the art can readily appreciate other advantages and functions of the present invention from the disclosure herein. The present invention may be embodied or applied in various other specific embodiments, and various modifications and changes may be made without departing from the spirit and scope of the invention.

Furthermore, the following drawings merely illustrate the basic concept of the present invention in a schematic manner, and only the components related to the present creation are shown in the drawings, rather than the number, shape and size of the components in actual implementation, and the types of components in the specific implementation. The state, the quantity, and the proportions may be arbitrarily changed without departing from the technical scope of the present invention.

First embodiment:

Referring to Figure 1, there is shown a schematic view of a first embodiment of a smart cart for use in a store of the present invention. As shown, the smart cart 1 includes a cart body 10, an image capture device 11, a pointing device 12, a database 13, an input device 14, a processing device 15, and a feedback device 16.

The image capturing device 11 is disposed on the cart body 10 for capturing image information of the user and/or image information of the store. In the embodiment, the image capturing device 11 is optionally a CCD lens, a digital camera or a digital camera.

The positioning device 12 is disposed on the cart body 10 for calculating the position information of the cart body 10 in the store. In this embodiment, the positioning device 12 can be, for example, a wireless positioning device such as a Global Positioning System (GPS) or a wireless local area network positioning system.

The database 13 is disposed on the cart body 10 for storing layout information of the store. In this embodiment, the layout information of the foregoing store may include a product display location map, a road route map, a service personnel configuration map, a product promotion plan, a product advertisement, a store member information, and a manufacturing date and manufacture of various commodities in the store. Manufacturer, shelf life, heat, and recommended dosage.

The input device 14 is disposed on the cart body 10 for the user to input related instruction information. In this embodiment, the input device 14 is optionally a tablet, a keyboard, or a touch panel. Therefore, the foregoing database 13 can be used to store an on/off command input by the user through the input device 14, a consumption rule (for example, a one-day consumption limit set for the user, etc.), or a consumption habit (for example, for the user) Set the order of purchase of goods, etc.).

The processing device 15 is disposed on the cart body 10, and is electrically connected to the image capturing device 11, the positioning device 12, the data library 13, and the input device 14 for capturing the image capturing device 11. The image information, the location information located by the location device 12, the layout information stored in the database 13, and/or the user's command information input by the input device 14 perform an immediate and comprehensive analysis to obtain The user and/or the live dynamic information of the store, and then provide the corresponding service message according to the dynamic information mentioned above. In the embodiment, the processing device 15 is an electronic processor (for example, a microcomputer) having functions of calculation, comparison, analysis, and the like.

The feedback device 16 can be a video player with a screen and a speaker, and is disposed on the cart body 10 for feeding back service information provided by the processing device 15 to the user.

In an embodiment of the present embodiment, when the user uses the smart cart of the present invention in the store, the image capturing device 11 disposed on the cart body 10 immediately and continuously images the user and the store. Capture. At the same time, the positioning device 12 disposed on the cart body 10 will continuously position the cart body 10 to obtain the instantaneous position information of the cart body 10 in the store. The processing device 15 can perform an instant and comprehensive analysis on the image information, the location information, and the layout information stored in the database 13, thereby obtaining dynamic information of the user and the store. The processing device 15 then submits an appropriate service message to the user via the feedback device 16 based on the dynamic information described above.

For example, the processing device 15 can capture user feature information in the image message according to an instruction input by the user through the input device 14, and compare the vector axes (X-axis, Y-axis, and Z-axis) according to the vector axis (X-axis, Y-axis, and Z-axis). Calculate the user's head steering angle and line of sight direction from the user feature information, match the layout message and the location message to obtain the area that the user is looking at, and then provide services such as product information, advertising messages, and special offers corresponding to the area. The message is fed back to the user by means of feedback device 16 in the form of an image or sound. According to this, the user can quickly learn the related information, which not only saves the time of inquiry and inquiry, but also saves the manpower requirement of the service personnel.

Preferably, the user features captured by the processing device 15 from the image information may be image features of the user's eyes, nose, lips, etc., and the vector axis alignment principle accurately distinguishes the user between 0. Face steering angle and line of sight direction from ° to 70°. When the user's face turning angle is greater than 70°, image features such as the user's ear and skull contour can be extracted from the image information to accurately analyze the user's face steering angle and line of sight direction. Of course, the processing device 15 can simultaneously capture the black eye contour of the user in the image message (for example, the position and proportion of the eyeball and the pupil), and then use the vector axis comparison principle to enhance the obtained user's face steering angle and The accuracy of the line of sight direction.

In another embodiment of the present embodiment, the feedback device 16 can be a display screen, and the processing device 15 according to the location information located by the positioning device 12 and the layout information stored in the database 13 The merchandise in the vicinity of the location of the smart cart 1 is selectively displayed on the feedback device 16 in the form of a train or a marquee. In detail, the image capturing device 11 can capture the image information of the user and the store, and the processing device 15 analyzes the direction of the user's line of sight from the image message to obtain the screen area that the user is interested in. Further, information related to the products in the screen area (for example, product advertisements, matching schemes, coupons, display positions of the products, etc.) is extracted from the database 13, and then displayed on the display screen in an enlarged manner such as enlargement or pop-up. display. The processing device 15 can also identify the user's image information at the same time to determine the soft attribute information such as the user's gender and age, and further calculate the potential purchasing power of users of different genders or different age groups, and then supply the market. The industry is the basis for the deployment of the store. In addition, the processing device 15 can analyze the image information of the store obtained by the image capturing device to obtain the image information of the product shelf in the store, and then generate the replenishment information of the product shelf and provide the information immediately. The manager of the store.

In another embodiment of the present embodiment, when the user first uses the smart cart 1 , the image capturing device 11 first captures image information such as a user's avatar and uses it through the processing device 15 . The avatar of the person is stored in the database 13 as a registered user of the smart cart 1. Then, when the image capturing device 11 continuously captures the image information of the user, the processing device 15 instantly compares the avatar of the user stored in the database 13 to determine whether the user is a registered user. If the user is different from the user, the warning device can be alerted. According to this, it is possible to prevent the user from accidentally misidentifying the smart cart 1 used by others.

In a further embodiment of the present embodiment, the processing device 15 can analyze the image information of the user to generate the health information of the user, and remind the user through the feedback device 16. For example, if the processing device 15 analyzes that the user's health condition is excessive fatigue or the body temperature is too high, the feedback device 16 can be used to remind the user to rest or replenish moisture. In addition, when the processing device 15 receives the consumption habit information input by the user through the input device 14, the appropriate path planning information may be calculated according to the location information of the trolley body 10 in the store and the layout information of the store. And inform the user through the feedback device to avoid the user wasting extra time.

Second embodiment:

Referring to Figure 2, there is shown a schematic view of a second embodiment of the smart cart of the present invention. As shown, the smart cart 2 includes a cart body 20, an image capturing device 21, a pointing device 22, a database 23, an input device 24, a processing device 25, a feedback device 26, a detecting device 27, and a reading device. Device 28. It should be noted that the difference between the present embodiment and the foregoing embodiment is that the detecting device 27 and the reading device 28 are included in the same manner, and the remaining components are the same as those in the foregoing embodiment, and thus will not be further described herein. It should be noted that the detecting device 27 and the reading device 28 described above may also be separately disposed.

The detecting device 27 is disposed on the cart body 20 and electrically connected to the processing device 25 for detecting the direction and distance of the user relative to the cart body 20, and the user of the user (for example, a child, The direction and distance of the older person, etc. relative to the cart body 20, and/or the direction and distance of the merchandise that the user has purchased relative to the cart body 20. In this embodiment, the detecting device 27 can be a radar-enabled detector and can be disposed on the user, on the user's accommodator, and/or on a product that the user has purchased, such as an RFID tag. The signal transmitter detects the direction and distance of the user relative to the cart body 20, the direction and distance of the user's attendant relative to the cart body 20, and/or the item that the user has purchased relative to the cart body 20 Direction and distance.

It is worth mentioning that the database 23 can selectively store preset range conditions, and the processing device 25 monitors the distance between the user and the cart body 20 according to the above range conditions, and the user's accommodator. Whether the distance from the cart body 20 and/or the distance between the product purchased by the user and the cart body 20 exceeds the above range. For example, when the processing device 25 determines that the distance is too large, the feedback device 26 can issue a warning message to remind the user (for example, an alarm sound, etc.), thereby preventing the user from being stolen and preventing the product from being stolen. The user or his or her attendant is lost due to being too far away from the cart body 20.

The reading device 28 is disposed on the cart body 20 and electrically connected to the processing device 25 for reading an identification barcode (for example, Bar code) of the product to obtain corresponding product information. In this embodiment, the reading device 28 can be a CCD scanner or a laser scanner. The obtained product information may be information such as product classification, product price, product weight, product volume, and source of goods.

Therefore, if the data stored in the database 23 is stored by the user, the processing device 25 can analyze the product information obtained by the reading device 28 from the identification barcode of the product, and use the above-mentioned consumption rule to calculate the appropriate The suggested information is then fed back to the user via the feedback device 26. For example, the processing device 25 can calculate the type of shopping bag and the number of shopping bags suitable for the user according to the weight, classification, and volume of the product. Moreover, the processing device 25 can also provide better recipe suggestions, timeliness prompts, and related product comparison tables based on the previously suggested information. In addition, the user may also input a consumption rule including the budget upper limit amount before the input device 24, and when the user reads the product information by using the reading device 28, the processing device 25 then sums up the commodity price and compares the budget upper limit amount. If the upper limit of the budget is found, the feedback device 26 can be alerted to the user to avoid the user spending too much money.

Third embodiment:

Please refer to FIG. 3, which is a schematic view showing a third embodiment of the smart cart of the present invention. As shown in the figure, the smart cart 3 includes a cart body 30, an image capturing device 31, a positioning device 32, a database 33, an input device 34, a processing device 35, a feedback device 36, a storage device 37, and a detecting device 38. And power equipment 39. It should be noted that the difference between the embodiment and the foregoing embodiment is that the storage device 37 and the power device 39 are included in the same manner, and the remaining components are the same as those in the foregoing embodiment, and thus will not be further described herein. Of course, the storage device 37 and the power device 39 can also be separately provided.

The storage device 37 is, for example, a safe, which is disposed on the cart body 30 and electrically connected to the processing device 35 for placing the user's personal items. The access authority of the storage device 37 can be set by using the processing device 35 and the image information captured by the image capturing device 31 in conjunction with the user inputting the command message through the input device 34.

For example, the user image captured by the image capturing device 31 and the user's avatar captured by the user may be integrated into the database 33 through a combination of passwords input by the user into the digital device and/or text. Thereby, the authority setting of the storage device 37 is completed. According to this, the user can place the personal valuables in the storage device 37 having the authority management function, thereby preventing the valuable items of the user from being stolen.

The power device 39 can be disposed on the cart body 30 and connected to the processing device 35, and drives or stops the cart body 30 according to the smart control rules. In the embodiment, the intelligent control rule may include a user follow mode, a push assist mode, a fixed mode, or a recycle mode, and may be selected by the user through the input device 34. The power unit 39 is an electric motor that can drive the wheel (not shown) of the cart body 30.

Therefore, when the user selects the user following mode, the cart body 30 can instantly detect the position of the user by the detecting device 38, and the processing device 35 causes the power device 39 to drive the cart body 30 to follow the user to move. . When the user selects to push the assist mode, the power device 39 can provide the user's auxiliary power to reduce the thrust required by the user to apply the cart body 30. When the user selects the fixed mode, the power device 39 can lock the wheel of the cart body 30 to avoid the danger that the cart body 30 slides on the slope. When the user selects the recycling mode, the processing device 35 can use the store layout information stored in the database 33 to match the power device 39 to homage the cart body 30 used by the user.

Fourth embodiment:

Referring to Figure 4, there is shown a schematic view of a specific embodiment of the smart cart of the present invention. As shown, the present embodiment includes a store management system 6 having a communication module 60 and an artificial intelligence module 61. The smart cart 4 includes a smart cart body 40 and a lithographic computer 41 disposed on the smart cart body 40. It is worth noting that the lithographic computer 41 is the aforementioned image capturing device, positioning device, database, Input devices, processing devices, feedback devices, and detection devices are integrated to save space. The user A of the smart cart 4 is equipped with an inductive wristband 5 that can emit signals and generate vibration, and the inductive wristband 5 can be transmitted through a system such as Bluetooth, infrared, Wifly, or radio frequency. The processing devices (not shown) in the lithographic computer 41 are connected.

According to the above, the communication module 60 can connect the processing device in the lithographic computer 41 on the smart cart 4 by using a system such as Bluetooth, infrared, Wifly, etc. to acquire the image captured by the image capturing device. The message, the location message located from the location device, and/or the command message entered by the user through the input device. In this embodiment, the communication module 60 is a wireless base station. However, the communication module 60 can be connected to the lithographic computer 41 through the above-mentioned network system, and can also be connected to the Internet through the above-mentioned network system, so that the user A can connect to the Internet through the lithographic computer 41. network.

The artificial intelligence module 61 is connected to the communication module 60 to provide appropriate service measures according to the image message, the location message and/or the command message. In this embodiment, the artificial intelligence module 61 is a computing center having a plurality of servers and a neural network.

In actual implementation, the artificial intelligence module 61 can provide appropriate service measures according to the image information captured by the image capturing module and the location information located by the positioning module. For example, the artificial intelligence module 61 can analyze the health status of the user from the image information, and if the user's health condition is poor, the appropriate care measures can be provided according to the location information. Furthermore, the artificial intelligence module 61 can also provide services for celebrity identification or customized orders.

In addition, the artificial intelligence module 61 can also provide appropriate service measures according to the command message input by the user through the input device. For example, the user A can input a meal order instruction on the input module (for example, a touch screen, a tablet, etc.) in the lithography computer 41, and when the artificial intelligence module 61 receives the aforementioned order instruction According to the location information located by the positioning device and the ordering instruction of the user, the nearest service personnel can arrange the meal meeting the above-mentioned ordering instruction to be delivered to the user.

It should be noted that the detection device included in the lithographic computer 41 disclosed above can continuously detect the sensor bracelet 5 worn by the user A to detect the user A distance. The direction and distance of the smart cart 4, and when the processing device of the lithographic computer 41 determines that the direction and distance of the user A from the smart cart 4 is too large, the sensor bracelet 5 can vibrate to remind the user. Of course, the artificial intelligence module 61 can also dispatch the nearest service personnel to the concern when the user A is too far away from the smart cart body 40. In addition, the artificial intelligence module 61 can simultaneously count the line of sight of all users in the store environment, and then serve as a basis for the future adjustment of the product display mode and the motion line planning. Preferably, the inductive wristband 5 can also be worn on the user's attendant (eg, a young child, an elderly person, etc.). Therefore, if the user's traveler is too far away from the smart cart body 40, The sensor bracelet 5 worn by the user can be vibrated to prevent the user's traveler from accidentally losing.

In summary, the smart cart provided by the present invention includes a cart body, an image capturing device, a positioning device, a data library, an input device, a processing device, and a feedback device. The processing device retrieves related information from the image capturing device, the positioning device, the input device, and the database to view the image of the user, the layout of the store, the location of the cart body, and/or the user. The input instructions are analyzed in a timely and comprehensive manner to obtain dynamic information of the user and/or the store, and the corresponding service information is provided to the user by the feedback device. Therefore, the smart cart of the present invention can accurately grasp the various status information of the user and the store by using the image recognition technology, and notify the user of the appropriate service message or warning message through instant analysis and calculation, which not only provides the user with more convenience but also A safer shopping model also solves the lack of conventional technology.

The above-described embodiments are merely illustrative of the principles of the invention and its effects, and are not intended to limit the invention. Modifications and variations of the above-described embodiments can be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of protection of the present invention should be as set forth in the scope of the claims described below.

1, 2, 3, 4. . . Smart trolley

10, 20, 30, 40. . . Cart body

11, 21, 31. . . Image capture device

12, 22, 32. . . Positioning device

13, 23, 33. . . database

14, 24, 34. . . input device

15, 25, 35. . . Processing equipment

16, 26, 36. . . Feedback device

27, 38. . . Detection device

28. . . Reading device

37. . . Storage equipment

39. . . Power plant

41. . . Lithographic computer

5. . . Induction bracelet

6. . . Store management system

60. . . Communication module

61. . . Artificial intelligence module

A. . . user

Figure 1 is a schematic view showing a first embodiment of the smart cart of the present invention;

2 is a schematic view showing a second embodiment of the smart cart of the present invention;

Figure 3 is a schematic view showing a third embodiment of the smart cart of the present invention;

Figure 4 is a schematic view showing a fourth embodiment of the smart cart of the present invention.

1. . . Smart trolley

10. . . Cart body

11. . . Image capture device

12. . . Positioning device

13. . . database

14. . . input device

15. . . Processing equipment

16. . . Feedback device

Claims (14)

A smart trolley is used in a store, including: a trolley body; an image capturing device is disposed on the body of the trolley for capturing image information of a user and/or the store; the positioning device is disposed on the The cart body is configured to calculate a position information of the cart body in the store; the database is disposed on the cart body for storing the layout information of the store; and the input device is disposed on the cart body. For the user to input a command message; the processing device is disposed on the body of the cart and is coupled to the image capturing device, the positioning device, the input device, and the database for The layout message, the location message, and/or the command message are analyzed to obtain dynamic information of the user and/or the store, thereby providing a corresponding service message; and the feedback device is disposed on the body of the trolley to Returning the service message provided by the processing device to the user; wherein the processing device retrieves the user in the image message Information, and calculating the line of sight direction of the user from the user feature information according to the principle of vector axis alignment, and then analyzing the area that the user is looking at with the layout message and the location message, and then the product corresponding to the area Messages, advertising messages and/or special offers are passed to the feedback device. The smart cart of claim 1 includes a detecting device disposed on the body of the cart and connected to the processing device for detecting the direction and distance of the user relative to the body of the cart. The direction and distance of the user of the user relative to the body of the cart, and/or the direction and distance of the item purchased by the user relative to the body of the cart. The smart cart of claim 2, wherein the processing device distances the user from the body of the cart according to a preset range condition, the distance between the user of the user and the body of the cart, and/or the The distance between the purchased product and the body of the trolley is monitored. When the processing device determines that the distance is too large, a warning message is transmitted to the feedback device to notify the user. A smart cart as claimed in claim 2, wherein the detecting device is transmitted through a signal transmitter disposed on the user, on the user's accommodator, and/or on the user's paid product Detect direction and distance. For example, the smart cart of the first application of the patent scope includes a reading device disposed on the body of the cart and connected to the information processing device for reading the identification barcode of the product to obtain corresponding product information. The smart cart of claim 1, wherein the database stores a consumption rule input by the user, and the processing device analyzes the product information acquired by the reading device according to the consumption rule to generate Suggestion information and suggestion information through the feedback device Give back to the user. The smart cart of claim 1 includes a storage device disposed on the body of the cart and connected to the processing device for placing a personal item of the user, and the usage authority of the storage device is processed by the processing The device is set according to the image message and the instruction message. The smart cart of claim 1 includes a power device disposed on the body of the cart, and the power device drives or stops the cart body according to a smart control rule. For example, the smart cart of claim 8 of the patent scope, wherein the smart control rule is a user follow mode, a push assist mode, a fixed mode, or a recycle mode. The smart cart of claim 1, wherein the user characteristic information refers to an image feature of the user's eyes, nose, mouth, ears, and/or head curvature. The smart cart of claim 1, wherein the processing device identifies the image information of the user obtained by the image capturing device to determine the gender and age of the user. For example, the smart cart of the first application of the patent scope, wherein the processing device analyzes the image information of the store obtained by the image capturing device to obtain image information of the product shelf, thereby generating a supplement for the shelf of the product. Goods information. The smart cart of claim 1, wherein the processing device analyzes the image information of the user to generate the use The health status information of the person and inform the user through the feedback device. The smart cart of claim 1, wherein the processing device calculates a route plan based on the position information of the cart body in the store and the layout information of the store when receiving the consumption habit message input by the user Information and inform the user through the feedback device.