TW202034220A - Customer recognition method and apparatus thereof capturing user feature information of the user image and searching user information corresponding to the user feature information in a database - Google Patents

Abstract

This invention relates to a customer recognition method and an apparatus thereof. The customer recognition apparatus includes an image capturer, which captures a user image to a processor to retrieve user feature information of the user image and search user information corresponding to the user feature information in a database, so that corresponding commodity information is searched out according to the user information and is displayed on a display. However, if the processor does not find user information corresponding to the user feature information, the user feature information is stored in the database to form new user information. By using the customer recognition apparatus, face images of different consumers may be automatically recorded, so that appropriate commodity information may be still recommended to the consumers even if membership data is not established, or purchased commodity records are acquired to assist a shop owner in recognizing preferences of the consumers.

Description

Customer identification method and device

The present invention relates to a data processing technology, in particular to a customer identification method and device that can identify customers through images without establishing a member.

The way of playing advertisements can be roughly divided into the following three categories: 1. Traditional TV advertisements; 2. Internet push advertisements; 3. Advertisements on TV walls in physical stores. Traditional TV advertising is when commercials buy advertising time from TV stations, so that they can be played on the TV platform. However, in the past, TV advertising could not be targeted at individuals to broadcast corresponding advertisements of interest. Therefore, many users would switch channels during advertising hours to find more updates. Interesting content, thus reducing the effectiveness of TV advertising.

The origin of Internet push advertising is that with the gradual development of Internet technology, almost everyone has a computer of their own. Therefore, in order to improve the effectiveness of advertising, businesses have gradually developed advertising push technology for personal computers. Push personalized advertising information to the corresponding consumers.

The advertisements on the TV wall in the physical store are aimed at the customers who come to consume in the store, and the advertisements of the products in the store are continuously placed. Although it is more targeted than the traditional TV advertisements in the past, the advertisements in the TV wall still cannot accurately target individuals. Recommend corresponding advertising information, so the effectiveness of advertising is still limited.

Although advertising devices have been introduced in some brick-and-mortar stores to log in to members by shooting faces so that the advertising devices can recommend corresponding product information to consumers, consumers need to create member information before logging in to members, such as creating The consumer’s face image, consumer contact information, or the corresponding consumer's sensor card number and other data, the consumer can log in to the member through the face or sensor card, and the advertising device can recommend the corresponding product information to the consumer ; But if you do not join the member, the advertising device is completely unable to identify the identity of the current consumer, so it cannot recommend the corresponding advertisement for the individual, lacking Humanized design. In addition, when consumers join members, they are very time consuming and lack humanization when creating membership information.

In view of this, the present invention proposes a customer identification method and device to effectively overcome the above-mentioned problems in order to solve the above-mentioned problems.

The main purpose of the present invention is to provide a customer identification method and device, which can automatically record the facial images of different consumers. Even if the consumer has not established membership information, the consumer can still be identified using the facial image data of past historical records. , To recommend suitable product information to consumers.

Another object of the present invention is to provide a customer identification method and device, which can automatically record the facial images of different consumers. Even if the consumer has not established membership information, the consumer can still be identified to obtain the consumer's past purchases. Commodity records to assist service personnel to identify consumer preferences and requirements.

In order to achieve the above objective, the present invention provides a customer identification method, the steps of which include firstly capturing a user image of at least one user; then capturing the user characteristic information in the user image; searching for data in the database Plural user information, and compare the plural user information, whether there is a user information corresponding to the user characteristic information, if so, retrieve the user information corresponding to the user characteristic information, and search for the corresponding according to the user information At least one product information of, and display product information; but if not, store user characteristic information in the database to become a new user information.

Each user information includes user characteristic information and corresponding at least one product record information, where the product record information is the product record after the user purchases the product or the product browsing record of the user browsed the product; in the plural user information After searching the user information that matches the user characteristic information, obtain the product record information of the user information to search for the corresponding product information based on the product record information.

Among them, in the step of creating user characteristic information in the database to become new user information, you can also add the product browsing record of the user browsed product to the new user information to generate a new product record information for new use者信息中.

In addition, the present invention further provides a customer identification device, which includes at least one imager capable of capturing a user image; at least one database has a plurality of user information stored therein; at least one processor is electrically connected to the imager and the database, The processor receives the user image of the imager to capture user characteristic information in the user image, and searches for plural user information in the database, when the processor retrieves the corresponding user characteristic information in the database When the user information of the user information, the corresponding at least one product information is searched out according to the user information; when the processor does not retrieve the user information corresponding to the user characteristic information in the database, the user characteristic information is stored in In the database to become a new user information; and at least one display is electrically connected to the processor to receive the product information and display the product information.

Detailed descriptions are given below by specific embodiments, so that it will be easier to understand the purpose, technical content, features, and effects of the present invention.

1‧‧‧Customer identification device

10‧‧‧Viewfinder

12‧‧‧Database

14‧‧‧Processor

16‧‧‧Display

20‧‧‧machine

3‧‧‧Customer identification device

30‧‧‧Viewfinder

32‧‧‧Database

34‧‧‧Processor

36‧‧‧Display

38‧‧‧Transmitter

The first figure is a perspective view of the device of the present invention.

The second figure is a block diagram of the device of the present invention.

The third figure is a flowchart of the method of the present invention.

The fourth figure is a three-dimensional schematic diagram of a device according to another embodiment of the present invention.

The fifth figure is a block diagram of another embodiment of the present invention.

The present invention is a technology that can identify customers without establishing a membership. When the customer is When a regular customer, it can effectively capture the customer's past shopping records, etc., to provide follow-up recommended products and to assist service personnel in identifying consumer preferences and requirements.

Firstly, the device of the present invention will be explained. Please refer to the first and second figures. The customer identification device 1 of the present invention includes a machine 20 that can be placed in a merchant, allowing customers to approach the operating machine 20 to obtain goods in the merchant Information, the machine 20 is equipped with an imager 10, a database 12, a processor 14, and a display 16. The database 12 of the machine 20 of this embodiment further stores various product information to provide The processor 14 is given to the processor 14 to display the product information on the display 16 to provide customers who consume in the merchant can browse the information of different products through the customer identification device 1 and allow the customer to browse the products through the display 16.

Please continue to refer to the first and second figures to illustrate the structure of the customer identification device 1 in detail. In this embodiment, the imager 10 and the display 16 are both installed on the surface of the machine 20, and the imager 10 is installed above the display 16. The imager 10 can be a camera to capture a user image of at least one user, wherein the user image can be an image of the user's face. The database 12 and the processor 14 are arranged in the machine 20. The database 12 stores a plurality of user information, and each user information includes user characteristic information and corresponding at least one product record information. The user characteristic The information can be the value obtained after analyzing the user's image using Euclidean Distance; the product record information is the product record after the user purchases the product in the past, or the product browsing record of the user browsing the product information. The processor 14 is electrically connected to the imager 10, the database 12 and the display 16 to process user images and correspondingly control the imager 10, the database 12 and the display 16.

After describing the structure of the customer identification device 1 of the present invention, the method flow of the present invention will be described next, and how to match the above-mentioned device to achieve the effect of the present invention. Please refer to the first to third figures together. First, go to step S10. When the user stands in front of the machine 20, the imager 10 can capture the face of the user correspondingly, so that the imager 10 captures the user's face The user image of the face, and then the imager 10 transmits the captured user image to the processor 14. Then enter step S12, the processor 14 receives the After the user image, the angle of the user image is corrected, such as face correction, color correction, and filtering out the noise of user characteristic information, and then use Euclidean Distance to analyze and capture User image to retrieve user characteristic information. Then enter step S14, the processor 14 searches the plural user information in the database 12, whether there is user information corresponding to the user characteristic information, and each user information mentioned above includes user characteristic information , And the corresponding product record information. Therefore, the step S14 can obtain the corresponding user information according to whether there is the same user characteristic information. If the determination of step S14 is yes, then it will go to step S16, and the processor 14 can retrieve Take out the user information that contains the user characteristic information, and store the user characteristic information in the corresponding user information to improve the accuracy of subsequent image recognition, and the user information includes product record information. Therefore, it is possible to know the products purchased or viewed by the user in the past according to the product record information. At this time, the processor 14 can search for the corresponding product information according to the product record information, and transmit the product information to the display 16 for display; In other words, if it is known from the product record information that the user has bought shampoo in the past, then the processor 14 can recommend different brands of shampoo, or similar products, such as shower gel and other product information to the display 16 is displayed for user reference. However, if it is no in step S14, and the processor 14 determines that there is no corresponding user information in the database 12, it proceeds to step S18, and the processor 14 stores the user characteristic information in the database 12 to become a new User information. Of course, the new user is likely to browse the product information originally displayed on the machine 20. At this time, the processor 14 can add the product browsing records of the products viewed by the new user to the new user information To generate a new product record information to the new user information. When the new user is captured by the customer recognition device 1 again in the future, the customer recognition device 1 can recognize the face of the new user based on the new user information stored in the database 12.

Next, please refer to the fourth and fifth figures to illustrate another embodiment of the present invention. In addition to the above-mentioned embodiment, the structure of the customer identification device of the present invention is a machine set in a store. , The processor and the display are set separately, as detailed below, as shown in the fourth and fifth figures, The customer identification device 2 of this embodiment includes at least one image capturer 30, at least one database 32, at least one processor 34, at least one display 36, and at least one transmitter 38, wherein the image capturer 30, the database 32, and the transmitter 38 All are electrically connected to the processor 34, and the display 36 is electrically connected to the transmitter 38. The image taker 30 of this embodiment is a camera and is set at the entrance of the store. The processor 34, the database 32 and the transmitter 38 are all set at the counter end. The processor 34, the database 32 and the transmitter 38 can be A device in a computer, in which the transmitter 38 can be a communication transmitter; the display 36 is a display of a mobile communication device held by a user, such as a display of a smart phone. When the user enters the store, the imager 30 can take the image of the user entering the store, and pass the user image to the processor 34 installed at the counter, and then the processor 34 can determine the usage based on the user image The face of the person can be used to add user information or generate corresponding recommended product information. The steps of adding user information and generating corresponding product information are the same as those in the above embodiment, so the description is not repeated.

The difference between this embodiment and the above-mentioned embodiments is that after the processor 34 generates the corresponding recommended product information, it transmits the product information to the display 36 for display through the communication transmitter 38, which is the display of the user’s mobile communication device. Therefore, the user can learn the product information recommended by the merchant through the mobile communication device to obtain good advertising benefits. In addition, the processor 34 can transmit the user information of the user to the display of the mobile communication device of the merchant through the transmitter 38, so that the store clerk can obtain the user's past shopping product records from the user information. It assists the store clerk to identify the user's preferences and requirements, so that the merchant can provide customized services closer to the user.

In summary, the present invention can automatically record the facial images of different consumers. Even if the consumer has not established membership information, the consumer can still be identified by using historical facial image data to recommend suitable product information to the consumer. In addition, the consumer's past shopping product records can be obtained through facial image recognition to assist service personnel in identifying consumers' preferences and requirements. For the ordering system, using the technology of the present invention, it is not necessary to register as a member in advance. It only needs to use facial image recognition to judge the consumer’s face and record the consumer’s order information. Next time you come to order food, this Mingzhi technology can recommend similar meals based on the last order information. At the same time, the present invention can help service personnel to identify frequent customers, and bring out the last visit information and dining habits of customers, and provide customized services closer to customers, such as customers’ meal preferences, whether they have been allergic to certain ingredients, Steak maturity and more information.

Only the above are merely preferred embodiments of the present invention, and are not used to limit the scope of the present invention. Therefore, all equivalent changes or modifications made in accordance with the characteristics and spirit of the application scope of the present invention shall be included in the patent application scope of the present invention.

1‧‧‧Customer identification device

10‧‧‧Viewfinder

12‧‧‧Database

14‧‧‧Processor

16‧‧‧Display

Claims (14)

A customer identification method includes the following steps: capturing a user image of at least one user; capturing a user characteristic information in the user image; and searching for plural user information in a database, and comparing the In the user information, whether there is a user information corresponding to the user characteristic information: if so, retrieve the user information corresponding to the user characteristic information, and search for at least one product corresponding to the user information Information, and display the product information; and if not, store the user characteristic information in the database to become a new user information. According to the customer identification method of claim 1, wherein each user information includes the user characteristic information and corresponding at least one product record information, and searches for the user characteristic information in the user information After the user information, obtain the product record information of the user information, and search for the corresponding product information based on the product record information. According to the customer identification method of claim 2, wherein the product record information is the product record after the user purchases the product or the product browsing record of the user browsing the product. The customer identification method according to claim 1, wherein before the step of capturing the user characteristic information in the user image, it further includes performing angle and color correction on the user image, and filtering out the user characteristic Information noise. The customer identification method as described in claim 1, wherein in the step of creating the user characteristic information in the database to become the new user information, the product browsing record of the product browsed by the user can be added to the In the new user information, to generate a new product record information to the new user information. A customer identification device includes: at least one imager that captures a user image of at least one user; at least one database in which a plurality of user information is stored; at least one processor electrically connected to the imager And the database, the processor receives the user image of the imager to retrieve a user characteristic information in the user image, and searches the user information in the database, when the processing When the processor retrieves the user information corresponding to the user characteristic information in the database, it searches for at least one product information corresponding to the user information; when the processor does not find the corresponding information in the database When the user information should be the user characteristic information, the user characteristic information is stored in the database to become a new user information; and at least one display is electrically connected to the processor to receive the product information , And display the product information. The customer identification device according to claim 6, further comprising at least one transmitter electrically connected to the processor and the display, and the processor can transmit the product information to the display through the transmitter. The customer identification device according to claim 7, wherein the transmitter is a communication transmitter. The customer identification device according to claim 7, wherein the display is a mobile communication device display. The customer identification device according to claim 6, wherein the imager is a camera. The customer identification device according to claim 6, wherein each user information in the database includes the user characteristic information and corresponding at least one product record information, when the processor is in the user information After searching for the user information that matches the user characteristic information, the processor can obtain the product record information of the user information to search for the corresponding product information based on the product record information. The customer identification device according to claim 6, wherein the product record information is the product record after the user purchases the product or the product browsing record when the user browses the product. The customer identification device according to claim 6, wherein the processor may further perform angle and color correction on the user image, and filter out the user before capturing the user characteristic information in the user image Characteristic information noise. The customer identification device according to claim 6, wherein when the processor creates the new user information, it can also add the product browsing record of the product browsed by the user to the new user information to generate a new product Record the information in the new user information.

Images