JP2005044170A - Preference data processing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily determine a customer's preference. <P>SOLUTION: A preference data processing device 10 uses cameras 1a, 1b-1n, nb to take images of dishes arranged on a table and a customer sitting at the table. From the images of dishes, meals in the dishes and leftovers are determined and stored in a customer table 162 as preference data. The customer's attributes are determined from the customer's image and the attribute data are stored in the customer table 162. The customer's attribute data and the preference data including the names of the meals which the customer ate and the names of the meals left over are printed and outputted as a report. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a tableware image in which food and drink to be eaten by a customer are stored, and a preference data processing device and program for collecting the customer's preference data from the captured image.

Conventionally, a system has been developed in which preference data such as customer's hobbies and preferences are stored in a database, and when introducing products to customers, products are introduced according to customer preferences based on the preference data ( For example, see Patent Document 1).
JP 2001-229224 A

  However, in the method as described above, preference data must be input in advance, and when the number of customers is enormous, the input operation is complicated. In addition, the system is effective when there are many fixed customers, but the system cannot be used at restaurants where many unspecified customers such as restaurants often visit.

  The subject of this invention is providing the preference data processing apparatus which can grasp | ascertain a customer's preference easily.

The invention described in claim 1
Image storage means for storing a determination image for determining food and drink in the tableware and the remaining amount thereof;
Photographing means for photographing tableware images containing food and drinks for customers to eat and drink;
A determination means for comparing the photographed tableware image of the food and drink with the stored determination image, and determining the food and drink in the tableware and the remaining amount thereof,
Preference storage means for storing data corresponding to the determined food and drink and its remaining amount as customer preference data;
Output means for outputting the stored preference data;
A preference data processing apparatus comprising:

The invention according to claim 3 is as follows.
On the computer,
A function for storing a determination image for determining food and drink in the tableware and its remaining amount in the image storage means;
A function that causes the photographing means to photograph the tableware image containing the food and drink that the customer eats and drinks,
A function of comparing the photographed tableware image of the food and drink with the stored determination image, and determining the food and drink in the tableware and the remaining amount thereof,
A function of storing data according to the determined food and drink and its remaining amount in the taste storage means as customer preference data;
A function of causing the output means to output the stored preference data;
It is a program for realizing.

  According to invention of Claim 1, 35, a tableware image is image | photographed, the food / beverage in tableware and its remaining amount are determined by collation with the tableware image and the image for determination, and a determination result is used as preference data. Since it is memorized and output, it is possible to easily grasp the palatability of the customer, which food or drink is left uneaten.

  According to invention of Claim 2, since the attribute of the customer who eats and drinks food / drink is determined and the attribute data is stored and output in association with the preference data, what kind of customer prefers which food / drink Whether to eat or drink, the correlation between customer attributes and palatability can be easily grasped.

  According to the third aspect of the present invention, when there is an instruction to finish eating and drinking, photographing and determination are performed, so that the remaining amount of food and drink can be determined at an appropriate timing.

  According to invention of Claim 4, since the kind of food and drink and its residual amount are determined about each of several food and drink currently piled up in the same tableware, which food and drink are liked among one dish It is possible to grasp the more detailed palatability.

  In this embodiment, the tableware served on the table and the image of the customer who has arrived at the table are photographed, the type of dish in the tableware and the uneaten dish are determined, the attributes of the customer are determined, An example of storing and printing out the attribute of the customer, the name of the food that the customer has eaten and eaten, and the name of the leftover food as customer preference data will be described.

First, the configuration will be described.
FIG. 1 shows the configuration of the preference data processing apparatus 10.
As shown in FIG. 1, the preference data processing apparatus 10 includes a main body 10a and cameras 1a, 1b to na, nb which are photographing means. The main body 10a and the cameras 1a, 1b to na, nb It is connected via the I / F 14 of the main body 10a.

First, the cameras 1a, 1b to na, nb will be described.
Camera 1a, 1b-na, nb is an imaging device installed in each table for customers in a restaurant. Each table is given a table number T for identifying the table, and two cameras are installed for one table. The two cameras are assigned the same camera number C, and are identified by the camera number C as cameras that photographed the same table.

  The cameras 1a to na are installed so as to take a table with a table number T from an oblique direction in order to take a three-dimensional image of tableware or a customer image. The cameras 1b to nb are installed so as to photograph the table of the table number T from directly above in order to specify the coordinate position of the tableware arranged on the table and the seating position of the customer. The cameras 1a, 1b to na, nb output the image data of the table image acquired by photographing to the main body 10a.

  In addition, each table is provided with a switch SW for calling a store clerk when the tableware that has finished eating and drinking is lowered, and when the switch SW is pressed, the table of the table provided with the switch SW is provided. The pressing signal together with the table number information is output to the main body 10a. In other words, the switch SW can realize an instruction means for notifying that the cooking has been completed.

Next, the main body 10a will be described.
The main unit 10a includes a CPU (Central Processing Unit) 11, an input unit 12, a display unit 13, an I / F (InterFace) 14, a communication unit 15, a RAM (Random Access Memory) 16, a storage unit 17, and a printing unit 18. Each part is connected by a bus 19.

  In addition to the system program stored in the storage unit 17, the CPU 11 includes a preference data processing program according to the present invention (see FIG. 6), each processing program in the preference data processing program, that is, a customer attribute determination processing program (FIG. 7), a dish-drawing processing program (see FIG. 8), and a serving dish determination processing program (see FIG. 10) are developed in the RAM 16, and the processing operation is comprehensively controlled in cooperation with the program.

  In the customer attribute determination process, the CPU 11 analyzes a photographed image of the customer to extract a person feature amount, and determines the customer attribute based on the person feature amount. In addition, in the serving dish determination process, the dished image of the tableware arranged on the table is compared with the detailed dish image as the determination image to determine the dish in the tableware, and the position of the tableware image and the customer's position are determined. From the position, the combination of the customer and the food that the customer is eating and drinking is determined. Furthermore, in the dish withdrawal process, the photographed tableware image is compared with the empty tableware image and the detailed dish image, which are determination images, to determine the remaining amount of dish in the tableware. That is, the determination unit can be realized by the CPU 11 operating according to each processing program.

  The input unit 12 includes a keyboard including character keys, numeric keys, and various function keys, and outputs a press signal corresponding to the pressed key to the CPU 11. Note that a pointing device such as a mouse or a touch panel may be included.

  The display unit 13 includes a display such as an LCD (Liquid Crystal Display), and displays and outputs an operation screen such as a menu screen and various display information such as a processing result of the CPU 11.

  The I / F 14 is an interface for connecting the main body 10a to each camera 1a, 1b to na, nb, and a switch SW installed on the table, and adjusts the data transfer speed, converts the data format, and the like. Go and mediate the exchange of data.

  The communication unit 15 includes a communication interface such as a network interface card, a modem, and a terminal adapter, and transmits / receives various information to / from an external device on the communication network. For example, it is possible to connect to a payment system that processes fee data and performs a payment process, or an order management system in the kitchen.

  The RAM 16 forms a work area for temporarily storing various programs executed by the CPU 11 and data processed by these various programs.

  Further, the RAM 16 stores a position table 161 for managing position information of various tableware images included in the table images taken by the cameras 1b to nb, and a customer table 162 for managing customer attributes and preference data. Preference storage means.

  For example, when the table image obtained by photographing is an image as shown in FIG. 2, the tableware close to the table reference position (the position indicated by the point P on the table in FIG. 2) for each tableware on the table. A device number D for identifying each tableware is given in the clockwise order. At the same time, the image area of each tableware is recognized as a rectangular area including the tableware, and as coordinate information of each tableware image, two coordinate values Z1 [Dn] (x1, y1), Z2 [Dn ] (X2, y2) is detected. In addition, the image area of the customer sitting around the table is recognized, and the customer number A is assigned in order from the customer closest to the table reference position.

  In the position table 161, as shown in FIG. 3, the item a1 of the table number T of the photographed table, the item a2 of the camera number C of the camera that photographed the table, and each tableware image included in the table image are specified. It is determined that the item a3 of the device number D, items a4 and a5 storing coordinate value data of coordinates Z1 [Dn] and Z2 [Dn] which are position information of the tableware image, and eating and drinking food and drink in the tableware Each item information of the item a6 for storing the customer number A of the customer is stored in association with each other.

  In the customer table 162, as shown in FIG. 4, the item b1 of the table number T, the item b2 of the customer number A of the customer sitting on the table, and the item b3 indicating the attribute of the customer (for example, “adult, male Each item information of “etc.” is stored as attribute data of the customer, item b4 that stores the table number D of the tableware of the dish that the customer is determined to be eating and drinking, and the name of the dish that the customer is eating and drinking Item b5 (for example, “croquette set meal”, etc.), item b6 indicating the name of the dish determined to be left over (for example, “completely eaten” if the tableware is empty, and if determined to have left over) Each item information of the dish name “salad” is stored as preference data.

  The storage unit 17 has a storage medium (not shown) in which programs and data are stored in advance, and the system program, the preference data processing program according to the present invention, and the preference data processing program are stored in the storage medium. Each processing program, that is, a customer attribute determination processing program, a food withdrawal processing program, a cooked food determination processing program, data processed by these programs, and the like are stored. This storage medium is composed of a magnetic or optical storage medium or a semiconductor memory, and is fixedly provided in the storage unit 17 or detachably mounted.

  The storage unit 17 is an image storage unit that stores an image data group of reference images used for various determinations and a determination table 171 for managing the reference images. As the reference image for this determination, an empty tableware image for determining whether or not the tableware is empty and a detailed dish image for determining various foods and drinks placed in one tableware are taken in advance. Being prepared.

  As shown in FIG. 5, the determination table 171 includes a dish name item c1 (for example, “beer”) and an item c2 for storing the file name of an empty tableware image of the dish serving the dish (for example, beer). An image file name “jug.gif” in which the mug is empty, and an item c3 (for example, a hamburger set for one dish with a hamburger set meal, salad) Each item information of the dish image file name “ham.gif” and “sarada.gif”) is stored.

  The printing unit 18 performs printing on a print recording medium such as paper by various printing methods such as an electrophotographic method, a thermal transfer method, and an ink jet method. The printing unit 18 prints out a report that summarizes the attributes of the customers determined from each table image in response to an instruction from the CPU 11, the names of dishes eaten and eaten by the customers, and the names of leftover dishes. That is, an output unit can be realized by the printing unit 18.

Next, the operation in the present embodiment will be described.
FIG. 6 is a flowchart illustrating the preference data processing executed by the preference data processing device 10.

  In the preference data processing shown in FIG. 6, first, 1 is assigned to the camera number C (which matches the table number), and C = 1 is set (step S1). Next, in any table, it is determined whether or not the switch SW is pressed and the pressing signal is input (step S2). For example, if an order has just been placed and no switch SW pressing signal is input from any table (step S2; N), the process proceeds to the customer attribute determination process of step S3, and after the eating and drinking of the ordered food is finished, When a switch SW pressing signal is input from the table, a signal corresponding to the table number is output for each switch SW (step S2; Y), and the process proceeds to the dish withdrawal process in step S7. That is, when the switch SW is pressed, the dish withdrawal process is started as an interrupt process.

First, when it is highly likely that all customers who have just been ordered and the switch SW depression signal is not input have arrived at the table, for example, when the first order data is input from an order input terminal (not shown). The customer attribute determination process to be started will be described.
FIG. 7 is a flowchart for explaining the customer attribute determination process for determining the customer attribute in step S3. This customer attribute determination process is a process for determining attributes such as the sex of a customer who has arrived at the table, and adult / child distinction.
In the customer attribute determination process shown in FIG. 7, photographing on the table is performed by the camera of camera number C, and a table image as shown in FIG. 2 is acquired (step M1). Next, the image area of the customer who has arrived at the table is recognized from the acquired table image, and customer numbers A are assigned in the clockwise order from the customer close to the table reference position (step M2).

  Next, a numerical value of 1 is substituted into customer number A, and A = 1 is set (step M3). When the customer number A is set, image analysis of the customer image of the customer number A is performed, and each part constituting the face such as eyebrows, eyes, nose, mouth, and the contour of the shoulder are recognized. Character feature amounts such as the size of the eye, the distance between the eyes and the eyebrows, the circularity of the eyes, the presence or absence of wrinkles, the length of the hair, and the shoulder width are extracted (step M4).

  Next, in step M5, the customer's age group (adult or child) and gender (male or female) are compared by comparing the extracted person feature quantity with a threshold value prepared in advance for customer attribute determination. A determination is made. For example, when determining a child and an adult, each person feature amount is sequentially determined such that a child is determined if the face size is smaller than a threshold, an adult is determined if the face size is larger, a child is determined if there is no wrinkle, and an adult is determined if present. A determination is made. Then, for each item of the person feature amount, it is counted whether it is determined to be a child or an adult. For example, if the face size and shoulder width are determined to be an adult and the eye circularity is determined to be a child, “adult: 2” and “child: 1” are counted. Similarly, determination of gender is performed from the extracted person feature amount, and the number of times of determination is counted as to whether it is determined to be female or male for each item of the person feature amount. For example, gender is also sequentially determined for each person feature amount, such as male being determined to have wrinkles, female being applied with lipstick, and male or female depending on body shape.

  Eventually, the age group is determined to be an adult when the number of times determined to be an adult is higher than that of a child, and the sex of the customer is determined to be a male if the number of times determined to be a male is higher than that of a woman As described above, the attribute is determined in the direction where the determined count number is larger. Note that the determination method is not limited to this. For example, when distinguishing between an adult and a child, 5 points if the face size is large, 1 point if the face is small, 5 points if there is a wrinkle, 1 point if there is none, It is also possible to convert the points and determine the attributes of the customers by weighting them as adults if the points are large and children if the points are small.

  When the attribute of the customer is determined, in the table number area of the numerical value of the camera number C currently designated in the customer table 162, the data of the attribute is stored in association with the customer number A of the customer whose attribute is determined. (Step M6). When the storage of the attribute data is completed, it is determined whether or not the attributes have been determined for all customers recognized from the photographed table image (step M7). If the attribute determination has not been completed for all customers (step M7; N), a value obtained by incrementing the currently set value of A by 1 is substituted for customer number A (step M8), and step M4. Returning to the process, the attribute determination is repeated for the customer of the next customer number A + 1. On the other hand, when the attribute determination is completed for all customers (step M7; Y), the process proceeds to the next process, that is, the serving dish determination process in step S4 shown in FIG.

  The serving dish determination process in step S4 will be described with reference to FIG. This cooked dish determination process is a process of determining a dish served by a customer and determining a combination of the customer and the dish that the customer is eating and drinking.

  In the serving dish process shown in FIG. 8, the image area of each tableware on the table is recognized from the table image acquired by the camera of camera number C, and the rectangular area including the tableware is used. A device number D is assigned in the order of rotation (step R1). Next, the coordinates of two points specifying the rectangular area of each tableware image are Z1 [Dn] (x1, y1) and Z2 [Dn] (x2, y2) are associated with the unit number D as the table position information. It is stored in the table 161 (step R2).

  When the position information of each tableware is stored, a value of 1 is assigned to the device number D, and D = 1 is set (step R3). When the device number D is set, the detailed cooking image for determination is read from the storage unit 17, the tableware image of the device number D is compared with the detailed cooking image, and the presence or absence of a similar detailed cooking image is determined. (Step R4). When there is no detailed dish image similar to the dish image with the unit number D (step R4; N), the process proceeds to step R9, and when there is a similar detailed dish image (step R4; Y), the dish with the unit number D is displayed. Is determined (step R5).

A specific determination example of cooking will be described with reference to FIG.
For example, if the hamburger set includes three types of dishes: egg, salad, and hamburger, a detailed image of the egg, a detailed image of the salad, and a detailed image of the hamburger are prepared for the hamburger set. And stored in the storage unit 17.
As shown in FIG. 9, when the dish image taken is similar to the detailed dish image of the hamburger set meal, it is determined that the dish in the tableware with the dish number D is a hamburger set meal. The

  When the dish is determined, a combination of the determined dish and a customer who eats and drinks the dish is determined (step R6). Specifically, based on the position table 161, the customer closest to the position of the device number D is determined as a customer who is eating and drinking the dish of the device number D.

  Next, it is determined whether or not a dish name corresponding to the customer has already been stored in the customer table 162 based on the determined combination of the customer and the dish (step R7). When it is determined that the dish name corresponding to the customer is stored (step R7; Y), the process proceeds to step R9, while when it is determined that the dish name corresponding to the customer is not stored. (Step R7; N), the dish name of the detailed dish image similar to the customer number A in the customer table 162 is stored (Step R8).

  In step R9, it is determined whether or not determination has been made for all tableware images. If the determination has not been completed for all the tableware images (step R9; N), a value obtained by incrementing the currently set value of D by 1 is substituted for the device number D (step R10), and the process of step R4 is performed. Returning to FIG. 4, the determination of the dish and the combination of the dish and the customer is repeatedly performed for the next tableware number D + 1. On the other hand, if all tableware images have been determined (step R9; Y), the process proceeds to the next process, that is, step S5 shown in FIG.

  In step S5 shown in FIG. 6, it is determined whether or not the determination of the customer attributes and the determination of the dishes in the arranged tableware have been completed for all the tables. If the determination is not completed for all the tables (step S5; N), the camera number C is substituted with a value obtained by incrementing the currently set C value by 1, and the process returns to step S2. The determination of the customer's attribute and the determination of the dish are repeatedly performed from the image taken by the camera of number C + 1. On the other hand, when the determination is completed for all the tables (step S5; Y), the process returns to step S1, and each determination is repeated again in order from camera number 1.

  Next, a case will be described in which the switch SW installed in the table is pressed during the preference data processing, and it is determined that the switch SW pressing signal is input in step S2 shown in FIG.

FIG. 10 is a flowchart for explaining the dish withdrawal process.
In the dish withdrawal process shown in FIG. 10, the table number corresponding to the signal output for each switch SW is first photographed on the table by the camera with the camera number C, and the table image as shown in FIG. 2 is acquired. (Step Q1). Next, the image area of each tableware on the table is recognized from the table image acquired by photographing in the rectangular area including the tableware, and the unit number D is given in the clockwise order from the tableware near the table reference position (step Q2). ).

  When the device number D is given, the coordinates of the two points specifying the rectangular area of each tableware image are Z1 [Dn] (x1, y1), and Z2 [Dn] (x2, y2) are used as the position information of the tableware. It is stored in the position table 161 in association with the number D (step Q3).

  When the position information of each tableware is stored, a value of 1 is assigned to the device number D, and D = 1 is set (step Q4). Next, an empty dish image and a detailed dish image of the dish corresponding to the device number D determined by the serving dish determination process based on the customer table 162 are read from the determination table 171 (step Q5) and obtained by photographing. The tableware image of the device number D is collated with the read empty tableware image and the detailed dish image (step Q6). And it is discriminate | determined from the collation result whether the tableware of the device number D is an empty state (step Q7).

  Whether the tableware is empty or not is checked by comparing the photographed tableware image with the empty tableware image. If they are similar, it is determined that the table is empty, and vice versa. It is determined that it remains in For example, if the empty tableware image is an image as shown in FIG. 11 (a) and the photographed tableware image is an image as shown in FIG. 11 (b), each image is not similar, so the dish remains. It is determined that

  If it is determined that the tableware is empty (step Q7; Y), it is assumed that all the dishes have been eaten by the customer, and data of “complete meal” is written in the remaining amount item in the customer table 162 (step S7). Q8), the process proceeds to step Q10.

  On the other hand, when it is determined that the tableware is not empty (step Q7; N), the dish left uneaten in the tableware is specified. First, the photographed tableware image and the detailed dish image are collated, and it is determined whether or not the tableware image includes an image similar to the detailed dish image. If an image similar to the detailed dish image is included, the detailed dish name is written in the customer table 162, assuming that the detailed dish remains (step Q9). In the example shown in FIG. 11B, since the image area similar to the detailed dish image of the salad is included in the photographed tableware image, it is determined that the uneaten dish is a salad. When the leftover food is determined, the process proceeds to step Q10.

  In step Q10, it is determined whether or not the determination of leftover food for all tableware has been performed. If the determination has not been completed for all tableware (step Q10; N), a value incremented by 1 is assigned to the currently set value of D for the device number D (step Q11), and step Q5 is entered. Returning to the table, the dish left over for the tableware with the unit number D + 1 is determined.

  On the other hand, when the determination has been completed for all tableware (step Q10; Y), based on the customer table 162, a report showing the attributes of customers in the table, the names of foods eaten and eaten, and the names of leftover foods is displayed. The printing unit 18 prints out the print as shown in FIG. 12 (step Q12), and the dish-drawing process is terminated. After completion of the dish withdrawal process, the process proceeds to step S4 of the preference data serving dish determination process of step S4 shown in FIG. If the preference data processing device 10 is a sales data processing device such as a POS terminal device, the total number of completed meals and the number of leftovers are added for each customer attribute and for each dish, and set to the check mode or the checkout mode. Then, the configuration may be such that each data is output as a report by setting the check mode or the checkout mode.

  As described above, the arranged tableware image is taken, the dish in the tableware is determined, the tableware image is photographed again when lowering the dish, the uneaten dish is determined, and the determination result is obtained. Since it is output as a report, it is possible to easily grasp which dishes have been left uneaten, and it is possible to determine the palatability of customers.

  In addition, the customer's image is photographed, the customer's attributes are determined from the photographed image, the customer and the food that the customer is eating and drinking are determined, and the determination result is output as a report. It is possible to easily grasp which dish to eat and drink, and it is possible to determine the correlation between customer attributes and palatability.

  In addition, the description content in this Embodiment is a suitable example of the preference data processing apparatus 10 to which this invention is applied, It is not limited to this.

  For example, in the above description, the tableware image arranged on the table is photographed, and the dish in the tableware and the remaining amount of the dish are determined. However, the present invention is not limited to this. By periodically photographing the vessel, it may be possible to periodically determine the remaining amount of the Viking food and grasp the palatability of the customer.

  The above-described method for determining customer attributes is also an example, and is not limited thereto. For example, the group configuration may be determined as a customer attribute. For example, if only one customer is detected in one table from the photographed table image, “one person” is detected. If adult men and women are detected one by one in the table, “couple” is displayed in one table. When several adults and several children are detected, it is determined to be “with family” and stored in the customer table 162 as customer attributes. Thereby, it is possible to grasp a more detailed palatability of customers.

  Further, the age may be determined as the customer attribute. For example, human feature amounts such as wrinkles, sagging, skin color, hair color, etc. are extracted from the photographed customer image, and if there are many wrinkles and saggings based on this person feature amount, it is over 60 years old and if it is moderate Age is determined such as 40 to 50 years old and 20 to 30 years old if it is small. Thereby, it is possible to grasp a more detailed palatability of customers.

  In addition, in the above description, an example is shown in which preference data such as customer attributes, names of foods eaten and eaten by customers and names of leftover foods are printed and output as reports. Then, take statistics on the names of dishes and leftovers, such as eating and drinking for each attribute of customers who have eaten the most hamburger meals and the most leftovers of salads. It may be printed out as preference data. Further, the output form may be output on the display unit 13 instead of the print output.

  In addition, the detailed configuration and detailed operation of the preference data processing apparatus 10 according to the present embodiment can be changed as appropriate without departing from the spirit of the present invention.

It is a figure which shows the internal structure of the preference data processing 10 in embodiment to which this invention is applied. It is a figure which shows the table image image | photographed from right above with the cameras 1b-nb. It is a figure which shows the data structural example of the position table 161. FIG. It is a figure which shows the data structural example of the customer table 162. FIG. It is a figure which shows the example of a data structure of the determination table. 4 is a flowchart illustrating preference data processing executed by the preference data processing device 10. It is a flowchart explaining the customer attribute determination process performed by the preference data processing apparatus. It is a flowchart explaining the serving dish determination process performed by the preference data processing apparatus. It is a figure explaining a detailed cooking image. It is a flowchart explaining the dish withdrawal process performed by the preference data processing apparatus. It is a figure which shows the example of determination whether a tableware is empty. It is a figure which shows the example of a report output about the customer layer and the food / drinks which were eaten for every customer.

Explanation of symbols

10 Preference data processing device 11 CPU
12 Input unit 13 Display unit 14 I / F
15 Communication unit 16 RAM
161 Position table 162 Customer table 17 Storage unit 171 Determination table 18 Printing unit 1a, 1b to na, nb Camera SW switch

Claims (5)

Image storage means for storing a determination image for determining food and drink in the tableware and the remaining amount thereof;
Photographing means for photographing tableware images containing food and drinks for customers to eat and drink;
A determination means for comparing the photographed tableware image of the food and drink with the stored determination image, and determining the food and drink in the tableware and the remaining amount thereof,
Preference storage means for storing data corresponding to the determined food and drink and its remaining amount as customer preference data;
Output means for outputting the stored preference data;
A preference data processing apparatus comprising: The photographing means photographs a customer image,
The determination means determines a customer attribute based on the photographed customer image,
The preference storage means stores the determined attribute data of the customer and preference data in association with each other,
The preference data processing apparatus according to claim 1, wherein the output unit outputs the stored customer attribute data and preference data. An instruction means for notifying that eating and drinking has ended is provided.
3. The preference data processing apparatus according to claim 1, wherein photographing by the photographing unit and determination by the determining unit are started in response to an instruction from the instruction unit.   The determination unit collates the tableware image captured by the imaging unit with the determination image stored in the image storage unit, and for each of the plurality of foods and drinks housed in the tableware, The preference data processing device according to any one of claims 1 to 3, wherein the type and the remaining amount thereof are determined. On the computer,
A function for storing an image for determination in the image storage means for determining food and drink in the tableware and the remaining amount thereof;
A function that causes the photographing means to photograph the tableware image containing the food and drink that the customer eats and drinks;
A function of comparing the photographed food and drink tableware image with the stored determination image, and determining the food and drink in the tableware and the remaining amount thereof,
A function of storing data according to the determined food and drink and its remaining amount in the taste storage means as customer preference data;
A function of causing the output means to output the stored preference data;
A program to realize

Images