JP2004213319A - Image data processing system and image data processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce manual works related to the order of food to the payment therefor. <P>SOLUTION: The food cooked and laid out by a cook in charge is placed on a table h, and the food is imaged by cameras f and g to acquire layout image data. The layout image data are compared with food reference image data that are the reference of a proper layout of food stored in a storage part 15. Whether this layout of food is proper or not is automatically determined by a comparison part 111 according to the matching degree. The determination result of the layout of food is displayed on a display part 14 by a control part 112. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image data processing system and an image data processing program for assisting various operations using image data.
[0002]
[Prior art]
Conventionally, human work performed in restaurants, cafeterias, etc. includes accepting orders for dishes from customers, cooking and serving the ordered dishes, serving cooked dishes, and serving dishes prepared by customers. There was a settlement.
[0003]
In addition, some of the above operations are considered to be automated using a computer. For example, for the settlement of the dishes of customers who have finished meals, the dishes to be served are determined in advance according to the type (price) of the dishes, and when the dishes are settled, the dishes on which the dishes were arranged are irradiated with slit light, The irradiated tableware is photographed with a camera to acquire image data, the slit light in the image data is analyzed, the shape and number of the tableware photographed are calculated, and the shape and number of the tableware are calculated. An apparatus for adjusting the price of a dish has been considered (see, for example, Patent Document 1).
[0004]
[Patent Document 1]
Japanese Patent Laid-Open No. 10-069579 (pages 3 to 4, FIGS. 1 and 2)
[0005]
[Problems to be solved by the invention]
However, there are many parts where the above work is not alleviated, and the work may not be properly performed. For example, in the ordering of ordered dishes, there is a personality depending on the cook in charge, and the result of the ordering including the amount of dishes may not always match objectively, which is not good for customers who ordered the same dish. There was a case where fairness occurred. In terrible cases, the cook in charge sometimes forgot the arrangement of dishes to be arranged. A cooking person, a waiter or a waitress visually checks the arrangement of these dishes. However, the burden of checking the cooking arrangement of the cook was heavy, and a check error occurred because of the work by the person. In particular, when the store was busy and busy, the burden of checking the placement became even larger, and the frequency of check mistakes also increased negatively.
[0006]
In addition, when a customer places an order at the counter and the ordered food is completed, and the customer receives the food again, the waiter or waitress grasps the customer's face, the food ordered by the customer, and the order. Was a big burden. For example, a waiter or waitress may forget the customer's face, or mistakenly deliver a dish to a customer who has not ordered or a customer who has ordered but not in the order to receive it.
[0007]
Further, for the settlement of the food of the customer who finished the meal, the work of the waiter or waitress viewing the slip and entering the fee, or the work of inputting the table number from the slip of the customer was necessary. For this reason, there was a burden of input work at the time of payment.
[0008]
The subject of this invention is enabling it to reduce the operation | work which the person in a check-out performs from the order of a dish.
[0009]
[Means for Solving the Problems]
The present invention
A storage unit for storing dish reference image data serving as a reference for proper dish arrangement;
A shooting unit that shoots cooked dishes and outputs the arranged image data;
A comparison unit that compares the cooking reference image data stored in the storage unit with the arranged image data photographed in the photographing unit, and calculates the degree of coincidence;
A controller that outputs an evaluation of cooking arrangement based on the degree of coincidence calculated by the comparison unit.
[0010]
According to the present invention, the degree of coincidence between the dish reference image data and the arrangement image data is calculated, and the evaluation of dish arrangement based on the degree of coincidence is output. The burden of executing the evaluation work can be reduced. Moreover, since the cooking arrangement is accurately evaluated, it is possible to make the cook improve the cooking arrangement accuracy.
[0011]
Further, for example, the storage unit stores identification data for identifying a cook of cooking, and the control unit outputs an evaluation of the cooking arrangement corresponding to the identification data and stores it in the storage unit. You may comprise.
[0012]
Further, for example, the control unit calculates evaluation data for evaluating each cook based on the identification data stored in the storage unit and the evaluation of the cooking arrangement, and the evaluation corresponding to the identification data You may comprise as outputting data.
[0013]
The present invention also provides:
A first photographing unit for photographing an ordering customer who ordered food and outputting ordering customer image data;
A second photographing unit for photographing a customer who has received the dish and outputting the customer image data;
The ordered customer image data photographed by the first photographing unit is compared with the receiving customer image data photographed by the second photographing unit, and the ordering customer and the receiving customer match according to the degree of coincidence. A comparison unit for determining whether or not to perform,
A controller that instructs the receiving customer to execute the delivery of the dish when the comparing unit determines that the ordering customer and the receiving customer match.
[0014]
According to the present invention, it is determined whether or not the ordering customer and the receiving customer match by comparing the ordering customer image data and the receiving customer image data, and when it is determined that the ordering customer and the receiving customer match. Since the delivery instruction of the dish to the receiving customer is instructed, it is possible to reduce the burden of executing an appropriate checking operation of the receiving customer visually. In addition, since an appropriate customer is accurately identified, it is possible to prevent an error in delivery of the dish.
[0015]
The present invention also provides:
A first photographing unit for photographing an ordering customer who ordered food and outputting ordering customer image data;
A storage unit for storing the order customer image data photographed by the first photographing unit and the settlement data for settlement according to the order customer;
A second imaging unit that shoots a customer who checks out the food and outputs the customer image data;
The order customer image data stored in the storage unit is compared with the settlement customer image data photographed by the second photographing unit, and whether or not the order customer and the settlement customer match according to the degree of coincidence. A comparison unit for determining whether or not
When the comparison unit determines that the ordering customer and the checkout customer match, the checkout data corresponding to the checkout customer is read from the storage unit, and the checkout execution instruction of the dish to the checkout customer and the checkout customer And a control unit for outputting the settlement data corresponding to.
[0016]
According to the present invention, by comparing the order customer image data and the checkout customer image data, it is determined whether or not the order customer and the checkout customer match, and when it is determined that the order customer and the checkout customer match. Since the cooking customer is instructed to perform the cooking payment and the payment data is output, it is possible to reduce the burden of executing the information input operation for obtaining the payment data corresponding to the customer. In addition, since the correct settlement data corresponding to the settlement customer is output accurately, the settlement error can be prevented.
[0017]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, first and second embodiments of the present invention will be described in order with reference to the accompanying drawings.
[0018]
(First embodiment)
A first embodiment according to the present invention will be described with reference to FIGS. First, the features of the apparatus according to the present embodiment will be described with reference to FIGS. FIG. 1 is a diagram showing a configuration of an image data processing system α in the present embodiment. FIG. 2 is a diagram illustrating an internal configuration of the order terminal 20.
[0019]
As shown in FIG. 1, the image data processing system α according to the present embodiment is provided in a restaurant, a restaurant, or the like. The image data processing system α includes an ECR (Electronic Cash Register) 10 that performs various processes and settlement of dishes, a portable ordering terminal 20 that is carried by a waiter or waitress and that accepts orders, and various processes that are provided in the kitchen. Are provided for each of the kitchen terminals 30 for performing the above, cameras a and b as photographing units for photographing the face of the customer at the time of payment at the ECR 10, and tables e1 to eN (where N is an arbitrary natural number) attached to the customer. Cameras c1 to cN and d1 to dN as photographing units for photographing the face of a customer who is to be photographed, and a camera f as a photographing unit that is provided in a kitchen or a counter for serving and is used for photographing cooked food before serving g. The cameras a, b, c1 to cN, d1 to dN are connected to the ECR 10, and the cameras f and g are connected to the kitchen terminal 30. The order terminal 20 and the kitchen terminal 30 are connected to the ECR 10 and a wireless LAN (Local Area Network).
[0020]
Two cameras each shoot a subject. Cameras a, c1 to cN, f photograph the subject from the lateral direction. Cameras b, d1 to dN, g photograph the subject from above. By combining the image data from the lateral direction and the image data from the upward direction, stereoscopic image data of the subject can be photographed. The camera is a DCE (digital still camera), a digital video camera, or the like, and can capture still image data or moving image data.
[0021]
The ECR 10 includes a CPU (Central Processing Unit) 11 that centrally controls each unit, an input unit 12 that receives input of information from the user, a RAM (Random Access Memory) 13 that temporarily stores information, and information to the user. A display unit 14 for displaying information, a storage unit 15 for storing information, a camera connection unit 16 connected to the cameras a, b, c1 to cN and d1 to dN, a communication unit 17 for transmitting / receiving information to / from an external device, The timer unit 18 outputs the current date and time, and each unit is communicably connected by a bus 19.
[0022]
The CPU 11 expands in the RAM 13 an application program designated from the system programs and various application programs stored in the storage device 15, and stores various instructions input from the input unit 12 or various data corresponding thereto in the RAM 13. In accordance with the input instruction and input data, various processes are executed according to the application program stored in the storage unit 15, and the processing results are stored in the RAM 13 and displayed on the display unit 14. To do.
[0023]
The storage unit 15 includes a first order reception program for executing the first order reception process, a placement and distribution program for executing the placement and distribution process, and a payment program for executing the payment process. The cook management program for executing the cook management process and various data to be described later are stored. In the ECR 10, the CPU 11 reads the first order receiving program stored in the storage unit 15, develops it in the RAM 13, and executes it, thereby executing the first order receiving process. In the ECR 10, the CPU 11 reads the serving / laying program stored in the storage unit 15, develops it in the RAM 13, and executes it, thereby executing the serving / laying process. In the ECR 10, the CPU 11 reads the settlement program stored in the storage unit 15, develops it in the RAM 13, and executes it to execute the settlement process. In the ECR 10, the CPU 11 reads the cook management program stored in the storage unit 15, develops it in the RAM 13, and executes it, whereby the cook management process is executed. In these execution configurations, as illustrated in FIG. 1, it is assumed that the comparison unit 111 that performs various determinations and the control unit 112 that performs various controls are configured in the ECR 10. In addition, although the comparison part 111 and the control part 112 are the structures implement | achieved by software, the structure mounted as a hardware may be sufficient.
[0024]
The input unit 12 includes a keyboard having cursor keys, numeric input keys, various function keys, and the like, and outputs a pressing signal pressed by the operator using the keyboard to the CPU 11. Further, the input unit 12 may include a pointing device such as a mouse, and may output a position signal of the pointing device to the CPU 11.
[0025]
The RAM 13 is a memory having a work area for storing various programs, input data, and various data such as processing results so that they can be randomly accessed and temporarily storing various information.
[0026]
The display unit 14 includes a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or an EL (Electro Luminescence) display, and displays various display data according to display instructions input from the CPU 11. I do.
[0027]
The storage unit 15 includes a recording medium (not shown) in which various programs, various data, and the like are stored or writable in advance, and the recording medium is a magnetic or optical recording medium or a nonvolatile memory such as a semiconductor. The CPU 11 is a readable recording medium. The recording medium is not limited to a fixed hard disk or the like, but includes a removable medium such as a CD-RW, a DVD ± RW, a DVD-RAM, a memory card, and a portable hard disk.
[0028]
The RAM 13 and the storage unit 15 are configured to be able to read and rewrite internal data under the control of the CPU 11. As the recording medium, a readable / writable flexible disk, a magneto-optical disk, and a flash memory may be employed. In addition, as a recording medium for recording the program, a read-only CD-ROM, DVD, ROM or the like may be adopted.
[0029]
Moreover, you may make it the structure which receives and stores the program, data, etc. which were memorize | stored in the memory | storage part 15 from the external device via a communication network and the communication part 17. FIG. The storage unit 15 may be a storage device of an external device built on the communication network. Further, the various programs may be transmitted and installed to an external device via the communication network.
[0030]
The communication unit 17 includes a wireless LAN card, an access point, and the like that perform wireless LAN communication with the order terminal 20 and the kitchen terminal 30, but may be configured to connect to the communication network. In that case, the communication network may include not only a wireless LAN but also a wired LAN and a WAN, such as a telephone line network, an ISDN line network, a broadband communication line network, a dedicated line, a mobile communication network, a communication satellite line, and a CATV line. A configuration including an optical communication line, a wireless communication line, and an Internet service provider for connecting them may be used. The communication unit 17 may be configured to perform wired LAN communication or the like with the order terminal 20 and the kitchen terminal 30.
[0031]
The camera connection unit 16 transmits the shooting command of the CPU 11 to the cameras a, b, c1 to cN and d1 to dN, receives the captured image data from the camera, and outputs the received image data to the CPU 11. The timer unit 18 outputs the current date and time data to the CPU 11 in response to a request from the CPU 11.
[0032]
Note that the ECR 10 is configured by one information processing apparatus in the present embodiment. However, for example, a configuration in which various functions are distributed and executed by a plurality of devices by installing a plurality of devices via a communication network may be used. In this case, the load for executing various functions is distributed.
[0033]
With reference to FIG. 2, the internal structure of the order terminal 20 will be described. The order terminal 20 includes a CPU 21, a RAM 23, a display unit 24, a storage unit 25, and a communication unit 26, and each unit is connected by communication via a bus 27. The CPU 21, RAM 23, display unit 24, storage unit 25, and communication unit 26 have the same configuration as the CPU 11, RAM 13, display unit 14, storage unit 15, and communication unit 17 of the ECR 10, and different points will be described.
[0034]
The input unit 24 includes a keypad for a portable device. The display unit 24 includes a mobile device display such as an LCD or an EL display. The storage unit 25 includes a ROM, a flash ROM, and the like. The communication unit 26 performs wireless LAN communication with the ECR 10.
[0035]
The storage unit 25 stores an order input program for performing an order input process. The CPU 21 reads out the order input program stored in the storage unit 25 and stores it in the RAM 23 to execute the order input process.
[0036]
Although not shown, the kitchen terminal 30 includes a CPU, a RAM, an input unit, a display unit, a storage unit, a camera connection unit that connects to the cameras f and g, and a communication unit that performs wireless LAN communication with the ECR 10. The CPU photographs the dish on the table h on the cameras f and g via the camera connection unit by the input of the input unit such as a cook, and acquires the captured image data via the camera connection unit.
[0037]
Data stored in the storage unit 15 will be described with reference to FIGS. FIG. 3 is a diagram illustrating a configuration of the order table 50. FIG. 4 is a diagram showing the configuration of the rating score table 60. FIG. 5 is a diagram showing the configuration of the fee table 70.
[0038]
The storage unit 15 of the ECR 10 stores an order table 50, a serving score table 60, a fee table 70, and dish reference image data. As shown in FIG. 3, the order table 50 is a table having data related to orders. The table number 51 that is a number assigned to each of the tables e1 to eN and the order dish that is the name of the dish ordered by the customer. Name 52, order time 53, which is the time when the food order was received, a distributed flag 54 indicating whether or not the ordered food has been distributed, and image data of the customer who ordered the food (referred to as the ordering customer) 55.
[0039]
Table numbers 51 to 0N correspond to tables e1 to eN. In addition, the served flag 54 is set to 1 when the dish has been served, and is set to 0 when the dish is not served. The image data 55 is stereoscopic image data of the face of one customer who has made an order for each table, but the image data may be obtained by storing and storing a plurality of patterns for each person due to changes in facial expressions. . Further, the image data 55 may be image data of a plurality or all of customers on the table. This is because the ordering customer and the checkout customer may be different when a group of a plurality of people is attached to one table.
[0040]
As shown in FIG. 4, the scoring score table 60 is a table showing the scoring score of dishes for each cook belonging to a restaurant, canteen, etc., and a cook code 61 that is a character code for identifying each cook. And a score 62 that is the total score of each cook's dishes, and a basic salary 63 for each cook. The rating score 62 is data reflected in each cook's salary. If the cooking is poor, the score is reduced each time.
[0041]
The data for identifying each cook is not limited to the cook code, and may be a cook name, cook number, or the like. Further, in the present embodiment, the ranking score 62 is assumed to be data for each month when the basic salary 63 is a basic salary, but is not limited to this, and is not limited to this, but every day, every week, every week, It is good also as data of the arbitrary period every year.
[0042]
As shown in FIG. 5, the price table 60 includes an ordered dish name 71 that is the name of the ordered dish, and a dish price 72 corresponding to each dish name. In addition, although not shown, the dish reference image data stored in the storage unit 15 is image data of appropriate dishes that serve as a reference for the amount and arrangement of each dish. This dish reference image data is also three-dimensional image data.
[0043]
Next, the operation of the image data processing system α will be described with reference to FIGS. FIG. 6 is a flowchart showing an order input process executed by the order terminal 20. FIG. 7 is a flowchart showing a first order receiving process executed by the ECR 10. FIG. 8 is a flowchart showing the arrangement / laying process executed by the ECR 10. FIG. 9 is a diagram showing a display screen displayed on the kitchen terminal 30 or the order terminal 20, (I) is a diagram showing a display screen 3A displayed on the kitchen terminal 30, and (II) is a display on the kitchen terminal 30. (III) is a diagram showing a display screen 2A displayed on the ordering terminal 20. FIG. FIG. 10 is a flowchart showing the settlement process executed by the ECR 10. FIG. 11 is a flowchart showing the cook management process executed by the ECR 10.
[0044]
First, a customer who enters the restaurant where the image data processing system α is installed and attaches to the table or a customer who is already on the table requests an order, and a customer such as a waiter or waitress listens to the order. Take 20 and head to the table where the customer is sitting. Then, triggered by the input of execution of the order input process from the input unit 22 of the order terminal 20 by the customer, the CPU 21 reads the order input program from the storage unit 25 and stores it in the RAM 23 to execute the order input process. To do.
[0045]
As shown in FIG. 6, first, the table number of the table on which the customer is seated is input by the customer service via the input unit 22, and the table number is transmitted to the ECR 10 via the communication unit 26. Order data corresponding to the number is received (step S11). The order data includes a table number, an order dish name, an order time, and a distributed flag. On the ECR 10 side, a table number is received from the order terminal 20 via the communication unit 17. In the order table 50 in the storage unit 15, the received table number, the corresponding order dish name 52, the order time 53, and The distributed flag 54 is read as order data, and the order data is transmitted to the order terminal 20 via the communication unit 17. The order data is data that has already been ordered and stored in the ECR 10 before execution of the order input process, and is NULL in the case of a new customer.
[0046]
And it is discriminate | determined whether the input flag corresponding to the table number input by step S11 is ON (= 1) among the input flags memorize | stored in the memory | storage part 25 (step S12). The fact that the input flag is ON indicates that the order input at the currently used ordering terminal 20 is temporarily stopped halfway. When the input flag is ON (step S12; YES), the temporarily completed order dish name stored in the storage unit 25 is read (step S13).
[0047]
Then, the order dish name is input via the input unit 22 by the distributor (step S13). When the input flag is off (step S12; NO), the process proceeds to step S14. And it is discriminate | determined whether the order dish name input in step S14 was complete | finished, or it was temporarily terminated (step S15). If the order dish name input has not been completed (step S15; NO), the process proceeds to step S14. When the order dish name input is completed (step S15; YES), the input flag corresponding to the table number acquired in step S11 stored in the storage unit 25 is turned off, and the order dish name input in step S14. Then, the table number acquired in step S11 is transmitted as order data to the ECR 10 via the communication unit 26 (step S16), and the order input process is terminated.
[0048]
When the order data input is temporarily terminated (step S15; temporary termination), the input flag stored in the storage unit 25 and corresponding to the table number input in step S11 is turned on, and input to the storage unit 25 in step S14. The ordered dish name is stored (step S17), and the order input process is terminated.
[0049]
Next, triggered by the start of order data reception from the order terminal 20 via the communication unit 17 of the ECR 10, the CPU 11 reads the first order acceptance program from the storage unit 15, stores it in the RAM 13, and stores it in the first RAM. The order reception process is executed.
[0050]
As shown in FIG. 7, first, order data is received from the order terminal 20 via the communication unit 17 (step S21). Then, the current time is acquired from the time measuring unit 18, and the current time is stored in the order table 50 in the storage unit 15 together with the order data received in step S21 (step S22). Specifically, the table number and the order dish name in the order data are stored in the table number 51 and the order dish name 52, and the current time is stored in the order time 53. In addition, the arranged flag 54 is stored as off (= 0).
[0051]
Then, the ordering customer's face photographing instruction is transmitted to the camera corresponding to the table to which the ordering customer is attached from among the tables e1 to eN via the camera connection unit 16, and the ordering customer is responded by the camera according to the photographing instruction. The photographed customer's image data is received from the camera via the camera connection unit 16, and the customer image data is stored in the order table 50 in the storage unit 15 (step S23). ). Specifically, the order customer image data is stored in the image data 55 of the record stored in step S22 in the order table 50.
[0052]
Then, the order dish name received in step S21 is transmitted to the kitchen terminal 30 via the communication unit 17 (step S24), and the first order receiving process is ended.
In the kitchen terminal 30, the order dish name is received from the ECR 10, and the order dish name is displayed on a display unit (not shown). The cook looks at the displayed order dish name and performs cooking of the ordered dish. Here, the cook in charge of cooking the dish is the responsible cook.
[0053]
Next, when cooking of the dish ordered by the cook in charge is completed and the arrangement is completed, the dish on which the arrangement has been completed is placed on the table h. The person in charge of cooking inputs the fact that cooking of the dishes has been completed and the cook code of the person in charge of the person in charge through the input unit (not shown) of the kitchen terminal 30. Then, the kitchen terminal 30 transmits a photographing instruction to the cameras f and g, and the dishes on the table h are photographed by the cameras f and g and transmitted to the kitchen terminal 30 as arranged image data. Then, the kitchen terminal 30 transmits to the ECR 10 the completion of the dish arrangement and the cook code.
[0054]
Then, triggered by the fact that cooking has been completed from the kitchen terminal 30 and the cook code received from the kitchen terminal 30 via the communication unit 17 of the ECR 10, the CPU 11 reads out the arrangement and distribution program from the storage unit 15 and reads the RAM 13 And store and serve.
[0055]
As shown in FIG. 8, first, the arranged image data is received from the kitchen terminal 30 via the communication unit 17 (step S31). Then, it is determined whether or not the arrangement image data is received in step S31 (step S32). When the arranged image data has not been received (step S32), the process proceeds to step S32. When the arrangement image data is received (step S32; YES), the dish reference image data stored in the storage unit 15 corresponding to the dish for which the arrangement has been completed is read (step S33).
[0056]
Then, the comparison unit 111 compares the configuration of the arranged image data received in step S31 and the arranged image data received in step S33 (step S34). The comparison of image data configurations is performed based on, for example, brightness distribution, color distribution, and the like. In addition, since the image data is three-dimensional, it can be compared more accurately than planar image data. Further, for example, the degree of coincidence of image data is calculated, and when the degree of coincidence is equal to or greater than a predetermined value, the same configuration is determined. When the degree of coincidence is lower than the predetermined value, it is determined that the configuration is not the same. If the composition is the same, it means that there is no problem in arranging finished dishes. If the composition is not the same, it means that there is a problem with the arrangement of the finished dish.
[0057]
Then, based on the comparison result in step S34, the comparison unit 111 determines whether the arrangement image data received in step S31 and the arrangement image data received in step S33 have the same configuration. (Step S35). If the structure is the same (step S35; YES), the order dish name and the order dish name 52 of the dish having the same structure in the records of the order table 50 match, the serving flag 54 is 0, and the order time is reached. The table number 51 having the earliest 53 is acquired (step S36).
[0058]
Then, the control unit 112 transmits, via the communication unit 17, data indicating that there is no problem in arranging the completed dish (OK) and the table number acquired in step S36 to the kitchen terminal 30 ( Step S37). Then, the control unit 112 sends the data indicating the ordering instruction for the ordered food, the table number acquired in step S 36, and the image data 55 of the order table 50 corresponding to the table number 51 via the communication unit 17. It is transmitted to the order terminal 20 (step S38). Then, the distribution completed flag 53 corresponding to the ordered dish instructed for distribution in the order table 50 is turned on (= 1) (step S39), and the arrangement distribution process is ended.
[0059]
When the configuration is different (step S35; NO), the control unit 112 transmits data indicating that there is a problem (NG) to the finished dish arrangement to the kitchen terminal 30 via the communication unit 17 ( Step S40). And in the arrangement | positioning score table 60 in the memory | storage part 15, the arrangement | positioning score 62 corresponding to the cook code received before step S31 is deducted a predetermined number of points (step S41), and arrangement | positioning distribution process is complete | finished.
[0060]
After step S37, in the kitchen terminal 30, the data indicating that the completed dish arrangement is OK and the table number are received from the ECR 10, and the data indicating that the completed dish arrangement is OK; The table number and the cook name corresponding to the cook code are displayed on a display unit (not shown) of the kitchen terminal 30. For example, it is displayed as a display screen 3B as shown in FIG. For this reason, it can be made to confirm that the cook in charge does not have any problem with the cooking by the display screen 3B.
[0061]
Further, after step S38, the order terminal 20 receives the data indicating the ordering of the ordered dish, the table number thereof, and the order customer image data from the ECR 10, and the data indicating the ordering instruction of the ordered dish. The table number and the order customer image data are displayed on the display unit 24 of the order terminal 20. For example, it is displayed as a display screen 2A as shown in FIG. For this reason, the customer can check the table number of the serving destination and the order customer image data on the display screen 2A, and the ordered dishes can be easily served.
[0062]
In addition, after step S40, the kitchen terminal 30 receives data indicating that the completed dish is NG from the ECR 10, data indicating that the completed dish is NG, and the cook code The name of the cook corresponding to is displayed on a display unit (not shown) of the kitchen terminal 30. For example, it is displayed as a display screen 3A as shown in FIG. For this reason, it is possible to cause the cook in charge to confirm that there is a problem with the cooking arrangement and to perform the cooking arrangement re-execution on the display screen 3A.
[0063]
Next, in order for the ordering customer to finish eating the ordered food and to settle the food, the customer (referred to as the “accounting customer”) moves to the checkout office where the ECR 10 is installed. Cameras a and b are installed at the checkout office. Then, triggered by the start of the settlement process input by the customer via the input unit 12 of the ECR 10, the CPU 11 reads the settlement program from the storage unit 15, stores it in the RAM 13, and executes the settlement process.
[0064]
As shown in FIG. 10, first, all the image data 55 (order customer image data) of the order table 50 in the storage unit 15 is read (step S51). Then, an instruction for photographing the customer's face is transmitted to the cameras a and b via the camera connection unit 16, and the face of the customer is photographed according to the photographing instruction by the cameras a and b. Customer image data is received from the cameras a and b via the camera connection unit 16, and the customer image data is stored in the RAM 13 (step S52). The checkout customer image data is also three-dimensional image data.
[0065]
Then, the ordering customer image data read in step S51 is compared with the adjusted customer image data photographed in step S52 by the comparison unit 111 (step S53). This image data comparison is the same as the image data comparison in step S34. Then, based on the comparison result of step S53, the comparison unit 111 determines whether or not the subject customers of the order customer image data and the checkout customer image data are the same person (step S54).
[0066]
When it is determined that they are the same person (step S54; YES), the table number 51 corresponding to the order customer image data (corresponding to the checkout customer image data) and the order food from the order table 50 in the storage unit 15 are also obtained. The name 52 is read, and the charge 72 corresponding to the read ordered dish name 52 is read from the charge table 70 in the storage unit 15, and the total is calculated (step S55). Then, the total charge calculated in step S55 is displayed on the display unit 14 by the control unit 112 together with the read table number, a settlement instruction is displayed on the display unit 14 (step S56), and the settlement process is terminated. The The customer performs checkout based on the total fee and checkout instructions.
[0067]
If it is not determined that they are the same person (step S54; NO), the customer number is input by the customer service via the input unit 12 (step S57), and the process proceeds to step S55. In this case, in step S55, the order dish name 52 corresponding to the table number read in step S57 is read from the order table 50 in the storage unit 15, and read from the charge table 70 in the storage unit 15. A fee 72 corresponding to the order name 52 is read and the sum is calculated.
[0068]
Although omitted in the present embodiment, the ECR 10 is provided with a print output unit for printing receipts and the like. After the settlement is performed, a receipt including the name of the order dish, table name, etc. is output from the print unit. , The receipt is handed over from the customer to the checkout customer.
[0069]
Next, the cook management process which evaluates the cooking arrangement of the cook will be described. The cook management process is automatically executed after the end of the daily business. This execution interval is not limited to every day, but may be other intervals such as every week. In addition, the salary closing date is determined in advance. Triggered by the execution of the cook management process by the manager such as the store manager via the input unit 12 of the ECR 10, the CPU 11 reads the cook management program from the storage unit 15 and stores it in the RAM 13 to store the cook. Execute management processing. In addition, the cook management process may be automatically executed with a trigger at a predetermined time for each predetermined period.
[0070]
As shown in FIG. 11, first, the current date and time is acquired from the time measuring unit 18, and it is determined whether or not the current date and time is the cook's salary closing date (step S61). If it is the salary closing date (step S61; YES), an unselected (new or next) cook among all cooks is selected, and the selected cook is selected from the rating score table 60 in the storage unit 15. The serving score 62 and the basic salary 63 corresponding to the cook code 61 are read out (step S62).
[0071]
Then, salary data is calculated based on the rating score and basic salary read in step S62, and the salary data is stored in the storage unit 15 (step S63). Specifically, for example, when a rating score is given by the deduction method, it is calculated by the formula of basic salary * (current rating score / first rating score). For example, the salary data of the cook with the cook code 001 in FIG. 4 is 250,000 * (1000/1000) = 250,000, and the salary data of the cook with the cook code 002 is 200000 * (900/1000) = 18000. Become.
[0072]
Then, the rating score 62 corresponding to the selected cook in the rating score table 60 is reset to the first numerical value and stored (step S64). And it is discriminate | determined whether all the cooks were selected in step S62 (step S65). When all the cooks are not selected (step S65; NO), the process proceeds to step S62. When all the cooks are selected (step S65; YES), the cook management process is terminated.
[0073]
When it is not the salary closing date (step S61; NO), the rating score table 60 in the storage unit 15 is read, the rating score table 60 is displayed on the display unit 14 as a report (step S66), and the cook management process is performed. Is terminated. By displaying the rating score table 60, an administrator can confirm the rating score table 60. Based on the rating score 62 of the rating score table 60, the manager can appropriately instruct the cook to improve the rating. Further, when the ECR 10 is provided with a print output unit (not shown), the salary data and the report may be printed out. Further, in the arrangement / laying process, the arrangement image data that has been arranged as NG may be stored in the storage unit 15, and in that case, the arrangement image data that has been decided as NG is displayed on the display unit 14. (Or print output from the print output unit) to show the NG arrangement image data to the cook and instruct the arrangement.
[0074]
As described above, according to the present embodiment, in cooking arrangement and serving, the dishes cooked and arranged by the responsible chef are photographed by the cameras f and g to obtain the arrangement image data, and the arrangement image is obtained. The data and the cooking reference image data are compared to determine whether there is a problem, and the determination result is displayed on the display unit 14. For this reason, the burden of the check of the dish arrangement | positioning by human visual observation is reduced, and the check of the dish arrangement | positioning can be performed correctly. In addition, the determination result can be notified to the cook in charge, and the cook can be improved in the accuracy of cooking.
[0075]
Further, according to the present embodiment, when there is a problem in the dishing of the dish, the serving chef's serving score is deducted, and the salary as the evaluation of each cook is determined based on the serving score. The For this reason, the cook can be evaluated fairly by checking the cooking arrangement by comparing the image data, not by human eyes, and the burden of the execution of the evaluation by the manager can be reduced. In addition, the evaluation result (salary) can allow the cook to further improve the accuracy of cooking.
[0076]
Further, according to the present embodiment, in the settlement of dishes, the order customer image data photographed at the time of ordering is compared with the settlement customer image data photographed at the time of settlement, and it is determined that the subject is the same person. In such a case, a total charge corresponding to the checkout customer is calculated and the checkout is instructed. For this reason, it is possible to reduce the burden of checking and inputting the table number of the customer at the time of payment by the customer, and it is possible to accurately calculate and settle the total fee.
[0077]
In the present embodiment, the arrangement score is deducted by a predetermined number when the dish arrangement becomes NG. However, the present invention is not limited to this. A configuration may be used in which the number of points to be deducted is changed stepwise in accordance with the degree of coincidence with the reference image data. Further, when the degree of matching is high and the rating is excellent, a configuration may be used in which a predetermined score is added to the rating score, or the number of added points may be changed stepwise in accordance with the level of matching. Moreover, the structure which deducts a score at the stage where the number of NGs of arrangement | positioning reaches predetermined number may be sufficient, and the structure which adds a score for the stage when the number of OK times of arrangement | positioning reaches predetermined number may be sufficient.
[0078]
Further, in the arrangement and distribution process, the order terminal 20 and the kitchen terminal 30 are each provided with a print output unit, and data corresponding to each of the display screen 3A shown in FIG. 9I and the display screen 3B shown in FIG. A configuration may be adopted in which printing is performed at the kitchen terminal 30 and data corresponding to the display screen 2A shown in FIG.
[0079]
(Second Embodiment)
Next, a second embodiment according to the present invention will be described with reference to FIGS. This embodiment is not a method in which a customer visits a table to take an order as in the first embodiment, but when a customer orders food at the counter and then the ordered food is completed, Is applied again to restaurants, etc. that take custom dishes to the counter again. First, the features of the apparatus according to the present embodiment will be described with reference to FIG. FIG. 12 is a diagram showing a configuration of the image data processing system β in the present embodiment.
[0080]
As shown in FIG. 12, the image data processing system β according to the present embodiment includes a camera i as a photographing unit that photographs an ECR 80 installed in a counter and an ordering customer and a dish receiving customer that are also installed in the counter. j and a kitchen terminal 90 provided in the kitchen and connected to the ECR 80 by a wireless or wired LAN. Three-dimensional image data of an ordering customer and a delivery customer as subjects are photographed by a camera i photographing from the horizontal direction and a camera j photographing from the upward direction.
[0081]
The kitchen terminal 90 has the same configuration as the kitchen terminal 30 in the first embodiment. The ECR 80 includes a CPU 81, an input unit 82, a RAM 83, a display unit 84, a storage unit 85, a camera connection unit 86 connected to the cameras i and j, and a communication unit that performs wireless LAN communication with the kitchen terminal 90. 87 and a time measuring unit 88, and each unit is communicatively connected to a bus 89. The CPU 81, the input unit 82, the RAM 83, the display unit 84, the storage unit 85, the camera connection unit 86, the communication unit 87, and the time measuring unit 88 are respectively the CPU 11, the input unit 12, the RAM 13, the display unit 14, the storage unit 15, and the camera. The configuration is the same as that of the connection unit 16, the communication unit 17, and the time measuring unit 18. Therefore, a different part from ECR10 and the kitchen terminal 30 of 1st Embodiment is mainly demonstrated.
[0082]
The storage unit 85 stores a second order receiving program for executing the second order receiving process, a delivery program for executing the dish delivery process, and various data to be described later. In the ECR 80, the CPU 81 reads out the second order reception processing program stored in the storage unit 85, develops it in the RAM 83, and executes it to execute the second order reception processing. Further, in the ECR 80, the CPU 81 reads out the delivery program stored in the storage unit 85, develops it in the RAM 83, and executes it to execute delivery processing. In this execution configuration, as shown in FIG. 12, the comparison unit 811 that performs various determinations and the control unit 812 that performs various controls will be described as being configured in the ECR 80. In addition, although the comparison part 811 and the control part 812 are the structures implement | achieved by software, the structure mounted as a hardware may be sufficient.
[0083]
Next, a data configuration stored in the storage unit 85 will be described with reference to FIG. FIG. 13 is a diagram showing the configuration of the order table 100. The storage unit 85 stores an order table 100 shown in FIG. The order table 100 is a table having data related to orders, and includes an order dish name 101, an order time 102, a delivery completion flag 103 indicating whether or not a dish has been delivered, and image data 104. The order dish name 101, the order time 102, the delivered flag 103, and the image data 104 are respectively the order dish name 51, the order time 52, the served flag 53, and the image data 54 of the order table 50 of the first embodiment. It is the same.
[0084]
Next, the operation of the image data processing system β will be described with reference to FIGS. 14 and 15. FIG. 14 is a flowchart showing a second order receiving process executed by the ECR 80. FIG. 15 is a flowchart showing a delivery process executed by the ECR 80.
[0085]
First, an ordering customer who wants to order food comes to the counter where the ECR 80 is installed to order food. The CPU 81 uses the second order receiving program from the storage unit 85 as a trigger when the execution of the second order receiving process is input via the input unit 82 of the ECR 80 by a waiter or waitress at the counter. Is stored in the RAM 83 and the second order receiving process is executed.
[0086]
As shown in FIG. 14, first, the customer name of the dish ordered by the ordering customer is input via the input unit 82 by the customer service (step S71). And it is discriminate | determined whether the input of the order dish name in step S71 was complete | finished (step S72). When the input of the order dish name is not completed (step S72; NO), the process proceeds to step S71.
[0087]
When the input of the order food name is completed (step S72; YES), the current time is acquired from the time measuring unit 88, and the current time is stored in the storage unit 85 as the order table 100 together with the order food name input in step S71. (Step S73). Specifically, the inputted order dish name is stored as the order dish name 101 and the current time is stored as the order time 102. In addition, the delivery completion flag 103 is set to off.
[0088]
Then, an ordering customer's face photographing instruction is transmitted to the cameras i and j via the camera connection unit 86, and the ordering customer's face is photographed and photographed in accordance with the photographing instruction by the cameras i and j. The customer image data is received from the cameras i and j via the camera connection unit 86, and the ordered customer image data is stored in the image data 104 of the order table 100 (step S75). The order customer image data is stereoscopic image data.
[0089]
Then, order data including the order dish name is transmitted to the kitchen terminal 90 via the communication unit 87 (step S75), and the second order acceptance process is ended. The kitchen terminal 90 receives the order data from the ECR 80 and displays the order dish name on a display unit (not shown). For this reason, the cook name of the kitchen can be confirmed. The cook in charge performs the cooking of the custom dish name.
[0090]
Next, cooking and arrangement of the dish by the cook in charge are completed, and the cook instructor inputs the completion of the dish through the input unit (not shown) of the kitchen terminal 90, and the ECR 80 through the communication unit (not shown). Is sent to that effect. Then, the completion of cooking is received from the kitchen terminal 90 via the communication unit 80 of the ECR 80. After that, a customer (received customer) appears on the counter to receive the ordered food. Therefore, triggered by the customer input from the input unit 82 of the ECR 80 as a trigger, the CPU 81 reads the dish delivery program from the storage unit 85, stores it in the RAM 83, and executes the delivery process.
[0091]
As shown in FIG. 15, in the order table 100 in the storage unit 85, the completed order dish name matches the order dish name 101, the delivery flag 103 is off (= 0), and the order time 102 is one. The earliest image data 104 is read (step S81). Then, an instruction for photographing the recipient's face is transmitted to the cameras i and j via the camera connection unit 86, and the receiver's face is photographed according to the photographing instruction by the cameras i and j, and the photographed receipt is received. The customer image data is received from the cameras i and j through the camera connection unit 86, and the received customer image data is stored in the RAM 83 (step S82). The customer image data is stereoscopic image data.
[0092]
Then, the ordering customer image data read in step S81 is compared with the customer image data taken in step S82 by the comparison unit 811 (step S83). This image data comparison is the same as the image data comparison in step S34 of the first embodiment. Then, based on the comparison result of step S83, the comparison unit 811 determines whether or not the customers as subjects of the ordered customer image data and the received customer image data are the same person (step S84).
[0093]
When it is determined that they are the same person (step S84; YES), the control unit 812 displays instruction data indicating delivery of the completed custom dish to the receiver on the display unit 84 (step S85). Then, the delivery completion flag 103 of the order table 100 in the storage unit 85 corresponding to the order customer image data read in step S81 is set to ON (step S86), and the delivery process is ended. The customer service delivers the completed custom dish to the customer based on the instruction data for delivering the displayed custom dish.
[0094]
When it is determined that they are not the same person (step S84; NO), all the order customer image data corresponding to the order dish name are searched from the image data 104 of the order table 100 together with the order time 102 (step S87). Then, the control unit 812 displays on the display unit 82 data indicating that the ordering customer to whom the food is to be delivered is different from the receiving customer, the ordering customer image data retrieved in step S87, and the ordering time. (Step S88), the delivery process is terminated. Based on the data display to indicate that the customer is different, the customer can identify the customer's ordered customer image data, check the order time, and inform the customer of the current waiting number, expected completion time, etc. .
[0095]
As described above, according to the present embodiment, in the counter, the ordering customer image data is acquired by the cameras i and j when the dish is ordered and the ordering customer image data is acquired, and the receiving customer is captured and received when the completed dish is delivered. The customer image data is acquired, the order customer image data to be delivered and the received customer image data are compared to determine whether or not the subject is the same person, and if the subject is the same person, a dish delivery instruction is displayed. Displayed on the portion 84. For this reason, the burden of the confirmation work of the customer who should deliver the dish by the customer can be reduced. In addition, it is possible to accurately confirm the customer who should deliver the food, and it is possible to prevent the food from being delivered to the wrong customer.
[0096]
Further, even when the subject of the order customer image data to which the dish is to be delivered and the customer image data are not the same person, the order customer image data for which the dish has been ordered is displayed on the display unit 84 together with the order time. For this reason, the customer can be made to explain the current situation to the customer who should not deliver the dish.
[0097]
In the first and second embodiments, the configuration is such that the subject is photographed by two cameras and stereoscopic image data is acquired. However, the present invention is not limited to this, and one camera is used. A configuration in which a subject is photographed to obtain planar image data may be used. In the first and second embodiments, the various processes are performed by the ECR. However, the present invention is not limited to this, and the various processes may be performed in an information processing apparatus independent of the ECR. .
[0098]
As described above, the embodiments of the present invention have been described. However, the present invention is not necessarily limited only to the above-described means and methods, and within the scope of achieving the object of the present invention and having the effects of the present invention. It is possible to make changes as appropriate.
[0099]
【The invention's effect】
According to the present invention, the degree of coincidence between the dish reference image data and the arrangement image data is calculated, and the evaluation of dish arrangement based on the degree of coincidence is output. The burden of executing the evaluation work can be reduced. Moreover, since the cooking arrangement is accurately evaluated, it is possible to make the cook improve the cooking arrangement accuracy.
[0100]
Further, according to the present invention, it is determined whether or not the ordering customer and the receiving customer match by comparing the ordering customer image data and the receiving customer image data, and it is determined that the ordering customer and the receiving customer match. In this case, since the delivery instruction of the dish to the receiving customer is instructed, it is possible to reduce the burden of executing an appropriate checking operation of the receiving customer visually. In addition, since an appropriate customer is accurately identified, it is possible to prevent an error in delivery of the dish.
[0101]
Further, according to the present invention, by comparing the order customer image data and the checkout customer image data, it is determined whether or not the order customer and the checkout customer match, and it is determined that the order customer and the checkout customer match. In this case, since the payment adjustment instruction and the payment data of the food to the payment customer are output, it is possible to reduce the burden of executing the information input operation for obtaining the payment data corresponding to the payment customer. In addition, since the correct settlement data corresponding to the settlement customer is output accurately, the settlement error can be prevented.
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration of an image data processing system α in a first embodiment according to the present invention.
FIG. 2 is a diagram showing an internal configuration of the order terminal 20;
3 is a diagram showing a configuration of an order table 50. FIG.
FIG. 4 is a diagram showing a configuration of a rating score table 60;
FIG. 5 is a diagram showing a configuration of a charge table 70;
6 is a flowchart showing an order input process executed by the order terminal 20. FIG.
FIG. 7 is a flowchart showing a first order receiving process executed by the ECR 10;
FIG. 8 is a flowchart showing the arrangement / laying process executed by the ECR 10;
9 is a diagram showing a display screen displayed on the kitchen terminal 30 or the order terminal 20, FIG. 9 (I) is a diagram showing a display screen 3A displayed on the kitchen terminal 30, and (II) is a display on the kitchen terminal 30. (III) is a diagram showing a display screen 2A displayed on the ordering terminal 20. FIG.
FIG. 10 is a flowchart showing a checkout process executed by the ECR10.
FIG. 11 is a flowchart showing a cook management process executed by the ECR 10;
FIG. 12 is a diagram showing a configuration of an image data processing system β in the second embodiment according to the present invention.
13 is a diagram showing a configuration of an order table 100. FIG.
FIG. 14 is a flowchart showing a second order receiving process executed by ECR80.
15 is a flowchart showing a delivery process executed by the ECR 80. FIG.
[Explanation of symbols]
α, β ... Image data processing system
10, 80 ... ECR
20 ... Order terminal
11, 21, 81 ... CPU
111, 811 ... comparison unit
112, 812 ... control unit
12, 22, 82 ... input section
13, 23, 83 ... RAM
14, 24, 84 ... display section
15, 25, 85 ... storage unit
16, 86 ... Camera connection part
17, 26, 87 ... communication section
18, 88 ... Timekeeping section
30, 90 ... Kitchen terminal
a, b, c1 to cN, d1 to dN, f, g, i, j ... camera
e1-eN, h ... table
19, 29, 89 ... bus

Claims (8)

A storage unit for storing dish reference image data serving as a reference for proper dish arrangement;
A shooting unit that shoots cooked dishes and outputs the arranged image data;
A comparison unit that compares the cooking reference image data stored in the storage unit with the arranged image data photographed in the photographing unit, and calculates the degree of coincidence;
A control unit that outputs an evaluation of cooking arrangement based on the degree of coincidence calculated by the comparison unit;
An image data processing system that assists in arranging appropriate dishes using image data. The storage unit stores identification data for identifying a cook of cooking,
The image data processing system according to claim 1, wherein the control unit outputs an evaluation of the dish arrangement in correspondence with the identification data and stores the evaluation in the storage unit. The control unit calculates evaluation data for evaluating each cook based on the identification data stored in the storage unit and the evaluation of the cooking arrangement, and outputs the evaluation data corresponding to the identification data. The image data processing system according to claim 2. A first photographing unit for photographing an ordering customer who ordered food and outputting ordering customer image data;
A second photographing unit for photographing a customer who has received the dish and outputting the customer image data;
The ordered customer image data photographed by the first photographing unit is compared with the receiving customer image data photographed by the second photographing unit, and the ordering customer and the receiving customer match according to the degree of coincidence. A comparison unit for determining whether or not to perform,
A controller for instructing delivery of the dish to the receiving customer when the comparing unit determines that the ordering customer and the receiving customer match;
An image data processing system that assists in the delivery of an appropriate dish using image data. A first photographing unit for photographing an ordering customer who ordered food and outputting ordering customer image data;
A storage unit for storing the order customer image data photographed by the first photographing unit and the settlement data for settlement according to the order customer;
A second imaging unit that shoots a customer who checks out the food and outputs the customer image data;
The order customer image data stored in the storage unit is compared with the settlement customer image data photographed by the second photographing unit, and whether or not the order customer and the settlement customer match according to the degree of coincidence. A comparison unit for determining whether or not
When the comparison unit determines that the ordering customer and the checkout customer match, the checkout data corresponding to the checkout customer is read from the storage unit, and the checkout execution instruction of the dish to the checkout customer and the checkout customer And a control unit that outputs settlement data corresponding to
An image data processing system that assists in the settlement of appropriate dishes using image data. On the computer,
A function of shooting cooked dishes and outputting arranged image data,
A function for comparing dish reference image data stored in a storage unit for storing dish reference image data serving as a reference for proper dish arrangement and the photographed serving image data, and calculating a degree of coincidence thereof; ,
An image data processing program for realizing a function of outputting an evaluation of cooking arrangement based on the calculated degree of coincidence. On the computer,
A function for photographing the customer who ordered the food and outputting the customer image data,
A function to capture the customer who came to receive the food and output the customer image data,
A function of comparing the photographed order customer image data with the photographed customer image data, and determining whether the order customer and the customer are in accordance with the degree of matching;
An image data processing program for realizing a function of instructing delivery of a dish to the receiving customer when it is determined that the ordering customer and the receiving customer match. On the computer,
A function for photographing the customer who ordered the food and outputting the customer image data,
A function of storing the photographed order customer image data and settlement data for settlement according to the order customer in a storage unit;
The function of photographing the customer who is paying for the food and outputting the customer image data,
A function of comparing the order customer image data stored in the storage unit with the photographed customer image data and determining whether or not the order customer and the customer are matched according to the degree of matching; ,
When it is determined that the order customer and the checkout customer coincide with each other, the checkout data corresponding to the checkout customer is read from the storage unit, the cooking checkout execution instruction to the checkout customer, and the checkout corresponding to the checkout customer An image data processing program for realizing a function of outputting data.

Images