WO2019234997A1 - Food product management system - Google Patents

Abstract

Provided is a food product management system capable of providing information on food products in accordance with customer trends and preferences prior to food product purchase. The food product management system has: a sensor for detecting a food product (fd) in a store (3) and a visitor (hm) visiting the store (3); and a food product management unit for managing food products. The sensor sends detection information detected by the sensor. The food product management unit receives the detection information, obtains association information that associates the food product (fd) and the visitor (hm) detected by the sensor, and generates food product information relating to the food product (hd) associated with the visitor (hm).

Description

Food management system

This disclosure relates to a food management system for managing food.

Patent Document 1 discloses a dietary management system that generates user-specific dietary management information when a meal is settled.

Japanese Unexamined Patent Publication No. 2006-276900

In Patent Document 1, if the customer did not actually buy the food, the information on the food such as calorie intake was not known. For this reason, it was assumed that the purchased food would be disappointing for the customer. For this reason, it is desired that food information is provided so that the customer can obtain information on the food (for example, the total calories of the food) before purchasing the food and use it as a judgment material for the purchase of the food. Furthermore, it is desirable to be able to provide food information according to customer trends and preferences.

This disclosure has been made in view of the above circumstances, and provides a food management system that can provide food information according to customer trends and preferences before purchasing food.

One aspect of the present disclosure includes a sensor that detects food in a store, a customer in the store, and a food management device that manages the food, and the sensor is detected by the sensor. The food management device receives the detection information, associates the food detected by the sensor with the customer, and derives food information related to the food associated with the customer. It is a food management system.

According to the present invention, food information can be provided in accordance with customer trends and preferences before purchasing food.

The figure which shows an example of the outline | summary of the buffet type counter system in 1st Embodiment. Plan view showing an example of a buffet-type counter viewed from above The figure which shows an example of the hardware constitutions of the buffet type counter system 5 The figure which shows an example of the hardware constitutions of a camera The figure which shows an example of the hardware constitutions of the smart phone The figure which shows an example of the hardware constitutions of a server The figure which shows an example of the information provision area of the buffet type counter in which the information corresponding to the position of a smart phone is provided The figure which shows an example of the registration content of the condition determination table registered in the memory of a server The figure explaining an example of matching of the food placed on the tray and the smartphone The sequence diagram which shows an example of the operation | movement procedure of the buffet type counter system in a 1st operation example. Diagram showing an example of the record contents of a record The figure which shows an example of the screen of the smart phone on which the information regarding the food on the tray is displayed The flowchart which shows an example of the operation | movement procedure of the server in a 2nd operation example. The figure which shows an example of the screen of the smart phone where the recommended menu is displayed The figure which shows schematically an example of the table vicinity of the fixture of the buffet-type counter in 2nd Embodiment. The figure which shows an example of a mounting surface The figure which shows an example of a structure of a face-up mechanism

Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter.

(First embodiment)
FIG. 1 is a diagram illustrating an example of an outline of a buffet counter system 5 including a buffet counter 10 according to the first embodiment.

The buffet counter 10 may be installed in a store 3 such as a convenience store or a supermarket food department. The buffet-type counter 10 is, for example, arranged in a bowl 11 with a rectangular food space 15 in the center, a pair of semicircular counters 12 a and 12 b arranged on both sides of the bowl 11, and before and after the bowl 11. The long counters 12c and 12d are combined.

On the upper surface of the counters 12a to 12d, a lane in which the tray 70 is movable is formed so as to surround the food space 15 of the fixture 11. The movable lane is formed on the upper surfaces of the counters 12a and 12b, and may not be formed on the upper surfaces of the counters 12c and 12d. At least one of the counters 12a to 12d is also simply referred to as a counter 12.

In the food space 15, many foods fd are stacked and displayed in multiple stages. A coffee maker 61 and an oden utensil 62 may be installed on the upper surface of the counter 12b. A payment terminal or a server 30 having a payment function may be installed on the upper surface of the counter 12a. Moreover, the recessed part 12z may be formed in the side surface of the counter 12a. In the recess 12z, unused trays 70 are stacked in multiple stages.

Above the buffet counter 10, for example, two signage 50 are suspended from the ceiling. The signage 50 displays information related to the food fd. The signage 50 may be installed at an arbitrary position inside or outside the store 3. Note that the server 30 may be installed at other positions in the store 3 or outside the store 3 (for example, the headquarters).

When the customer hm purchases the food fd with the buffet counter 10, he puts the tray 70 on the counters 12 a to 12 d and walks around the buffet counter 10 while taking the food fd picked up from the food space 15. Is placed on the tray 70.

FIG. 2 is a plan view showing the buffet counter 10 viewed from above.

In FIG. 2, food fd such as lunch box fd1 and rice ball fd2 is displayed in the food space 15 of the buffet counter 10. The counter 12a may be provided with a payment terminal or a server 30 having a payment function. A coffee maker 61 and an oden bowl 62 may be installed on the counter 12b.

In FIG. 2, two trays 70 are placed on the upper surfaces of the counters 12c and 12d while moving while being pushed by the hands of the customer hm. On the tray 70 moving in the lane of the counter 12c, the smartphone 40 is placed in addition to the rice balls fd2 and coffee fd3. Only the smartphone 40 is placed on the tray 70 that moves in the lane of the counter 12d.

FIG. 3 is a diagram showing a hardware configuration of the buffet counter system 5.

The buffet counter system 5 manages the food in the buffet counter 10. That is, the buffet type counter system 5 is an example of a food management system. The buffet counter system 5 includes a camera 20, a server 30, a signage 50, a cooking device 60, weight sensors 82 and 85, and a smartphone 40. Some of the above-described components of the buffet counter system 5 may be omitted.

The camera 20 is attached to an arbitrary position (for example, the ceiling of the store 3) so as to capture at least a part of the buffet counter 10 including the counters 12a to 12d. The camera 20 images the counters 12a to 12d from above so as to include a tray 70 movable along the lane. In FIG. 3, four cameras 20 are shown, but the number of cameras may be any number, and may be one or more.

The server 30 receives information based on images captured by the camera 20 (for example, moving images and still images) and captured images. Based on the received captured image and information, the server 30 performs display processing of food information regarding the food fd (for example, billing information for food), information on recommended menus for customers hm who purchase food, and the like. Further, the server 30 performs a payment process by the smartphone 40.

The signage 50 displays information provided to the customer hm, such as introduction and advertisement of the food fd. The signage 50 is an example of an information presentation device.

The cooking device 60 may include a coffee maker 61 and an oden utensil 62 installed on the counter 12b. In addition, the cooking device 60 may include a deep-fried chicken, a rice ball machine, or the like. The cooking device 60 may communicate with the server 30 to notify the server 30 of information on the cooked food (for example, the taste of fried chicken and the size of the copy). In this case, for example, the camera 20 or the server 30 can supplementarily use information from the cooking device 60 together with the recognition result of the food by image recognition on the captured image. That is, the cooking device 60 can support improvement of food recognition accuracy.

The weight sensor 82 measures the weight of the food fd placed on the fixture 11. The weight sensor 85 is attached to the lower surface of the tray 70 and measures the weight of the food fd placed on the tray 70. The weight sensors 82 and 85 are optional and may be omitted from the buffet counter system 5. For example, when the camera 20 or the server 30 recognizes an object (food) based on the captured image, the weight information by the weight sensors 82 and 85 can be used as supplementary information, thereby improving the food recognition accuracy. When determining which food the weight of the food fd corresponds to, for example, the weight information of the food fd held in the food information DB 38z (see FIG. 6) of the server 30 may be referred to.

The smartphone 40 is possessed by the customer hm, and placed on the tray 70 when purchasing the food fd with the buffet counter 10. The smartphone 40 is an example of a terminal, and may be another terminal (for example, a tablet terminal or a dedicated information terminal).

FIG. 4 is a diagram illustrating a hardware configuration of the camera 20. The camera 20 includes a processor 21, a memory 22, an imaging unit 23, a recording unit 24, and a communication I / F (Interface) 25.

The processor 21 performs, for example, signal processing for overall control of operations of each unit of the camera 20, data input / output processing with other units, data calculation processing, and data storage processing. The memory 22 is, for example, a ROM (Read Only Memory) that stores data such as a program that defines the operation of the camera 20, setting values, and the like, and a RAM that temporarily stores various data used during processing by the processor 21. (Random Access Memory).

The image pickup unit 23 has an image pickup element such as a CCD (charge coupled device) image sensor or a CMOS (complementary metal oxide semiconductor) image sensor, and makes light incident from a preset angle of view incident on the light receiving surface. The optical image is converted into an electrical signal.

The recording unit 24 records various data and information. The recording unit 24 records the captured image acquired by the imaging unit 23, various data included in the captured image (for example, metadata), information based on the captured image (for example, information on the result of object recognition for the captured image), and the like. .

The communication I / F 25 is connected to the server 30 by wire or wirelessly, and transmits image data and various data captured by the imaging unit 23 to the server 30. The server 30 records the image captured by the camera 20 in the recording unit 35 so as to be reproducible.

FIG. 5 is a diagram illustrating a hardware configuration of the smartphone 40. The smartphone 40 includes a processor 41, a speaker 42, an imaging unit 49, an operation unit 43, a communication unit 45, a memory 47, and a display unit 48. The operation part 43 and the display part 48 may be comprised with the touchscreen TP, and may be shape | molded integrally.

The processor 41 performs, for example, signal processing for overall control of operations of each unit of the smartphone 40, data input / output processing with other units, data calculation processing, and data storage processing. The processor 41 communicates data with the server 30 via the communication unit 45. The processor 41 acquires data input via the operation unit 43. The processor 41 causes the display unit 48 to display information received from the server 30 (for example, food information regarding food, recommended information described later, and billing information). The processor 41 can execute an application related to installed food (also simply referred to as a food application).

The speaker 42 outputs various kinds of information as sound and outputs sound such as an alarm. The operation unit 43 receives data input to the smartphone 40. Here, the operation unit 43 may be a part of the touch panel TP. The operation unit 43 may include buttons, keys, a microphone, and the like.

The communication unit 45 communicates with other devices using various wireless communication methods. The wireless communication method may include, for example, a wireless LAN, Bluetooth (registered trademark), short-range wireless communication, or a public wireless line. Between the smartphone 40 and the server 30, the communication unit 45 may communicate with the server 30 via a network NW connected using a wireless LAN.

The memory 47 is, for example, a ROM (Read Only Memory) that stores data such as a program that defines the operation of the smartphone 40, data such as setting values, and a RAM that temporarily stores various data used during processing by the processor 41. (Random Access Memory) is included. The imaging unit 49 images a subject with an imaging element (image sensor).

The display unit 48 is configured using, for example, an LCD (Liquid Crystal Display), and displays information about food (for example, recommended information and billing information) output from the processor 41.

FIG. 6 is a diagram illustrating a hardware configuration of the server 30. The server 30 includes a processor 31, a memory 32, a display unit 33, an operation unit 34, a recording unit 35, a communication I / F 37, and a storage 38.

The processor 31 performs, for example, signal processing for overall control of operations of each unit of the server 30, data input / output processing with other units, data calculation processing, and data storage processing. The memory 32 includes, for example, a program that defines the operation of the server 30, a ROM that stores data such as setting values, and a RAM that temporarily stores various data used during processing by the processor 31. The memory 32 stores various data and information, for example, a condition determination table Tb1 (see FIG. 8). The display unit 33 displays various information including information related to food. The operation unit 34 may accept various input operations by the administrator of the server 30.

The recording unit 35 records a captured image captured by the camera 20 and information about the captured image. The recording unit 35 records purchase behavior information, which is behavior at the time of purchasing food by the customer hm, in the record 35z.

The communication I / F 37 performs data communication with the smartphone 40 and the camera 20 via wired or wireless communication. The communication I / F 37 may be communicably connected to a cloud server (not shown) via a network. The communication I / F 37 may receive captured images, various data, and various information from the camera 20.

The storage 38 may be a large-capacity storage medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage 38 includes a food information DB (DataBase) 38z and a customer information DB 38y. In the food information DB 38z, food information such as the type, price, calorie, weight, and place of production of food is registered for each food fd as information about food. In the customer information DB 38y, when the customer is a member, attributes (personal information) such as name, age, sex, food preference, etc. are registered as information about the customer. The preference information may include, for example, information such as a specific favorite food, salt conservation, diet preference (purpose), sports preference, health preference, and the like.

The server 30 may be a PC (Personal Computer) installed in the backyard of the store 3, or may be a cloud server or a center server connected to a network. The server 30 may be a terminal or server of a point-of-sale management system (POS: PointＰＯSale system), or may be a store computer including a cash register, a handy terminal, and the like. Further, the server 30 and the POS are separate bodies, and the server 30 and the POS may cooperate with each other and may communicate each data.

Next, the operation of the buffet counter system 5 will be described.

(First operation example)
FIG. 7 is a diagram illustrating information providing areas SA1 and SA2 of the buffet counter 10 in which information corresponding to the position of the smartphone 40 is provided.

FIG. 7 shows an arrangement of the buffet counter 10 as viewed from above. Assume an XY coordinate having one point at the upper left corner of FIG. 7 as the origin, the horizontal axis as the X axis, and the vertical axis as the Y axis. In the food space 15, as an example of the food fd, a lunch box fd1, a rice ball fd2, a salad fd5, and a juice fd4 are displayed.

The information providing area SA1 is a rectangular area (indicated by a broken line in the figure) represented by coordinates (10, 3)-(20, 8) including a part of the counter 12d around the area where the lunch box fd1 is displayed. (Enclosed range). That is, the information providing area SA1 is an area having the coordinates (10, 3) and the coordinates (20, 8) as two diagonal points. The information providing area SA2 is a circular area (indicated by a broken line in the figure) represented by a radius 10 centered on coordinates (30, 18) including a part of the counter 12c around the area where the juice fd4 is displayed. (Enclosed range). In addition, the shape of each information provision area is not limited to a rectangle or a circle, and may have other shapes.

FIG. 8 is a diagram showing the registration contents of the condition determination table Tb1 registered in the memory 32 of the server 30.

In the condition determination table Tb1, for example, information about food (lunch) corresponding to the information provision area SA1 and information about food (juice) corresponding to the information provision area SA2 are registered. Note that the number and size of the information providing areas can be arbitrarily set by the processor 31 of the server 30, for example.

For example, the buffet counter 10 is imaged by the camera 20 installed above. The processor 21 of the camera 20 analyzes the captured image reflected by the buffet counter 10 and recognizes objects (for example, the smartphone 40, the customer hm, and the food fd) included in the captured image. Further, the processor 21 may repeat the detection of the same object included in the captured image captured a plurality of times in time series and track the movement of the object.

Note that image processing (for example, image analysis, object recognition, and object motion tracking) based on the captured image may be performed by the server 30 instead of the camera 20. In this case, the communication I / F 25 of the camera 20 may transmit the captured image to the server 30, the communication I / F 37 of the server 30 may receive the captured image, and the processor 31 may perform image processing based on the captured image.

For example, when the customer hm moves the tray 70 on which the smartphone 40 is placed along the lanes of the counters 12a to 12d, the processor 21 of the camera 20 confirms that the smartphone 40 has entered the information provision area SA1 as a result of image analysis. When detected, the communication I / F 25 may notify the server 30 that the smartphone 40 has entered the information provision area SA1.

In the server 30, the communication I / F 37 receives the notification that the smartphone 40 has entered the information providing area SA1 from the camera 20, and the processor 31 determines that the customer hm is located in the vicinity of the display position of the lunch box fd1. To do. In accordance with the condition determination table Tb1, the processor 31 notifies the customer hm's smartphone 40 of information related to the lunch (for example, notification of a new product lunch). In the smart phone 40, when the communication unit 45 receives notification of information related to the lunch box, the display unit 48 displays information related to the lunch box. The smartphone 40 has unique identification information (ID). Therefore, the processor 31 reads the ID of the smartphone 40 by, for example, a reading method described later, and can identify which smartphone 40 is the smartphone 40 that has entered the specific information provision area. The processor 31 may transmit information related to the lunch box or the like to the specific smartphone 40 that has entered the specific information providing area via the communication I / F 37.

When the processor 21 of the camera 20 detects that the smartphone 40 has entered the information provision area SA2 as a result of the image analysis, the communication I / F 25 notifies the server 30 that the smartphone 40 has entered the information provision area SA2. You may be notified.

In the server 30, the communication I / F 37 receives the notification that the smartphone 40 has entered the information providing area SA2 from the camera 20, and determines that the customer hm is located in the vicinity of the display position of the juice fd4. In accordance with the condition determination table Tb1, the processor 31 notifies the customer hm's smartphone 40 of information related to the juice fd4 (for example, juice discount information). Upon receiving this notification, the smartphone 40 displays information regarding the juice fd4. Note that the smartphone 40 may present information to be displayed (for example, voice output or vibration) by a method other than display.

Further, when the processor 21 detects that the customer hm goes around the counters 12a to 12d and enters the information providing areas SA1 and SA2 again as a result of the tracking of the customer hm, the processor 31 of the server 30 It is not necessary to notify again about the information. In addition, the processor 31 may notify the information regarding the same food again, and may notify the information regarding the food different from the 1st time.

Further, the processor 21 of the camera 20 analyzes the captured image when the customer hm puts the lunch box fd1 on the tray 70, for example, and detects the purchase behavior that the customer hm places the lunch box fd1 on the tray 70, for example. You can do it. The communication I / F 25 may notify the server 30 of the detected purchase behavior. In the server 30, the communication I / F 37 may notify the smartphone 40 of information (for example, recommended information about side dishes) that is suitable for the lunch box fd1, for example, when receiving the notification of the purchase behavior of the lunch box fd1. Thereby, the smart phone 40 can acquire and display information about the side dishes, and the customer hm can know the side dishes recommended.

FIG. 9 is a diagram for explaining the association between the food fd placed on the tray 70 and the smartphone 40.

In FIG. 9, it is assumed that two trays 70a and 70b are arranged next to each other on the counter 12 of the buffet counter 10. A smartphone 40a and a rice ball fd2 are placed on the tray 70a. The identification information (ID) of the smartphone 40a placed on the tray 70a is ID: 123. Only the smartphone 40b is placed on the tray 70b. The identification information of the smartphone 40b placed on the tray 70b is ID: 567.

When the two trays 70a and 70b are arranged side by side, the rice ball fd2 is closer to the smartphone 40b placed on another tray 70b than the smartphone 40a placed on the same tray 70a. Therefore, when the association between the food fd and the smartphone 40 is performed based on the distance based on the captured image captured by the camera 20 disposed above the buffet counter 10, the rice ball fd2 and the smartphone 40b correspond to each other. It is easy to determine that the

In the present embodiment, the buffet counter system 5 may associate the rice ball fd2 with the smartphone 40a in the following procedure.

In the camera 20, the imaging unit 23 images the two trays 70 a and 70 b arranged adjacent to the lane of the counter 12 from above. The processor 21 of the camera 20 may recognize the positions of the smartphones 40a and 40b included in the captured image GZ1. The processor 21 recognizes and decodes the two-dimensional codes cd1 and cd2 displayed on the captured images GZ1 smartphones 40a and 40b, and acquires the IDs of the smartphones 40a and 40b (S1). In this case, the processor 21 may recognize the smartphones 40a and 40b from the captured image GZ1 and recognize the positions of the smartphones 40a and 40b in the captured image.

In the figure, the recognition of the two-dimensional codes cd1 and cd2 is indicated by frames w1 and w2 superimposed on the captured image GZ1. The processor 21 may recognize the positions of the smartphones 40a and 40b in the real space based on the installation position of the camera 20, the orientation of the imaging unit 23, the imaging range, and the smartphones 40a and 40b in the captured image. Good.

The processor 21 may recognize the trays 70a and 70b from the captured images and recognize the positions of the trays 70a and 70b in the captured images. Further, the processor 21 performs image processing such as edge enhancement processing on the captured image GZ1 to extract a contour, and recognizes the range of the trays 70a and 70b included in the captured image GZ1 as rectangular frames w3 and w4. (S2).

The processor 21 associates the tray 70a with the smartphone 40a based on the positional relationship between the frame w3 and the smartphone 40a included therein. Similarly, the processor 21 associates the tray 70b and the smartphone 40b with each other based on the positional relationship between the frame w4 and the smartphone 40b included therein (S3).

The processor 21 obtains the image by recognizing the type of the food fd placed on the tray 70a and its placement position (S4). For example, the processor 21 compares the outline image of the food fd registered in the memory 22 with the image of the rice ball fd2 included in the captured image GZ1, identifies the type of food based on the similarity, and the rice ball fd2 You may get the position of In the figure, the recognition of the rice ball fd2 that is the food fd is indicated by a frame w5 superimposed on the captured image GZ1.

The processor 21 determines whether the position of the frame w5 of the rice ball fd2 is inside the frame w3 of the tray 70a or inside the frame w4 of the tray 70b. The processor 21 determines that the position of the frame w5 of the rice ball fd2 is inside the frame w4 of the tray 70b, and associates the rice ball fd2 with the smartphone 40a (S5). That is, the processor 21 associates the type of food fd (rice ball fd2) with the smartphone 40a (customer hm who owns the smartphone 40a). The communication I / F 25 transmits the associated food type (rice ball fd2) and the ID of the smartphone 40a to the server 30.

In the server 30, the communication I / F 37 receives from the camera 20 the associated type of food fd (rice ball fd2) and the ID of the smartphone 40a. The processor 31 acquires the price of the food fd corresponding to the type of the food fd from the food information DB 38z. The communication I / F 37 transmits billing information including the price of the rice ball fd2 to the smartphone 40a as billing information for the user of the smartphone 40a.

In the smartphone 40a, the communication unit 45 receives charging information including the price of the rice ball fd2 from the server 30, and the display unit 48 displays the charging information including the price of the rice ball fd2.

Although the two-dimensional code indicates the ID of the smartphone 40 here, it can be said that the two-dimensional code indicates the ID (member ID) of the customer hm. This is because the two-dimensional code is allocated by installing a food application on the smartphone 40, and the food application can be used for each customer hm. Further, since the smartphone 40 is placed on the tray 70 on the counter at a close distance from the customer hm, it can be said that the position of the smartphone 40 in the real space is substantially the same as the position of the customer hm.

9, the camera 20 can associate the specific food fd with the specific smartphone 40 using the tray 70. Furthermore, the camera 20 can associate the specific food fd and the specific customer hm that are difficult to directly associate with each other using the tray 70 and the smartphone 40. Therefore, by registering the customer's hm's food preferences and the like, it is possible to link the customer hm and the provision information desired to be provided to the customer hm, and to match the trend (for example, position and movement) of the customer hm. Can provide various information.

In FIG. 9, the camera 20 captures an image, recognizes the image (for example, object recognition), and determines the ID and position of the smartphone 40, the position and range of the tray 70, and the type and position of the food fd. An example of grasping and performing various associations was illustrated. Instead, the server 30 may perform association or the like. That is, the server 30 acquires an image captured by the camera 20, and the server 30 performs image recognition (for example, object recognition) on the captured image, and the ID and position of the smartphone 40, the position and range of the tray 70, and the type of food fd. And the position may be grasped and various associations may be performed. In this case, necessary data and information are communicated between the camera 20 and the server 30.

In addition, when the smartphone 40 displays the charging information, for example, when the charging information of the food taken by the adjacent customer hm is erroneously recognized and displayed (for example, the charging information of the food placed on the tray 70b) Is displayed on the display unit 48 of the smartphone 40a), the processor 41 may perform a cancellation process for canceling the misrecognized billing information. For example, a cancel button (an example of the operation unit 43) for canceling misrecognized billing information may be provided on the screen of the food application. The processor 41 cancels the misrecognized billing information when the customer hm who is the user of the smartphone 40a presses the cancel button, and the communication unit 45 transmits the cancel information for canceling the billing information to the server 30. Good. This cancellation of the billing information can be said to be a cancellation of the association between the food fd and the smartphone 40 or the customer hm.

Also, various methods may be used for associating foods with smartphones. For example, instead of displaying the two-dimensional code on the display unit 48, the smartphone 40 may notify the camera 20 of the light ID based on the LED light as the ID of the smartphone 40. In this case, the camera 20 can acquire the ID of the smartphone 40 by capturing an image including the light ID.

Further, a two-dimensional code indicating an ID for identifying the tray 70 may be pasted on the surface of the tray 70. When the customer hm has the tray 70, the camera 20 may associate the ID of the tray 70 with the ID of the smartphone 40 by capturing the two-dimensional code of the tray 70 and recognizing the image. The camera 20 can also associate the food item and the smartphone 40 via the tray 70 by associating the tray 70 with the food item placed on the tray 70. For example, since the two-dimensional code pasted on the surface of the tray 70 can be made larger than the two-dimensional code displayed on the smartphone 40, the camera 20 can reduce ID reading errors by the camera 20, and the smartphone 40 and the food Can be improved.

Further, the food fd and the smartphone 40 may be associated using a beacon signal. In this case, one or more beacon terminals (receivers) may be installed at an arbitrary position (for example, around the buffet counter 10 or the ceiling of the store 3). An RFID (Radio Frequency IDentifier) tag may be attached to the smartphone 40, the food fd, or the tray 70. The beacon terminal communicates with the RFID tag attached to the food fd, the smartphone 40, or the tray 70, whereby the identification information (ID) and position information of the smartphone 40, the identification information (type) and position information of the food fd, the tray 70 Position information, etc. may be detected. That is, the identification information and position information of food obtained by the camera 20, the identification information and position information of the smartphone 40, and the identification information and position information of the tray 70 may be detected by the beacon terminal.

In addition, the smartphone 40 includes a GPS receiver and the like, acquires position information (for example, latitude and longitude) of the own terminal, and acquires the position information of the own terminal via the wireless LAN and Bluetooth (registered trademark). You may send it directly to.

FIG. 10 is a sequence diagram showing an operation procedure of the buffet counter system 5 in the first operation example.

The smartphone 40 has already installed the food application. In the smartphone 40, for example, the customer hm operates the smartphone 40 via the operation unit 43, and the processor 41 activates the food application (T1). The processor 41 displays an initial screen on the display unit 48 (T2). On the initial screen, the identification information (ID) of the smartphone 40 is displayed as a two-dimensional code. Here, a QR code (registered trademark) may be used as the two-dimensional code. The two-dimensional code may always be displayed on the screen while the application is activated.

The customer hm places the smartphone 40 on which the two-dimensional code is displayed on the tray 70, and moves the tray 70 along the counters 12a to 12d of the buffet counter 10. The customer hm takes the food fd placed in the food space 15 and places it on the tray 70.

In the camera 20, the imaging unit 23 captures an imaging area including the counters 12 a to 12 d and stores the captured image in the recording unit 24. The processor 21 decodes (image recognition) the two-dimensional code displayed on the display unit 48 of the smartphone 40 placed on the tray 70 included in the captured image, and reads the ID of the smartphone 40 (T3).

The processor 21 stores the read ID in the memory 22, performs store registration of this ID, and transmits the ID of the smartphone 40 to the server 30 via the communication I / F 25 (T4). In the server 30, when the processor 31 receives the ID of the smartphone 40 via the communication I / F 37, the processor 31 performs store registration of this ID in the record 35z stored in the recording unit 35 (T5). Although not shown in FIG. 10, the communication I / F 37 of the server 30 may notify the smart phone 40 to display the fact that the smart phone 40 has been registered when entering the store. In the smartphone 40 that has received the notification, the processor 41 may change the display to indicate that the store has been registered according to the food application.

FIG. 11 is a diagram showing the recorded contents of the record 35z. In the record 35z, purchase behavior of the food fd by the customer hm is recorded in time series. The record 35z has record items such as an ID of the smartphone 40, a purchased item (food to be purchased, for example, food placed on the tray 70), a position of the smartphone 40, and a store entry time.

In the store registration of the procedure T5, ID: 123, purchased item: blank, position: blank, and store entry time: 12:18 are recorded. That is, in the store registration, the ID and the store entry time may be registered. The record 35z records ID: 123, purchased item: rice ball, coffee, position: (10.10), and entry time: 12:15, but this information has already entered the store. This is information about the customer hm.

In the camera 20, the processor 21 tracks the position of the smartphone 40 based on the image captured by the imaging unit 23, and periodically acquires tracking information including the position of the smartphone 40 via the communication I / F 25. (T6). In the server 30, the processor 31 receives the tracking information including the position of the smartphone 40 via the communication I / F 37, and updates the record 35z based on the tracking information (T7). That is, the camera 20 and the server 30 may track the movement of the customer hm corresponding to the movement of the smartphone 40.

In the update of the position information in the procedure T7, as shown in FIG. 11, ID: 567, purchased item: blank, position: (15, 5), and entrance time: 12:18 are recorded in the record 35z. That is, the position of the customer hm after entering the store identified by ID: 567 is tracked and recorded, and the food item fd desired to be purchased is not yet placed on the tray 70 of the customer hm.

Also, ID: 123, purchased item: rice ball, coffee, position: (40, 20), and entry time: 12:15 are recorded in the record 35z. That is, the customer hm identified by ID: 123 is moving in the store 3 and is being tracked by the camera 20.

In the server 30, the processor 31 acquires provision information corresponding to the position of the smartphone 40 based on the condition determination table Tb <b> 1 stored in the memory 32 or the storage 38. For example, the customer hm identified by the ID 567 is located at the position: (15, 5) and is located inside the information providing area SA1. Therefore, the provision information may include information related to the lunch (for example, information on the lunch A of the new product). The processor 31 transmits the provision information to the smartphone 40 via the communication I / F 37 (T8).

In the smartphone 40, when receiving the provision information from the server 30 via the communication unit 45, the processor 41 displays the provision information on the display unit 48 (T9). As provided information, for example, recommended information can be cited. Thereby, the customer hm can purchase the food fd while confirming the provided information displayed on the smartphone 40. For example, the customer hm can confirm the recommended information on the new product lunch A and make the lunch A a purchase target.

Customer hm puts his / her favorite food fd on the tray 70 from the food fd displayed in the food space 15. In this case, in the camera 20, the processor 21 detects the movement of the food fd based on the captured image captured by the imaging unit 23 (T10). In this case, the processor 21 performs image analysis on the captured image, recognizes an object (for example, rice ball, lunch box, juice) included in the captured image, and identifies the type, size, and model number of the food.

The processor 21 extracts the ID of the smartphone 40 placed on the tray 70 on which the food fd is placed (T11). As described above, the processor 21 acquires, for example, the ID of the smartphone 40 located inside the frame w3 that represents the range of the tray 70. The processor 21 transmits the type of the food fd and the ID of the smartphone 40 to the server 30 via the communication I / F 25 (T12). The food fd and the smartphone 40 are associated with each other as described above.

In the server 30, the processor 31 receives the type of food and the ID of the smartphone 40 via the communication I / F 37 (T13). The processor 31 acquires the food information identified by the type of the received food fd from the food information DB 38z. The acquired food information is transmitted to the smartphone 40 identified by the received ID via the communication I / F 37, and an instruction to update the display displayed on the display unit 48 is given (T14).

In the update of the display regarding the food fd in the procedure T14, ID: 567, purchased item: lunch A, position: (15.6), and entrance time: 12: 18 are recorded in the record 35z. That is, the customer hm identified by ID: 567 is moving with the lunch box A placed on the tray 70. Also, the record 35z is updated and recorded with ID: 123, purchased item: rice ball, coffee, position: (40, 80), and entry time: 12:15.

The processor 41 of the smartphone 40 receives the food information regarding the food fd placed on the tray 70 via the communication unit 45, and displays the food information on the display unit 48 (T15).

According to the processing of FIG. 10, the buffet counter system 5 can track the movement of the smartphone 40, the customer hm, and the food fd from the customer hm's entry into the store 3, and sequentially register this information in the record 35z. You can manage each move. Therefore, the buffet counter system 5 can associate the smartphone 40, the customer hm, and the food fd with maintaining the freedom of movement of the smartphone 40, the customer hm, and the food fd.

Further, the buffet counter system 5 can provide information according to the position of the customer hm when the customer hm does not place the food fd on the tray 70, for example. In addition, the buffet counter system 5 provides information according to the position of the customer hm, for example, when the customer hm places the food fd on the tray 70, and information according to the food placed on the tray 70 (for example, calorie Information, billing information).

Next, display by the smartphone 40 and the signage 50 will be described.

FIG. 12 is a diagram illustrating an example of the screen GM1 of the smartphone 40 on which the food information regarding the food fd placed on the tray 70 is displayed.

On the screen GM1 of the display unit 48 of the smartphone 40, as the food information regarding the food fd placed on the tray 70, for example, the type of the food fd (for example, rice balls, coffee), billing information (for example, 150 yen, 100 yen, total 250 yen) ) And calorie values (for example, 215 kcal, 10 kcal, total 225 kcal). In addition, on the screen GM1 of the smartphone 40, recommended information, a member ID, a two-dimensional code, and the like are displayed. This recommended information may be, for example, information that recommends buying salads and fried chicken together with the purchase of rice balls and coffee. The member ID is the ID of the customer hm who owns the smartphone 40 and is associated with the smartphone 40.

As shown in FIG. 12, the food information regarding the food fd placed on the tray 70 is displayed in real time on the screen GM1 of the display unit 48 of the smartphone 40 possessed by the customer hm placed on the tray 70. In addition, when the customer hm presses the settlement button bn1 (an example of the operation unit 43) displayed on the screen GM1 of the smartphone 40, the processor 41 may detect the pressing and instruct the server 30 to perform the settlement. In this case, the processor 41 may transmit information for executing settlement of the amount related to the billing information to the server 30 via the communication unit 45. In the server 30, when the processor 31 receives information for executing payment via the communication I / F 37, the processor 31 performs payment with, for example, a payment center. Note that the processor 41 of the smartphone 40 may display a bar code for settlement on the display unit 48 when detecting the depression of the settlement button bn1. Then, the payment barcode of the food item fd on the tray 70 may be input to the POS terminal by scanning the payment barcode with the POS terminal of the store 3, and then the payment using the POS terminal may be performed. .

Moreover, in the signage 50, the same information as the smartphone 40 may be displayed, or different information may be displayed. For example, information for individuals for each customer hm may be displayed on the smartphone 40, and information common to each customer hm may be displayed on the signage 50. The signage 50 displays, for example, advertisement information of the food fd, an image after cooking the food fd, information on the cooking method of the food fd (foodstuff) (for example, recipe), information on the production area of the food fd (foodstuff), etc. Good. In addition, the signage 50 may display information related to, for example, a food fd with low sales, a food fd with a near expiration date, and the like. For example, the sales may be acquired by the signage 50 in cooperation with the server 30 or the POS, or may be determined from the weight of the weight sensor 82 (for example, the remaining number of foods d is greater than the threshold). . In this way, personal or common information can be effectively provided using the display unit included in the smartphone 40 or the signage 50.

As described above, the buffet counter system 5 images the food fd displayed on the buffet counter 10 installed in the store 3 and the smartphone 40 possessed by the customer hm (an example of a customer) located in the store 3. A camera 20 (an example of a sensor) and a server 30 (an example of a food management device) that manages the food fd are provided. The camera 20 transmits the captured image and information (an example of detection information) obtained from the captured image to the server 30. The server 30 receives a captured image and information obtained from the captured image. The server 30 acquires association information between the food fd and the smartphone 40 (that is, the customer hm) by associating (associating) the food fd included in the captured image GZ1 with the smartphone 40 (that is, the customer hm). Alternatively, the camera 20 may associate the food fd included in the captured image GZ1 with the smartphone 40 (that is, the customer hm), and the server 30 may acquire this association information from the camera 20. The server 30 refers to the customer information DB 38y and the food information DB 38z, for example, and acquires (an example of derivation) food information regarding the food fd associated with the customer hm.

Thereby, before the customer hm purchases the food fd, the buffet counter system 5 can provide the customer hm with information on the food associated with the customer hm. For example, the buffet counter system 5 can associate the customer hm with the food fd based on the location of the customer hm. The buffet type counter system 5 can associate the food fd with, for example, the preference of the customer hm. Therefore, food information can be provided in accordance with customer trends and preferences before purchasing food.

Moreover, the camera 20 may decode the two-dimensional code displayed on the smartphone 40 included in the captured image GZ1, for example, and acquire the position of the smartphone 40 possessed by the customer hm. The server 30 may acquire food information from the food information DB 38z or the like based on the position of the smartphone 40. That is, the camera 20 may detect the position of the customer hm, and the server 30 may derive the food information based on the position of the customer hm.

Thereby, the buffet counter system 5 can provide food information corresponding to the position of the customer hm. For example, the buffet-type counter system 5 can provide information related to the lunch box when the customer hm is located near the lunch box area where the lunch box is displayed.

In addition, the camera 20 may track the position of the smartphone 40 possessed by the customer hm and transmit this tracking information to the server 30. The server 30 may receive the tracking information of the smartphone 40 and update and acquire the food information from the food information DB 38z or the like based on the tracked position of the smartphone 40. That is, the camera 20 may track the position of the customer hm and transmit tracking information of the customer hm. The server 30 may receive the tracking information of the customer hm, and update and derive the food information based on the tracked location of the customer hm.

Thereby, the buffet type counter system 5 can sequentially provide information on foods displayed near the position of the customer hm, for example, as the customer hm moves.

The camera 20 takes an image so as to include a tray 70 for placing the food fd, a food fd placed on the tray 70, and a smartphone 40 (an example of a terminal) possessed by the customer hm placed on the tray 70. You can do it. The camera 20 may detect the tray 70, the food fd, and the smartphone 40 by image recognition for the captured image. The server 30 may acquire food information regarding foods placed on the same tray 70 as the smartphone 40. That is, the server 30 may derive the food information regarding the food placed on the same tray 70 as the smartphone 40.

Thereby, the buffet counter system 5 can provide food information regarding the food fd placed on the tray 70. Therefore, the customer hm can easily grasp the food to be purchased even when a large number of food fd is placed on the tray 70 as the purchase target.

Further, the server 30 may transmit the acquired food information to the smartphone 40 (an example of an information presentation device). When the smartphone 40 receives the food information, the smartphone 40 may display the food information on the display unit 48 (an example of presentation).

Thereby, the customer hm can know the food information specifically by looking at the food information displayed on the smartphone 40.

Further, the server 30 may acquire the captured image GZ1 including the tray 70 by the camera 20. The server 30 may extract the contour of the tray 70 by performing image recognition or the like on the captured image GZ1. The server 30 may acquire the ID (identification information) and position of the smartphone 40 included in the captured image GZ1 by image recognition or the like. When the position of the food fd and the smartphone 40 is included inside the frame w3 representing the contour of the extracted tray 70 (within the contour range), the server 30 associates the food information of the food fd with the ID of the smartphone 40. May be attached.

Thereby, the food fd placed on the tray 70 of the customer hm and the smartphone 40 placed on the tray 70 are linked. Therefore, the buffet counter system 5 can suppress the correspondence between the smartphone 40 owned by another customer and the food fd placed on the tray 70 used by the customer, and the tray used by another customer hm. It is possible to suppress the association between the food fd on 70 and the smartphone 40 possessed by itself. Thereby, the buffet type counter system 5 can suppress, for example, that food information relating to food that is not placed on the tray 70 is erroneously displayed or that food that is not placed on the tray 70 is charged.

(Second operation example)
In the first operation example, a case where recommended information according to the position of the smartphone 40 is provided is shown. The second operation example shows a case where recommended information according to the attribute of the customer hm is provided.

FIG. 13 is a flowchart showing an operation procedure of the server 30 in the second operation example.

The processor 31 receives the ID of the smartphone 40 transmitted from the camera 20 via the communication I / F 37 (S11). The processor 31 refers to the customer information DB 38y using the received ID of the smartphone 40, and acquires the customer attribute regarding the customer hm associated with the ID of the smartphone 40. Customer attributes are included in the customer information.

The processor 31 provides information on a recommended menu (that is, a recommended menu corresponding to the ID) based on the acquired customer attributes. In this case, the processor 31 may instruct the smartphone 40 to display a recommended menu via the communication I / F 37 (S12). For example, when the attribute of the customer hm includes information indicating that the customer hm is on a diet, the processor 31 may provide information on a food with low calories as information on the recommended menu. In addition, when the attribute of the customer hm includes information indicating that the customer hm is a sportsman, the processor 31 may provide information on food containing a lot of protein as information on the recommended menu.

The processor 31 acquires the position of the smartphone 40 via the communication I / F 37 (S13). The processor 31 acquires the display position of each food fd. The display position of each food fd is stored in, for example, the food information DB 38 z and may be acquired by the processor 31.

The processor 31 determines whether or not the position of the smartphone 40 is near the position where the food fd included in the recommended menu is displayed (S14). The vicinity of the position where the food fd is displayed may indicate that it is within the threshold th1 from the display position (display position) of the food fd. The threshold th1 may be determined based on, for example, a position where the customer hm carrying the smartphone 40 can easily take the food fd corresponding to the customer hm from the food space 15. The vicinity of the position where the food fd is displayed may be the same as the information providing areas SA1 and SA2.

In S14, when the position of the smartphone 40 is not near the food fd included in the recommended menu, the processor 31 returns to the process of S13.

On the other hand, if the position of the smartphone 40 is near the food fd included in the recommended menu in S14, the processor 31 gives a predetermined instruction to the smartphone 40 via the communication I / F 37 (S15). For example, the processor 31 may present a notification alarm from the speaker 42 to the smartphone 40 (for example, by outputting sound and displaying it. The notification alarm may be displayed, for example, by information on the corresponding food fd or the corresponding food fd. Information indicating that the customer hm is located in the vicinity may be output by voice (for example, reading a message, simply outputting an alarm sound) or highlighted (for example, display by characters or images, LED lighting or blinking). Thereafter, the processor 31 returns to the process of S13.

13, the buffet counter system 5 can provide a recommended menu corresponding to the attribute of the customer hm for each customer hm carrying the smartphone 40, that is, for each member who uses the food application. Therefore, the customer hm can take out the food fd from the buffet counter system 5 while checking the recommended menu unique to the customer hm. At this time, the buffet counter system 5 can notify an alarm or the like so as not to forget to purchase the recommended food item fd according to the position of the customer hm.

FIG. 14 is a diagram showing a screen GM2 of the smartphone 40 on which a recommended menu is displayed.

The recommended menu is displayed on the screen GM2 of the display unit 48 of the smartphone 40. The recommended menu is created by the server 30 based on the attribute of the customer hm registered in the customer information DB 38y searched using the ID of the smartphone 40 possessed by the customer hm (that is, the ID of the customer hm).

Check boxes cb1, cb2, cb3, and cb4 are displayed in the display area of each food fd included in the recommended menu on the screen GM2. When each food fd included in the recommended menu is placed on the tray 70, a check mark is added to each check box. FIG. 14 illustrates that the salad chicken and seaweed salad are placed on the tray 70. In this case, the processor 41 of the smartphone 40 recognizes the food fd placed on the tray 70 in cooperation with the processor 31 of the server 30, and adds a check mark to the check boxes cb1 and cb4 of the corresponding food fd. For the food fd to which the check mark is added, the charging information (amount information) of the food fd is displayed at the bottom of the screen GM2, assuming that the food has already been acquired by the customer hm.

Further, when the smartphone 40 is positioned near the food fd included in the recommended menu, the processor 41 of the smartphone 40 may highlight the corresponding food fd in cooperation with the processor 31 of the server 30. In the highlighted display, the processor 41 may change the background color of the display area of the corresponding food fd to a conspicuous color such as orange. Further, when the smartphone 40 is located near the food fd included in the recommended menu, the processor 41 may display a message such as “It is placed on the shelf in front of you!” On the display unit 48.

Also, a color code may be displayed as a two-dimensional code in the upper right corner of the screen GM2, for example. In the lower right corner of the screen GM2, a settlement button bn1 may be arranged. The operation when the settlement button bn1 is pressed is the same as in the first operation example.

Thus, in the second operation example, the recommended menu can be presented to the customer hm based on the attributes such as the sex, age, and preference of the customer hm, and the purchase of the food fd can be assisted.

As described above, the camera 20 may detect the ID of the smartphone 40 using a two-dimensional barcode or the like, and transmit the ID to the server 30. The server 30 may receive the ID of the smartphone 40, search the customer information DB 38 y based on the ID of the smartphone 40, and acquire customer attribute information. The server 30 may acquire the food information corresponding to the customer attribute by searching the food information DB 38z. That is, the camera 20 may detect the identification information of the customer hm for identifying the customer hm. The server 30 may derive food information based on the identification information of the customer hm.

Thereby, the buffet counter system 5 can provide food information corresponding to the attributes of the customer hm such as gender, age, taste, and the like. In this case, the buffet-type counter system 5 has a simple user operation in which, for example, the processor 41 of the smartphone 40 registers the attribute information of the customer hm in the customer information DB 38y via the food application in cooperation with the server 30. Food information can be provided easily.

The camera 20 may detect the ID of the smartphone 40 possessed by the customer hm reflected in the captured image, for example, based on the captured image. The camera 20 may transmit the ID of the smartphone 40 and the position information of the smartphone 40 to the server 30. The server 30 may receive the ID of the smartphone 40 from the camera 20. The server 30 may acquire recommended menu information recommended for the customer hm identified by the ID of the smartphone 40 using, for example, the customer information DB 38y and the food information DB 38z. The server 30 may derive food information regarding the food fd recommended for the customer hm included in the recommended menu.

Thereby, for example, the server 30 can provide the customer hm with a recommended menu that matches the attributes of the customer hm such as sex, age, and preference. Further, the server 30 can provide information on the food fd included in the recommended menu.

Further, the camera 20 may detect position information of the smartphone 40. The server 30 may determine the food information to be presented in an emphasized manner based on the position of the customer hm and the recommended menu information.

Thereby, when the buffet type counter system 5 approaches the place where the food fd included in the recommended menu is displayed, for example, the buffet type counter system 5 emphasizes and presents the food information regarding the food included in the recommended menu and close to the customer hm. The smartphone 40 can be instructed. Accordingly, the server 30 can provide supplementary information (for example, information indicating that the food fd is output or a message indicating that the food fd is approaching) for purchasing the food fd included in the recommended menu.

Moreover, the camera 20 may image the tray 70 and the food fd placed on the tray 70. The server 30 may instruct the smartphone 40 to change the display mode (an example of the presentation mode) of the food information related to the food fd placed on the tray 70 with respect to the smartphone 40 having the corresponding ID.

Thereby, for example, when the food product fd included in the recommended menu is placed on the tray 70, the customer hm can gray out, check, or delete the information on the food product. Therefore, the customer hm can confirm that it is not necessary to additionally purchase the food fd placed on the tray 70 in the shopping list to be purchased by the customer hm such as the recommended menu. Therefore, the buffet type counter system 5 can support purchasing one or more foods fd included in the recommended menu without excess or deficiency, for example.

Note that the first operation example and the second operation example of the present embodiment may be performed at the same timing or may be performed at different timings.

Thus, in this embodiment, the buffet counter system 5 can present the recommended food fd according to the position of the customer hm in the store 3 and the attribute of the customer hm, and can increase the customer's hm's willingness to purchase. .

(Modification)
A modification of the display of each food fd placed on the fixture 11 will be described.

In a convenience store or a supermarket food department, a large number of food items fd are arranged in multiple stages on the fixture 11. When the food fd displayed on the fixture 11 is sold, the height of the food fd becomes low, and the height of the displayed food fd differs for each region in the fixture 11. In the region where the food fd that sells well is displayed, the height of the uppermost stage of the food fd stacked and displayed tends to be low. In the region where the food fd that is not sold well is displayed, the height of the uppermost stage of the food fd that is stacked and displayed remains high.

In the modified example, each food fd is moved up and down so that the food group (each area) displayed on the fixture 11 has a uniform height regardless of the number of food fd.

FIG. 15 is a diagram schematically showing the vicinity of the table 11z of the fixture 11 of the buffet counter 10 in a modified example. FIG. 15 shows a part of a buffet type counter system 5 </ b> A which is a modification of the buffet type counter system 5. In the buffet type counter system 5A, the same components as those in the buffet type counter system 5 shown in FIG. 3 and the like are denoted by the same reference numerals, and the description thereof is omitted or simplified.

In FIG. 3, the food fd is directly placed on the fixture 11 of the buffet counter 10, but in FIG. 15, the mounting table 110 is installed on the fixture 11. Various food items fd are displayed on the mounting table 110.

The mounting table 110 is placed on a mounting surface 110z including a plurality of circular mounting tables 110y on which various foods fd are placed, a face-up mechanism 111 capable of moving up and down independently of the plurality of circular mounting tables 110y, and the mounting surface 110z. And a weight sensor 112 that measures the weight of the food fd. The weight sensor 112 may be absent. Note that a table other than the circular table 110y may be used, and the shape of the table may be any shape (for example, rectangular or other shape).

FIG. 16 is a diagram showing the placement surface 110z. The circular mounting table 110y partitioned by the mounting surface 110z corresponds to the upper surface of the cylindrical member 124. The height of each circular placing table 110y is arbitrarily adjusted according to the height of the food fd to be placed.

As an example, in FIG. 15, a lunch box fd1, a rice ball fd2, and a pizza fd6 are displayed on the placement surface 110z. The lunch box fd1 is stacked in two stages. The rice balls fd2 are arranged in a plane without being stacked. The pizza fd6 is stacked in three stages. The cylindrical member 124 is moved up and down by the face-up mechanism 111 so that the tops of the lunch box fd1, the rice ball fd2, and the pizza fd6 have a certain height Hc, and the height of the circular table 110y is aligned.

Here, the processor 31 of the server 30 selects the food (for example, the lunch box fd1) having the highest spatial height of the food fd that is stacked on the top of the food group displayed on the placement surface 110z. It may be determined whether or not the difference between the position and the position of the lowest food (for example, rice ball fd2) is equal to or greater than the threshold th2. When it is equal to or greater than the threshold th2, the processor 31 may drive the face-up mechanism 111 so that the difference between the position of the highest food fd and the position of the lowest food fd is reduced (for example, there is no difference). As a result, in FIG. 15, the placement surface 110z is uneven so that the area corresponding to the lunch box fd1 is low, the area corresponding to the rice ball fd2 is high, and the area corresponding to the pizza fd6 is intermediate height. It is deformed.

FIG. 17 is a diagram illustrating an example of the configuration of the face-up mechanism 111.

The face-up mechanism 111 includes a cylindrical member 124 having the circular mounting table 110y as an upper surface, a motor 121, a ball screw 123, and a nut 122 for each circular mounting table 110y. The nut 122 is screwed into the ball screw 123. When the ball screw 123 rotates, the nut 122 moves in the axial direction of the ball screw 123. The nut 122 is fixed to the lower end side of the cylindrical member 124. The motor 121 drives the ball screw 123 to rotate.

The motor 121 is connected to the server 30, and when a drive signal is sent from the server 30, the ball screw 123 is rotated forward or backward in accordance with the drive signal. When the ball screw 123 rotates normally or reversely, the nut 122 moves in the vertical direction (gravity direction) by a distance corresponding to the rotation amount. Thereby, the cylindrical member 124 to which the nut 122 is fixed moves up and down. Therefore, the height of the circular table 110y that is the upper part of the cylindrical member 124 is changed, and the height of the food fd placed on the circular table 110y changes.

The circular mounting table 110y may mount one food fd by one circular mounting table 110y, or may mount one food fd by a plurality of (for example, many) circular mounting tables 110y. The size of the area of the surface (corresponding to the circular portion here) on which food is placed on the circular mounting table 110y is arbitrary. As the surface of the circular table 110y is smaller, one food fd is placed on a larger number of circular tables 110y. In addition, for example, even if the type of food displayed on the fixture 11 is sequentially changed and the size of the food changes, the food fd of various sizes can be placed by the circular table 110y. In this case, the number of circular platforms 110y that support one food fd can be changed. Therefore, the mounting table 110 can cope with the face-up of each food fd even when the layout of the food display is changed according to the presence / absence of an event, the season, or the time zone. It should be noted that the processor 31 of the server 30 may acquire and set information on the operation by a human as to which round table to use for the face-up of each food fd displayed, or a camera installed on the ceiling The captured image picked up by the image 20 may be subjected to image processing to obtain (for example, calculate) the size and position of each food fd, and automatically assigned according to the size and position of each food fd.

In the server 30, the processor 31 determines whether or not each position on the mounting table 110 is planar. In this case, the processor 31 may determine whether or not it is planar depending on whether or not the height of each position on the mounting table 110 is uniform. The processor 31 may detect a recessed portion in comparison with another position instead of being planar, and operate the face-up mechanism 111 to raise the circular mounting table 110y at the recessed portion to face up.

Information on the height of each position on the mounting table 110 may be acquired by various methods. For example, the height of the food fd in each area can be determined by directly measuring the distance from the infrared sensor or ultrasonic sensor to each food fd using an infrared sensor or ultrasonic sensor installed above the buffet counter 10. May be acquired. The processor 21 of the camera 20 or the processor 31 of the server 30 calculates the distance between the camera 20 installed on the ceiling and the food fd in each area, for example, based on the captured image, and the height of the food fd in each area. May be judged. Alternatively, the camera 20 may form a stereo camera with a plurality of cameras, calculate the distance between the camera 20 and the food fd in each area based on the captured image, and determine the height of the food fd in each area. . Further, the server 30 may determine the height of the food fd in each area based on the weight of one or more foods fd stacked by the weight sensor 112.

Further, when the weight sensor 112 is used, the weight sensor 112 may be disposed below the face-up mechanism 111 and measure the entire weight of the face-up mechanism 111. The weight sensor 112 may notify the server 30 of the total weight information of the measured face-up mechanism 111. The processor 31 of the server 30 may determine increase / decrease in the food fd based on the weight information received from the weight sensor 112. For example, when the customer hm moves one food fd to the tray 70, the entire weight of the face-up mechanism 111 is reduced accordingly. The server 30 may collate the weight of the food registered in advance in the food information DB 38z with the changed amount of the lightened weight to determine the type of the lost food fd. The server 30 may drive the face-up mechanism 111 so as to raise and lower the circular table 110y corresponding to the lost food fd.

Thereby, the buffet type counter system 5A can avoid being displayed in a depressed state from other product groups even if the popular food fd is sold. Moreover, the buffet type counter system 5A can arrange the heights so that the heights of many foods fd displayed in the food space 15 are constant. Therefore, it becomes easy for the customer hm to easily take the food fd in any region of the fixture 11, and the customer hm's willingness to purchase can be enhanced.

Further, the weight sensor 112 may notify the server 30 every time a change in weight is detected, that is, every time the food fd is taken out, for example. In the server 30, the processor 31 may operate the face-up mechanism 111 upon receiving a notification of a change in weight. Thereby, buffet type counter system 5A can maintain the height of food fd uniformly for every area, whenever food fd is taken out.

Further, in the server 30, the processor 31 may operate the face-up mechanism 111 when, for example, a change in weight is notified a predetermined number of times, that is, when the food fd is extracted a predetermined number of times. Thereby, buffet type counter system 5A can maintain the height of food fd uniformly for every area according to the amount of increase or decrease of food, when food fd is taken out a predetermined number of times (predetermined number).

In the server 30, the processor 31 may measure the time by a timer and operate the face-up mechanism 111 at regular intervals. Thereby, buffet type counter system 5A can maintain the height of food fd uniformly for every area, without depending on whether food fd was taken out.

Here, the case where the face-up mechanism 111 is operated so that the heights of many foods fd are constant has been shown, but the processor 31 of the server 30 increases the popularity of the foods fd that are not popular. The face-up mechanism may be operated so as to intentionally change the height of the food group in accordance with the marketing strategy such as lowering the high food fd. In this case, the server 30 may operate the face-up mechanism 111 based on the food inventory management information and purchase information held by the server 30.

In addition, when the processor 31 of the server 30 acquires the ID of the smartphone 40, the corresponding food is increased so as to increase the purchase intention of the food according to the attributes (diet preference, sports preference) of the customer hm corresponding to the ID of the smartphone 40. The face-up mechanism 111 may be operated so that fd becomes high.

In addition, here, as an example, the face-up mechanism 111 using the motor 121 is shown. However, the face-up mechanism 111 may be configured so that the circular mounting table 110y can be moved up and down. Arbitrary structures, such as the structure used and the structure using an electromagnet, may be sufficient.

Here, as an example, the weight sensor 112 measures the weight of the entire face-up mechanism 111 including the food fd. However, the weight of each circular mounting table 110y on which the food fd is placed and a predetermined number of circular mounting tables are measured. The weight of 110y may be measured. Thereby, the buffet-type counter system 5A determines which food fd has been taken out from which area in the bowl 11, based on the area where the circular table 110y that has changed in weight and weight has been placed. It can be accurately identified. Moreover, a small weight sensor can be used, and space saving is achieved.

Moreover, although the mounting table 110 is a separate body from the fixture 11, it may be formed integrally with the fixture 11. Moreover, although the server 30 performed the process related to face-up, the control device different from the server 30 may perform the process related to face-up. Thereby, the apparatus which assists face-up, and the apparatus (server 30) which manages food information can be installed separately.

In this way, the buffet-type counter system 5A sets the heights of the foods fd displayed in a stack so that the heights of the many foods fd displayed in the food space 15 are constant. Can be aligned by area. Thereby, the buffet type counter system 5A makes the height of the food hd uniform in any region in the bowl 11, makes it easy to take the food fd uniformly, and can increase the customer's hm's willingness to purchase.

Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present disclosure. Understood. In addition, the constituent elements in the above-described embodiment may be arbitrarily combined without departing from the spirit of the invention.

In the above embodiment, the purchase of the food fd and the like is managed. However, the present disclosure is applicable not only to the food fd but also to managing other products (for example, clothes, toys, and electrical products). .

In the above embodiment, the processor may be physically configured in any manner. Further, if a programmable processor is used, the processing contents can be changed by changing the program, so that the degree of freedom in designing the processor can be increased. The processor may be composed of one semiconductor chip or physically composed of a plurality of semiconductor chips. When configured by a plurality of semiconductor chips, each control of the embodiment may be realized by separate semiconductor chips. In this case, it can be considered that a plurality of semiconductor chips constitute one processor. Further, the processor may be configured by a member (a capacitor or the like) having a function different from that of the semiconductor chip. Further, one semiconductor chip may be configured so as to realize the functions of the processor and other functions. In addition, a plurality of processors may be configured by one processor.

This application is based on a Japanese patent application (Japanese Patent Application No. 2018-110236) filed on June 8, 2018, the contents of which are incorporated herein by reference.

This disclosure is useful for food management systems that can provide food information according to customer trends and preferences before purchasing food.

3 Stores 5 and 5A Buffet type counter system 10 Buffet type counter 11 Furniture 12a, 12b, 12c, 12d Counter 15 Food space 20 Camera 21, 31, 41 Processor 22, 32, 47 Memory 23, 49 Imaging unit 24, 35 Recording unit 25, 37 Communication I / F
30 Server 33, 48 Display unit 34, 43 Operation unit 35z Record 38 Storage 38y Customer information DB
38z Food Information DB
40 Smartphone 45 Communication unit 50 Signage 61 Coffee maker 62 Oden bowl 70 Tray 82, 85, 112 Weight sensor 110 Mounting table 110y Circular mounting table 110z Mounting surface 111 Face up mechanism 121 Motor 122 Nut 123 Ball screw 124 Cylindrical member SA1, SA2 Information provision area bn1 Settlement button cb1, cb2, cb3, cb4 Check box fd Food fd1 Lunch box fd2 Rice ball fd3 Coffee fd4 Juice fd5 Salad fd6 Pizza GM1, GM2 Screen GZ1 Captured image Hc Height hm Customer NW Network Tb1 Condition determination table TP Touch panel w1, w2 frame w3, w4 frame

Claims (9)

1. A sensor for detecting foods present in the store and customers located in the store;
   A food management device for managing the food;
   With
   The sensor transmits detection information detected by the sensor,
   The food management device includes:
   Receiving the detection information;
   Obtaining association information that associates the food and the customer detected by the sensor;
   Deriving food information about the food associated with the customer;
   Food management system.
2. The sensor detects the position of the customer;
   The food management device derives the food information based on the position of the customer;
   The food management system according to claim 1.
3. The sensor tracks the position of the customer, transmits the tracking information of the customer;
   The food management device receives the tracking information of the customer and updates and derives the food information based on the tracked location of the customer;
   The food management system according to claim 2.
4. The sensor is
   A tray for loading the food;
   Food placed on the tray;
   Detecting a terminal possessed by the customer placed on the tray;
   The food management device includes:
   Deriving food information about food placed on the same tray as the terminal,
   The food management system according to any one of claims 1 to 3.
5. The sensor detects customer identification information for identifying the customer,
   The food management device derives the food information based on the identification information of the customer;
   The food management system according to any one of claims 1 to 4.
6. The sensor detects the identification information of the customer,
   The food management device includes:
   Obtaining information on a menu recommended for the customer identified by the customer identification information;
   Deriving the food information about food recommended for customers included in the menu;
   The food management system according to claim 5.
7. The sensor detects the position information of the customer,
   The food management device determines the food information to be presented in an emphasized manner based on the information of the customer's position and the menu
   The food management system according to claim 6.
8. An information presentation device,
   The food management device transmits the derived food information,
   The information presentation device receives and presents the food information;
   The food management system according to any one of claims 1 to 7.
9. The sensor detects a tray for placing the food and a food placed on the tray,
   The food management device instructs the information presentation device to change a presentation mode of food information related to food placed on the tray;
   The food management system according to claim 8.

Images