WO2019234997A1 - Système de gestion de produits alimentaires - Google Patents

Système de gestion de produits alimentaires Download PDF

Info

Publication number
WO2019234997A1
WO2019234997A1 PCT/JP2019/006658 JP2019006658W WO2019234997A1 WO 2019234997 A1 WO2019234997 A1 WO 2019234997A1 JP 2019006658 W JP2019006658 W JP 2019006658W WO 2019234997 A1 WO2019234997 A1 WO 2019234997A1
Authority
WO
WIPO (PCT)
Prior art keywords
food
information
customer
smartphone
tray
Prior art date
Application number
PCT/JP2019/006658
Other languages
English (en)
Japanese (ja)
Inventor
菜穂子 木下
小山　崇
基浩 青木
雄大 ▲辻▼
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Publication of WO2019234997A1 publication Critical patent/WO2019234997A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions

Definitions

  • This disclosure relates to a food management system for managing food.
  • Patent Document 1 discloses a dietary management system that generates user-specific dietary management information when a meal is settled.
  • Patent Document 1 if the customer did not actually buy the food, the information on the food such as calorie intake was not known. For this reason, it was assumed that the purchased food would be disappointing for the customer. For this reason, it is desired that food information is provided so that the customer can obtain information on the food (for example, the total calories of the food) before purchasing the food and use it as a judgment material for the purchase of the food. Furthermore, it is desirable to be able to provide food information according to customer trends and preferences.
  • This disclosure has been made in view of the above circumstances, and provides a food management system that can provide food information according to customer trends and preferences before purchasing food.
  • One aspect of the present disclosure includes a sensor that detects food in a store, a customer in the store, and a food management device that manages the food, and the sensor is detected by the sensor.
  • the food management device receives the detection information, associates the food detected by the sensor with the customer, and derives food information related to the food associated with the customer. It is a food management system.
  • food information can be provided in accordance with customer trends and preferences before purchasing food.
  • Plan view showing an example of a buffet-type counter viewed from above The figure which shows an example of the hardware constitutions of the buffet type counter system 5
  • the figure which shows an example of the hardware constitutions of a camera The figure which shows an example of the hardware constitutions of the smart phone
  • the figure which shows an example of the hardware constitutions of a server The figure which shows an example of the information provision area of the buffet type counter in which the information corresponding to the position of a smart phone is provided
  • the figure which shows an example of the registration content of the condition determination table registered in the memory of a server The figure explaining an example of matching of the food placed on the tray and the smartphone
  • Diagram showing an example of the record contents of a record The figure which shows an example of the screen of the smart phone on which the information regarding the food on the tray is displayed
  • the flowchart which shows an example of the operation
  • the figure which shows an example of the screen of the smart phone where the recommended menu is displayed The figure which shows schematically an example of the table vicinity of the fixture of the buffet-type counter in 2nd Embodiment.
  • the figure which shows an example of a mounting surface The figure which shows an example of a structure of a face-up mechanism
  • FIG. 1 is a diagram illustrating an example of an outline of a buffet counter system 5 including a buffet counter 10 according to the first embodiment.
  • the buffet counter 10 may be installed in a store 3 such as a convenience store or a supermarket food department.
  • the buffet-type counter 10 is, for example, arranged in a bowl 11 with a rectangular food space 15 in the center, a pair of semicircular counters 12 a and 12 b arranged on both sides of the bowl 11, and before and after the bowl 11.
  • the long counters 12c and 12d are combined.
  • a lane in which the tray 70 is movable is formed so as to surround the food space 15 of the fixture 11.
  • the movable lane is formed on the upper surfaces of the counters 12a and 12b, and may not be formed on the upper surfaces of the counters 12c and 12d.
  • At least one of the counters 12a to 12d is also simply referred to as a counter 12.
  • a coffee maker 61 and an oden utensil 62 may be installed on the upper surface of the counter 12b.
  • a payment terminal or a server 30 having a payment function may be installed on the upper surface of the counter 12a.
  • the recessed part 12z may be formed in the side surface of the counter 12a. In the recess 12z, unused trays 70 are stacked in multiple stages.
  • the signage 50 displays information related to the food fd.
  • the signage 50 may be installed at an arbitrary position inside or outside the store 3.
  • the server 30 may be installed at other positions in the store 3 or outside the store 3 (for example, the headquarters).
  • FIG. 2 is a plan view showing the buffet counter 10 viewed from above.
  • food fd such as lunch box fd1 and rice ball fd2 is displayed in the food space 15 of the buffet counter 10.
  • the counter 12a may be provided with a payment terminal or a server 30 having a payment function.
  • a coffee maker 61 and an oden bowl 62 may be installed on the counter 12b.
  • two trays 70 are placed on the upper surfaces of the counters 12c and 12d while moving while being pushed by the hands of the customer hm.
  • the smartphone 40 is placed in addition to the rice balls fd2 and coffee fd3. Only the smartphone 40 is placed on the tray 70 that moves in the lane of the counter 12d.
  • FIG. 3 is a diagram showing a hardware configuration of the buffet counter system 5.
  • the buffet counter system 5 manages the food in the buffet counter 10. That is, the buffet type counter system 5 is an example of a food management system.
  • the buffet counter system 5 includes a camera 20, a server 30, a signage 50, a cooking device 60, weight sensors 82 and 85, and a smartphone 40. Some of the above-described components of the buffet counter system 5 may be omitted.
  • the camera 20 is attached to an arbitrary position (for example, the ceiling of the store 3) so as to capture at least a part of the buffet counter 10 including the counters 12a to 12d.
  • the camera 20 images the counters 12a to 12d from above so as to include a tray 70 movable along the lane.
  • four cameras 20 are shown, but the number of cameras may be any number, and may be one or more.
  • the server 30 receives information based on images captured by the camera 20 (for example, moving images and still images) and captured images. Based on the received captured image and information, the server 30 performs display processing of food information regarding the food fd (for example, billing information for food), information on recommended menus for customers hm who purchase food, and the like. Further, the server 30 performs a payment process by the smartphone 40.
  • images captured by the camera 20 for example, moving images and still images
  • the server 30 performs display processing of food information regarding the food fd (for example, billing information for food), information on recommended menus for customers hm who purchase food, and the like. Further, the server 30 performs a payment process by the smartphone 40.
  • the signage 50 displays information provided to the customer hm, such as introduction and advertisement of the food fd.
  • the signage 50 is an example of an information presentation device.
  • the cooking device 60 may include a coffee maker 61 and an oden utensil 62 installed on the counter 12b.
  • the cooking device 60 may include a deep-fried chicken, a rice ball machine, or the like.
  • the cooking device 60 may communicate with the server 30 to notify the server 30 of information on the cooked food (for example, the taste of fried chicken and the size of the copy).
  • the camera 20 or the server 30 can supplementarily use information from the cooking device 60 together with the recognition result of the food by image recognition on the captured image. That is, the cooking device 60 can support improvement of food recognition accuracy.
  • the weight sensor 82 measures the weight of the food fd placed on the fixture 11.
  • the weight sensor 85 is attached to the lower surface of the tray 70 and measures the weight of the food fd placed on the tray 70.
  • the weight sensors 82 and 85 are optional and may be omitted from the buffet counter system 5.
  • the weight information by the weight sensors 82 and 85 can be used as supplementary information, thereby improving the food recognition accuracy.
  • the weight information of the food fd held in the food information DB 38z (see FIG. 6) of the server 30 may be referred to.
  • the smartphone 40 is possessed by the customer hm, and placed on the tray 70 when purchasing the food fd with the buffet counter 10.
  • the smartphone 40 is an example of a terminal, and may be another terminal (for example, a tablet terminal or a dedicated information terminal).
  • FIG. 4 is a diagram illustrating a hardware configuration of the camera 20.
  • the camera 20 includes a processor 21, a memory 22, an imaging unit 23, a recording unit 24, and a communication I / F (Interface) 25.
  • the processor 21 performs, for example, signal processing for overall control of operations of each unit of the camera 20, data input / output processing with other units, data calculation processing, and data storage processing.
  • the memory 22 is, for example, a ROM (Read Only Memory) that stores data such as a program that defines the operation of the camera 20, setting values, and the like, and a RAM that temporarily stores various data used during processing by the processor 21. (Random Access Memory).
  • the image pickup unit 23 has an image pickup element such as a CCD (charge coupled device) image sensor or a CMOS (complementary metal oxide semiconductor) image sensor, and makes light incident from a preset angle of view incident on the light receiving surface. The optical image is converted into an electrical signal.
  • an image pickup element such as a CCD (charge coupled device) image sensor or a CMOS (complementary metal oxide semiconductor) image sensor
  • the recording unit 24 records various data and information.
  • the recording unit 24 records the captured image acquired by the imaging unit 23, various data included in the captured image (for example, metadata), information based on the captured image (for example, information on the result of object recognition for the captured image), and the like. .
  • the communication I / F 25 is connected to the server 30 by wire or wirelessly, and transmits image data and various data captured by the imaging unit 23 to the server 30.
  • the server 30 records the image captured by the camera 20 in the recording unit 35 so as to be reproducible.
  • FIG. 5 is a diagram illustrating a hardware configuration of the smartphone 40.
  • the smartphone 40 includes a processor 41, a speaker 42, an imaging unit 49, an operation unit 43, a communication unit 45, a memory 47, and a display unit 48.
  • the operation part 43 and the display part 48 may be comprised with the touchscreen TP, and may be shape
  • the processor 41 performs, for example, signal processing for overall control of operations of each unit of the smartphone 40, data input / output processing with other units, data calculation processing, and data storage processing.
  • the processor 41 communicates data with the server 30 via the communication unit 45.
  • the processor 41 acquires data input via the operation unit 43.
  • the processor 41 causes the display unit 48 to display information received from the server 30 (for example, food information regarding food, recommended information described later, and billing information).
  • the processor 41 can execute an application related to installed food (also simply referred to as a food application).
  • the speaker 42 outputs various kinds of information as sound and outputs sound such as an alarm.
  • the operation unit 43 receives data input to the smartphone 40.
  • the operation unit 43 may be a part of the touch panel TP.
  • the operation unit 43 may include buttons, keys, a microphone, and the like.
  • the communication unit 45 communicates with other devices using various wireless communication methods.
  • the wireless communication method may include, for example, a wireless LAN, Bluetooth (registered trademark), short-range wireless communication, or a public wireless line.
  • the communication unit 45 may communicate with the server 30 via a network NW connected using a wireless LAN.
  • the memory 47 is, for example, a ROM (Read Only Memory) that stores data such as a program that defines the operation of the smartphone 40, data such as setting values, and a RAM that temporarily stores various data used during processing by the processor 41. (Random Access Memory) is included.
  • the imaging unit 49 images a subject with an imaging element (image sensor).
  • the display unit 48 is configured using, for example, an LCD (Liquid Crystal Display), and displays information about food (for example, recommended information and billing information) output from the processor 41.
  • LCD Liquid Crystal Display
  • FIG. 6 is a diagram illustrating a hardware configuration of the server 30.
  • the server 30 includes a processor 31, a memory 32, a display unit 33, an operation unit 34, a recording unit 35, a communication I / F 37, and a storage 38.
  • the processor 31 performs, for example, signal processing for overall control of operations of each unit of the server 30, data input / output processing with other units, data calculation processing, and data storage processing.
  • the memory 32 includes, for example, a program that defines the operation of the server 30, a ROM that stores data such as setting values, and a RAM that temporarily stores various data used during processing by the processor 31.
  • the memory 32 stores various data and information, for example, a condition determination table Tb1 (see FIG. 8).
  • the display unit 33 displays various information including information related to food.
  • the operation unit 34 may accept various input operations by the administrator of the server 30.
  • the recording unit 35 records a captured image captured by the camera 20 and information about the captured image.
  • the recording unit 35 records purchase behavior information, which is behavior at the time of purchasing food by the customer hm, in the record 35z.
  • the communication I / F 37 performs data communication with the smartphone 40 and the camera 20 via wired or wireless communication.
  • the communication I / F 37 may be communicably connected to a cloud server (not shown) via a network.
  • the communication I / F 37 may receive captured images, various data, and various information from the camera 20.
  • the storage 38 may be a large-capacity storage medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive).
  • the storage 38 includes a food information DB (DataBase) 38z and a customer information DB 38y.
  • food information such as the type, price, calorie, weight, and place of production of food is registered for each food fd as information about food.
  • customer information DB 38y when the customer is a member, attributes (personal information) such as name, age, sex, food preference, etc. are registered as information about the customer.
  • the preference information may include, for example, information such as a specific favorite food, salt conservation, diet preference (purpose), sports preference, health preference, and the like.
  • the server 30 may be a PC (Personal Computer) installed in the backyard of the store 3, or may be a cloud server or a center server connected to a network.
  • the server 30 may be a terminal or server of a point-of-sale management system (POS: PointPOSale system), or may be a store computer including a cash register, a handy terminal, and the like. Further, the server 30 and the POS are separate bodies, and the server 30 and the POS may cooperate with each other and may communicate each data.
  • POS PointPOSale system
  • FIG. 7 is a diagram illustrating information providing areas SA1 and SA2 of the buffet counter 10 in which information corresponding to the position of the smartphone 40 is provided.
  • FIG. 7 shows an arrangement of the buffet counter 10 as viewed from above. Assume an XY coordinate having one point at the upper left corner of FIG. 7 as the origin, the horizontal axis as the X axis, and the vertical axis as the Y axis.
  • a lunch box fd1 As an example of the food fd, a lunch box fd1, a rice ball fd2, a salad fd5, and a juice fd4 are displayed.
  • the information providing area SA1 is a rectangular area (indicated by a broken line in the figure) represented by coordinates (10, 3)-(20, 8) including a part of the counter 12d around the area where the lunch box fd1 is displayed. (Enclosed range). That is, the information providing area SA1 is an area having the coordinates (10, 3) and the coordinates (20, 8) as two diagonal points.
  • the information providing area SA2 is a circular area (indicated by a broken line in the figure) represented by a radius 10 centered on coordinates (30, 18) including a part of the counter 12c around the area where the juice fd4 is displayed. (Enclosed range).
  • the shape of each information provision area is not limited to a rectangle or a circle, and may have other shapes.
  • FIG. 8 is a diagram showing the registration contents of the condition determination table Tb1 registered in the memory 32 of the server 30.
  • condition determination table Tb1 for example, information about food (lunch) corresponding to the information provision area SA1 and information about food (juice) corresponding to the information provision area SA2 are registered.
  • the number and size of the information providing areas can be arbitrarily set by the processor 31 of the server 30, for example.
  • the buffet counter 10 is imaged by the camera 20 installed above.
  • the processor 21 of the camera 20 analyzes the captured image reflected by the buffet counter 10 and recognizes objects (for example, the smartphone 40, the customer hm, and the food fd) included in the captured image. Further, the processor 21 may repeat the detection of the same object included in the captured image captured a plurality of times in time series and track the movement of the object.
  • image processing for example, image analysis, object recognition, and object motion tracking
  • the communication I / F 25 of the camera 20 may transmit the captured image to the server 30, the communication I / F 37 of the server 30 may receive the captured image, and the processor 31 may perform image processing based on the captured image.
  • the processor 21 of the camera 20 confirms that the smartphone 40 has entered the information provision area SA1 as a result of image analysis.
  • the communication I / F 25 may notify the server 30 that the smartphone 40 has entered the information provision area SA1.
  • the communication I / F 37 receives the notification that the smartphone 40 has entered the information providing area SA1 from the camera 20, and the processor 31 determines that the customer hm is located in the vicinity of the display position of the lunch box fd1. To do. In accordance with the condition determination table Tb1, the processor 31 notifies the customer hm's smartphone 40 of information related to the lunch (for example, notification of a new product lunch). In the smart phone 40, when the communication unit 45 receives notification of information related to the lunch box, the display unit 48 displays information related to the lunch box.
  • the smartphone 40 has unique identification information (ID).
  • the processor 31 reads the ID of the smartphone 40 by, for example, a reading method described later, and can identify which smartphone 40 is the smartphone 40 that has entered the specific information provision area.
  • the processor 31 may transmit information related to the lunch box or the like to the specific smartphone 40 that has entered the specific information providing area via the communication I / F 37.
  • the communication I / F 25 notifies the server 30 that the smartphone 40 has entered the information provision area SA2. You may be notified.
  • the communication I / F 37 receives the notification that the smartphone 40 has entered the information providing area SA2 from the camera 20, and determines that the customer hm is located in the vicinity of the display position of the juice fd4.
  • the processor 31 notifies the customer hm's smartphone 40 of information related to the juice fd4 (for example, juice discount information).
  • the smartphone 40 displays information regarding the juice fd4.
  • the smartphone 40 may present information to be displayed (for example, voice output or vibration) by a method other than display.
  • the processor 31 of the server 30 It is not necessary to notify again about the information.
  • the processor 31 may notify the information regarding the same food again, and may notify the information regarding the food different from the 1st time.
  • the processor 21 of the camera 20 analyzes the captured image when the customer hm puts the lunch box fd1 on the tray 70, for example, and detects the purchase behavior that the customer hm places the lunch box fd1 on the tray 70, for example. You can do it.
  • the communication I / F 25 may notify the server 30 of the detected purchase behavior.
  • the communication I / F 37 may notify the smartphone 40 of information (for example, recommended information about side dishes) that is suitable for the lunch box fd1, for example, when receiving the notification of the purchase behavior of the lunch box fd1.
  • the smart phone 40 can acquire and display information about the side dishes, and the customer hm can know the side dishes recommended.
  • FIG. 9 is a diagram for explaining the association between the food fd placed on the tray 70 and the smartphone 40.
  • FIG. 9 it is assumed that two trays 70a and 70b are arranged next to each other on the counter 12 of the buffet counter 10.
  • a smartphone 40a and a rice ball fd2 are placed on the tray 70a.
  • the identification information (ID) of the smartphone 40a placed on the tray 70a is ID: 123.
  • Only the smartphone 40b is placed on the tray 70b.
  • the identification information of the smartphone 40b placed on the tray 70b is ID: 567.
  • the rice ball fd2 is closer to the smartphone 40b placed on another tray 70b than the smartphone 40a placed on the same tray 70a. Therefore, when the association between the food fd and the smartphone 40 is performed based on the distance based on the captured image captured by the camera 20 disposed above the buffet counter 10, the rice ball fd2 and the smartphone 40b correspond to each other. It is easy to determine that the
  • the buffet counter system 5 may associate the rice ball fd2 with the smartphone 40a in the following procedure.
  • the imaging unit 23 images the two trays 70 a and 70 b arranged adjacent to the lane of the counter 12 from above.
  • the processor 21 of the camera 20 may recognize the positions of the smartphones 40a and 40b included in the captured image GZ1.
  • the processor 21 recognizes and decodes the two-dimensional codes cd1 and cd2 displayed on the captured images GZ1 smartphones 40a and 40b, and acquires the IDs of the smartphones 40a and 40b (S1).
  • the processor 21 may recognize the smartphones 40a and 40b from the captured image GZ1 and recognize the positions of the smartphones 40a and 40b in the captured image.
  • the recognition of the two-dimensional codes cd1 and cd2 is indicated by frames w1 and w2 superimposed on the captured image GZ1.
  • the processor 21 may recognize the positions of the smartphones 40a and 40b in the real space based on the installation position of the camera 20, the orientation of the imaging unit 23, the imaging range, and the smartphones 40a and 40b in the captured image. Good.
  • the processor 21 may recognize the trays 70a and 70b from the captured images and recognize the positions of the trays 70a and 70b in the captured images. Further, the processor 21 performs image processing such as edge enhancement processing on the captured image GZ1 to extract a contour, and recognizes the range of the trays 70a and 70b included in the captured image GZ1 as rectangular frames w3 and w4. (S2).
  • the processor 21 associates the tray 70a with the smartphone 40a based on the positional relationship between the frame w3 and the smartphone 40a included therein. Similarly, the processor 21 associates the tray 70b and the smartphone 40b with each other based on the positional relationship between the frame w4 and the smartphone 40b included therein (S3).
  • the processor 21 obtains the image by recognizing the type of the food fd placed on the tray 70a and its placement position (S4). For example, the processor 21 compares the outline image of the food fd registered in the memory 22 with the image of the rice ball fd2 included in the captured image GZ1, identifies the type of food based on the similarity, and the rice ball fd2 You may get the position of In the figure, the recognition of the rice ball fd2 that is the food fd is indicated by a frame w5 superimposed on the captured image GZ1.
  • the processor 21 determines whether the position of the frame w5 of the rice ball fd2 is inside the frame w3 of the tray 70a or inside the frame w4 of the tray 70b.
  • the processor 21 determines that the position of the frame w5 of the rice ball fd2 is inside the frame w4 of the tray 70b, and associates the rice ball fd2 with the smartphone 40a (S5). That is, the processor 21 associates the type of food fd (rice ball fd2) with the smartphone 40a (customer hm who owns the smartphone 40a).
  • the communication I / F 25 transmits the associated food type (rice ball fd2) and the ID of the smartphone 40a to the server 30.
  • the communication I / F 37 receives from the camera 20 the associated type of food fd (rice ball fd2) and the ID of the smartphone 40a.
  • the processor 31 acquires the price of the food fd corresponding to the type of the food fd from the food information DB 38z.
  • the communication I / F 37 transmits billing information including the price of the rice ball fd2 to the smartphone 40a as billing information for the user of the smartphone 40a.
  • the communication unit 45 receives charging information including the price of the rice ball fd2 from the server 30, and the display unit 48 displays the charging information including the price of the rice ball fd2.
  • the two-dimensional code indicates the ID of the smartphone 40 here, it can be said that the two-dimensional code indicates the ID (member ID) of the customer hm. This is because the two-dimensional code is allocated by installing a food application on the smartphone 40, and the food application can be used for each customer hm. Further, since the smartphone 40 is placed on the tray 70 on the counter at a close distance from the customer hm, it can be said that the position of the smartphone 40 in the real space is substantially the same as the position of the customer hm.
  • the camera 20 can associate the specific food fd with the specific smartphone 40 using the tray 70. Furthermore, the camera 20 can associate the specific food fd and the specific customer hm that are difficult to directly associate with each other using the tray 70 and the smartphone 40. Therefore, by registering the customer's hm's food preferences and the like, it is possible to link the customer hm and the provision information desired to be provided to the customer hm, and to match the trend (for example, position and movement) of the customer hm. Can provide various information.
  • the camera 20 captures an image, recognizes the image (for example, object recognition), and determines the ID and position of the smartphone 40, the position and range of the tray 70, and the type and position of the food fd.
  • An example of grasping and performing various associations was illustrated.
  • the server 30 may perform association or the like. That is, the server 30 acquires an image captured by the camera 20, and the server 30 performs image recognition (for example, object recognition) on the captured image, and the ID and position of the smartphone 40, the position and range of the tray 70, and the type of food fd. And the position may be grasped and various associations may be performed. In this case, necessary data and information are communicated between the camera 20 and the server 30.
  • the processor 41 may perform a cancellation process for canceling the misrecognized billing information.
  • a cancel button an example of the operation unit 43 for canceling misrecognized billing information may be provided on the screen of the food application.
  • the processor 41 cancels the misrecognized billing information when the customer hm who is the user of the smartphone 40a presses the cancel button, and the communication unit 45 transmits the cancel information for canceling the billing information to the server 30. Good.
  • This cancellation of the billing information can be said to be a cancellation of the association between the food fd and the smartphone 40 or the customer hm.
  • the smartphone 40 may notify the camera 20 of the light ID based on the LED light as the ID of the smartphone 40.
  • the camera 20 can acquire the ID of the smartphone 40 by capturing an image including the light ID.
  • a two-dimensional code indicating an ID for identifying the tray 70 may be pasted on the surface of the tray 70.
  • the camera 20 may associate the ID of the tray 70 with the ID of the smartphone 40 by capturing the two-dimensional code of the tray 70 and recognizing the image.
  • the camera 20 can also associate the food item and the smartphone 40 via the tray 70 by associating the tray 70 with the food item placed on the tray 70.
  • the two-dimensional code pasted on the surface of the tray 70 can be made larger than the two-dimensional code displayed on the smartphone 40, the camera 20 can reduce ID reading errors by the camera 20, and the smartphone 40 and the food Can be improved.
  • the food fd and the smartphone 40 may be associated using a beacon signal.
  • one or more beacon terminals may be installed at an arbitrary position (for example, around the buffet counter 10 or the ceiling of the store 3).
  • An RFID (Radio Frequency IDentifier) tag may be attached to the smartphone 40, the food fd, or the tray 70.
  • the beacon terminal communicates with the RFID tag attached to the food fd, the smartphone 40, or the tray 70, whereby the identification information (ID) and position information of the smartphone 40, the identification information (type) and position information of the food fd, the tray 70 Position information, etc. may be detected. That is, the identification information and position information of food obtained by the camera 20, the identification information and position information of the smartphone 40, and the identification information and position information of the tray 70 may be detected by the beacon terminal.
  • the smartphone 40 includes a GPS receiver and the like, acquires position information (for example, latitude and longitude) of the own terminal, and acquires the position information of the own terminal via the wireless LAN and Bluetooth (registered trademark). You may send it directly to.
  • position information for example, latitude and longitude
  • Bluetooth registered trademark
  • FIG. 10 is a sequence diagram showing an operation procedure of the buffet counter system 5 in the first operation example.
  • the smartphone 40 has already installed the food application.
  • the customer hm operates the smartphone 40 via the operation unit 43, and the processor 41 activates the food application (T1).
  • the processor 41 displays an initial screen on the display unit 48 (T2).
  • the identification information (ID) of the smartphone 40 is displayed as a two-dimensional code.
  • a QR code registered trademark
  • the two-dimensional code may always be displayed on the screen while the application is activated.
  • the customer hm places the smartphone 40 on which the two-dimensional code is displayed on the tray 70, and moves the tray 70 along the counters 12a to 12d of the buffet counter 10.
  • the customer hm takes the food fd placed in the food space 15 and places it on the tray 70.
  • the imaging unit 23 captures an imaging area including the counters 12 a to 12 d and stores the captured image in the recording unit 24.
  • the processor 21 decodes (image recognition) the two-dimensional code displayed on the display unit 48 of the smartphone 40 placed on the tray 70 included in the captured image, and reads the ID of the smartphone 40 (T3).
  • the processor 21 stores the read ID in the memory 22, performs store registration of this ID, and transmits the ID of the smartphone 40 to the server 30 via the communication I / F 25 (T4).
  • the processor 31 receives the ID of the smartphone 40 via the communication I / F 37
  • the processor 31 performs store registration of this ID in the record 35z stored in the recording unit 35 (T5).
  • the communication I / F 37 of the server 30 may notify the smart phone 40 to display the fact that the smart phone 40 has been registered when entering the store.
  • the processor 41 may change the display to indicate that the store has been registered according to the food application.
  • FIG. 11 is a diagram showing the recorded contents of the record 35z.
  • purchase behavior of the food fd by the customer hm is recorded in time series.
  • the record 35z has record items such as an ID of the smartphone 40, a purchased item (food to be purchased, for example, food placed on the tray 70), a position of the smartphone 40, and a store entry time.
  • ID: 123 purchased item: blank, position: blank, and store entry time: 12:18 are recorded. That is, in the store registration, the ID and the store entry time may be registered.
  • the record 35z records ID: 123, purchased item: rice ball, coffee, position: (10.10), and entry time: 12:15, but this information has already entered the store. This is information about the customer hm.
  • the processor 21 tracks the position of the smartphone 40 based on the image captured by the imaging unit 23, and periodically acquires tracking information including the position of the smartphone 40 via the communication I / F 25. (T6).
  • the processor 31 receives the tracking information including the position of the smartphone 40 via the communication I / F 37, and updates the record 35z based on the tracking information (T7). That is, the camera 20 and the server 30 may track the movement of the customer hm corresponding to the movement of the smartphone 40.
  • ID: 567 In the update of the position information in the procedure T7, as shown in FIG. 11, ID: 567, purchased item: blank, position: (15, 5), and entrance time: 12:18 are recorded in the record 35z. That is, the position of the customer hm after entering the store identified by ID: 567 is tracked and recorded, and the food item fd desired to be purchased is not yet placed on the tray 70 of the customer hm.
  • ID: 123 purchased item: rice ball, coffee, position: (40, 20), and entry time: 12:15 are recorded in the record 35z. That is, the customer hm identified by ID: 123 is moving in the store 3 and is being tracked by the camera 20.
  • the processor 31 acquires provision information corresponding to the position of the smartphone 40 based on the condition determination table Tb ⁇ b> 1 stored in the memory 32 or the storage 38.
  • the customer hm identified by the ID 567 is located at the position: (15, 5) and is located inside the information providing area SA1. Therefore, the provision information may include information related to the lunch (for example, information on the lunch A of the new product).
  • the processor 31 transmits the provision information to the smartphone 40 via the communication I / F 37 (T8).
  • the processor 41 when receiving the provision information from the server 30 via the communication unit 45, the processor 41 displays the provision information on the display unit 48 (T9).
  • provided information for example, recommended information can be cited.
  • the customer hm can purchase the food fd while confirming the provided information displayed on the smartphone 40.
  • the customer hm can confirm the recommended information on the new product lunch A and make the lunch A a purchase target.
  • the processor 21 detects the movement of the food fd based on the captured image captured by the imaging unit 23 (T10). In this case, the processor 21 performs image analysis on the captured image, recognizes an object (for example, rice ball, lunch box, juice) included in the captured image, and identifies the type, size, and model number of the food.
  • an object for example, rice ball, lunch box, juice
  • the processor 21 extracts the ID of the smartphone 40 placed on the tray 70 on which the food fd is placed (T11). As described above, the processor 21 acquires, for example, the ID of the smartphone 40 located inside the frame w3 that represents the range of the tray 70. The processor 21 transmits the type of the food fd and the ID of the smartphone 40 to the server 30 via the communication I / F 25 (T12). The food fd and the smartphone 40 are associated with each other as described above.
  • the processor 31 receives the type of food and the ID of the smartphone 40 via the communication I / F 37 (T13).
  • the processor 31 acquires the food information identified by the type of the received food fd from the food information DB 38z.
  • the acquired food information is transmitted to the smartphone 40 identified by the received ID via the communication I / F 37, and an instruction to update the display displayed on the display unit 48 is given (T14).
  • ID: 567 purchased item: lunch A, position: (15.6), and entrance time: 12: 18 are recorded in the record 35z. That is, the customer hm identified by ID: 567 is moving with the lunch box A placed on the tray 70. Also, the record 35z is updated and recorded with ID: 123, purchased item: rice ball, coffee, position: (40, 80), and entry time: 12:15.
  • the processor 41 of the smartphone 40 receives the food information regarding the food fd placed on the tray 70 via the communication unit 45, and displays the food information on the display unit 48 (T15).
  • the buffet counter system 5 can track the movement of the smartphone 40, the customer hm, and the food fd from the customer hm's entry into the store 3, and sequentially register this information in the record 35z. You can manage each move. Therefore, the buffet counter system 5 can associate the smartphone 40, the customer hm, and the food fd with maintaining the freedom of movement of the smartphone 40, the customer hm, and the food fd.
  • the buffet counter system 5 can provide information according to the position of the customer hm when the customer hm does not place the food fd on the tray 70, for example.
  • the buffet counter system 5 provides information according to the position of the customer hm, for example, when the customer hm places the food fd on the tray 70, and information according to the food placed on the tray 70 (for example, calorie Information, billing information).
  • FIG. 12 is a diagram illustrating an example of the screen GM1 of the smartphone 40 on which the food information regarding the food fd placed on the tray 70 is displayed.
  • the type of the food fd for example, rice balls, coffee
  • billing information for example, 150 yen, 100 yen, total 250 yen
  • calorie values for example, 215 kcal, 10 kcal, total 225 kcal.
  • recommended information may be, for example, information that recommends buying salads and fried chicken together with the purchase of rice balls and coffee.
  • the member ID is the ID of the customer hm who owns the smartphone 40 and is associated with the smartphone 40.
  • the food information regarding the food fd placed on the tray 70 is displayed in real time on the screen GM1 of the display unit 48 of the smartphone 40 possessed by the customer hm placed on the tray 70.
  • the processor 41 may detect the pressing and instruct the server 30 to perform the settlement.
  • the processor 41 may transmit information for executing settlement of the amount related to the billing information to the server 30 via the communication unit 45.
  • the processor 31 receives information for executing payment via the communication I / F 37, the processor 31 performs payment with, for example, a payment center.
  • the processor 41 of the smartphone 40 may display a bar code for settlement on the display unit 48 when detecting the depression of the settlement button bn1. Then, the payment barcode of the food item fd on the tray 70 may be input to the POS terminal by scanning the payment barcode with the POS terminal of the store 3, and then the payment using the POS terminal may be performed. .
  • the same information as the smartphone 40 may be displayed, or different information may be displayed.
  • information for individuals for each customer hm may be displayed on the smartphone 40, and information common to each customer hm may be displayed on the signage 50.
  • the signage 50 displays, for example, advertisement information of the food fd, an image after cooking the food fd, information on the cooking method of the food fd (foodstuff) (for example, recipe), information on the production area of the food fd (foodstuff), etc. Good.
  • the signage 50 may display information related to, for example, a food fd with low sales, a food fd with a near expiration date, and the like.
  • the sales may be acquired by the signage 50 in cooperation with the server 30 or the POS, or may be determined from the weight of the weight sensor 82 (for example, the remaining number of foods d is greater than the threshold). .
  • the weight of the weight sensor 82 for example, the remaining number of foods d is greater than the threshold.
  • the buffet counter system 5 images the food fd displayed on the buffet counter 10 installed in the store 3 and the smartphone 40 possessed by the customer hm (an example of a customer) located in the store 3.
  • a camera 20 an example of a sensor
  • a server 30 an example of a food management device that manages the food fd are provided.
  • the camera 20 transmits the captured image and information (an example of detection information) obtained from the captured image to the server 30.
  • the server 30 receives a captured image and information obtained from the captured image.
  • the server 30 acquires association information between the food fd and the smartphone 40 (that is, the customer hm) by associating (associating) the food fd included in the captured image GZ1 with the smartphone 40 (that is, the customer hm).
  • the camera 20 may associate the food fd included in the captured image GZ1 with the smartphone 40 (that is, the customer hm), and the server 30 may acquire this association information from the camera 20.
  • the server 30 refers to the customer information DB 38y and the food information DB 38z, for example, and acquires (an example of derivation) food information regarding the food fd associated with the customer hm.
  • the buffet counter system 5 can provide the customer hm with information on the food associated with the customer hm.
  • the buffet counter system 5 can associate the customer hm with the food fd based on the location of the customer hm.
  • the buffet type counter system 5 can associate the food fd with, for example, the preference of the customer hm. Therefore, food information can be provided in accordance with customer trends and preferences before purchasing food.
  • the camera 20 may decode the two-dimensional code displayed on the smartphone 40 included in the captured image GZ1, for example, and acquire the position of the smartphone 40 possessed by the customer hm.
  • the server 30 may acquire food information from the food information DB 38z or the like based on the position of the smartphone 40. That is, the camera 20 may detect the position of the customer hm, and the server 30 may derive the food information based on the position of the customer hm.
  • the buffet counter system 5 can provide food information corresponding to the position of the customer hm.
  • the buffet-type counter system 5 can provide information related to the lunch box when the customer hm is located near the lunch box area where the lunch box is displayed.
  • the camera 20 may track the position of the smartphone 40 possessed by the customer hm and transmit this tracking information to the server 30.
  • the server 30 may receive the tracking information of the smartphone 40 and update and acquire the food information from the food information DB 38z or the like based on the tracked position of the smartphone 40. That is, the camera 20 may track the position of the customer hm and transmit tracking information of the customer hm.
  • the server 30 may receive the tracking information of the customer hm, and update and derive the food information based on the tracked location of the customer hm.
  • the buffet type counter system 5 can sequentially provide information on foods displayed near the position of the customer hm, for example, as the customer hm moves.
  • the camera 20 takes an image so as to include a tray 70 for placing the food fd, a food fd placed on the tray 70, and a smartphone 40 (an example of a terminal) possessed by the customer hm placed on the tray 70. You can do it.
  • the camera 20 may detect the tray 70, the food fd, and the smartphone 40 by image recognition for the captured image.
  • the server 30 may acquire food information regarding foods placed on the same tray 70 as the smartphone 40. That is, the server 30 may derive the food information regarding the food placed on the same tray 70 as the smartphone 40.
  • the buffet counter system 5 can provide food information regarding the food fd placed on the tray 70. Therefore, the customer hm can easily grasp the food to be purchased even when a large number of food fd is placed on the tray 70 as the purchase target.
  • the server 30 may transmit the acquired food information to the smartphone 40 (an example of an information presentation device).
  • the smartphone 40 may display the food information on the display unit 48 (an example of presentation).
  • the customer hm can know the food information specifically by looking at the food information displayed on the smartphone 40.
  • the server 30 may acquire the captured image GZ1 including the tray 70 by the camera 20.
  • the server 30 may extract the contour of the tray 70 by performing image recognition or the like on the captured image GZ1.
  • the server 30 may acquire the ID (identification information) and position of the smartphone 40 included in the captured image GZ1 by image recognition or the like.
  • the server 30 associates the food information of the food fd with the ID of the smartphone 40. May be attached.
  • the buffet counter system 5 can suppress the correspondence between the smartphone 40 owned by another customer and the food fd placed on the tray 70 used by the customer, and the tray used by another customer hm. It is possible to suppress the association between the food fd on 70 and the smartphone 40 possessed by itself. Thereby, the buffet type counter system 5 can suppress, for example, that food information relating to food that is not placed on the tray 70 is erroneously displayed or that food that is not placed on the tray 70 is charged.
  • the second operation example shows a case where recommended information according to the attribute of the customer hm is provided.
  • FIG. 13 is a flowchart showing an operation procedure of the server 30 in the second operation example.
  • the processor 31 receives the ID of the smartphone 40 transmitted from the camera 20 via the communication I / F 37 (S11).
  • the processor 31 refers to the customer information DB 38y using the received ID of the smartphone 40, and acquires the customer attribute regarding the customer hm associated with the ID of the smartphone 40. Customer attributes are included in the customer information.
  • the processor 31 provides information on a recommended menu (that is, a recommended menu corresponding to the ID) based on the acquired customer attributes.
  • the processor 31 may instruct the smartphone 40 to display a recommended menu via the communication I / F 37 (S12).
  • the processor 31 may provide information on a food with low calories as information on the recommended menu.
  • the processor 31 may provide information on food containing a lot of protein as information on the recommended menu.
  • the processor 31 acquires the position of the smartphone 40 via the communication I / F 37 (S13).
  • the processor 31 acquires the display position of each food fd.
  • the display position of each food fd is stored in, for example, the food information DB 38 z and may be acquired by the processor 31.
  • the processor 31 determines whether or not the position of the smartphone 40 is near the position where the food fd included in the recommended menu is displayed (S14).
  • the vicinity of the position where the food fd is displayed may indicate that it is within the threshold th1 from the display position (display position) of the food fd.
  • the threshold th1 may be determined based on, for example, a position where the customer hm carrying the smartphone 40 can easily take the food fd corresponding to the customer hm from the food space 15.
  • the vicinity of the position where the food fd is displayed may be the same as the information providing areas SA1 and SA2.
  • the processor 31 gives a predetermined instruction to the smartphone 40 via the communication I / F 37 (S15).
  • the processor 31 may present a notification alarm from the speaker 42 to the smartphone 40 (for example, by outputting sound and displaying it.
  • the notification alarm may be displayed, for example, by information on the corresponding food fd or the corresponding food fd.
  • Information indicating that the customer hm is located in the vicinity may be output by voice (for example, reading a message, simply outputting an alarm sound) or highlighted (for example, display by characters or images, LED lighting or blinking).
  • the processor 31 returns to the process of S13.
  • the buffet counter system 5 can provide a recommended menu corresponding to the attribute of the customer hm for each customer hm carrying the smartphone 40, that is, for each member who uses the food application. Therefore, the customer hm can take out the food fd from the buffet counter system 5 while checking the recommended menu unique to the customer hm. At this time, the buffet counter system 5 can notify an alarm or the like so as not to forget to purchase the recommended food item fd according to the position of the customer hm.
  • FIG. 14 is a diagram showing a screen GM2 of the smartphone 40 on which a recommended menu is displayed.
  • the recommended menu is displayed on the screen GM2 of the display unit 48 of the smartphone 40.
  • the recommended menu is created by the server 30 based on the attribute of the customer hm registered in the customer information DB 38y searched using the ID of the smartphone 40 possessed by the customer hm (that is, the ID of the customer hm).
  • Check boxes cb1, cb2, cb3, and cb4 are displayed in the display area of each food fd included in the recommended menu on the screen GM2.
  • a check mark is added to each check box.
  • FIG. 14 illustrates that the salad chicken and seaweed salad are placed on the tray 70.
  • the processor 41 of the smartphone 40 recognizes the food fd placed on the tray 70 in cooperation with the processor 31 of the server 30, and adds a check mark to the check boxes cb1 and cb4 of the corresponding food fd.
  • the charging information (amount information) of the food fd is displayed at the bottom of the screen GM2, assuming that the food has already been acquired by the customer hm.
  • the processor 41 of the smartphone 40 may highlight the corresponding food fd in cooperation with the processor 31 of the server 30. In the highlighted display, the processor 41 may change the background color of the display area of the corresponding food fd to a conspicuous color such as orange. Further, when the smartphone 40 is located near the food fd included in the recommended menu, the processor 41 may display a message such as “It is placed on the shelf in front of you!” On the display unit 48.
  • a color code may be displayed as a two-dimensional code in the upper right corner of the screen GM2, for example.
  • a settlement button bn1 may be arranged in the lower right corner of the screen GM2. The operation when the settlement button bn1 is pressed is the same as in the first operation example.
  • the recommended menu can be presented to the customer hm based on the attributes such as the sex, age, and preference of the customer hm, and the purchase of the food fd can be assisted.
  • the camera 20 may detect the ID of the smartphone 40 using a two-dimensional barcode or the like, and transmit the ID to the server 30.
  • the server 30 may receive the ID of the smartphone 40, search the customer information DB 38 y based on the ID of the smartphone 40, and acquire customer attribute information.
  • the server 30 may acquire the food information corresponding to the customer attribute by searching the food information DB 38z. That is, the camera 20 may detect the identification information of the customer hm for identifying the customer hm.
  • the server 30 may derive food information based on the identification information of the customer hm.
  • the buffet counter system 5 can provide food information corresponding to the attributes of the customer hm such as gender, age, taste, and the like.
  • the buffet-type counter system 5 has a simple user operation in which, for example, the processor 41 of the smartphone 40 registers the attribute information of the customer hm in the customer information DB 38y via the food application in cooperation with the server 30. Food information can be provided easily.
  • the camera 20 may detect the ID of the smartphone 40 possessed by the customer hm reflected in the captured image, for example, based on the captured image.
  • the camera 20 may transmit the ID of the smartphone 40 and the position information of the smartphone 40 to the server 30.
  • the server 30 may receive the ID of the smartphone 40 from the camera 20.
  • the server 30 may acquire recommended menu information recommended for the customer hm identified by the ID of the smartphone 40 using, for example, the customer information DB 38y and the food information DB 38z.
  • the server 30 may derive food information regarding the food fd recommended for the customer hm included in the recommended menu.
  • the server 30 can provide the customer hm with a recommended menu that matches the attributes of the customer hm such as sex, age, and preference. Further, the server 30 can provide information on the food fd included in the recommended menu.
  • the camera 20 may detect position information of the smartphone 40.
  • the server 30 may determine the food information to be presented in an emphasized manner based on the position of the customer hm and the recommended menu information.
  • the buffet type counter system 5 when the buffet type counter system 5 approaches the place where the food fd included in the recommended menu is displayed, for example, the buffet type counter system 5 emphasizes and presents the food information regarding the food included in the recommended menu and close to the customer hm.
  • the smartphone 40 can be instructed.
  • the server 30 can provide supplementary information (for example, information indicating that the food fd is output or a message indicating that the food fd is approaching) for purchasing the food fd included in the recommended menu.
  • the camera 20 may image the tray 70 and the food fd placed on the tray 70.
  • the server 30 may instruct the smartphone 40 to change the display mode (an example of the presentation mode) of the food information related to the food fd placed on the tray 70 with respect to the smartphone 40 having the corresponding ID.
  • the customer hm can gray out, check, or delete the information on the food product. Therefore, the customer hm can confirm that it is not necessary to additionally purchase the food fd placed on the tray 70 in the shopping list to be purchased by the customer hm such as the recommended menu. Therefore, the buffet type counter system 5 can support purchasing one or more foods fd included in the recommended menu without excess or deficiency, for example.
  • first operation example and the second operation example of the present embodiment may be performed at the same timing or may be performed at different timings.
  • the buffet counter system 5 can present the recommended food fd according to the position of the customer hm in the store 3 and the attribute of the customer hm, and can increase the customer's hm's willingness to purchase. .
  • a large number of food items fd are arranged in multiple stages on the fixture 11.
  • the height of the food fd becomes low, and the height of the displayed food fd differs for each region in the fixture 11.
  • the height of the uppermost stage of the food fd stacked and displayed tends to be low.
  • the height of the uppermost stage of the food fd that is stacked and displayed remains high.
  • each food fd is moved up and down so that the food group (each area) displayed on the fixture 11 has a uniform height regardless of the number of food fd.
  • FIG. 15 is a diagram schematically showing the vicinity of the table 11z of the fixture 11 of the buffet counter 10 in a modified example.
  • FIG. 15 shows a part of a buffet type counter system 5 ⁇ / b> A which is a modification of the buffet type counter system 5.
  • the same components as those in the buffet type counter system 5 shown in FIG. 3 and the like are denoted by the same reference numerals, and the description thereof is omitted or simplified.
  • the food fd is directly placed on the fixture 11 of the buffet counter 10, but in FIG. 15, the mounting table 110 is installed on the fixture 11. Various food items fd are displayed on the mounting table 110.
  • the mounting table 110 is placed on a mounting surface 110z including a plurality of circular mounting tables 110y on which various foods fd are placed, a face-up mechanism 111 capable of moving up and down independently of the plurality of circular mounting tables 110y, and the mounting surface 110z. And a weight sensor 112 that measures the weight of the food fd.
  • the weight sensor 112 may be absent.
  • a table other than the circular table 110y may be used, and the shape of the table may be any shape (for example, rectangular or other shape).
  • FIG. 16 is a diagram showing the placement surface 110z.
  • the circular mounting table 110y partitioned by the mounting surface 110z corresponds to the upper surface of the cylindrical member 124.
  • the height of each circular placing table 110y is arbitrarily adjusted according to the height of the food fd to be placed.
  • a lunch box fd1, a rice ball fd2, and a pizza fd6 are displayed on the placement surface 110z.
  • the lunch box fd1 is stacked in two stages.
  • the rice balls fd2 are arranged in a plane without being stacked.
  • the pizza fd6 is stacked in three stages.
  • the cylindrical member 124 is moved up and down by the face-up mechanism 111 so that the tops of the lunch box fd1, the rice ball fd2, and the pizza fd6 have a certain height Hc, and the height of the circular table 110y is aligned.
  • the processor 31 of the server 30 selects the food (for example, the lunch box fd1) having the highest spatial height of the food fd that is stacked on the top of the food group displayed on the placement surface 110z. It may be determined whether or not the difference between the position and the position of the lowest food (for example, rice ball fd2) is equal to or greater than the threshold th2. When it is equal to or greater than the threshold th2, the processor 31 may drive the face-up mechanism 111 so that the difference between the position of the highest food fd and the position of the lowest food fd is reduced (for example, there is no difference). As a result, in FIG. 15, the placement surface 110z is uneven so that the area corresponding to the lunch box fd1 is low, the area corresponding to the rice ball fd2 is high, and the area corresponding to the pizza fd6 is intermediate height. It is deformed.
  • FIG. 17 is a diagram illustrating an example of the configuration of the face-up mechanism 111.
  • the face-up mechanism 111 includes a cylindrical member 124 having the circular mounting table 110y as an upper surface, a motor 121, a ball screw 123, and a nut 122 for each circular mounting table 110y.
  • the nut 122 is screwed into the ball screw 123.
  • the motor 121 drives the ball screw 123 to rotate.
  • the motor 121 is connected to the server 30, and when a drive signal is sent from the server 30, the ball screw 123 is rotated forward or backward in accordance with the drive signal.
  • the ball screw 123 rotates normally or reversely, the nut 122 moves in the vertical direction (gravity direction) by a distance corresponding to the rotation amount.
  • the cylindrical member 124 to which the nut 122 is fixed moves up and down. Therefore, the height of the circular table 110y that is the upper part of the cylindrical member 124 is changed, and the height of the food fd placed on the circular table 110y changes.
  • the circular mounting table 110y may mount one food fd by one circular mounting table 110y, or may mount one food fd by a plurality of (for example, many) circular mounting tables 110y.
  • the size of the area of the surface (corresponding to the circular portion here) on which food is placed on the circular mounting table 110y is arbitrary. As the surface of the circular table 110y is smaller, one food fd is placed on a larger number of circular tables 110y. In addition, for example, even if the type of food displayed on the fixture 11 is sequentially changed and the size of the food changes, the food fd of various sizes can be placed by the circular table 110y. In this case, the number of circular platforms 110y that support one food fd can be changed.
  • the mounting table 110 can cope with the face-up of each food fd even when the layout of the food display is changed according to the presence / absence of an event, the season, or the time zone.
  • the processor 31 of the server 30 may acquire and set information on the operation by a human as to which round table to use for the face-up of each food fd displayed, or a camera installed on the ceiling
  • the captured image picked up by the image 20 may be subjected to image processing to obtain (for example, calculate) the size and position of each food fd, and automatically assigned according to the size and position of each food fd.
  • the processor 31 determines whether or not each position on the mounting table 110 is planar. In this case, the processor 31 may determine whether or not it is planar depending on whether or not the height of each position on the mounting table 110 is uniform. The processor 31 may detect a recessed portion in comparison with another position instead of being planar, and operate the face-up mechanism 111 to raise the circular mounting table 110y at the recessed portion to face up.
  • Information on the height of each position on the mounting table 110 may be acquired by various methods.
  • the height of the food fd in each area can be determined by directly measuring the distance from the infrared sensor or ultrasonic sensor to each food fd using an infrared sensor or ultrasonic sensor installed above the buffet counter 10. May be acquired.
  • the processor 21 of the camera 20 or the processor 31 of the server 30 calculates the distance between the camera 20 installed on the ceiling and the food fd in each area, for example, based on the captured image, and the height of the food fd in each area. May be judged.
  • the camera 20 may form a stereo camera with a plurality of cameras, calculate the distance between the camera 20 and the food fd in each area based on the captured image, and determine the height of the food fd in each area.
  • the server 30 may determine the height of the food fd in each area based on the weight of one or more foods fd stacked by the weight sensor 112.
  • the weight sensor 112 may be disposed below the face-up mechanism 111 and measure the entire weight of the face-up mechanism 111.
  • the weight sensor 112 may notify the server 30 of the total weight information of the measured face-up mechanism 111.
  • the processor 31 of the server 30 may determine increase / decrease in the food fd based on the weight information received from the weight sensor 112. For example, when the customer hm moves one food fd to the tray 70, the entire weight of the face-up mechanism 111 is reduced accordingly.
  • the server 30 may collate the weight of the food registered in advance in the food information DB 38z with the changed amount of the lightened weight to determine the type of the lost food fd.
  • the server 30 may drive the face-up mechanism 111 so as to raise and lower the circular table 110y corresponding to the lost food fd.
  • the buffet type counter system 5A can avoid being displayed in a depressed state from other product groups even if the popular food fd is sold. Moreover, the buffet type counter system 5A can arrange the heights so that the heights of many foods fd displayed in the food space 15 are constant. Therefore, it becomes easy for the customer hm to easily take the food fd in any region of the fixture 11, and the customer hm's willingness to purchase can be enhanced.
  • the weight sensor 112 may notify the server 30 every time a change in weight is detected, that is, every time the food fd is taken out, for example.
  • the processor 31 may operate the face-up mechanism 111 upon receiving a notification of a change in weight.
  • buffet type counter system 5A can maintain the height of food fd uniformly for every area, whenever food fd is taken out.
  • the processor 31 may operate the face-up mechanism 111 when, for example, a change in weight is notified a predetermined number of times, that is, when the food fd is extracted a predetermined number of times.
  • buffet type counter system 5A can maintain the height of food fd uniformly for every area according to the amount of increase or decrease of food, when food fd is taken out a predetermined number of times (predetermined number).
  • the processor 31 may measure the time by a timer and operate the face-up mechanism 111 at regular intervals. Thereby, buffet type counter system 5A can maintain the height of food fd uniformly for every area, without depending on whether food fd was taken out.
  • the face-up mechanism 111 is operated so that the heights of many foods fd are constant has been shown, but the processor 31 of the server 30 increases the popularity of the foods fd that are not popular.
  • the face-up mechanism may be operated so as to intentionally change the height of the food group in accordance with the marketing strategy such as lowering the high food fd.
  • the server 30 may operate the face-up mechanism 111 based on the food inventory management information and purchase information held by the server 30.
  • the processor 31 of the server 30 acquires the ID of the smartphone 40
  • the corresponding food is increased so as to increase the purchase intention of the food according to the attributes (diet preference, sports preference) of the customer hm corresponding to the ID of the smartphone 40.
  • the face-up mechanism 111 may be operated so that fd becomes high.
  • the face-up mechanism 111 using the motor 121 is shown.
  • the face-up mechanism 111 may be configured so that the circular mounting table 110y can be moved up and down.
  • Arbitrary structures, such as the structure used and the structure using an electromagnet, may be sufficient.
  • the weight sensor 112 measures the weight of the entire face-up mechanism 111 including the food fd.
  • the weight of each circular mounting table 110y on which the food fd is placed and a predetermined number of circular mounting tables are measured.
  • the weight of 110y may be measured.
  • the buffet-type counter system 5A determines which food fd has been taken out from which area in the bowl 11, based on the area where the circular table 110y that has changed in weight and weight has been placed. It can be accurately identified.
  • a small weight sensor can be used, and space saving is achieved.
  • the mounting table 110 is a separate body from the fixture 11, it may be formed integrally with the fixture 11.
  • the server 30 performed the process related to face-up
  • the control device different from the server 30 may perform the process related to face-up. Thereby, the apparatus which assists face-up, and the apparatus (server 30) which manages food information can be installed separately.
  • the buffet-type counter system 5A sets the heights of the foods fd displayed in a stack so that the heights of the many foods fd displayed in the food space 15 are constant. Can be aligned by area. Thereby, the buffet type counter system 5A makes the height of the food hd uniform in any region in the bowl 11, makes it easy to take the food fd uniformly, and can increase the customer's hm's willingness to purchase.
  • the purchase of the food fd and the like is managed.
  • the present disclosure is applicable not only to the food fd but also to managing other products (for example, clothes, toys, and electrical products). .
  • the processor may be physically configured in any manner. Further, if a programmable processor is used, the processing contents can be changed by changing the program, so that the degree of freedom in designing the processor can be increased.
  • the processor may be composed of one semiconductor chip or physically composed of a plurality of semiconductor chips. When configured by a plurality of semiconductor chips, each control of the embodiment may be realized by separate semiconductor chips. In this case, it can be considered that a plurality of semiconductor chips constitute one processor.
  • the processor may be configured by a member (a capacitor or the like) having a function different from that of the semiconductor chip. Further, one semiconductor chip may be configured so as to realize the functions of the processor and other functions.
  • a plurality of processors may be configured by one processor.
  • This disclosure is useful for food management systems that can provide food information according to customer trends and preferences before purchasing food.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Development Economics (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

L'invention concerne un système de gestion de produits alimentaires pouvant fournir des informations sur des produits alimentaires en fonction des tendances et des préférences du client avant l'achat de produits alimentaires. Le système de gestion de produits alimentaires comprend : un capteur pour détecter un produit alimentaire (fd) dans un magasin (3) et un visiteur (hm) visitant le magasin (3) ; et une unité de gestion de produits alimentaires pour gérer des produits alimentaires. Le capteur envoie des informations de détection détectées par le capteur. L'unité de gestion de produits alimentaires reçoit les informations de détection, obtient des informations d'association qui associent le produit alimentaire (fd) et le visiteur (hm) détectés par le capteur, et génère des informations de produit alimentaire concernant le produit alimentaire (hd) associé au visiteur (hm).
PCT/JP2019/006658 2018-06-08 2019-02-21 Système de gestion de produits alimentaires WO2019234997A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-110236 2018-06-08
JP2018110236 2018-06-08

Publications (1)

Publication Number Publication Date
WO2019234997A1 true WO2019234997A1 (fr) 2019-12-12

Family

ID=68770250

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/006658 WO2019234997A1 (fr) 2018-06-08 2019-02-21 Système de gestion de produits alimentaires

Country Status (1)

Country Link
WO (1) WO2019234997A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3862935A1 (fr) * 2020-02-04 2021-08-11 Ronny Saul Système et procédé de gestion de déchets alimentaires
WO2021156302A1 (fr) * 2020-02-04 2021-08-12 Foodoptimize Aps Procédé et système de gestion de déchets alimentaires

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002304671A (ja) * 2001-04-05 2002-10-18 K & L Interactive:Kk ショッピング情報提供方法及びショッピング情報提供システム
JP2006011617A (ja) * 2004-06-23 2006-01-12 Hakuhodo Inc 商品販売促進情報の配信方法
JP2006113711A (ja) * 2004-10-13 2006-04-27 Matsushita Electric Ind Co Ltd マーケティング情報提供システム
JP2012168836A (ja) * 2011-02-16 2012-09-06 Seiko Epson Corp 情報提供装置および情報提供システム
JP2013016134A (ja) * 2011-07-06 2013-01-24 Japan Research Institute Ltd 提案装置
JP2014056416A (ja) * 2012-09-12 2014-03-27 Sharp Corp 携帯端末および情報提供システム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002304671A (ja) * 2001-04-05 2002-10-18 K & L Interactive:Kk ショッピング情報提供方法及びショッピング情報提供システム
JP2006011617A (ja) * 2004-06-23 2006-01-12 Hakuhodo Inc 商品販売促進情報の配信方法
JP2006113711A (ja) * 2004-10-13 2006-04-27 Matsushita Electric Ind Co Ltd マーケティング情報提供システム
JP2012168836A (ja) * 2011-02-16 2012-09-06 Seiko Epson Corp 情報提供装置および情報提供システム
JP2013016134A (ja) * 2011-07-06 2013-01-24 Japan Research Institute Ltd 提案装置
JP2014056416A (ja) * 2012-09-12 2014-03-27 Sharp Corp 携帯端末および情報提供システム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3862935A1 (fr) * 2020-02-04 2021-08-11 Ronny Saul Système et procédé de gestion de déchets alimentaires
WO2021156302A1 (fr) * 2020-02-04 2021-08-12 Foodoptimize Aps Procédé et système de gestion de déchets alimentaires

Similar Documents

Publication Publication Date Title
US10885336B1 (en) Object identification and device communication through image and audio signals
US20210304176A1 (en) Information processing system
RU2727084C1 (ru) Устройство и способ определения информации о заказе
US10290031B2 (en) Method and system for automated retail checkout using context recognition
WO2017085771A1 (fr) Système, programme et procédé d'aide au paiement
RU2739542C1 (ru) Система автоматической регистрации для торговой точки
US20140019311A1 (en) Store system, control method thereof, and non-transitory computer-readable medium storing a control program thereof
CN105047112B (zh) 展示物品及其媒体播放的系统及方法
US20130117153A1 (en) Fully interactive, wireless, retail video display tag, integrated with content distribution, data management, feedback data collection, inventory and product price search capabilities
TWI778030B (zh) 店鋪裝置、店鋪管理方法及程式
US20090083122A1 (en) Method and apparatus for identifying customer behavioral types from a continuous video stream for use in optimizing loss leader merchandizing
US20150213498A1 (en) Method and apparatus for providing product information
CN105580040A (zh) 销售促进系统、销售促进方法、非瞬时计算机可读介质和货架系统
US10445807B1 (en) Enhanced customer shopping experience in physical store locations
JP6653813B1 (ja) 情報処理システム
CN112639862A (zh) 物品定位、清单创建、路线规划、成像和检测的系统、设备和方法
US20200327782A1 (en) Presentation apparatus (iot)
WO2013174983A1 (fr) Système d'enregistrement
AU2020201577B2 (en) Presentation apparatus (IOT)
WO2019234997A1 (fr) Système de gestion de produits alimentaires
JP2019145045A (ja) 顧客管理システム、顧客管理方法、及びプログラム
JP6369319B2 (ja) 売上処理装置、および客層別商品人気分析方法
JP6439415B2 (ja) 売上処理装置、および売上処理方法
TW202008186A (zh) 商品資訊查詢方法和系統
JP2018077666A (ja) 情報処理システム、情報処理装置、表示装置及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19815796

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19815796

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP