JP6570898B2 - Ingredient position presentation method and refrigerator - Google Patents

Description

  The present disclosure relates to a food material position presentation method that presents the position of a food material in a refrigerator, and a refrigerator that presents the position of the food material.

  Conventionally, a technique for appropriately managing food materials in a refrigerator has been desired. For example, by presenting the user with the presence or absence of food in the refrigerator, it is possible to prevent the user from forgetting or buying too much food. In addition, for example, when the expiration date of the ingredients in the refrigerator is presented to the user, the user can use the ingredients before the expiration date.

  For example, conventionally, refrigerators have been developed that take images of the interior with a camera provided in the refrigerator and transmit the taken images to a smartphone. In this case, the user can check the image in the refrigerator sent to the smartphone on the go, and can prevent duplicate purchase of food.

  Further, for example, in Patent Document 1, when the food product data (for example, the name of the food product, the expiration date) is read by the reading unit and the food product is placed on the mounting unit, the weight increase change of the mounting unit is changed. It is detected by the weight detection unit, the place where it is placed is calculated by the calculation unit, the food data, the weight data, and the position data are stored in the storage unit, and each data is displayed on the display unit.

  Further, for example, in Patent Document 2, the refrigerator is provided in a plurality of shelves on which foods arranged side by side in the vertical direction, a refrigerator compartment having the shelves, and an upper center from the front end of the shelves. Temperature detection means, and the temperature detection means detects the inflection point temperature between the food temperature and the user's body temperature, and specifies the placement position and temperature of the food on the shelf.

JP 2002-303479 A JP 2011-158233 A

  However, in the conventional technology, information on the ingredients in the refrigerator is displayed on a display unit provided on the front surface of the smartphone or the refrigerator, and is presented to the user at a location away from the actual ingredients. For this reason, the user cannot immediately use the ingredients in the refrigerator. For example, even if information related to a food with a near expiration date is displayed on a smartphone, the food is not in front of the user. Therefore, the user forgets to use the food and may not be able to use the food before the expiration date.

  The present disclosure has been made in order to solve the above-described problem, and a user can immediately cope with the ingredients in the refrigerator, and the ingredient position presentation method and the refrigerator that can use the ingredients without waste. It is intended to provide.

  A food material position presentation method according to an aspect of the present disclosure is a food material position presentation method that uses a computer to present a food material position in a refrigerator, and specifies the food material in the refrigerator. The position of the food is specified, the food information related to the specified food is stored in inventory information that associates the specified position information indicating the position of the food, and the refrigerator door is opened. When acquiring the door opening information shown, when acquiring the door opening information, based on the inventory information, specify the ingredients to be used by the user, generate a control command to illuminate the identified ingredients, The generated control command is transmitted to the refrigerator.

  According to the present disclosure, when the refrigerator door is opened, the ingredients to be used by the user in the refrigerator are illuminated, so the user can immediately deal with the ingredients in the refrigerator. It can be used without waste.

It is a figure which shows the structure of the foodstuff position presentation system which concerns on Embodiment 1 of this indication. In this Embodiment 1, it is a schematic diagram for demonstrating the method of pinpointing the position of the foodstuff in a store | warehouse | chamber with the camera provided in the store | warehouse | chamber. In this Embodiment 1, it is a schematic diagram for demonstrating the method of pinpointing the position of the foodstuff in a store | warehouse | chamber with the camera provided outside the store | warehouse | chamber. It is a schematic diagram for demonstrating the example of arrangement | positioning of the several light source in this Embodiment 1. FIG. It is a flowchart for demonstrating the operation | movement which records the inventory information of the foodstuff position presentation system in this Embodiment 1. FIG. It is a flowchart for demonstrating the operation | movement which illuminates the specific foodstuff of the foodstuff position presentation system in this Embodiment 1. FIG. In this Embodiment 1, it is a schematic diagram for demonstrating the example which illuminates a foodstuff according to an expiration date. It is a figure which shows the structure of the foodstuff position presentation system which concerns on the modification of Embodiment 1 of this indication. In the modification of this Embodiment 1, it is a schematic diagram for demonstrating the example which illuminates a foodstuff according to the recipe of the cooking which a user makes. It is a figure which shows the structure of the refrigerator which concerns on Embodiment 2 of this indication. It is a flowchart for demonstrating the operation | movement which records the inventory information of the refrigerator in this Embodiment 2. FIG. It is a flowchart for demonstrating the operation | movement which illuminates the specific foodstuff of the refrigerator in this Embodiment 2.

  In order to solve the above-mentioned problem, a food material position presentation method according to one aspect of the present disclosure is a food material position presentation method that uses a computer to present the food material position in the refrigerator, and specifies the food material in the refrigerator. In addition, the position of the food in the refrigerator is specified, the food information related to the specified food is stored in inventory information in which the position information indicating the position of the specified food is associated, In order to acquire door opening information indicating that the door has been opened, and when the door opening information is acquired, based on the inventory information, to identify the ingredients to be used by the user, and to illuminate the identified ingredients The control command is generated, and the generated control command is transmitted to the refrigerator.

  According to this structure, while the foodstuff in a refrigerator is specified, the position of the foodstuff in a refrigerator is specified. Inventory information in which the food material information related to the specified food material is associated with the position information indicating the position of the specified food material is stored. Door opening information indicating that the refrigerator door has been opened is acquired. When the door opening information is acquired, the food material to be used by the user is specified based on the inventory information, and a control command for illuminating the specified food material is generated. The generated control command is transmitted to the refrigerator.

  Therefore, when the door of the refrigerator is opened, ingredients to be used by the user in the refrigerator are illuminated, so that the user can immediately deal with the ingredients in the refrigerator and use the ingredients without waste. be able to.

  Further, in the food material position presentation method, when the door opening information is acquired, the expiration date of the food material indicated by the food material information included in the inventory information is acquired, and the date when the door opening information is acquired, You may identify the foodstuff whose difference with the acquired said expiration date is below a predetermined threshold value, and generate | occur | produce the control command for illuminating the identified said foodstuff.

  According to this configuration, when the door opening information is acquired, the expiration date of the ingredient indicated by the ingredient information included in the inventory information is acquired. A food material whose difference between the date when the door opening information is acquired and the acquired expiration date is equal to or less than a predetermined threshold is specified, and a control command for illuminating the specified food material is generated.

  Therefore, the foodstuff whose difference between the date when the door opening information is acquired and the expiration date is less than or equal to a predetermined threshold is specified and the specified foodstuff is illuminated. The food can be used without waste.

  In the food material position presentation method, the control command may include a command for illuminating the specified food material with light of a different color corresponding to the difference.

  According to this configuration, the control command includes a command for illuminating the identified food with light of a different color corresponding to the difference. Therefore, since the food is illuminated with light of different colors according to the difference between the date when the door opening information is acquired and the expiration date, it is possible to present to the user the food that is about to expire. .

  Further, in the food material position presentation method, when the door opening information is acquired, at least one food material used for a predetermined dish is specified from the food materials indicated by the food material information included in the inventory information. Then, a control command for illuminating the specified at least one food material may be generated.

  According to this configuration, when the door opening information is acquired, at least one food used for the predetermined dish is specified from the food indicated by the food information included in the inventory information, and at least the specified food is used. A control command for illuminating one food item is generated.

  Therefore, since at least one food used for the predetermined dish is specified and the specified at least one food is illuminated, the user can use at least the predetermined food when the refrigerator door is opened. One food can be easily selected.

  In the food material position presentation method, the control command is a command for controlling a light source provided in the refrigerator so that the specified food material position is irradiated with light of a color different from that of other food materials. May be included.

  According to this configuration, since the food to be used by the user is irradiated with light of a color different from that of other food, the user can easily find the food to be dealt with immediately among the food in the refrigerator. it can.

  Moreover, in the above-described food material position presentation method, the placing portion on which the food material of the refrigerator is placed is divided into a plurality of regions, and the food material placed in each of the divided regions is Illuminated by a plurality of light sources provided in the refrigerator, the control command is a command for controlling the plurality of light sources to irradiate the food on the region corresponding to the specified position of the food. May be included.

  According to this configuration, the placement unit on which the foodstuff of the refrigerator is placed is divided into a plurality of regions, and the foodstuffs placed in each of the plurality of divided regions are a plurality of materials provided in the refrigerator. Illuminated by a light source. The plurality of light sources are controlled so as to irradiate the food on the region corresponding to the specified position of the food.

  Accordingly, since the food placed on each of the plurality of divided regions of the placement unit on which the food of the refrigerator is placed is illuminated by the plurality of light sources, it is possible to easily irradiate the specific food with light. Can do.

  Further, in the above-described food material position presentation method, by acquiring an image in a warehouse imaged by an imaging device provided in the refrigerator, and estimating the position of the food material based on the acquired image, You may specify the position of a foodstuff.

  According to this structure, the image in the warehouse imaged with the imaging device provided in the refrigerator is acquired, and the position of the food is specified by estimating the position of the food based on the acquired image. Therefore, the position of the newly placed food can be easily specified.

  In the food position presentation method, the food placed in the refrigerator is photographed by an imaging device, and the position of the food in the refrigerator is estimated from the trajectory of the food placed in the photographed refrigerator. Thus, the position of the food material may be specified.

  According to this configuration, the ingredients to be put in the refrigerator are photographed by the imaging device, and the position of the ingredients in the refrigerator is estimated from the trajectory of the ingredients to be put in the photographed refrigerator. Therefore, the position of the newly placed food material can be easily specified.

  Further, in the above-described food position presentation method, by estimating the position of the food based on weight data detected by a weight sensor provided in a placement unit on which the food in the refrigerator is placed, You may specify the position of a foodstuff.

  According to this structure, the position of a foodstuff is pinpointed by estimating the position of a foodstuff based on the weight data detected by the weight sensor provided in the mounting part in which the foodstuff in a refrigerator is mounted. Therefore, the position of the newly placed food can be easily specified.

  In the food material position presentation method, the food material may be specified by reading a barcode, a color code, or a two-dimensional code attached to the food material with a reader.

  According to this configuration, since the foodstuff is specified by reading the barcode, color code or two-dimensional code attached to the foodstuff with the reading device, the newly placed foodstuff can be easily specified. .

  Further, in the above-described food material position presentation method, information on the food material stored in an RFID (Radio Frequency Identifier) tag attached to the food material is read by an RFID reader provided in the refrigerator. You may specify.

  According to this configuration, since the information about the food stored in the RFID tag attached to the food is read by the RFID reader provided in the refrigerator, the food is specified. Can be easily identified.

  Moreover, the refrigerator according to another aspect of the present disclosure is a refrigerator that presents the position of a food material, and specifies the food material in the refrigerator, and a specifying unit that specifies the position of the food material in the refrigerator; A storage unit for storing inventory information in which the food material information about the food specified by the specifying unit and the position information indicating the position of the food specified by the specifying unit are associated with each other, and the refrigerator door is opened. When the door opening detector detects that the door has been opened, and when the door is detected to be opened by the door opening detector, the user uses it based on the inventory information. A control unit that controls the lighting of the plurality of light sources so as to identify a food material to be illuminated and illuminate the identified food material.

  According to this structure, while the foodstuff in a refrigerator is specified, the position of the foodstuff in a refrigerator is specified. Inventory information in which the food material information related to the specified food material is associated with the position information indicating the position of the specified food material is stored. It is detected that the refrigerator door has been opened. When it is detected that the door is opened, the food material to be used by the user is specified based on the inventory information, and lighting of the plurality of light sources is controlled so as to illuminate the specified food material.

  Therefore, when the door of the refrigerator is opened, ingredients to be used by the user in the refrigerator are illuminated, so that the user can immediately deal with the ingredients in the refrigerator and use the ingredients without waste. be able to.

  Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiment is an example in which the present disclosure is embodied, and does not limit the technical scope of the present disclosure.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration of a food material position presentation system according to Embodiment 1 of the present disclosure. The food material position presentation system shown in FIG. 1 includes a server 1 and a refrigerator 2. The server 1 and the refrigerator 2 are connected to each other via a network 3 so that they can communicate with each other. The network 3 is, for example, the Internet.

  The server 1 includes a communication unit 101, a specification unit 102, an inventory information storage unit 103, and a control command generation unit 104.

  The communication unit 101 transmits various information to the refrigerator 2 and receives various information from the refrigerator 2. The communication unit 101 acquires a captured image captured by a camera (imaging device) provided in the refrigerator 2. That is, the communication unit 101 receives a captured image that is transmitted by the refrigerator 2 and images the interior. In addition, the communication unit 101 acquires door opening information transmitted by the refrigerator 2 and indicating that the door of the refrigerator 2 has been opened.

  The specifying unit 102 specifies the food placed on the refrigerator 2 and specifies the position of the food in the refrigerator. The specifying unit 102 includes a food name specifying unit 105 and a storage position specifying unit 106.

  The ingredient name identification unit 105 identifies the ingredient name from the captured image acquired by the communication unit 101. A bar code, a two-dimensional code, or a color code is attached to the surface of the food material. The two-dimensional code is, for example, a QR code (registered trademark). The color code is information represented by an array of a plurality of colors such as red, blue, and yellow. The ingredient name specifying unit 105 reads a barcode, a two-dimensional code, or a color code included in the captured image, and uses the ingredient name database associated with the read barcode information, the two-dimensional code information, or the color code information. Get from.

  The food name database (not shown) stores a table in which barcode information, two-dimensional code information or color code information and food names are associated with each other. Note that the server 1 may include a food name database, and the external server may include a food name database. In this way, the food name identification unit 105 identifies the food by reading the barcode, color code, or two-dimensional code attached to the food with the reading device (camera).

  The bar code, two-dimensional code, or color code may be printed on the package in advance. In addition, a bar code, a two-dimensional code, or a color code printed by a user is attached to a food, such as vegetables, that is not packaged or a food that is not printed with a bar code, a two-dimensional code, or a color code. . In the barcode, two-dimensional code, or color code printed by the user, information on the food, for example, the food name and the food manufacturing number are embedded.

  In addition, the name of the food material may include not only the name of the food material but also the type of food material, the product name of the food material, or the product number of the food material.

  In addition, the food name database may store a table in which a food package image captured by a camera is associated with a food name. In this case, the ingredient name specifying unit 105 performs image recognition and acquires the ingredient name associated with the package image included in the captured image from the ingredient name database.

  In addition, the ingredient name identification unit 105 may identify the ingredient by reading the information about the ingredient stored in the RFID (Radio Frequency Identifier) tag attached to the ingredient with the RFID reader provided in the refrigerator 2. Good. That is, the RFID tag may be attached to the food material. The RFID tag stores information related to food, for example, the name of the food and the production number of the food, and the RFID reader reads information related to the food from the RFID tag. Information about the read food is transmitted to the server 1.

  The storage position specifying unit 106 specifies the position of the food by estimating the position of the food in the refrigerator 2 based on the captured image acquired by the communication unit 101. For example, a tag is attached to the surface of the food, and the storage position specifying unit 106 detects the position of the tag from the captured image, the depth direction in the refrigerator 2 is the x axis, the width direction is the y axis, The coordinate position (x, y, z) of the foodstuff in the three-dimensional coordinate space with the height direction as the z-axis is estimated.

  The stock information storage unit 103 stores stock information in which the food material information related to the food specified by the food name specifying unit 105 and the position information indicating the position of the food specified by the storage position specifying unit 106 are associated with each other. The inventory information storage unit 103 may store model information indicating the model of the refrigerator 2 in association with the inventory information. The food material information may include not only the food material name but also a product number for uniquely identifying the food material.

  When the door opening information is acquired from the refrigerator 2, the control command generation unit 104 specifies a food to be used by the user based on the inventory information, and generates a control command for illuminating the specified food. The control command generation unit 104 specifies a food material to be used by the user, and acquires position information associated with the specified food material from the inventory information storage unit 103. The control command generation unit 104 acquires the arrangement state of the plurality of light sources of the refrigerator 2 from the model information of the refrigerator 2, specifies the light source corresponding to the position information acquired from the inventory information storage unit 103, and turns on the specified light source Generate control commands. The communication unit 101 transmits a control command to the refrigerator 2.

  Note that the control command generation unit 104 generates a control command for lighting a plurality of light sources when there are a plurality of ingredients to be used by the user. In addition, the control command generation unit 104 may specify the color of light emitted from the light source, and the control command may include the color of the light source to be lit.

  Further, when the control command generation unit 104 acquires the door opening information, the control command generation unit 104 acquires the expiration date of the food indicated by the food information included in the inventory information from the external server. Note that the expiration date may be the expiration date or the expiration date. In addition, the external server stores an expiration date database in which the ingredient name is associated with the expiration date of the ingredient. The control command generation unit 104 specifies a food whose difference between the date when the door opening information is acquired and the acquired expiration date is equal to or less than a predetermined threshold, and generates a control command for illuminating the specified food To do. The predetermined threshold is, for example, one week. That is, the control command generation unit 104 specifies a food that expires within one week among the food in the refrigerator 2.

  The server 1 may store the expiration date database. Further, when the food material is a fresh food such as vegetables or fruits, the expiration date database may store the general expiration date of the fresh food in association with the name of the fresh food. When the food is processed food, the expiration date database may store the production number of the processed food and the expiration date of the processed food in association with each other.

  The control command may include a command for illuminating the specified foodstuff with light of a different color corresponding to the difference. In the present embodiment, the control command generation unit 104 identifies a food whose difference between the date when the door opening information is acquired and the acquired expiration date is equal to or less than a predetermined threshold, The control command generation unit 104 is not particularly limited to this, and the control command generation unit 104 specifies a food material in which the difference between the date when the door opening information is acquired and the acquired expiration date is equal to or less than the first threshold, and specifies the first Among the ingredients that are less than or equal to the threshold value, the ingredients that have a difference that is less than or equal to the second threshold value that is smaller than the first threshold value may be specified. The first threshold is, for example, one week, and the second threshold is, for example, three days. Then, the control command generation unit 104 illuminates the food having a difference equal to or smaller than the first threshold and greater than the second threshold with light of the first color (for example, green), and the difference is equal to the second threshold. You may generate | occur | produce the control command which illuminates the foodstuff which is below a threshold value with the light of 2nd color (for example, red) different from 1st color.

  In addition, the control command generation unit 104 generates a control command when the door opening information is acquired from the refrigerator 2, but the present disclosure is not particularly limited thereto, and the refrigerator 2 exists in front of the refrigerator 2. The detected command is transmitted to the server 1, and the control command generator 104 may generate a control command when acquiring the detected information from the refrigerator 2.

  The refrigerator 2 includes a door open / close detection unit 201, an in-chamber information acquisition unit 202, a communication unit 203, a control unit 204, and a plurality of light sources 205.

  The door opening / closing detection unit 201 detects that the door provided on the front surface of the refrigerator 2 has been opened and also detects that the door has been closed.

  The chamber information acquisition unit 202 includes, for example, a camera, captures an image of the interior, and acquires a captured image. When the door opening / closing detection unit 201 detects that the door is closed, the interior information acquisition unit 202 captures an image of the interior and acquires a captured image.

  Here, in the first embodiment, a method for imaging the interior with the camera provided in the interior will be described.

  FIG. 2 is a schematic diagram for explaining a method of specifying the position of food in the warehouse using a camera provided in the warehouse in the first embodiment.

  A camera 401 and a camera 402 illustrated in FIG. 2 are examples of the in-compartment information acquisition unit 202. The camera 401 captures an image from above the shelf provided in the cabinet, and the camera 402 captures an image from the side of the shelf. Note that the camera 401 and the camera 402 may be provided for each shelf, and only one of the camera 401 and the camera 402 may be provided.

  A tag 502 is attached to the surface of the food material 501. The storage position specifying unit 106 recognizes the tag 502 included in the captured image acquired from the camera 401 and the camera 402, and estimates the coordinate position of the recognized tag 502 in the refrigerator.

  FIG. 3 is a schematic diagram for explaining a method of specifying the position of food in the warehouse by a camera provided outside the warehouse in the first embodiment.

  A camera 403 and a camera 404 illustrated in FIG. 3 are examples of the internal information acquisition unit 202. The camera 403 is provided on the upper side of the front surface of the refrigerator 2 with the door opened, and images the ingredients put into the refrigerator 2 from above, and the camera 402 is provided on the lower side of the front surface of the refrigerator 2 with the door opened. The foodstuff put in the refrigerator 2 is imaged from the downward direction.

  A tag 502 is attached to the surface of the food material 501. The storage position specifying unit 106 recognizes the tag 502 included in the captured image acquired from the camera 403 and the camera 404, and the food in the refrigerator 2 from the trajectory of the food 501 (tag 502) put in the captured refrigerator 2. The position of the foodstuff is specified by estimating the position of. That is, the storage position specifying unit 106 estimates the coordinate position of the tag 502 in the refrigerator by detecting what trajectory the tag 502 has drawn into the refrigerator 2.

  In the first embodiment, the server 1 includes the storage position specifying unit 106. However, the present disclosure is not particularly limited thereto, and the refrigerator 2 may include the storage position specifying unit 106. The position of the specified food material may be transmitted to the server 1.

  Moreover, in this Embodiment 1, the in-compartment information acquisition part 202 may be provided in the mounting part in which a foodstuff is mounted, and may also contain the weight sensor which detects a weight. The control command generation unit 104 may specify the position of the food by estimating the position of the food based on the weight data detected by the weight sensor. That is, since the weight of the position where the food is placed changes when the food is placed, the position where the food is placed can be estimated by detecting the position where the weight has changed.

  Moreover, in this Embodiment 1, the in-compartment information acquisition part 202 may be provided in the mounting part in which a foodstuff is mounted, and may also contain the temperature sensor which detects temperature. The control command generation unit 104 may specify the position of the food by estimating the position of the food based on the temperature data detected by the temperature sensor. That is, when the food is placed, the temperature at the position where the food is placed changes, and therefore the position where the food is placed can be estimated by detecting the position where the temperature has changed.

  The communication unit 203 transmits various information to the server 1 and receives various information from the server 1. The communication unit 203 transmits the captured image captured by the internal information acquisition unit 202 to the server 1. In addition, when the door opening / closing detection unit 201 detects that the door has been opened, the communication unit 203 transmits door opening information indicating that the door of the refrigerator 2 has been opened to the server 1. In addition, the communication unit 203 receives a control command transmitted by the server 1.

  The control unit 204 controls lighting of each of the light sources 205 based on the control command received by the communication unit 203.

  The plurality of light sources 205 are, for example, LEDs (Light Emitting Diodes) and emit light. The plurality of light sources 205 are embedded in an upper surface of a placement unit (shelf) on which foodstuffs provided in the refrigerator 2 are placed, and irradiate light on the placed foodstuffs from below. In addition, the plurality of light sources 205 may be embedded in the front surface of a storage pocket for storing food provided inside the door of the refrigerator 2.

  FIG. 4 is a schematic diagram for explaining an arrangement example of a plurality of light sources in the first embodiment.

  As shown in FIG. 4, the refrigerator 2 includes a placement unit (shelf) 601 for placing food materials in the cabinet. The refrigerator 2 includes a storage pocket 603 for storing foods inside the door. Note that the refrigerator 2 may include a plurality of placement units 601 and a plurality of storage pockets 603.

  The upper surface of the mounting portion 601 is divided into a plurality of regions in a lattice shape, and the light source 205 is disposed in each region. The front surface of the storage pocket 603 is divided into a plurality of regions in a striped manner, and the light source 205 is disposed in each region. The plurality of light sources 205 can be turned on independently. The plurality of light sources 205 can emit light of a plurality of colors, respectively.

  In this way, the shelf on which the foodstuff of the refrigerator 2 is placed is divided into a plurality of areas, and the foodstuff placed in each of the divided areas is illuminated by each of the plurality of light sources 205. The control command includes a command for controlling the plurality of light sources 205 so as to irradiate the food on the region corresponding to the specified position of the food.

  In the first embodiment, the plurality of light sources 205 irradiate the food material from below. However, the present disclosure is not particularly limited to this, and the plurality of light sources 205 irradiates the food material from above. May be. In this case, the refrigerator 2 includes a first placement portion and a second placement portion disposed below the first placement portion, and the lower surface of the first placement portion has a lattice shape. It is divided into a plurality of areas, and a light source 205 is arranged in each area. The plurality of light sources 205 arranged on the lower surface of the first placement unit irradiates light toward the upper surface of the second placement unit. Thereby, light is irradiated to the foodstuff mounted in the upper surface of the 2nd mounting part. At this time, the control command includes a command for controlling the light source 205 so as to irradiate the specified food material with light. In addition, the control command may include a command for controlling the light source 205 so that the position of the specified food material is irradiated with light of a color different from the position of the other food material.

  The plurality of light sources 205 may be disposed inside the storage pocket 603 instead of being disposed on the front surface of the storage pocket 603.

  Moreover, the refrigerator 2 may be provided with one light source which can move the lower surface of a 1st mounting part. In this case, the control unit 204 moves the light source above the food placed on the upper surface of the second placement unit, and irradiates the food placed on the upper surface of the second placement unit with light. Also good.

  Next, the operation of the food material position presentation system in the first embodiment will be described.

  FIG. 5 is a flowchart for explaining the operation of recording the inventory information of the food material position presentation system in the first embodiment.

  First, in step S <b> 1, the door opening / closing detection unit 201 of the refrigerator 2 detects that the door provided on the front surface of the refrigerator 2 is closed.

  Next, in step S2, the in-compartment information acquisition unit 202 activates a camera provided in the interior.

  Next, in step S3, the in-compartment information acquisition unit 202 captures an image of the interior. In addition, when the some camera is provided for every shelf, the image in a warehouse is acquired from each camera.

  Next, in step S4, the in-compartment information acquisition unit 202 ends imaging with the camera provided in the interior.

  Next, in step S <b> 5, the communication unit 203 transmits the captured image obtained by capturing the interior acquired by the interior information acquisition unit 202 to the server 1. Note that the captured image may be a still image or a moving image (a plurality of still images). Moreover, the communication part 203 may add the apparatus identification information for identifying the refrigerator 2, or the user identification information for identifying the user who uses the refrigerator 2 to a captured image, and may transmit.

  Next, in step S <b> 6, the communication unit 101 of the server 1 receives the captured image transmitted by the refrigerator 2.

  Next, in step S <b> 7, the ingredient name specifying unit 105 specifies the ingredient name of the newly placed ingredient from the captured image acquired by the communication unit 101. Note that whether or not the food is newly placed can be determined by comparing the captured image acquired this time with the captured image acquired last time. A color code is attached to the surface of the food. The ingredient name specifying unit 105 reads the color code included in the captured image, and acquires the ingredient name associated with the read color code information from the ingredient name database.

  At this time, the ingredient name specifying unit 105 may specify the ingredient name of the ingredient extracted from the inside of the captured image acquired by the communication unit 101. In addition, it can be judged whether it is the food taken out from the inside by comparing the captured image acquired this time with the captured image acquired last time.

  Next, in step S <b> 8, the storage position specifying unit 106 specifies the storage position of the food newly placed in the refrigerator 2 based on the captured image acquired by the communication unit 101. By imaging one shelf with at least two cameras, it can be roughly estimated at which position in the refrigerator 2 the food is present.

  At this time, the storage position specifying unit 106 may specify the storage position of the food taken out from the inside based on the captured image acquired by the communication unit 101.

  Next, in step S <b> 9, the inventory information storage unit 103 has the newly placed food name specified by the food name specifying unit 105 and the newly placed food name specified by the storage position specifying unit 106. Stock information that associates the storage position of the food is stored. At this time, the stock information storage unit 103 stores the ingredient name of the ingredient taken out from the inside specified by the ingredient name specifying part 105 and the storage position of the ingredient taken out from the inside specified by the storage position specifying part 106. The inventory information that is associated with may be deleted.

  In addition, the ingredient name specifying unit 105 does not specify the ingredient name of the ingredient newly placed in the warehouse and the ingredient name of the ingredient taken out from the ingredient, but all the ingredients placed in the warehouse. Ingredient names of the ingredients may be specified. Further, the storage position specifying unit 106 does not specify the storage position of the food newly placed in the warehouse and the storage position of the food taken out from the warehouse, but all of the food ingredients placed in the warehouse. You may specify the storage position of the foodstuff. The stock information storage unit 103 stores stock information that associates the names of all the ingredients specified by the ingredient name specifying unit 105 with the storage positions of all the ingredients specified by the storage position specifying unit 106. . As a result, the inventory information stored in the inventory information storage unit 103 is updated.

  FIG. 6 is a flowchart for explaining an operation of illuminating a specific food in the food position presentation system according to the first embodiment.

  First, in step S <b> 21, the door opening / closing detection unit 201 of the refrigerator 2 detects that the door provided on the front surface of the refrigerator 2 has been opened.

  Next, in step S <b> 22, the communication unit 203 transmits door opening information indicating that the door of the refrigerator 2 has been opened to the server 1.

  Next, in step S <b> 23, the communication unit 101 of the server 1 receives the door opening information transmitted by the refrigerator 2.

  Next, in step S <b> 24, the control command generation unit 104 determines whether there is any food in the refrigerator 2 that should be used by the user. At this time, the control command generation unit 104 acquires the expiration date of the ingredient indicated by the ingredient name included in the inventory information stored in the inventory information storage unit 103 from the external server. Then, the control command generation unit 104 determines whether or not the difference between the date when the door opening information is acquired and the expiration date acquired from the external server is equal to or less than a predetermined threshold. The control command generation unit 104 determines that there is a food to be used by the user when the difference is equal to or less than a predetermined threshold, and determines that there is no food to be used by the user when the difference is greater than the predetermined threshold. If it is determined that there is no food to be used by the user (NO in step S24), the process ends.

  On the other hand, when it is determined that there is a food to be used by the user (YES in step S24), in step S25, the control command generation unit 104 generates a control command for illuminating the food to be used by the user. At this time, the control command generation unit 104 acquires position information associated with the food to be used by the user from the inventory information storage unit 103. Then, the control command generation unit 104 acquires the arrangement state of the plurality of light sources of the refrigerator 2 from the model information of the refrigerator 2, specifies the light source corresponding to the position information acquired from the inventory information storage unit 103, and selects the specified light source. Generate a control command to light up.

  Next, in step S <b> 26, the communication unit 101 transmits the control command generated by the control command generation unit 104 to the refrigerator 2.

  Next, in step S <b> 27, the communication unit 203 of the refrigerator 2 receives the control command transmitted by the server 1.

  Next, in step S <b> 28, the control unit 204 controls lighting of the plurality of light sources 205 based on the control command received by the communication unit 203. That is, the control command includes information about which light source among the plurality of light sources 205 is turned on. The control unit 204 turns on the light source indicated by the control command. The control command may include information about the color that turns on the light source. In this case, the control unit 204 turns on the light source indicated by the control command in the color indicated by the control command.

  FIG. 7 is a schematic diagram for explaining an example of illuminating the food according to the expiration date in the first embodiment.

  As shown in FIG. 7, a food 701 and a food 702 are placed on the refrigerator 2. The food 701 has one day remaining until the expiration date, and the food 702 has six days remaining until the expiration date.

  In this case, the control command generation unit 104 specifies a food material for which the difference between the date when the door opening information is acquired and the acquired expiration date is equal to or less than the first threshold. And control command generation part 104 specifies a foodstuff whose difference is below the 2nd threshold smaller than the 1st threshold among foodstuffs below the specified 1st threshold. The first threshold is, for example, one week, and the second threshold is, for example, three days. Then, the control command generation unit 104 illuminates the food having a difference equal to or smaller than the first threshold and greater than the second threshold with light of the first color (for example, green), and the difference is equal to the second threshold. A control command for illuminating a food material that is equal to or lower than the threshold with light of a second color (for example, red) different from the first color is generated.

  Therefore, the food 701 is illuminated with red light 703 because it is one day remaining until the expiration date, and the food 702 is illuminated with green light 704 because it is six days remaining until the expiration date.

  Thus, the user can confirm the expiration date of the food by confirming the color of the illuminated light.

  In addition, in this Embodiment 1, although the foodstuff is illuminated according to an expiration date, this indication is not specifically limited to this, You may illuminate the foodstuff which should be used preferentially. For example, the food may be illuminated according to the frequency of use, and the use of the less frequently used food can be promoted by illuminating the less frequently used food. In this case, a period in which the food is placed without being taken out is stored in the inventory information storage unit 103, and it is determined whether or not the period in which the food is placed without being taken out is equal to or greater than a predetermined threshold. .

  Also, for example, the ingredients may be illuminated according to the date on which the ingredients can be eaten most deliciously. The control command generation unit 104 specifies a food whose date when the door opening information is acquired is the date that can be most deliciously eaten, and generates a control command that illuminates the specified food with blue light.

  In addition, when there is a food that has passed the expiration date, the control command generation unit 104 may generate a control command that illuminates the food that has passed the expiration date with red flashing light.

  In addition, the inventory information storage unit 103 may store the date when the food is placed in the refrigerator, and the control command generation unit 104 specifies the food that has passed a predetermined period after being placed in the refrigerator. Then, a control command for illuminating the specified food material may be generated.

  Furthermore, in this Embodiment 1, although the foodstuff is illuminated according to an expiration date, this indication is not specifically limited to this, You may light a foodstuff according to the recipe of the cooking which a user makes. Hereinafter, the modification of this Embodiment 1 which illuminates a foodstuff according to the recipe of the cooking which a user makes is demonstrated.

  FIG. 8 is a diagram illustrating a configuration of a food material position presentation system according to a modification of the first embodiment of the present disclosure. The food material position presentation system shown in FIG. 8 includes a server 1, a refrigerator 2, and an information terminal 4. In the food position presentation system shown in FIG. 8, the same components as those in the food position presentation system shown in FIG.

  The information terminal 4 is, for example, a smartphone, a tablet computer, or a personal computer, and is connected to the server 1 via the network 3 so that they can communicate with each other.

  The information terminal 4 displays a plurality of cooking recipes in a selectable manner. In addition, the information regarding the recipe of a some dish is received from the external server different from the server 1 or the server 1. FIG. Further, the information terminal 4 accepts user selections for the displayed recipes. The information terminal 4 transmits recipe information indicating the recipe selected by the user to the server 1.

  The communication unit 101 of the server 1 receives the recipe information transmitted by the information terminal 4.

  When the door opening information is acquired from the refrigerator 2, the control command generation unit 104 specifies a food to be used by the user based on the inventory information, and generates a control command for illuminating the specified food.

  Here, when acquiring the door opening information, the control command generation unit 104 selects at least one ingredient used for a predetermined dish from among the ingredients indicated by the ingredient information (the ingredient name) included in the inventory information. A control command for identifying and illuminating the identified at least one ingredient is generated. The communication unit 101 transmits the control command generated by the control command generation unit 104 to the refrigerator 2.

  Note that the recipe information may include at least one ingredient name used in the recipe. In this case, the control command generation unit 104 identifies at least one ingredient included in the recipe information from among the ingredients indicated by the ingredient information (food name) included in the inventory information.

  Further, the server 1 may store the recipe identification information for identifying the recipe and the ingredients used for the recipe in association with each other, and the recipe information may include recipe identification information for identifying the recipe. In this case, the control command generation unit 104 specifies at least one food material associated with the recipe identification information included in the recipe information from the food materials indicated by the food material information (food material name) included in the inventory information.

  FIG. 9 is a schematic diagram for explaining an example of illuminating ingredients according to a cooking recipe created by the user in the modification of the first embodiment.

  As shown in FIG. 9, a foodstuff 801, a foodstuff 802, and a foodstuff 803 are placed in the refrigerator 2. The ingredients 801 to 803 are ingredients used for the recipe of the same dish.

  In this case, the information terminal 4 transmits recipe information indicating the recipe selected by the user to the server 1. When receiving the door opening information after receiving the recipe information, the control command generation unit 104 uses the recipe indicated by the recipe information from the ingredients indicated by the ingredient information (food name) included in the inventory information. Identifying at least one ingredient to be generated and generating a control command for illuminating the identified at least one ingredient.

Since the ingredients 801 to 803 are ingredients used for the recipe of the same dish, the ingredients 801 to 803 are irradiated with light 804, 805, and 806 of the same color, respectively. When making a dish, it is possible to easily identify the ingredients to be used in a predetermined dish by checking the ingredients to be illuminated.

  In addition, in the modification of this Embodiment 1, although the light of the same color is irradiated with respect to the foodstuff used for the recipe of the same cooking, this indication is not limited to this in particular, It is in a cooking procedure. Depending on the cooking procedure, the order of lighting may be changed or light of a different color may be irradiated.

  Moreover, the refrigerator 2 of this Embodiment 1 receives the selection by the user of the mode which shows a user the expiration date of a foodstuff, and the mode which presents a foodstuff according to a predetermined dish to a user, and is in the selected mode. You may switch.

(Embodiment 2)
Then, the refrigerator in Embodiment 2 of this indication is explained. The refrigerator in the second embodiment has the functions of the refrigerator 2 and the server 1 included in the food material position presentation system in the first embodiment.

  FIG. 10 is a diagram illustrating a configuration of the refrigerator according to the second embodiment of the present disclosure. The refrigerator 21 shown in FIG. 10 includes a door opening / closing detection unit 211, an in-chamber information acquisition unit 212, a specifying unit 213, an inventory information storage unit 214, a control unit 215, and a plurality of light sources 216.

  The configuration of the door opening / closing detection unit 211 is the same as the configuration of the door opening / closing detection unit 201 shown in FIG. The configuration of the internal information acquisition unit 212 is the same as the configuration of the internal information acquisition unit 202 shown in FIG.

  The identification unit 213 identifies the food placed on the refrigerator 21 and identifies the position of the food in the refrigerator. The specifying unit 213 includes a food name specifying unit 217 and a storage position specifying unit 218.

  The food material name specifying unit 217 specifies the food material name from the captured image acquired by the internal information acquisition unit 212. The configuration of the ingredient name specifying unit 217 is the same as that of the ingredient name specifying unit 105 shown in FIG.

  The storage position specifying unit 218 specifies the position of the food by estimating the position of the food in the refrigerator 21 based on the captured image acquired by the internal information acquisition unit 212. The configuration of the storage position specifying unit 218 is the same as the configuration of the storage position specifying unit 106 shown in FIG.

  The configuration of the inventory information storage unit 214 is the same as that of the inventory information storage unit 103 shown in FIG.

  When the door opening / closing detection unit 211 detects that the door is opened, the control unit 215 identifies a food to be used by the user based on the inventory information, and illuminates the identified food. The lighting of the light source 216 is controlled.

  The control unit 215 specifies a food material to be used by the user, and acquires position information associated with the specified food material from the inventory information storage unit 214. The control part 215 acquires the arrangement | positioning state of the some light source 216 of the refrigerator 21 memorize | stored previously, specifies the light source corresponding to the positional information acquired from the inventory information storage part 214, and makes the specified light source light.

  FIG. 11 is a flowchart for explaining the operation of recording the inventory information of the refrigerator in the second embodiment.

  The processing of step S41 to step S44 is the same as the processing of step S1 to step S4 shown in FIG.

  Next, in step S45, the ingredient name specifying unit 217 specifies the ingredient name of the newly placed ingredient from the captured image acquired by the internal information acquisition unit 212. Note that whether or not the food is newly placed can be determined by comparing the captured image acquired this time with the captured image acquired last time. A color code is attached to the surface of the food. The ingredient name specifying unit 217 reads the color code included in the captured image, and acquires the ingredient name associated with the read color code information from the ingredient name database.

  At this time, the ingredient name specifying unit 217 may specify the ingredient name of the ingredient extracted from the inside from the captured image acquired by the inside information acquiring unit 212. In addition, it can be judged whether it is the food taken out from the inside by comparing the captured image acquired this time with the captured image acquired last time.

  Next, in step S <b> 46, the storage position specifying unit 218 specifies the storage position of the food newly placed in the refrigerator 21 based on the captured image acquired by the internal information acquisition unit 212. By imaging one shelf with at least two cameras, it is possible to roughly estimate at which position in the refrigerator 21 the food is present.

  At this time, even if the storage position specifying unit 218 specifies the position of the food by estimating the storage position of the food taken out from the inside based on the captured image acquired by the inside information acquisition unit 212. Good.

  The process of step S47 is the same as the process of step S9 shown in FIG.

  In addition, the ingredient name specifying unit 217 does not specify the ingredient name of the ingredient newly placed in the warehouse and the ingredient name of the ingredient taken out from the interior, but all the ingredients placed in the warehouse. Ingredient names of the ingredients may be specified. In addition, the storage position specifying unit 218 does not specify the storage position of the food newly placed in the warehouse and the storage position of the food taken out from the warehouse, but all of the food ingredients placed in the warehouse. You may specify the storage position of the foodstuff. The stock information storage unit 214 stores stock information in which the names of all the ingredients specified by the ingredient name specifying unit 217 and the storage positions of all the ingredients specified by the storage position specifying unit 218 are associated. . As a result, the inventory information stored in the inventory information storage unit 214 is updated.

  FIG. 12 is a flowchart for explaining an operation of illuminating a specific food in the refrigerator in the second embodiment.

  The process of step S51 is the same as the process of step S21 shown in FIG.

  Next, in step S <b> 52, the control unit 215 determines whether there is any food in the refrigerator 21 that should be used by the user. At this time, the control unit 215 obtains the expiration date of the food indicated by the name of the food contained in the stock information stored in the stock information storage unit 214 from the external server. Then, the control unit 215 determines whether or not the difference between the date when the door opening information is acquired and the expiration date acquired from the external server is equal to or less than a predetermined threshold. When the difference is equal to or smaller than the predetermined threshold, the control unit 215 determines that there is a food to be used by the user. When the difference is larger than the predetermined threshold, the control unit 215 determines that there is no food to be used by the user. Here, if it is determined that there is no food to be used by the user (NO in step S52), the process ends.

  On the other hand, when it is determined that there are ingredients to be used by the user (YES in step S52), in step S53, the control unit 215 turns on the plurality of light sources 216 to illuminate the ingredients to be used by the user. Control. At this time, the control unit 215 acquires position information associated with the food to be used by the user from the inventory information storage unit 214. And the control part 215 acquires the arrangement state of the several light source 216 of the refrigerator 21, specifies the light source corresponding to the positional information acquired from the inventory information storage part 214, and makes the specified light source light.

  Ingredient position presenting method and refrigerator according to the present disclosure can immediately cope with the ingredients in the refrigerator, can use the ingredients without waste, and present the ingredients position presenting method in the refrigerator And useful as a refrigerator.

DESCRIPTION OF SYMBOLS 1 Server 2,21 Refrigerator 3 Network 4 Information terminal 101 Communication part 102 Identification part 103 Inventory information storage part 104 Control command generation part 105 Food name identification part 106 Storage position specification part 201 Door opening / closing detection part 202 In-chamber information acquisition part 203 Communication Unit 204 control unit 205 plural light sources 211 door opening / closing detection unit 212 internal information acquisition unit 213 identification unit 214 inventory information storage unit 215 control unit 216 plural light sources 217 food name identification unit 218 storage position identification unit

Claims (15)

A method for presenting food ingredients using a computer,
When a plurality of food is placed on the placing portion provided in the refrigerator, to identify the previous SL plurality of ingredients, and, a plurality of regions, each of said plurality of food is included in the mounting section Identify which of them is on top ,
And ingredient information about the identified plurality of ingredients, each of the previous SL multiple food stores position information and stock information that associates indicating which is placed over one of the plurality of regions ,
Obtaining door opening information indicating that the door of the refrigerator has been opened;
When acquiring the door opening information, based on the inventory information, the user specifies a food material to be used from among the plurality of food materials, and the food material to be used by the user specified among the plurality of regions is an area that is placed to generate a control command. Used to illumination by one or more light sources provided in the refrigerator,
Sending the generated control command to the refrigerator;
Ingredient position presentation method. When the door opening information is acquired, the expiration date of the ingredient indicated by the ingredient information included in the inventory information is acquired,
The difference between the date on which the door opening information is acquired and the date on which the acquired expiration date is acquired specifies a food that is equal to or less than a predetermined threshold, and generates a control command for illuminating the specified food.
The food material position presentation method according to claim 1. The control command includes a command for illuminating the identified food material with light of a different color according to the difference,
The food material position presentation method according to claim 2. When the door opening information is acquired, at least one ingredient used for a predetermined dish is identified from among the ingredients indicated by the ingredient information included in the inventory information, and the identified at least one ingredient is Generate control commands for lighting,
The food material position presentation method according to claim 1. The control command includes a command for controlling a light source provided in the refrigerator so as to irradiate the specified position of the food with light of a color different from the position of the other food.
The food material position presentation method according to any one of claims 1 to 4. Obtain the image in the warehouse imaged by the imaging device provided in the refrigerator,
By estimating the position of the food based on the acquired image, the position of the food is specified.
The foodstuff position presentation method according to any one of claims 1 to 5 . The food material put into the refrigerator is photographed by an imaging device, and the position of the food material is specified by estimating the position of the food material in the refrigerator from the trajectory of the food material put into the photographed refrigerator. ,
The foodstuff position presentation method according to any one of claims 1 to 5 . The position of the food is specified by estimating the position of the food based on weight data detected by a weight sensor provided in a placement unit on which the food in the refrigerator is placed.
The foodstuff position presentation method according to any one of claims 1 to 5 . The bar code, color code or two-dimensional code attached to the food material is read by a reader to identify the food material.
The foodstuff position presentation method according to any one of claims 1 to 8 . Information on the food stored in an RFID (Radio Frequency Identifier) tag attached to the food is specified by the RFID reader provided in the refrigerator to identify the food,
The foodstuff position presentation method according to any one of claims 1 to 8 .   The plurality of regions are regions in which the placement unit is divided into a lattice shape.
  The foodstuff position presentation method according to any one of claims 1 to 10.   The control command includes control not to illuminate an area where food other than the food to be used by the user among the plurality of food is placed.
  The foodstuff position presentation method according to any one of claims 1 to 11.   The mounting portion is plate-shaped,
  The foodstuff position presentation method according to any one of claims 1 to 12.   The position information indicates coordinate positions of the plurality of ingredients in the refrigerator,
  The region where the ingredients to be used by the user are placed is specified based on the coordinate position.
  The food material position presentation method according to any one of claims 1 to 13. When a plurality of food is placed on the placing portion provided in the refrigerator, to identify the previous SL plurality of ingredients, and, a plurality of regions, each of said plurality of food is included in the mounting section A specific part for identifying which of the above is mounted ,
Stock associating the position information indicating whether the food information related to the plurality of ingredients specified by the specifying unit, the respective front Symbol plurality of food is placed on any of the plurality of regions A storage unit for storing information;
A door opening detector for detecting that the refrigerator door is opened;
One or more light sources that emit light;
When the door opening detection unit detects that the door is opened, based on the inventory information, the food to be used by the user is identified from the plurality of foods, and the A control unit that controls lighting of the one or more light sources so as to illuminate an area where foodstuffs to be used by the identified user are placed ;
Refrigerator.

Images