JPWO2018016054A1 - Refrigerator system - Google Patents

Abstract

  Provided is a refrigerator system in which information that cannot be understood only from a storage room image can be easily grasped along with the situation of the storage room, and a user can easily input information that cannot be understood from only the storage room image. For this reason, in the refrigerator system, a refrigerator main body having a camera that images the inside of a storage room for storing food and outputs a storage room image, and a terminal device that has a terminal display unit and is communicable with the refrigerator main body, A storage room image storage unit that stores a storage room image output from the camera, a food information storage unit that stores food information about food stored in the storage room, and one of the food information stored in the food information storage unit A food information output unit that selects and outputs all or part of the food, and a food information addition unit that adds the food information output by the food information output unit to the storage room image stored in the storage room image storage unit. The terminal display unit superimposes the food information added by the food information adding unit on the storage room image.

Description

  The present invention relates to a refrigerator system.

  In a conventional refrigerator system, a refrigerator main body constituted by an inner box and an outer box and having an open front surface, a storage room configured by partitioning the refrigerator main body, a heat insulating door covering the storage room, and a storage room or a heat insulating door And a camera that images the inside of the storage room, and is capable of confirming the food status in the refrigerator imaged by the camera using a display terminal or the like (see, for example, Patent Document 1). . Moreover, in what was described in this patent document 1, a user can input memo information on an image by tracing on the image in the refrigerator output to the display terminal, and can reflect this.

Japanese Unexamined Patent Publication No. 2015-072109

  However, in the conventional refrigerator system disclosed in Patent Document 1, the situation in the refrigerator can be confirmed without opening the door, and information that cannot be understood only from the image (storage room image) in the storage room of the refrigerator is recorded. Although it can be input and reflected as information, it is necessary for the user to input information that cannot be understood only from the storage room image by tracing the image, which is very troublesome.

  The present invention has been made to solve such a problem, and information that cannot be understood only from the storage room image can be easily grasped together with the situation of the storage room, and information that cannot be understood only from the storage room image. Thus, a refrigerator system can be obtained in which the user can easily perform input.

  The refrigerator system according to the present invention includes a refrigerator body having a storage room for storing food, a camera for photographing the inside of the storage room and outputting a storage room image, a terminal display unit, and the refrigerator A terminal device provided to be communicable with the main body, a storage room image storage unit that stores a storage room image output from the camera, and a food information storage unit that stores food information about food stored in the storage room; The food information output unit includes a food information output unit that selects and outputs part or all of the food information stored in the food information storage unit, and a storage room image stored in the storage room image storage unit. A food information adding unit for adding the output food information, and the terminal display unit displays the food information added by the food information adding unit on the storage room image.

  In the refrigerator system according to the present invention, information that cannot be understood only from the storage room image can be easily grasped together with the situation of the storage room, and the user can easily input information that cannot be understood from only the storage room image. There is an effect that can be.

It is a front view of the refrigerator with which the refrigerator system which concerns on Embodiment 1 of this invention is provided. It is a figure which shows typically the whole structure of the refrigerator system which concerns on Embodiment 1 of this invention, and the structure of the refrigerator compartment of a refrigerator. It is a figure which shows an example of the display screen of the terminal device with which the refrigerator system which concerns on Embodiment 1 of this invention is provided. It is a figure which shows an example of the display screen of the terminal device with which the refrigerator system which concerns on Embodiment 1 of this invention is provided. It is a figure which shows an example of the display screen of the terminal device with which the refrigerator system which concerns on Embodiment 1 of this invention is provided. It is a figure which shows an example of the display screen of the terminal device with which the refrigerator system which concerns on Embodiment 1 of this invention is provided. It is a figure which shows an example of the display screen of the terminal device with which the refrigerator system which concerns on Embodiment 1 of this invention is provided. It is a flowchart which shows operation | movement of the refrigerator system which concerns on Embodiment 1 of this invention. It is a figure which shows typically the whole structure of the refrigerator system which concerns on Embodiment 2 of this invention, and the structure of the refrigerator compartment of a refrigerator. It is a figure which shows typically the whole structure of the refrigerator system which concerns on Embodiment 3 of this invention, and the structure of the refrigerator compartment of a refrigerator. It is a figure which shows typically the whole structure of the refrigerator system which concerns on Embodiment 4 of this invention, and the structure of the refrigerator compartment of a refrigerator.

  DESCRIPTION OF EMBODIMENTS Embodiments of the present invention will be described with reference to the accompanying drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and overlapping descriptions are simplified or omitted as appropriate. The present invention is not limited to the following embodiments, and various modifications can be made without departing from the spirit of the present invention.

Embodiment 1 FIG.
1 to 8 relate to Embodiment 1 of the present invention, FIG. 1 is a front view of a refrigerator provided in the refrigerator system, and FIG. 2 is a schematic diagram showing the overall configuration of the refrigerator system and the refrigerator compartment. FIGS. 3 to 7 are diagrams illustrating an example of a display screen of a terminal device included in the refrigerator system, and FIG. 8 is a flowchart illustrating the operation of the refrigerator system.

  The refrigerator system according to Embodiment 1 of the present invention includes a refrigerator 1000. Refrigerator 1000 is a refrigerator body in the refrigerator system according to Embodiment 1 of the present invention. In the first embodiment, the refrigerator 1000 includes a refrigerating room 100, an ice making room 200, a switching room 300, a freezing room 400, and a vegetable room 500. The refrigerator compartment 100, the ice making room 200, the switching room 300, the freezing room 400, and the vegetable room 500 are storage rooms for storing food.

  As shown in FIG. 1, the refrigerator room 100, the ice making room 200, the switching room 300, the freezer room 400, and the vegetable room 500 are arranged in this order from the top. The ice making chamber 200 and the switching chamber 300 are arranged side by side at the same vertical position. On the front face of the refrigerator compartment 100, a refrigerator compartment door 101 for opening and closing the refrigerator compartment 100 is provided. The refrigerator compartment door 101 is an example of a door that opens and closes a storage compartment. Moreover, the ice making room 200, the switching room 300, the freezer room 400, and the vegetable room 500 are comprised so that it can pull out to the near side of the refrigerator 1000 with the door provided in each front.

  An operation panel 1 is provided on the front surface, that is, the outer surface side of the refrigerator compartment door 101. The operation panel 1 includes a panel display unit 1a. The panel display unit 1a is a main body display unit capable of displaying information. The panel display unit 1a can display, for example, in-chamber information such as the set temperature of each storage room and the current temperature. The panel display unit 1a includes a liquid crystal display, for example. The operation panel 1 includes operation units such as a touch panel, buttons, and switches. The user can input necessary information by operating the operation unit of the operation panel 1. In addition, the installation position of the operation panel 1 is not restricted to the door of the refrigerator compartment 100, The door of another storeroom, the side surface of the refrigerator 1000, etc. may be sufficient.

  As shown in FIG. 2, the refrigerator compartment 100 is closed on the front side (the left side in the figure) by a refrigerator compartment door 101. The cross-sectional view shown in FIG. 2 is taken along a cross-section A-A ′ in FIG. 1. A plurality of refrigerating room shelf plates 102 are provided inside the refrigerating room 100. The inside of the refrigerator compartment 100 is partitioned into a plurality of spaces (shelves) in the vertical direction by these refrigerator compartment shelf plates 102. The space below the lowermost refrigerator compartment shelf 102 is a chilled chamber 110. A chilled case 111 is installed inside the chilled chamber 110. The chilled case 111 can be pulled forward along a guide member (not shown) such as a rail. Further, a cooling air passage 1010 is formed on the rear side (right side in the drawing) of the refrigerator compartment 100.

  On the inner surface of the refrigerator compartment door 101, the in-compartment photographing apparatus 2 is installed. The in-compartment photographing device 2 is a camera that photographs the inside of a storage room (here, the refrigerator compartment 100) and outputs a storage room image. The in-compartment photographing apparatus 2 has a visual field range from the ceiling surface inside the refrigerator compartment 100 to the chilled room 110. In other words, the storage room image captured and output by the in-compartment photographing apparatus 2 can photograph the inside of the refrigerating room 100 from the same viewpoint as the user viewing the inside of the refrigerating room 100 from the refrigerating room door 101 side.

  For example, the in-compartment photographing apparatus 2 photographs the inside of the refrigerator compartment 100 when the refrigerator compartment door 101 is opened and closed. This is because when the refrigerator compartment door 101 is opened and closed, food in the refrigerator compartment 100 is taken in and out, and the storage state in the refrigerator compartment 100 may change. The refrigerator 1000 includes a sensor that can detect opening and closing of the door. This sensor is, for example, a general magnet type sensor. That is, for example, the proximity of the magnet embedded in the refrigerator compartment door 101 is detected by a pair of reed switches installed on the refrigerator 1000 main body side. For example, the in-compartment photographing apparatus 2 performs photographing while the inside of the refrigerator compartment 100 is illuminated after detecting that the opened refrigerator compartment door 101 is closed.

  Note that the in-compartment photographing apparatus 2 is not limited to the inner surface of the refrigerator compartment door 101, and may be installed anywhere as long as it can photograph the stored items such as food placed on the refrigerator compartment shelf plate 102. Further, the number of in-compartment photographing apparatuses 2 is not limited to one, and a plurality of in-compartment photographing apparatuses 2 may be installed. By installing a plurality of in-compartment photographing apparatuses 2, it is possible to suppress blind spots caused by the visual field being blocked by food stored in the refrigerator compartment 100.

  The refrigerator 1000 includes a control board 1001. A control board 1001 is accommodated in the upper part of the refrigerator 1000, for example, on the back side. The control board 1001 is provided with a control circuit and the like for performing various controls necessary for the operation of the refrigerator 1000. The control board 1001 includes, for example, a microcomputer, and includes a processor and a memory. The control board 1001 controls the refrigerator 1000 by executing a preset process when the processor executes a program stored in the memory.

  The control board 1001 includes a storage room image management unit 3, a food information addition unit 4, and a wireless communication unit 5. The functions of these units are realized, for example, by executing a preset process by the processor executing a program stored in the memory in the microcomputer of the control board 1001.

  The storage room image management unit 3 is a storage room image storage unit that stores the storage room image output from the internal photographing apparatus 2. As described above, when opening / closing of the refrigerator compartment door 101 is detected, the in-compartment photographing apparatus 2 photographs the entire inside of the refrigerator compartment 100. The in-compartment imaging device 2 outputs the entire image (storage room image) in the refrigerated room 100 taken to the storage room image management unit 3. The storage room image output from the in-compartment photographing apparatus 2 is input to the storage room image management unit 3. Therefore, the storage room image management unit 3 outputs the storage room image management unit 3 from the in-chamber photographing device 2 every time the refrigerating room door 101 is opened and closed (that is, every time the storage state in the refrigerating room 100 may change). A storage room image is input. Thus, the latest storage room image is always input to the storage room image management unit 3.

  The storage room image management unit 3 stores the input storage room image. At this time, the storage room image management unit 3 stores the time when the storage room image is input to the storage room image management unit 3 in association with the storage room image as shooting time information. Hereinafter, the photographing time information is also referred to as supplementary information of the storage room image. Then, the storage room image management unit 3 stores the storage room images in the order of the shooting time according to the shooting time information. In this way, the storage room image management unit 3 manages the storage room images photographed by the in-compartment photographing device 2. Note that the shooting time information includes information on the date (month or date) when the image was taken.

  The refrigerator system according to Embodiment 1 of the present invention includes a user terminal 9. The user terminal 9 is a terminal device provided to be able to communicate with the refrigerator 1000 (refrigerator main body). Specifically, the user terminal 9 is, for example, a PC, a smartphone, a tablet terminal, or the like.

  In order to realize communication between the refrigerator 1000 and the user terminal 9, the wireless communication unit 5 is provided in the refrigerator 1000. The wireless communication unit 5 performs mutual communication of information between the refrigerator 1000 and the user terminal 9 using, for example, a well-known wireless communication technique. In this way, the refrigerator 1000 and the user terminal 9 inside or outside the house can communicate with each other via one or both of a router and the Internet (not shown), for example. One or more user terminals 9 are provided, and preferably a plurality of user terminals 9 are provided.

  The user terminal 9 includes a user terminal display unit 9a. The user terminal display unit 9a is a terminal display unit that can display information. The user terminal display unit 9a includes, for example, a liquid crystal display. In addition, the user terminal display unit 9a may be configured with a touch panel to display information and accept operations from the user. Below, the example which comprised the user terminal display part 9a with the touch panel is demonstrated.

  The user terminal display unit 9a can display a storage room image stored in the storage room image management unit 3 (storage room image storage unit). That is, the storage room image stored in the storage room image management unit 3 is transmitted from the wireless communication unit 5 to the user terminal 9 via the food information addition unit 4 provided on the control board 1001. The user terminal 9 that has received the storage room image displays the received storage room image on the user terminal display unit 9a.

  FIG. 3A shows an example of a state in which the normal screen 21 is displayed on the user terminal display unit 9a. In the normal screen 21, a storage room image is displayed. Further, in the example shown in FIG. 3A, time information 23 is displayed at the bottom of the normal screen 21. The time information 23 is information related to the time when the storage room image was taken. The time information 23 is the photographing time information described above. The shooting time information is managed by the storage room image management unit 3. For this reason, when displaying the time information 23 on the normal screen 21, when the storage room image is transmitted from the refrigerator 1000 to the user terminal 9, the photographing time information of the storage room image is also transmitted. That's fine.

  On the normal screen 21 shown in FIG. 3A, the storage room image may be displayed back in time by, for example, a swipe operation. By doing in this way, it becomes possible for the user to check the situation in the refrigerator compartment 100 every time the door is opened and closed, and to easily grasp the type of stored food, the storage amount, etc. every moment. Can do.

  The user terminal 9 includes a food information output unit 6, a food information storage unit 7, and a food information editing unit 8. The food information storage unit 7 stores food information. The food information is information regarding food stored in the storage room (here, the refrigerator room 100). The food information includes any one of stamp information, date information, and fixed phrase information. Stamp information is information consisting of illustrations or symbols related to food.

  The date information is information including dates related to food. Specifically, the date information is, for example, information on one or more dates among the expiration date, the expiration date, the purchase date, and the cooking date of the food. The fixed sentence information is information composed of sentences about food. Specific examples of texts related to foods that are standard text information include messages such as “Please eat this”, “Warm in the range”, “For going out”, “For storage”, etc. Conceivable.

  The user terminal display unit 9a, which is a terminal display unit, can display the food information stored in the food information storage unit 7. That is, the user terminal 9 can display the stamp information, date information, and fixed sentence information stored in the food information storage unit 7 on the user terminal display unit 9a.

  The food information editing unit 8 is for editing the food information stored in the food information storage unit 7. That is, the user can edit the contents of the stamp information, date information, and fixed phrase information stored in the food information storage unit 7 by using the food information editing unit 8 of the user terminal 9.

  The food information output unit 6 selects and outputs part or all of the food information stored in the food information storage unit 7. As described above, the user terminal display unit 9 a can display the storage room image stored in the storage room image management unit 3 and the food information stored in the food information storage unit 7. Information that the food information output unit 6 selects and outputs from the food information stored in the food information storage unit 7 while checking the storage room image and the food information displayed on the user terminal display unit 9a. Can be specified.

  A specific example of designation of food information to be selected and output by the food information output unit 6 will be described with reference to FIGS. First, FIG. 4 shows an example of designating stamp information to be selected and output from the food information output unit 6 among the food information. FIG. 4A shows an example of a state in which the stamp selection screen 27 is displayed on the user terminal display unit 9a. On the stamp selection screen 27, a stamp list 29 is displayed. In the stamp list 29, stamp information stored in the food information storage unit 7 is displayed as a list. The user can select and specify stamp information output from the food information output unit 6 from the stamp list 29.

  The stamp information displayed in the stamp list 29, that is, the stamp information stored in the food information storage unit 7 can be added or deleted. The stamp information can be added by, for example, registering a new stamp acquired by searching on the Internet, distribution from another user, or the like via the food information editing unit 8.

  FIG. 4B shows an example of a state in which the stamp arrangement screen 28 is displayed on the user terminal display unit 9a. When the user specifies desired stamp information from the stamp list 29 displayed on the stamp selection screen 27 shown in FIG. 4A, for example, a stamp arrangement screen 28 as shown in FIG. It is displayed on the display unit 9a. On the stamp arrangement screen 28, a selection stamp 30 and a stamp determination button 31 are displayed with the storage room image as a background.

  The selected stamp 30 is stamp information designated by the user from the stamp list 29. The user can change the position where the selection stamp 30 is displayed on the stamp arrangement screen 28 and specify the display position of the selection stamp 30 with respect to the storage room image. The display position of the selection stamp 30 may be specified by, for example, moving the selection stamp 30 by a drag operation and further reducing / enlarging it by a pinch-in / pin-out operation. When the user operates the stamp determination button 31, the designation of stamp information output from the food information output unit 6 and the display position of the stamp information can be determined.

  FIG. 5 shows an example when the fixed sentence information to be selected and output from the food information output unit 6 among the food information is designated. FIG. 5A shows an example of a state in which the fixed sentence selection screen 32 is displayed on the user terminal display unit 9a. A fixed sentence comment list 34 is displayed on the fixed sentence selection screen 32. A fixed sentence comment list 34 is displayed. In the fixed sentence comment list 34, fixed sentence information stored in the food information storage unit 7 is displayed as a list. The user can select and specify the fixed sentence information output from the food information output unit 6 from the fixed sentence comment list 34.

  The fixed sentence information displayed in the fixed sentence comment list 34, that is, the fixed sentence information stored in the food information storage unit 7 can be added or deleted. For example, the fixed sentence information can be added by registering a fixed sentence created by the user operating the food information editing unit 8.

  FIG. 5B shows an example of a state in which the fixed sentence arrangement screen 33 is displayed on the user terminal display unit 9a. When the user specifies desired fixed sentence information from the fixed sentence comment list 34 displayed on the fixed sentence selection screen 32 shown in FIG. 5A, for example, the fixed sentence arrangement as shown in FIG. A screen 33 is displayed on the user terminal display unit 9a. The fixed sentence arrangement screen 33 displays a selected fixed sentence comment 35 and a fixed sentence comment determination button 36 with the storage room image as a background.

  The selected fixed sentence comment 35 is fixed sentence information specified by the user from the fixed sentence comment list 34. The user can change the position where the selected fixed sentence comment 35 is displayed on the fixed sentence arrangement screen 33 and specify the display position of the selected fixed sentence comment 35 with respect to the storage room image. The designation of the display position of the selected fixed phrase comment 35 may be performed, for example, by moving the selected fixed sentence comment 35 by a drag operation. Then, when the user operates the fixed sentence comment determination button 36, it is possible to determine the fixed sentence information output from the food information output unit 6 and the display position of the fixed sentence information.

  Here, as described above, the user can edit the food information including the fixed sentence information by the food information editing unit 8. FIG. 6 shows an example in which the user edits the fixed sentence information by the food information editing unit 8. (A) of FIG. 6 has shown an example of the state which displayed the fixed phrase edit screen 37 on the user terminal display part 9a. A fixed sentence edit input pad 39 is displayed on the fixed sentence edit screen 37.

  The fixed sentence information can be edited by the food information editing unit 8 in the user terminal 9 and frequently used information can be stored in the food information storage unit 7 in advance. Moreover, it is also possible to edit based on the contents of the selected fixed phrase comment 35 specified through the screens shown in FIGS. When the editing start operation of the selected fixed sentence comment 35 is performed in (b) of FIG. 5 (for example, double tap of the selected fixed sentence comment 35, etc.), the fixed sentence editing screen 37 of (a) of FIG. 6 is displayed. . On the standard sentence editing screen 37, the user can perform editing such as adding additional explanation based on the contents of the selected fixed sentence comment 35 by operating the standard sentence editing input pad 39.

  When the editing is completed, the edited sentence display screen 38 of FIG. 6B is displayed on the user terminal display unit 9a. On the edited sentence display screen 38, an edited comment 40 is displayed. Thus, when it is desired to temporarily add a long comment, a long comment can be easily created based on the fixed sentence information stored in advance in the food information storage unit 7.

  FIG. 7 shows an example of designating date information to be selected and output from the food information output unit 6 among the food information. FIG. 7A shows an example of a state in which the date input screen 41 is displayed on the user terminal display unit 9a. On the date input screen 41, a date type selection column 43 and a date selection column 44 are displayed. In the date type selection field 43, the types of dates stored as date information in the food information storage unit 7 are displayed as a list. The user can select and specify the type of date information output by the food information output unit 6 from the date type selection column 43. In the example shown in FIG. 7A, the date type selection column 43 displays the expiration date, date of creation (cooking date), and date of purchase (purchase date). Then, the user can select a specific date of the type of date selected in the date type selection field 43 by using the date selection field 44.

  The date information displayed in the date type selection column 43, that is, the date information stored in the food information storage unit 7 can be added or deleted. Specifically, for example, the user can operate the food information editing unit 8 to add the expiration date, the scheduled disposal date, etc. as a new date type.

  FIG. 7B shows an example of a state in which the date arrangement screen 42 is displayed on the user terminal display unit 9a. When date information desired by the user is specified by the date type selection field 43 and the date selection field 44 shown in FIG. 7A, for example, a date arrangement screen 42 as shown in FIG. 7B is displayed on the user terminal. It is displayed on the part 9a. On the date arrangement screen 42, a selection date balloon 45 and a date balloon determination button 46 are displayed with the storage room image as a background.

  The selection date balloon 45 is date information designated by the user from the date type selection column 43 and the date selection column 44. The user can change the position where the selection date balloon 45 is displayed on the date arrangement screen 42 and specify the display position of the selection date balloon 45 with respect to the storage room image. The designation of the display position of the selection date balloon 45 may be performed, for example, by moving the selection date balloon 45 by a drag operation. When the user operates the date balloon determination button 46, the designation of date information output from the food information output unit 6 and the display position of the date information can be determined.

  The description will be continued with reference to FIG. 2 again. As described above, the food information output unit 6 selects and outputs part or all of the food information stored in the food information storage unit 7. The food information output by the food information output unit 6 is transmitted from the user terminal 9 to the refrigerator 1000. The food information transmitted to the refrigerator 1000 is received by the wireless communication unit 5. The food information addition unit 4 provided on the control board 1001 of the refrigerator 1000 adds the food information received by the wireless communication unit 5 to the storage room image stored in the storage room image management unit 3.

  Here, the food information received by the wireless communication unit 5 is food information output by the food information output unit 6 selecting and outputting part or all of the food information stored in the food information storage unit 7. Therefore, the food information adding unit 4 adds the food information output by the food information output unit 6 to the storage room image stored in the storage room image management unit 3.

  In addition, as described above, the storage room image management unit 3 stores the shooting time information of the storage room image as supplementary information of the storage room image together with the storage room image. The food information adding unit 4 may add incidental information (shooting time information) of the storage room image to the storage room image in addition to the food information output from the food information output unit 6.

  The storage room image to which the food information is added by the food information adding unit 4 is transmitted to the user terminal 9 by the wireless communication unit 5. The user terminal 9 that has received the storage room image with the food information added displays the received storage room image on the user terminal display unit 9a. At this time, the food information added to the received storage room image is displayed on the user terminal display unit 9a so as to be superimposed on the storage room image. That is, the user terminal display unit 9a, which is a terminal display unit, displays the food information added by the food information addition unit 4 in a superimposed manner on the storage room image.

  FIG. 3B shows an example of a state in which the information addition screen 22 is displayed on the user terminal display unit 9a. The information addition screen 22 is a screen on which the food information added by the food information addition unit 4 is displayed superimposed on the storage room image. In the example shown in FIG. 3B, the present stamp 24a and the skull stamp 24b are displayed superimposed on the storage room image. Hereinafter, the present stamp 24a and the skull stamp 24b are collectively referred to as a stamp 24. These stamps 24 are examples of stamp information added by the food information adding unit 4.

  The present stamp 24a can be used, for example, to convey to the husband that the wife returns late that the present is a dessert prepared as a present. In addition, the skull stamp 24b can be used, for example, to make it easier to visually recognize that the food has a near expiration date.

  Further, in the example shown in FIG. 3B, a transmission standard sentence comment 25a and a warning standard sentence comment 25b are displayed superimposed on the storage room image. In the following, the fixed message comment 25a and the warning message comment 25b are collectively referred to as a fixed message comment 25. These fixed sentence comments 25 are an example of fixed sentence information added by the food information adding unit 4. These fixed sentence comments 25 can use the meaning of each stamp 24, for example, to supplement the meaning of those stamps.

  Further, in the example shown in FIG. 3B, the expiration date balloon 26a and the cooking date balloon 26b are displayed superimposed on the storage room image. Hereinafter, the expiration date balloon 26a and the cooking date balloon 26b are collectively referred to as the date balloon 26. These date balloons 26 are examples of date information added by the food information adding unit 4.

  As described above, the food information output unit 6 selects and outputs part or all of the food information stored in the food information storage unit 7, and the food information output by the food information output unit 6 is displayed on the user terminal. In the unit 9a, the image is superimposed on the storage room image stored in the storage room image management unit 3 and displayed as a stamp 24, a fixed phrase comment 25, and a date balloon 26. At this time, if the refrigerator system includes a plurality of user terminals 9, the user terminal display unit 9a of the plurality of user terminals 9 has a stamp 24, a fixed phrase comment 25, and a date balloon superimposed on the storage room image. 26 is displayed.

  For this reason, the information addition screen 22 of FIG. 3B on which the storage room image to which the food information about the stored food is added, which cannot be understood only by looking at the normal screen 21 of FIG. It can be shared among multiple users. That is, the plurality of users can easily grasp the food information that cannot be understood only from the storage room image together with the state of the storage room. Further, by providing the food information output unit 6 that selects and outputs part or all of the food information stored in the food information storage unit 7, the user designates the food information output by the food information output unit 6. This makes it possible to input food information that cannot be understood from only the storage room image, and the user can easily input the food information.

  Therefore, for example, it is possible to determine whether the user can eat the food displayed in the storage room image, whether there is a stock, or whether it is better to buy a new one even if it is present. In addition, it is possible to prevent food loss such as forgetting to buy, duplicate buying, and disposal due to forgetting consumption.

  In addition to sharing expiration dates and expiration dates among multiple users and promoting consumption, the purchase date and cooking date of food that only the stored person knows can be known to multiple users. The deadline can be estimated. Furthermore, since the storage room image and the food information can be provided to a limited third party other than the owner of the refrigerator 1000, the stock status can be shared among a plurality of users and used as a communication tool.

  In the first embodiment, the wireless communication unit 5 transmits not only the user terminal 9 but also the operation panel 1 to the storage room image to which the food information is added by the food information adding unit 4. The operation panel 1 that has received the storage room image to which the food information is added displays the received storage room image on the panel display unit 1a. At this time, on the panel display unit 1a, the food information added to the received storage room image is displayed superimposed on the storage room image. That is, the panel display unit 1a as the main body display unit can also display the food information added by the food information addition unit 4 on the storage room image in the same manner as the user terminal display unit 9a as the terminal display unit. .

  Next, an example of the operation flow of the refrigerator system configured as described above will be described with reference to FIG. First, when the refrigerator door 101 is opened and closed by the user, the above-described sensor detects the opening and closing of the refrigerator door 101, and the process proceeds from step S11 to step S12.

  In step S12, the in-compartment photographing apparatus 2 photographs the inside of the refrigerator compartment 100 that is a storage room. In a succeeding step S13, the photographed image inside the refrigerator compartment 100 is transmitted to the storage room image management unit 3 as a storage room image. In subsequent step S14, the storage room image management unit 3 stores and stores the storage room image taken by the in-compartment photographing apparatus 2 together with the accompanying information (photographing time information). Then, in the subsequent step S15, the storage room image management unit 3 transmits the storage room image captured by the in-compartment photographing apparatus 2 and the incidental information (photographing time information) of the storage room image to the food information addition unit 4. To do.

  After step S15, the process proceeds to step S16. In step S <b> 16, the food information adding unit 4 checks whether or not the food information output from the food information output unit 6 exists. When the food information output from the food information output part 6 exists, it progresses to step S17. In step S <b> 17, the food information adding unit 4 superimposes and stores the food information output from the food information output unit 6 on the storage room image transmitted from the storage room image management unit 3.

  After step S17, the process proceeds to step S18. On the other hand, if there is no food information output from the food information output unit 6 in step S16, the process proceeds from step S16 to step S18 without passing through step S17. In step S <b> 18, the food information adding unit 4 transmits the storage room image to the operation panel 1 and the user terminal 9. This transmission is performed via the wireless communication unit 5. The storage room image transmitted in step S18 is a storage room image in which the food information is superimposed in step S17 when step S17 is performed. On the other hand, when step S17 is not passed, the storage room image transmitted in step S18 is the storage room image transmitted by the storage room image management unit 3 in step S15.

  In subsequent step S19, panel display unit 1a displays the storage room image transmitted in step S18. The user terminal display unit 9a also displays the storage room image transmitted in step S18. When step S19 ends, the process returns to step S11, and the operation of each step described above is repeated.

  In the above, the in-compartment photographing apparatus 2 is provided in the refrigerator compartment 100, but may be provided in a storage compartment other than the refrigerator compartment 100. Moreover, you may install the internal imaging device 2 in a some storage room simultaneously. For example, the vegetable room 500 is a storage room in which vegetables that are easily deteriorated are stored while it is relatively difficult to grasp the state of the inside of the cabinet. Therefore, the storage state can be shared among a plurality of users by installing the in-chamber photographing device 2 in the vegetable room 500, and the plurality of users confirm the storage state to grasp and discard the expiration date of the vegetables. The possibility can be reduced. In addition, by installing the in-chamber photographing device 2 in the freezer compartment 400, it is possible to grasp the storage status of frozen meat, rice, etc., which is the main meal, and to purchase frozen foods that must be stored when purchased. The amount can be judged.

Embodiment 2. FIG.
FIG. 9 relates to Embodiment 2 of the present invention, and is a diagram schematically showing the overall configuration of the refrigerator system and the configuration of the refrigerator compartment of the refrigerator.

  In the second embodiment described here, the food information output unit, the food information storage unit, and the food information editing unit provided in the terminal device in the configuration of the first embodiment described above are provided in the refrigerator main body. It is. Hereinafter, the refrigerator system according to the second embodiment will be described with a focus on differences from the first embodiment.

  In the refrigerator system according to the second embodiment, as shown in FIG. 9, the operation panel 1 of the refrigerator 1000 includes a food information output unit 6, a food information storage unit 7, and a food information editing unit 8. The configurations, functions, and the like of the food information output unit 6, the food information storage unit 7, and the food information editing unit 8 are basically the same as those in the first embodiment. However, in the first embodiment, the food information output unit 6 is provided in the user terminal 9. For this reason, the food information selected and output by the food information output unit 6 from the food information stored in the food information storage unit 7 is transmitted from the user terminal 9 to the wireless communication unit 5 of the refrigerator 1000, and wireless communication is performed. The food information received by the unit 5 was input to the food information adding unit 4.

  On the other hand, in the second embodiment, the food information output unit 6 is provided on the operation panel 1 of the refrigerator 1000. For this reason, the food information selected and output by the food information output unit 6 is directly input to the food information adding unit 4 without using the wireless communication unit 5.

  Moreover, in this Embodiment 2, the panel display part 1a which is a main body display is memorize | stored in the storage room image memorize | stored in the storage room image management part 3 (storage room image storage part), and the food information storage part 7. FIG. Food information can be displayed. That is, the panel display unit 1 a displays the normal screen 21, the information addition screen 22, the stamp selection screen 27, the stamp arrangement screen 28, the fixed sentence selection screen 32, the fixed form, which are displayed on the user terminal display unit 9 a in the first embodiment. Each of a sentence arrangement screen 33, a fixed sentence editing screen 37, an edited sentence display screen 38, a date input screen 41, and a date arrangement screen 42 can be displayed.

Therefore, the user confirms the food information stored in the food information storage unit 7 displayed on the panel display unit 1a and the storage room image, while checking the food information stored in the food information storage unit 7 from the food information. The information output unit 6 can select and output information to be selected. Further, the user can edit the food information by the food information editing unit 8 by operating the operation panel 1.
Other configurations and operations are the same as those in the first embodiment, and detailed description thereof is omitted.

  In the refrigerator system according to the second embodiment configured as described above, the food information storage unit 7 and the food information output unit 6 have the same effects as those of the first embodiment. Since it is provided in the main body (refrigerator 1000), the food information output by the food information output unit 6 can be input to the food information adding unit 4 without going through the wireless communication unit 5. Therefore, the communication load in the wireless communication unit 5 can be reduced, and communication between the wireless communication unit 5 and each user terminal 9 can be performed smoothly even if the number of user terminals 9 increases.

  In addition, by providing the food information storage unit 7 that constitutes a food information database that may have a large capacity on the main body side of the refrigerator 1000, it is possible to reduce the storage data capacity required for the plurality of user terminals 9. it can. Furthermore, since it is possible to specify the food information to be selected and output by the food information output unit 6 only from the operation panel 1 of the refrigerator 1000, the food information added by the food information adding unit 4 to the storage room image is centralized. It is possible to manage.

Embodiment 3 FIG.
FIG. 10 relates to Embodiment 3 of the present invention, and is a diagram schematically showing the overall configuration of the refrigerator system and the configuration of the refrigerator compartment of the refrigerator.

  In Embodiment 3 described here, in the configuration of Embodiment 1 described above, a server device is provided separately from the refrigerator main body and the terminal device, and a food information storage unit is provided in the server device. Hereinafter, the refrigerator system according to the third embodiment will be described focusing on differences from the first embodiment.

  The refrigerator system according to the third embodiment includes a cloud server 11. The cloud server 11 is provided to be able to communicate with a user terminal 9 that is a terminal device via, for example, the Internet 10 that is a communication network. Here, a case where a cloud server 11 including a plurality of servers (server group) connected to the Internet 10 is used as the server device is illustrated. However, the server device is not limited to the cloud server 11 and may be a single server.

  The cloud server 11 includes a food information storage unit 7 and a personal authentication unit 12. The configuration, function, and the like of the food information storage unit 7 are basically the same as those in the first embodiment. The personal authentication unit 12 authenticates whether the user terminal 9 has the authority to connect to the refrigerator 1000. That is, the personal authentication unit 12 of the cloud server 11 stores in advance the terminal device ID of the user terminal 9 that has the authority to connect to the refrigerator 1000 with respect to the ID of the refrigerator 1000.

  Here, the ID of the refrigerator 1000 is information that can uniquely identify a plurality of refrigerators 1000 connected to the Internet 10. The terminal device ID is information that can uniquely identify a plurality of user terminals 9 connected to the Internet 10. Then, the personal authentication unit 3003 confirms whether or not the portable terminal ID of the user terminal 9 is stored as having authority to connect to the refrigerator 1000 with respect to the refrigerator 1000 of the refrigerator 1000, thereby About 9, the presence or absence of the connection authority to the refrigerator 1000 is authenticated.

  The cloud server 11 permits the user terminal 9 that has been authenticated by the personal authentication unit 12 to have the authority to connect to the refrigerator 1000 to connect to the refrigerator 1000 via the Internet 10 or the wireless communication unit 5. That is, the cloud server 11 restricts the user terminal 9 that is not authenticated by the personal authentication unit 12 from being authorized to connect to the refrigerator 1000 to connect to the refrigerator 1000 via the Internet 10 or the wireless communication unit 5. To do.

  The user terminal 9 that has authenticated that the personal authentication unit 12 has the authority to connect to the refrigerator 1000 is connected to the refrigerator 1000 via the wireless communication unit 5 or the like, and the storage room image stored in the storage room image management unit 3. And the storage room image can be displayed on the user terminal display unit 9a. As described above, when the user terminal 9 has the authority to connect to the refrigerator 1000, the storage room stored in the storage room image management unit 3 of the refrigerator 1000 is displayed on the user terminal display unit 9 a of the user terminal 9. An image can be displayed.

  Therefore, the personal authentication unit 12 determines whether or not the user terminal 9 has the authority to display the storage room image stored in the storage room image management unit 3 on the user terminal display unit 9a of the user terminal 9. In other words, it can be authenticated. In the first embodiment and the second embodiment, for example, the personal authentication unit 12 may be provided in the refrigerator 1000 or the like.

  In the third embodiment, the user terminal 9 does not include the food information storage unit 7. On the other hand, the food information output unit 6 and the food information editing unit 8 are provided in the user terminal 9 as in the first embodiment. The food information edited by the user in the food information editing unit 8 of the user terminal 9 is transmitted to the cloud server 11 via the Internet 10. The cloud server 11 stores the received edited food information in the food information storage unit 7 and reflects the edited content of the food information.

  Moreover, the user terminal 9 can acquire the food information memorize | stored in the food information storage part 7 of the cloud server 11 via the internet 10, and can display it on the user terminal display part 9a. Information that the food information output unit 6 selects and outputs from the food information stored in the food information storage unit 7 while checking the storage room image and the food information displayed on the user terminal display unit 9a. Can be specified.

  The food information output unit 6 selects and outputs a designated item from the food information stored in the food information storage unit 7 of the cloud server 11. The food information selected and output by the food information output unit 6 is transmitted from the user terminal 9 to the wireless communication unit 5 and input to the food information addition unit 4. Other configurations and operations are the same as those in the first embodiment, and detailed description thereof is omitted.

  The refrigerator system of the third embodiment configured as described above can achieve the same effect as that of the first embodiment, and in addition, food information that constitutes a food information database that may have a large capacity. By providing the storage unit 7 in the cloud server 11, it is possible to reduce the storage data capacity necessary for the refrigerator 1000 and the plurality of user terminals 9.

  Furthermore, if the terminal device ID of the user terminal 9 owned by a user other than the user who owns the refrigerator 1000 is registered in the personal authentication unit 12 of the cloud server 11, the security of the user's refrigerator 1000 can be maintained while maintaining security. The internal situation can be shared with the food information selected and output by the food information output unit 6. In addition, for example, it is possible to easily check the stock status of food in the storage room at a shopping destination such as a supermarket, so it is possible to prevent the family from buying or forgetting the same food ingredients be able to.

  The personal authentication unit 12 described above authenticates the authority using the ID. The authentication method is not limited to this. In addition to the ID, for example, the authority may be authenticated by biometric authentication such as fingerprints, veins, and irises of the eyes, authentication by password, or a combination of these authentication methods.

Embodiment 4 FIG.
FIG. 11 relates to Embodiment 4 of the present invention and is a diagram schematically showing the overall configuration of the refrigerator system and the configuration of the refrigerator compartment of the refrigerator.

  In the fourth embodiment described here, in the configuration of the third embodiment described above, a storage room image management unit and a food information addition unit are also provided in the server device. Hereinafter, the refrigerator system according to the fourth embodiment will be described focusing on differences from the third embodiment.

  The refrigerator system according to the fourth embodiment includes the cloud server 11 as in the third embodiment. The cloud server 11 is communicably connected to a refrigerator 1000 that is a refrigerator main body via, for example, the Internet 10 that is a communication network. In addition, the cloud server 11 is also communicably connected to a user terminal 9 that is a terminal device via, for example, the Internet 10 that is also a communication network. As in the third embodiment, the server device is not limited to the cloud server 11 and may be a single server.

  In addition to the food information storage unit 7 and the personal authentication unit 12, the cloud server 11 further includes a storage room image management unit 3 and a food information addition unit 4. The configurations, functions, and the like of the food information storage unit 7 and the personal authentication unit 12 are basically the same as those in the third embodiment. Further, the configuration, function, and the like of the storage room image management unit 3 and the food information addition unit 4 are basically the same as those in the first embodiment.

  In the fourth embodiment, the control room 1001 of the refrigerator 1000 is not provided with the storage room image management unit 3 and the food information addition unit 4. A wireless communication unit 5 is provided on the control board 1001. The storage room image output from the internal photographing device 2 is input to the wireless communication unit 5. The wireless communication unit 5 transmits the input storage room image to the cloud server 11 via the Internet 10. When the cloud server 11 receives the storage room image, the storage room image management unit 3 provided in the cloud server 11 stores the received storage room image.

  The food information output unit 6 and the food information editing unit 8 are provided in the user terminal 9 as in the third embodiment. The food information edited by the user in the food information editing unit 8 of the user terminal 9 is transmitted to the cloud server 11 via the Internet 10. The cloud server 11 stores the received edited food information in the food information storage unit 7 and reflects the edited content of the food information.

  Moreover, the user terminal 9 can acquire the food information memorize | stored in the food information storage part 7 of the cloud server 11 via the internet 10, and can display it on the user terminal display part 9a. Information that the food information output unit 6 selects and outputs from the food information stored in the food information storage unit 7 while checking the storage room image and the food information displayed on the user terminal display unit 9a. Can be specified.

  The food information output unit 6 selects and outputs a designated item from the food information stored in the food information storage unit 7 of the cloud server 11. The food information selected and output by the food information output unit 6 is transmitted from the user terminal 9 to the cloud server 11 via the Internet 10. The food information received by the cloud server 11 is input to the food information adding unit 4 provided in the cloud server 11. The food information adding unit 4 adds the food information received by the cloud server 11 to the storage room image stored in the storage room image management unit 3.

  The storage room image to which the food information is added by the food information adding unit 4 is transmitted from the cloud server 11 to the user terminal 9 via the Internet 10. The user terminal 9 that has received the storage room image with the food information added displays the received storage room image on the user terminal display unit 9a. At this time, the food information added to the received storage room image is displayed on the user terminal display unit 9a so as to be superimposed on the storage room image.

  The storage room image to which the food information is added by the food information adding unit 4 is also transmitted from the cloud server 11 to the wireless communication unit 5 of the refrigerator 1000 via the Internet 10. The wireless communication unit 5 that has received the storage room image to which the food information is added transmits the received storage room image to the operation panel 1. The operation panel 1 that has received the storage room image to which the food information is added displays the received storage room image on the panel display unit 1a. At this time, the food information added to the received storage room image is displayed on the panel display unit 1a so as to be superimposed on the storage room image. Other configurations and operations are the same as those in the first or third embodiment, and detailed description thereof is omitted.

  The refrigerator system according to the fourth embodiment configured as described above can achieve the same effects as those of the first or third embodiment, and in addition, can store and manage storage room image data. By providing the room image management unit 3 in the cloud server 11, the storage data capacity necessary for the refrigerator 1000 and the plurality of user terminals 9 can be further reduced. Further, by providing the cloud server 11 with the food information addition unit 4 that performs image processing for adding food information to the storage room image, the processing load on the control board 1001 of the refrigerator 1000 can be reduced.

  The present invention includes a refrigerator main body having a camera that images the inside of a storage room for storing food and outputs a storage room image, and a terminal device that has a terminal display unit and is communicable with the refrigerator main body. Can be used in a refrigerator system.

DESCRIPTION OF SYMBOLS 1 Operation panel 1a Panel display part 2 In-chamber imaging device 3 Storage room image management part 4 Food information addition part 5 Wireless communication part 6 Food information output part 7 Food information storage part 8 Food information edit part 9 User terminal 9a User terminal display part DESCRIPTION OF SYMBOLS 10 Internet 11 Cloud server 12 Personal authentication part 21 Normal screen 22 Information addition screen 23 Time information 24 Stamp 24a Present stamp 24b Skull stamp 25 Fixed phrase comment 25a Transmission fixed phrase comment 25b Warning fixed phrase comment 26 Date balloon 26a Expiration date balloon 26b Cooking Date balloon 27 Stamp selection screen 28 Stamp placement screen 29 Stamp list 30 Selected stamp 31 Stamp decision button 32 Preset sentence selection screen 33 Prefix sentence placement screen 34 Prefix sentence comment list 35 Selected fixed sentence comment 36 Prefix Sentence comment determination button 37 Fixed sentence edit screen 38 Edit sentence display screen 39 Fixed sentence edit input pad 40 Comment after editing 41 Date input screen 42 Date arrangement screen 43 Date type selection field 44 Date selection field 45 Selected date balloon 46 Date balloon determination button DESCRIPTION OF SYMBOLS 100 Refrigerating room 101 Refrigerating room door 102 Refrigerating room shelf board 110 Chilled room 111 Chilled case 200 Ice making room 300 Switching room 400 Freezing room 500 Vegetable room 1000 Refrigerator 1001 Control board 1010 Cooling air path

Refrigerator system according to the invention includes a storage chamber for accommodating a food, a camera for outputting a storage chamber image by photographing the inside of the storage compartment, the refrigerator body having, a terminal display unit, said refrigerator comprising a terminal device which is provided to be capable of communicating with the main body, wherein the terminal display unit displays the food information on food housed in the storage compartment by superposing the storage compartment image output from the camera, the The food information includes date information including dates related to food, and the type of date information displayed on the terminal display unit in a superimposed manner on the storage room image can be added or deleted .

The selected stamp 30 is stamp information designated by the user from the stamp list 29. The user can change the position where the selection stamp 30 is displayed on the stamp arrangement screen 28 and specify the display position of the selection stamp 30 with respect to the storage room image. Specifying the display position of the selected stamp 30, for example, to move the selected stamp 30 by dragging, further may be able to be carried out by reducing / enlarging by pinch / Pin Chi-out operation. When the user operates the stamp determination button 31, the designation of stamp information output from the food information output unit 6 and the display position of the stamp information can be determined.

FIG. 5 shows an example when the fixed sentence information to be selected and output from the food information output unit 6 among the food information is designated. FIG. 5A shows an example of a state in which the fixed sentence selection screen 32 is displayed on the user terminal display unit 9a. A fixed sentence comment list 34 is displayed on the fixed sentence selection screen 32 . The boilerplate comment list 34 of this, boilerplate information that is stored in the food information storage unit 7 is displayed as a list. The user can select and specify the fixed sentence information output from the food information output unit 6 from the fixed sentence comment list 34.

In the first embodiment, the wireless communication unit 5 transmits not only the user terminal 9 but also the operation panel 1 to the storage room image to which the food information is added by the food information adding unit 4. The operation panel 1 that has received the storage room image to which the food information is added displays the received storage room image on the panel display unit 1a. At this time, the panel display unit 1a, the food information attached to the storage chamber image received is displayed superimposed on the storage chamber image. That is, the panel display unit 1a as the main body display unit can also display the food information added by the food information addition unit 4 on the storage room image in the same manner as the user terminal display unit 9a as the terminal display unit. .

Claims (11)

A refrigerator body having a storage room for storing food, and a camera for photographing the inside of the storage room and outputting a storage room image;
A terminal device having a terminal display unit and capable of communicating with the refrigerator main body;
A storage room image storage unit for storing the storage room image output from the camera;
A food information storage unit for storing food information related to food stored in the storage room;
A food information output unit that selects and outputs part or all of the food information stored in the food information storage unit;
A food information addition unit for adding the food information output by the food information output unit to the storage room image stored in the storage room image storage unit,
The said terminal display part is a refrigerator system which superimposes and displays the food information added by the said food information addition part on a storeroom image.   The refrigerator system according to claim 1, wherein the storage room image storage unit and the food information addition unit are provided in the refrigerator body. The refrigerator body is
A door for opening and closing the storage room;
A main body display unit provided on the outer surface side of the door and capable of displaying information;
The food information storage unit and the food information output unit are provided in the refrigerator body,
The refrigerator system according to claim 2, wherein the main body display unit can display a storage room image stored in the storage room image storage unit and food information stored in the food information storage unit. The food information storage unit and the food information output unit are provided in the terminal device,
The refrigerator system according to claim 2, wherein the terminal display unit can display a storage room image stored in the storage room image storage unit and food information stored in the food information storage unit. A server device provided to be able to communicate with the terminal device;
The food information storage unit is provided in the server device,
The food information output unit is provided in the terminal device,
The refrigerator system according to claim 2, wherein the terminal display unit can display a storage room image stored in the storage room image storage unit and food information stored in the food information storage unit. A server device provided to be communicable with the refrigerator main body and the terminal device;
The storage room image storage unit, the food information addition unit and the food information storage unit are provided in the server device,
The food information output unit is provided in the terminal device,
The refrigerator system according to claim 1, wherein the terminal display unit is capable of displaying a storage room image stored in the storage room image storage unit and food information stored in the food information storage unit.   The refrigerator system according to any one of claims 1 to 6, wherein the food information stored in the food information storage unit includes stamp information including an illustration or a symbol related to food.   The refrigerator system according to any one of claims 1 to 7, wherein the food information stored in the food information storage unit includes date information including dates related to food.   The refrigerator system according to any one of claims 1 to 8, wherein the food information stored in the food information storage unit includes fixed sentence information including sentences relating to food.   The refrigerator system according to any one of claims 1 to 9, further comprising a food information editing unit that edits food information stored in the food information storage unit.   The said terminal device was further equipped with the authentication part which authenticates whether it has the authority to display the storage room image memorize | stored in the said storage room image storage part in the said terminal display part of the said terminal device. The refrigerator system according to any one of claims 1 to 10.

Images