JP2021117572A - Refrigerator control device and program - Google Patents

Abstract

To allow a user to properly manage food in a refrigerator.SOLUTION: A refrigerator control device 20 comprises a storage room designating section 936 that designates any of a plurality of storage rooms 61 to 64 provided in a refrigerator 10 based on a user's operation of an operation/display section 24 that performs input/output of information or information supplied from the refrigerator 10 and a storage room image storage control section 938 that stores the image acquired from a photographing section 26 that captures images in an image storage section 912 as an image inside the storage room corresponding to the storage rooms 61 to 64 designated by the storage room designating section 936.SELECTED DRAWING: Figure 1

Description

The present invention relates to a refrigerator management device and a program.

As background technology in this technical field, the following abstract of Patent Document 1 states, "Information on foods stored in a refrigerator while consumers are at home, expiration dates of the foods, and foods sold at stores. The recipe is decided based on the information of In addition, we will provide a food purchase management support system that can prevent the purchase of food more than necessary and shorten the shopping time at stores. "

Japanese Unexamined Patent Publication No. 2008-242911

By the way, in recent refrigerators, for example, a vegetable room (storage temperature of about 3 to 7 ° C), a refrigerator room (2 to 6 ° C), a chilled room (-1 to 1 ° C), and a freezer room (-20 to 20 ° C). Since the number of storage chambers is increasing, such as (-18 ° C), it becomes difficult for the user to remember which foodstuff is stored in which storage chamber, and there is a possibility that the management of the foodstuff becomes inappropriate.
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a refrigerator management device and a program capable of appropriately managing foodstuffs in a refrigerator by a user.

In order to solve the above problems, the refrigerator management device of the present invention has a plurality of storage chambers provided in the refrigerator based on the user's operation on the operation / display unit for inputting / outputting information or the information supplied from the refrigerator. The storage room designation unit that specifies either one and the image acquired from the photographing unit that captures the image are stored in the image storage unit as a storage room image associated with the storage room designated by the storage room designation unit. It is characterized by including an image storage control unit in a storage room.

According to the present invention, the user can appropriately manage the ingredients in the refrigerator.

It is a block diagram of the refrigerator control system by a preferred embodiment. It is a flowchart of a command reception routine executed in a refrigerator. It is a figure which shows the transition state of the screen at the time of starting an application program. It is another figure which shows the transition state of the screen at the time of starting an application program. It is a figure which shows the example of a menu dialog. It is a figure which shows the example of the seasonal ingredient detail screen. It is a figure which shows the variation of the shopping index home screen. It is a figure which shows other variation of a shopping index home screen. It is a figure which shows the example of the shopping index detail screen. It is a figure which shows the example of the recipe collection browser screen, the recipe collection application migration confirmation screen, and the recipe collection application program screen. It is a figure which shows the example of the content image display screen and the shooting screen. It is a figure which shows the example of the display room switching screen, other contents image display screen, and a room selection button. How to use It is a figure which shows an example of a concierge top screen and a free word search screen. It is a figure which shows the example of another free word search screen and a guide screen. It is a figure which shows the variation of the refrigerator icon. It is a figure which shows the example of the food material preservation list screen. It is a figure which shows the example of the foodstuff management list display screen and the foodstuff management list deletion screen. It is a figure which shows the example of the foodstuff management album display screen and the foodstuff management album deletion screen. It is a figure which shows the example of the food material management new addition / edit screen. It is a figure which shows the example of the date selection calendar screen. It is a figure which shows the example of the image selection screen. It is a figure which shows the example of the operation information-top screen. It is a figure which shows the example of the support screen. It is a figure which shows the example of the setting-top screen and the cooling mode setting screen. It is a figure which shows the example of the notification setting screen and other setting screens. It is a figure which shows the example of the postal code setting screen and the notification history list screen. It is a figure which shows the weather distribution point, the maximum temperature distribution point, the precipitation probability distribution point, the wind speed distribution point, and an icon table. It is a figure which shows the example of the weather comment management table, the wind speed comment management table, the temperature comment management table, the precipitation probability comment management table, and the rank comment management table.

<Structure of Embodiment>
FIG. 1 is a block diagram showing a hardware configuration of the refrigerator control system S according to a preferred embodiment.
The refrigerator control system S includes one or more (M units) refrigerators 10-1 to 10-M (hereinafter, may be collectively referred to as refrigerator 10) and one or more (N units) mobile terminals 20-. 1 to 20-N (refrigerator management device, computer, hereinafter, may be collectively referred to as a mobile terminal 20).

The refrigerator 10 and the mobile terminal 20 can communicate with each other via the LAN 52, and can communicate with each other via the LAN 52 and the WAN 54. The LAN 52 is, for example, a home wireless LAN, and the WAN 54 is, for example, the Internet. The data server 56 is a server machine operated by the manufacturer of the refrigerator 10, is connected to the WAN 54, and includes an image storage unit 912 and a food material storage unit 914. The retailer server 58 is a server machine operated by the retailer.

The refrigerator 10 includes a control unit 11, a storage unit 12, a communication unit 13, an operation / display unit 14, a freezing / refrigerating unit 15, and a housing 60. The freezing / refrigerating unit 15 includes a compressor, a heat exchanger, and the like. The operation / display unit 14 is provided with an LED display, a membrane switch, etc., and can display various states of the refrigerator 10 to the user, and the user can input various commands via the membrane switch, etc. It has become.

Further, the housing 60 of the refrigerator 10 includes a refrigerating chamber 61, a freezing chamber 62, an upper switching chamber 63, a lower switching chamber 64, a vacuum chilled chamber 65, and an ice making chamber 66. In addition, these may be collectively referred to as "storage chambers 61-66".

The storage unit 12 stores various information. The communication unit 13 communicates with the mobile terminal 20 and the like via the LAN 52. The control unit 11 includes hardware as a general computer such as a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory), and the ROM is a control executed by the CPU. Programs, various data, etc. are stored.

Here, the refrigerating chamber 61 is an open-door refrigerating chamber (storage temperature of about 2 to 6 ° C.), but the refrigerating chamber 61 can also be set as a chilled chamber. Further, the upper switching chamber 63 and the lower switching chamber 64 are of a drawer type, and these functions can be arbitrarily selected by the user in the operation / display unit 14 from a plurality of candidates. Here, the candidates for the functions that can be selected are, for example, a vegetable room (storage temperature of about 3 to 7 ° C.), a refrigerator room (2 to 6 ° C.), a chilled room (-1 to 1 ° C.), and a freezer room (same as above). -20 to -18 ° C) and the like. The control unit 11 sets the atmospheric pressure of the vacuum chilled chamber 65 to about 0.8 atm. However, the vacuum chilled chamber 65 can be set to non-vacuum (about 1 atm) by the user's setting.

Further, the mobile terminal 20 includes a control unit 21, a storage unit 22, a communication unit 23, an operation / display unit 24, a photographing unit 26, and a microphone 27. The operation / display unit 24 includes a flat panel display and a touch sensor provided on the surface thereof, so that various information can be displayed to the user and the user can input various commands. It has become. The communication unit 23 communicates with the refrigerator 10 or the like via LAN 52 or WAN 54.

The storage unit 22 stores various information. The data stored in the storage units 12 and 22 does not necessarily have to be stored inside the refrigerator 10 or the mobile terminal 20, and a storage device for storing these data is provided in another device such as a server, and the LAN 52. It may be accessible via or WAN54. The shooting unit 26 shoots a moving image or a still image based on a command from the control unit 21. The microphone 27 collects sound.

The control unit 21 includes hardware such as a CPU, RAM, and ROM as a general computer, and the ROM stores a control program executed by the CPU, various data, and the like. In FIG. 1, the inside of the control unit 21 shows a function realized by a control program or the like as a block. That is, the control unit 21 includes a storage room designation unit 936 (storage room designation means), a storage room image storage control unit 938 (storage room image storage control means), a food material designation unit 940, a position presentation unit 942, and the weather. Recommended by information acquisition unit 944, shopping index display control unit 946, postal code input unit 948, geographic information estimation unit 950 (geographic information acquisition unit), food material data management unit 952, and retailer communication unit 954. It includes a food material screen display control unit 956, a recipe display screen control unit 958, an operation information screen display control unit 960, a cyclic screen selection unit 962, and an image analysis unit 964. The functions of the components of the control unit 21 will be described later.

(Refrigerator information)
Various information about the refrigerator 10 is stored in the storage unit 12 of the refrigerator 10. The stored information is called "refrigerator information". The refrigerator information is also transferred to the mobile terminal 20, and a copy of the refrigerator information is also stored in the storage unit 22 of the mobile terminal 20. As a result, the user can confirm the refrigerator information by operating the mobile terminal 20. "Refrigerator information" includes notifications, operation signs, parameter values, door opening / closing time information, and the like.

Here, the "notification" is information to be notified to the user, and includes a normal notification, a caution notification, a failure notification, and the like. The "normal notice" is the normal information of the refrigerator 10. For example, when the user commands "ice making cleaning (defrosting the ice making room)", when the "ice making cleaning" is completed, it is information for notifying the user that the "ice making cleaning" is completed. The "caution notice" is a notice that an event that should be noted has occurred although it is not a malfunction of the refrigerator 10. For example, the door is left open (the door of the refrigerator compartment, the freezer compartment, etc. is kept open for a predetermined time (for example, 3 minutes). ) When the above is open), it is information to notify that fact. Further, the "failure notification" is information for notifying when a failure of the refrigerator 10 (for example, a temperature abnormality of each part, a motor rotation abnormality, an overcurrent, etc.) occurs.

Further, the "door opening / closing time information" is the cumulative total of the door opening / closing times of the freezing room or the refrigerating room, etc., for each day in the past 10 days including the current day. In addition, "operation sign" means "power consumption is suppressed (during power saving operation)", "please replenish water in the water supply tank", "during ice making cleaning (during defrosting of the ice making room)". , "Upper stage switching", "Lower stage switching", "Automatic ice maker is operating", "Rapid ice making", "Rapid cooling", etc. In addition, "upper stage switching in progress" and "lower stage switching in progress" indicate that the functions such as the set temperature of the upper stage switching chamber 63 and the lower stage switching chamber 64 (see FIG. 1) are being changed, respectively.

Further, the "parameter value" is various values that can be set from the mobile terminal 20. For example, the refrigerator 10 has "temperature of the refrigerating chamber 61" and "temperature of the freezing chamber 62" as setting items, and for these items, there are three stages of "weak", "medium", and "strong", or "1". The parameter value can be set from the 11-step candidates of ~ "11". The "parameter values" for the vacuum chilled chamber 65 include "chilled (refrigerating temperature about + 1 ° C)", "ice temperature (refrigerating temperature about -2 ° C)", and "vacuum cutting (refrigerating temperature is normal refrigerating temperature)". The parameter value can be set from the three types of candidates, "the pressure is about 1 pressure)".

Further, for the refrigerating room, there are setting items of "spot cooling mode" and "rapid cooling mode", and parameter values can be selected from on or off for these setting items. Further, the ice making chamber 66 of the refrigerator 10 is provided with an "ice making function", and for this, a parameter value can be selected from "rapid ice making", "ice making", and "stop". Further, the refrigerator 10 has setting items such as "power saving" and "operation unit lock", and parameter values can be selected from on or off for these setting items. Further, the refrigerator 10 has a setting item called "volume", and for these, a parameter value can be selected from "standard", "large", and "off".

(Food data)
In the storage unit 22 of each mobile terminal 20, for example, food material data related to foodstuffs stored in the refrigerator 10 can be stored. Further, the food material data of the storage unit 22 is transferred to the food material storage unit 914 of the data server 56, and the food material data stored in the food material storage unit 914 is transferred to another mobile terminal 20 that controls the same refrigerator 10. Transferred. As a result, the same food material data can be shared in real time by the plurality of mobile terminals 20.

In addition, each food material data includes food material image data, memo data, reminder information, an alarm notification flag, and a starting date. The "food material image data" is arbitrary image data, and may be image data other than the food material. However, since the image data is included in the food material data and it is considered that the image data of the food material is often used, it is referred to as "food material image data" in the present specification.

Further, the "memo data" is arbitrary character data of about several tens of characters, and generally, a character string such as a name or description of the food material is applied. Further, the "starting point date" is arbitrary date data that serves as a starting point for the food material, and may be a date on which the shooting unit 26 has taken the food material image data or the food material image data is stored in the storage unit 22. can. If the starting point date is set to the shooting date or the storage date of the food material image data, the starting point date can be automatically set in cooperation with the operation of the shooting unit 26, which is convenient for the user. Further, since it is considered that these dates often coincide with or are close to the storage start date of the food material in the refrigerator 10, it is easy to ensure the accuracy. Of course, it may be the day when the food is purchased or the day when the food is stored in the refrigerator 10.

Further, the "reminder information" is information that specifies the date and time when the reminder is performed to the user. For the reminder information, an absolute date and time may be specified, for example, "May 3, 2019, 10:00 PM", or a date and time relatively determined based on the starting date, such as "14th from the starting date". May be. Further, the "alarm notification flag" specifies that a predetermined alarm operation (for example, sounding of a buzzer or vibration of the mobile terminal 20) is performed (on) or not performed (off) when a reminder is performed to the user. Information.

<Operation of the embodiment>
(Command reception in refrigerator 10)
FIG. 2 is a flowchart of a command receiving routine executed in the refrigerator 10. In the present embodiment, each mobile terminal 20 can transmit various commands to any of the refrigerators 10. The command receiving routine shown in FIG. 2 is activated when the refrigerator 10 receives any command.

When the refrigerator 10 receives the command, the process proceeds to step S10 in FIG. Here, the control unit 11 (see FIG. 1) of the refrigerator 10 determines the command type and branches the process according to the command type. In the present embodiment, the "command type" is any one of "information request", "setting request", and "other". Here, the "information request" is a command for requesting refrigerator information (that is, notification, operation sign, parameter value, and door open / close count information) from the refrigerator 10.

If the command type is an information request, the process proceeds to step S12, the control unit 11 returns the refrigerator information to the mobile terminal 20 via the communication unit 13, and this routine ends.
If the command type is "setting request", the process proceeds from step S10 to step S14. Here, the "setting request" is a command for requesting the setting or change of the parameter value. In step S14, the control unit 11 determines whether or not the setting request should be rejected based on exclusive control.

Here, "exclusive control" refers to control for rejecting a setting request from the mobile terminal 20 based on the state of the refrigerator 10. For example, in the refrigerator 10, when any door in the housing 60 (see FIG. 1) is in the open state, the control unit 11 uses the “refrigerator room temperature”, “freezer room temperature”, “vacuum chilled room”, and the like. Rejects the setting of parameter values for each setting item of "spot cooling", "rapid cooling", "ice making function" and "power saving". Further, if the refrigerator 10 is "during ice making cleaning (during defrosting of the ice making room)", the control unit 11 refuses to set the parameter value related to the "ice making function". However, in this case, the control unit 11 determines each setting item of "refrigerator room temperature", "freezer room temperature", "vacuum chilled room", "spot cooling", "rapid cooling" and "power saving". Allow setting of parameter values.

If it is determined in step S14 that "Yes" (the setting request is rejected by exclusive control), the process proceeds to step S16, and the control unit 11 means "rejection of the setting request" via the communication unit 13. The NAK signal is returned to the mobile terminal 20, and this routine ends. Here, the NAK signal includes information indicating the reason for rejecting the setting request. Therefore, in the mobile terminal 20 that has received the NAK signal, a message based on the cause rejected by the exclusive control (for example, "in maintenance mode" or the like) is displayed on the operation / display unit 24 (see FIG. 1). Further, the mobile terminal 20 transmits an "information request" to the refrigerator 10 to acquire various states of the refrigerator 10 and updates the display contents on the mobile terminal 20.

On the other hand, if it is determined in step S14 that "No" (permits the setting request), the process proceeds to step S18, and the control unit 11 uses the communication unit 13 to ACK, which means "accept the setting request". The signal is returned to the mobile terminal 20. Next, when the process proceeds to step S20, the control unit 11 executes the content specified in the setting request. If the received command type is other, the process proceeds from step S10 to step S26, and the control unit 11 executes the other process.

(Conditions for generating information requests)
Here, the conditions under which the above-mentioned "information request" occurs in the mobile terminal 20 will be described. The information request occurs when the user performs a predetermined information update operation on the mobile terminal 20, a timer event occurs at predetermined time intervals, and a NAK signal is returned from the refrigerator 10. Here, the "information update operation" is, more specifically, an operation in which the user displays the driving information home screen V08 (driving information screen, see FIG. 4) on the mobile terminal 20. Further, the timer event occurs every 3 seconds when the mobile terminal 20 is in the house (more specifically, when communication with the LAN 52 is established). On the other hand, the timer event occurs every minute when the mobile terminal 20 is outside the home (more specifically, when communication with WAN 54 is established).

<User interface>
(Starting the application program)
When the user performs a predetermined operation (for example, tapping a predetermined icon) on the operation / display unit 24, the food / refrigerator management application program according to the present embodiment is started. When the application program is started, the recommended food ingredient screen display control unit 956 (see FIG. 1) displays, for example, the seasonal foodstuff home screen V02 (recommended foodstuff screen) shown in FIG. 3 on the operation / display unit 24.

Here, FIGS. 3 and 4 are diagrams showing the transition state of the screen when the application program is started.
In FIG. 3, the seasonal food home screen V02 includes left and right scroll buttons 90L and 90R. When the user taps the scroll button 90R on the screen V02, the shopping index display control unit 946 (see FIG. 1) transitions the display screen of the operation / display unit 24 to the shopping index home screen V04 (shopping index screen). When the user taps the scroll button 90L on the screen V02, the operation information screen display control unit 960 (see FIG. 1) shifts the display screen to the operation information home screen V08 (operation information screen) shown in FIG.

Further, when the user taps the scroll button 90R on the shopping index home screen V04, the recipe display screen control unit 958 (see FIG. 1) shifts the display screen to the recipe information home screen V06 (recipe display screen). As described above, the screens V02, V04, V06, and V08 all include the scroll button 90L and the scroll button 90R. Then, when the user taps the scroll button 90R, the display screen cyclically transitions as V02 → V04 → V06 → V08 → V02 → ....

Further, when the user taps the scroll button 90L, the display screen cyclically transitions as V02 → V08 → V06 → V04 → V02 → .... Further, these screens V02, V04, V06, V08 can be automatically scrolled by setting. When automatic scrolling is set, the cyclic screen selection unit 962 (see FIG. 1) displays the display screen every predetermined time (for example, 5 seconds to 10 seconds) from V02 → V04 → V06 → V08 → V02 → ... In order, the transition is made cyclically.

(Screen V02)
Further, in FIG. 3, the seasonal foodstuff home screen V02 has a main menu bar 100, a weather forecast display unit 140, a foodstuff information display unit 160, a navigation unit 150, and a submenu bar from the upper end to the lower end. 120 and are included. Here, the main menu bar 100 includes a menu button 102, a model display field 104, and a connection display field 106. The model display field 104 displays the model number of the refrigerator 10 controlled by the mobile terminal 20 (see FIG. 1). Further, the connection display field 106 displays whether or not the mobile terminal 20 has a bidirectional communication line connected to the refrigerator 10 to be controlled.

In addition, the weather forecast display unit 140 shows the date and time when the weather forecast was announced, the area targeted by the weather forecast, the contents of the weather forecast (for example, sunny and sometimes cloudy), the expected temperature, the expected humidity, and the forecast. The probability of precipitation is shown. This information was acquired by the weather information acquisition unit 944 (see FIG. 1) by accessing a predetermined weather site.

The food ingredient information display unit 160 displays information on seasonal foodstuffs (recommended foodstuffs) recommended to the user, and displays the seasonal foodstuff image display unit 162, the comment display unit 164, and the detailed display instruction button 166. Includes. The seasonal food image display unit 162 displays the food image data of the recommended food, and the comment display unit 164 displays a simple comment regarding the “seasonal food”. The detailed display instruction button 166 is a button for instructing the display of more detailed information regarding seasonal ingredients.

Further, the navigation unit 150 includes a dot indicator 152, a refrigerator content check button 154, and a usage concierge button 156. Further, the sub-menu bar 120 includes a home button 121, a food material management button 122, an operation status button 123, a support button 124, and a setting button 125.

(Overview of screens V04, V06, V08)
Further, in FIGS. 3 and 4, although some reference numerals in the drawings are omitted, the screens V04, V06, and V08 have a main menu bar 100 and a sub menu bar 120, as in the seasonal food home screen V02. , A weather forecast display unit 140, and a navigation unit 150 are included. Here, the dot indicator 152 includes four dots arranged in the horizontal direction, and each dot corresponds to the screens V02, V04, V06, and V08. Then, among the screens V02 to V08, the dots corresponding to the screen displayed on the operation / display unit 24 are turned on, and the other dots are turned off. As a result, the user can grasp at a glance which of V02 to V08 the screen displayed on the operation / display unit 24 is.

In FIG. 3, the shopping index home screen V04 includes a shopping index display unit 170 instead of the food information display unit 160 of the screen V02. The shopping index display unit 170 includes a humanoid icon 172, a shopping index SI, a comment character string CS, and a detailed display instruction button 178. The shopping index SI is an integer in the range of "0" to "100" and indicates the degree to which shopping is recommended. Further, the humanoid icon 172 is a humanoid icon having a figure corresponding to the shopping index. The comment character string CS is a character string corresponding to the shopping index. In the example shown in FIG. 3, the comment character string CS is a character string "text" to show a general example. However, the actual comment character string CS is the content according to the content of the weather forecast, the shopping index SI, and the like. The details of this comment character string CS will be described later.

Further, in FIG. 4, the recipe information home screen V06 includes a recipe information display unit 180 instead of the food information display unit 160 on the screen V02. The recipe information display unit 180 includes an image display unit 182 and a detailed display instruction button 184.

Further, the driving information home screen V08 includes a driving information display unit 190 instead of the food information display unit 160 of the screen V02. The operation information display unit 190 includes an icon display unit 192, a door opening / closing time display unit 194, a notification display unit 196, and a detailed display instruction button 198. When the mobile terminal 20 receives the "notification" from the corresponding refrigerator 10, the notification display unit 196 displays "notification" as shown in the figure. On the other hand, when there is no "notification", "normal operation" is displayed on the notification display unit 196 (not shown).

(Overview of screen V10)
FIG. 5 is a diagram showing an example of a menu dialog.
For example, when the user taps the menu button 102 on the screen V02 (see FIG. 3), the menu dialog 200 shown in FIG. 5 is displayed on the operation / display unit 24. In the menu dialog 200, the user can instruct the detailed display of "connection setting", "notice", "inquiry", "version information", "terms of use", or "copyright information". The user can also "log out" in the menu dialog 200.

(Seasonal food details screen V12)
FIG. 6 is a diagram showing an example of the seasonal food detail screen V12.
When the user taps the detailed display instruction button 166 of the food information display unit 160 on the seasonal food home screen V02 (see FIG. 4), the seasonal food detail screen V12 shown in FIG. 6 is displayed on the operation / display unit 24. NS. By the way, as shown in the figure, the dimensions and shape of the seasonal food detail screen V12 may be vertically longer than that of the operation / display unit 24. In this case, a part of the seasonal food detail screen V12 is actually displayed on the operation / display unit 24, and when the user scrolls the seasonal food detail screen V12, the hidden part is displayed on the operation / display unit 24. ..

The seasonal food detail screen V12 includes a food image display unit 212, a food weight display unit 214, a food name display unit 216, and a food explanation display unit 218. An image of the target food material is displayed on the food material image display unit 212. The food material weight display unit 214 displays the approximate weight of the food material. The name of the foodstuff is displayed on the foodstuff name display unit 216. The foodstuff description display unit 218 displays how to select the foodstuff, nutritional characteristics, storage method, and the like.

(Variation of shopping index home screen V04)
7 and 8 are diagrams showing an example of the shopping index home screens V04A, V04B, V04C, and V04D, which are variations of the shopping index home screen V04 (see FIG. 4).
The shopping index home screens V04A to V04D also include the shopping index display unit 170, as in the shopping index home screen V04 (see FIG. 3). However, the shopping index home screens V04A, V04B, V04C, and V04D are examples in which the shopping index SI is "50", "0", "80", and "100", respectively.

The humanoid icon 172 is an icon corresponding to these shopping indexes. Further, in the shopping index home screens V04B, V04C, and V04D in the figure, the character string "text" is shown as the comment character string CS in order to show a general example. However, as described above, the actual comment character string CS has contents according to the contents of the weather forecast, the shopping index SI, and the like. The details of this comment character string CS will be described later.

(Shopping index detail screen V14)
FIG. 9 is a diagram showing an example of the shopping index detail screen V14.
When the user taps the detailed display instruction button 178 on the shopping index home screens V04, V04A to V04D (see FIGS. 3, 7, and 8), the shopping index display control unit 946 (see FIG. 1) operates and displays the operation / display unit 24. On the other hand, the shopping index detail screen V14 as shown in the figure is displayed. The shopping index detail screen V14 includes a 24-hour weather display unit 222 and a weekly shopping index display unit 230.

On the 24-hour weather display unit 222, the contents of the weather forecast from the current time to the lapse of 24 hours are displayed by icons. In addition, the weekly shopping index display unit 230 includes seven lines (unsigned) corresponding to seven days including today. And each line contains a date 232, a humanoid icon 234, a weather forecast 236, an expected maximum / minimum temperature 238, and an expected precipitation probability 240. This allows the user to determine the appropriate date and time to go shopping.

(Recipe collection browser screen V15)
FIG. 10 is a diagram showing an example of a recipe collection browser screen V15, a recipe collection application migration confirmation screen V16, and a recipe collection application program screen V17.
When the user taps the detailed display instruction button 184 on the recipe information home screen V06 (see FIG. 4), the recipe display screen control unit 958 (see FIG. 1) sends a predetermined "recipe collection application program" to the mobile terminal 20. Determine if is installed. Then, when the recipe collection application program is not installed, the recipe display screen control unit 958 launches a browser on the mobile terminal 20 while designating the address of a predetermined "recipe collection site". The recipe collection browser screen V15 shown in FIG. 10 is an example of the display screen of the browser launched as a result.

(Recipe collection application migration confirmation screen V16)
When a predetermined "recipe collection application program" is installed on the mobile terminal 20, the recipe display screen control unit 958 (see FIG. 1) displays the recipe collection application migration confirmation screen V16 on the operation / display unit 24. Display it. The recipe collection application migration confirmation screen V16 includes a pop-up window 250 for confirming application migration. The pop-up window 250 includes a check box 251, a cancel button 252, and an OK button 254.

The check box 251 is toggled on / off each time the user taps it. When the user taps the cancel button 252, the recipe display screen control unit 958 (see FIG. 1) opens the browser while specifying the address of the "recipe collection site" as in the case where the recipe collection application program is not installed. Launch. As a result, for example, the recipe collection browser screen V15 is displayed on the operation / display unit 24.

(Recipe collection application program screen V17)
When the user taps the OK button 254, the recipe display screen control unit 958 (see FIG. 1) activates the recipe collection application program. The recipe collection application program screen V17 shown in FIG. 10 is an example of a display screen by the recipe collection application program launched as a result.

When the check box 251 described above is turned on and the cancel button 252 or the OK button 254 is tapped, the recipe display screen control unit 958 (see FIG. 1) stores the tapped button. After that, when the user taps the detailed display instruction button 184 on the recipe information home screen V06 (see FIG. 4), the recipe display screen control unit 958 displays the confirmation screen V16 on the stored button. Correspondingly, one of the screens V15 and V17 is displayed on the operation / display unit 24.

(Content image display screen V20)
FIG. 11 is a diagram showing an example of the content image display screen V20 and the shooting screen V22.
When the user taps the refrigerator contents check button 154 on any of the screens V02 to V08 (see FIGS. 3 and 4) described above, the control unit 21 (see FIG. 1) displays the contents image on the operation / display unit 24. Display the screen V20. The content image display screen V20 includes a back button 271, a storage room image display unit 272, a room selection button 273, and a camera button 274.

When the user taps the back button 271, the control unit 21 causes the operation / display unit 24 to redisplay the original screen (for example, the seasonal food home screen V02 in FIG. 3). The room selection button 273 is for selecting any of the storage rooms 61 to 64 (see FIG. 1) based on the operation of the user. The storage room image display unit 272 displays the latest storage room image of the selected storage room. The camera button 274 is a button for designating a picture of the selected storage chambers 61 to 64.

(Shooting screen V22)
When the user taps the camera button 274 on the content image display screen V20, the storage room image storage control unit 938 (see FIG. 1) causes the operation / display unit 24 to display the shooting screen V22. The shooting screen V22 includes a monitor image display unit 276 and a shooting button 277.

The monitor image display unit 276 displays the image acquired by the photographing unit 26. Then, when the user taps the shutter button 277, the storage room image storage control unit 938 stores the monitor image at that time in the storage unit 22 (see FIG. 1) as a storage room image corresponding to the selected storage room. Let me. At that time, if the storage room image corresponding to the storage room is already stored in the storage unit 22, the storage room image storage control unit 938 deletes the previous storage room image and updates it with a new storage room image. .. Next, the storage room image storage control unit 938 transmits the storage room image and specific information specifying the corresponding storage room to the data server 56 via the communication unit 23 and WAN 54.

Next, when the data server 56 receives the storage room image and the specific information, the data server 56 stores the storage room image in the image storage unit 912 in association with the specific information. At that time, if the storage room image corresponding to the specific information is already stored in the image storage unit 912, the data server 56 deletes the previous storage room image and updates it with a new storage room image. Next, the storage room image storage control unit 938 causes the operation / display unit 24 to display a new content image display screen for displaying the updated storage room image. The content image display screen V20A shown in FIG. 12 is an example.

(Display room switching screen V24)
FIG. 12 is a diagram showing an example of a display room switching screen V24, another content image display screen V20A, and room selection buttons 273A and 273B.
When the user taps the room selection button 273 on the content image display screen V20 (see FIG. 11), the storage room designation unit 936 (see FIG. 1) displays the display room switching screen V24 shown in FIG. 12 on the operation / display unit 24. Let me. The display room switching screen V24 includes a cancel button 280 and storage room selection buttons 281 to 284 corresponding to the storage rooms 61 to 64, respectively. Further, although not particularly shown, a storage chamber selection button corresponding to the vacuum chilled chamber 65 (see FIG. 1) and the ice making chamber 66 may be included in the display chamber switching screen V24.

When the user taps any of the storage room selection buttons 281 to 284, the storage room designation unit 936 selects the corresponding storage room (any of 61 to 64) as a display target. Next, the storage room designation unit 936 causes the operation / display unit 24 to display the original image (for example, the screen V20 of FIG. 11) while reflecting the selection of the display target. Further, when the user taps the cancel button 280, the storage room designation unit 936 causes the operation / display unit 24 to display the original image without changing the storage room to be displayed.

The room selection button 273A shown in FIG. 12 is an example of the room selection button 273 shown on the screen V20 (see FIG. 11), and the refrigerating room 61 (see FIG. 1) is selected as the storage room to be displayed. This is an example of the case. Here, when the user taps the storage room selection button 284 on the display room switching screen V24, the corresponding lower switching room 64 (see FIG. 1) is selected as the storage room to be displayed. Then, when the storage room designation unit 936 displays the original image (for example, the screen V20 of FIG. 11), the room selection button 273 included therein is changed like the room selection button 273B shown in FIG.

(How to use concierge top screen V30)
FIG. 13 is a diagram showing an example of a usage concierge top screen V30 and a free word search screen V32.
When the user taps the usage concierge button 156 on any of the screens V02 to V08 (see FIGS. 3 and 4) described above, the food ingredient designation unit 940 (see FIG. 1) of the control unit 21 is displayed on the operation / display unit 24. , How to use Display the concierge top screen V30.
The usage concierge top screen V30 includes a food storage guide unit 302, a refrigerator icon 308 (graphic), and a comment display unit 310.

The comment display unit 310 displays various proposals regarding how to use the refrigerator 10 (see FIG. 1). Further, the food material storage guide unit 302 includes a list designation unit 304 and a free word input unit 306. When the user wants to know an appropriate storage method for a certain food material (guide target food material), he / she can operate the food material storage guide unit 302 to specify the guide target food material and display the storage method.

(Free word search screen V32)
When the user taps the free word input unit 306, the foodstuff designation unit 940 (see FIG. 1) causes the free word search screen V32 to be displayed on the operation / display unit 24. The free word search screen V32 includes a free word display field 312, a microphone button 314, and a keyboard image 316. When the user taps the microphone button 314, the foodstuff designation unit 940 analyzes the voice acquired from the microphone 27 (see FIG. 1) and displays the result in the free word display field 312. Further, when the user operates the keyboard image 316 to input a character string, the food material designation unit 940 displays the input character string in the free word display field 312.

(Free word search screen V34)
FIG. 14 is a diagram showing an example of another free word search screen V34 and a guide screen V36.
The free word search screen V34 includes a free word display field 312, a candidate display field 320, and a keyboard image 316. The function of the keyboard image 316 is the same as that of the screen V32 (see FIG. 13) described above. Further, on the screen V34, "Niku" is input in the free word display field 312.

The candidate display field 320 displays a list of food ingredient names related to the input free word. In the illustrated example, "beef", "pork", "lamb", and "horse meat" are displayed as the names of ingredients related to the free word "meat". When the user taps any food material name in the candidate display field 320, the food material name is selected as the guide target food material.

In this way, when the guide target food material is selected, the position presenting unit 942 (see FIG. 1) causes the operation / display unit 24 to display the guide screen V36. The guide screen V36 includes a food material storage guide unit 302, a refrigerator icon 308, and a comment display unit 310, as in the usage concierge top screen V30 (see FIG. 13).

However, the food material name (beef in the illustrated example) of the food material to be guided is displayed on the free word input unit 306 of the food material storage guide unit 302. Further, the position presenting unit 942 displays in the refrigerator icon 308 the portion corresponding to the storage chambers 61 to 65 (see FIG. 1) suitable for storing the guide target food material in a color-coded manner. In the illustrated example, the portions corresponding to the freezing chamber 62 and the upper switching chamber 63 are color-coded. Further, the position presenting unit 942 displays a brief explanation or the like regarding the guide target food material on the comment display unit 310.

FIG. 15 is a diagram showing variations of the refrigerator icon 308 displayed on the usage concierge top screen V30 by the position presenting unit 942.
In the illustrated example, the refrigerator icon 308 is selected from a total of 13 patterns of "A" to "M". Here, the pattern "M" is a pattern selected when the guide target food material has not yet been specified, as shown on the screen V30 (see FIG. 13).

(Ingredient storage list screen V40)
FIG. 16 is a diagram showing an example of the foodstuff storage list screen V40.
How to use On the concierge top screen V30 (see FIG. 13), when the user taps the list designation unit 304, the food specification unit 940 (see FIG. 1) causes the operation / display unit 24 to display the food storage list screen V40. .. The foodstuff storage list screen V40 includes a foodstuff list 330. The foodstuff list 330 is a table representation of an appropriate storage temperature and an appropriate storage location for various foodstuffs.

(Ingredient management screen)
FIG. 17 is a diagram showing an example of the foodstuff management list display screen V50 and the foodstuff management list deletion screen V52.
When the user taps the food material management button 122 on any of the screens V02 to V08 (see FIGS. 3 and 4) described above, the food material data management unit 952 (see FIG. 1) of the control unit 21 stores in the storage unit 22. The operation / display unit 24 displays the foodstuff management list display screen V50 based on the foodstuff data. The foodstuff management list display screen V50 includes a main menu bar 100, a display operation unit 350, a foodstuff item list display unit 360, an editing operation unit 370, and a submenu bar 120. The contents of the main menu bar 100 and the sub menu bar 120 are the same as those of the screen V02 (see FIG. 3) described above.

In the illustrated example, the food material item enumeration display unit 360 includes four food material item fields 362-13-262-4. The food item list display unit 360 actually includes the fifth and subsequent food item items, and when the user scrolls the food item list display unit 360, the food data management unit 952 displays the remaining food item fields. .. Each food ingredient item column displays the contents of the above-mentioned food material data and the like.

In the food material management list display screen V50, the food material item column 362-2 includes a check box 382, a food material name field 384, an image display unit 386, a starting date date display unit 388, and an elapsed day number display unit 390. Here, the foodstuff name column 384 displays the foodstuff name included in the foodstuff data. The image display unit 386 displays the food material image data included in the food material data. The starting point date display unit 388 displays the starting date of the food material data. The elapsed days display unit 390 displays the number of days elapsed from the starting date to today. The structure of the other food item column is the same as that of the food item column 362-2, although the reference numeral is omitted.

The food material data management unit 952 (see FIG. 1) displays the elapsed days display unit 390, usually in black. However, if today's date is one month after the starting date, or if the current time is past the date and time based on the reminder information, the food material data management unit 952 changes the display color of the elapsed days display unit 390 to red. .. In FIG. 17, the elapsed days display unit 390 displayed in red is shown by a rectangular frame. That is, on the foodstuff management list display screen V50, the elapsed days display unit 390 in the foodstuff item column 362-1, 362-2 is displayed in red, and the other elapsed days display unit is displayed in black.

On the food material management list display screen V50, the display operation unit 350 includes a current date display field 352, a sort order instruction button 354, and a display format switching button 356. When the user taps the current date display field 352, the food material data management unit 952 (see FIG. 1) changes the sort order of the food material item list display unit 360. For example, the sort order can be changed to "date order" or "date reverse order". When the user taps the display format switching button 356, the food material data management unit 952 operates and displays the food material management album display screen V54 (see FIG. 18) described later on the operation / display unit 24 instead of the food material management list display screen V50. Display it.

Further, on the foodstuff management list display screen V50, the editing operation unit 370 includes an image capture button 372, a shooting button 374, and an editing button 376. When the user taps the image capture button 372, the food material data management unit 952 displays the image selection screen V66 (see FIG. 21) on the operation / display unit 24. On the image selection screen V66, the user can select any image data as food material image data. When the food material image data is selected, the food material data management unit 952 generates new food material data including the food material image data, and the food material management new addition / edit screen V60 corresponding to the new food material data (see FIG. 19). ) Is displayed on the operation / display unit 24. The details of the image selection screen V66 and the food management new addition / editing screen V60 will be described later.

Further, when the user taps the shooting button 374 on the food material management list display screen V50, the food material data management unit 952 (see FIG. 1) displays the shooting screen V22 (see FIG. 11) on the operation / display unit 24. When the user shoots the food material image data on the shooting screen V22, the food material data management unit 952 generates new food material data including the food material image data, and the food material management new addition / editing screen V60 corresponding to the new food material data is generated. (See FIG. 19) is displayed on the operation / display unit 24. Further, when the user taps the edit button 376 on the food material management list display screen V50, the food material data management unit 952 generates new food material data without food material image data. Then, the food material data management unit 952 causes the operation / display unit 24 to display the food material management new addition / editing screen V60 (see FIG. 19) corresponding to the new food material data.

Further, in the food material item list display unit 360, each check box 382 is for designating the food material data to be deleted, and the on / off state is toggled each time the user taps. When at least one check box 382 is turned on, the foodstuff data management unit 952 (see FIG. 1) changes the foodstuff management list display screen V50 to, for example, the foodstuff management list deletion screen V52 shown in the figure. The illustrated screen V52 is an example in which the food item item column 362-3 is turned on and the other food item fields are turned off.

On the foodstuff management list display screen V52, the character string "list deletion" is displayed on the display operation unit 350. Further, the editing operation unit 370 of the screen V52 includes a cancel button 377 and a delete button 378. When the user taps the delete button 378, the food item column (362-3 in the illustrated example) that is on and the corresponding food data are deleted. When the user taps the cancel button 377, all the check boxes 382 are turned off and the display screen returns to the screen V50.

FIG. 18 is a diagram showing an example of the foodstuff management album display screen V54 and the foodstuff management album deletion screen V56.
When the user taps the display format switching button 356 on the foodstuff management list display screen V50 (see FIG. 17) described above, the foodstuff data management unit 952 (see FIG. 1) displays the foodstuff management album display screen on the operation / display unit 24. Display V54. Similar to the screen V50, the foodstuff management album display screen V54 includes a main menu bar 100, a display operation unit 350, an editing operation unit 370, and a sub menu bar 120.

Further, the screen V54 includes a food material item list display unit 400 instead of the food item list display unit 360 (see FIG. 17) of the screen V50. In the illustrated example, the foodstuff item list display unit 400 includes four foodstuff item items 402-1 to 402-4. The food item list display unit 400 also includes the fifth and subsequent food item item fields, and when the user scrolls the food item list display unit 400, the food data management unit 952 operates and displays the remaining food item fields. Display on 24.

The food material item fields 402-1 to 402-4 have a substantially square shape, and these food material item fields are displayed in two columns in the vertical direction. In the food material item column 402-1 to 402-4, the corresponding food material image data is displayed over almost the entire area. In addition, each of the foodstuff item columns 402-1 to 402-4 includes a check box 404. The function of the check box 404 is the same as that of the check box 382 on the screen V50 (see FIG. 17).

Then, when at least one check box 404 is turned on, the food material data management unit 952 causes the operation / display unit 24 to display the food material management album deletion screen V56. On the screen V56, the display operation unit 350 and the editing operation unit 370 are changed in the same manner as those shown on the screen V52 (see FIG. 17). The functions of the cancel button 377 and the delete button 378 are also the same as those of the screen V52.

(Ingredient management new addition / editing screen V60)
FIG. 19 is a diagram showing an example of the food material management new addition / editing screen V60.
When adding new food material data or editing existing food material data, the food material data management unit 952 (see FIG. 1) causes the operation / display unit 24 to display the food material management new addition / edit screen V60. Here, when adding new food material data, any of the buttons 372, 374, and 376 is operated on the food material management list display screen V50 or the food material management album display screen V54 (see FIGS. 17 and 18) described above. If it is done. In addition, when editing the existing food material data, the part of the food material item column 362-13-262-4, 402-1 to 402-4 (see FIGS. 17 and 18) excluding the check boxes 382 and 404. When the user taps.

On the food management new addition / editing screen V60, the main menu bar 100, the back button 412, the image display unit 414, the image capture button 416, the shooting button 418, the starting date display unit 420, and the memo data editing column 422, a reminder information edit field 424, an alarm notification permission button 426, a save button 428, and a submenu bar 120 are included.

The function of the back button 412 is similar to that of the back button 271 (see FIG. 11) described above. When the user taps the shooting button 418, the food material data management unit 952 (see FIG. 1) displays the shooting screen V22 (see FIG. 11) on the operation / display unit 24. When the user taps the image capture button 416, the food material data management unit 952 displays the image selection screen V66 (details will be described later) shown in FIG. 22 on the operation / display unit 24. Therefore, the food material image data in the food material data can be changed through these screens. When the food material image data is changed, the food material data management unit 952 also changes the content of the image display unit 414 to the changed food material image data.

When the user taps the memo data editing field 422, a character editing dialog (not shown) is displayed, and the user can edit the contents of the memo data. Further, when the user taps the starting date display unit 420 or the reminder information editing field 424, the date selection calendar screen V62 (see FIG. 20) is displayed. This allows the user to set the origin date or reminder information.

Further, the retailer communication unit 954 (see FIG. 1) can transfer the foodstuff data stored in the foodstuff storage unit 914 of the data server 56 to the retailer server 58. As a result, the retailer can appropriately propose the foodstuff to be supplemented to the user. Further, the retailer communication unit 954 can receive data on foodstuffs from the retailer server 58 and display the received data on the operation / display unit 24. As a result, the user can easily grasp the contents of the bargain sale, for example.

Further, when the alarm notification permission button 426 is tapped, the on / off state of the alarm notification flag related to the food material data is toggled. In this way, when the user taps the save button 428 after inputting or editing various data, the control unit 21 updates the food material data based on the content input on the screen V60. Then, the control unit 21 causes the operation / display unit 24 to redisplay the original screens (for example, the screens V50 and V54 of FIGS. 17 and 18).

(Date selection calendar screens V62, V64)
FIG. 20 is a diagram showing an example of date selection calendar screens V62 and V64.
As described above, for example, when the user taps the starting date display unit 420 on the screen V60 (see FIG. 19), the control unit 21 (see FIG. 1) causes the operation / display unit 24 to display the screen V62 shown in FIG. The date selection calendar screen V62 includes a back button 432 and a calendar unit 434.

When the user taps the back button 432, the control unit 21 (see FIG. 1) displays the original screen (for example, FIG. 1) on the operation / display unit 24 without changing the target date (starting date, reminder information). The screen V60) of 19 is displayed again. Further, when the user specifies a date in the calendar unit 434, the control unit 21 changes the target date (starting date, reminder information) and displays the original screen (for example, screen V60 in FIG. 19) reflecting the result. Displayed on the operation / display unit 24. As shown in the figure, since the submenu bar 120 (see FIG. 19) is not displayed on the screen V62, the user can concentrate on inputting the date.

The date selection calendar screen V64 shown in FIG. 20 is a modification of the date selection calendar screen V62 described above. The date selection calendar screen V64 includes a drum roll menu unit 440. The drum roll menu unit 440 includes a cancel button 442, a decision button 444, and a date designation unit 446. When the user scrolls the date designation unit 446, any date is located at the cursor line 446a.

Then, when the user taps the enter button 444, the control unit 21 changes the target date (starting date, reminder information) and operates the original screen (for example, the screen V60 in FIG. 19) that reflects the result. It is displayed on the display unit 24. On the other hand, when the user taps the cancel button 442, the control unit 21 (see FIG. 1) displays the original screen (see FIG. 1) on the operation / display unit 24 without changing the target date (starting date, reminder information). For example, the screen V60) of FIG. 19 is redisplayed.

(Image selection screen V66)
FIG. 21 is a diagram showing an example of the image selection screen V66.
The image selection screen V66 includes a food material image thumbnail display unit 450, a cancel button 452, and a selection button 454. In the food material image thumbnail display unit 450, thumbnails (unsigned) of food material image data stored in the image storage unit 912 or the storage unit 22 (see FIG. 1) are arranged. When the user taps any thumbnail and then taps the selection button 454, the food image data related to the thumbnail is selected.

When the food material image data is selected, the control unit 21 causes the operation / display unit 24 to redisplay the original screen (for example, the screen V60 in FIG. 19) while reflecting the selection result of the food material image data. Further, when the user taps the cancel button 452, the control unit 21 causes the operation / display unit 24 to redisplay the original screen (for example, the screen V60 in FIG. 19) without changing the food image data.

(Operation information / top screen V70)
FIG. 22 is a diagram showing an example of the operation information / top screens V70 and V72.
When the user taps the operation status button 123 on any of the screens V02 to V08 (see FIGS. 3 and 4) described above, the operation information screen display control unit 960 (see FIG. 1) of the control unit 21 operates and displays. For example, the illustrated operation information / top screen V70 is displayed on the unit 24. The operation information / top screen V70 includes a main menu bar 100, a notification display unit 462, an operation sign unit 464, a graph display unit 466, and a sub menu bar 120.

The notification display unit 462 displays the presence / absence of various "notifications" (normal notifications, caution notifications, failure notifications) related to the refrigerator 10, and if the "notifications" exist, the latest date and time is displayed. In addition, the operation sign unit 464 has the above-mentioned operation signs, that is, "power consumption is suppressed", "please replenish water in the water supply tank", "ice making cleaning", "upper stage switching", "lower stage". "Switching", "Automatic ice maker is running", "Rapid ice making", "Rapid cooling", etc. are displayed one by one per line.

Further, the graph display unit 466 displays the door opening time (integrated time per day) of the refrigerator 10 as a histogram for each date. That is, in the histogram, the rectangular figure (unsigned) corresponding to each day becomes longer in the vertical direction as the door opening time on that day becomes longer. Further, since the histogram is displayed in different colors on the refrigerating room door and the refrigerating room door, the user can grasp each door opening time at a glance.

When the user taps the notification display unit 462, the control unit 21 (see FIG. 1) causes the operation / display unit 24 to display the notification history list screen V90 (see FIG. 26). The details of the notification history list screen V90 will be described later. When the user taps the operation sign unit 464, the control unit 21 causes the operation / display unit 24 to display the detailed information of the corresponding operation sign (not shown). By the way, as described above, the driving sign unit 464 displays one driving sign per line. The operation information / top screen V72 shown in FIG. 22 is an example in which the operation sign unit 464 has seven lines. In the screen V72, the graph display unit 466 is almost hidden, but when the user scrolls the screen, the entire graph display unit 466 can be displayed on the operation / display unit 24.

(Support screen V74)
FIG. 23 is a diagram showing an example of the support screen V74.
When the user taps the support button 124 on any of the screens V02 to V08 (see FIGS. 3 and 4) described above, the operation information screen display control unit 960 (see FIG. 1) of the control unit 21 is operated / displayed. For example, the illustrated support screen V74 is displayed on the 24. The support screen V74 includes a main menu bar 100, a support menu unit 470, and a sub menu bar 120. The support menu unit 470 includes a plurality of buttons 471 to 484, and when the user taps a desired button, a support operation corresponding to the button is executed.

(Settings / Top screen V80)
FIG. 24 is a diagram showing an example of the setting / top screen V80 and the cooling mode setting screen V82.
When the user taps the setting button 125 on any of the screens V02 to V08 (see FIGS. 3 and 4) described above, the control unit 21 (see FIG. 1) displays the operation / display unit 24, for example, the setting shown in the drawing. Display the top screen V80. The setting / top screen V80 includes a refrigerator setting unit 500, a notification setting button 522, a zip code setting button 524, and a notification history list button 526.

Further, the refrigerator setting unit 500 includes a refrigerating room setting unit 501, an ice making room setting unit 506, an upper switching room setting unit 503, a lower switching room setting unit 504, a cooling mode setting unit 515, and other setting units 516. And are included. When the user taps the cooling mode setting unit 515 on the setting / top screen V80, the operation information screen display control unit 960 (see FIG. 1) causes the operation / display unit 24 to display, for example, the illustrated cooling mode setting screen V82.

(Cooling mode setting screen V82)
The cooling mode setting screen V82 includes a back button 532, a spot cooling setting unit 534, and a rapid cooling setting unit 536. The function of the back button 532 is similar to that of the back button 271 (see FIG. 11) described above. When the user taps the spot cooling setting unit 534, the operation information screen display control unit 960 toggles the on / off state of the spot cooling mode. Here, the "spot cooling mode" is a mode in which the temperature of the low-temperature refrigerating space (not shown), which is a predetermined portion of the refrigerating chamber 61 (see FIG. 1), is lowered more than usual.

Further, when the user taps the rapid cooling setting unit 536, the operation information screen display control unit 960 toggles the on / off state of the rapid cooling mode. Here, the "quick cooling mode" means that the temperature of food placed in the automatic rapid cooling space (not shown), which is a predetermined portion of the refrigerating chamber 61 (see FIG. 1), is detected by a sensor, and the detected temperature is measured. If it is equal to or more than a predetermined value, it is a mode in which the automatic rapid cooling space is rapidly cooled.

(Notification setting screen V84)
FIG. 25 is a diagram showing an example of the notification setting screen V84 and the other setting screen V86.
When the user taps the notification setting button 522 on the setting / top screen V80 (see FIG. 24), the operation information screen display control unit 960 (see FIG. 1) displays, for example, the illustrated notification setting screen V84 on the operation / display unit 24. Display it. The notification setting screen V84 includes a back button 542, an ice making completion setting unit 543, an ice making cleaning end setting unit 544, a door open setting unit 545, and a foreign matter detection setting unit 546 of the ice tray. ..

The function of the back button 542 is similar to that of the back button 271 (see FIG. 11) described above. Further, when the user taps each setting unit 543, 544, 545 or 546, the operation information screen display control unit 960 displays "ice making completed", "ice making cleaning finished", "door open" or "foreign matter detection of ice tray". Toggle whether or not to notify the user as "notification".

(Other setting screen V86)
When the user taps the other setting unit 516 on the setting / top screen V80 (see FIG. 24), the operation information screen display control unit 960 (see FIG. 1) displays, for example, the other setting screen V86 shown in the figure on the operation / display unit 24. Display it. The other setting screen V86 includes a back button 552, a power saving mode setting unit 554, and a volume setting unit 556.

The function of the back button 552 is similar to that of the back button 271 (see FIG. 11) described above. Further, when the user taps the power saving mode setting unit 554, the operation information screen display control unit 960 toggles the on / off state of the "power saving mode" that saves power consumption. When the user taps the volume setting unit 556, the operation information screen display control unit 960 causes the operation / display unit 24 to display a pop-up window (not shown) for adjusting the volume.

(Zip code setting screen V88)
FIG. 26 is a diagram showing an example of the postal code setting screen V88 and the notification history list screen V90.
When the user taps the zip code setting button 524 on the setting / top screen V80 (see FIG. 24), the zip code input unit 948 (see FIG. 1) displays, for example, the illustrated zip code setting screen V88 on the operation / display unit 24. Display it. The postal code setting screen V88 includes a back button 562, a postal code input field 564, and a setting button 566.

The function of the back button 562 is similar to that of the back button 271 (see FIG. 11) described above. In addition, the user can input the postal code of the residential area in the postal code input field 564. Then, when the setting button 566 is tapped with the zip code input, the zip code input unit 948 stores the zip code in the storage unit 22 (see FIG. 1). The geographic information estimation unit 950 estimates the geographic information of the user's residential area based on this zip code. When the weather information acquisition unit 944 (see FIG. 1) accesses a predetermined weather site and acquires a weather forecast, the area related to this geographical information is set as the area to be the target of the weather forecast.

(Notification history list screen V90)
When the user taps the notification history list button 526 on the setting / top screen V80 (see FIG. 24), the operation information screen display control unit 960 (see FIG. 1) is displayed on the operation / display unit 24, for example, the illustrated notification history list screen. Display V90. The notification history list screen V90 includes a back button 572 and a notification history list 574.

The function of the back button 572 is the same as that of the back button 271 (see FIG. 11) described above. In addition, the notification history list 574 includes one or more lines corresponding to the "notification" received in the past. Each line of the notification history list 574 includes a reception date 582 related to the "notification", a reception time 584, and a notification code 586 indicating the type of the "notification". When the user taps any line of the notification history list 574, the operation information screen display control unit 960 causes the operation / display unit 24 to display a detailed screen (not shown) showing the details of the "notification".

<Details of shopping index SI>
FIG. 27 is a diagram showing a weather distribution point SIA, a maximum temperature distribution point SIB, a precipitation probability distribution point SIC, a wind speed distribution point SID, and an icon table 580.
The shopping index SI shown on the shopping index home screen V04 (see FIG. 3) or the like is equal to the sum of the weather distribution point SIA, the maximum temperature distribution point SIB, the precipitation probability distribution point SIC, and the wind speed distribution point SID. In other words, the shopping index display control unit 946 (see FIG. 1) calculates the shopping index SI by "SI = SIA + SIB + SIC + SID".

As shown in FIG. 27, the weather allocation SIA is determined according to the expected weather. As shown in the figure, when the weather includes "storm" such as "storm" and "storm", the weather allocation SIA is "30". If the weather does not include "storm" but includes "rain" or "snow", the weather allocation SIA is "50". In addition, the weather allocation SIA is "100" for other weather. Further, as shown in FIG. 27, the maximum temperature distribution point SIB is determined according to the predicted maximum temperature. For example, when the predicted maximum temperature in 1 ° C increments is "-1 ° C or less", the maximum temperature distribution SIB is "-20", and when it is "0-9 ° C", the maximum temperature distribution SIB is ". -10 ".

Further, as shown in FIG. 27, the precipitation probability allocation point SIC is determined according to the precipitation probability. For example, when the predicted probability of precipitation in 10% increments is "0%", the probability of precipitation SIC is "0", and when the probability of precipitation is "10-40%", the probability of precipitation SIC is "-10". Is. Further, as shown in FIG. 27, the wind speed distribution point SID is determined according to the predicted wind speed. For example, when the predicted wind speed in 1 m / s increments is "4 m / s or less", the wind speed distribution point SID is "0", and when it is "5-9 m / s", the wind speed distribution point SID is "-10". ".

When the shopping index SI is calculated, the shopping index display control unit 946 (see FIG. 1) selects the humanoid icon 172 to be displayed on the shopping index display unit 170 (see screen V04 in FIG. 3) based on the icon table 580. .. Further, the shopping index display control unit 946 determines a rank which is an integer of "1" to "5" based on the shopping index SI and the icon table 580.

<Details of comment character string CS>
FIG. 28 is a diagram showing an example of a weather comment management table 590, a wind speed comment management table 592, a temperature comment management table 594, a precipitation probability comment management table 596, and a rank comment management table 598.
The comment character string CS shown on the shopping index home screen V04 (see FIG. 3) and the like includes a weather comment CSA (not shown), a wind speed comment CSB (not shown), and a temperature comment CSC (not shown). It is a comment character string in which a precipitation probability comment CSD (not shown) and a rank comment CSE (not shown) are combined as necessary.

The management tables 590 to 598 in FIG. 28 are stored in the shopping index display control unit 946 (see FIG. 1) in order to manage the comments CSA to CSE. In the figure, the specific comment character strings of each comment CSA to CSE are omitted, but the weather comment CSA is, for example, "Today there is a blizzard warning. Let's refrain from going out." As you can see, it is a comment string about the weather. In addition, the wind speed comment CSB is a comment character string related to the wind speed, for example, "A strong wind warning is issued today. Let's refrain from going out."

In addition, the temperature comment CSC is a comment character string related to the temperature, for example, "A warning about heat stroke is issued today. Please refrain from going out and rehydrate." In addition, the precipitation probability comment CSD is a comment character string related to the precipitation probability, such as "Today's precipitation probability is 90%. Please bring rain gear when you go out." The rank comment CSE is a comment character string corresponding to the "rank" of "1" to "5" shown in the icon table 580 of FIG. 27.

If "Yes" is described in the "Comment presence / absence" column of each management table 590-598, the corresponding comment character string exists, and if it is "-", the corresponding comment character string does not exist. It shows that. The comment character string CS (see FIG. 3) is a combination of the above-mentioned comment CSA, CSB, CSC, CSD, and CSE as necessary, and the comment character string CS has a predetermined maximum number of characters (for example, 32 characters). ) Is defined. Therefore, the shopping index display control unit 946 (see FIG. 1) combines the comments CSA to CSE in descending order of priority within the range of the maximum number of characters or less, and adopts the result as the comment character string CS. In FIG. 28, the values shown in the “Priority” column of each management table 590 to 598 indicate that the smaller the value, the higher the priority.

<Modification example>
The present invention is not limited to the above-described embodiment, and various modifications are possible. The above-described embodiments are exemplified for the purpose of explaining the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described. Further, another configuration may be added to the configuration of the above embodiment, and a part of the configuration may be replaced with another configuration. In addition, the control lines and information lines shown in the figure show what is considered necessary for explanation, and do not necessarily show all the control lines and information lines necessary for the product. In practice, it can be considered that almost all configurations are interconnected. Possible modifications to the above embodiment are, for example, as follows.

(1) In the above embodiment, the user manages the foodstuffs stored in the refrigerator 10 on the screens V50 to V66 (see FIGS. 17 to 21) and the like. However, the image analysis unit 964 analyzes a photograph of the inside of the refrigerator 10 (for example, the photograph of the storage room image display unit 272 in FIG. 11) so that the foodstuffs stored in the refrigerator 10 are automatically determined. You may.

(2) Further, in the above embodiment, when the recipe display screen control unit 958 (see FIG. 1) displays the recipe information home screen V06 (see FIG. 4), the food material data stored in the food material storage unit 914 is displayed. A recipe using such ingredients or seasonal ingredients (recommended ingredients) shown on the seasonal ingredients home screen V02 (see FIG. 3) may be selected and displayed.

(3) Further, in the above embodiment, when the user operates the room selection button 273 and the display room switching screen V24 (see FIG. 12), the storage room designation unit 936 (see FIG. 1) takes a picture of the storage room. It was specified which storage chambers 61-64 (see FIG. 1) the image corresponds to. However, the refrigerator 10 may transmit the open / close information indicating the open / closed state of the doors of the storage chambers 61 to 64 to the mobile terminal 20. That is, the storage room designation unit 936 may specify which storage room 61 to 64 (see FIG. 1) corresponds to the storage room image to be captured based on the opening / closing information.

(4) Since the hardware of the mobile terminal 20 in the above embodiment can be realized by a general computer, a program or the like that executes the above-mentioned various processes may be stored in a storage medium or distributed via a transmission path. ..

<Effect of embodiment>
As described above, the refrigerator management device (20) of the present embodiment includes a plurality of refrigerator management devices (20) provided in the refrigerator 10 based on the user's operation on the operation / display unit 24 for inputting / outputting information or the information supplied from the refrigerator 10. The storage room designation unit 936 that designates any of the storage rooms 61 to 64 and the image acquired from the photographing unit 26 that captures the image are associated with the storage rooms 61 to 64 designated by the storage room designation unit 936. As the storage room image, the storage room image storage control unit 938 to be stored in the image storage unit 912 is provided. As a result, the storage chamber image can be clearly associated with the corresponding storage chambers 61 to 64, so that the user can appropriately manage the foodstuffs in the refrigerator.

Further, the refrigerator management device (20) includes a food material designation unit 940 that accepts food material designation, and a storage room 61 in which an appropriate storage temperature range is set for the designated food material among the plurality of storage rooms 61 to 65. It is preferable to further include a position presenting unit 942 that presents the positions of ~ 65 by the figure (308). As a result, the user can clearly grasp the appropriate storage chambers 61 to 65 for the foodstuff to be stored, and can manage the foodstuff more appropriately.

In addition, the refrigerator management device (20) has a weather information acquisition unit 944 that acquires current or future weather information, and a shopping index screen (V04) that displays a shopping index that is the degree to which shopping is recommended based on the weather information. It is preferable to further include a shopping index display control unit 946 for displaying the above on the operation / display unit 24. As a result, the user can determine an appropriate day to go shopping, and can manage the ingredients more appropriately.

Further, when a new storage room image is supplied from the storage room image storage control unit 938 when the image storage unit 912 stores the storage room image for any of the storage rooms 61 to 64, the new storage room It is preferable to have a function of updating the conventional storage room image by the image. As a result, the user can easily browse the latest storage room image of the designated storage room, and can manage the ingredients more appropriately.

Further, the refrigerator management device (20) further includes a zip code input unit 948 that accepts the input of a zip code, and a geographic information estimation unit 950 that estimates geographic information related to the zip code based on the input zip code. In preparation, it is more preferable that the weather information acquisition unit 944 acquires the weather information corresponding to the geographical information. As a result, for example, when the postal code of the user's place of residence is input, the weather information of the place of residence and the shopping index based on the weather information of the place of residence are acquired even when the user is away from the place of residence. This allows the user to manage the ingredients more appropriately.

Further, the refrigerator management device (20) has a food material data management unit 952 that causes the food material storage unit 914 that stores food material data related to the food material stored in the refrigerator 10 to add and delete food material data, and food material data. It is more preferable to further include an inter-retailer communication unit 954 that notifies the retailer server 58 operated by the retailer. Thereby, for example, the food material data can be transmitted to the retailer, and the retailer can appropriately propose the foodstuff to be supplemented to the user.

Further, it is more preferable that the retailer communication unit 954 receives data on sales information of the foodstuffs related to the retailer from the retailer server 58. As a result, the user can easily grasp the contents of the bargain sale, for example.

Further, the refrigerator management device (20) operates / displays the recommended food ingredient screen display control unit 956 that causes the operation / display unit 24 to display the recommended food ingredient screen (V02) for notifying the recommended foodstuff which is the recommended foodstuff. The recipe display screen control unit 958 that displays the recipe display screen (V06) that notifies the recipe to the unit 24, and the operation information screen (V08) that notifies the operation / display unit 24 of the operation information of the refrigerator 10. The operation information screen display control unit 960, the recommended food ingredient screen (V02), the shopping index screen (V04), the recipe display screen (V06), and the operation information screen (V08) are cyclically changed. It is preferable to further include a cyclic screen selection unit 962. As a result, the user can cyclically browse a plurality of screens V02 to V08 displaying important information.

Further, it is preferable that the refrigerator management device (20) further includes an image analysis unit 964 that analyzes images in the storage room and acquires food material data related to the foodstuffs stored in the storage rooms 61 to 64. As a result, the food material data can be automatically collected, and the time and effort for the user to input the food material data can be reduced.

Further, the refrigerator management device (20) further includes a food material data management unit 952 for adding and deleting food material data to the food material storage unit 914 for storing food material data related to the food material stored in the refrigerator 10. It is more preferable that the recipe display screen control unit 958 displays the ingredients related to the ingredient data or the recipe using the recommended ingredients on the recipe display screen (V06). As a result, the user can easily confirm the recipe using the ingredients related to the ingredient data or the recommended ingredients.

10 Refrigerator 20 Mobile terminal (refrigerator management device)
21 Control unit (computer)
24 Operation / display unit 26 Photography unit 58 Retailer server 61-66 Storage room 308 Refrigerator icon (figure)
912 Image storage unit 914 Food storage unit 936 Storage room designation unit (storage room designation means)
938 Storage room image storage control unit (storage room image storage control means)
940 Foodstuff designation unit 942 Location presentation unit 944 Weather information acquisition unit 946 Shopping index display control unit 948 Zip code input unit 950 Geographic information estimation unit (geographic information acquisition unit)
952 Food data management unit 954 To retailer communication department 956 Recommended food screen display control unit 958 Recipe display screen control unit 960 Operation information screen display control unit 962 Circular screen selection unit 964 Image analysis unit V02 screen, foodstuff home screen (recommended foodstuff) screen)
V04 Shopping index home screen (shopping index screen)
V06 Recipe information home screen (recipe display screen)
V08 Driving information home screen (driving information screen)

Claims (10)

A storage room designation unit that specifies one of a plurality of storage rooms provided in the refrigerator based on the user's operation on the operation / display unit for inputting / outputting information or the information supplied from the refrigerator.
It is provided with a storage room image storage control unit that stores an image acquired from a photographing unit that captures an image in an image storage unit as a storage room image associated with the storage room designated by the storage room designation unit. A refrigerator management device characterized by. Ingredients designation department that accepts ingredients designation and
A claim, further comprising a position presenting unit that graphically presents the position of the storage chamber in which an appropriate storage temperature range is set for a designated food material among the plurality of the storage chambers. The refrigerator management device according to 1. The weather information acquisition department that acquires current or future weather information,
The operation of the shopping index screen that displays the shopping index, which is the degree to which shopping is recommended, is calculated according to a part or all of the group consisting of the weather, the temperature, the probability of precipitation, and the wind speed included in the weather information. The refrigerator management device according to claim 1 or 2, further comprising a shopping index display control unit for displaying on the display unit. When a new storage room image is supplied from the storage room image storage control unit while the image storage unit is storing an image of the storage room for any of the storage rooms, the new storage room image is used as a conventional image storage unit. The refrigerator management device according to any one of claims 1 to 3, wherein the storage chamber image has a function of updating the image. The weather information acquisition department that acquires current or future weather information,
Further equipped with a geographic information estimation unit that estimates or acquires geographic information regarding the place where the refrigerator is installed.
The refrigerator management device according to any one of claims 1 to 4, wherein the weather information acquisition unit acquires the weather information corresponding to the geographic information. A geographic information estimation unit that estimates or acquires geographic information about the location where the refrigerator is installed,
A food material data management unit that allows the food material storage unit that stores food material data related to the food material stored in the refrigerator to add and delete the food material data.
Further equipped with a retailer communication department that notifies the retailer server operated by the retailer of the food material data.
The refrigerator management device according to any one of claims 1 to 5, wherein at least a part of the retailers to which the food material data is notified is determined according to the geographical information. The refrigerator management device according to claim 6, wherein the retailer communication unit receives data on foodstuffs sold by the retailer from the retailer server. A recommended food screen display control unit that displays a recommended food screen for notifying the recommended food, which is a recommended food, to the operation / display unit.
A recipe display screen control unit that displays a recipe display screen that notifies the recipe to the operation / display unit.
An operation information screen display control unit that displays an operation information screen for notifying the operation information of the refrigerator to the operation / display unit.
The third aspect of claim 3, further comprising a cyclic screen selection unit for cyclically transitioning the recommended food ingredient screen, the shopping index screen, the recipe display screen, and the operation information screen. Refrigerator management device. A food material data management unit for adding and deleting the food material data is further provided for the food material storage unit for storing food material data related to the food material stored in the refrigerator.
The refrigerator management device according to claim 8, wherein the recipe display screen control unit displays the foodstuff related to the foodstuff data or a recipe using the recommended foodstuff on the recipe display screen. Computer,
Operation for inputting / outputting information ・ A storage room designation means for designating one of a plurality of storage rooms provided in the refrigerator based on the user's operation on the display unit or the information supplied from the refrigerator.
A storage room image storage control means for storing an image acquired from a photographing unit for capturing an image in an image storage unit as a storage room image associated with the storage room designated by the storage room designating means.
A program to function as.

Images