CN113154788A

CN113154788A - Refrigerator management apparatus, and computer readable medium

Info

Publication number: CN113154788A
Application number: CN202010918862.8A
Authority: CN
Inventors: 小川真申; 堀井笃史; 兼坂尚宏; 吉川晴奈; 岩渕真也
Original assignee: Hitachi Global Life Solutions Inc
Current assignee: Hitachi Global Life Solutions Inc
Priority date: 2020-01-23
Filing date: 2020-09-04
Publication date: 2021-07-23

Abstract

The present invention provides a refrigerator management apparatus, a management apparatus, and a computer-readable medium, which enable a user to appropriately manage food materials in a refrigerator. In a refrigerator management device (20), provided are: a storage chamber specifying unit (936) that specifies any one of a plurality of storage chambers (61-64) provided in the refrigerator (10) on the basis of the user's operation on an operation/display unit (24) that inputs and outputs information, or information supplied from the refrigerator (10); and a storage room internal image storage control unit (938) that causes the image storage unit (912) to store the image acquired from the imaging unit (26) that captures the image as a storage room internal image corresponding to the storage room (61-64) specified by the storage room specifying unit (936).

Description

Refrigerator management apparatus, and computer readable medium

Technical Field

The invention relates to a refrigerator management apparatus, a management apparatus and a computer readable medium.

Background

Patent document 1 discloses a technique of selling information on the entry and exit of a refrigerator to a third party such as a food seller 17 and providing a reward to each merchant as a user of the refrigerator (claim 1, 0088, pages 0095 to 0097).

Patent document 1: japanese patent laid-open publication No. 2003-263543

Disclosure of Invention

Generally, a seller sells food under the restriction of a shop address, a distribution range, and the like. Therefore, it is difficult to expect significance of obtaining stock information on entry and exit of a refrigerator that is too far away. Therefore, it is expected that obtaining the address of the refrigerator provided or the address of the user of the refrigerator at the same time is effective for making an efficient sales policy or the like.

In this way, it is desirable for the user of the refrigerator to register geographic information such as a zip code corresponding to the installation address of the refrigerator, but such registration often gives a cumbersome impression to the user, and if no user benefit is provided by the registration, the geographic information cannot be efficiently acquired. Patent document 1 discloses consideration as a user benefit, but payment of consideration requires acquisition of personal information such as a merchant address and bank account information or information close to the personal information.

On the other hand, in recent years, users who feel a contradiction in providing personal information are also increasing. Therefore, a method for providing an arbitrary user benefit without providing personal information is desired, for example, by limiting the range to the "regional" level to which the business belongs, that is, by not individually determining the provision of anonymous information and pseudonymous information of the individual and the business.

The first invention proposed in view of the above-mentioned circumstances is a management apparatus,

acquiring food material data related to food materials stored in a refrigerator and geographic information related to an installation area of the refrigerator or a living area of a user of the refrigerator,

providing provided information corresponding to the geographic information that is different from the geographic information.

In addition, a second invention proposed in view of the above situation is a management apparatus,

providing food material data related to food materials stored in a refrigerator to a computer transmitting sales information of the food materials to a device used by a user of the refrigerator,

the computer is selected according to geographical information related to an installation area of the refrigerator or a residential area of the user.

In view of the above circumstances, a third aspect of the present invention is a management device,

acquiring geographic information related to an installation area of the refrigerator or a residential area of a user of the refrigerator and current or future weather information corresponding to the geographic information,

and outputting a shopping index, which is a recommended shopping degree corresponding to a part or all of a group consisting of weather, air temperature, precipitation probability, and wind speed included in the weather information.

Drawings

Fig. 1 is a block diagram of a refrigerator control system of a preferred embodiment.

Fig. 2 is a flowchart of an instruction receiving routine executed in the refrigerator.

Fig. 3 is a diagram showing a transition state of a screen at the time of application startup.

Fig. 4 is another diagram showing a transition state of a screen at the time of application startup.

Fig. 5 is a diagram showing an example of a menu dialog.

Fig. 6 is a diagram showing an example of a detailed view of the material.

Fig. 7 is a diagram showing a modification of the shopping index home screen.

Fig. 8 is a diagram showing another modification of the shopping index home screen.

Fig. 9 is a diagram showing an example of a shopping index detail screen.

Fig. 10 is a diagram showing an example of a recipe set browsing screen, a recipe set application transition confirmation screen, and a recipe set application screen.

Fig. 11 is a diagram showing an example of the content image display screen and the shooting screen.

Fig. 12 is a diagram showing an example of a display room switching screen, another contents image display screen, and an indoor selection button.

Fig. 13 is a diagram showing an example of a usage method introduction/top screen and a free word search screen.

Fig. 14 is a diagram showing another example of the free word search screen and the guidance screen.

Fig. 15 is a diagram showing a modification of the refrigerator icon.

Fig. 16 is a diagram showing an example of a food storage list screen.

Fig. 17 is a diagram showing an example of a food material management list display screen and a food material management list deletion screen.

Fig. 18 is a diagram showing an example of a food material management gallery display screen and a food material management gallery deletion screen.

Fig. 19 is a diagram showing an example of a food material management new addition/editing screen.

Fig. 20 is a diagram showing an example of a date selection calendar screen.

Fig. 21 is a diagram showing an example of an image selection screen.

Fig. 22 is a diagram showing an example of the operation information/top screen.

Fig. 23 is a diagram showing an example of a support screen.

Fig. 24 is a diagram showing a setting/top screen and a cooling mode setting screen.

Fig. 25 is a diagram showing an example of the notification setting screen and the other setting screens.

Fig. 26 is a diagram showing an example of a postal code setting screen and a notification history list screen.

Fig. 27 is a diagram showing a weather score, a maximum air temperature score, a precipitation probability score, a wind speed score, and an icon table.

Fig. 28 is a diagram showing examples of a weather review management table, a wind speed review management table, a temperature review management table, a precipitation probability review management table, and a level review management table.

Detailed Description

< Structure of embodiment >

Fig. 1 is a block diagram showing a hardware configuration of a refrigerator control system S of the preferred embodiment.

The refrigerator control system S includes one or more (M) refrigerators 10-1 to 10-M (hereinafter, sometimes collectively referred to as "refrigerator 10") and one or more (N) portable terminals 20-1 to 20-N (refrigerator management device, computer, hereinafter, sometimes collectively referred to as "portable terminal 20").

The refrigerator 10 and the portable terminal 20 can communicate with each other via the LAN52 and can communicate with each other via the LAN52 and the WAN 54. The LAN52 is, for example, a wireless LAN in a home, and the WAN54 is, for example, the internet. The data server 56 is a server device operated by the manufacturer of the refrigerator 10, is connected to the WAN54, and includes an image storage unit 912 and a food material storage unit 914. Additionally, the retailer server 58 is a server device operated by the retailer.

The refrigerator 10 includes a control unit 11, a storage unit 12, a communication unit 13, an operation/display unit 14, a freezing/refrigerating unit 15, and a casing 60. The freezing/refrigerating section 15 includes a compressor, a heat exchanger, and the like. The operation/display unit 14 includes an LED display, a membrane switch (membrane switch), and the like, and displays various states of the refrigerator 10 to a user, and the user can input various commands (command) via the membrane switch and the like.

Further, the casing 60 of the refrigerator 10 includes a refrigerating compartment 61, a freezing compartment 62, an upper stage switching compartment 63, a lower stage switching compartment 64, a fresh food (chilled) compartment 65, and an ice making compartment 66. These are sometimes collectively referred to as "storage chambers 61 to 66".

The storage unit 12 stores various information. The communication unit 13 communicates with the mobile terminal 20 and the like via the LAN 52. The control unit 11 includes hardware of a general computer, such as a CPU (central Processing unit), a ram (random Access memory), and a ROM (read Only memory), and a control program executed by the CPU, various data, and the like are stored in the ROM.

Here, the refrigerating room 61 is a door-open type refrigerating room (preservation temperature is about 2 to 6 ℃), but the refrigerating room 61 may be a cold room (chilled room). The upper stage switching room 63 and the lower stage switching room 64 are drawer-type rooms, and the user can arbitrarily select their functions from a plurality of candidates in the operation/display unit 14. Here, the optional function candidates are, for example, a vegetable room (preservation temperature is about 3 to 7 ℃), a refrigerating room (which is 2 to 6 ℃), a fresh keeping room (which is-1 to 1 ℃), a freezing room (which is-20 to-18 ℃), and the like. Further, the controller 11 sets the air pressure of the fresh food compartment 65 to about 0.8 atmosphere. However, the vacuum fresh-keeping chamber 65 may be set to a non-vacuum state (about 1 atmosphere) according to the setting of the user.

The portable terminal 20 includes a control unit 21, a storage unit 22, a communication unit 23, an operation/display unit 24, an imaging unit 26, and a microphone 27. The operation/display unit 24 includes a flat panel display and a touch sensor provided on the surface thereof, and displays various information to the user and enables the user to input various instructions. The communication section 23 communicates with the refrigerator 10 and the like via the LAN52 or the WAN 54.

The storage unit 22 stores various information. The data stored in the

storage units

12 and 22 is not necessarily stored in the refrigerator 10 or the portable terminal 20, and a storage device storing the data may be provided in another device such as a server and may be accessed via the LAN52 or the WAN 54. The image pickup unit 26 picks up a moving image or a still image in accordance with an instruction from the control unit 21. The microphone 27 collects sound.

The control unit 21 includes hardware of a general computer such as a CPU, a RAM, and a ROM, and a control program executed by the CPU, various data, and the like are stored in the ROM. In fig. 1, functions realized by a control program and the like are shown as blocks in the control unit 21. That is, the control unit 21 includes a storage room specifying unit 936 (storage room specifying means), a storage room internal image storage control unit 938 (storage room internal image storage control means), a food material specifying unit 940, a position presenting unit 942, a weather information obtaining unit 944, a shopping index display control unit 946, a zip code input unit 948, a geographic information estimating unit 950 (geographic information obtaining unit), a food material data management unit 952, a retailer-specific communication unit 954, a recommended food material screen display control unit 956, a recipe display screen control unit 958, an operation information screen display control unit 960, a circulation screen selecting unit 962, and an image analyzing unit 964. The functions of the components of the control unit 21 will be described later.

(refrigerator information)

In the storage portion 12 of the refrigerator 10, various information related to the refrigerator 10 is stored. The stored information is referred to as "refrigerator information". The refrigerator information is transferred to the portable terminal 20, and a copy of the refrigerator information is stored in the storage section 22 of the portable terminal 20. Thereby, the user can confirm the refrigerator information by operating the portable terminal 20. The "refrigerator information" includes a notification, an operation flag, a parameter value, door opening/closing time information, and the like.

Here, the "notification" is information reported to the user, and includes a general notification, an attention notification, a failure notification, and the like. The "general notification" refers to general information of the refrigerator 10. For example, if the user instructs "ice-making cleaning (defrosting of the ice-making chamber)", the information of completion is reported to the user when "ice-making cleaning" is completed. Note that the "notice" is a notice that a phenomenon to be noticed occurs although the refrigerator 10 is not malfunctioning, and is information that reports when a door is opened (a door of a refrigerating room, a freezing room, or the like is opened for a predetermined time (for example, 3 minutes) or more), for example. The "failure notification" is information that reports a failure of the refrigerator 10 (e.g., abnormal temperature of each part, abnormal rotation of the motor, overcurrent, etc.) when the failure occurs.

The "door opening/closing time information" is an integration of the opening/closing times of the doors of the freezer compartment, the refrigerator compartment, and the like for each day including the current day for the past 10 days. The "operation flag" is information for reporting the operation states such as "power consumption is being suppressed (power saving operation is being performed)", "water is required to be supplied to the water supply tank", "ice making cleaning (defrosting of the ice making chamber)", "upper stage switching is in progress", "lower stage switching is in progress", "automatic ice maker is in operation", "rapid ice making is in progress", and "rapid cooling is in progress". The "middle of upper stage switching" and "middle of lower stage switching" respectively indicate functions such as changing the set temperatures of the upper stage switching chamber 63 and the lower stage switching chamber 64 (see fig. 1).

The "parameter value" refers to various values that can be set from the mobile terminal 20. For example, in the refrigerator 10, there are "temperature of the refrigerating room 61" and "temperature of the freezing room 62" as setting items, and parameter values can be set for these items from candidates of the 3 th order of "weak", "medium", and "strong", or the 11 th order of "1" to "11". Further, as for the "parameter value" corresponding to the vacuum refreshing chamber 65, the parameter value can be set from 3 candidates of "refreshing (refrigeration temperature about +1 ℃)", "freezing temperature (refrigeration temperature about-2 ℃)"), and "vacuum off (refrigeration temperature is a normal refrigeration temperature and air pressure is about 1 atm)".

Further, there are setting items such as "spot cooling mode" and "rapid cooling mode" for the refrigerating room, and parameter values can be selected from on or off for these. The ice making chamber 66 of the refrigerator 10 is provided with an "ice making function" for which parameter values can be selected from "rapid ice making", "ice making", and "stop". Further, there are setting items such as "power saving" and "operation section lock" for the refrigerator 10, and for these, parameter values can be selected from on and off. Further, there are setting items such as "sound volume" for the refrigerator 10, and parameter values can be selected from "standard", "large", and "off" for these.

(food data)

The storage unit 22 of each portable terminal 20 can store, for example, material data related to materials stored in the refrigerator 10. The food data stored in the storage unit 22 is transferred to the food storage unit 914 of the data server 56, and the food data stored in the food storage unit 914 is transferred to another portable terminal 20 that controls the same refrigerator 10. This enables the plurality of mobile terminals 20 to share the same food material data in real time.

Each food material data includes food material image data, memo (memo) data, reminder information, an alarm notification flag, and a start date. The "food material image data" is arbitrary image data, and may be image data other than food materials. However, since the image data is included in the food material data and it is considered that the image data of the food material is often used, the image data is referred to as "food material image data" in the present specification.

Note that the "remark data" is arbitrary character data of about several tens of characters, and a character string such as a name and a description of the material is generally applied. The "start date" is arbitrary date data that becomes a starting point for the food, and may be a date at which the photographing unit 26 photographs the food image data or stores the food image data in the storage unit 22. If the start date is set as the photographing date or the storage date of the material image data, the start date can be automatically set in accordance with the operation of the photographing unit 26, which is convenient for the user. In addition, since it is considered that these dates are often identical to or close to the storage start date of the food materials stored in the refrigerator 10, it is also easy to ensure accuracy. Of course, the date of purchase of the food material and the date of storage in the refrigerator 10 may be used.

The "reminder information" is information for specifying the date and time when the reminder is given to the user. The reminder information may be, for example, as "5/3/2019 PM 10: 00 ", or a date and time relatively specified with reference to the start day, such as" 14 days from the start day ". The "alarm notification flag" is information specifying that a predetermined alarm operation (for example, a buzzer sound or a vibration of the mobile terminal 20) is performed (on) or not performed (off) when a user is reminded of the alarm.

< actions of the embodiment >

(receiving an instruction of the refrigerator 10)

Fig. 2 is a flowchart of an instruction receiving routine executed in the refrigerator 10. In the present embodiment, each portable terminal 20 can transmit various commands to any refrigerator 10. When the refrigerator 10 receives an arbitrary instruction, the instruction receiving routine shown in fig. 2 is started.

If the refrigerator 10 receives the instruction, in fig. 2, the process proceeds to step S10. Here, the control unit 11 (see fig. 1) of the refrigerator 10 determines the type of the instruction, and branches the process according to the type of the instruction. In the present embodiment, the "instruction type" is any one of "information request", "setting request", and "other". Here, the "information request" is a command for requesting refrigerator information (i.e., notification, operation flag, parameter value, and door opening/closing frequency information) from the refrigerator 10.

If the command type is an information request, the process proceeds to step S12, and the control unit 11 returns the refrigerator information to the mobile terminal 20 via the communication unit 13, and the routine ends.

In addition, if the instruction type is "setting request", the process proceeds from step S10 to step S14. Here, the "setting request" refers to a command for requesting setting or changing of a parameter value. In step S14, the control unit 11 determines whether or not the setting request should be rejected based on the exclusive control.

Here, the "exclusive control" refers to a control of rejecting a setting request from the portable terminal 20 according to the state of the refrigerator 10. For example, when any one of the doors of the casing 60 (see fig. 1) of the refrigerator 10 is in the open state, the control unit 11 rejects the setting of the parameter values for each setting item of "temperature of refrigerating room", "temperature of freezing room", "fresh food compartment", "spot cooling", "quick cooling", "ice making function", and "power saving". In addition, if it is "in ice making cleaning (in defrosting of the ice making chamber)" in the refrigerator 10, the control part 11 rejects the setting of the parameter value related to the "ice making function". However, in this case, the control unit 11 permits setting of the parameter values for each setting item of "temperature of refrigerating room", "temperature of freezing room", "vacuum fresh room", "spot cooling", "rapid cooling", and "power saving".

If it is determined as "yes" in step S14 (the setting request is rejected by the exclusive control), the process proceeds to step S16, and the control unit 11 returns a NAK signal indicating "reject the setting request" to the mobile terminal 20 via the communication unit 13, and the routine ends. Here, the NAK signal includes information indicating the reason why the setting request is rejected. Therefore, in the mobile terminal 20 that has received the NAK signal, the operation/display unit 24 (see fig. 1) displays a message (for example, "in maintenance mode" or the like) based on the reason for rejection by exclusive control. The mobile terminal 20 transmits an "information request" to the refrigerator 10, acquires various states of the refrigerator 10, and updates the display content of the mobile terminal 20.

On the other hand, if it is determined in step S14 as "no" (permission setting request), the process proceeds to S18, and the controller 11 returns an ACK signal indicating "approval setting request" to the mobile terminal 20 via the communication unit 13. Next, if the process proceeds to step S20, the control portion 11 executes the content specified by the setting request. When the received command type is other, the process proceeds from step S10 to step S26, and the controller 11 executes other processes.

(conditions for generating information request)

Here, the condition that the above-described "information request" is generated in the mobile terminal 20 will be described. The information request is generated when a user performs a predetermined information update operation in the mobile terminal 20, when a timer event is generated every predetermined time, and when a NAK signal is returned from the refrigerator 10. More specifically, the "information update operation" refers to an operation in which the user displays the operation information home screen V08 (operation information screen, see fig. 4) on the mobile terminal 20. In addition, when the mobile terminal 20 is located indoors (more specifically, when communication with the LAN52 is established), a timer event occurs every 3 seconds. On the other hand, when the mobile terminal 20 is located outdoors (more specifically, when communication with the WAN54 is established), a timer event is generated every 1 minute.

< user interface >

(initiation of application)

If the user performs a predetermined operation (for example, clicking a predetermined icon) on the operation/display unit 24, the food/refrigerator management application of the present embodiment is started. When the application is started, the recommended food material screen display control unit 956 (see fig. 1) causes the operation/display unit 24 to display, for example, the hour food material home screen V02 (recommended food material screen) shown in fig. 3.

Here, fig. 3 and 4 are diagrams showing a transition state of a screen at the time of application startup.

In fig. 3, the season food home screen V02 includes left and

right scroll buttons

90L and 90R. When the user clicks the scroll button 90R on the screen V02, the shopping mall display controller 946 (see fig. 1) transitions the display screen of the operation/display unit 24 to the shopping mall home screen V04 (shopping mall screen). Further, if the user clicks the scroll key 90L on the screen V02, the operation information screen display control unit 960 (see fig. 1) transitions the display screen to the operation information home screen V08 (operation information screen) shown in fig. 4.

Further, if the user clicks the scroll button 90R on the shopping index home screen V04, the recipe display screen control unit 958 (see fig. 1) transitions the display screen to the recipe information home screen V06 (recipe display screen). In this way, the screens V02, V04, V06, and V08 include

scroll buttons

90L and 90R. Then, if the user clicks the scroll key 90R, the display screen cyclically migrates as V02 → V04 → V06 → V08 → V02 → … ….

In addition, if the user clicks the scroll key 90L, the display screen cyclically migrates as in V02 → V08 → V06 → V04 → V02 → … …. The screens V02, V04, V06, and V08 can be automatically scrolled by setting. When the auto scroll is set, the circulation screen selecting unit 962 (see fig. 1) cyclically shifts the display screen in the order of V02 → V04 → V06 → V08 → V02 → … … at predetermined time intervals (for example, 5 seconds to 10 seconds).

(Picture V02)

In fig. 3, the season food home screen V02 includes, from the top to the bottom, a main menu bar 100, a weather forecast display unit 140, a food material information display unit 160, a navigation unit 150, and a side menu bar 120. The main menu bar 100 includes a menu button 102, a model display column 104, and a connection display column 106. The model display field 104 displays the model of the refrigerator 10 to be controlled by the mobile terminal 20 (see fig. 1). The connection display field 106 displays whether or not a bidirectional communication line is connected between the portable terminal 20 and the refrigerator 10 to be controlled.

The weather forecast display unit 140 displays the date and time when the weather forecast is released, the area to be subjected to the weather forecast, the content of the weather forecast (for example, cloudy weather), the predicted temperature, the predicted humidity, and the predicted precipitation probability. The weather information acquisition unit 944 (see fig. 1) accesses a predetermined weather site to acquire these pieces of information.

The food material information display unit 160 displays information on a season food material (recommended food material) recommended to the user, and includes a season food material image display unit 162, a comment display unit 164, and a detailed display instruction button 166. The season food image display unit 162 displays food material image data of the recommended food material, and the comment display unit 164 displays a simple comment on "season food material". The detailed display instruction button 166 is a button for instructing display of more detailed information for the current food material.

The navigation unit 150 includes a point indicator 152, a refrigerator content check button 154, and a use method introduction (containment) button 156. The side menu 120 includes a home button 121, a food material management button 122, an operation status button 123, a support button 124, and a setting button 125.

(summaries of pictures V04, V06 and V08)

Note that, although some of the symbols in the drawings are omitted in fig. 3 and 4, the screens V04, V06, and V08 include a main menu bar 100, a sub menu bar 120, a weather forecast display unit 140, and a navigation unit 150, as in the case of the seasonal food material home screen V02. Here, the dot indicator 152 includes 4 dots arranged in the horizontal direction, and each dot corresponds to a screen V02, V04, V06, or V08. Among the screens V02 to V08, the point corresponding to the screen being displayed on the operation/display unit 24 is in the on state, and the other points are in the off state. This allows the user to clearly recognize at a glance which screen is displayed on the operation/display unit 24 is V02 to V08.

In fig. 3, the shopping index home screen V04 includes a shopping index display unit 170 instead of the food material information display unit 160 of the screen V02. The shopping-index display unit 170 includes a human-shaped icon 172, a shopping index SI, a comment character string CS, and a detailed-display instruction button 178. The shopping index SI is an integer ranging from "0" to "100" and indicates the degree of recommended shopping. The human icon 172 is a human icon of a figure corresponding to the shopping index. In addition, the comment string CS is a string corresponding to the shopping index. In the example shown in fig. 3, the comment character string CS represents a general example and is therefore a character string such as "text". However, the actual comment string CS is the content of the weather forecast, the content corresponding to the shopping index SI, and the like. This comment string CS will be described in detail later.

In fig. 4, the recipe information home screen V06 includes a recipe information display unit 180 instead of the food material information display unit 160 of the screen V02. The recipe information display unit 180 includes an image display unit 182 and a detailed display instruction button 184.

The operation information home screen V08 includes an operation information display unit 190 in place of the food information display unit 160 of the screen V02. The operation information display unit 190 includes an icon display unit 192, a door open/close time display unit 194, a notification display unit 196, and a detailed display instruction button 198. If the mobile terminal 20 receives "notification" from the corresponding refrigerator 10, the notification display unit 196 displays "notification is present" as shown in the drawing. On the other hand, if there is no "notification", the notification display unit 196 displays "normal operation" (not shown).

(overview of Picture V10)

Fig. 5 is a diagram showing an example of a menu dialog.

For example, if the user clicks the menu button 102 on the screen V02 (see fig. 3), the menu dialog 200 shown in fig. 5 is displayed on the operation/display unit 24. The user can instruct detailed display of "connection setting", "notification", "consultation", "version information", "usage regulation", or "copyright information" in the menu dialog 200. In addition, the user can perform "logout (logout)" in the menu dialog 200.

(detailed picture of season food material V12)

Fig. 6 is a diagram showing an example of the detailed food material screen V12.

When the user clicks the detailed display instruction button 166 of the food material information display unit 160 on the season food home screen V02 (see fig. 4), the operation/display unit 24 displays a season food material detailed screen V12 shown in fig. 6. However, as shown in the drawings, the food material detail screen V12 may be longer in size and shape than the operation/display unit 24. In this case, a part of the material detailed screen V12 is actually displayed on the operation/display unit 24, and if the user scrolls the material detailed screen V12, a hidden part is displayed on the operation/display unit 24.

The schedule food material detailed screen V12 includes a food material image display unit 212, a food material weight display unit 214, a food material name display unit 216, and a food material description display unit 218. The food material image display unit 212 displays an image of the target food material. The approximate weight of the material is displayed in the material weight display unit 214. The name of the food is displayed on the food name display unit 216. The food material specification display unit 218 displays a selection method, nutritional characteristics, a preservation method, and the like of the food material.

(variation of shopping index Home Picture V04)

Fig. 7 and 8 are views showing examples of shopping-index home screens V04A, V04B, V04C, and V04D, which are variations of the shopping-index home screen V04 (see fig. 4).

The shopping mall index home screen images V04A to V04D also include a shopping mall index display unit 170, as in the shopping mall index home screen image V04 (see fig. 3). However, the shopping index home screens V04A, V04B, V04C, and V04D are examples of cases where the shopping index SI is "50", "0", "80", and "100", respectively.

The human icon 172 corresponds to the shopping indices. Note that, since the shopping index home screens V04B, V04C, and V04D in the figure show a common example, a character string such as "text" is shown as the comment character string CS. However, as described above, the actual comment string CS is the content of the weather forecast and the content corresponding to the shopping index SI. This comment string CS will be described in detail later.

(shopping mall index details picture V14)

Fig. 9 is a diagram showing an example of the shopping-index detail screen V14.

When the user clicks the detailed display instruction button 178 on the shopping index home screen images V04, V04A to V04D (see fig. 3, 7, and 8), the shopping index display controller 946 (see fig. 1) causes the operation/display unit 24 to display a shopping index detailed screen image V14 as shown in the figure. The shopping mall indices detail screen V14 includes a 24-hour weather display unit 222 and a weekly shopping mall indices display unit 230.

The 24-hour weather display unit 222 displays the contents of the weather forecast from the current time to the elapse of 24 hours by an icon. Further, 7 lines (without a symbol) corresponding to 7 days including the current day are included in the weekly shopping index display unit 230. Each row includes a date 232, a human icon 234, a weather forecast 236, a predicted maximum/minimum air temperature 238, and a predicted precipitation probability 240. Thus, the user can determine the appropriate date and time when the user goes out to make a purchase.

(recipe collection browsing picture V15)

Fig. 10 is a diagram showing an example of the recipe set browsing screen V15, the recipe set application transition confirmation screen V16, and the recipe set application program screen V17.

When the user clicks the detailed display instruction button 184 on the recipe information home screen V06 (see fig. 4), the recipe display screen control unit 958 (see fig. 1) determines whether or not a predetermined "recipe set application" is installed on the portable terminal 20. Then, when the recipe set application is not installed, the recipe display screen control unit 958 activates the browser in the mobile terminal 20 while designating the address of a predetermined "recipe set website". The recipe set browsing screen V15 shown in fig. 10 is an example of a display screen of the browser that is started as a result.

(recipe set application transfer confirmation screen V16)

When a predetermined "recipe set application" is installed in the mobile terminal 20, the recipe display screen control unit 958 (see fig. 1) causes the operation/display unit 24 to display the recipe set application transition confirmation screen V16. The recipe set application transition confirmation screen V16 includes a pop-up window 250 for application transition confirmation. The pop-up window 250 includes a check box 251, a cancel button 252, and an OK button 254.

The check box 251 switches the switching on/off state every time the user clicks. When the user clicks the cancel button 252, the recipe display screen control unit 958 (see fig. 1) designates an address of a "recipe set website" and starts the browser, as in the case where the recipe set application program is not installed. Thereby, for example, the recipe set browsing screen V15 is displayed on the operation/display unit 24.

(recipe set application program picture V17)

Further, if the user clicks the OK button 254, the recipe display screen control unit 958 (see fig. 1) starts the recipe set application. The recipe set application screen V17 shown in fig. 10 is an example of a display screen of the recipe set application started as a result.

When the check box 251 is in the on state and the cancel button 252 or the OK button 254 is clicked, the recipe display screen control unit 958 (see fig. 1) stores the clicked button. Then, if the user clicks the detailed display instruction button 184 on the recipe information home screen V06 (see fig. 4) thereafter, the recipe display screen control unit 958 does not display the confirmation screen V16, and causes the operation/display unit 24 to display one of the screens V15 and V17 in accordance with the stored button.

(Contents image display screen V20)

Fig. 11 is a diagram showing an example of the content image display screen V20 and the shooting screen V22.

If the user clicks the refrigerator content check button 154 on any one of the screens V02 to V08 (see fig. 3 and 4), the control unit 21 (see fig. 1) causes the operation/display unit 24 to display the content image display screen V20. The content image display screen V20 includes a return button 271, a storage room internal image display unit 272, an indoor selection button 273, and a camera button 274.

When the user clicks the return button 271, the control unit 21 causes the operation/display unit 24 to display the original screen (for example, the hour food home screen V02 in fig. 3) again. The indoor selection button 273 is used to select any one of the storage chambers 61 to 64 (see fig. 1) according to the operation of the user. The storage room interior image display unit 272 displays the latest storage room interior image of the selected storage room. The camera button 274 is a button for specifying the selected storage room 61-64.

(photograph V22)

When the user clicks the camera button 274 on the content image display screen V20, the storage room internal image storage controller 938 (see fig. 1) causes the operation/display unit 24 to display a shooting screen V22. The shooting screen V22 includes a monitor image display unit 276 and a shooting key 277.

The monitor image display unit 276 displays the image acquired by the imaging unit 26. Then, if the user clicks the shutter key 277, the storage room internal image storage control unit 938 stores the monitored image at that point in time in the storage unit 22 (see fig. 1) as a storage room internal image corresponding to the selected storage room. At this time, when the storage unit 22 already stores the storage room internal image corresponding to the storage room, the storage room internal image storage control unit 938 deletes the previous storage room internal image and updates the storage room internal image with a new storage room internal image. Next, the storage room internal image storage control unit 938 transmits the storage room internal image and identification information for identifying the corresponding storage room to the data server 56 via the communication unit 23 and the WAN 54.

Next, if the data server 56 receives the storage room internal image and the identification information, the data server 56 stores the storage room internal image in the image storage unit 912 in association with the identification information. At this time, when the internal image of the storage room corresponding to the identification information is already stored in the image storage unit 912, the data server 56 deletes the previous internal image of the storage room and updates the internal image of the storage room with a new internal image of the storage room. Next, the storage room internal image storage control unit 938 causes the operation/display unit 24 to display a new content image display screen indicating the updated storage room internal image. The content image display screen V20A shown in fig. 12 is an example thereof.

(display room switching picture V24)

Fig. 12 is a diagram showing an example of the display room switching screen V24, the other content image display screen V20A, and the

indoor selection buttons

273A and 273B.

When the user clicks on room selection button 273 in content image display screen V20 (see fig. 11), storage room designation unit 936 (see fig. 1) causes operation/display unit 24 to display room switching screen V24 shown in fig. 12. The display room switching screen V24 includes a cancel button 280 and storage room selection buttons 281 to 284 corresponding to the storage rooms 61 to 64, respectively. Although not shown in particular, the display room switching screen V24 may include storage room selection buttons corresponding to the fresh food compartment 65 (see fig. 1) and the ice making compartment 66.

If the user clicks any one of the storage room selection buttons 281 to 284, the storage room designating unit 936 selects the corresponding storage room (any one of 61 to 64) as the display object. Next, the storage room designating unit 936 displays the original image (for example, the screen V20 in fig. 11) on the operation/display unit 24 while reflecting the selection of the display object. Further, if the user clicks the cancel button 280, the storage room specifying unit 936 does not change the storage room to be displayed, and causes the operation/display unit 24 to display the original image.

Indoor selection key 273A shown in fig. 12 is an example of indoor selection key 273 displayed on screen V20 (see fig. 11) or the like, and is an example of a case where a storage room to be displayed in refrigerating room 61 (see fig. 1) is selected. Here, if the user clicks storage room selection key 284 on display room switching screen V24, the corresponding lower switching room 64 (see fig. 1) is selected as the storage room to be displayed. Then, if the storage compartment designation unit 936 displays the original image (for example, screen V20 in fig. 11), the indoor selection button 273 included therein is changed as in the case of the indoor selection button 273B shown in fig. 12.

(method of use introduction/Top Panel V30)

Fig. 13 is a diagram showing an example of the usage method introduction/top screen V30 and the free word search screen V32.

When the user clicks the use method introduction button 156 on any one of the screens V02 to V08 (see fig. 3 and 4), the food material specifying unit 940 (see fig. 1) of the control unit 21 causes the operation/display unit 24 to display the use method introduction/top screen V30.

The usage introduction/top screen V30 includes a food material storage guide unit 302, a refrigerator icon 308 (graphic), and a comment display unit 310.

Various advice contents related to the usage method of the refrigerator 10 (refer to fig. 1) are displayed in the comment display portion 310. The material storage guide unit 302 includes a list specification unit 304 and a free word (free word) input unit 306. When the user desires to know an appropriate storage method for a certain food material (guidance target food material), the user can designate the guidance target food material by operating the food material storage guidance unit 302 and display the storage method.

(free word retrieval picture V32)

When the user clicks the free word input unit 306, the food material specification unit 940 (see fig. 1) causes the operation/display unit 24 to display the free word search screen V32. The free word search screen V32 includes a free word display field 312, a microphone button 314, and a keyword image 316. When the user clicks the microphone button 314, the material specifying unit 940 analyzes the voice acquired from the microphone 27 (see fig. 1) and displays the result in the free word display field 312. In addition, if the user operates the keyword image 316 to input a character string, the food material specifying section 940 displays the input character string in the free word display field 312.

(free word retrieval picture V34)

Fig. 14 is a diagram showing another example of the free word search screen V34 and the guide screen V36.

The free word search screen V34 includes a free word display field 312, a candidate display field 320, and a keyword image 316. The function of the keyword image 316 is the same as that of the screen V32 (see fig. 13). On the screen V34, "meat" is input to the free word display field 312.

The candidate display column 320 displays a list of food material names associated with the input free words. In the illustrated example, "beef", "pork", "mutton", and "horse meat" are displayed as food material names associated with the free word "meat". If the user clicks any one of the food item names in the candidate display column 320, the food item name is selected as the guidance-target food item.

When the material to be instructed is selected in this way, the position presenting unit 942 (see fig. 1) causes the operation/display unit 24 to display the instruction screen V36. The guidance screen V36 includes a food storage guidance unit 302, a refrigerator icon 308, and a comment display unit 310, as in the use method introduction/top screen V30 (see fig. 13).

However, the material name (beef in the illustrated example) of the guidance target material is displayed on the free word input unit 306 of the material storage guidance unit 302. The position presenting unit 942 displays, in color, a portion corresponding to the storage compartments 61 to 65 (see fig. 1) suitable for storing the material to be instructed in the refrigerator icon 308. In the illustrated example, the portions corresponding to the freezing chamber 62 and the upper stage switching chamber 63 are displayed in color separation. The position presenting unit 942 also displays a simple explanation or the like about the guidance target food material on the comment display unit 310.

Fig. 15 is a diagram showing a modification of the refrigerator icon 308 displayed on the use method introduction/top screen V30 by the position presenting unit 942.

In the illustrated example, the refrigerator icon 308 is selected from a total of 13 patterns of "a" to "M". Here, the pattern "M" is a pattern selected when the guidance target food material has not been specified as in the screen V30 (see fig. 13).

(food storage list screen V40)

Fig. 16 is a diagram showing an example of the food material storage list screen V40.

When the user clicks the list specification unit 304 on the usage method introduction/top screen V30 (see fig. 13), the food material specification unit 940 (see fig. 1) causes the operation/display unit 24 to display the food material storage list screen V40. The food material storage list screen V40 includes a food material list 330. The food material list 330 represents appropriate storage temperatures and appropriate storage locations for each food material in a table format.

(food material management screen)

Fig. 17 is a diagram showing an example of the food material management list display screen V50 and the food material management list deletion screen V52.

When the user clicks the material management key 122 on any one of the screens V02 to V08 (see fig. 3 and 4), the material data management unit 952 (see fig. 1) of the control unit 21 causes the operation/display unit 24 to display the material management list display screen V50 based on the material data stored in the storage unit 22. The food material management list display screen V50 includes a main menu bar 100, a display operation unit 350, a food material item list display unit 360, an editing operation unit 370, and a sub menu bar 120. The contents of the main menu bar 100 and the sub menu bar 120 are the same as the above-described screen V02 (see fig. 3).

In the illustrated example, the food item list display 360 includes 4 food item columns 362-1 to 362-4. The food item list display unit 360 actually includes the fifth and subsequent food item columns, and if the user scrolls through the food item list display unit 360, the food data management unit 952 displays the remaining food item columns. Each food item column displays the content of the food data and the like.

In the food material management list display screen V50, the food material item column 362-2 includes a check box 382, a food material name column 384, an image display unit 386, a start date display unit 388, and an elapsed day number display unit 390. Here, the food material name column 384 displays the food material name included in the food material data. The image display unit 386 displays the food material image data included in the food material data. The start date display unit 388 displays the start date of the material data. The elapsed days display unit 390 displays the elapsed days from the start day to the current day. Note that the other food item column is not shown, but is similar to the food item column 362-2.

The food material data management unit 952 (see fig. 1) normally displays the elapsed days display unit 390 in black. However, when the date of the current day exceeds 1 month from the start date or when the current time exceeds the date and time of the reminder information, the food material data management unit 952 changes the display color of the elapsed day display unit 390 to red. In fig. 17, the elapsed day display unit 390 displayed in red is shown by a rectangular frame. That is, in the food material management list display screen V50, the elapsed days display unit 390 in the food material item columns 362-1 and 362-2 is displayed in red, and the other elapsed days display units are displayed in black.

The food material management list display screen V50 includes a current date display field 352, a sort order instruction button 354, and a display format switching button 356 in the display operation unit 350. When the user clicks the current date display column 352, the food material data management unit 952 (see fig. 1) changes the sort order of the food material item list display unit 360. For example, the sort order can be changed to "date order" or "reverse order of dates". Further, if the user clicks the display format switching button 356, the food material data manager 952 causes the operation/display unit 24 to display a food material management gallery display screen V54 (see fig. 18) described later instead of the food material management list display screen V50.

The material management list display screen V50 includes an image acquisition button 372, a shooting button 374, and an editing button 376 in the editing operation unit 370. When the user clicks the image input button 372, the food material data management unit 952 causes the operation/display unit 24 to display an image selection screen V66 (see fig. 21). In the image selection screen V66, the user can select any one of the image data as the food material image data. When the material image data is selected, the material data management unit 952 generates new material data including the material image data, and causes the operation/display unit 24 to display a material management new addition/edition screen V60 (see fig. 19) corresponding to the new material data. The image selection screen V66 and the food material management new addition/editing screen V60 will be described in detail later.

Further, if the user clicks the photographing button 374 on the food material management list display screen V50, the food material data management unit 952 (see fig. 1) causes the operation and display unit 24 to display a photographing screen V22 (see fig. 11). When the user photographs the food material image data on the photographing screen V22, the food material data management unit 952 generates new food material data including the food material image data, and causes the operation/display unit 24 to display a new food material management addition/editing screen V60 (see fig. 19) corresponding to the new food material data. In addition, if the user clicks the edit button 376 on the food material management list display screen V50, the food material data management unit 952 generates new food material data without food material image data. Then, the food material data management unit 952 causes the operation and display unit 24 to display a new food material management addition/edition screen V60 (see fig. 19) corresponding to the new food material data.

In the food item list display unit 360, each check box 382 is used to designate food data to be deleted, and switches the on/off state each time the user clicks. If at least one of the check boxes 382 is in an on state, the food material data management unit 952 (see fig. 1) changes the food material management list display screen V50, for example, as in the illustrated food material management list deletion screen V52. The illustrated screen V52 is an example of a case where the material item column 362-3 is in an open state and the other material item columns are in a closed state.

On the food material management list deletion screen V52, the display operation unit 350 displays a character string "list deletion". The editing operation unit 370 of the screen V52 includes a cancel button 377 and a delete button 378. If the user clicks the delete button 378, the food item column (362-3 in the illustrated example) in the open state and the corresponding food data are deleted. Further, if the user clicks the cancel button 377, all check boxes 382 are turned off, and the display screen returns to screen V50.

Fig. 18 is a diagram showing an example of the food material management gallery display screen V54 and the food material management gallery deletion screen V56.

When the user clicks the display format switching button 356 on the food material management list display screen V50 (see fig. 17), the food material data management unit 952 (see fig. 1) causes the operation/display unit 24 to display a food material management gallery display screen V54. Similarly to the screen V50, the material management gallery display screen V54 includes a main menu bar 100, a display operation unit 350, an editing operation unit 370, and a sub menu bar 120.

Further, the screen V54 includes a food item list display unit 400 instead of the food item list display unit 360 of the screen V50 (see fig. 17). In the illustrated example, the food item list display unit 400 includes 4 food item columns 402-1 to 402-4. The food item list display unit 400 further includes the fifth and subsequent food item columns, and if the user scrolls through the food item list display unit 400, the food data management unit 952 causes the operation/display unit 24 to display the remaining food item columns.

The food item columns 402-1 to 402-4 have a substantially square shape, and are displayed in two rows in the longitudinal direction. In the food item columns 402-1 to 402-4, corresponding food image data is displayed in substantially all areas. In addition, the food item columns 402-1 to 402-4 respectively include check boxes 404. The check box 404 has the same function as the check box 382 on the screen V50 (see fig. 17).

Then, if at least one of the check boxes 400 is in the on state, the food material data management unit 952 causes the operation/display unit 24 to display the food material management gallery deletion screen V56. In the screen V56, the display operation unit 350 and the editing operation unit 370 are changed in the same manner as shown in the screen V52 (see fig. 17). Further, the cancel button 377 and the delete button 378 also have the same functions as those of screen image V52.

(food material management new addition/edition screen V60)

Fig. 19 is a diagram showing an example of the food material management new addition/editing screen V60.

When new material data is added or existing material data is edited, the material data management unit 952 (see fig. 1) causes the operation and display unit 24 to display a material management new addition/editing screen V60. Here, the case where new material data is added refers to a case where any of the

buttons

372, 374, 376 is operated on the material management list display screen V50 or the material management gallery display screen V54 (see fig. 17 and 18). The case of editing the existing food material data is a case where the user clicks on the

check boxes

382 and 404 of the food material item columns 362-1 to 362-4 and 402-1 to 402-4 (see fig. 17 and 18).

The food material management new addition/edition screen V60 includes a main menu bar 100, a return key 412, an image display unit 414, an image capture key 416, a shooting key 418, a start date display unit 420, a memo data edition field 422, a reminder information edition field 424, an alarm notification permission key 426, a save key 428, and a side menu bar 120.

The return button 412 functions in the same manner as the return button 271 (see fig. 11) described above. Further, if the user clicks the photographing button 418, the food material data management unit 952 (see fig. 1) causes the operation and display unit 24 to display the photographing screen V22 (see fig. 11). Further, if the user clicks the image input button 416, the food material data management unit 952 causes the operation/display unit 24 to display an image selection screen V66 (described in detail later) shown in fig. 22. Therefore, the food material image data of the food material data can be changed via these screens. If the material image data is changed, the material data management unit 952 changes the content of the image display unit 414 to the changed material image data.

Further, if the user clicks the memo data edit field 422, a dialog box for character editing (not shown) is displayed, and the user can edit the content of the memo data. Further, if the user clicks the start date display unit 420 or the reminder information edit field 424, a date selection calendar screen V62 (see fig. 20) is displayed. Thus, the user can set the start date or the reminder information.

The retailer communication unit 954 (see fig. 1) can transfer the food data stored in the food storage unit 914 of the data server 56 to the retailer server 58. Thereby, the retailer can appropriately make suggestions of food materials to be supplemented to the user, and the like. The retailer communication unit 954 is capable of receiving data related to the food material from the retailer server 58 and causing the operation/display unit 24 to display the received data. This enables the user to easily grasp, for example, the contents of high discount.

In addition, if the alarm notification permission button 426 is clicked, the on/off state of the alarm notification flag related to the material data is switched. In this way, if the user clicks the save button 428 after inputting and editing various data, the control unit 21 updates the food material data based on the content input to the screen V60. Then, the control unit 21 causes the operation/display unit 24 to display the original screen (for example, the screens V50 and V54 in fig. 17 and 18) again.

(date selection calendar pictures V62, V64)

Fig. 20 is a diagram showing an example of the date selection calendar screens V62 and V64.

As described above, if the user clicks the start date display unit 420 on the screen V60 (see fig. 19), for example, the controller 21 (see fig. 1) causes the operation/display unit 24 to display the screen V62 shown in fig. 20. The date selection calendar screen V62 includes a return button 432 and a calendar unit 434.

When the user clicks the return button 432, the control unit 21 (see fig. 1) causes the operation/display unit 24 to display the original screen (for example, screen V60 in fig. 19) without changing the date (date of arrival, reminder information) to be the target. Further, if the user designates a date in the calendar unit 434, the control unit 21 changes the date to be the target (the date of arrival, the reminder information), and causes the operation/display unit 24 to display the original screen on which the result is reflected (for example, screen V60 in fig. 19). As shown in the figure, the sub-menu bar 120 (see fig. 19) is not displayed on the screen V62, and therefore the user can input the date with concentration.

The date selection calendar screen V64 shown in fig. 20 is a modification of the date selection calendar screen V62 described above. The date selection calendar screen V64 includes a scroll menu unit 440. The scroll menu unit 440 includes a cancel button 442, a decision button 444, and a date designating unit 446. If the user scrolls date designation section 446, any one date is located on cursor line 446 a.

Then, if the user clicks the decision button 444, the control unit 21 changes the date (date of arrival, reminder information) to be the target date, and causes the operation/display unit 24 to display the original screen (for example, screen V60 in fig. 19) reflecting the result. On the other hand, if the user clicks the cancel button 442, the control unit 21 (see fig. 1) causes the operation/display unit 24 to display the original screen (for example, the screen V60 in fig. 19) again without changing the date to be the target (the date of arrival, the reminder information).

(image selection screen V66)

Fig. 21 is a diagram showing an example of the image selection screen V66.

The image selection screen V66 includes a food material image thumbnail display unit 450, a cancel key 452, and a selection key 454. In the food material image thumbnail display unit 450, thumbnails (no reference numeral) of the food material image data stored in the image storage unit 912 or the storage unit 22 (see fig. 1) are arranged. If the user clicks any one of the thumbnails and then clicks the selection key 454, the food material image data related to the thumbnail is selected.

When the material image data is selected, the control unit 21 causes the operation/display unit 24 to display the original screen (for example, a screen V60 in fig. 19) while reflecting the selection result of the material image data. Further, if the user clicks the cancel button 452, the control unit 21 causes the operation/display unit 24 to display the original screen (for example, the screen V60 in fig. 19) again without changing the material image data.

(running information/Top view V70)

Fig. 22 is a diagram showing an example of the operation information/top screens V70 and V72.

In any of the above-described screens V02 to V08 (see fig. 3 and 4), if the user clicks the operation status button 123, the operation information screen display control unit 960 (see fig. 1) of the control unit 21 causes the operation/display unit 24 to display, for example, the illustrated operation information/top screen V70. The operation information/top screen V70 includes a main menu bar 100, a notification display unit 462, an operation flag unit 464, a graph display unit 466, and a sub menu bar 120.

The notification display unit 462 displays the presence or absence of various "notifications" (normal notification, notice notification, trouble notification) related to the refrigerator 10, and displays the latest date and time when the "notification" is present. The operation flag section 464 displays, for each row, one of the above-described operation flags, that is, "power consumption is being suppressed", "water is required to be supplied to the water supply tank", "ice making cleaning is being performed", "upper stage switching is in progress", "lower stage switching is in progress", "automatic ice maker is in operation", "rapid ice making is in progress", and "rapid cooling is in progress".

In addition, the graph display portion 466 displays the door open time (cumulative time of day) of the refrigerator 10 as a histogram for each date. That is, in the histogram, for a rectangular figure (unsigned) corresponding to each day, the longer the door open time of the day, the longer in the up-down direction. In addition, the histograms are displayed as the refrigerating compartment door and the refrigerating compartment door in color, so that the user can grasp the opening time of each door at a glance.

When the user clicks the notification display unit 462, the control unit 21 (see fig. 1) causes the operation/display unit 24 to display a notification history list screen V90 (see fig. 26). The notification history list screen V90 will be described in detail later. Further, if the user clicks the operation flag section 464, the control section 21 causes the operation/display section 24 to display detailed information (not shown) of the corresponding operation flag. However, as described above, only one operation mark is displayed per one line by the operation mark section 464. The operation information/top screen V72 shown in fig. 22 is an example of the case where the operation flag section 464 has 7 lines. Although the graph display portion 466 is almost hidden in the screen V72, the user can cause the operation/display portion 24 to display the entire graph display portion 466 if the user scrolls the screen.

(supporting picture V74)

Fig. 23 is a diagram showing an example of the support screen V74.

When the user clicks the support button 124 on any one of the above-described screens V02 to V08 (see fig. 3 and 4), the operation information screen display control unit 960 (see fig. 1) of the control unit 21 causes the operation/display unit 24 to display, for example, the illustrated support screen V74. The support screen V74 includes a main menu bar 100, a support menu section 470, and a side menu bar 120. The support menu unit 470 includes a plurality of keys 471 to 484, and the like, and if the user clicks a desired key, a support operation corresponding to the key is executed.

(setting/Top view V80)

Fig. 24 is a diagram showing an example of the setting/top screen V80 and the cooling mode setting screen V82.

When the user clicks the setting button 125 on any one of the above-described screens V02 to V08 (see fig. 3 and 4), the controller 21 (see fig. 1) causes the operation/display unit 24 to display, for example, the illustrated setting/top screen V80. The setting/top screen V80 includes a refrigerator setting unit 500, a notification setting button 522, a zip code setting button 524, and a notification history list button 526.

Further, the refrigerator setting unit 500 includes a refrigerating room setting unit 501, an ice making room setting unit 506, an upper stage switching room setting unit 503, a lower stage switching room setting unit 504, a cooling mode setting unit 515, and another setting unit 516. If the user clicks the cooling mode setting unit 515 on the setting/top screen V80, the operation information screen display controller 960 (see fig. 1) causes the operation/display unit 24 to display, for example, the illustrated cooling mode setting screen V82.

(Cooling mode setting screen V82)

Cooling mode setting screen V82 includes return button 532, spot cooling setting unit 534, and rapid cooling setting unit 536. The return button 532 functions in the same manner as the return button 271 (see fig. 11) described above. If the user clicks the spot cooling setting unit 534, the operation information screen display control unit 960 switches the on/off state of the switching spot cooling mode. Here, the "spot cooling mode" refers to a mode in which the temperature of a low-temperature refrigeration space (not shown), which is a predetermined portion of the refrigeration compartment 61 (see fig. 1), is set lower than normal.

Further, if the user clicks the rapid cooling setting unit 536, the operation information screen display control unit 960 switches the on/off state to the rapid cooling mode. Here, the "rapid cooling mode" refers to a mode in which the temperature of food placed in an automatic rapid cooling space (not shown) that is a predetermined portion of refrigerating room 61 (see fig. 1) is detected by a sensor, and if the detected temperature is a predetermined value or more, the automatic rapid cooling space is rapidly cooled.

(Notification setting screen V84)

Fig. 25 is a diagram showing an example of the notification setting screen V84 and the other setting screen V86.

When the user clicks the notification setting button 522 on the setting/top screen V80 (see fig. 24), the operation information screen display control unit 960 (see fig. 1) causes the operation/display unit 24 to display, for example, the illustrated notification setting screen V84. The notification setting screen V84 includes a return button 542, an ice making completion setting unit 543, an ice making cleaning completion setting unit 544, a door opening setting unit 545, and an ice tray foreign matter detection setting unit 546.

The return button 542 functions in the same manner as the return button 271 (see fig. 11) described above. Further, if the user clicks each setting

unit

543, 544, 545, or 546, the operation information screen display control unit 960 switches whether or not to notify the user of "ice making completion", "ice making cleaning completion", "door open", or "foreign matter detection on ice tray".

(other setting screen V86)

When the user clicks the other setting unit 516 on the setting/top screen V80 (see fig. 24), the operation information screen display control unit 960 (see fig. 1) causes the operation/display unit 24 to display, for example, the other setting screen V86 shown in the drawing. The other setting screen V86 includes a return button 552, a power saving mode setting unit 554, and a volume setting unit 556.

The return button 552 has the same function as the return button 271 (see fig. 11) described above. Further, if the user clicks the power saving mode setting unit 554, the operation information screen display control unit 960 switches the on/off state of the "power saving mode" for saving the power consumption. Further, if the user clicks the sound volume setting unit 556, the operation information screen display control unit 960 causes the operation/display unit 24 to display a pop-up window (not shown) for sound volume adjustment.

(postal code setting screen V88)

Fig. 26 is a diagram showing an example of the zip code setting screen V88 and the notification history list screen V90.

When the user clicks the zip code setting button 524 on the setting/top screen V80 (see fig. 24), the zip code input unit 948 (see fig. 1) causes the operation/display unit 24 to display, for example, a zip code setting screen V88 as shown in the drawing. The zip code setting screen V88 includes a return button 562, a zip code input field 564, and a setting button 566.

The return button 562 functions in the same manner as the return button 271 (see fig. 11) described above. In addition, the user can input the zip code of the living area in the zip code input field 564. Then, if the setting button 566 is clicked in a state where the zip code is input, the zip code input unit 948 stores the zip code in the storage unit 22 (see fig. 1). The geographic information estimation unit 950 estimates geographic information of the living area of the user from the zip code. When accessing a predetermined weather site to obtain a weather forecast, the weather information acquisition unit 944 (see fig. 1) sets the region associated with the geographical information as a region to be subjected to the weather forecast.

(Notification history list screen V90)

When the user clicks the notification history list button 526 on the setting/top screen V80 (see fig. 24), the operation information screen display control unit 960 (see fig. 1) causes the operation/display unit 24 to display, for example, the illustrated notification history list screen V90. The notification history list screen V90 includes a return button 572 and a notification history list 574.

The return button 572 functions in the same manner as the return button 271 (see fig. 11) described above. Note that notification history list 574 includes one or more lines corresponding to "notifications" received in the past. Each row of notification history list 574 includes reception day 582 related to "notification", reception time 584, and notification code 586 indicating the type of "notification". If the user clicks any one line of the notification history list 574, the operation information screen display control unit 960 causes the operation/display unit 24 to display a detailed screen (not shown) showing the details of the "notification".

< details of shopping index SI >

Fig. 27 is a diagram showing a weather score SIA, a maximum air temperature score SIB, a precipitation probability score SIC, a wind speed score SID, and an icon table 580.

The shopping index SI shown in the shopping index home screen V04 (see fig. 3) is equal to the sum of the weather score SIA, the maximum air temperature score SIB, the precipitation probability score SIC, and the wind speed score SID. In other words, the shopping index display control unit 946 (see fig. 1) calculates the shopping index SI from "SIA + SIB + SIC + SID".

As shown in fig. 27, the weather score SIA is determined corresponding to the predicted weather. As illustrated, in the case where "storm" is included in the weather like "rainstorm" or "snowstorm", the weather score SIA is "30". In addition, in the case where "storm wind" is not included in the weather, and "rain" or "snow" is included, the weather score SIA is "50". In addition, for weather other than that, the weather score SIA is "100". As shown in fig. 27, the maximum air temperature score SIB is determined in accordance with the predicted maximum air temperature. For example, when the predicted maximum temperature on the 1 ℃ scale is "1 ℃ or lower", the maximum temperature score SIB is "-20", and when the maximum temperature score SIB is "0 to 9", the maximum temperature score SIB is "-10".

In addition, as shown in fig. 27, a precipitation probability score SIC is determined in accordance with the precipitation probability. For example, when the predicted precipitation probability on the scale of 10% is "0%", the precipitation probability score SIC is "0", and when the predicted precipitation probability on the scale of 10 to 40% ", the precipitation probability score SIC is" -10 ". In addition, as shown in fig. 27, a wind speed score SID is determined in correspondence with the predicted wind speed. For example, when the predicted wind speed on the scale of 1m/s is "4 m/s or less", the wind speed score SID is "0", and when it is "5 to 9 m/s", the wind speed score SID is "-10".

When the shopping index SI is calculated, the shopping index display controller 946 (see fig. 1) selects the human icon 172 displayed on the shopping index display 170 (see screen V04 in fig. 3) based on the icon table 580. The shopping index display control unit 946 specifies the ranks of integers "1" to "5" from the shopping index SI and the icon table 580.

< details of comment string CS >

Fig. 28 is a diagram showing examples of a weather review management table 590, a wind speed review management table 592, an air temperature review management table 594, a precipitation probability review management table 596, and a level management table 598.

The comment character string CS displayed on the shopping index home screen V04 (see fig. 3) or the like is a comment character string obtained by combining a weather comment CSA (not shown), a wind speed comment CSB (not shown), a temperature comment CSC (not shown), a precipitation probability comment CSD (not shown), and a level comment CSE (not shown) as necessary.

In order to manage these comments CSA to CSE, the shopping index display control unit 946 (see fig. 1) stores the management tables 590 to 598 in fig. 28. In the figure, the contents of the specific comment character strings of the respective comments CSA to CSE are omitted, but the weather comment CSA indicates, for example, "a snowstorm warning is issued today". Reducing the outing. Such a weather-related comment string. In addition, the wind speed comment CSB means, for example, a comment such as "strong wind attention warning is issued today. Reducing the outing. "such a comment string related to wind speed.

The temperature review CSC means, for example, "a warning of heatstroke today is issued. Please decrease the comment string related to the temperature, such as "supply of water outside". In addition, the precipitation probability comment CSD means that "the precipitation probability of today is 90%. Please take an umbrella when going out, and a comment character string related to the precipitation probability. The rating comment CSE is a comment character string corresponding to the rating of "1" to "5" shown in the icon table 580 of fig. 27.

The presence column in each of the management tables 590 to 598 indicates that there is a corresponding comment character string when "presence" is described, and indicates that there is no corresponding comment character string when "-" is described. The comments CSA, CSB, CSC, CSD, and CSE are combined as necessary in the comment character string CS (see fig. 3), but a predetermined maximum number of characters (for example, 32 characters) is determined in the comment character string CS. Therefore, the shopping index display control unit 946 (see fig. 1) combines the comments CSA to CSE in the range of the maximum number of characters or less in the order of higher priority, and uses the result as the comment character string CS. In fig. 28, the value shown in the column "priority" of each of the management tables 590 to 598 indicates that the smaller the value, the higher the priority.

< modification example >

The present invention is not limited to the above embodiment, and various modifications can be made. The above embodiments are illustrated for easy understanding of the present invention, and are not necessarily limited to having all of the configurations described. Further, other mechanisms may be added to the structure of the above embodiment, and a part of the structure may be replaced with another structure. The control lines and information lines shown in the drawings indicate portions deemed necessary for the description, and are not limited to indicating all the control lines and information lines required for the product. In practice, it is also conceivable to connect almost all structures to one another. The modifications that can be made to the above embodiment are, for example, as follows.

(1) In the above embodiment, the user manages the food stored in the refrigerator 10 on the respective screens V50 to V66 (see fig. 17 to 21) and the like. However, the image analysis unit 964 may analyze a photograph taken of the inside of the refrigerator 10 (e.g., a photograph of the storage room internal image display unit 272 in fig. 11) and automatically determine the food stored in the refrigerator 10.

(2) In the above embodiment, the recipe display screen control unit 958 (see fig. 1) may select and display a recipe using the food material related to the food material data stored in the food material storage 914 or the seasonal food material (recommended food material) shown in the seasonal food material homepage screen V02 (see fig. 3) or the like when displaying the recipe information homepage V06 (see fig. 4).

(3) In the above embodiment, the user operates the indoor selection button 273 and the display room switching screen V24 (see fig. 12), whereby the storage room designating unit 936 (see fig. 1) designates to which storage room 61 to 64 (see fig. 1) the photographed storage room internal image corresponds. However, the refrigerator 10 may transmit opening/closing information indicating the opened/closed state of the doors of the storage chambers 61 to 64 to the portable terminal 20. That is, the storage room designating unit 936 may designate which storage room 61 to 64 (see fig. 1) the photographed storage room internal image corresponds to based on the opening/closing information.

(4) Since the hardware of the mobile terminal 20 in the above-described embodiment can be realized by a general computer, a program or the like for executing the various processes described above may be stored in a storage medium or distributed via a transmission path.

< effects of the embodiment >

As described above, the refrigerator management device (20) of the present embodiment includes: a storage room specifying unit 936 that specifies any one of the plurality of storage rooms 61 to 64 included in the refrigerator 10, based on a user operation on the operation/display unit 24 that inputs and outputs information, or information supplied from the refrigerator 10; and a storage room internal image storage control unit 938 that stores the image acquired from the image capturing unit 26 that captured the image in the image storage unit 912 as a storage room internal image corresponding to the storage room 61-64 specified by the storage room specifying unit 936. Accordingly, the internal images of the storage chambers can be clearly associated with the corresponding storage chambers 61 to 64, so that the user can appropriately manage the food in the refrigerator.

Preferably, the refrigerator management device (20) further includes: a food material specification unit 940 that receives specification of a food material; and a position presenting unit 942 for presenting, by means of the graphic (308), the position of the storage chamber 61-65, among the plurality of storage chambers 61-65, for which an appropriate storage temperature range is set for a specified food material. Thus, the user can clearly know the storage chambers 61 to 65 suitable for the food to be stored, and can manage the food more appropriately.

Preferably, the refrigerator management device (20) further includes: a weather information acquisition unit 944 that acquires current or future weather information; the shopping mall display controller 946 causes the operation/display unit 24 to display a shopping mall screen (V04) indicating a shopping mall, which is a recommended shopping degree. Thus, the user can determine the appropriate day to go out for shopping, and can manage the food more appropriately.

In addition, it is preferable that the image storage unit 912 has a function of updating the previous internal image of the storage room based on the new internal image of the storage room if the new internal image of the storage room is supplied from the internal image storage controller 938 when the internal image of the storage room corresponding to any one of the storage rooms 61 to 64 is stored. This allows the user to easily view the latest internal image of the storage room designated by the user, and to manage the food materials more appropriately.

Further, it is preferable that the refrigerator management device (20) further includes: a zip code input unit 948 for receiving input of geographic information, which is information such as a zip code indicating a user's living area or an installation area of a refrigerator; and a geographic information estimation unit 950 for estimating geographic information related to the zip code from the input zip code, wherein the weather information acquisition unit 944 acquires weather information corresponding to the geographic information. Thus, for example, if the zip code of the place where the user resides is input, even when the user is away from the place where the user resides, the weather information of the place where the user resides and the shopping index based on the weather information of the place where the user resides can be acquired, and the user can manage the food more appropriately.

Further, it is preferable that the refrigerator management device (20) further includes: a food material data management unit 952 that adds or deletes food material data to or from the food material storage unit 914 that stores food material data relating to the food material stored in the refrigerator 10; for the retailer communicator 954, it notifies the retailer server 58 operated by the retailer of the food material data. This enables, for example, the transmission of the food material data to the retailer, and the retailer can appropriately make suggestions of food materials to be supplemented to the user. As a retailer that receives food material data, a retailer that has a store in or near a region indicated by geographic information (zip code or the like) and can distribute food material data to the region is desirable.

In addition, it is more desirable for the retailer communication section 954 to receive data relating to sales information of the food material of the retailer from the retailer server 58. This enables the user to easily grasp, for example, the contents of high discount. The weather information, the shopping index, and the food sales information are provided information that can provide the user's interest using geographic information such as a zip code received from the user.

Preferably, the refrigerator management device (20) further includes: a recommended-material-screen-display control unit 956 that causes the operation/display unit 24 to display a recommended material screen (V02) regarding a report of recommended materials, which is a recommended material; a recipe display screen control unit 958 that causes the operation/display unit 24 to display a recipe display screen for reporting a recipe (V06); an operation information screen display control unit 960 that causes the operation/display unit 24 to display an operation information screen (V08) that reports operation information of the refrigerator 10; and a circulation screen selection unit 962 that cyclically transitions the recommended food material screen (V02), the shopping index screen (V04), the recipe display screen (V06), and the operation information screen (V08). This enables the user to cyclically view a plurality of screens V02 to V08 on which important information is displayed.

Preferably, the refrigerator management device (20) further includes: and an image analysis unit 964 for analyzing the storage chamber internal image and acquiring the material data about the materials stored in the storage chambers 61 to 64. Therefore, the food material data can be automatically collected, and the trouble of inputting the food material data by the user can be reduced.

Further, it is preferable that the refrigerator management device (20) further includes: the food material data management unit 952 adds or deletes food material data to or from the food material storage unit 914 storing the food material data related to the food material stored in the refrigerator 10, and the recipe display screen control unit 958 displays a recipe using the food material related to the food material data or the recommended food material on the recipe display screen (V06). Thus, the user can easily confirm the recipe in which the food material related to the food material data or the recommended food material is used.

In addition, when providing the food material data to the retailer, not only the retailer corresponding to the geographical information but also the user may be able to select the range thereof. For example, it is possible to select whether the food material data can be provided by a retailer in the vicinity of the region limited to the zip code indicated by the geographical information, or the food material data can be provided in a wider range. In this way, the user can select a range in which the provided personal information, anonymous information, or pseudonymous information is provided, in consideration of the enjoyable convenience.

The present application includes the following technical ideas.

[ additional notes 1]

A kind of management device is disclosed, which comprises a management device,

[ appendix 2]

A kind of management device is disclosed, which comprises a management device,

[ additional notes 3]

A kind of management device is disclosed, which comprises a management device,

[ problems to be solved by additional notes 1 to 3]

Jp 2003-263543 a discloses selling information on the storage and retrieval of a refrigerator to a third party such as a food seller 17 and providing a reward to each merchant as a user of the refrigerator (pages 1, 0088, 0095-0097).

[ additional notes 4]

A refrigerator management device is characterized by comprising:

a storage room specifying unit that specifies any one of a plurality of storage rooms provided in the refrigerator, based on a user operation for an operation/display unit that performs input/output of information, or information supplied from the refrigerator; and

and a storage room internal image storage control unit that causes the image storage unit to store the image obtained from the image capturing unit that captures the image as a storage room internal image corresponding to the storage room specified by the storage room specifying unit.

[ additional notes 5]

A program for causing a computer to function as:

a storage room specifying unit that specifies any one of a plurality of storage rooms provided in the refrigerator, based on a user operation on an operation/display unit that inputs and outputs information, or information supplied from the refrigerator; and

and a storage room internal image storage control unit for causing the image storage unit to store the image obtained from the image capturing unit for capturing the image as a storage room internal image corresponding to the storage room specified by the storage room specifying unit.

[ problems to be solved by additional notes 4 and 5]

In the abstract of japanese patent application laid-open No. 2008-242911, "providing a food purchase management support system that determines a recipe from information on food accommodated in a refrigerator, information on the shelf life of the food, information on food sold at a special price in a store, and the like in a state where a consumer is at home is described. Further, by storing information on food items to be purchased in the IC card of the store's membership card or the IC chip of the mobile terminal and using the information flexibly, it is possible to prevent forgetting to purchase food items scheduled to be purchased, prevent purchasing more than necessary food items, and shorten the shopping time in the store ".

However, in recent refrigerators, the number of storage rooms such as a vegetable room (storage temperature of about 3 to 7 ℃), a refrigerating room (storage temperature of about 2 to 6 ℃), a fresh-keeping room (storage temperature of-1 to 1 ℃), and a freezing room (storage temperature of-20 to-18 ℃) is added, and therefore, it is difficult for a user to remember which food is stored in which storage room, and there is a possibility that management of food is not appropriate.

In view of the above, a refrigerator management apparatus and a program are provided that enable a user to appropriately manage food materials in a refrigerator.

Description of the symbols

10: a refrigerator; 20: a portable terminal (refrigerator management apparatus); 21: a control unit (computer); 24: an operation/display section; 26: a shooting part; 58: a retailer server; 61-66: a storage chamber; 308: refrigerator icons (graphics); 912: an image storage unit; 914: a food material storage part; 936: a storage room designating unit; 938: a storage room internal image storage control unit (storage room internal image storage control means); 940: a food material designating section; 942: a position presenting unit; 944: a weather information acquisition unit; 946: a shopping index display control unit; 948: a postal code input section; 950: a geographic information estimation unit (geographic information acquisition unit); 952: a food material data management unit; 954: a communication section for a retailer; 956: a recommended food material screen display control unit; 958: a recipe display screen control unit; 960: an operation information screen display control unit; 962: a loop picture selection unit; 964: an image analysis section; v02: a screen, a food material home screen (recommended food material screen); v04: a shopping index home screen (shopping index screen); v06: a recipe information home screen (recipe display screen); v08: an operation information home screen (operation information screen).

Claims

1. A management device, characterized in that,

2. The management apparatus according to claim 1,

providing the food material data to a computer used by a person different from a user of the refrigerator,

and outputting sales information of the food material as the provided information, corresponding to the geographic information and the information managed by the different person.

3. The management apparatus according to claim 2,

the sales information also corresponds to the food material data.

4. The management device according to any one of claims 1 to 3,

the provided information includes weather or shopping index.

5. The management device according to any one of claims 1 to 4,

the range of the computer providing the food material data can be selected by the operation of the user of the refrigerator.

6. A management device, characterized in that,

7. A management device, characterized in that,

8. A refrigerator management device is characterized by comprising:

9. The refrigerator management apparatus of claim 8,

the refrigerator management device further includes:

a food material specification unit that receives specification of a food material; and

and a position presenting unit that graphically presents a position of the storage chamber, in which an appropriate storage temperature range is set for a specified food material, among the plurality of storage chambers.

10. The refrigerator management apparatus of claim 8 or 9,

the refrigerator management device further includes:

a weather information acquisition unit that acquires current or future weather information; and

and a shopping index display control unit that causes the operation/display unit to display a shopping index screen that displays a shopping index that is a recommended shopping degree calculated from a part or all of the group consisting of weather, air temperature, precipitation probability, and wind speed included in the weather information.

11. The refrigerator management apparatus of any one of claims 8 to 10,

the image storage unit has the following functions: when the internal image of the storage room corresponding to any one of the storage rooms is stored, if a new internal image of the storage room is supplied from the internal image storage control part of the storage room, the internal image of the storage room before is updated according to the new internal image of the storage room.

12. The refrigerator management apparatus of any one of claims 8 to 11,

the refrigerator management device further includes:

a geographical information estimating unit that estimates or acquires geographical information relating to a location where the refrigerator is installed,

the weather information acquisition unit acquires the weather information corresponding to the geographical information.

13. The refrigerator management apparatus of any one of claims 8 to 12,

the refrigerator management device further includes:

a geographical information estimating unit that estimates or acquires geographical information relating to a location where the refrigerator is installed;

a food material data management unit that causes a food material storage unit that stores food material data relating to food materials stored in the refrigerator to perform addition and deletion of the food material data; and

for a retailer communication part which notifies a retailer server operated by a retailer of the above-mentioned food material data,

determining at least a part of the retailers that notify the food material data according to the geographic information.

14. The refrigerator management apparatus of claim 13,

the communication part for the retailer receives data related to the food material sold by the retailer from the retailer server.

15. The refrigerator management apparatus of claim 10,

the refrigerator management device further includes:

a recommended-material screen display control unit that causes the operation/display unit to display a recommended-material screen related to notification of a recommended material that is a recommended material;

a recipe display screen control unit that causes the operation/display unit to display a recipe display screen for notifying a recipe;

an operation information screen display control unit for displaying an operation information screen for notifying the operation information of the refrigerator on the operation/display unit; and

and a circulation screen selection unit that cyclically shifts the recommended food material screen, the shopping index screen, the recipe display screen, and the operation information screen.

16. The refrigerator management apparatus of claim 15, wherein,

the refrigerator management device further includes: a food material data management unit that causes a food material storage unit that stores food material data relating to food materials stored in the refrigerator to perform addition and deletion of the food material data,

the recipe display screen control unit displays a recipe using a material related to the material data or the recommended material on the recipe display screen.

17. A computer-readable medium storing a program for causing a computer to function as: