AU2016415984A1

AU2016415984A1 - Refrigerator system

Info

Publication number: AU2016415984A1
Application number: AU2016415984A
Authority: AU
Inventors: Takashi Ito; Shigeyuki Nagata; Tsuyoshi Uchida; Takaki YAGISAWA
Original assignee: Mitsubishi Electric Corp
Current assignee: Mitsubishi Electric Corp
Priority date: 2016-07-21
Filing date: 2016-07-21
Publication date: 2018-07-26
Anticipated expiration: 2036-07-21
Also published as: TWI683986B; JPWO2018016054A1; WO2018016054A1; CN109477677A; DE112016007082T5; KR20180100636A; AU2016415984B2; TW201804119A; JP6642713B2

Abstract

Provided is a refrigerator system that allows a user to easily ascertain the state of a storage chamber and information that cannot be found only from an image of the storage chamber and to input information that cannot be known only from the storage chamber image. To achieve this, a refrigerator system is provided with: a refrigerator main body that has a camera to output an image of a storage chamber by imaging the interior of the storage chamber in which food is stored; a terminal device that has a terminal display unit and that is provided so as to be able to communicate with the refrigerator main body; a storage chamber image storage unit that stores images of the storage chamber output from the camera; a food information storage unit that stores food information related to food stored in the storage chamber; a food information output unit that selects and outputs a portion or all of the food information stored in the food information storage unit; and a food information addition unit that adds food information, which is output by the food information output unit, to the storage chamber image, which stored in the storage chamber image storage unit. The terminal display unit superimposes and displays the food information, which is added by the food information addition unit, on the storage chamber image.

Description

Title

REFRIGERATOR SYSTEM

Field [ 0001]

The present invention relates to a refrigerator system.

Background [ 0002]

A conventionally known refrigerator system (e.g., PTL 1) includes: a refrigerator main body configured of an inner box and an outer box and having an open front face; storage rooms formed by partitioning the refrigerator main body; thermal insulation doors covering the storage rooms; and cameras each provided in the storage room or the thermal insulation door and capturing an image of the inside of the storage room. The image of the state of food inside the refrigerator captured by the camera can be checked by use of a display terminal or the like. In the refrigerator system described in PTL 1, a user can input memorandum information on an image of the inside of the refrigerator output on the display terminal and reflect the information, by moving a finger along the image.

Citation List

Patent Literature [ 0003] [ PTL 1] JP 2015-072109 A

Summary

Technical Problem [ 0004]

However, although the state inside the refrigerator can be checked without opening the door, and information unrecognizable only from an image (storage room image) of a storage room of the refrigerator can be input and reflected as memorandum information in the conventional refrigerator system disclosed in PTL 1, the user is required to input the information unrecognizable only from the storage room image by moving a finger along the image. This takes a lot of time and effort.

[ 0005]

The invention has been made to solve such a problem, and provides a refrigerator system in which information unrecognizable only from an image of a storage room can be easily grasped together with the state of the storage room, and a user can easily input the information unrecognizable only from a storage room image.

Solution to Problem [ 0006]

A refrigerator system according to the present invention includes: a refrigerator main body having a storage room configured to store a food item and a camera configured to capture inside of the storage room and to output a storage room image; a terminal device having a terminal display part, the terminal device configured to be able to communicate with the refrigerator main body; a storage room image memory part configured to store the storage room image output from the camera;

a food information memory part configured to store food information related to the food item stored in the storage room; a food information output part configured to select and output a part of or the entire food information stored in the food information memory part, and a food information adding part configured to add the food information output by the food information output part to the storage room image stored in the storage room image memory part, the terminal display part configured to display the food information added by the food information adding part by superimposing the food information on the storage room image.

Advantageous Effects of Invention [ 0007]

According to the refrigerator system of the invention, information unrecognizable only from an image of a storage room can be easily grasped together with the state of the storage room, and a user can easily input the information unrecognizable only from a storage room image.

Brief Description of the Drawings [ 0008]

Fig. 1 is a front view of a refrigerator included in a refrigerator system relating to Embodiment 1 of the present invention.

Fig. 2 is a diagram schematically showing an overall configuration of the refrigerator system relating to Embodiment 1 of the present

invention and a	configuration of a cold room of the refrigerator.
Fig. 3 is	diagram showing an example of display screens of a
terminal device	included in the refrigerator system relating to
Embodiment 1 of	the present invention.
Fig. 4 is	diagram showing an example of display screens of a
terminal device	included in the refrigerator system relating to
Embodiment 1 of	the present invention.
Fig. 5 is	diagram showing an example of display screens of a
terminal device	included in the refrigerator system relating to
Embodiment 1 of	the present invention.
Fig. 6 is	diagram showing an example of display screens of a
terminal device	included in the refrigerator system relating to
Embodiment 1 of	the present invention.
Fig. 7 is	diagram showing an example of display screens of a
terminal device	included in the refrigerator system relating to
Embodiment 1 of	the present invention.

Fig. 8 is a flowchart showing operations of the refrigerator system relating to Embodiment 1 of the present invention.

Fig. 9 is a diagram schematically showing an overall configuration of a refrigerator system relating to Embodiment 2 of the present invention and a configuration of a cold room of a refrigerator.

Fig. 10 is a diagram schematically showing an overall configuration of a refrigerator system relating to Embodiment 3 of the present invention and a configuration of a cold room of a refrigerator.

Fig. 11 is a diagram schematically showing an overall configuration of a refrigerator system relating to Embodiment 4 of the present invention and a configuration of a cold room of a refrigerator.

Description of Embodiments [ 0009]

Embodiments for implementing the invention will be described with reference to the accompanying drawings. In the drawings, the same or corresponding parts are assigned the same reference numeral, and overlapping description will be simplified or omitted as appropriate.

Note that the present invention is not limited to the following embodiments, and various changes can be made without departing from the gist of the invention.

[ 0010]

Embodiment 1

Figs. 1 to 8 relate to Embodiment 1 of the invention, where Fig.

is a front view of a refrigerator included in a refrigerator system,

Fig. 2 is a diagram schematically showing an overall configuration of the refrigerator system and a configuration of a cold room of the refrigerator, Figs. 3 to 7 are diagrams showing an example of display screens of a terminal device included in the refrigerator system, and

Fig. 8 is a flowchart showing operations of the refrigerator system.

[ 0011]

The refrigerator system of Embodiment 1 of the invention includes a refrigerator 1000. The refrigerator 1000 is a refrigerator main body in the refrigerator system of Embodiment 1 of the invention. In

Embodiment 1, the refrigerator 1000 includes a cold room 100, an ice-making room 200, a switchable room 300, a refrigerating room 400, and a vegetable room 500. The cold room 100, ice-making room 200, switchable room 300, refrigerating room 400, and vegetable room 500 are storage rooms for storing a food item.

[ 0012]

As shown in Fig. 1, the cold room 100, the ice-making room 200 and switchable room 300, the refrigerating room 400, and the vegetable room 500 are arranged in this order from the top. The ice-making room

200 and the switchable room 300 are arranged next to each other on the right and left at the same vertical position. A cold room door 101 that opens and closes the cold room 100 is provided on a front face of the cold room 100 . The cold room door 101 is an example of a door that opens and closes a storage room. The ice-making room 200, the switchable room

300, the refrigerating room 400, and the vegetable room 500 can be pulled out to the near side of the refrigerator 1000, together with doors provided on front faces of the rooms.

[ 0013]

An operation panel 1 is provided on a front face, that is, the outer face side of the cold room door 101. The operation panel 1 includes a panel display part la. The panel display part la is a main body display part capable of displaying information. Information on the inside of the refrigerator such as a preset temperature and the current temperature of each storage room can be displayed on the panel display part la. The panel display part la includes a liquid crystal display and other parts, for example. The operation panel 1 includes operation parts such as a touch panel, a button, and a switch, for example. A user can input necessary information by operating operation parts of the operation panel 1. Note that the setting position of the operation panel 1 is not limited to the door of the cold room 100, and may be a door of another storage room, a side face of the refrigerator 1000, or other positions.

[ 0014]

As shown in Fig. 2, the front face side (left side in Fig. 2) of the cold room 100 is closed by the cold room door 101. Note that the cross-sectional view shown in Fig. 2 is a section taken along line

A-A' in Fig. 1. Multiple cold room shelf boards 102 are provided inside the cold room 100. The inside of the cold room 100 is partitioned into multiple spaces (shelves) in the vertical direction by the cold room shelf boards 102. The space below the lowest cold room shelf board 102 is a chilled room 110 . A chilled case 111 is installed inside the chilled room 110 . The chilled case 111 can be pulled out toward the front, along a guide member (not shown) such as rails. Additionally, a cooling air passage 1010 is formed on the rear face side (right side in Fig. 2) of the cold room 100.

[ 0015]

An interior imaging device 2 is installed on an inner face of the cold room door 101. The interior imaging device 2 is a camera that captures an image of the inside of a storage room (cold room 100 in the embodiment) and outputs a storage room image. The field of view of the interior imaging device 2 ranges from a ceiling surface of the inside of the cold room 100 to the chilled room 110 . That is, the storage room image captured and output by the interior imaging device 2 is an image of the inside of the cold room 100, captured from the same view point as a user viewing the inside of the cold room 100 from the cold room door 101 side.

[ 0016]

The interior imaging device 2 captures an image of the inside of the cold room 100 when the cold room door 101 is opened and closed, for example. This is because when the cold room door 101 is opened and closed, a food item is likely to be placed in or taken out of the cold room 100 and change the storage state inside the cold room 100. The refrigerator 1000 includes a sensor capable of detecting opening and closing of the door. The sensor is a general magnet-type sensor, for example. Specifically, the sensor detects approaching of a magnet buried in the cold room door 101 by a pair of reed switches installed on the refrigerator 1000 main body side, for example. The interior imaging device 2 captures an image after detection of closure of the cold room door 101 that had been open, and while light inside the cold room 100 is lit, for example.

[ 0017]

Note that the installation position of the interior imaging device is not limited to the inner face of the cold room door 101, and may be anywhere, as long as it is a position where the interior imaging device 2 can capture an image of stored goods such as a food item placed on the cold room shelf boards 102 . Additionally, the number of interior imaging devices 2 to be installed is not limited to one, and multiple interior imaging devices 2 may be installed. By installing multiple interior imaging devices 2, it is possible to avoid formation of a blind spot due to blockage of field of view by a food item and other goods stored inside the cold room 100.

[ 0018]

The refrigerator 1000 includes a control circuit board 1001. The control circuit board 1001 is stored in an upper part of the rear face side of the refrigerator 1000, for example. The control circuit board

1001 includes parts such as a control circuit for performing various control necessary for operation of the refrigerator 1000. The control circuit board 1001 includes a micro computer, for example, and includes a processor and a memory. The control circuit board 1001 controls the refrigerator 1000 by causing the processor to execute a program stored in the memory, and thereby performing preset processing.

[ 0019]

The control circuit board 1001 includes a storage room image management part 3, a food information adding part 4, and a wireless communication part 5. Functions of these parts are implemented by causing the processor in the micro computer of the control circuit board

1001 to execute a program stored in the memory, and thereby performing preset processing, for example.

[ 0020]

The storage room image management part 3 is a storage room image memory part that stores the storage room image output from the interior imaging device 2. As mentioned earlier, the interior imaging device captures an image of the entire inside of the cold room 100 when opening and closing of the cold room door 101 is detected. The interior imaging device 2 outputs the captured image (storage room image) of the entire inside of the cold room 10 0 to the storage room image management part

3. The storage room image output from the interior imaging device 2 is input into the storage room image management part 3. Accordingly, every time the cold room door 101 is opened and closed (i.e., every time there is chance that the storage state of the inside of the cold room 100 may change), a storage room image output from the interior imaging device 2 is input into the storage room image management part

3. Thus, a storage room image of the most recent state is continuously input into the storage room image management part 3.

[ 0021]

The storage room image management part 3 stores an input storage room image. At this time, the storage room image management part 3 stores the time when the storage room image is input into the storage room image management part 3, as imaging time information, in association with the storage room image. Note that imaging time information is hereinafter also referred to as accompanying information of a storage room image. Then, the storage room image management part stores storage room images by sorting the storage room images in the order of imaging time, according to imaging time information. In this way, the storage room image management part 3 manages the storage room images captured by the interior imaging device 2. Note that imaging time information also contains information on the captured date (month and day, or year, month, and day).

[ 0022]

The refrigerator system of Embodiment 1 of the invention includes a user terminal 9. The user terminal 9 is a terminal device capable of communicating with the refrigerator 1000 (refrigerator main body).

To be specific, the user terminal 9 is a PC, a smartphone, a tablet terminal, or the like.

[ 0023]

To achieve communication between the refrigerator 1000 and the user terminal 9, the wireless communication part 5 is provided in the refrigerator 1000. The wireless communication part 5 uses a known wireless communication technique, for example, and exchanges information between the refrigerator 1000 and the user terminal 9. Thus, the refrigerator 1000 and the user terminal 9 inside or outside home can communicate with each other through one or both of an unillustrated router and the Internet. Note that one or more user terminals 9 are provided, and preferably, multiple user terminals 9 are provided.

[ 0024]

The user terminal 9 includes a user terminal display part 9a.

The user terminal display part 9a is a terminal display part capable of displaying information. The user terminal display part 9a includes a liquid crystal display or the like. Alternatively, the user terminal display part 9a may be formed of a touch panel, which can not only display information, but also receive user operation. Hereinafter, an example in which the user terminal display part 9a is formed of a touch panel will be described.

[ 0025]

The user terminal display part 9a is capable of displaying a storage room image stored in the storage room image management part (storage room image memory part) . Specifically, a storage room image stored in the storage room image management part 3 is transmitted from the wireless communication part 5 to the user terminal 9, through the food information adding part 4 provided in the control circuit board

1001. Upon receipt of the storage room image, the user terminal 9 displays the received storage room image on the user terminal display part 9a.

[ 0026]

Part (a) of Fig. 3 shows an example of a state where a normal screen 21 is displayed on the user terminal display part 9a. In the normal screen 21, a storage room image is displayed. Moreover, in the example shown in Fig. 3 (a) , time information 23 is displayed in a lower part of the normal screen 21. The time information 23 is information related to the time when the storage room image was captured. The time information 23 is the aforementioned imaging time information. Imaging time information is managed by the storage room image management part

3. Hence, to display the time information 23 on the normal screen 21, imaging time information on the storage room image may be transmitted together when transmitting the storage room image from the refrigerator

1000 to the user terminal 9.

[ 0027]

The normal screen 21 shown in Fig. 3(a) may be configured to be capable of displaying storage room images in reverse chronological order by a swiping operation, for example. With this configuration, the user can check the state inside the cold room 100 at every opening and closing time in reverse chronological order, so that he/she can easily grasp the type, amount, and other information on the stored food items over time.

[ 0028]

The user terminal 9 includes a food information output part 6, a food information memory part 7, and a food information editing part

8. The food information memory part 7 stores food information. Food information is information related to food stored in a storage room (cold room 100 in the embodiment) . Food information contains any of stamp information, date information, and fixed phrase information.

Stamp information is information including an illustration or a symbol related to a food item.

[ 0029]

Date information is information including a date related to food.

Specifically, date information is one or more pieces of date information among a best-before date, a use-by date, a purchase date, and a cooked date, for example. Fixed phrase information is information including text related to a food item. Specifically, conceivable text related to a food item as fixed phrase information is a message or text indicating usage, for example, such as help yourself, heat before eating, to take out, and to preserve.

[ 0030]

The user terminal display part 9a as a terminal display part is capable of displaying food information stored in the food information memory part 7. That is, the user terminal 9 can display stamp information, date information, and fixed phrase information stored in the food information memory part 7, on the user terminal display part

9a.

[ 0031]

The food information editing part 8 is configured to edit food information stored in the food information memory part 7. That is, the user can edit contents of stamp information, date information, and fixed phrase information stored in the food information memory part 7, by using the food information editing part 8 of the user terminal 9.

[ 0032]

The food information output part 6 selects and outputs a part of or the entire food information stored in the food information memory part 7. As mentioned earlier, the user terminal display part 9a is capable of displaying a storage room image stored in the storage room image management part 3, and food information stored in the food information memory part 7. The user can specify the information to be selected and output by the food information output part 6 from among the pieces of food information stored in the food information memory part 7, while checking the storage room image and food information displayed on the user terminal display part 9a.

[ 0033]

A specific example of the specification of food information to be selected and output by the food information output part 6 will be described with reference to Figs. 4 to 7 . First, Fig. 4 shows an example of a case of specifying the stamp information to be selected and output by the food information output part 6, from among the pieces of food information. Part (a) of Fig. 4 shows an example of a state where a stamp selection screen 27 is displayed on the user terminal display part 9a. A stamp list 29 is displayed in the stamp selection screen

27. The stamp list 29 displays a list of stamp information stored in the food information memory part 7 . The user can select and specify the stamp information to be output by the food information output part

6, from the stamp list 29.

[ 0034]

Note that the stamp information displayed in the stamp list 2 9, that is, stamp information stored in the food information memory part

7, may be added or deleted. Stamp information may be added by registering, through the food information editing part 8, a new stamp acquired by searching the Internet or distribution from another user, for example.

[ 0035]

Part (b) of Fig. 4 shows an example of a state where a stamp placement screen 28 is displayed on the user terminal display part 9a.

When the user specifies a desired piece of stamp information from the stamp list 2 9 displayed in the stamp selection screen 27 shown in part (a) of Fig. 4, the stamp placement screen 28 as shown in part (b) of

Fig. 4 is displayed on the user terminal display part 9a, for example.

A selected stamp 30 and stamp determination buttons 31 are displayed with the storage room image in the background, in the stamp placement screen 28.

[ 0036]

The selected stamp 30 is stamp information that the user specified from the stamp list 29. The user can specify the display position of the selected stamp 30 relative to the storage room image, by changing the position in which the selected stamp 30 is displayed in the stamp placement screen 28. The display position of the selected stamp 30 may be specified by moving the selected stamp 30 by a dragging operation, for example, and further, the selected stamp 30 may by reduced or enlarged by a pinch in or pin out operation. Then, when the user operates the stamp determination buttons 31, the stamp information to be output from the food information output part 6 can be specified, and the display position of the stamp information can be determined.

[ 0037]

Fig. 5 shows an example of a case of specifying the fixed phrase information to be selected and output by the food information output part 6, from among the pieces of food information. Part (a) of Fig.

shows an example of a state where a fixed phrase selection screen is displayed on the user terminal display part 9a. A fixed phrase comment list 34 is displayed in the fixed phrase selection screen 32.

The fixed phrase comment list 34 is displayed. Pieces of fixed phrase information stored in the food information memory part 7 are displayed as a list in the fixed phrase comment list 34. The user can select and specify the fixed phrase information to be output by the food information output part 6, from the fixed phrase comment list 34.

[ 0038]

Note that the fixed phrase information displayed in the fixed phrase comment list 34, that is, fixed phrase information stored in the food information memory part 7, may be added or deleted. Fixed phrase information may be added by registering a fixed phrase generated by a user's operation of the food information editing part 8, for example.

[ 0039]

Part (b) of Fig. 5 shows an example of a state where a fixed phrase placement screen 33 is displayed on the user terminal display part 9a.

When the user specifies a desired piece of fixed phrase information from the fixed phrase comment list 34 displayed in the fixed phrase selection screen 32 shown in part (a) of Fig. 5, the fixed phrase placement screen 33 as shown in part (b) of Fig. 5 is displayed on the user terminal display part 9a, for example. A selected fixed phrase comment 35 and fixed phrase comment determination buttons 36 are displayed with the storage room image in the background, in the fixed phrase placement screen 33.

[ 0040]

The selected fixed phrase comment 35 is fixed phrase information that the user specified from the fixed phrase comment list 34. The user can specify the display position of the selected fixed phrase comment relative to the storage room image, by changing the position in which the selected fixed phrase comment 35 is displayed in the fixed phrase placement screen 33. The display position of the selected fixed phrase comment 35 may be specified by moving the selected fixed phrase comment by a dragging operation, for example. Then, when the user operates the fixed phrase comment determination buttons 36, the fixed phrase information to be output from the food information output part 6 can be specified, and the display position of the fixed phrase information can be determined.

[ 0041]

As mentioned earlier, the user can edit food information containing fixed phrase information by the food information editing part 8. Fig. 6 shows an example in which the user edits fixed phrase information by the food information editing part 8. Part (a) of Fig.

shows an example of a state where a fixed phrase editing screen 37 is displayed on the user terminal display part 9a. A fixed phrase edit input pad 39 is displayed in the fixed phrase editing screen 37.

[ 0042]

In the user terminal 9, fixed phrase information may be edited by the food information editing part 8, and frequently used fixed phrase information may be prestored in the food information memory part 7.

Additionally, contents of the selected fixed phrase comment 35 specified through the screens shown in parts (a) and (b) of Fig. 5 may be restored to the original state and be edited. When an edit start operation of the selected fixed phrase comment 35 (e.g., double tapping of the selected fixed phrase comment 35), is performed in part (b) of Fig.

5, the fixed phrase editing screen 37 of part (a) of Fig. 6 is displayed.

In the fixed phrase editing screen 37, the user can operate the fixed phrase edit input pad 39 to restore the contents of the selected fixed phrase comment 35 to the original state, and can also perform edition such as adding a footnote, for example.

[ 0043]

When editing is completed, an edited text display screen 38 of part (b) of Fig. 6 is displayed on the user terminal display part 9a.

An edited comment 40 is displayed in the edited text display screen . If a long comment thus needs to be added temporarily, a long comment can be generated easily on the basis of fixed phrase information prestored in the food information memory part 7.

[ 0044]

Fig. 7 shows an example of a case of specifying the date information to be selected and output by the food information output part 6, from among the pieces of food information. Part (a) of Fig.

shows an example of a state where a date input screen 41 is displayed on the user terminal display part 9a. A date type selection field 43 and a date selection field 44 are displayed in the date input screen

41. Date types stored as date information in the food information memory part 7 are displayed as a list in the date type selection field 43.

The user can select and specify the type of date information to be output by the food information output part 6, from the date type selection field 43. In the example shown in Fig. 7(a), a use-by date, a cooked date, and a purchase date are displayed in the date type selection field . Then, the user can select and determine, by the date selection field

44, a specific date of the type of date selected in the date type selection field 43.

[ 0045]

Note that the date information displayed in the date type selection field 43, that is, date information stored in the food information memory part 7, may be added or deleted. To be specific, the user can operate the food information editing part 8 and add, as a new date type, a best-before date, an estimated disposal date, or the like, for example.

[ 0046]

Part (b) of Fig. 7 shows an example of a state where a date placement screen 42 is displayed on the user terminal display part 9a.

When the user specifies a desired piece of date information from the date type selection field 43 and the date selection field 44 shown in part (a) of Fig. 7, the date placement screen 42 as shown in part (b) of Fig. 7 is displayed on the user terminal display part 9a, for example.

A selected date balloon 45 and date balloon determination buttons 46 are displayed with the storage room image in the background, in the date placement screen 42.

[ 0047]

The selected date balloon 45 is date information that the user specified from the date type selection field 43 and the date selection field 44. The user can specify the display position of the selected date balloon 45 relative to the storage room image, by changing the position in which the selected date balloon 45 is displayed in the date placement screen 42. The display position of the selected date balloon may be specified by moving the selected date balloon 45 by a dragging operation, for example. Then, when the user operates the date balloon determination buttons 46, the date information to be output from the food information output part 6 can be specified, and the display position of the date information can be determined.

[ 0048]

The description will be continued by referring back to Fig. 2.

As has been described, the food information output part 6 selects and outputs a part of or the entire food information stored in the food information memory part 7. The food information output by the food information output part 6 is transmitted from the user terminal 9 to the refrigerator 1000. The food information transmitted to the refrigerator 1000 is received by the wireless communication part 5.

The food information adding part 4 provided in the control circuit board

1001 of the refrigerator 1000 adds, to the storage room image stored in the storage room image management part 3, the food information received by the wireless communication part 5.

[ 0049]

Food information received by the wireless communication part 5 is a part of or the entire food information that the food information output part 6 selected and output from the food information stored in the food information memory part 7. Accordingly, the food information adding part 4 adds food information output by the food information output part 6 to the storage room image stored in the storage room image management part 3.

[ 0050]

Additionally, as mentioned earlier, imaging time information on a storage room image is stored together with the storage room image as accompanying information of the storage room image, in the storage room image management part 3. Then, the food information adding part may add, in addition to the food information output from the food information output part 6, the accompanying information (imaging time information) of the storage room image to the storage room image.

[ 0051]

The storage room image to which food information is added by the food information adding part 4 is transmitted from the wireless communication part 5 to the user terminal 9. The user terminal 9 that received the storage room image to which food information is added displays the received storage room image on the user terminal display part 9a. At this time, the food information added to the received storage room image is displayed by being superimposed on the storage room image, on the user terminal display part 9a. That is, the user terminal display part 9a which is a terminal display part displays the food information added by the food information adding part 4, by superimposing the food information on the storage room image.

[ 0052]

Part (b) of Fig. 3 shows an example of a state where an information adding screen 22 is displayed on the user terminal display part 9a.

The information adding screen 22 is a screen displayed by superimposing food information added by the food information adding part 4 on a storage room image. In the example shown in Fig. 3 (b) , a present stamp 24a and a skull and crossbones stamp 24b are displayed by being superimposed on the storage room image. Hereinafter, the present stamp 24a and the skull and crossbones stamp 24b are collectively referred to as stamps

24. The stamps 24 are an example of stamp information added by the food information adding part 4.

[ 0053]

Note that the present stamp 24a may be used as a notification of a dessert or the like prepared as a present from a wife to a husband coming home late, for example. Meanwhile, the skull and crossbones stamp 24b may be used to visually notify that the food item is near its best-before date, for example.

[ 0054]

In addition, in the example shown in Fig. 3 (b) , a conveying fixed phrase comment 25a and a warning fixed phrase comment 25b are displayed by being superimposed on the storage room image. Hereinafter, the conveying fixed phrase comment 25a and the warning fixed phrase comment

25b are collectively referred to as fixed phrase comments 25 . The fixed phrase comments 25 are an example of fixed phrase information added by the food information adding part 4. The fixed phrase comments 25 may be used to complement the meaning of each of the stamps 24, for example.

[ 0055]

Moreover, in the example shown in Fig. 3 (b), a best-before date balloon 26a and a cooked date balloon 26b are displayed by being superimposed on the storage room image. Hereinafter, the best-before date balloon 26a and the cooked date balloon 26b are collectively referred to as date balloons 26. The date balloons 26 are an example of date information added by the food information adding part 4.

[ 0056]

As has been described, the food information output part 6 selects and outputs a part of or the entire food information stored in the food information memory part 7, and the food information output by the food information output part 6 is superimposed on a storage room image stored in the storage room image management part 3 and displayed as the stamps

24, the fixed phrase comments 25, and the date balloons 26 on the user terminal display part 9a. At this time, if the refrigerator system includes multiple user terminals 9, the stamps 24, the fixed phrase comments 25, and the date balloons 26 superimposed on the storage room image are displayed on each of the user terminal display parts 9a of the multiple user terminals 9.

[ 0057]

For this reason, multiple users such as family members can share the information adding screen 22 of Fig. 3 (b) that displays the storage room image to which food information related to the stored food item is added, the food information being unrecognizable only by viewing the normal screen 21 of Fig. 3 (a) . That is, the multiple users can easily grasp food information unrecognizable only from the storage room image, together with the state of the storage room. In addition, since the food information output part 6 that selects and outputs a part of or the entire food information stored in the food information memory part is provided, the user can input food information unrecognizable only from the storage room image by merely specifying food information output by the food information output part 6. Hence, the user can easily input food information.

[ 0058]

Accordingly, it is possible to determine whether one is allowed to eat food displayed in a storage room image, whether there is enough stock, or even if there is, whether new food item needs to be bought.

This can prevent forgetful purchasing, redundant purchasing, and waste of food due to disposal of old food.

[ 0059]

Additionally, not only is it possible to prompt consumption by sharing a best-before date and a use-by date among multiple users, but it is also possible to notify multiple users of the purchase date and cooked date of a food item that only the person who stored the food item knows. Hence, other users can estimate the edible time limit.

Furthermore, since storage room images and food information can be provided to a limited third party other than the owner of the refrigerator 1000, the stock status can be shared among multiple users, and the storage room images and food information can be used as a communication tool.

[ 0060]

Note that in Embodiment 1, the wireless communication part 5 transmits the storage room image to which food information is added by the food information adding part 4 not only to the user terminal

9, but also to the operation panel 1. Upon receipt of the storage room image to which food information is added, the operation panel 1 displays the received storage room image on the panel display part la. At this time, the food information added to the received storage room image is displayed by being superimposed on the storage room image, on the panel display part la. That is, as in the case of the user terminal display part 9a which is a terminal display part, the panel display part la which is a main body display part can also display the food information added by the food information adding part 4 by superimposing the food information on the storage room image.

[ 0061]

Next, an example of a flow of operation of the refrigerator system configured in the above manner will be described, with reference to

Fig. 8. First, when the cold room door 101 is opened and closed by the user, the aforementioned sensor detects the opening and closing of the cold room door 101, and the processing proceeds from step Sil to step

S12.

[ 0062]

In step S12, the interior imaging device 2 captures an image of the inside of the cold room 100 which is a storage room. In the next step S13, the captured image of the inside of the cold room 100 is transmitted as a storage room image to the storage room image management part 3. In the following step S14, the storage room image management part 3 stores and retains the storage room image captured by the interior imaging device 2, together with accompanying information (imaging time information) . Then, in the next step S15, the storage room image management part 3 transmits the storage room image captured by the interior imaging device 2 and the accompanying information (imaging time information) of the storage room image to the food information adding part 4.

[ 0063]

After step S15, the processing proceeds to step SI6. In step S16, the food information adding part 4 checks whether there is food information output from the food information output part 6. If there is food information output from the food information output part 6, the processing proceeds to step S17. In step S17, the food information adding part 4 superimposes the food information output from the food information output part 6 on the storage room image transmitted from the storage room image management part 3, and retains the storage room image .

[ 0064]

After step S17, the processing proceeds to step S18. Meanwhile, in step S16, if there is no food information output from the food information output part 6, the processing proceeds from step SI6 to step S18 without passing through step S17. In step S18, the food information adding part 4 transmits the storage room image to the operation panel 1 and the user terminal 9 . The transmission is performed through the wireless communication part 5. If the processing passes through step S17, the storage room image transmitted in step S18 is a storage room image on which the food information is superimposed in step S17. Meanwhile, if the processing does not pass through step S17, the storage room image transmitted in step S18 is the original storage room image transmitted by the storage room image management part 3 in step S15.

[ 0065]

In the following step S19, the panel display part la displays the storage room image transmitted in step S18. Additionally, the user terminal display part 9a also displays the storage room image transmitted in step S18. Upon completion of step S19, the processing returns to Sil, and the operations in the above-described steps are repeated.

[ 0066]

Note that although the interior imaging device 2 is provided in the cold room 100 in the above description, the interior imaging device may be provided in a storage room other than the cold room 100. Also, the interior imaging device 2 may be simultaneously installed in multiple storage rooms. For example, the inside state of the vegetable room 500 is relatively hard to grasp, and the vegetable room 500 is a storage room that stores vegetables that go bad easily. Hence, by installing the interior imaging device 2 in the vegetable room 500, the stored state can be shared among multiple users. Since the stored state is checked by multiple users, the use-by date of the vegetables can be grasped, and the possibility of disposal of the vegetables can be reduced. Also, by installing the interior imaging device 2 in the refrigerating room 400, it is possible to grasp the stored state of frozen meat, rice and the like which are main dishes of a meal, and it is also possible to determine the purchase amount of frozen food that inevitably has to be stored if purchased.

[ 0067]

Embodiment 2

Fig. 9 relates to Embodiment 2 of the invention, and is a diagram schematically showing an overall configuration of a refrigerator system and a configuration of a cold room of a refrigerator.

[ 0068]

In Embodiment 2 described herein, the food information output part, the food information memory part, and the food information editing part that are provided in the terminal device in the aforementioned configuration of Embodiment 1 are provided in a refrigerator main body.

Hereinafter, a refrigerator system of Embodiment 2 will be described by mainly focusing on differences from Embodiment 1.

[ 0069]

In the refrigerator system of Embodiment 2, as shown in Fig. 9, an operation panel 1 of a refrigerator 1000 includes a food information output part 6, a food information memory part 7, and a food information editing part 8. The configuration, function, and the like of each of the food information output part 6, the food information memory part

7, and the food information editing part 8 are basically the same as

Embodiment 1. Note, however, that the food information output part 6 is provided in the user terminal 9 in Embodiment 1. For this reason, the food information selected and output by the food information output part 6 from among the pieces of food information stored in the food information memory part 7 is transmitted from the user terminal 9 to the wireless communication part 5 of the refrigerator 1000, and the food information received in the wireless communication part 5 is input into the food information adding part 4.

[ 0070]

Meanwhile, in Embodiment 2, the food information output part 6 is provided in the operation panel 1 of the refrigerator 1000. For this reason, the food information selected and output by the food information output part 6 is directly input into a food information adding part

4, without passing through a wireless communication part 5.

[ 0071]

Additionally, in Embodiment 2, a panel display part la which is a main body display is capable of displaying a storage room image stored in a storage room image management part 3 (storage room image memory part) , and food information stored in the food information memory part

7. That is, the panel display part la is capable of displaying screens including a normal screen 21, an information adding screen 22, a stamp selection screen 27, a stamp placement screen 28, a fixed phrase selection screen 32, a fixed phrase placement screen 33, a fixed phrase editing screen 37, an edited text display screen 38, a date input screen

41, and a date placement screen 42, which are displayed on the user terminal display part 9a in Embodiment 1.

[ 0072]

Accordingly, the user can specify information to be selected and output by the food information output part 6 from among the pieces of food information stored in the food information memory part 7, while checking the food information and storage room image stored in the food information memory part 7 and displayed on the panel display part la.

Also, the user can edit food information by the food information editing part 8, by operating the operation panel 1.

Note that other configurations and operations are the same as

Embodiment 1, and detailed descriptions will be omitted.

[ 0073]

The refrigerator system of Embodiment 2 configured in the above manner not only can achieve the same effects as Embodiment 1, but can also input the food information output by the food information output part 6 into the food information adding part 4 without passing through the wireless communication part 5, since the food information memory part 7 and the food information output part 6 are provided in a refrigerator main body (refrigerator 1000) . Hence, communication load in the wireless communication part 5 can be reduced, and communication between the wireless communication part 5 and each user terminal 9 can be performed smoothly even when the number of user terminals 9 increases .

[ 0074]

Additionally, since the food information memory part 7 that forms a food information database likely to have a large capacity is provided on the refrigerator 1000 main body side, the required storage data capacity of the multiple user terminals 9 can be reduced. Moreover, since the food information to be selected and output by the food information output part 6 is specified only from the operation panel of the refrigerator 1000, the food information that the food information adding part 4 adds to the storage room image can be managed collectively.

[ 0075]

Embodiment 3

Fig. 10 relates to Embodiment 3 of the invention, and is a diagram schematically showing an overall configuration of a refrigerator system and a configuration of a cold room of a refrigerator.

[ 0076]

In Embodiment 3 described herein, a server device is provided separately from a refrigerator main body and a terminal device in the aforementioned configuration of Embodiment 1, and a food information memory part is provided in the server device. Hereinafter, a refrigerator system of Embodiment 3 will be described by mainly focusing on differences from Embodiment 1.

[ 0077]

The refrigerator system of Embodiment 3 includes a cloud server

11. The cloud server 11 is capable of communicating with a user terminal which is a terminal device, through the Internet 10, for example, which is a communication network. Note that the embodiment exemplifies a case of using, as the server device, the cloud server 11 formed of multiple servers (server group) connected to the Internet 10. However, the server device is not limited to the cloud server 11, and may be a single server.

[ 0078]

The cloud server 11 includes a food information memory part 7 and an individual authentication part 12 . The configuration, function, and the like of the food information memory part 7 is basically the same as Embodiment 1. The individual authentication part 12 authenticates whether the user terminal 9 has permission to connect to the refrigerator 1000. Specifically, the individual authentication part 12 of the cloud server 11 prestores terminal device IDs of the user terminals 9 that have permission to connect to the ID of the refrigerator 1000.

[ 0079]

The ID of the refrigerator 1000 is information that can uniquely identify the multiple refrigerators 1000 connected to the Internet 10.

Also, the terminal device ID is information that can uniquely identify the multiple user terminals 9 connected to the Internet 10. Individual authentication means 3003 authenticates whether the user terminal 9 has permission to connect to the refrigerator 1000, by checking whether a mobile terminal ID of the user terminal 9 is stored as an ID having permission to connect to the refrigerator 1000 for the refrigerator

1000 of the refrigerator 1000.

[ 0080]

The cloud server 11 allows the user terminal 9 authenticated by the individual authentication part 12 and having permission to connect to the refrigerator 1000, to connect to the refrigerator 1000 through the Internet 10 or a wireless communication part 5. In other words, the cloud server 11 restricts the user terminal 9 not authenticated by the individual authentication part 12 and not having permission to connect to the refrigerator 1000, from connecting to the refrigerator

1000 through the Internet 10 or the wireless communication part 5.

[ 0081]

The user terminal 9 authenticated by the individual authentication part 12 and having permission to connect to the refrigerator 1000 connects to the refrigerator 1000 through the wireless communication part 5 or the like, acquires a storage room image stored in a storage room image management part 3, and can display the storage room image on a user terminal display part 9a. Thus, if the user terminal has permission to connect to the refrigerator 1000, the user terminal can display a storage room image stored in the storage room image management part 3 of the refrigerator 1000, on the user terminal display part 9a of the user terminal 9.

[ 0082]

Hence, in other words, the individual authentication part 12 is a part that authenticates whether the user terminal 9 has permission to display a storage room image stored in the storage room image management part 3 on the user terminal display part 9a of the user terminal 9. Note that an individual authentication part 12 may also be provided in the refrigerator 1000 or the like, for example, in

Embodiments 1 and 2.

[ 0083]

In Embodiment 3, the user terminal 9 does not include a food information memory part 7. Meanwhile, a food information output part and a food information editing part 8 are provided in the user terminal

9, as in the case of Embodiment 1. Food information edited by the user in the food information editing part 8 of the user terminal 9 is transmitted to the cloud server 11 through the Internet 10. The cloud server 11 stores the received edited food information in the food information memory part 7, and reflects the edited contents of the food information.

[ 0084]

Also, the user terminal 9 can acquire food information stored in the food information memory part 7 of the cloud server 11 through the Internet 10, and display the food information on the user terminal display part 9a. The user can specify information to be selected and output by the food information output part 6 from among the pieces of food information stored in the food information memory part 7, while checking the storage room image and food information displayed on the user terminal display part 9a.

[ 0085]

The food information output part 6 selects and outputs the specified food information from among the pieces of food information stored in the food information memory part 7 of the cloud server 11.

Then, the food information that the food information output part 6 selected and output is transmitted from the user terminal 9 to the wireless communication part 5, and is input into a food information adding part 4. Note that other configurations and operations are the same as Embodiment 1, and detailed descriptions will be omitted.

[ 0086]

The refrigerator system of Embodiment 3 configured in the above manner not only can achieve the same effects as Embodiment 1, but can also reduce the required storage data capacity of the refrigerator 1000 and the multiple user terminals 9, since the food information memory part 7 that forms a food information database likely to have a large capacity is provided in the cloud server 11.

[ 0087]

Moreover, by registering the terminal device ID of the user terminal 9 owned by a user other than the user that owns the refrigerator

1000 in the individual authentication part 12 of the cloud server 11, it is possible to share the inside state of the user's refrigerator

1000 together with food information selected and output by the food information output part 6, while maintaining security. Also, while shopping at a supermarket or the like, for example, it is possible to easily check the stock status of food items inside the storage room, so that purchase of the same products among family members, or forgetful purchasing, for example, can be prevented.

[ 0088]

Note that the individual authentication part 12 described above is configured to perform authentication by use of an ID. The authentication method is not limited to this. Examples of authentication methods other than an ID include biometric authentication such as a fingerprint, a vein, and the iris of an eye, authentication by a password, or a combination of these authentication methods .

[ 0089]

Embodiment 4

Fig. 11 relates to Embodiment 4 of the invention, and is a diagram schematically showing an overall configuration of a refrigerator system and a configuration of a cold room of a refrigerator.

[ 0090]

In Embodiment 4 described herein, a storage room image management part and a food information adding part are also provided in a server device in the aforementioned configuration of Embodiment 3.

Hereinafter, a refrigerator system of Embodiment 4 will be described by mainly focusing on differences from Embodiment 3.

[ 0091]

As in the case of Embodiment 3, the refrigerator system of

Embodiment 4 includes a cloud server 11. The cloud server 11 is connected to and capable of communicating with a refrigerator 1000 which is a refrigerator main body, through the Internet 10, for example, which is a communication network. Additionally, the cloud server 11 is also connected to and capable of communicating with a user terminal 9 which is a terminal device, through the Internet 10, for example, which is a communication network. Note that as in the case of Embodiment 3, the server device is not limited to the cloud server 11, and may be a single server.

[ 0092]

The cloud server 11 includes, in addition to a food information memory part 7 and an individual authentication part 12, a storage room image management part 3 and a food information adding part 4. The configuration, function, and the like of the food information memory part 7 and the individual authentication part 12 are basically the same as Embodiment 3. Also, the configuration, function, and the like of the storage room image management part 3 and the food information adding part 4 are basically the same as Embodiment 1.

[ 0093]

In Embodiment 4, the storage room image management part 3 and the food information adding part 4 are not provided in a control circuit board 1001 of the refrigerator 1000. A wireless communication part 5 is provided in the control circuit board 1001. A storage room image output from an interior imaging device 2 is input into the wireless communication part 5. The wireless communication part 5 transmits the input storage room image to the cloud server 11 through the Internet

10. When the cloud server 11 receives the storage room image, the storage room image management part 3 provided in the cloud server 11 stores the received storage room image.

[ 0094]

A food information output part 6 and a food information editing part 8 are provided in the user terminal 9, as in the case of Embodiment

3. The food information that the user edited by the food information editing part 8 of the user terminal 9 is transmitted to the cloud server through the Internet 10. The cloud server 11 stores the received edited food information in the food information memory part 7, and reflects the edited contents of the food information.

[ 0095]

[ 0096]

Then, the food information that the food information output part 6 selected and output is transmitted from the user terminal 9 to the cloud server 11 through the Internet 10. The food information received by the cloud server 11 is input into the food information adding part 4 provided in the cloud server 11. The food information adding part 4 adds the food information received by the cloud server 11 to the storage room image stored in the storage room image management part 3.

[ 0097]

The storage room image to which the food information is added by the food information adding part 4 is transmitted from the cloud server 11 to the user terminal 9, through the Internet 10. Upon receipt of the storage room image to which the food information is added, the user terminal 9 displays the received storage room image on the user terminal display part 9a. At this time, the food information added to the received storage room image is displayed by being superimposed on the storage room image, on the user terminal display part 9a.

[ 0098]

Additionally, the storage room image to which the food information is added by the food information adding part 4 is also transmitted from the cloud server 11 to the wireless communication part 5 of the refrigerator 1000, through the Internet 10. Upon receipt of the storage room image to which the food information is added, the wireless communication part 5 transmits the received storage room image to the operation panel 1. Upon receipt of the storage room image to which the food information is added, the operation panel 1 displays the received storage room image on a panel display part la. At this time, the food information added to the received storage room image is displayed by being superimposed on the storage room image, on the panel display part la. Note that other configurations and operations are the same as

Embodiment 1 or 3, and detailed descriptions will be omitted.

[ 0099]

The refrigerator system of Embodiment 4 configured in the above manner not only can achieve the same effects as Embodiment 1 or 3, but can also reduce the required storage data capacity of the refrigerator

1000 and the multiple user terminals 9 even more, since the storage room image management part 3 that stores and manages storage room image data is provided in the cloud server 11. Also, processing load in the control circuit board 1001 of the refrigerator 1000 can be reduced, since the food information adding part 4 that performs image processing and the like for adding food information to a storage room image is provided in the cloud server 11.

Industrial Applicability [ 0100]

The invention can be used in a refrigerator system including a refrigerator main body that has a camera for capturing an image of the inside of a storage room storing a food item and outputting a storage room image, and a terminal device that has a terminal display part and is capable of communicating with the refrigerator main body.

Reference Signs List [ 0101]

Operation panel la Panel display part

Interior imaging device

Storage room image management part

Food information adding part

Wireless communication part

Food information output part

Food information memory part

Food information editing part

User terminal

9a User terminal display part

Internet

Cloud server

Individual authentication part

Normal screen

Information adding screen

Time information

Stamp

24a Present stamp

24b Skull and crossbones stamp

Fixed phrase comments

25a Conveying fixed phrase comment

25b Warning fixed phrase comment

Date balloons

26a Best-before date balloon

26b Cooked date balloon

Stamp selection screen

Stamp placement screen

Stamp list

Selected stamp

Stamp determination buttons

Fixed phrase selection screen

Fixed phrase placement screen

Fixed phrase comment list

Selected fixed phrase comment

Fixed phrase comment determination buttons

Fixed phrase editing screen

Edited text display screen

Fixed phrase edit input pad

Edited comment

Date input screen

Date placement screen

Date type selection field

Date selection field

Selected date balloon

Date balloon determination buttons

100 Cold room

101 Cold room door

102 Cold room shelf boards

110 Chilled room

111 Chilled case

200 Ice-making room

300 Switchable room

400 Refrigerating room

500 Vegetable room

1000 Refrigerator

1001 Control circuit board

1010 Cooling air passage

Claims

Claims [ Claim 1] A refrigerator system comprising: a refrigerator main body including a storage room configured to store a food item and a camera configured to capture inside of the storage room and to output a storage room image; a terminal device having a terminal display part, the terminal device configured to be able to communicate with the refrigerator main body; a storage room image memory part configured to store the storage room image output from the camera; a food information memory part configured to store food information related to the food item stored in the storage room; a food information output part configured to select and output a part of or the entire food information stored in the food information memory part, and a food information adding part configured to add the food information output by the food information output part to the storage room image stored in the storage room image memory part, the terminal display part configured to display the food information added by the food information adding part by superimposing the food information on the storage room image. [ Claim 2] The refrigerator system according to claim 1, wherein the storage room image memory part and the food information adding part are provided in the refrigerator main body. [ Claim 3] The refrigerator system according to claim 2, wherein: the refrigerator main body further includes a door configured to open and close the storage room, and a main body display part provided on an outer face side of the door, the main body display part configured to be able to display information; the food information memory part and the food information output part are provided in the refrigerator main body; and the main body display part is capable of displaying the storage room image stored in the storage room image memory part and the food information stored in the food information memory part. [ Claim 4] The refrigerator system according to claim 2, wherein: the food information memory part and the food information output part are provided in the terminal device; and the terminal display part is capable of displaying the storage room image stored in the storage room image memory part and the food information stored in the food information memory part. [ Claim 5] The refrigerator system according to claim 2, further comprising a server device configured to be able to communicate with the terminal device, wherein: the food information memory part is provided in the server device; the food information output part is provided in the terminal device; and the terminal display part is capable of displaying the storage room image stored in the storage room image memory part and the food information stored in the food information memory part. [ Claim 6] The refrigerator system according to claim 1, further comprising a server device configured to be able to communicate with the refrigerator main body and the terminal device, wherein: the storage room image memory part, the food information adding part, and the food information memory part are provided in the server device; the food information output part is provided in the terminal device; and the terminal display part is capable of displaying the storage room image stored in the storage room image memory part and the food information stored in the food information memory part. [ Claim 7] The refrigerator system according to any one of claims 1 to 6, wherein the food information stored in the food information memory part contains stamp information including an illustration or a symbol related to the food item. [ Claim 8] The refrigerator system according to any one of claims 1 to 7, wherein the food information stored in the food information memory part contains date information including a date related to the food item. [ Claim 9] The refrigerator system according to any one of claims 1 to 8, wherein the food information stored in the food information memory part contains fixed phrase information including text related to the food item. [ Claim 10] The refrigerator system according to any one of claims 1 to 9, further comprising a food information editing part configured to edit the food information stored in the food information memory part. [ Claim 11] The refrigerator system according to any one of claims 1 to 10, further comprising an authentication part configured to authenticate whether or not the terminal device has permission to display the storage room image stored in the storage room image memory part on the terminal display part of the terminal device. 100 200 400

1 1 A’

1000

1a

300

500

1/11

FIG. 1

2/11

FIG.2

1001

110 111 1010

3/11 FIG. 3A z

FIG.3B |||4G<i> 4:21 PM 72% EHD (a) STAMP SELECTION SCREEN (b) STAMP PLACEMENT SCREEN

4/11

FIG.4A

FIG.4B

9a |||4G<? 4:21PM 72% ED

5/11 FIG. 5A (a) FIXED PHRASE SELECTION SCREEN □

6/11 FIG. 6A |||4G<? 4:21PM 72% EHD (a) FIXED PHRASE EDITING SCREEN (b) FIXED PHRASE DISPLAY SCREEN

FIG. 6B

9a (a) DATE INPUT SCREEN

7/11 FIG. 7A

FIG. 7B

8/11 FIG. 8

S11: IS REFRIGERATOR DOOR OPENED AND CLOSED?

S12: CAPTURE IMAGE OF INSIDE OF COLD ROOM 100

S13: TRANSMIT STORAGE ROOM IMAGE TO STORAGE ROOM IMAGE MANAGEMENT PART 3

S16: IS THERE FOOD INFORMATION?

9/11 FIG. 9

1001

110 111 1010

10/11 FIG. 10

1001 ///// FIG. 11

1001