CN105402972B

CN105402972B - Refrigerator and control method thereof

Info

Publication number: CN105402972B
Application number: CN201510552886.5A
Authority: CN
Inventors: 黄圣喆; 李承姬; 崔允豪; 金润英; 金重烨
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2014-09-04
Filing date: 2015-09-01
Publication date: 2020-08-11
Anticipated expiration: 2035-09-01
Also published as: CN105402972A; WO2016036015A1

Abstract

The invention discloses a refrigerator, which comprises: a storage compartment having a plurality of receiving spaces provided therein; a detection unit detecting the storage containers accommodated in the plurality of accommodation spaces; a display unit displaying accommodation information regarding the plurality of accommodation spaces; and a controller controlling the display unit to display the receiving space in which the new storage container can be received, based on a detection result of the detection unit.

Description

Refrigerator and control method thereof

Technical Field

The present invention relates to a refrigerator and a method of controlling the refrigerator, and more particularly, to a refrigerator capable of accommodating a storage container storing food items and a method of controlling the refrigerator.

Background

In general, a refrigerator is a home appliance including a storage chamber storing food and a cold air supply unit for supplying cold air to the storage chamber to keep the food fresh.

Recently, refrigerators for keeping special foods under refrigerated conditions in addition to general foods have been developed. For example, a fermented food cooler for keeping fermented foods in an optimum state and a wine cooler for keeping wine in an optimum state have been published.

In particular, since the storage temperatures of the wines are different from each other according to the types of the wines, the wines can be individually stored according to the types of the wines.

However, in the related art wine chiller, a user should determine the type of wine by himself and store the wine in different storage compartments according to the type of wine.

Disclosure of Invention

Technical problem

The present invention relates to providing a refrigerator capable of recognizing food items and displaying a storage space in which the recognized food items can be stored, and a method of controlling the refrigerator.

The present invention is also directed to providing a refrigerator capable of displaying a storage space in which food items selected by a user are stored and a method of controlling the refrigerator.

Technical solution

One aspect of the present invention provides a refrigerator, comprising: a storage chamber in which a plurality of receiving spaces are provided; a detection unit detecting the storage containers accommodated in the plurality of accommodation spaces; a display unit displaying accommodation information on the plurality of accommodation spaces; and a controller controlling the display unit to display the receiving space in which the new storage container can be received, based on a detection result of the detection unit.

According to an embodiment, the refrigerator may further include a communication unit communicating with an external device, wherein the controller may control the display unit to display the receiving space of the storage container that may receive the storage item based on information about the food item received from the external device and a detection result of the detection unit.

According to an embodiment, the controller may transmit information about an accommodation space in which the storage container is accommodated to an external device when the storage container is accommodated.

According to an embodiment, the refrigerator may further include a communication unit communicating with an external device, wherein the controller may control the display unit to display the receiving space in which the storage container storing the food item is received, based on information about the food item received from the external device.

According to an embodiment, when the storage container received in the receiving space is unloaded, the controller may transmit information about the receiving space from which the storage container is unloaded to the external device.

According to an embodiment, the detection unit may include a plurality of micro switches installed in positions corresponding to the plurality of receiving spaces.

According to an embodiment, the controller may determine the receiving space in which the storage container is received based on a micro switch that outputs a container detection signal among the plurality of micro switches.

According to an embodiment, the detection unit may include a plurality of infrared sensors installed in positions corresponding to the plurality of receiving spaces.

According to an embodiment, the display unit may include a plurality of light emitting diodes installed in positions corresponding to the plurality of receiving spaces.

According to an embodiment, the controller may control the display unit to make the light emitting diode module corresponding to the receiving space in which the storage container is received emit light.

According to an embodiment, the controller may control the display unit to make the light emitting diode module corresponding to the receiving space in which the storage container may be received emit light.

According to an embodiment, the refrigerator may further include an image pickup unit to pick up an image, wherein the controller may identify the food items stored in the storage container based on the picked-up image when the image pickup unit picks up the image of the storage container.

According to an embodiment, the controller may control the display unit to display the receiving space of the storage container that may receive the identified food item.

According to an embodiment, the refrigerator may further include an image display unit displaying the image captured by the image capturing unit.

Another aspect of the present invention provides a method of controlling a refrigerator including a plurality of receiving spaces having different storage temperature ranges, the method including: identifying a food item stored in a storage container based on a label of the storage container; detecting the storage space stored in each of the plurality of receiving spaces; and displaying an accommodation space in which the storage container is to be stored based on the detection of the storage container.

According to an embodiment, the step of detecting the storage space stored in each of the plurality of receiving spaces may include: a plurality of micro switches installed to correspond to the plurality of receiving spaces are used to determine whether the storage container is received.

According to an embodiment, the displaying of the receiving space in which the storage container is to be stored may include: the receiving space in which the storage container may be received is displayed using a plurality of light emitting diode modules installed to correspond to the plurality of receiving spaces.

According to an embodiment, the step of identifying the food items stored in the storage container may comprise: transmitting an image of the storage container to an external device; and receiving identification information about the food item from the external device.

According to an embodiment, the method may further comprise: receiving information from a user of a food item to be unloaded; and displaying the receiving space of the storage container in which the food item to be unloaded is received.

According to an embodiment, the step of displaying the receiving space of the storage container receiving the food item to be unloaded may include: the receiving space in which the storage container is received is displayed using a plurality of light emitting diode modules installed to correspond to the plurality of receiving spaces.

Yet another aspect of the present invention provides a food management system, comprising: a label detecting unit for detecting a label of the storage container; a holding unit including a plurality of holding spaces for holding the storage container; a detection unit installed in the plurality of holding spaces and detecting whether the storage container is held in the plurality of holding spaces; a display unit installed in each of the plurality of holding spaces; and a display device displaying information about holding the storage container in the plurality of holding spaces, wherein the display unit and the display device may display the holding space in which a new storage container is to be held based on the detection result of the label detecting unit and the information about holding the storage container.

Yet another aspect of the present invention provides a refrigerator, comprising: a main body in which a storage chamber is formed; and a shelf assembly provided in the storage chamber, forming a plurality of receiving spaces and including a container detection sensor for detecting a storage container received in each of the plurality of receiving spaces and a display for displaying receiving information about the storage container.

According to embodiments, a shelf assembly may be provided to protrude from or be inserted into the storage compartment.

According to an embodiment, the container detection sensor may include a reed switch including: a moving member that generates a magnetic field according to whether the storage container is accommodated and moves between a first position and a second position; and a fixing member outputting a container detection signal according to whether the magnetic field is detected.

According to an embodiment, the container detection sensor may include an infrared sensor module including an infrared radiation device radiating infrared light and an infrared detector disposed on a side opposite to the infrared radiation device based on the receiving space and outputting a container detection signal according to whether infrared light is detected.

According to an embodiment, the display may include a light emitting device which is provided to correspond to the plurality of receiving spaces and displays receiving information indicating whether the storage container is received in each of the plurality of receiving spaces.

According to an embodiment, the refrigerator may further include a processor provided in the main body and displaying the accommodation information on the display based on a detection result of the container detection sensor.

According to embodiments, the shelving assembly may include: electrical wires that transmit electrical signals between the container detection sensor, the display, and the processor; and a chain for guiding the electric wire from the shelf assembly to the main body.

According to embodiments, the chain may be expanded or contracted in a moving direction of the shelving assembly, and the chain may be restricted from moving in a direction perpendicular to the moving direction of the shelving assembly.

Advantageous effects

As described above, the refrigerator may recognize food items using an image of the storage container, determine a storage space where the food items may be stored using the container detecting unit, and display the storage space where the food items may be stored using the accommodating space displaying unit.

In addition, the refrigerator may determine a storage space in which the food item selected by the user is stored, display the storage space in which the food item selected by the user is stored, and determine whether the food item selected by the user is unloaded using the container detecting unit.

Drawings

Fig. 1 is a view of an example of operations of a refrigerator and a portable terminal device according to an embodiment of the present invention.

Fig. 2 and 3 are views of the exterior of a refrigerator according to an embodiment of the present invention.

Fig. 4 and 5 are views of the inside of a refrigerator according to an embodiment of the present invention.

Fig. 6 is a view of a shelf assembly included in a refrigerator according to an embodiment of the present invention.

Fig. 7 is a view of a control configuration of a refrigerator according to an embodiment of the present invention.

Fig. 8A is a view of a control panel provided in a first rotational position included in a refrigerator according to an embodiment of the present invention.

Fig. 8B is a view of the left side surface of the control panel shown in fig. 8A.

Fig. 9A is a view of a control panel provided in a second rotational position included in a refrigerator according to an embodiment of the present invention.

Fig. 9B is a view of the left side surface of the control panel shown in fig. 9A.

Fig. 10 is a view of a container inspection unit included in a refrigerator according to an embodiment of the present invention.

Fig. 11 is an enlarged view of the region C shown in fig. 10.

Fig. 12 and 13 are views of a portable terminal device according to an embodiment of the present invention, which is capable of communicating with a refrigerator according to an embodiment of the present invention.

Fig. 14 is a view of an example of a storage container accommodating operation of a refrigerator and a portable terminal device according to an embodiment of the present invention.

Fig. 15 to 17 are views of examples of screens displayed on the portable terminal apparatus.

Fig. 18 and 19 are views of examples in which a portable terminal device recognizes a food item.

Fig. 20 and 21 are views of another example of a screen displayed on the portable terminal apparatus.

Fig. 22 is a view showing a state of an accommodating space in which a storage container can be accommodated in a refrigerator according to an embodiment of the present invention.

Fig. 23 is a view of an example of a screen displayed on the portable terminal apparatus after the storage container is received in the refrigerator according to the embodiment of the present invention.

Fig. 24 is a view of an example of a storage container unloading operation of the refrigerator and the portable terminal device according to the embodiment of the present invention.

Fig. 25 and 26 are views of examples of screens displayed on the portable terminal apparatus in order to unload the storage container from the refrigerator according to the embodiment of the present invention.

Fig. 27 is a view of the refrigerator according to the embodiment of the present invention showing a state in which the receiving space of the storage container is to be unloaded from the refrigerator.

Fig. 28 and 29 are views of examples of screens displayed on the portable terminal apparatus after the storage container is unloaded from the refrigerator according to the embodiment of the present invention.

Fig. 30 is a view of another example of a storage container unloading operation of the refrigerator and the portable terminal device according to the embodiment of the present invention.

Fig. 31 is a view of an example of an item reloading operation of a refrigerator and a portable terminal device according to an embodiment of the present invention.

Fig. 32 is a view of a screen displayed on a cooler according to an embodiment of the present invention when reloading an item.

Fig. 33 is a view of a refrigerator according to an embodiment of the present invention showing a state of a receiving space in which a storage container can be received when an item is reloaded.

Fig. 34 is a view of an example of the operation of a refrigerator according to another embodiment of the present invention.

Fig. 35 is a view of a control configuration of a refrigerator according to another embodiment of the present invention.

Fig. 36 is a view of an example of a storage container accommodating operation of a refrigerator according to another embodiment of the present invention.

Fig. 37 is a view of a case where an image pickup instruction for picking up an image of a storage container is inputted using a refrigerator according to another embodiment of the present invention.

Fig. 38 and 39 are views of an example of a screen displayed on a refrigerator according to another embodiment of the present invention.

Fig. 40 is a view of a refrigerator according to another embodiment of the present invention collecting an image of a storage container and displaying an example of the image.

Fig. 41 is a view of an example in which a refrigerator according to another embodiment of the present invention captures an image of a storage container.

Fig. 42 and 43 are views of another example of a screen displayed on a refrigerator according to another embodiment of the present invention.

Fig. 44 is a view illustrating an example of a storage container unloading operation of a refrigerator according to another embodiment of the present invention.

Fig. 45 is a view of an example of an item reloading operation of a refrigerator according to another embodiment of the present invention.

Figure 46 is a view of the exterior of a cooler according to another embodiment of the present invention.

Fig. 47 is a view of a shelving assembly included in a cooler in accordance with yet another embodiment of the invention.

Fig. 48 is an enlarged view of the shelving assembly shown in fig. 47.

Fig. 49 is a view of a display unit included in the shelving assembly shown in fig. 47.

Fig. 50 is a sectional view taken along line D-D' shown in fig. 49.

Fig. 51 is a view of an example of a storage container detecting unit included in the shelving assembly shown in fig. 47.

Fig. 52 and 53 are sectional views taken along the line a-a' shown in fig. 47.

Fig. 54 is a view of another example of a storage container detecting unit included in the shelving assembly shown in fig. 47.

Fig. 55 and 56 are sectional views taken along the line B-B' shown in fig. 54.

Fig. 57 is a view of still another example of a storage container detecting unit included in the shelving assembly shown in fig. 47.

Fig. 58 and 59 are sectional views taken along the line C-C' shown in fig. 57.

Fig. 60 is a view of the electrical wiring arrangement of the shelving assembly shown in fig. 47.

Fig. 61 is a view of the chain included in the shelving assembly shown in fig. 47.

Fig. 62A and 62B are views of the extended shelving assembly shown in fig. 47.

Detailed Description

The embodiments described in the specification and the configurations shown in the drawings are merely exemplary embodiments of the present invention, and various modifications capable of substituting for the embodiments and drawings of the specification may exist at the time of filing the present application.

Further, in the drawings of the present specification, like reference numerals or signs refer to like parts or elements performing substantially the same function.

In addition, the terminology used in the description is for the purpose of describing particular embodiments only and is not intended to be limiting and/or restrictive of the invention. The use of the expression in the singular includes the expression in the plural unless it is obvious that it is meant otherwise in context. In this specification, it will be understood that terms such as "including" or "having," etc., are intended to indicate the presence of the features, numbers, steps, actions, components, parts, or combinations thereof disclosed in the specification, and are not intended to preclude the possibility that one or more other features, numbers, steps, actions, components, parts, or combinations thereof may be present or may be added.

In addition, it should be understood that although terms including ordinal words such as "first," "second," etc., may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element may be termed a second element, and, similarly, a second element may be termed a first element, without departing from the teachings of the example embodiments. The term "and/or" includes any and all combinations of one or more of the associated listed items.

In addition, a "touch" may be generated by one of the fingers including the thumb or a touchable input unit, such as a stylus. The touch may include a hover generated by one of fingers including a thumb or a touchable input unit. In addition, "touch" may include single touch or multi-touch.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Referring to fig. 1, a refrigerator 100 and a portable terminal apparatus 200 may cooperate with each other to manage food items to be stored in the refrigerator 100.

In detail, the portable terminal device 200 may capture an image of the storage container B storing the food item, and may identify the food item based on the captured image. In this case, the portable terminal device 200 may use a food item database stored in the external server 10 or a food item database stored in the portable terminal device 200 in order to identify food items.

Further, the portable terminal device 200 may display information on the identified food item based on the image of the storage container B. The portable terminal device 200 may use a food item database stored in the external server 10 or a food item database stored in the portable terminal device 200 in order to display information on food items.

If the food item is recognized, the portable terminal device 200 may transmit information about the recognized food item to the refrigerator 100 according to a user's instruction.

The refrigerator 100 receiving the information about the identified food item determines whether the food item is loaded into the receiving space. In other words, the refrigerator 100 determines whether the storage container B of the food item is loaded into the storage compartment. If food items are loaded into the receiving space, the refrigerator 100 may store storage information indicating that the food items are stored in the receiving space, receiving space information regarding a space in which the food items are stored, and information regarding the food items.

Subsequently, if the user selects a food item in order to unload the food item, the refrigerator 100 may determine an accommodation space in which the food item is stored based on the accommodation space information and may display an accommodation space in which the user-selected food item is stored.

As described above, the refrigerator 100 may manage food items stored in the refrigerator 100 in cooperation with the portable terminal apparatus 200.

Hereinafter, the configurations of the refrigerator 100 and the portable terminal apparatus 200 will be described first, and then the detailed operations of the refrigerator 100 and the portable terminal apparatus 200 will be described.

Fig. 2 and 3 are views of the outside of a refrigerator according to an embodiment of the present invention, and fig. 4 and 5 are views of the inside of a refrigerator according to an embodiment of the present invention. Fig. 6 is a view of a shelf assembly included in a refrigerator according to an embodiment of the present invention.

The external and internal structures of the refrigerator 100 according to the embodiment of the present invention will be described with reference to fig. 2 to 6.

The refrigerator 100 may include a refrigerator body 101 constituting an exterior of the refrigerator 100, a storage chamber 102 formed in the refrigerator body 101, and a door 103 shielding the storage chamber 102.

The refrigerator body 101 may include an inner case 101a forming the storage chamber 102, an outer case 101b coupled to an outside of the inner case 101a and forming an outside of the refrigerator 100, and an insulation material disposed between the inner case 101a and the outer case 101b and insulating the storage chamber 102.

The refrigerator body 101 may form the outside of the refrigerator 100 and may accommodate various components constituting the refrigerator 100.

Further, the refrigerator body 101 is opened at the front of the refrigerator 100 to form an opening in the refrigerator body 101, and the storage chamber 102 is disposed in the opening. In addition, a door 103 may be provided at the front of the refrigerator body 101 to shield the storage chamber 102 from the outside.

The door 103 is rotatably coupled to the refrigerator main body 101 using a hinge. Further, a gasket for controlling cool air of the storage chamber 102 by sealing the door 103 and the refrigerator body 101 when the door 103 is closed may be provided at an edge of the rear side of the door 103.

In addition, a micro switch may be provided at one side of the refrigerator body 101 to detect whether the door 103 is opened or closed. For example, the micro switch may output a door open signal when the door 103 is open.

The storage chamber 102 may be partitioned into an upper first storage chamber 102a and a lower second storage chamber 102b using a partition wall 101 c. A storage container B storing food items may be accommodated in the storage chamber 102.

The first storage chamber 102a and the second storage chamber 102b may be maintained at different temperatures. For example, the inside of the first storage chamber 102a may be maintained at a temperature of about 16 ℃, and the inside of the second storage chamber 102b may be maintained at a temperature of about 10 ℃.

In this way, the refrigerator 100 is partitioned into the first and

second storage chambers

102a and 102b and the first and

second storage chambers

102a and 102b are maintained at different temperatures to store various food items. In detail, the first storage chamber 102a may store food items belonging to a first group, and the second storage chamber 102b may store food items belonging to a second group.

For example, it is known that red wine is preferably kept at about 14 ℃ to 18 ℃ to maintain its taste and mouthfeel, while white wine is preferably kept at about 8 ℃ to 13 ℃ to maintain its taste and mouthfeel. Thus, red wine may be stored in the first storage chamber 102a and white wine may be stored in the second storage chamber 102 b.

A plurality of shelf assemblies 900 for receiving storage containers B for storing food items may be provided in the first storage chamber 102a and the second storage chamber 102B.

For example, as shown in fig. 2, first and

second shelving assemblies

900a, 900b may be disposed in the first storage compartment 102a, and third and

fourth shelving assemblies

900c, 900d may be disposed in the second storage compartment 102 b.

The first through fourth shelving assemblies 900a through 900d may protrude forward from the refrigerator body 101, as shown in fig. 3.

In this manner, a plurality of the shelf assemblies 900 are provided to protrude forward from the refrigerator body 101 so that a user can easily receive the storage containers B storing food items in the shelf assemblies 900. Further, when the user unloads the storage container B storing a specific food item from the refrigerator 100, the user may confirm the label attached to the outer surface of the storage container B after extending the shelf assembly 900 forward from the refrigerator 100, and may easily unload the storage container B storing a desired food item from the refrigerator 100.

For purposes of describing the structure of the shelving assembly 900, the first shelving assembly 900a will now be described. In addition, the structures of the second through fourth shelving assemblies 900b through 900d are identical to the structure of the first shelving assembly 900a, and a separate description thereof will be omitted.

The first shelving assembly 900a may include a shelf plate 910a of a storage container B accommodating food items, slide rails 920a movably supporting the shelf plate 910a, and folding arms 930a limiting a moving range of the shelf plate 910a, as shown in fig. 4 to 6.

As shown in fig. 6, a plurality of shelf partition members 941a to 948a partitioning the shelf plate body 910a into a plurality of receiving spaces 951a to 958a are provided in the shelf plate body 910 a.

In order to effectively dispose the storage containers B of food items, a plurality of receiving spaces 951a to 958a may be disposed to be dispersed in front of the shelf plate body 910a and in rear of the shelf plate body 910 a.

For example, as shown in fig. 6, first, third, fifth, and seventh

shelf partition members

941a, 943a, 945a, and 947a may be provided in a front portion of the shelf plate 910a, and second, fourth, sixth, and eighth

shelf partition members

942a, 944a, 946a, and 948a may be provided in a rear portion of the shelf plate 910 a.

The receiving spaces 951a to 958a may be formed by a plurality of shelf partition members 941a to 948 a.

For example, as shown in fig. 6, a first receiving space 951a may be formed between the left wall 911a of the shelf plate body 910a and the second shelf partition member 942a, and a second receiving space 952a may be formed between the first shelf partition member 941a and the third shelf partition member 943 a. A third accommodation space 953a may be formed between the second shelf partition member 942a and the fourth shelf partition member 944a, and a fourth accommodation space 954a may be formed between the third shelf partition member 943a and the fifth shelf partition member 945 a.

Also, a fifth receiving space 955a may be formed between the fourth shelf partition member 944a and the sixth shelf partition member 946a, and a sixth receiving space 956a may be formed between the fifth shelf partition member 945a and the seventh shelf partition member 947 a. The seventh receiving space 957a may be formed between the sixth shelf separation member 946a and the eighth shelf separation member 948a, and the eighth receiving space 958a may be formed between the seventh shelf separation member 947a and the right wall 912a of the shelf plate 910 a.

The slide rails 920a guide forward and backward movement of the shelf plate 910a protruding from the inside of the storage chamber 102. In other words, the shelf panel 910a may protrude from the storage chamber 102 along the slide rail 920a or may be inserted into the storage chamber 102.

The folding arm 930a restricts the movement of the shelf panel 910a so that the shelf panel 910a cannot be separated from the storage chamber 102. In addition, the folding arm 930a may accommodate wires for receiving detection signals from the plurality of micro switch modules 151a to 158a (see fig. 10) to be described below and for supplying control signals to the plurality of light emitting diode modules 171a to 178a (see fig. 10).

The folding arm 930a may include a first arm 931a and a second arm 932a, as shown in fig. 5.

One end of the first arm 931a is rotatably coupled to the outer wall of the shelf plate body 910a, and the other end of the first arm 931a is rotatably coupled to the second arm 932 a. Also, one end of the second arm 932a is rotatably coupled to the inner wall of the storage chamber 102, and the other end of the second arm 932a is rotatably coupled to the first arm 931 a.

In this manner, the first and

second arms

931a and 932a are rotatably coupled to each other such that the folding arm 930 may be unfolded or folded according to the advance and retreat of the shelf plate body 910 a. In other words, the inner angle between the first and

second arms

931a and 932a may be decreased or increased according to the advance and retreat of the shelf plate 910 a.

Further, the range of the inner angle between the first arm 931a and the second arm 932a is limited so that the folding arm 930a may limit the moving range of the shelf plate 910 a.

Further, a torsion spring may be disposed between the first and

second arms

931a and 932a of the folding arm 930 a. The folding arm 930a may use the elastic force of the torsion spring to enable the shelf panel 910a to be easily protruded from the storage chamber 102.

Further, a motor and a gear may be provided between the first and

second arms

931a and 932a of the folding arm 930 a. The folding arm 930a may use a motor and gears to enable the shelf panel 910a to be automatically extended from the storage chamber 102 or automatically inserted into the storage chamber 102.

As described above, the shelf assemblies 900a to 900d may protrude from the storage chamber 102 and may include a plurality of receiving spaces 951a to 958a which may receive the storage containers B.

However, the shape of the shelving assembly of the storage container B for receiving food items is not limited to the first shelving assembly 900a illustrated in fig. 4 to 6. The shelf assembly may adopt various structures that can effectively receive the storage container B and the storage container B can be easily loaded into or unloaded from the refrigerator 100.

The control panel 105 may be disposed in an upper portion of the front side of the refrigerator main body 101. The control panel 105 may receive control instructions from a user and may display operational information of the refrigerator 100.

The configuration and operation of the control panel 105 will now be described in detail.

The exterior and structure of the refrigerator 100 according to the embodiment of the present invention have been described above. However, the above-described refrigerator 100 is only one example of the refrigerator 100 to which the present invention may be applied, and the embodiment of the present invention is not limited to the above-described refrigerator 100.

Hereinafter, a control configuration for controlling the refrigerator 100 according to the embodiment of the present invention will be described.

Fig. 7 is a view of a control configuration of a refrigerator according to an embodiment of the present invention. Fig. 8A is a view of a control panel included in a refrigerator according to an embodiment of the present invention, which is disposed in a first rotational position, and fig. 8B is a view of a left side surface of the control panel shown in fig. 8A. Fig. 9A is a view of a control panel included in a refrigerator according to an embodiment of the present invention, which is disposed in a second rotational position, and fig. 9B is a view of a left side surface of the control panel shown in fig. 9A. Fig. 10 is a view of a container detection unit included in a refrigerator according to an embodiment of the present invention, and fig. 11 is an enlarged view of a region C shown in fig. 10.

Referring to fig. 7 to 11, the refrigerator 100 may include: a user interface 120 for interacting with a user; a temperature detection unit 130 that detects the temperature inside the storage chamber 102; an image acquisition unit 140 that acquires an image of the storage container B; a container detection unit 150 that detects the storage container B provided in the storage chamber 102; a cooling unit 160 supplying cold air to the storage chamber 102; an accommodation space display unit 170 displaying accommodation spaces 951a to 958a of the storage chamber 102; a refrigerator communication unit 180 that performs communication with an external device; and a refrigerator controller 110 that controls the overall operation of the refrigerator 100.

The user interface 120 may receive instructions from a user and may display a plurality of pieces of information to the user. In detail, the user interface 120 may include an input unit that receives an instruction of a user from the user and a display unit that displays a plurality of pieces of information to the user according to the instruction of the user.

For example, the user interface 120 may include a touch screen 121 that receives a touch input from a user and displays operation information corresponding to the touch input of the user.

The touch screen 121 may include a touch panel that detects touch input coordinates contacted by a portion of a user's body and a display panel that displays a plurality of pieces of information according to the touch input of the user.

The touch panel may be disposed at a front side of the display panel and may be formed of a transparent material to prevent distortion of a displayed image. Further, the touch panel may detect whether a part of a user's body is in contact with the touch panel, and may also detect touch input coordinates in which the part of the user's body is in contact.

A capacitive touch panel that detects a change in capacitance caused by a user's touch and a resistive touch panel that detects pressure caused by a user's touch may be used as the touch panel.

The display panel displays a user's instruction that can be input by a user, and displays a plurality of pieces of information according to a touch input of the user. For example, the display panel may display whether the refrigerator 100 is operating, operational information of the refrigerator 100, such as the temperature of the storage compartment 102, and general information, such as weather or time.

A Liquid Crystal Display (LCD) panel, a Light Emitting Diode (LED) panel, or an Organic Light Emitting Diode (OLED) panel may be used as the display panel.

The touch screen 121 may be installed in the control panel 105 provided in an upper portion of the front side of the refrigerator main body 101.

The control panel 105 may protrude from the refrigerator body 101 for the user's convenience.

The control panel 105 may include a panel member 106 mounted with various devices including a touch screen 121 and a panel housing 107 rotatably supporting the panel member 106.

The panel member 106 may be a polygonal column having a fan-shaped bottom surface as shown in fig. 8B and 9B, and may be disposed such that one side included in the polygonal column may face forward. In other words, one side of the polygonal post is the front surface 106a of the panel member 106.

The touch screen 121 described above and a camera module 141 of an image pickup unit 140 to be described below may be installed in the front surface 106a of the panel member 106.

A panel housing 107 is fixedly provided in the refrigerator main body 101 and the panel member 106 is accommodated in the panel housing 107. Specifically, the panel housing 107 can rotatably support the top end of the panel member 106, and the panel member 106 can rotate in the panel housing 107 about the rotation shaft 106b provided on the top end of the panel member 106.

In detail, the panel member 106 is rotatable and movable between a first rotational position P1 shown in fig. 8A and 8B and a second rotational position P2 shown in fig. 9A and 9B.

For example, when the user presses the panel member 106 disposed in the first rotational position P1 as shown in fig. 8A and 8B rearward, the panel member 106 may be rotated about the rotational shaft 106B and may be disposed in the second rotational position P2 as shown in fig. 9A and 9B.

Also, when the user presses the panel member 106 disposed in the second rotational position P2 rearward, the panel member 106 is rotatable about the rotational shaft 106b and is disposed in the first rotational position P1.

When the panel member 106 is disposed in the first rotational position P1, the front surface 106a of the panel member 106 faces forward relative to the refrigerator main body 101, as shown in fig. 8B, and the touch screen 121 of the user interface 120 also faces forward relative to the refrigerator main body 101. Likewise, when the panel member 106 is disposed in the second rotational position P2, the front surface 106a of the panel member 106 faces upward and forward relative to the refrigerator body 101, as shown in fig. 9B, and the touch screen 121 of the user interface 120 also faces upward and forward relative to the refrigerator body 101.

Generally, the user's eye level is in a higher position than the position of the control panel 105 of the refrigerator 100. Therefore, when the panel member 106 is disposed in the second rotational position P2, the user can easily confirm the screen of the touch screen 121 as compared with the case where the panel member 106 is disposed in the first rotational position P1.

The cooling unit 160 may supply cold air to the storage chamber 102.

In detail, the cooling unit 160 may maintain the temperature of the storage chamber 102 within a predetermined range using evaporation of the refrigerant.

The cooling unit 160 may include: a compressor 161 that compresses a gaseous refrigerant; a condenser 163 that changes the compressed gaseous refrigerant into a liquid refrigerant; an expander 165 that decompresses the liquid refrigerant; and an evaporator 167 that changes the decompressed liquid refrigerant into a gas state.

Specifically, the cooling unit 160 may supply cold air to the storage chamber 102 using the following phenomenon: wherein the decompressed liquid refrigerant is changed to a liquid state and absorbs heat from the surrounding air.

However, the configuration of the cooling unit 160 is not limited to the compressor 161, the condenser 163, the expander 165, and the evaporator 167.

For example, the cooling unit 160 may further include a Peltier element using a Peltier (Peltier) effect. The peltier effect is one such effect: when current flows through the contact surfaces between different types of metals, heat dissipation occurs in one metal and heat absorption occurs in another metal.

The cooling unit 160 may also use a peltier element to supply cold air to the storage chamber 102.

As another example, the cooling unit 160 may include a magnetic cooling device using a magnetocaloric effect. The magnetocaloric effect is such an effect: the specific material (magnetocaloric material) dissipates heat when magnetized and absorbs heat when demagnetized.

The cooling unit 160 may also use a magnetic cooling device to supply cold air to the storage chamber 102.

The temperature detection unit 130 may be provided in the storage chamber 102 and may detect the temperature inside the storage chamber 102. In addition, the temperature detection unit 130 may include a first temperature sensor 131 detecting the temperature inside the first storage chamber 102a and a second temperature sensor 132 detecting the temperature of the second storage chamber 102 b.

Each of the first and

second temperature sensors

131 and 132 may include a thermistor of which resistance changes according to temperature.

The image acquisition unit 140 may include a camera module 141 that acquires an image and outputs an electrical signal corresponding to the acquired image.

The camera module 141 may be mounted in the front surface 106a of the panel member 106 included in the control panel 105. In addition, the camera module 141 may include a lens to focus light scattered or reflected from the front of the refrigerator body 101 and an image sensor to convert the focused light into an electrical signal. Here, a Complementary Metal Oxide Semiconductor (CMOS) sensor or a Charge Coupled Device (CCD) sensor may be used as the image sensor.

Further, the shooting direction of the camera module 141 may be changed according to the position of the panel member 106 included in the control panel 105.

For example, when the panel member 106 is disposed in the first rotational position P1 as shown in fig. 8A and 8B, the front surface 106a of the panel member 106 faces forward, and the shooting direction of the camera module 141 is the first shooting direction SD 1. In other words, the camera module 141 may capture an image of an object disposed in front of the control panel 105.

Further, when the panel member 106 is disposed in the second rotational position P2 as shown in fig. 9A and 9B, the front surface 106a of the panel member 106 faces upward and forward with respect to the control panel 105, and the shooting direction of the camera module 141 is the second shooting direction SD 2. In other words, the camera module 141 may capture images of objects disposed above and in front of the control panel 105.

Specifically, the camera module 141 may capture an image of a label attached to the outside of the storage container B. In order to identify the food items stored in the storage container B, the user may capture an image of the tag of the storage container B using the camera module 141.

The container detecting unit 150 is installed in a plurality of receiving spaces 951a to 958a formed in the shelf assembly 900, and detects whether a storage container B is received in each of the receiving spaces 951a to 958 a.

The container detecting unit 150 may detect whether the storage container B is accommodated using various methods.

For example, the container detecting unit 150 may include a plurality of micro switch modules installed to correspond to the plurality of receiving spaces 951a to 958 a.

For the description of the micro switch module, the micro switch modules 151a to 158a installed in the first shelf assembly 900a will be described. The micro-switch modules installed in the second through fourth shelf assemblies 900b through 900d have the same structure as that of the micro-switch modules 151a through 158a installed in the first shelf assembly 900 a.

The plurality of micro-switch modules 151a to 158a may be mounted in the side surfaces of the plurality of shelf partition members 941a to 948a as shown in fig. 10. In detail, a plurality of micro switch modules 151a to 158a may be installed in the plurality of shelf partition members 941a to 948a to correspond to the plurality of receiving spaces 951a to 958 a.

A first micro-switch module 151a detecting the storage container B received in the first receiving space 951a may be installed in the second shelf partition member 942a adjacent to the first receiving space 951a, and a second micro-switch module 152a detecting the storage container B received in the second receiving space 952a may be installed in the first shelf partition member 941a adjacent to the first receiving space 952 a.

Also, a third micro-switch module 153a detecting the storage container B received in the third receiving space 953a may be installed in the fourth shelf partition member 944a adjacent to the third receiving space 953a, and a fourth micro-switch module 154a detecting the storage container B received in the fourth receiving space 954a may be installed in the third shelf partition member 943a adjacent to the fourth receiving space 954 a.

In the same manner, the fifth micro-switch module 155a may be installed in the sixth shelf separation member 946a, the sixth micro-switch module 156a may be installed in the fifth shelf separation member 945a, the seventh micro-switch module 157a may be installed in the eighth shelf separation member 948a, and the eighth micro-switch module 158a may be installed in the seventh shelf separation member 947 a.

Each of the micro-switch modules 151a to 158a may include a rotating member rm and a micro-switch ms, as shown in fig. 11.

When the storage containers B are accommodated in the accommodation spaces 951a to 958a, the rotary member rm transfers the generated pressure to the micro switch ms, and the micro switch ms converts the pressure transferred from the rotary member rm into an electric signal.

In this way, the micro switch modules 151a to 158a may supply the storage container detection signal to the refrigerator controller 110 when the storage container B is received in the receiving spaces 951a to 958 a.

The container inspection unit 150 including the plurality of micro switch modules 151a to 158a has been described above. However, the micro switch modules 151a to 158 are only one example of the container detecting unit 150, and embodiments of the present invention are not limited thereto.

For example, the container detection unit 150 may include: an infrared sensor module radiating infrared light toward the plurality of accommodating spaces 951a to 958a and detecting light reflected from the storage container B; and a laser sensor module radiating laser light toward the plurality of accommodation spaces 951a to 958a and detecting the laser light reflected from the storage container B.

As another example, the container detecting unit 150 may further include an image sensor module that captures an image of the shelf assembly 900a and determines whether the storage container B is received in each of the receiving spaces 951a to 958a based on the captured image of the shelf assembly 900 a.

Further, as another example, a Radio Frequency Identification (RFID) tag may be attached to each storage container B, and the container detecting unit 150 may include an RFID reader. Container detection unit 150 may use an RFID reader to receive information about food items from an RFID tag attached to storage container B and may determine the location at which storage container B is loaded.

The storage space display unit 170 displays empty storage spaces 951a to 958a or displays storage spaces 951a to 958a in which the storage containers B are stored.

In detail, when the user receives the storage container B in the refrigerator 100, the receiving space display unit 170 may display the empty receiving spaces 951a to 958 a. Also, when the user unloads the storage container B from the refrigerator 100, the accommodating space display unit 170 may display the accommodating spaces 951a to 958a in which the storage containers B are accommodated.

For example, the accommodation space display unit 170 may include a plurality of light emitting diodes installed to correspond to the plurality of accommodation spaces 951a to 958 a.

For the description of the light emitting diode modules, the light emitting diode modules 171a to 178a installed in the first shelf assembly 900a will be described. The light emitting diode modules mounted in the second through fourth shelf assemblies 900b through 900d have the same structure as the light emitting diode modules 171a through 178a mounted in the first shelf assembly 900 a.

A plurality of light emitting diode modules 171a to 178a may be mounted in the front wall of the shelf plate body 910a, as shown in fig. 10. In detail, a plurality of light emitting diode modules 171a to 178a may be installed in a front wall of the shelf plate body 910a to correspond to the plurality of receiving spaces 951a to 958 a.

For example, the first light emitting diode module 171a may be mounted in a position corresponding to the first receiving space 951a, and the second light emitting diode module 172a may be mounted in a position corresponding to the second receiving space 952 a. In this way, the third to eighth light emitting diode modules 173a to 178a may be installed in positions corresponding to the third to eighth receiving spaces 953a to 958 a.

When the user loads the storage container B into the refrigerator 100, the light emitting diode module corresponding to the receiving space not receiving the storage container B among the plurality of light emitting diode modules 171a to 178a may emit light. Also, when the user unloads the storage container B from the refrigerator 100, the light emitting diode module corresponding to the receiving space in which the user-desired storage container B has been received may emit light.

In addition, the functions of the plurality of light emitting diode modules 171a to 178a are not limited to showing the accommodation space in which the storage container B can be accommodated or showing the accommodation space in which the storage container B desired by the user is accommodated.

The plurality of light emitting diode modules 171a to 178a may display a plurality of pieces of information using various colors.

For example, the light emitting diode modules 171a to 178a may display the types of food items stored in the storage container B using various colors. In addition, the light emitting diode modules 171a to 178a may also display the time period for which the storage container B is received in the refrigerator 100 using various colors.

The refrigerator communication unit 180 may transmit data to an external device such as the portable terminal device 200, or may receive data from the external device using various communication protocols.

The refrigerator communication unit 180 may include: a bluetooth communication module 181 which communicates with a single external device one-to-one or with a small number of external devices many-to-one; a wireless fidelity (WiFi) communication module 183 capable of accessing a Local Area Network (LAN) using a wireless access point; and a Zigbee communication module 185 forming a local communication network between a plurality of electronic devices (mainly, home appliances).

However, the communication module included in the refrigerator communication unit 180 is not limited to the bluetooth communication module 181, the WiFi communication module 183, and the Zigbee communication module 185. The refrigerator communication unit 180 may include a communication module performing communication based on various communication protocols.

The refrigerator controller 110 controls the overall operation of the refrigerator 100.

The refrigerator controller 110 may include a main processor 111, a graphics processor 113, and a memory 115.

The memory 115 may store a control program or control data for controlling the operation of the refrigerator 100, or may temporarily store control instruction data output by the main processor 111 or image data output by the graphic processor 113.

The memory 115 may include: volatile memories such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM) and flash memories; or non-volatile memory such as Read Only Memory (ROM), or erasable programmable ROM (eprom) or Electrically Erasable Programmable Read Only Memory (EEPROM).

In detail, the nonvolatile memory may store a control program or control data for controlling the operation of the refrigerator 100, and the volatile memory may read the control program and control data from the nonvolatile memory and may temporarily store them, or may temporarily store control instruction data output by the main processor 111 or image data output by the graphic processor 113.

The graphic processor 113 may convert the image data transmitted by the main processor 111, the image data stored in the memory 115, or the image data obtained by the image acquisition unit 140 into image data having a format in which the image data may be displayed on the touch screen 121, and may transmit the converted image data to the touch screen 121.

The main processor 111 processes data stored in the memory 115 according to a control program stored in the memory 115.

For example, the main processor 111 may process a user's instruction input through the user interface 120, a storage compartment temperature received from the temperature detection unit 130, a storage container detection signal received from the container detection unit 150, and communication data received from the refrigerator communication unit 180.

In addition, the main processor 111 may generate image data to be displayed on the touch screen 121 of the user interface 120, a cooling control signal for controlling the cooling unit 160, and a display control signal for controlling the accommodating space display unit 170.

The refrigerator controller 110 may control the cooling unit 160 based on the detection result of the temperature detection unit 130 so that the temperature of the storage chamber 102 may be maintained at a constant level.

When the user loads the storage container B into the refrigerator 100, the refrigerator controller 110 may control the accommodation space display unit 170 based on the communication data received by the refrigerator communication unit 180 so as to display the accommodation spaces 951a to 958a in which the storage container B may be accommodated, the storage container image obtained by the image pickup unit 140, and the detection result of the container detection unit 150.

Also, when the user unloads the storage container B from the refrigerator 100, the refrigerator controller 110 may control the accommodating space display unit 170 based on the communication data received by the refrigerator communication unit 180 so as to display the accommodating spaces 951a to 958a in which the storage containers B are stored and the detection result of the container detection unit 150.

In this manner, the refrigerator controller 110 controls the operation of the various configurations included in the refrigerator 100.

Further, the operation of the refrigerator 100, which will be described below, will be considered to be performed by the control operation of the refrigerator controller 110.

The refrigerator 100 according to the embodiment of the present invention has been described above.

Hereinafter, a portable terminal device that can communicate with the refrigerator 100 according to the embodiment of the present invention will be described.

Referring to fig. 12 and 13, the portable terminal apparatus 200 may include: a user interface 220 for interacting with a user; a sound collection unit 230 collecting sound; an image acquisition unit 240 that acquires an image; a sound output unit 250 that outputs sound; a terminal device communication unit 280 that communicates with an external device such as the refrigerator 100; and a terminal device controller 210 that controls the overall operation of the portable terminal device 200. Further, the portable terminal device 200 may include a terminal device storage unit 290 that optionally stores programs and data regarding the operation of the portable terminal device 200.

The user interface 220 may receive a user's instruction from a user and may display a plurality of pieces of information corresponding to the user's instruction.

The user interface 220 may include

input buttons

221a and 221b for inputting a predetermined user's instruction, and a touch screen 223 for displaying a plurality of pieces of information according to a user's touch input.

The

input buttons

221a and 221b may include: a power button 221a which is provided at a side face 201b of the terminal apparatus main body 201 and turns on/off the power of the portable terminal apparatus 200 or the power of the touch screen 223; and a home button 221b that is provided at a lower portion of the front surface 201a of the terminal apparatus main body 201 and returns the screen displayed on the touch screen 223 to its original screen.

A push switch, a membrane switch, or a touch switch that detects contact of a part of the user's body, which detects the pressurization of the user, may be used as the

input buttons

221a and 221 b.

The

input buttons

221a and 221b are only optional configurations of the portable terminal apparatus 200, and the portable terminal apparatus 200 does not necessarily include the

input buttons

221a and 221 b.

The touch screen 223 may be disposed at the center of the front surface 201a of the terminal apparatus main body 201, may receive a touch input from a user, and may display information corresponding to the touch input by the user.

The touch screen 223 may include a touch panel that detects touch input coordinates for making contact with a portion of a user's body and a display panel that displays a plurality of pieces of information according to the touch input of the user.

The touch panel may be disposed at a front surface of the display panel and may be configured of a transparent material through which an image displayed on the display panel is not distorted. Further, the touch panel may detect whether a part of a user's body is in contact with the touch input coordinates, and may also detect the touch input coordinates in which the part of the user's body is in contact.

A capacitive touch panel that detects a change in capacitance due to a user's contact or a resistive touch panel that detects pressure caused by a user's contact may be used as the touch panel.

The display panel displays a user's instruction that can be input by a user, and displays a plurality of pieces of information according to a touch input of the user. For example, the display panel may also display information about whether the refrigerator 100 is operating, information about the operation of the refrigerator 100, such as the temperature of the storage compartment 102, and general information, such as weather or time.

An LCD panel, an LED panel, or an OLED panel may be used as the display panel.

The sound collection unit 230 may include a microphone 231 that converts sound into an electrical signal. Further, the sound collection unit 230 may provide the electric sound signal converted by the microphone to the terminal device controller 211.

The image acquisition unit 240 may include a camera module 241 that acquires an image and outputs an electrical signal corresponding to the acquired image.

The camera module 241 may be installed in the rear surface of the terminal apparatus body 201, and may include a lens to focus light diverged or reflected from the rear of the terminal apparatus body 201 and an image sensor to convert the focused light into an electrical signal. Here, a CMOS sensor or a CCD sensor may be used as the image sensor.

The sound output unit 250 may include a microphone 251 that converts an electric signal into sound. Here, the sound output unit 250 may receive an electric sound signal from the terminal device controller 210 and may output a sound corresponding to the received electric sound signal.

The terminal device communication unit 280 may include: a bluetooth communication module 281 that communicates with a single external device one-to-one or communicates with a few external devices many-to-one; a WiFi communication module 283 capable of accessing a LAN using a wireless access point; a Zigbee communication module 285 forming a local communication network between a plurality of electronic devices (mainly, home appliances); and a wide area communication module 287 that may communicate with remotely located external devices using a relay device.

Further, the wide area communication module 287 may use a wide area wireless communication method, such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), wireless broadband (Wibro), Worldwide Interoperability for Microwave Access (WiMAX), or Long Term Evolution (LTE).

The terminal device controller 210 controls the overall operation of the portable terminal device 200.

The terminal device controller 210 may include: an input/output interface 217 which communicates data input/output between various configuration devices included in the portable terminal device 200 and the terminal device controller 210; a memory 215 storing programs and data; a graphics processor 213 that performs image processing; and a main processor 211 that performs arithmetic operations on programs and data stored in the memory 215.

The terminal device controller 210 may include a system bus 219 that communicates data reception/transmission between the input/output interface 217, the memory 215, the graphics processor 213, and the main processor 211.

The input/output interface 217 receives user instruction data received by the user interface 220, sound data collected by the sound collection unit 230, and image data collected by the image collection unit 240 using the system bus 219, and transmits the received data to the main processor 211, the graphic processor 213, and the memory 215.

The memory 215 may temporarily store a control program or control data for controlling the operation of the portable terminal device 200, control instruction data output by the main processor 211, or image data output by the graphic processor 213.

The memory 215 may include: volatile memory such as SRAM or DRAM and flash memory; or a non-volatile memory such as a ROM, EPROM or EEPROM.

In detail, the nonvolatile memory may store a control program or control data for controlling the operation of the portable terminal device 200, and the volatile memory may read the control program and control data from the nonvolatile memory and may temporarily store them, or may temporarily store control instruction data output by the main processor 211 or image data output by the graphic processor 213.

The graphic processor 213 may convert the image data transmitted by the main processor 211, the image data stored in the memory 215, or the image data obtained by the image capturing unit 240 into image data having a format in which the image data may be displayed on the touch screen 223, and may transmit the converted image data to the touch screen 223.

The main processor 211 processes data stored in the memory 215 according to a control program stored in the memory 215.

For example, the main processor 211 may process a user's instruction input through the user interface 220, sound data collected by the sound collection unit 230, and communication data received from the terminal device communication unit 280. In addition, the main processor 211 may generate image data to be displayed on the touch screen 223 of the user interface 220 and sound data to be output by the sound output unit 250.

The terminal device controller 210 may output sound data received from an external device using the terminal device communication unit 280 using the sound output unit 250, and may transmit the sound data collected by the sound collection unit 230 to the external device using the terminal device communication unit 280.

The terminal device controller 210 may capture an image of the storage container B according to a user's instruction, and may recognize the food items stored in the storage container B based on the captured image. In addition, the terminal device controller 210 may control the terminal device communication unit 280 to transmit identification information about the food item to the refrigerator 100 together with the storage container accommodating message.

In addition, the terminal device controller 210 may display information of the storage container B received in the refrigerator 100 according to a user's instruction, and may control the terminal device communication unit 280 to transmit identification information about the food item to the refrigerator 100 together with a storage container unloading message.

In this way, the terminal device controller 210 controls the operations of various configurations included in the portable terminal device 200.

Further, the operation of the portable terminal device 200, which will be described below, will be considered to be performed by the control operation of the terminal device controller 210.

The portable terminal device 200 may optionally include a terminal device storage unit 290.

The terminal device storage unit 290 may store a control program and control data for controlling the operation of the portable terminal device 200. Further, the terminal device storage unit 290 may operate as an auxiliary storage device of the memory 215 included in the terminal device controller 210.

Specifically, the terminal device storage unit 290 may include a food item database 291 for identifying food items stored in the refrigerator 100.

An image of a tag attached to the outer surface of the storage container B of the food item in association with identification information on the food item may be stored in the food item database 291 of the terminal device storage unit 290.

Accordingly, the portable terminal device 200 may retrieve identification information on food items from an image of a tag attached to the outer surface of the storage container B using the food item database 291. Here, the identification information on the food items refers to information for distinguishing one food item from another food item, such as the name of the food item, production area, year of production, and manufacturer.

In addition, the food item database 291 may be updated by an external server (see 10 of fig. 1) at every predetermined update period. In detail, the portable terminal device 200 may request the external server (see 10 of fig. 1) to update the food item database 291 every predetermined update period, and may receive the updated food item database 291 from the external server (see 10 of fig. 1).

However, the food item database 291 is not an indispensable configuration of the portable terminal device 200. In other words, if the food item can be identified through the food item database 291 of the external server (see 10 of fig. 1), the portable terminal device 200 does not need to include the food item database 291.

The configurations of the refrigerator 100 and the portable terminal apparatus 200 according to the embodiment of the present invention have been described above.

Hereinafter, operations of the refrigerator 100 and the portable terminal device 200 according to the embodiment of the present invention will be described.

The refrigerator 100 and the portable terminal device 200 may manage food items stored in the refrigerator 100 according to a user's instruction.

First, an example of the operation of the refrigerator 100 and the portable terminal device 200 when a user loads a new food item into the refrigerator 100 will be described.

Fig. 14 is a view of an example of a storage container accommodating operation of a refrigerator and a portable terminal device according to an embodiment of the present invention. Fig. 15 to 17 are views of examples of screens displayed on the portable terminal apparatus. Fig. 18 and 19 are views of examples in which a portable terminal device recognizes a food item. Fig. 20 and 21 are views of another example of a screen displayed on the portable terminal apparatus. Fig. 22 is a view of a refrigerator according to an embodiment of the present invention showing a state of an accommodation space in which a storage container can be accommodated, and fig. 23 is a view of an example of a screen displayed on a portable terminal apparatus after the storage container is accommodated in the refrigerator according to an embodiment of the present invention.

The storage container accommodating operation 1000 of the refrigerator 100 and the portable terminal apparatus 200 will be described with reference to fig. 14 to 23.

The portable terminal device 200 displays an initial screen 300(1010) for managing food items stored in the refrigerator 100 according to a user's instruction.

In detail, the portable terminal device 200 may execute a management application for managing food items stored in the refrigerator 100 according to a user's instruction. If the management application is executed, the portable terminal apparatus 200 may display an initial screen 300 shown in fig. 15 and 16.

For example, the initial screen 300 may be divided into a title area 310, a top menu area 320, a main display area 330, and a bottom menu area 340, as shown in fig. 15 and 16. Further, an image capture icon 301 for capturing an image of the storage container B using the image capture unit 240 included in the portable terminal device 200 may be displayed at one side of the initial screen 300.

A title representing information to be displayed in the main display area 330 may be displayed in the title area 310.

For example, when the information displayed in the main display area 330 is information on food items stored in the refrigerator 100, the title "my refrigerator" may be displayed in the title area 310, as shown in fig. 15.

Various menus may be displayed in top menu region 320, depending on the information to be displayed in main display region 330.

For example, various menus such as a "refrigerator menu" for displaying information on food items stored in the refrigerator 100, a "food item menu" for collecting information on various food items, and an "item evaluation menu" for evaluating food items may be displayed in the top menu region 320.

A method of setting and arranging information to be displayed in the main display area 330 may be displayed in the bottom menu area 340.

For example, an entire display menu 341 displaying all food items stored in the refrigerator 100, a first group display menu 343 displaying food items belonging to a first group, a second group display menu 345 displaying food items belonging to a second group, and a map display menu 347 displaying food items according to positions where the food items are accommodated in the refrigerator 100 may be displayed in the bottom menu region 340.

A plurality of pieces of information may be displayed in the main display area 330 according to a user's selection.

For example, if the user selects the full display menu 341 from the bottom menu region 340, information 331 regarding all food items stored in the refrigerator 100 may be displayed in the main display region 330, as shown in fig. 15. In detail, information 331a about a first item, information 331b about a second item, information 331c about a third item, information 331d about a fourth item, and information 331e about a fifth item stored in the refrigerator 100 may be displayed in the main display area 330.

The user can confirm the food items stored in the refrigerator 100 based on the information 331 about the food items displayed in the main display area 330.

In addition, if the user selects the icon display menu 347 from the bottom menu region 340, the shelf assembly icon 333 displaying the storage container B of food items received in the shelf assembly 900 of the refrigerator 100 may be displayed in the main display region 330, as shown in fig. 16.

In detail, a first shelf assembly designation view 333a showing food items stored in the first shelf assembly 900a, a second shelf assembly designation view 333b showing food items stored in the second shelf assembly 900b, a third shelf assembly designation view 333c showing food items stored in the third shelf assembly 900c, and a fourth shelf assembly designation view 333d showing food items stored in the fourth shelf assembly 900d may be displayed in the main display area 330.

Each of the shelving assembly designation images 333a through 333d displays the location of food items stored in the first through fourth shelving assemblies 900a through 900 d. In detail, the shelf assembly designation views 333a to 333d respectively show whether the storage containers B are received in each of the plurality of receiving spaces 951a to 958a formed in the shelf assemblies 900a to 900 d.

Further, the shelf assembly map 333 may display whether the storage containers B are received in each of the receiving spaces 951a to 958a, and may also display identification information on food items received in the storage containers B.

With respect to the shelf component map 333, the portable terminal device 200 may receive shelf component map information from the refrigerator 100.

For example, the portable terminal device 200 may receive the shelf assembly map information from the refrigerator 100 at predetermined time intervals. In other words, the refrigerator 100 may generate the shelving assembly map information regarding all of the shelving assemblies 900a to 900d at predetermined time intervals based on the detection result of the container detection unit 150, and may transmit the generated shelving assembly map information to the portable terminal apparatus 200.

As another example, if a new storage container B is received in one of the shelf assemblies 900a to 900d or the received storage container B is unloaded from one of the shelf assemblies 900a to 900d, the refrigerator 100 may transmit shelf assembly map information to the portable terminal apparatus 200.

The user may confirm the location of the storage container B containing the food items based on the shelf assembly map 333 displayed in the main display area 330.

Upon displaying the initial screen 300, the portable terminal device 200 determines whether an image of the storage container B of the food item is captured (1020).

When the user wants to additionally accommodate the storage container B of the food item in the refrigerator 100, the user may input a photographing instruction for photographing an image of the storage container B of the food item to the portable terminal apparatus 200 using the image pickup icon 301 provided at one side of the initial screen 300 displayed on the portable terminal apparatus 200.

If a photographing instruction is input, the portable terminal device 200 may display an image photographing screen 400 to capture an image of the storage container B of the food item.

For example, the image photographing screen 400 may include an image display region 410 occupying most of the screen and a bottom menu region 420 in the lower portion of the screen, as shown in fig. 17.

The image display area 410 displays the image captured by the image capturing unit 240 of the portable terminal apparatus 200 in real time.

In detail, the portable terminal device 200 may capture an image of the storage container B using the camera module 241. The image processing, such as resolution change, may be performed on the acquired image using the graphic processor 213 of the terminal device controller 210. Subsequently, an image of the storage container B may be displayed on the touch screen 223 of the user interface 220 in real time.

For example, the portable terminal apparatus 200 may display the storage container image BI shown in fig. 17 on the touch screen 223.

A photographing button 421 for capturing an image displayed on the touch screen 223 and storing the captured image may be provided in the bottom menu region 420.

If the user touches the photographing button 421, the portable terminal device 200 may store an image captured when the user touches the photographing button 421 in the memory 215.

If the storage container image BI of the food item is acquired ("yes" of 1020), the portable terminal device 200 identifies the food item stored in the storage container B based on the image of the storage container B (1030).

In detail, the portable terminal device 200 may identify the food items stored in the storage container B by analyzing the label attached to the outer surface of the storage container B of the image.

Since the name or trademark of the food items stored in the storage container B is indicated on the label of the storage container B, the portable terminal device 200 can identify the food items based on the label.

For example, the portable terminal device 200 may identify food items using a food item database stored in the external server 10.

As shown in fig. 18, the portable terminal device 200 may transmit the storage container image BI to the external server 10 in order to identify the food item.

The external server 10 receiving the storage container image BI from the portable terminal device 200 may identify the food item using the food item database and may generate identification information on the food item. In this case, the identification information on the food item may include a name of the food item, a group to which the food item belongs, a production area of the food item, and a production year of the food item.

For example, the external server 10 may extract feature points from the storage container image BI received from the portable terminal device 200, may compare the feature points with the feature points of the storage container image stored in the food item database, and may identify the food item stored in the storage container B.

In addition, the external server 10 may collect relevant information, such as a price of the food item, an evaluation of the food item by another user, and an evaluation grade of the food item, from the food item database based on the identification information about the food item.

Subsequently, the external server 10 may transmit the identification information on the food item and the related information of the food item to the portable terminal device 200, as shown in fig. 18.

As another example, the portable terminal device 200 may identify a food item using the food item database 291 stored in the terminal device storage unit 290 and may generate identification information on the food item.

The portable terminal device 200 may extract a feature point from the collected storage container image BI, may compare the feature point with a feature point of a storage container image stored in the food item database 291, and may identify a food item stored in the storage container B.

Subsequently, the portable terminal device 200 may transmit the identification information on the food item to the external server 10, as shown in fig. 19. In this case, the identification information on the food item may include a name of the food item, a group to which the food item belongs, a production area of the food item, and a production year of the food item.

The external server 10, which receives the identification information on the food item from the portable terminal device 200, may collect relevant information, such as the price of the food item, the evaluation of the food item by another user, and the evaluation grade of the food item, from the food item database based on the identification information on the food item.

The external server 10 collecting the related information may transmit the related information on the food item to the portable terminal device 200, as shown in fig. 19.

As described above, the portable terminal device 200 captures an image of the storage container B and recognizes the food item using the captured image of the storage container B. However, the embodiments of the present invention are not limited thereto.

For example, in order to identify the food item, the portable terminal device 200 may also identify the food item using a barcode indicated on the storage container B.

Further, if the user speaks the name or trademark of the food item in order to recognize the food item, the portable terminal device 200 may also recognize the user's voice and recognize the food item based on the recognized user's voice.

After identifying the food items stored in the storage container B, the portable terminal device 200 may display identification information about the food items and related information of the food items.

For example, the portable terminal device 200 may display a first item check screen 500, the first item check screen 500 displaying identification information about food items and related information of the food items, as shown in fig. 20.

The first item check screen 500 may include: a title area 510 displaying a title; a storage container display area 520 displaying an image of the storage container B of the identified food item; an information display area 530 displaying information related to the identified food item; and a bottom menu area 540 displaying a menu for inputting various instructions.

Identification information about the food item (such as the name of the identified food item or the group to which the food item belongs) and related information (such as the price of the food item, the evaluation of the food item by another user, and the evaluation rating of the food item by other users) may be displayed in the information display area 530.

In addition, a receiving space display icon 541 for displaying an empty receiving space of the refrigerator 100 so as to store the identified food items in the refrigerator 100 is displayed in the bottom menu region 540.

Subsequently, the portable terminal device 200 determines whether the identified food item is stored in the refrigerator 100 (1040). In other words, the portable terminal device 200 determines whether the storage container B of the identified food item is accommodated in the refrigerator 100.

For example, when the user touches the accommodation space display icon 541 displayed on the above-described item check screen 500, the portable terminal apparatus 200 may determine that the storage container B of the food item is accommodated in the refrigerator 100.

If it is determined that the food item is not stored in the refrigerator 100 (NO of 1040), the portable terminal apparatus 200 terminates the operation being performed.

For example, if the user terminates the application program without touching the accommodation space display icon 541 displayed on the check screen 500, the portable terminal device 200 may terminate the operation related to accommodating the storage container B.

If it is determined that the food item is stored in the refrigerator 100 (yes of 1040), the portable terminal device 200 transmits a receipt message and identification information on the food item to the refrigerator 100 (1050).

In detail, if the user touches the accommodation space display icon 541 displayed on the first item check screen 500, the portable terminal device 200 may transmit identification information about the food item to the refrigerator 100 using the terminal device communication unit 280.

In addition, the portable terminal device 200 may convert the screen displayed on the touch screen 233 into the initial screen 300 displaying the shelf component map 333. For example, the portable terminal device 200 may display a shelf assembly designation view 333, the shelf assembly designation view 333 displaying an accommodation space in which the storage container B can be accommodated, as shown in fig. 21.

Further, the portable terminal device 200 may also display the receiving space of the storage container B adapted to receive the food item according to the group to which the identified food item belongs.

For example, when the identified food items belong to the second group, the portable terminal device 200 may display the third and fourth shelf member identification views 333c and 333d, which respectively display the third and

fourth shelf members

900c and 900d storing the second group of food items, as distinguished from the first and second shelf member identification views 333a and 333 b.

In detail, the portable terminal apparatus 200 may display the third and fourth shelf component designation views 333c and 333d as dark or may display the third and fourth shelf component designation views 333c and 333d as blinking. Further, the portable terminal device 200 may display the first and second shelf member identification views 333a and 333b with shading or may not display them.

The user may determine the shelf assembly of the storage container B that may accommodate the food item based on the shelf assembly designation view 333 of the touch screen 223 of the portable terminal apparatus 200.

The refrigerator 100 receiving the receiving message and the identification information about the food item displays the receiving space in which the storage container B can be received (1060). In detail, the refrigerator 100 may display the receiving space in which the storage container B may be received using the receiving space display unit 170.

The refrigerator 100 may determine an empty receiving space based on the detection result of the container detecting unit 150, and may generate shelf assembly map information based on the position of the receiving space in which the storage container B is received and the position of the empty receiving space.

Further, the refrigerator 100 may determine a group to which the food item belongs based on the received identification information about the food item.

The refrigerator 100 may determine the receiving space in which the storage container B may be received based on the shelf assembly map information indicating the location of the empty receiving space and the group to which the food items belong.

In addition, the refrigerator 100 may display the receiving space in which the storage container B may be received using the receiving space display unit 170.

For example, as shown in FIG. 22, the third and sixth receiving spaces of the first shelving assembly 900a, the first, second, fourth and fifth receiving spaces of the second shelving assembly 900b, the second and fourth receiving spaces of the third shelving assembly 900c and the first, second, sixth, seventh and eighth receiving spaces of the fourth shelving assembly 900d are empty.

In this case, if the food items belong to the second group, the refrigerator 100 may display empty receiving spaces in which the third and

fourth shelving assemblies

900c and 900d of the second group of food items can be stored.

In detail, the refrigerator 100 may control the accommodation space display unit 170 such that the second and fourth light emitting

diode modules

172c and 174c of the third shelf assembly 900c and the first, second, sixth, seventh and eighth light emitting

diode modules

171d, 172d, 176d, 177d and 178d of the fourth shelf assembly 900d can emit light, as shown in fig. 22.

The user can determine the receiving space in which the storage container B can be received using the shelf assembly map 333 displayed on the portable terminal apparatus 200 or the receiving space display unit 170 of the refrigerator 100.

The refrigerator 100 showing an acceptable accommodating space determines whether the storage container B is accommodated in the accommodating space (1070).

The refrigerator 100 may determine whether the storage container B is additionally received in the receiving space based on the detection result of the container detecting unit 150.

For example, if the user receives the storage container B in the fourth receiving space of the third shelving assembly 900c, the refrigerator 100 may determine whether the storage container B is received in the fourth receiving space of the third shelving assembly 900c using the fourth micro switch module of the third shelving assembly 900 c.

If it is determined that the storage container B is not received in the receiving space ("no" of 1070), the refrigerator 100 terminates the operation related to receiving the storage container B.

In detail, if the storage container B is not detected to be accommodated within the predetermined time, the refrigerator 100 may control the accommodating space display unit 170 so as to stop displaying the acceptable accommodating space.

If it is determined that the storage container B is received in the receiving space ("yes" of 1070), the refrigerator 100 transmits shelf assembly map information to the portable terminal apparatus 200 (1080). Here, the shelf assembly designation image information transmitted from the refrigerator 100 to the portable terminal apparatus 200 may include identification information about the receiving space in which the new storage container B is received.

In detail, the refrigerator 100 may transmit identification information about the receiving space in which the new storage container B is received to the portable terminal device 200 using the refrigerator communication unit 180.

Further, the refrigerator 100 updates the shelf assembly map 333 based on the identification information about the food items and the identification information about the receiving space of the storage container B in which the food items are received. In other words, the refrigerator 100 may store identification information about food items in the shelf assembly map 333 in an area corresponding to the receiving space in which the storage container B is received.

The portable terminal device 200 receiving the identification information on the accommodation space updates the shelf assembly map 333 (1090).

The portable terminal apparatus 200 updates the shelving component map 333 based on the shelving component map information received from the refrigerator 100.

For example, when the user receives the storage container B in the fourth receiving space of the third shelving assembly 900c, the portable terminal device 200 may correct the third shelving assembly designation view 333c displaying the third shelving assembly 900c, as shown in fig. 23. In other words, the portable terminal apparatus 200 may correct the third shelf assembly designation view 333c in such a manner that the fourth accommodation space of the third shelf assembly 900c is filled.

As described above, the user can determine the receiving space of the refrigerator 100 suitable for storing the food items using the portable terminal apparatus 200. In addition, the refrigerator 100 may display the receiving space of the storage container B that can receive the food item that the user wants to store.

Hereinafter, an example of operations of the refrigerator 100 and the portable terminal device 200 when the user unloads food items from the refrigerator 100 will be described.

Fig. 24 is a view of an example of a storage container unloading operation of the refrigerator and the portable terminal device according to the embodiment of the present invention. Fig. 25 and 26 are views of examples of screens displayed on the portable terminal apparatus in order to unload the storage container from the refrigerator according to the embodiment of the present invention, and fig. 27 is a view of the refrigerator according to the embodiment of the present invention showing a state in which the receiving space of the storage container is to be unloaded from the refrigerator, and fig. 28 and 29 are views of examples of screens displayed on the portable terminal apparatus after the storage container is unloaded from the refrigerator according to the embodiment of the present invention.

The storage container unloading operation 1100 of the refrigerator 100 and the portable terminal device 200 will be described with reference to fig. 24 to 29.

The portable terminal device 200 displays an initial screen 300(1110) for managing food items stored in the refrigerator 100 according to the user's instruction.

In detail, the portable terminal device 200 may execute a management application for managing food items stored in the refrigerator 100 according to a user's instruction. If the management application is executed, the portable terminal apparatus 200 may display an initial screen 300 shown in fig. 25 on the touch screen 223.

For example, the initial screen 300 may be divided into a title area 310, a top menu area 320, a main display area 330, and a bottom menu area 340, as shown in fig. 25.

The title area 310, the top menu area 320, the main display area 330, and the bottom menu area 340 have been described with reference to fig. 15 and 16, and thus, the description thereof will be omitted.

Specifically, the user may recognize the food items received in the refrigerator 100 based on the information 331 about the food items displayed in the main display area 330.

Upon displaying the initial screen 300, the portable terminal device 200 determines whether the food items stored in the refrigerator will be unloaded from the refrigerator 100 (1120).

If the user wants to unload the storage container B of the food items accommodated in the refrigerator 100, the user can select one from the food item information 331a to 331e displayed in the main display area 330 of the initial screen 300.

For example, the user may touch an area of the main display area 330 of the initial screen 300 corresponding to a food item to be unloaded, as shown in fig. 25.

If it is determined that the food item stored in the refrigerator 100 is unloaded from the refrigerator 100 ("yes" of 1120), the portable terminal device 200 transmits an unloading message and identification information on the food item to be unloaded to the refrigerator 100 (1130).

In detail, if the user selects one of the food item information 331a to 331e displayed in the main display area 330 of the initial screen 300, the portable terminal device 200 may transmit identification information about the selected food item to the refrigerator 100 using the terminal device communication unit 280.

In this way, the portable terminal device 200 can display the related information on the selected food item.

For example, the portable terminal device 200 may display a second item inspection screen 600, the second item inspection screen 600 displaying information related to food items, as shown in fig. 26.

The second item inspection screen 600 may include: a title area 610 displaying a title; a storage container display area 620 displaying an image of the storage container B of the selected food item; and an information display area 630 displaying information related to the selected food item.

The evaluation level of the other user evaluating the food item may be displayed in the information display area 630 along with information about the food item, such as the name of the identified food item and the group to which the food item belongs.

The refrigerator 100 receiving the unloading message and the identification information about the food item displays the receiving space storing the food item (1140). In detail, the refrigerator 100 may display the receiving space of the storage container B receiving the food items using the receiving space display unit 170.

The refrigerator 100 determines the receiving space of the storage container B in which the food items are received, based on the shelf assembly map 333 and the received identification information on the food items.

If the receiving space of the storage container B containing the food items is determined, the refrigerator 100 controls the receiving space display unit 170 so that the light emitting diode module corresponding to the receiving space can emit light.

For example, if the storage container B of the food item selected by the user is received in the second receiving space of the third shelving assembly 900c, as shown in fig. 27, the refrigerator 100 may control the receiving space display unit 170 such that the second light emitting diode module 172c of the third shelving assembly 900c can emit light.

Subsequently, the refrigerator 100 determines whether the storage container B is unloaded from the receiving space (1150).

The refrigerator 100 may determine whether the storage container B is unloaded from the receiving space based on the detection result of the container detecting unit 150.

For example, if the user unloads the storage container B from the second receiving space of the third shelving assembly 900c, the refrigerator 100 may detect that the storage container B is unloaded from the receiving space using the second micro switch module of the third shelving assembly 900 c.

If it is determined that the storage container B is not unloaded from the receiving space (no of 1150), the refrigerator 100 terminates the operation related to unloading the storage container B.

In detail, if the unloading of the storage container B is not detected within a predetermined time, the refrigerator 100 may control the accommodating space display unit 170 so as to stop displaying the accommodating space in which the storage container B, which is not unloaded, is accommodated.

If it is determined that the storage container B is unloaded from the receiving space (yes of 1150), the refrigerator 100 transmits shelf assembly map information to the portable terminal apparatus 200 (1160). Here, the shelf assembly map information transmitted from the refrigerator 100 to the portable terminal apparatus 200 may include identification information about the receiving space where the storage container B is unloaded.

In detail, the refrigerator 100 may transmit identification information about the receiving space, in which the storage container B is unloaded, to the portable terminal device 200 using the refrigerator communication unit 180.

Further, the refrigerator 100 updates the shelf assembly map 333 based on the identification information about the food items and the identification information about the receiving space of the storage container B from which the food items are unloaded. In other words, the refrigerator 100 may delete the identification information about the food items from the region corresponding to the receiving space from which the storage container B is unloaded in the shelf assembly map 333.

The portable terminal apparatus 200 receiving the identification information on the accommodation space updates the shelf member map 333 (1170).

The portable terminal apparatus 200 corrects the shelving member map 333 based on the shelving member map information received from the refrigerator 100.

For example, when the user unloads the storage container B from the second receiving space of the third shelving assembly 900c, the portable terminal device 200 may correct the third shelving assembly designation view 333c displaying the third shelving assembly 900c, as shown in fig. 28. In other words, the portable terminal device 200 can correct the second accommodation space to be empty in the third shelf assembly designation view 333 c.

Further, the portable terminal device 200 may display a food item unload message POP on the screen displayed on the touch screen 233 as shown in fig. 29.

As described above, the user can determine the receiving space of the refrigerator 100 in which the desired food item is stored using the portable terminal device 200. In addition, the refrigerator 100 may display the receiving space of the storage container B receiving the food item desired by the user.

Hereinafter, an example of operations of the refrigerator 100 and the portable terminal device 200 when a user arbitrarily unloads food items from the refrigerator 100 will be described. In detail, an example of operations of the refrigerator 100 and the portable terminal apparatus 200 when the user unloads a food item from the refrigerator 100 using the portable terminal apparatus 200 without selecting the food item to be unloaded will be described.

The storage container unloading operation 1300 of the refrigerator 100 and the portable terminal apparatus 200 will be described with reference to fig. 30.

The refrigerator 100 determines whether the food item is unloaded (1310).

In order to determine whether the food item is unloaded, the refrigerator 100 may determine whether the storage container B is unloaded from the receiving space based on the detection result of the container detecting unit 150.

For example, if the user unloads the storage container B from the second receiving space of the third shelving assembly 900c, the refrigerator 100' may determine that the storage container B is unloaded from the receiving space using the second micro switch module of the third shelving assembly 900 c.

If it is determined that the storage container B is unloaded from the receiving space (yes of 1310), the refrigerator 100' transmits shelf assembly map information to the portable terminal device 200 (1320).

Here, the shelf assembly map information transmitted from the refrigerator 100 to the portable terminal apparatus 200 may include identification information about the receiving space where the storage container B is unloaded.

Alternatively, the shelving assembly map information can include identification information regarding the food items unloaded. The refrigerator 100 may recognize the unloaded food items based on the shelf assembly indication map and the receiving space from which the storage container B is unloaded, and may transmit identification information about the unloaded food items to the portable terminal device 200.

In addition, the refrigerator 100' updates the shelf assembly indication map based on the identification information about the food items and the identification information about the receiving space of the storage container B from which the food items are unloaded. In other words, the refrigerator 100' may delete the identification information about the food items from the region corresponding to the receiving space from which the storage container B is unloaded in the shelf assembly map.

The portable terminal apparatus 200 receiving the shelving assembly map information updates the shelving assembly map based on the received identification information on the receiving space (1320).

The portable terminal apparatus 200 corrects the shelving assembly map based on the received shelving assembly map information.

For example, when the user unloads the storage container B from the second receiving space of the third shelving assembly 900c, the refrigerator 100 may correct the third shelving assembly designation by the way the second receiving space is empty.

As described above, even when the user arbitrarily unloads food items from the refrigerator 100, the refrigerator 100 can recognize the unloaded food items.

Hereinafter, an example of the operation of the refrigerator 100 and the portable terminal device 200 when the user reloads the unloaded food items into the refrigerator 100 will be described.

Fig. 31 is a view of an example of an item reloading operation of a refrigerator and a portable terminal device according to an embodiment of the present invention. Further, fig. 32 is a view of a screen displayed on the refrigerator according to the embodiment of the present invention when an item is reloaded, and fig. 33 is a view of a state in which the refrigerator according to the embodiment of the present invention displays an accommodating space in which a storage container can be accommodated when an item is reloaded.

An item reloading operation 1400 of the refrigerator 100 and the portable terminal device 200 will be described with reference to fig. 31 to 33.

The cooler 100 determines whether to reload the food item (1410).

Here, the reloading of food items refers to reloading remaining food items into the refrigerator 100 after a user consumes a portion of the food items unloaded from the refrigerator 100. For example, a user may unload wine from the refrigerator 100 and may consume only a portion of the wine. In this case, the user may reload the wine storage container (wine bottle) into the refrigerator 100 to preserve the remaining wine.

In this manner, when a user reloads a food item, the cooler 100 may reuse previously generated identification information about the food item without the need to re-identify the food item. For example, when a user reloads the remaining wine into the refrigerator 100, the refrigerator 100 may not need to re-identify the wine and may use previously generated identification information about the wine.

The cooler 100 may use various methods to determine whether to reload the food item.

For example, when a user loads a food item into the cooler 100 within a predetermined time after the food item has been unloaded, the cooler 100 may display a message asking whether to reload the food item.

When a user loads food items into the refrigerator 100 after the food items have been unloaded for a long time, it is likely that the loaded food items will not be food items previously unloaded from the refrigerator 100 but new food items. In other words, if a predetermined time has elapsed since the food item has been unloaded, it is highly likely that the entire unloaded food item will be consumed.

However, when a food item is unloaded and the user immediately loads the food item into the refrigerator 100 again, it is highly likely that the food item to be loaded is a food item that was previously unloaded from the refrigerator 100. In other words, if a predetermined time has not elapsed since the food item has been unloaded, it is highly likely that the user consumes a portion of the unloaded food item and another portion of the unloaded food item will remain.

Based on this, the refrigerator 100 may display a message asking whether to reload the food item when the user loads the food item into the refrigerator 100 within a predetermined time after having been unloaded from the food item.

In detail, when the user opens the door 103 of the refrigerator 100 within a predetermined time after having unloaded food items, the refrigerator 100 may display the reload inquiry message 800 shown in fig. 32 on the touch screen 121.

The reload inquiry message 800 may include: a message display area 810 displaying a message inquiring whether to reload the food item; a confirmation area 820 where the user confirms whether to reload the food item; and a cancel zone 830 where the user confirms that the food item is not reloaded.

As another example, the cooler 100 may include an additional reload button (not shown) for confirming whether to reload the food item. In other words, if the user opens the door 103 after pressing the reload button, the refrigerator 100 may determine that the previously unloaded food item is to be reloaded.

If it is determined that the food item is to be reloaded ("yes" of 1410), the refrigerator 100 displays an accommodating space of the storage container B that can accommodate the food item to be loaded (1420).

In detail, the refrigerator 100 may display the receiving space storing the food items unloaded within a predetermined time using the receiving space display unit 170.

The refrigerator 100 may determine an accommodation space for storing food items unloaded within a predetermined time using the shelf assembly map and may display the accommodation space for storing food items to be reloaded using the accommodation space display unit 170.

For example, if the storage container B containing the food items is unloaded from the second receiving space of the third shelving assembly 900c within a predetermined time from now on, the refrigerator 100 may control the receiving space display unit 170 such that the second light emitting diode module 172c of the third shelving assembly 900c can emit light, as shown in fig. 33.

Subsequently, the refrigerator 100 determines whether a storage container B for the food item is received in the receiving space (1430).

For example, if the user receives the storage container B in the second receiving space of the third shelving assembly 900c, the refrigerator 100 may determine that the storage container B is received in the second receiving space of the third shelving assembly 900c using the second micro switch module of the third shelving assembly 900 c.

If it is determined that the storage container B is not received in the receiving space ("no" of 1430), the refrigerator 100 terminates the operation related to reloading the food item.

If it is determined that the storage container B is received in the receiving space (yes of 1430), the refrigerator 100 transmits map information about the shelf assembly to the portable terminal apparatus 200 (1440). Here, the shelf assembly designation image information transmitted from the refrigerator 100 to the portable terminal apparatus 200 may include identification information on the receiving space in which the loaded storage container B is received and identification information on the loaded food item.

If the storage container B is reloaded into the receiving space from which the storage container B is unloaded within a predetermined time, the refrigerator 100 may determine that the unloaded food item is reloaded within a predetermined time. Accordingly, the refrigerator 100 may transmit identification information on the receiving space in which the reloaded storage container B is received and identification information on the reloaded food items to the portable terminal device 200.

In addition, if the storage container B is received in a receiving space other than the unloading storage container B, the refrigerator 100 may determine that a new food item is loaded. Accordingly, the refrigerator 100 may transmit identification information about the receiving space in which the storage container B is received to the portable terminal apparatus 200.

The portable terminal apparatus 200 receiving the shelf assembly map information updates the shelf assembly map (1450).

The portable terminal apparatus 200 may update the shelf assembly map 333 based on the shelf assembly map information received from the refrigerator 100.

In detail, if the identification information on the receiving space and the identification information on the food items are received from the refrigerator 100, the portable terminal device 200 may update the shelf assembly map in such a manner that: the food item corresponding to the received identification information is stored in the receiving space corresponding to the received identification information.

Further, if the identification information about the receiving space is received from the refrigerator 100, the portable terminal device 200 may update the shelf assembly map in such a manner that: the unidentified food item is stored in the receiving space corresponding to the received identification information.

As described above, if the user reloads the food item, the refrigerator 100 may display the receiving space for storing the reloaded food item.

The method of the refrigerator 100 in cooperation with the portable terminal apparatus 200 to recognize and manage the food items has been described above.

Hereinafter, a method of the refrigerator 100 identifying food items and managing the stored food items will be described.

Fig. 34 is a view of an example of the operation of a refrigerator according to an embodiment of the present invention.

Referring to fig. 34, the refrigerator 100 may manage food items to be stored in the refrigerator 100.

In detail, the refrigerator 100 may capture an image of the storage container B storing the food items, and may identify the food items based on the captured image. In this case, the refrigerator 100 may identify the food items using a food item database stored in the refrigerator 100.

In addition, the refrigerator 100 may display related information of the identified food items based on the image of the storage container B. The refrigerator 100 may use a food item database stored in the external server 10 or a food item database stored in the refrigerator 100 in order to display information related to food items.

If a food item is identified, the cooler 100 determines whether the food item is loaded into the receiving space. In other words, the refrigerator 100 determines whether the storage container B of the food item is loaded into the storage compartment. If a food item is loaded into the receiving space, the refrigerator 100 may record that the food item is held in the receiving space and store information related to the food item.

Subsequently, if the user selects a food item in order to unload the food item, the refrigerator 100 may display an accommodating space in which the food item selected by the user is stored.

Hereinafter, after the configuration of the refrigerator 100 is first described, the detailed operation of the refrigerator 100 is described.

The refrigerator 100 may include a refrigerator body 101, a storage compartment 102, a door 103, and a shelf assembly 900, as described in fig. 2 to 6.

Further, as shown in fig. 35, the refrigerator 100 may include: a user interface 120 for interacting with a user; a temperature detection unit 130 that detects the temperature inside the storage chamber 102; an image acquisition unit 140 that acquires an image of the storage container B; a container detection unit 150 that detects the storage container B stored in the storage chamber 102; a cooling unit 160 supplying cold air to the storage chamber 102; an accommodation space display unit 170 displaying accommodation spaces 951a to 958a of the storage chamber 102; a refrigerator communication unit 180 that performs communication with an external device; a refrigerator storage unit 190 storing programs and data related to the operation of the refrigerator 100; and a refrigerator controller 110 that controls the operation of the refrigerator 100 as a whole.

The descriptions of the user interface 120, the temperature detection unit 130, the image pickup unit 140, the container detection unit 150, the cooling unit 160, the accommodating space display unit 170, the refrigerator communication unit 180, and the refrigerator controller 110 are the same as those of fig. 7, and thus the descriptions thereof will be omitted.

The refrigerator storage unit 190 may store a control program and control data for controlling the operation of the refrigerator 100. Further, the refrigerator storage unit 190 may operate as an auxiliary storage device of the storage 115 to be described below.

In particular, the refrigerator storage unit 190 may include a food item database 191 for identifying food items stored in the refrigerator 100.

An image of a tag attached to an outer surface of the storage container B of the food item in association with identification information about the food item may be stored in the food item database 191 of the refrigerator storage unit 190.

Accordingly, the refrigerator 100 may retrieve identification information about food items from an image of a tag attached to an outer surface of the storage container B using the food item database 191. Here, the identification information on the food items refers to information for identifying one food item with respect to another food item, such as the name of the food item, production area, production year, and manufacturer.

In addition, the food item database 191 may be updated by an external server (see 10 of fig. 1) at every predetermined update period. In detail, the refrigerator 100 may request an external server (see 10 of fig. 1) to update the food item database 191 every predetermined update period, and may receive the updated food item database 191 from the external server (see 10 of fig. 1).

As described above, the refrigerator 100' according to another embodiment may further include the refrigerator storage unit 190 in comparison with the refrigerator 100 according to the embodiment previously described with reference to fig. 7, and the refrigerator storage unit 190 may store the food item database 191.

Hereinafter, another example of the operation of the refrigerator 100 'when the user receives a new storage container B in the refrigerator 100' will be described.

Fig. 36 is a view of an example of a storage container accommodating operation of a refrigerator according to another embodiment of the present invention, and fig. 37 is a view of a case where an image pickup instruction for picking up an image of a storage container is input using the refrigerator according to another embodiment of the present invention. In addition, fig. 38 and 39 are views of examples of screens displayed on a refrigerator according to another embodiment of the present invention. Further, fig. 40 is a view of an example in which a refrigerator according to another embodiment of the present invention captures an image of a storage container and displays the image. Further, fig. 41 is a view of an example in which a refrigerator according to another embodiment of the present invention captures an image of a storage container. In addition, fig. 42 and 43 are views of another example of a screen displayed on a refrigerator according to another embodiment of the present invention.

The storage container accommodating operation 1200 of the refrigerator 100' and the portable terminal apparatus 200 will be described with reference to fig. 36 to 43.

The cooler 100' determines whether food items are to be stored (1210).

When the user wants to additionally store food items in the refrigerator 100 ', the user may input an instruction for capturing an image of the storage container B to the refrigerator 100'.

For example, the user can push a panel member (see 106 of fig. 9A and 9B) of the control panel 105 provided on the front surface of the refrigerator main body 101, as shown in fig. 37.

The panel member (see 106 of fig. 9A and 9B) may be protruded forward according to a pushing operation by a user, as shown in fig. 9A and 9B. Further, when the panel member (see 106 of fig. 9A and 9B) is projected forward, the photographing aspect of the camera module 141 mounted in the front surface 106a of the panel member (see 106 of fig. 9A and 9B) is the second photographing direction (see SD2 of fig. 9A and 9B).

Further, when the user pushes the panel member (see 106 of fig. 9A and 9B) of the control panel 105, the touch screen 121 of the refrigerator 100' may display the initial screen 300.

The initial screen 300 may be divided into a title area 310, a main display area 330, and a bottom menu area 340, as shown in fig. 38 and 39.

A title displaying the information displayed in the main display area 330 may be displayed in the title area 310.

Various menus for setting and arranging information displayed in the main display area 330 may be displayed in the bottom menu area 340.

For example, an entire display menu 341 displaying all food items stored in the refrigerator 100 ', a first group display menu 343 displaying food items belonging to a first group, a second group display menu 345 displaying food items belonging to a second group, and a map display menu 367 displaying food items according to positions where the food items are accommodated in the refrigerator 100' may be displayed in the bottom menu region 340.

For example, if the user selects the full display menu 341 from the bottom menu region 340, information 331 regarding all food items stored in the refrigerator 100' may be displayed in the main display region 330, as shown in fig. 38.

In detail, information 331a about a first item stored in the refrigerator 100 ', information 331b about a second item stored in the refrigerator 100 ', information 331c about a third item stored in the refrigerator 100 ', information 331d about a fourth item stored in the refrigerator 100 ', and information 331e about a fifth item stored in the refrigerator 100 ' may be displayed in the main display area 330.

The user can confirm the food items accommodated in the refrigerator 100' based on the information 331 about the food items displayed in the main display area 330.

In addition, if the user selects the icon display menu 357 from the bottom menu region 340, the shelf assembly icon 333 of the storage container B displaying the food items received in the shelf assembly 900 of the refrigerator 100' is displayed in the main display region 330, as shown in fig. 39.

In detail, a first shelf component indicia view 333a, a second shelf component indicia view 333b, a third shelf component indicia view 333c, and a fourth shelf component indicia view 333d may be displayed in the primary display area 330.

Each of the shelf assembly designation views 333a to 333d shows a position where the storage container B is received in each of the shelf assemblies 900a to 900d included in the refrigerator 100'. In detail, the shelf assembly designation views 333a to 333d respectively show whether the storage containers B are received in each of the plurality of receiving spaces 951a to 958a formed in the shelf assemblies 900a to 900 d.

The refrigerator 100' may update the shelf assembly map based on the detection result of the container detection unit 150.

Further, the user may confirm the location of the storage container B containing the food items based on the shelf assembly map 333 displayed in the main display area 330.

Upon displaying the initial screen 300, the refrigerator 100' determines whether an image of the storage container B is captured (1220).

If the user pushes the panel member (see 106 of fig. 9A and 9B) as shown in fig. 40, the panel member (see 106 of fig. 9A and 9B) mounted with the camera module 141 is projected forward. Further, if the panel member (see 106 of fig. 9A and 9B) is protruded forward, the camera module 141 of the refrigerator 100 'captures an image, and the touch screen 121 of the refrigerator 100' displays the image captured by the camera module 141 in real time.

If the user allows the storage container B to access the control panel 105, as shown in fig. 40, the refrigerator 100' may capture an image of the storage container B using the camera module 141.

In addition, the refrigerator 100' may display an image of the storage container B on the touch screen 121 in real time. The user can determine whether the outside of the storage container B is clearly photographed using the image of the storage container B displayed on the touch screen 121.

The user may input a photographing instruction to the refrigerator 100' while displaying an image of the storage container B using the touch screen 121.

For example, the touch screen 121 of the refrigerator 100' may display a photographing screen 700 including an image of the storage container B captured by the camera module 141, as shown in (a) of fig. 41.

If the label of the storage container B is clearly displayed on the touch screen 121, the user may input an image capture instruction by touching the touch screen 121, as shown in (B) of fig. 41.

If the touch screen 121 is touched, the refrigerator 100' may store an image captured when the user touches the touch screen 121 in the memory 115.

In this case, if the captured image is unclear, the touch screen 121 of the refrigerator 100' may include a rephotographic screen 710 having an icon 711 displaying a rephotographic, as shown in (c) of fig. 41.

Further, if an appropriate image is captured, the touch screen 121 of the refrigerator 100' may include a photographing confirmation screen 720 having an icon 721 displaying photographing confirmation, as shown in (d) of fig. 41.

If an image of the storage container B of the food item is collected ("yes" of 1220), the refrigerator 100' identifies the food item stored in the storage container B based on the image of the storage container B.

In detail, the refrigerator 100' may identify the food items stored in the storage container B by analyzing the label attached to the outer surface of the storage container B of the photographed image.

Since the name or trademark of the food items stored in the storage container B is indicated on the label of the storage container B, the refrigerator 100' may identify the food items based on the name or trademark of the food items indicated on the label.

For example, the refrigerator 100' may identify food items using the food item database 191 stored in the refrigerator storage unit 190 and may generate identification information about the food items. The refrigerator 100' may extract feature points from the collected storage container image BI, may compare the feature points with the feature points of the storage container image stored in the food item database 191, and may identify the food items stored in the storage container B.

In other words, the refrigerator 100 including the food item database 191 may self-identify food items without the aid of external devices.

As another example, the refrigerator 100' may identify food items using a food item database stored in the external server 10.

The refrigerator 100' may transmit the storage container image BI to the external server 10 in order to identify the food item.

The external server 10 receiving the storage container image BI from the refrigerator 100' may identify the food item using the food item database and may generate identification information about the food item. The external server 10 may extract feature points from the storage container image BI received from the refrigerator 100, may compare the feature points with the feature points of the storage container image stored in the food item database, and may identify the food item stored in the storage container B.

The external server 10, which identifies the food item, may transmit identification information about the food item to the refrigerator 100'.

As another example, the refrigerator 100' may identify food items using the food item database 291 stored in the portable terminal device 200.

The refrigerator 100' may transmit the storage container image BI to the portable terminal apparatus 200 in order to identify the food item.

The portable terminal device 200 receiving the storage container image BI from the refrigerator 100' may identify the food item using the food item database 291 and may generate identification information on the food item. The portable terminal apparatus 200 may extract a feature point from the storage container image BI received from the refrigerator 100', may compare the feature point with a feature point of a storage container image stored in the food item database 291, and may identify a food item stored in the storage container B.

The portable terminal device 200, which recognizes the food item, may transmit identification information about the food item to the refrigerator 100'.

As described above, in order to identify the food item, the refrigerator 100' captures an image of the storage container B and uses the captured image of the storage container B. However, the embodiments of the present invention are not limited thereto.

For example, in order to identify food items, the refrigerator 100' may also identify food items using a barcode indicated on the storage container B.

In addition, if the user speaks the name or trademark of the food item in order to recognize the food item, the refrigerator 100 'may also recognize the food item by recognizing the user's voice.

After identifying the food item, the cooler 100' may display identification information about the food item.

For example, the refrigerator 100' may display a first item check screen 500, the first item check screen 500 displaying identification information on food items, as shown in fig. 42.

The first item check screen 500 may include: a title area 510 displaying a title; a storage container display area 520 displaying an image of the storage container B of the identified food item; and an information display area 530 displaying identification information about the identified food item.

Identification information about the food items, such as the names of the identified food items and groups to which the food items belong, may be displayed in the information display area 530.

Subsequently, the refrigerator 100' shows a receiving space (1240) in which the storage container B can be received. In detail, the refrigerator 100' may display the receiving space in which the storage container B may be received using the user interface 120 and the receiving space display unit 170.

The refrigerator 100' may determine an empty receiving space based on the detection result of the container detecting unit 150, and may generate shelving assembly map information based on the position of the receiving space in which the storage container B is received and the position of the empty receiving space.

In addition, the refrigerator 100' may determine a group to which the food item belongs based on the identification information on the food item, and may determine an accommodating space in which the storage container B may be accommodated based on the shelf assembly map information indicating the location of the empty accommodating space and the group to which the food item belongs.

Subsequently, the refrigerator 100' may display the receiving space in which the storage container B may be received using the user interface 120. For example, the refrigerator 100' may display a shelf assembly map 333, the shelf assembly map 333 displaying an accommodation space in which the storage container B can be accommodated, as shown in fig. 42.

In addition, the refrigerator 100' may display the receiving space of the storage container B adapted to receive the food items according to the group to which the identified food items belong, as shown in fig. 43.

fourth shelf members

In detail, the refrigerator 100' may display the third and fourth

shelf assembly icons

333c and 333d as dark or may display the third and fourth

shelf assembly icons

333c and 333d as blinking. In addition, the refrigerator 100' may display the first and second

shelf assembly icons

333a and 333b with shading or may not display them.

In addition, the refrigerator 100' may display the receiving space in which the storage container B may be received using the receiving space display unit 170.

For example, when the food items belong to the second group, the refrigerator 100' may control the accommodation space display unit 170 in such a manner that: the light emitting diode modules corresponding to the empty receiving spaces of the third and

fourth shelving assemblies

900c and 900d may emit light.

The user may determine the receiving space in which the storage container B may be received using the shelf assembly map 333 displayed in the user interface 120 or the receiving space display unit 170.

The refrigerator 100' showing an acceptable accommodating space determines whether the storage container B is accommodated in the accommodating space (1250).

The refrigerator 100' may determine whether the storage container B is additionally received in the receiving space based on the detection result of the container detecting unit 150.

For example, when the user receives the storage container B in the fourth receiving space of the third shelf assembly 900c, the refrigerator 100' may detect that the storage container B is received in the receiving space using the fourth micro switch module of the third shelf assembly 900 c.

If it is determined that the storage container B is not accommodated in the accommodating space (no of 1250), the refrigerator 100' terminates the operation related to accommodating the storage container B.

In detail, if the storage container B is not detected to be accommodated within the predetermined time, the refrigerator 100' may control the accommodating space display unit 170 so as to stop displaying the acceptable accommodating space.

If it is determined that the storage container B is received in the receiving space ("yes" of 1250), the refrigerator 100' updates the shelf assembly map (1260).

The refrigerator 100' updates the shelf assembly indication map based on the identification information about the food items and the identification information about the receiving space of the storage container B in which the food items are received. In other words, the refrigerator 100' may store identification information about food items in an area corresponding to the receiving space in which the storage container B is received in the shelf assembly indication view.

For example, when the user receives the storage container B in the fourth receiving space of the third shelving assembly 900c, the refrigerator 100 may correct the third shelving assembly designation by the way the fourth receiving space is filled.

As described above, a user may determine the receiving space of the cooler 100' that is suitable for storing food items. In addition, the refrigerator 100' may display the receiving space of the storage container B that can receive the food item that the user wants to store.

Hereinafter, another example of the operation of the refrigerator 100 'when the user unloads the storage container B from the refrigerator 100' will be described.

The storage container unloading operation 1300 of the refrigerator 100' will be described with reference to fig. 44.

The cooler 100' determines if the food item is unloaded (1510).

In order to determine whether the food item is unloaded, the refrigerator 100' may determine whether the storage container B is unloaded from the receiving space based on the detection result of the container detecting unit 150.

If it is determined that the storage container B is unloaded from the receiving space ("yes" of 1510), the refrigerator 100' updates the shelf assembly map (1520).

The refrigerator 100' updates the shelf assembly indication map based on the identification information about the food items and the identification information about the receiving space of the storage container B from which the food items are unloaded. In other words, the refrigerator 100' may delete the identification information about the food items from the region corresponding to the receiving space from which the storage container B is unloaded in the shelf assembly map.

As described above, the refrigerator 100' may determine an accommodating space in which a user accommodates food items.

Hereinafter, an example of the operation of the refrigerator 100 when the user reloads the unloaded food item into the refrigerator 100 will be described.

An item reload operation 1600 of the refrigerator 100 will be described with reference to fig. 45.

The cooler 100 determines whether to reload the food item (1610).

As another example, the cooler 100 may include a separate reload button (not shown) for confirming reloading of food items. In other words, when the user opens the door 103 after pressing the reload button, the refrigerator 100 may determine that the previously unloaded food item is to be reloaded.

If it is determined that the food item is to be reloaded ("yes" of 1610), the refrigerator 100 displays a receiving space of the storage container B that can receive the loaded food item (1620).

The refrigerator 100 may determine an accommodation space in which food items unloaded within a predetermined time are stored using the shelf assembly map, and may display an accommodation space in which food items to be reloaded are to be stored using the accommodation space display unit 170.

For example, if the storage container B storing the food items is unloaded from the second receiving space of the third shelving assembly 900c within a predetermined time from now on, the refrigerator 100 may control the receiving space display unit 170 such that the second light emitting diode module 172c of the third shelving assembly 900c can emit light, as shown in fig. 33.

Subsequently, the refrigerator 100 determines whether the storage container B of the food item is received in the receiving space (1630).

If it is determined that the storage container B is not received in the receiving space ("no" of 1630), the refrigerator 100 terminates the operation related to reloading the food item.

If it is determined that the storage container B is received in the receiving space (yes of 1630), the refrigerator 100 updates the shelf assembly map (1640).

If the storage container B is re-received in the receiving space from which the storage container B is unloaded within a predetermined time, the refrigerator 100 may determine that the unloaded food item is re-loaded within a predetermined time. Accordingly, the refrigerator 100 may update the shelf assembly indication map based on the identification information about the receiving space in which the reloaded storage container B is received and the identification information about the reloaded food items.

In addition, if the storage container B is received in a receiving space other than the unloading storage container B, the refrigerator 100 may determine that a new food item is loaded. Accordingly, the cooler 100 may update the shelving assembly map in such a manner that: the unidentified food item is stored in the receiving space that receives the storage container B.

As described above, if the user reloads the food item, the refrigerator 100 may display the receiving space in which the food item is stored.

Hereinafter, a configuration of a refrigerator according to another embodiment of the present invention will be described.

Figure 46 is a view of the exterior of a cooler according to another embodiment of the present invention. The external and internal structure of the refrigerator 2000 will be described with reference to fig. 46.

The refrigerator 2000 may include: a refrigerator body 2001 in which a storage chamber 2002 having an open front side is formed; and a door 2003 shielding the storage compartment 2002.

The refrigerator body 2001 may include an inner case 2001a forming the storage compartment 2002, an outer case 2001b coupled to an outside of the inner case 2001a and forming an outside of the refrigerator 2000, and an insulation material disposed between the inner case 2001a and the outer case 2001b and insulating the storage compartment 2002. The refrigerator body 2001 may form the outside of the refrigerator 2000 and may accommodate various components constituting the refrigerator 2000.

Further, the refrigerator body 2001 has an opening formed in a front side of the refrigerator body 2001, and a storage chamber 2002 is provided in the opening. Further, a door 2003 shielding the storage compartment 2002 from the outside may be provided on the front side of the refrigerator main body 2001.

The door 2003 is rotatably coupled to the refrigerator body 2001 using a hinge. Further, a gasket for sealing the cold air of the storage chamber 102 by sealing the door 2003 and the refrigerator body 2001 when the door 2003 is closed may be provided at an edge of the rear side of the door 2003.

In addition, a micro switch may be provided at one side of the refrigerator main body 2001 in order to detect whether the door 2003 is opened or closed. For example, the micro switch may output a door close signal when the door 2003 is closed, and may output a door open signal when the door 2003 is open.

A storage container B storing food items may be accommodated in the storage compartment 2002. The storage chamber 2002 may be partitioned into a first storage chamber 2002a and a second storage chamber 2002b using a partition wall 2001 c.

The first storage chamber 2002a and the second storage chamber 2002b may be maintained at different temperatures. For example, the interior of the first storage compartment 2002a may be maintained at a temperature of about 16 ℃, and the interior of the second storage compartment 2002b may be maintained at a temperature of about 10 ℃.

In this manner, the refrigerator 2000 is partitioned into the first storage compartment 2002a and the second storage compartment 2002b and the first storage compartment 2002a and the second storage compartment 2002b are maintained at different temperatures to store various food items. In detail, the first storage chamber 2002a may store red wine, and the second storage chamber 2002b may store white wine.

As described above, the storage chamber 2002 is partitioned into the first storage chamber 2002a and the second storage chamber 2002 b. However, embodiments of the present invention are not limited thereto, and the storage chamber 2002 may be formed as a single body or may be divided into three or more storage chambers.

One or more shelf assemblies 2100 for receiving storage containers B for storing food items may be provided in the first storage compartment 2002a and the second storage compartment 2002B. For example, as shown in fig. 46, eight shelving assemblies 2100 may be disposed in the first storage compartment 2002a and four shelving assemblies 2100 may be disposed in the second storage compartment 2002 b. However, the number of shelving assemblies 2100 is not limited by the drawings.

The shelf assembly 2100 may extend toward the front of the cooler body 2001 as shown in fig. 46. In this manner, a plurality of the diaphragm assemblies 2100 are provided to protrude forward so that a user can easily receive the storage container B storing the food items in the diaphragm assemblies 2100. In addition, when the user unloads the storage container B storing a specific food item, the user may check the label attached to the outer surface of the storage container B after the shelf assembly 2100 is protruded forward, and may easily unload the storage container B storing a desired food item.

Hereinafter, the shelving assembly 2100 will be described.

Fig. 47 is a view of a shelving assembly included in a refrigerator in accordance with another embodiment of the invention, and fig. 48 is an enlarged view of the shelving assembly shown in fig. 47. Further, fig. 49 is a view of a display unit included in the shelving assembly shown in fig. 47, and fig. 50 is a sectional view taken along line D-D' shown in fig. 49.

As shown in fig. 47 and 48, shelving assembly 2100 may include: a shelf assembly body 2200 forming receiving spaces 2110 to 2170 receiving the storage containers B; a storage container detecting unit 2300 detecting whether or not a storage container B is accommodated in each of the accommodating spaces 2110 to 2170 and displaying accommodation information indicating that the storage container B is accommodated in each of the accommodating spaces 2110 to 2170; and a chain 2700 connecting the shelving assembly 2100 to the cooler body 2001.

The shelving assembly body 2200 may include an upper plate 2210, a lower plate 2220, slide rails 2230, and a front cover 2240, as shown in fig. 48.

The upper plate 2210 has an alphabetical character "S" shape and forms one or more receiving spaces 2110 to 2170.

For example, the upper plate body 2210 may include a plurality of partition portions 2211 to 2218 disposed in parallel with each other, and a plurality of connecting portions 2211a to 2217a connecting the plurality of partition portions 2211 to 2218.

The plurality of partition portions 2211 to 2218 may include a first partition portion 2211, a second partition portion 2212, a third partition portion 2213, a fourth partition portion 2214, a fifth partition portion 2215, a sixth partition portion 2216, a seventh partition portion 2217, and an eighth partition portion 2218.

Further, the first receiving space 2110 may be formed by the first and

second partition portions

2211 and 2212, and the second receiving space 2120 may be formed by the second and

third partition portions

2212 and 2213, and the third receiving space 2130 may be formed by the third and

fourth partition portions

2213 and 2214. Further, the fourth accommodation space 2140 may be formed by the fourth and

fifth partition portions

2214 and 2215, and the fifth accommodation space 2150 may be formed by the fifth and

sixth partition portions

2215 and 2216, and the sixth accommodation space 2160 may be formed by the sixth and

seventh partition portions

2216 and 2217, and the seventh accommodation space 2170 may be formed by the seventh and

eighth partition portions

2217 and 2218.

A slope may be formed at one side of each of the partition portions 2211 to 2218 in order to accommodate the storage container B. In detail, each of the partition portions 2211 to 2218 may have a polygonal column shape whose cross section is trapezoidal.

Further, the plurality of connection portions 2211a to 2217a may include: a first connection portion 2211a connecting the first and

second partition portions

2211 and 2212; a second connection portion 2212a connecting the second and

third partition portions

2212 and 2213; a third connecting portion 2213a connecting the third and

fourth separating portions

2213 and 2214; a fourth connecting portion 2214a connecting the fourth dividing portion 2214 and the fifth dividing portion 2215; a fifth connecting portion 2215a connecting the fifth dividing portion 2215 and the sixth dividing portion 2216; a sixth connecting portion 2216a connecting the sixth and

seventh separating portions

2216 and 2217; and a seventh connecting portion 2217a connecting the seventh and

eighth dividing portions

2217 and 2218.

In addition, adjacent connecting

portions

2211a and 2212a, 2212a and 2213a, 2213a and 2214a, 2214a and 2215a, 2215a and 2216a, and 2216a and 2217a may be positioned on opposite sides of the partition members 2211 to 2218. Accordingly, the upper plate body 2210 may have an alphabetical character "S" shape including a plurality of partition portions 2211 to 2218 and a plurality of connecting portions 2211a to 2217 a.

In addition, the upper plate body 2210 may be formed as a single body or may be formed by assembling a plurality of the partition portions 2211 to 2218 and a plurality of the connection portions 2211a to 2217 a. In other words, the plurality of partition portions 2211 to 2218 and the plurality of connection portions 2211a to 2217a may be integrated with each other to form the upper plate body 2210, or the plurality of partition portions 2211 to 2218 and the plurality of connection portions 2211a to 2217a may be assembled with each other to form the upper plate body 2210.

The lower plate 2220 may include: a lower base 2221 coupled to the upper plate 2210; a front wall 2222 provided at the front of the lower base 2221; a right wall 2223 provided on the right side of the lower base 2221; a rear wall 2224 provided at the rear of the lower base 2221; and a left wall 2225 provided on the left side of the lower base 2221.

The lower base 2221 may be coupled to the upper plate 2210, and may have an alphabetical character "S" shape, similar to the upper plate 2210. Accordingly, the vent hole through which the cool air flows is formed in the lower portion of each of the receiving spaces 2110 to 2170 receiving the storage container B, so that the storage container B can be cooled more effectively.

A mounting space is formed between the lower base 2221 and the upper plate 2210. The storage container detection unit 2300, the electric wire extending from the storage container detection unit 2300 to the refrigerator main body 2001, and the electric wire extending from the display unit 2600 to the refrigerator main body 2001 may be installed in the installation space.

In addition, an electric wire through hole 2221a through which an electric wire extending from the storage container detection unit 2300 and the display unit 2600 to the refrigerator main body 2001 passes is formed in one side of the lower base 2221, and the electric wire may pass through the electric wire through hole 2221a and may extend to the chain rope 2700.

The front wall 2222, the right wall 2223, the rear wall 2224, and the left wall 2225 prevent the shape of the lower base 2221 from being deformed.

The lower base 2221, the front wall 2222, the right wall 2223, the rear wall 2224, and the left wall 2225 may be formed as a single body and may form a lower plate 2220, or the front wall 2222, the right wall 2223, the rear wall 2224, and the left wall 2225 are assembled with the lower base 2221 and may form the lower plate 2220.

The slide rails 2230 may include a right slide rail 2231 disposed between the right wall 2223 of the lower panel 2220 and the inner wall of the storage compartment 2002, and a left slide rail 2232 disposed between the left wall 2225 of the lower panel 2220 and the inner wall of the storage compartment 2002.

The right slide rail 2231 includes an inner member 2231a fixed to the right wall 2223 of the lower plate 2220 and linearly moving together with the shelf assembly 2100, and an outer member 2231b fixed to an inner wall of the storage compartment 2002 and movably supporting the inner member 2231 a.

The left slide rail 2232 includes an inner member 2232a fixed to the left wall 2225 of the lower plate 2220 and linearly moving together with the shelf assembly 2100, and an outer member 2232b fixed to an inner wall of the storage compartment 2002 and movably supporting the inner member 2232 a.

The shelving assembly 2100 may be movable to extend from the storage compartment 2002 or movable to be inserted into the storage compartment 2002 by use of right and left

slide rails

2231, 2232.

A front cover 2240 is provided on a front wall 2222 of the lower plate body 2220 and protects the display unit 2600 mounted on the front surface of the shelf assembly 2100. In detail, the installation space may be formed between the front wall 2222 of the lower plate body 2220 and the front cover 2240.

The front cover 2240 includes a first front cover 2241 formed of an opaque material and a second front cover 2242 formed of a transparent or translucent material. The first front cover 2241 allows the display unit 2600 to be not directly exposed to a user to produce an aesthetically appealing effect, and the second front cover 2242 allows light emitted from the display unit 2600 to be recognized by the user.

For example, as shown in fig. 48, when the display unit 2600 is disposed on the lower portion of the front wall 2222, an opaque first front cover 2241 may be mounted on the upper portion of the front wall 2222, and a transparent or translucent second front cover 2242 may be mounted on the lower portion of the front wall 2222. Accordingly, light emitted from the display unit 2600 may pass through the second front cover 2242 and may be recognized by a user.

The display unit 2600 displays whether the storage container B is accommodated in each of the accommodating spaces 2110 to 2170. For example, when the user unloads the storage container B, the display unit 2600 may display an empty receiving space, and when the user stores the storage container B, the display unit 2600 may display any one of the receiving spaces 2110 to 2170 in which the storage container B is received.

The display unit 2600 may include one or more light emitting devices 2610 to 2670 installed to correspond to the one or more receiving spaces 2110 to 2170, and a Printed Circuit Board (PCB)2690 on which the light emitting devices 2610 to 2670 are fixed.

One or more light emitting devices 2610 to 2670 may be disposed to correspond to the receiving spaces 2110 to 2170. For example, the one or more light emitting devices 2610 to 2670 may include a first light emitting device 2610 corresponding to the first receiving space 2110, a second light emitting device 2620 corresponding to the second receiving space 2120, a third light emitting device 2630 corresponding to the third receiving space 2130, a fourth light emitting device 2640 corresponding to the fourth receiving space 2140, a first light emitting device 2650 corresponding to the fifth receiving space 2150, a sixth light emitting device 2660 corresponding to the sixth receiving space 2160, and a seventh light emitting device 2670 corresponding to the seventh receiving space 2170.

In addition, each of the light emitting devices 2610 to 2670 may display the accommodation information (information indicating whether the storage container B is accommodated) of each of the accommodation spaces 2110 to 2170. For example, the first light emitting device 2610 may display whether or not the storage container B is received in the first receiving space 2110, the second light emitting device 2620 may display whether or not the storage container B is received in the second receiving space 2120, and the third light emitting device 2630 may display whether or not the storage container B is received in the third receiving space 2130. In addition, each of the fourth to seventh light emitting devices 2640 to 2670 may display whether the storage container B is received in each of the fourth to seventh receiving spaces 2140 to 2170.

Devices, such as Light Emitting Diodes (LEDs), which are turned on or off according to an electrical signal may be used as the light emitting devices 2610 to 2670.

The light emitting devices 2610 to 2670 are fixed on the PCB2690, and the PCB2690 transmits an electrical signal for turning on or off the light emitting elements in the light emitting devices 2610 to 2670. In addition, the PCB2690 includes a connector 2690a for receiving an electrical signal, and the connector 2690a of the PCB2690 is disposed in the mounting space between the upper board 2210 and the lower board 2220.

The above-described light emitting devices 2610 to 2670 receive electric signals corresponding to the accommodation information about the storage container B from a control processor (not shown) provided in the refrigerator main body 2001.

In addition, electric wires transmitting electric signals to each of the light emitting devices 2610 to 2670 extend from the connector 2690a of the PCB2690 and are connected to the refrigerator main body 2001 through the mounting space between the upper plate body 2210 and the lower plate body 2220 and the chain cable 2700. In other words, each of the light emitting devices 2610 through 2670 may receive an electrical signal from a control processor (not shown) of the refrigerator main body 2001 through the chain cable 2700 and the PCB 2690.

The storage container detecting unit 2300 detects whether or not the storage container B is accommodated in each of the accommodating spaces 2110 to 2170. For example, when a user loads the storage container B, the storage container detecting unit 2300 may detect each of the receiving spaces 2110 to 2170 in which the storage container B is loaded.

The storage container detecting unit 2300 may include one or more container detecting sensors 2310 to 2370 installed in one or more receiving spaces 2110 to 2170. For example, the storage container detecting unit 2300 may include a first container detecting sensor 2310 installed in the first receiving space 2110, a second container detecting sensor 2320 installed in the second receiving space 2120, a third container detecting sensor 2330 installed in the third receiving space 2130, a fourth container detecting sensor 2340 installed in the fourth receiving space 2140, a fifth container detecting sensor 2350 installed in the fifth receiving space 2150, a sixth container detecting sensor 2360 installed in the sixth receiving space 2160, and a seventh container detecting sensor 2370 installed in the seventh receiving space 2170.

In addition, each of the container detection sensors 2310 to 2370 may detect whether or not the storage container B is accommodated in each of the accommodating spaces 2110 to 2170. For example, the first container detection sensor 2310 may detect whether the storage container B is received in the first receiving space 2110, and the second container detection sensor 2320 may detect whether the storage container B is received in the second receiving space 2120, and the third container detection sensor 2330 may detect whether the storage container B is received in the third receiving space 2130. In addition, the fourth to seventh container detection sensors 2340 to 2370 may detect whether or not the storage container B is accommodated in each of the fourth to seventh accommodation spaces 2140 to 2170.

Each of the container detection sensors 2310 to 2370 transmits an electric signal indicating a detection result of whether or not the storage container B is accommodated to a control processor (not shown) provided in the refrigerator main body 2001.

In addition, an electric wire transmitting an electric signal extends from each of the container detection sensors 2310 to 2370, and is connected to the refrigerator main body 2001 through an installation space between the upper plate 2210 and the lower plate 2220 and the chain rope 2700. In other words, each of the container detection sensors 2310 through 2370 may transmit an electrical signal to a control processor (not shown) of the refrigerator main body 2001 through the chain cable 2700.

Various sensors such as a reed switch, a micro switch, and an infrared sensor may be used as the container detection sensors 2310 to 2370.

Detailed embodiments of the container detection sensors 2310 through 2370 will be described in detail below.

Fig. 51 is a view of an example of a storage container detecting unit included in the shelving assembly shown in fig. 47, and fig. 52 and 53 are sectional views taken along line a-a' shown in fig. 47.

Each of the container detection sensors 2310 through 2370 (see fig. 47) may include a reed switch, as shown in fig. 51. Since container detection sensors 2310 through 2370 (see fig. 47) have the same shape, the configuration of first container detection sensor 2310 will now be described, and the description of second container detection sensors 2320 through seventh container detection sensor 2370 (see fig. 47) will be omitted.

The container detection sensor 2310 may include: a moving member 2311 movable according to whether or not the storage container B is accommodated; a securing member 2312 secured to the shelving assembly body 2200; and an elastic member 2313 for restoring the moving member 2311.

The moving member 2311 may move in a vertical direction according to whether the storage container B is accommodated in the accommodating space 2110 (a first accommodating space since this description is directed to the first container detection sensor) in which the container detection sensor 2310 is installed.

For example, when the storage container B is not received in the receiving space 2110, the moving member 2311 is disposed at the first position P1, as shown in fig. 52.

In this case, when the storage container B is received in the receiving space 2110, as shown in fig. 53, the moving member 2311 moves downward due to the weight of the storage container B and stops at the second position P2 due to the stoppers 2311a and 2311B formed in the moving member 2311. That is, when the storage container B is accommodated in the accommodating space 2110, the moving member 2311 moves from the first position P1 to the second position P2.

In addition, when the storage container B is removed from the receiving space 2110, the moving member 2311 is moved upward due to the elastic force of the elastic member 2313 and stopped at the first position P1 due to the stoppers 2311a and 2311B formed in the moving member 2311. That is, when the storage container B is removed from the receiving space 2110, the moving member 2311 returns to the first position P1.

The moving member 2311 includes a permanent magnet M that generates a magnetic field in the moving member 2311, and the position where the magnetic field is generated is changed according to the movement of the moving member 2311.

The fixing member 2312 detects a magnetic field generated by the moving member 2311 and outputs an electrical signal indicating whether the magnetic field is detected. For example, the fixing member 2312 may include a switch (not shown) that is turned on or off according to the presence of a magnetic field.

When the moving member 2311 is disposed at the first position P1, as shown in fig. 52, the fixed member 2312 does not detect the magnetic field generated by the permanent magnet M included in the moving member 2311.

On the other hand, when the moving member 2311 is disposed at the second position P2, as shown in fig. 53, the fixing member 2312 may detect a magnetic field generated by the permanent magnet M included in the moving member 2311.

In addition, the fixing member 2312 may output a container detection signal indicating that the storage container B is accommodated or a container non-detection signal indicating that the storage container B is not accommodated according to whether the magnetic field is detected.

For example, the fixing member 2312 may output a container detection signal when the magnetic field generated by the moving member 2311 is detected, and the fixing member 2312 may output a container non-detection signal when the magnetic field generated by the moving member 2311 is not detected.

As described above, when the container detection sensors 2310 to 2370 (see fig. 47) include reed switches, the container detection sensors 2310 to 2370 (see fig. 47) may detect whether or not the storage container B is accommodated using physical pressure generated by the storage container B.

In addition, as above, container detection sensors 2310 to 2370 (see fig. 47) including reed switches have been described. However, the container detection sensors 2310 to 2370 are not limited to reed switches.

Fig. 54 is a view of another example of a storage container detecting unit included in the shelving assembly shown in fig. 47, and fig. 55 and 56 are sectional views taken along line B-B' shown in fig. 54.

As shown in fig. 54, 55, and 56, container detection sensors 2310 through 2370 (see fig. 47) may include

infrared sensor modules

2410a, 2410b … … 2470a, and 2470 b. In addition, each of the

infrared sensor modules

2410a, 2410b … … 2470a and 2470b may include an infrared radiation device 2410a to 2470a that radiates infrared light and an infrared detector 2410b to 2470b that detects infrared light.

The infrared radiation devices 2410a to 2470a and the infrared detectors 2410b to 2470b may be installed to face each other on both sides of each of the accommodating spaces 2110 to 2170, as shown in fig. 54. In detail, the infrared radiation devices 2410a to 2470a and the infrared detectors 2410B to 2470B may be installed to face each other in a direction perpendicular to the longitudinal axis of the storage container B.

For example, the first infrared radiation device 2410a may be installed in the first partition portion 2211 toward the second partition portion 2212, and the first infrared detector 2410b may be installed in the second partition portion 2212 toward the first partition portion 2211 such that the first infrared radiation device 2410a and the first infrared detector 2410b face each other on both sides of the first receiving space 2110.

In addition, a second infrared radiation device 2420a may be installed in the second dividing portion 2212 toward the third dividing portion 2213, and a second infrared detector 2420b may be installed in the third dividing portion 2213 toward the second dividing portion 2212 such that the second infrared radiation device 2420a and the second infrared detector 2420b face each other on both sides of the second accommodating space 2120.

In addition, a third infrared radiation device 2430a may be installed in the third division portion 2213 toward the fourth division portion 2214, and a third infrared detector 2430b may be installed in the fourth division portion 2214 toward the third division portion 2213 such that the third infrared radiation device 2430a and the third infrared detector 2430b face each other on both sides of the third accommodation space 2130.

In addition, each of the fourth to seventh infrared radiation devices 2440a to 2470a and each of the fourth to seventh infrared detectors 2440b to 2470b may be installed to face each other on both sides of each of the fourth to seventh accommodating spaces 2140 to 2170.

Accordingly, when the storage container B is not accommodated in each of the accommodation spaces 2110 to 2170, as shown in fig. 55, the infrared detectors 2410B to 2470B can detect infrared light radiated by the infrared radiation devices 2410a to 2470 a.

On the other hand, when the storage container B is accommodated in each of the accommodation spaces 2110 to 2170, as shown in fig. 56, the infrared detectors 2410B to 2470B do not detect infrared light radiated by the infrared radiation devices 2410a to 2470 a.

In addition, the infrared detectors 2410B to 2470B may output a container detection signal indicating that the storage container B is accommodated or a container non-detection signal indicating that the storage container B is not accommodated, depending on whether infrared light is detected.

For example, the infrared detectors 2410b to 2470b may output container detection signals when infrared light radiated by the infrared radiation devices 2410a to 2470a is detected, and the infrared detectors 2410b to 2470b may output container non-detection signals when infrared light radiated by the infrared radiation devices 2410a to 2470a is not detected.

As described above, container detection sensors 2310 through 2370 (see fig. 47) may include

infrared sensor modules

2410a, 2410b … … 2470a and 2470 b. Container detection sensors 2310 to 2370 (see fig. 47) may detect whether or not storage container B is accommodated according to whether or not infrared light is detected.

However, the medium for detecting the storage container B using the container detection sensors 2310 to 2370 (see fig. 47) is not limited to infrared light, and various detection media such as visible light, laser beam, and ultrasonic wave may be used.

Fig. 57 is a view of still another example of a storage container detecting unit included in the shelving assembly shown in fig. 47, and fig. 58 and 59 are sectional views taken along the line C-C' shown in fig. 57.

As shown in fig. 57, 58, and 59, container detection sensors 2310 through 2370 (see fig. 47) may include

infrared sensor modules

2510a, 2510b … … 2570a and 2570 b. In addition, the

infrared sensor modules

2510a, 2510b … … 2570a and 2570b may include infrared radiation devices 2510a to 2570a that radiate infrared light, and infrared detectors 2510b to 2570b that detect infrared light.

The infrared radiation devices 2510a to 2570a and the infrared detectors 2510b to 2570b may be installed to face each other on both sides of each of the receiving spaces 2110 to 2170, as shown in fig. 57. In detail, the infrared radiation devices 2510a to 2570a and the infrared detectors 2510B to 2570B may be installed to face each other in the same direction as the direction of the longitudinal axis of the storage container B.

For example, a first infrared radiation device 2510a may be installed in the first connection portion 2211a toward the front wall 2222, and a first infrared detector 2510b may be installed in the front wall 2222 toward the first connection portion 2211a, so that the first infrared radiation device 2510a and the first infrared detector 2510b may face each other on both sides of the first receiving space 2110.

In addition, a second infrared radiation device 2520a may be installed in the second connection portion 2212a toward the rear wall 2224, and a second infrared detector 2520b may be installed in the rear wall 2224 toward the second connection portion 2212a, so that the second infrared radiation device 2520a and the second infrared detector 2520b may face each other on both sides of the second housing space 2120.

In addition, a third infrared radiation device 2530a may be installed in the third connection portion 2213a toward the front wall 2222, and a third infrared detector 2530b may be installed in the front wall 2222 toward the third connection portion 2213a, so that the third infrared radiation device 2530a and the third infrared detector 2530b may face each other on both sides of the third receiving space 2130.

In addition, a fourth infrared radiation device 2540a may be installed in the fourth connection portion 2214a toward the rear wall 2224, and a fourth infrared detector 2540b may be installed in the rear wall 2224 toward the fourth connection portion 2214a, so that the fourth infrared radiation device 2540a and the fourth infrared detector 2540b may face each other on both sides of the fourth accommodating space 2140.

In addition, each of the fifth to seventh infrared radiation devices 2550a to 2570a and each of the fourth to seventh infrared detectors 2550b to 2570b may be installed to face each other on both sides of each of the fourth to seventh accommodating spaces 2150 to 2170.

Therefore, when the storage containers B are not accommodated in the accommodating spaces 2110 to 2170, as shown in fig. 58, the infrared detectors 2510B to 2570B can detect infrared light radiated by the infrared radiation devices 2510a to 2570 a.

On the other hand, when the storage container B is accommodated in each of the accommodation spaces 2110 to 2170, as shown in fig. 59, infrared light radiated by the infrared radiation devices 2510a to 2570a is not detected by the infrared detectors 2510B to 2570B.

In addition, the infrared detectors 2510B to 2570B may output a container detection signal indicating that the storage container B is accommodated or a container non-detection signal indicating that the storage container B is not accommodated, depending on whether infrared light is detected.

For example, the infrared detectors 2510b to 2570b may output container detection signals when infrared light radiated by the infrared radiation devices 2510a to 2570a is detected, and the infrared detectors 2510b to 2570b may output container non-detection signals when infrared light radiated by the infrared radiation devices 2510a to 2570a is not detected.

infrared sensor modules

2510a, 2510b … … 2570a and 2570 b. Container detection sensors 2310 to 2370 (see fig. 47) may detect whether or not storage container B is accommodated according to whether or not infrared light is detected.

As above, the storage container detecting unit 2300 has been described.

Hereinafter, a chain cable 2700 connecting the shelf assembly 2100 and the refrigerator main body 2001 will be described (see fig. 47).

Fig. 60 is a view of the electrical wiring arrangement of the shelving assembly shown in fig. 47, and fig. 61 is a view of the chain strand included in the shelving assembly shown in fig. 47, and fig. 62A and 62B are views of the extended shelving assembly shown in fig. 47.

The container detection sensors 2310 to 2370 of the storage container detection unit 2300 include electric wires EW1 to EW7 for transmitting electric signals to a control processor (not shown) provided in the refrigerator body 2001. In addition, the display unit 2600 includes an electric wire EW8 for receiving an electric signal from a control processor (not shown) provided in the refrigerator main body 2001.

A plurality of electric wires EW1 to EW8 for transmitting/receiving electric signals are provided in the installation space between the upper plate 2210 and the lower plate 2220 of the shelf assembly body 2200, as shown in fig. 60.

Further, a plurality of electric wires EW1 to EW8 are inserted into the chain rope 2700 through the electric wire through hole 2221a in the lower plate body 2220.

Chain 2700 is formed by continuously connecting a plurality of chain structures 2701 and forming joints 2702 between the plurality of chain structures 2701, as shown in fig. 61. The chain structures 2701 are connected to each other so as to pivot about an axis using the joints 2702. Thus, the chain 2700 is free to move in the x-z plane shown in FIG. 61, but the chain 2700 is limited in movement in the y-axis direction. In other words, the chain 2700 is free to move in the direction in which the shelving assembly 2100 extends from or is inserted into the storage compartment 2002. Thus, the chain 2700 extends in the direction of extension of the shelving assembly 2100 as the shelving assembly 2100 is extended from the storage compartment 2002, and the chain 2700 retracts in the direction of insertion of the shelving assembly 2100 as the shelving assembly 2100 is inserted into the storage compartment 2002. In addition, the chain 2700 is limited in movement in a direction perpendicular to the direction in which the shelving assembly 2100 extends from or is inserted into the storage compartment 2002.

In addition, a hollow portion is formed in each of the plurality of chain structures 2701. The hollow in each of the plurality of chain structures 2701 forms a hollow that passes through the entire chain rope 2700. In addition, the plurality of electric wires EW1 to EW8 described above are inserted into the hollow portion of the chain cable 2700. Therefore, the plurality of electric wires EW1 to EW8 can be protected from external influences by the chain rope 2700.

In detail, the plurality of electric wires EW1 to EW8 can be prevented from intertwining with each other due to the chain rope 2700. Since the plurality of electric wires EW1 to EW8 are bundled using the chain rope 2700, the plurality of electric wires EW1 to EW8 are prevented from being entangled with each other.

Additionally, while the shelving assembly 2100 is mobile, the plurality of wires EW 1-EW 8 do not jam against the structure in the shelving assembly body 2200 or the storage compartment 2002. As described above, the movement of the plurality of wires EW1 to EW8 is restricted by the chain cable 2700. Thus, multiple wires EW 1-EW 8 are prevented from being located in the path of movement of the shelving assembly 2100. Additionally, a portion of the plurality of wires EW 1-EW 8 are prevented from catching on structures in the storage compartment 2002 as the shelving assembly 2100 moves.

For example, when the shelving assembly 2100 is inserted into the storage compartment 2002, the chain 2700 is disposed beneath the shelving assembly body 2200, as shown in FIG. 62A. Accordingly, a plurality of wires EW 1-EW 8 are also disposed below the shelving assembly body 2200 and do not interfere with movement of the shelving assembly body 2200.

Additionally, when the shelving assembly 2100 extends from the storage compartment 2002, the chain 2700 is disposed behind the shelving assembly body 2200, as shown in FIG. 62B. Accordingly, a plurality of wires EW 1-EW 8 are also disposed behind the shelving assembly body 2200 and do not interfere with movement of the shelving assembly body 2200.

In addition, since the plurality of electric wires EW1 to EW8 are connected to the refrigerator body 2001 through the side wall of the storage compartment 2002, the space of the storage compartment 2002 can be effectively used.

The chain cover 2710 is provided near the chain rope 2700 to fix the chain rope 2700 and protect the chain rope 2700. A chain seating space 2711 may be formed in the chain cover 2710, and the chain 2700 may be received in the chain seating space 2711 of the chain cover 2710.

In detail, one end of the chain rope 2700 is fixed to the shelf assembly main body 2200, and the other end of the chain rope 2700 is fixed to the chain rope cover 2710. In other words, the chain cover 2710 secures the chain 2700 when the shelving assembly body 2100 is loaded/unloaded into/from the storage compartment 2002.

In addition, the chain cover 2710 prevents the chain rope 2700 from being exposed to the outside and prevents the chain rope 2700 from sagging downward due to gravity.

Specifically, the chain cover 2710 may limit movement of the chain 2700 such that the chain 2700 may be disposed within a predetermined range when the shelf assembly body 2100 is loaded/unloaded into/from the storage compartment 2002.

For example, when the shelf assembly 2100 is protruded from the storage chamber 2002, as shown in fig. 62B, at least a portion of the chain rope 2700 is seated in the chain seating space 2711 of the chain rope cover 2710, and a portion of the remaining portion of the chain rope 2700 is disposed at an upper side of the chain seating space 2711.

In this case, when the shelf assembly 2100 is inserted into the storage chamber 2002, the chain cables 2700 are sequentially seated in the chain seating spaces 2710. In addition, when the shelving assembly 2100 is fully inserted into the storage compartment 2002, as shown in fig. 62A, the chain 2700 is seated in the chain seating space 2711 of the chain cover 2710.

As described above, the movement of the chain cable 2700 is restricted by the chain cable cover 2710, and the movement range of the plurality of electric wires EW1 to EW8 is restricted by the chain cable 2700.

By using the chain 2700, the plurality of wires EW 1-EW 8 are prevented from moving freely and the plurality of wires EW 1-EW 8 are prevented from interfering with movement of the shelving assembly 2100. In addition, by using the chain 2700, the plurality of wires EW1 to EW8 are prevented from being disconnected.

While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A cooler, comprising:

a storage chamber including a shelf assembly on which a plurality of receiving spaces are formed;

a plurality of detectors, each of the plurality of detectors being disposed in one of the plurality of accommodating spaces to detect whether the one of the plurality of accommodating spaces is occupied;

a plurality of light emitting diodes, each of which is disposed in one of the plurality of accommodating spaces to display whether the one of the plurality of accommodating spaces is occupied;

a display screen; and

a controller configured to: controlling the plurality of light emitting diodes based on the detection results of the plurality of detectors to display the receiving space of the storage container adapted to receive the first food item,

the controller is further configured to:

controlling the display screen to display a query message of whether to reload the first storage container within a predetermined time after the first storage container is unloaded from the first accommodating space, the query message requesting a user to confirm whether to reload the first storage container in the first accommodating space; and

in response to confirming reloading of the first storage container in the first receiving space, determining that the first storage container previously unloaded will be reloaded in the first receiving space without re-identifying the food item.

2. The refrigerator of claim 1, further comprising a communication unit communicating with an external device, wherein the controller transmits information about an accommodation space in which the storage container is accommodated to the external device when the storage container is accommodated.

3. The refrigerator of claim 1, further comprising a communication unit in communication with an external device, wherein the controller is further configured to: controlling the plurality of light emitting diodes to display the receiving space in which the storage container storing the second food item is received, based on the information about the second food item received from the external device.

4. The refrigerator of claim 3, wherein the controller transmits information about the receiving space, from which the storage container is unloaded, to the external device when the storage container received in the receiving space is unloaded.

5. The refrigerator of claim 1, wherein the plurality of detectors comprise a plurality of micro switches respectively installed in positions corresponding to the plurality of receiving spaces.

6. The refrigerator of claim 5, wherein the controller determines the receiving space in which the storage container is received based on a micro switch that outputs a container detection signal among the plurality of micro switches.

7. The refrigerator of claim 1, wherein the plurality of detectors comprise a plurality of infrared sensors respectively installed in positions corresponding to the plurality of receiving spaces.

8. The cooler of claim 1, wherein the controller is further configured to: controlling the plurality of light emitting diodes so that a light emitting diode module corresponding to an accommodating space in which the storage container is accommodated emits light.

9. The cooler of claim 1, wherein the controller is further configured to: controlling the plurality of light emitting diodes to emit light from a light emitting diode module corresponding to an accommodation space capable of accommodating the storage container.

10. The cooler of claim 1, further comprising an image capture unit to capture images,

wherein, when the image capturing unit captures an image of the storage container, the controller identifies the food item stored in the storage container based on the captured image.

11. The cooler of claim 10, wherein the controller is further configured to: controlling the plurality of light emitting diodes to display the receiving space of the storage container capable of receiving the identified food item.

12. The cooler of claim 10, wherein the display screen displays images captured by the image capture unit.

13. A method of controlling a refrigerator, wherein the refrigerator includes a storage compartment including a shelf assembly on which a plurality of receiving spaces are formed, the method comprising:

identifying a food item stored in a storage container based on a tag of the storage container to acquire information about a group to which the food item belongs;

detecting whether each of the plurality of receiving spaces has a storage container therein;

displaying an accommodating space in which the storage container is to be stored, based on the detection of the accommodating space;

displaying a query message for whether to reload the first storage container within a predetermined time after the first storage container is unloaded from the first accommodating space, the query message requesting a user to confirm whether to reload the first storage container in the first accommodating space; and