KR20120117464A - A refrigerator and a control method the same - Google Patents

Abstract

PURPOSE: A refrigerator and a control method thereof with a recognition device are provided to easily manage food as whether or not the food is brought in and out is confirmed. CONSTITUTION: A method for controlling a refrigerator comprises following steps. The image information inside the refrigerator is obtained by filming the inside the refrigerator(S12). The image information is compared with other image information which is saved before. The information on food is recognized from a comparison result(S16). The image information and the other image information are displayed to be compared. The difference between the image information and the other image information is obtained. The image of the food is matched, and the information on the matched food is displayed. [Reference numerals] (AA) Start; (BB) Finish; (S11) A recognizing unit is operated at a specific spot; (S12) Obtaining the first image information on preserved food; (S13) The recognizing unit is operated again on the basis of the operating conditions; (S14) Obtaining the second image information on the preserved food; (S15) Recognizing the difference between the first and second image information; (S16) Performing the food management based on the difference between the image information

Description

Control method for refrigerators and freezers {A refrigerator and a control method the same}

The present invention relates to a refrigerator and a method of controlling the refrigerator.

Generally, a refrigerator is a device for supplying cold air generated by driving of a refrigeration cycle, and is a device for storing food at a low temperature.

In the case of the conventional refrigerator, it could simply perform a function for storing food at a low temperature. However, in recent years, the need for additional functions in addition to the food storage function is increasing.

An object of the present invention is to provide a refrigerator having a recognition device for obtaining the image in the refrigerator, in order to solve the above problems.

A refrigerator according to an embodiment of the present invention includes a storage space; A door selectively shielding the storage space; A recognition device for recognizing an image of food stored in the storage space or the door; A memory unit configured to store first image information and second image information regarding a food recognized by the recognition device; And a controller configured to recognize a difference image between the first image information and the second image information and to perform food management using the recognized result.

A control method of a refrigerator according to an embodiment of the present invention includes the steps of photographing the inside of the refrigerator and acquiring internal image information; Comparing the intra-vehicle image information with previously stored image information; And recognizing information on food from a comparison result of the in-vehicle image information and pre-stored image information.

According to the proposed embodiment, there is an advantage in that information about food managed in the refrigerator can be confirmed, and food management can be efficiently performed according to the confirmed contents.

In addition, according to the predetermined shooting conditions can be taken in the interior of the plural times, and it is possible to easily manage the food because it is possible to check whether the food is received or shipped depending on whether there is a difference between the captured images. .

In addition, since the state of the food stored in the refrigerator can be confirmed from the outside of the refrigerator, it is possible to determine whether or not to store the specific food without opening the refrigerator door, it is easy to determine whether or not the rearrangement of the food.

Therefore, the power consumption of the refrigerator can be reduced, and the usability of the refrigerator can be increased.

1 is a view showing the internal configuration of a refrigerator according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a refrigerator according to an embodiment of the present invention.
3 is a view illustrating a refrigerator display unit according to an embodiment of the present invention.
4 is a flowchart illustrating a control method of a refrigerator according to an embodiment of the present invention.
5 is a view of a display unit showing a before and after images of food, according to an embodiment of the present invention.
6 is a diagram of a display unit showing information related to a shipped food, according to another embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing the internal configuration of a refrigerator according to an embodiment of the present invention, Figure 2 is a block diagram showing the configuration of a refrigerator according to an embodiment of the present invention.

1 and 2, the refrigerator 10 according to an exemplary embodiment of the present invention includes a main body 20 forming the storage compartments 21 and 22 and an open side of the main body 20. Doors 31 and 32 are included.

The storage chambers 21 and 22 include a freezing chamber 21 for freezing and storing food and a refrigerating chamber 22 for cold storage. The freezing chamber 21 and the refrigerating chamber 22 may be understood as a plurality of spaces partitioned around the partition 41.

Each of the freezing compartment 21 and the refrigerating compartment 22 is provided with a plurality of storage portions 42 for storing the food 50, respectively. The storage unit 42 may be provided in the form of a shelf supporting the food 50. By the storage unit 42, a plurality of storage spaces may be defined in the freezing compartment 21 and the refrigerating compartment 22, respectively.

The doors 31 and 32 include a freezing compartment door 31 and a refrigerating compartment door 32 for opening and closing the freezing compartment 21 and the refrigerating compartment 22, respectively.

The freezing chamber 21 and the refrigerating chamber 22 include a recognizing apparatus 100 for recognizing information about food stored in the storage compartment.

A plurality of recognition apparatuses 100 may be provided in the freezing compartment 21 and the refrigerating compartment 22, respectively. Although not shown in the drawing, the recognition device 100 may be provided in a storage space provided in the doors 31 and 32.

In detail, the recognition device 100 may be provided in plural to recognize the foods stored in the storage units 42 in correspondence with the plurality of storage units 42. In other words, the recognition device 100 may be provided in each of a plurality of storage spaces formed in the storage chamber.

The recognition apparatus 100 may include a photographing apparatus (eg, a camera), a barcode reader, an RFID reader, or a weight sensor.

The photographing apparatus is a device capable of photographing an image of food stored in a refrigerator.

The barcode reader may be understood as a device for reading a bar-code provided to a food or food container, and the RFID reader may be understood as a device for reading an RFID tag provided to a food or food container.

The weight sensor is a device for detecting a storage amount of food, and may be provided in the storage 42. Here, the image of the food, the barcode, the RFID tag, and the storage amount of the food constitute information about the food.

The refrigerator 10 includes an input unit 110 for inputting a predetermined command for managing food, a display unit 130 for displaying information about food, and a memory unit for storing information about the food. 140 and a control unit 150 for controlling food management.

The information about the food may include information about food itself (food itself information) and food management information (food management information).

In detail, the food self information may include, for example, food type, food name, food shape, or food weight information, and the food management information may include information such as food storage location, storage amount, storage period or arrival and departure history. . The food itself and the food management information may be combined to be called "food information."

An interface 170 is defined between the recognition device 100 and the controller 150. The interface 170 is a path for information transfer between the recognition apparatus 100 and the controller 150, and a wired or wireless communication scheme may be applied.

On the other hand, the recognition device 100 may be provided detachably. In this case, the recognition device 100 does not need to be provided in every storage space in the storage compartment, but may be located only in a storage space that requires management.

If the storage space requiring the management is changed, the recognition apparatus 100 may be relocated to the changed storage space.

When the recognition apparatus 100 is detachably provided in the storage compartment, when a wired method is applied to the interface 170, a connector (not shown) for coupling the recognition apparatus 100 may be provided in the storage compartment. have.

3 is a view illustrating a refrigerator display unit according to an embodiment of the present invention.

Referring to FIG. 3, the refrigerator according to an embodiment of the present invention includes a display unit 130 on which food information recognized by the recognition device 100 is displayed. Here, the recognition device 100 may be a camera for obtaining image information of food.

Of course, a barcode reader or an RFID reader may be applied to the recognition device 100, and in this case, an image regarding predetermined information (barcode, tag) about food may be obtained. The camera may be the barcode reader or the RFID reader.

When the predetermined input unit 110 is input, the screen of the display unit 130 may be switched as shown in FIG. 3.

The display unit 130 may display an image of food stored for each storage space partitioned by the storage unit 42. That is, as shown in FIG. 3, the display unit 130 may be displayed to distinguish the first to sixth storage units.

In detail, the display unit 130 includes a freezer compartment display unit 131 for displaying a storage space image of the freezer compartment and a refrigerator compartment display unit 132 for displaying a storage space image of the refrigerator compartment.

In addition, the freezer compartment display unit 131 may be distinguishable from the fourth storage unit to the sixth storage unit, and the refrigerating compartment display unit 132 may be distinguishable from the first storage unit to the third storage unit.

The freezer compartment display unit 131 and the refrigerator compartment display unit 132 may include a food display unit 133 that displays a food image photographed by the recognition apparatus 100. The food display unit 133 corresponds to a food image stored in a refrigerator storage room.

In addition, information about the food image displayed on the display unit 130 may be stored in the memory unit 140.

In the state where the screen is shown as shown in FIG. 3, when the "confirmation input unit" is selected, the display unit 130 may be switched to a preset main screen.

4 is a flowchart illustrating a control method of a refrigerator according to an embodiment of the present invention. 4, a control method of a refrigerator according to an embodiment of the present invention will be described.

In the process of driving the refrigerator, the recognition device 100 may be operated at a specific time. The specific time point is a time point determined according to whether a predetermined condition is met.

For example, the specific time point may be a time point at which the freezing compartment door 31 or the refrigerating compartment door 32 is opened. When it is detected that the freezer compartment door 31 is opened, the recognition devices provided in the freezer compartment 21 may be driven. On the other hand, if it is detected that the refrigerating compartment door 32 is opened, the recognition devices provided in the refrigerating compartment 22 may be driven.

The specific time point may be a time point accumulated in accordance with a predetermined period. For example, when the recognition device 100 is set to operate at an interval of 1 hour and the initial operation time is set to 9 am, the specific time point will be 9 am, 10 am, 11 am, and the like.

The specific time point may be a time point that is integrated at a set period based on a time point when the recognition device 100 is operated. For example, when the recognition device 100 is operated at one time point, the recognition device 100 may be reactivated according to a setting cycle after a predetermined time has elapsed from the one time point.

The specific time point may be a time point at which the user inputs an operation command. That is, when a user inputs a predetermined command through the input unit 110 or the like at a desired time point, the recognition device 100 may be operated (S11).

When the recognition device 100 is operated, first image information about food stored in the storage rooms 21 and 22 may be obtained. In addition, the obtained first image information may be stored in the memory unit 140 (S12).

Based on the operating conditions, the recognition device 100 may be reactivated. The operation condition may be understood as an operation time condition of the recognition apparatus 100 described above.

Accordingly, the time point at which the recognition device 100 is reactivated may be the door opening time point, a specific time according to a setting cycle, a predetermined time elapsed after the operation of the recognition device 100, or a time point when the user inputs an operation command. It may be (S13).

When the recognition device 100 is reactivated, second image information about food stored in the storage rooms 21 and 22 may be obtained. The second image information may be understood as image information obtained after a time point at which the first image information is obtained.

The obtained second image information may be stored in the memory unit 140 (S14).

Based on the stored first image information and the second image information, difference image information between the first and second image information is recognized. The first image information is a "previous image" and the second image information is a "next image". The difference between the two image information may be recognized. For example, the difference of the image information may be recognized through an arithmetic operation. The memory unit 140 may store a "recognition program" for recognizing the difference image information (S15).

Based on the difference image information, information on food may be recognized, and food management may be performed.

For example, if there are more images (second size) of the second image information than the first image information, it may be recognized that food for the added image is received. On the other hand, if there are more images of the second image information (larger) than the second image information, it may be recognized that the food for the deleted image is shipped.

As such, when the food is recognized as received or released, the food management information may be updated. For example, information on whether a particular food is stored, a storage location of a particular food, a storage amount, or a storage period (time of receipt and release) may be updated.

The food management information is updated, including a method in which a user manually corrects (inputs and deletes) predetermined information or a method automatically recognized by a predetermined recognition device.

5 is a view of a display unit showing a before and after images of food, according to an embodiment of the present invention.

Referring to FIG. 5, the display unit 130 may display the previous image and the subsequent image of the food stored in the storage compartment based on the first image information and the second image information.

The display unit 130 includes a position display unit 135 displaying a location of a specific storage space in which the difference image information exists, a previous image display unit 136 on which the first image information is displayed, and the second image information. The subsequent image display unit 137 to be displayed is included.

The location of the specific storage space may be one of the first to sixth storage units described with reference to FIG. 3.

The user may check the contents displayed on the display unit 130 and check the food items that are received or shipped from the storage rooms 21 and 22. In addition, the food management information may be additionally recognized using the input unit 110 or the like. The recognized additional information may be stored in the memory unit 140.

For example, as shown in FIG. 5, when the subsequent image includes fewer food images than the previous image, the corresponding food may be recognized as shipped. Then, the information about the food (for example, information stored in the memory unit 140) can be modified or deleted. That is, information about storage of the food, storage location, storage amount, etc. may be modified or deleted.

On the other hand, although not shown in the figure, if the subsequent image includes more food images than the previous image, it can be recognized that the food is received. In addition, the information on the corresponding food may be corrected or additional information may be input. That is, the information regarding the storage of the food, the storage location, the storage amount, etc. may be corrected or additional information may be input.

In this way, since a plurality of image information is displayed to be comparable, and a user may check and perform food management, food management may be easy and convenience of use may be increased.

FIG. 6 is a diagram of a display unit showing information related to a shipped food, according to another embodiment of the present invention.

Referring to FIG. 6, the display unit 130 may display information about a food corresponding to a tea image based on the first image information and the second image information.

In detail, the memory unit 140 may store an image (representative image) relating to food to be stored in the refrigerator in advance. The food image corresponding to the difference image may be obtained based on the first image information and the second image information, and the representative image and the difference image image may be compared.

Then, after comparing a plurality of representative images and difference image images of the stored food, images matching each other may be recognized. In addition, the matching image (representative image or tea image image) of the food may be displayed on the display unit 130.

Although the images to be compared are not completely identical, the most similar images can be matched and displayed.

The display unit 130 includes a position display unit 135 for displaying a location of a specific storage space in which the difference image information exists, a food image display unit 138 for displaying an image of a food corresponding to the difference image information, and the corresponding food. A food information display unit 139 for displaying information is included.

The food information display unit 139 may display food self information or food management information. For example, a food name, a receipt date or a release date may be displayed. That is, based on the difference image information, additional information about the corresponding food may be further recognized. The recognized additional information may be stored in the memory unit 140.

As such, since the tea image image is obtained from the plurality of image information and the obtained tea image image is compared with the representative image of the food, the particular food that is worn or shipped can be identified, so that food management is easy and convenience of use can be increased. Can be.

10: refrigerator 21: freezer
22: refrigerator compartment 42: storage unit
110: input unit 130: display unit
131: freezer compartment display unit 132: refrigerator compartment display unit
133: food display unit 135: position display unit
136: previous image display unit 137: subsequent image display unit
138: food image display unit 139: food information display unit

Claims (14)

Storage space;
A door selectively shielding the storage space;
A recognition device for recognizing an image of food stored in the storage space or the door;
A memory unit configured to store first image information and second image information regarding a food recognized by the recognition device; And
And a controller configured to recognize a difference image between the first image information and the second image information and to perform food management using the recognized result. The method of claim 1,
And the second image information is recognized at a preset time point after the first image information is recognized. The method of claim 2,
And the first image information or the second image information is recognized at the time when the door is opened. The method of claim 2,
And the first image information or the second image information is recognized according to a setting cycle. The method of claim 2,
The second video information,
After the first image information is recognized, characterized in that the refrigerator is recognized according to a setting cycle. The method of claim 2,
Further comprising an input unit for inputting a command for management of the food,
And the first image information or the second image information is recognized according to the input of the input unit. The method of claim 1,
The recognition device,
And at least one of a camera, a barcode reader, and an RFID reader operated to obtain image information described in the recognition object. The method of claim 1,
In the memory unit,
In addition to the information recognized by the recognition device, the refrigerator further stores additional information for food management. Photographing the inside of the refrigerator and acquiring internal image information of the refrigerator;
Comparing the intra-vehicle image information with previously stored image information; And
And recognizing information on food from a comparison result of the inside image information and previously stored image information. The method of claim 9,
And displaying the intra-vehicle image information and the pre-stored image information in a comparable manner. The method of claim 9,
And obtaining a difference image between the intra-vehicle image information and the pre-stored image information. The method of claim 11,
And matching the image of the food corresponding to the tea image, and displaying information on the matched food. 13. The method according to any one of claims 9 to 12,
In addition to the information on the food recognized from the comparison result of the in-vehicle image information and the previously stored image information,
The control method of the refrigerator further comprises the step of recognizing the additional information about the food. The method of claim 9,
In the information about the food,
Food self information including at least a food name; And
A control method of a refrigerator, which is defined for the management of food and includes food management information including a food storage location, a food storage amount or a storage period.

Images