KR102155196B1 - Artificial intelligence Refrigerator - Google Patents

Abstract

The present invention relates to an artificial intelligent refrigerator. An artificial intelligent refrigerator according to an aspect includes: a main body having an inner wall forming a storage unit; A recognition device for recognizing an image of food stored in the storage unit; A memory for storing first image information and second image information of the food recognized by the recognition device; A discharge port provided on the inner wall to discharge cool air; A cold air control unit for controlling the flow of cold air from the discharge port; And a control unit for determining a location where food is received in the storage unit, and controlling the cold air control unit according to the determined location, using difference image information between the first image information and the second image information.

Description

Artificial intelligence Refrigerator

The present invention relates to a refrigerator.

In general, a refrigerator is a device for supplying cold air generated by driving of a refrigeration cycle, and is a device for storing food in a low temperature state.

Korean Patent Application Publication No. 2012-0117464, which is a prior document, discloses a refrigerator that performs food management by recognizing images of food stored in a storage space.

In the case of the refrigerator, the image of the food is recognized and the storage location and the storage time are managed in the refrigerator.

However, in the case of a conventional refrigerator, it is possible to recognize that the food is stored, but there is a problem in that the stored food cannot be cooled quickly because it does not have a function to control cold air according to the location of the food.

An object of the present invention is to provide a refrigerator capable of rapidly cooling the stored food by intensively supplying cold air to the location by determining the location of the food stored in the storage unit.

A refrigerator according to an aspect includes: a main body having an inner wall forming a storage unit; A recognition device for recognizing an image of food stored in the storage unit; A memory for storing first image information and second image information of the food recognized by the recognition device; A discharge port provided on the inner wall to discharge cool air; A cold air control unit for controlling the flow of cold air from the discharge port; And a control unit for determining a location where food is received in the storage unit, and controlling the cold air control unit according to the determined location, using difference image information between the first image information and the second image information.

The control unit divides an area in the storage unit into a plurality of areas based on the difference image information, and after determining at least one area where food is received from among the plurality of areas, the cold air is concentrated to the determined at least one area. You can control the cold air conditioner.

The cold air control unit includes a rotating vane, a rotating shaft connected to the vane, and a driving unit generating power so that the rotating shaft rotates, and the control unit controls the driving unit so that the vane faces at least one area. do.

The vane controls the discharge direction of the cold air discharged through the discharge port.

When food is put into one area, the control unit controls the driving unit to stop after the vanes are operated to face one area.

When food is put into two or more areas of a plurality of areas, the control unit controls the driving unit to continuously rotate the vanes in order to alternately supply cold air to two or more areas.

The control unit controls the driving unit so that the vane is at the reference position when a predetermined time elapses after the adjustment of the cold air direction is started.

The inner wall is provided with a plurality of discharge ports spaced apart in a horizontal direction, a plurality of cold air control units independently open and close each of the plurality of discharge ports, and the control unit includes the plurality of discharge ports to open the discharge ports corresponding to the area where food is stored. Controls one or more of the cold air conditioning units.

The control unit controls at least one of the plurality of cold air control units to open a preset reference discharge port among the plurality of discharge ports when a predetermined time elapses after the adjustment of the cold air direction is started.

The controller controls at least one of the plurality of cold air control units so that all of the plurality of discharge ports are opened when a predetermined time elapses after the adjustment of the cold air direction is started.

According to the proposed invention, there is an advantage in that the position of the stored food in the storage unit is determined, and cold air can be concentrated toward the stored food, thereby enabling rapid cooling of the stored food.

1 is a perspective view of a refrigerator according to a first embodiment.
FIG. 2 is a cross-sectional view taken along AA of FIG. 1.
3 is a block diagram showing the configuration of a refrigerator according to a third embodiment.
4 is a view showing a screen displayed on the display unit according to the first embodiment.
5 is a flowchart showing a method of controlling a refrigerator according to the first embodiment.
6 is a view showing a display of a previous image and a subsequent image of a food on the display unit according to the first embodiment.
7 is a view showing information related to a food delivered from a display unit according to the first embodiment being displayed.
8 is a view showing a cold air control unit according to the second embodiment.

Hereinafter, exemplary embodiments will be described in detail with reference to the drawings.

Hereinafter, a bottom freezer-type refrigerator in which a freezer compartment is provided below the refrigerating compartment is described as an example, and the idea of the present invention is a side-by-side refrigerator in which the freezer compartment and the refrigerator compartment are disposed left and right, or It should be noted that it can be applied to a variety of refrigerators, such as a top mount type refrigerator or a refrigerator having only a freezer or a freezer.

1 is a perspective view of a refrigerator according to a first embodiment, FIG. 2 is a cross-sectional view taken along line A-A of FIG. 1, and FIG. 3 is a block diagram showing the configuration of a refrigerator according to a third embodiment.

1 to 3, the refrigerator 10 according to the first embodiment includes a main body 20 forming the storage compartments 21 and 22, and the storage compartments 21 and 22 connected to the main body 20. ) To open and close the door (31, 32) may be included.

The storage chambers 21 and 22 may include a freezing chamber 21 for freezing and storing food and a refrigerating chamber 22 for refrigerating storage. The refrigerating chamber 21 and the freezing chamber 21 may be disposed in a vertical direction, and a freezing chamber 21 may be disposed below the refrigerating chamber 22.

At least one of the freezing chamber 21 and the refrigerating chamber 22 may be provided with a plurality of storage units for storing food, respectively. The plurality of storage units may be divided up and down or left and right by shelves supporting the food.

The doors 31 and 32 may include a freezing compartment door 31 and a refrigerating compartment door 32 for opening and closing the freezing compartment 21 and the refrigerating compartment 22, respectively.

At least one of the storage units of the freezing chamber 21 and the refrigerating chamber 22 may be provided with a recognition device 100 for photographing each of the storage units.

For example, a plurality of recognition devices 100 may be provided in each of the freezing chamber 21 and the refrigerating chamber 22. Meanwhile, although not shown in the drawings, the recognition device 100 may be provided in a storage space provided in the doors 31 and 32.

The recognition device 100 may be installed on an inner wall 23 forming the freezing chamber 21 or the refrigerating chamber 22. In FIG. 1, for example, the recognition device 100 is installed on the side wall of the inner wall 23, but is not limited thereto, and it may be installed on the rear wall, the upper wall or the lower wall of the inner wall 23. Alternatively, when the plurality of storage units are partitioned by shelves, they may be installed on the shelves.

In detail, the recognition device 100 may be provided with a plurality of pieces so that food stored in each storage unit can be distinguishably recognized in correspondence with the plurality of storage units. In other words, the recognition device 100 may be provided in each of a plurality of storage units formed in the storage chamber.

The recognition device 100 may be, for example, a camera.

The refrigerator 10 includes an input unit 110 for inputting a predetermined command for food management, a display unit 130 for displaying information on food, and a memory unit for storing information on the food. 140 and a control unit 150 for controlling food management, and a cold air control unit 50 for adjusting the flow of cold air supplied to the storage unit.

The information on the food may include information on the food itself (food itself information) and information on food management (food management information).

The food itself information includes, for example, a food type (category), a food name, a food shape, and the like, and the food management information may include information such as a storage location, a storage amount, a storage period, or an entry/exit history of the food. The storage location of the food includes a location of any one of a plurality of storage sections in the storage room and a relative location between food products in a specific storage section.

In the present invention, food itself information and food management information may be collectively referred to as "food information".

The recognition device 100 may be detachably coupled to the storage chamber. In this case, the recognition device 100 does not need to be provided in all storage units in the storage room, and may be located only in storage units requiring management.

In addition, when the storage unit requiring the management is changed, the recognition device 100 may change its location to the changed storage unit.

When the recognition device 100 is detachably coupled to the storage compartment, a connector (not shown) for coupling the recognition device 100 may be provided in the storage compartment.

The inner wall 23 may include a cold air duct 40 for flowing and discharging cold air. The cold air duct 40 may be disposed in a vertical direction in the storage chamber, for example, but is not limited thereto. The cold air duct 40 may be integrally formed with the inner wall 23 and may be coupled to the inner wall 23.

A plurality of discharge ports 41 through which cool air is discharged may be formed in the cold air duct 40. One or more discharge ports 41 may be arranged to correspond to each storage unit.

A cold air control unit 50 is disposed behind the inner wall 23 to control the flow of cold air discharged from at least one of the plurality of discharge ports.

In this case, the number of the cold air control units 50 may be the same as the number of the plurality of storage units. Therefore, it is possible to control the flow of cold air for each storage unit.

The controller 150 may determine the location of the stored food based on the image captured by the recognition device 100 and control the cold air control unit 50 based on the determined location.

The cold air control unit 50 generates power to rotate one or more vanes 51 for adjusting the flow direction of the cold air, a rotation shaft 52 connected to the one or more vanes 51 and the rotation shaft 52 It may include a driving unit 54 to.

The driving unit 54 may directly rotate the rotation shaft 52. Alternatively, the rotation shaft 52 may be rotated by moving the driving unit 54, which is not shown, but a support bar to which the rotation shaft 51 is connected.

In the present invention, the structure of the cold air control unit 50 may be implemented by a known structure, so a detailed description thereof will be omitted.

When the vanes 51 are arranged as shown in FIG. 2A, the cold air flows toward the center of the storage unit as shown in the drawing. In this case, since the cold air is directly supplied from the storage unit to the food located at the center, the food located at both sides may be cooled after the cold air is first cooled with the food located at the center.

When the vanes 51 are arranged as shown in FIG. 2(b), the cold air flows toward the right side in the storage unit. In this case, since cold air intensively flows from the storage unit to the food located on the right side, cooling of the food located on the right side in the storage unit can be performed quickly.

When the vanes 51 are arranged as shown in FIG. 2C, the cold air flows toward the left side of the storage unit as shown in the drawing. In this case, since cold air intensively flows from the storage unit to the food located on the left side, cooling of the food located on the left side in the storage unit can be performed quickly.

4 is a diagram illustrating a screen displayed on the display unit according to the first embodiment.

Referring to FIG. 4, the refrigerator according to the present embodiment may include a display unit 130 on which food information recognized by the recognition device 100 is displayed.

When a predetermined command is input through the input unit 110, the screen of the display unit 130 may be switched as shown in FIG. 4.

The display unit 130 may display an image of food stored in each of the storage units. That is, as shown in FIG. 4, on the display unit 130, for example, the first storage unit to the third storage unit may be displayed to be distinguishable.

In this case, the storage unit displayed on the display unit 130 is a storage unit in which the recognition device 100 is installed.

Hereinafter, as an example, three storage units in the refrigerating chamber are displayed on the display unit 130.

In detail, the display unit 130 may display a refrigerator compartment display unit 132 displaying an image of a storage space of the refrigerator compartment. The first to third storage units may be displayed on the refrigerating compartment display unit 132 to be distinguishable.

On the refrigerating compartment display unit 132, a food display unit 133 that displays a food image captured by the recognition device 100 may be displayed. The food display unit 133 corresponds to a food image stored in a refrigerator storage unit.

In addition, information on the food image displayed on the display unit 130 may be stored in the memory unit 140.

In a state in which the screen shown in FIG. 4 is shown on the display unit 130, when “confirmation button” is selected, the display unit 130 may be switched to a preset main screen.

5 is a flowchart illustrating a method of controlling a refrigerator according to the first embodiment.

A method of controlling a refrigerator according to the first embodiment will be described with reference to FIG. 5.

While the refrigerator is being driven, the recognition device 100 may be operated at a specific point in time. The specific time point is a time point determined according to whether a predetermined condition is met.

For example, the specific point in time may be a point in time when the freezing chamber door 31 or the refrigerating chamber door 32 is opened. When it is detected that the freezing compartment door 31 is opened, the recognition devices 100 provided in the freezing compartment 21 may be driven. On the other hand, when it is sensed that the refrigerating compartment door 32 is opened, the recognition devices 100 provided in the refrigerating compartment 22 may be driven.

Alternatively, the specific point in time may be a point in time when the freezing chamber door 31 or the refrigerating chamber door 32 is opened and then closed again.

The specific time point may be a time point that is accumulated according to a preset period. For example, when the recognition device 100 is set to operate in a period of 1 hour, the recognition device 100 photographs the storage unit in a period of 1 hour.

The specific point in time may be a point in time that is accumulated according to a set period based on the point in time at which the recognition device 100 has been operated. For example, when the recognition device 100 is operated at one point in time, the recognition device 100 may be restarted according to a setting period after a predetermined time has elapsed from the one point in time.

The specific time point may be a time point at which the user inputs an operation command. That is, when a user inputs a predetermined command through the input unit 110 at a desired time point, the recognition device 100 may be operated (S11).

When the recognition device 100 is operated, first image information about food stored in the storage compartments 21 and 22 may be obtained. That is, the recognition device 100 may acquire image information of the internal space of the storage unit.

In addition, the acquired first image information may be stored in the memory unit 140 (S12).

Based on the operating conditions, the recognition device 100 may be re-operated. The operating condition may be understood as an operating point condition of the recognition device 100 described above.

Therefore, when the recognition device 100 is re-operated, the above-described door opening time, door closing time, a specific time according to a setting period, a predetermined time elapsed after the operation of the recognition device 100 or a user gives an operation command. It may be the input time point (S13).

When the recognition device 100 is restarted, second image information about food stored in the storage compartments 21 and 22 may be obtained. The second image information may be understood as image information acquired after a time point at which the first image information is acquired.

In addition, the acquired second image information may be stored in the memory unit 140 (S14).

The controller 150 acquires difference image information between the first and second image information based on the stored first image information and the second image information (S15).

As the first image information is "previous image" and the second image information is "next image", the controller 150 may recognize a difference between the two image information. Alternatively, although not shown, a separate image analysis unit may be further provided, and the control unit 150 may receive the difference image information analyzed by the image analysis unit.

For example, the difference between the image information may be recognized through arithmetic operations. In the memory unit 140, a "recognition program" for recognizing the difference image information may be stored.

The control unit 150 may recognize information on food, based on the difference image information, and may perform food management (S16).

For example, if there are more images of the second image information than the first image information (if it is large), the controller 150 may recognize that food related to the added image has been in stock. On the other hand, if there are more images of the second image information (if larger) than the second image information, the controller 150 may recognize that food related to the deleted image has been shipped.

In this way, when food is recognized as being received or released, food management information may be updated. For example, information on whether a specific food is stored, a storage location of a specific food, a storage amount, or a storage period (in/out time) may be updated.

The method of updating the food management information includes a method in which a user manually corrects (inputs, deletes) predetermined information or a method that is automatically recognized by a predetermined recognition device.

The control unit 150 may determine the location of the received food in the storage unit based on the difference image information. In addition, the control unit 150 controls the cold air control unit 50 so that the cold air direction is adjusted for intensive cooling of the received food.

As shown in FIG. 2, the control unit 150 divides the storage unit into a plurality of areas, determines the area of the stored food, and controls the cold air control unit 50 so that cool air is concentrated in the area where the food is located. I can.

For example, the control unit 150 divides an area in the storage unit into three areas (a center area, a left area, and a right area), and the cold air control unit 50 so that the cool air is concentrated in one of the three areas. Control. In this case, the control unit 50 operates the driving unit 54 to stop the operation of the driving unit 54 after moving the vane 51 to face a certain area. Then, the vane 51 is maintained in a stopped state, and cold air is discharged toward any one area by the vane 51.

In this case, when food is received in two or more of the three areas, the vane 51 may be continuously rotated so that cold air is alternately supplied to two or more areas.

Accordingly, according to the present invention, since the location of the stored food in the storage unit is determined and cold air can be concentrated toward the stored food, there is an advantage in that the stored food can be quickly cooled.

The control unit 150 may control the cool air control unit 50 so that the cool air can be evenly supplied to the storage unit when a predetermined time elapses after the adjustment of the cold air direction is started. For example, the control unit 150 controls the cold air control unit 50 so that the vanes 51 are in a state as shown in FIG. 1A, or the vanes ( The cold air control unit 50 may be controlled so that 51) is continuously rotated. In the present invention, as shown in (a) of FIG. 1, the position of the vane when the vane 51 faces the central area of the storage unit may be referred to as a reference position. Accordingly, when a predetermined time elapses after the adjustment of the cold air direction starts, the control unit 150 may control the cold air control unit 50 so that the vanes 51 are at the reference position.

6 is a diagram illustrating a display of a previous image and a subsequent image of food on the display unit according to the first embodiment.

Referring to FIG. 5, the display unit 130 may display a previous image and a subsequent image of a food stored in a storage room in a comparable manner based on the first image information and the second image information.

The display unit 130 includes a location display unit 135 displaying a location of a specific storage space in which the difference image information exists, a previous image display unit 136 displaying the first image information, and the second image information. A subsequent image display unit 137 to be displayed is included.

The location of the specific storage space may be one of the first to third storage units described in FIG. 4.

The user can check the contents displayed on the display unit 130 and easily check the food items in or out of the storage rooms 21 and 22. Further, food management information may be additionally recognized using the input unit 110 or the like. In addition, the recognized additional information may be stored in the memory unit 140.

For example, as illustrated in FIG. 6, when the subsequent image includes a food image smaller than the previous image, it may be recognized that the food has been shipped. In addition, information on the food (for example, information stored in the memory unit 140) may be modified or deleted. That is, it is possible to modify or delete information on whether the food is stored, storage location, and storage amount.

On the other hand, although not shown in the drawing, when the subsequent image includes more food images than the previous image, it may be recognized that the food is in stock. In addition, information on the food may be modified or additional information may be input. That is, information on whether the food is stored, storage location, storage amount, etc. may be modified or additional information may be input.

In this way, since a plurality of image information is displayed so as to be comparable, and a user can check it and perform food management, food management can be facilitated and convenience of use can be increased.

FIG. 7 is a diagram illustrating that information related to food delivered from the display unit according to the first embodiment is displayed.

Referring to FIG. 7, on the display unit 130, information on food corresponding to a difference image may be displayed on the basis of the first image information and the second image information.

In detail, an image (representative image) of food to be stored in the refrigerator may be previously stored in the memory unit 140. And, based on the first image information and the second image information, a food image corresponding to the difference image (the difference image image) may be obtained, and the representative image and the difference image image may be compared.

In addition, after a plurality of representative images of the stored food and the difference image images are compared, images matching each other may be recognized. In addition, an image (a representative image or a difference image) of a matched food may be displayed on the display unit 130.

Even if the images to be compared are not exactly the same, the most similar images may be matched and displayed.

The display unit 130 includes a location display unit 135 that displays a location of a specific storage space in which the difference image information exists, a food image display unit 138 that displays an image of a food corresponding to the difference image information, and the corresponding food. A food information display unit 139 that displays information is included.

The food information display unit 139 may display food itself information or food management information. For example, a food name, a stocking date, or a delivery date may be displayed. That is, based on the difference image information, additional information on the food may be further recognized. In addition, the recognized additional information may be stored in the memory unit 140.

In this way, a difference image image is obtained from a plurality of image information, and the obtained difference image image and a representative image of the food are compared to identify specific foods received or released, so that food management is easy and convenience of use is increased. I can.

8 is a view showing a cold air control unit according to the second embodiment.

This embodiment is the same as the first embodiment in other parts, and there is a difference in the location of the outlet through which cold air is discharged and the cold air control unit. Therefore, hereinafter, only characteristic parts of the present embodiment will be described.

Referring to FIG. 8, a plurality of discharge ports 231, 232, and 233 spaced apart in a horizontal direction may be provided in an inner wall 23 forming a storage chamber (storage unit). For example, a plurality of discharge ports 231, 232, 233 includes a first discharge port 231 provided on a rear wall of the inner wall 23, a second discharge port 232 provided on a right wall of the inner wall 23, and the It may include a third discharge port 233 provided in the left wall of the inner wall 23.

Each of the discharge ports 231, 232, and 233 may be opened and closed by individual cold air control units 55, 56, and 57. That is, in the present embodiment, each storage unit may be provided with a plurality of discharge ports spaced apart in the horizontal direction and a plurality of cold air control units 55, 56, and 57 for opening and closing each discharge port.

In addition, the control unit individually controls the plurality of cold air control units 55, 56, and 57 based on the difference image information.

For example, when no additional food is received, the controller may control the plurality of cold air control units 55, 56, and 57 so that all of the plurality of discharge ports are opened.

In addition, when food is stored in a specific area within the storage unit, one or more of the plurality of cold air control units 55, 56, and 57 may be controlled so that only a discharge port corresponding to the corresponding area is opened.

For example, when food is stored in the right area in the storage unit, the second discharge port 232 may be opened, and when food is stored in the left area, the third discharge port 233 may be opened. .

Further, the control unit may control a plurality of cold air control units such that all discharge ports are opened when a predetermined time elapses after the adjustment of the cold air direction is started. Alternatively, when a predetermined time elapses after the adjustment of the cold air direction starts, the control unit may control the cold air control unit to open a preset reference discharge port. For example, the reference discharge port may be a first discharge port 231 located at the center of the storage unit.

10: refrigerator 21: freezer
22: refrigerator compartment 100: recognition device

Claims (10)

A main body having an inner wall defining a plurality of storage units vertically partitioned by shelves for supporting food;
A plurality of recognition devices provided corresponding to the plurality of storage units to recognize images of food stored in the storage unit;
A memory for storing first image information and second image information of the food recognized by the recognition device;
A cold air duct extending in a vertical direction for the flow and discharge of cold air at the center of the rear of the inner wall;
A discharge port provided in the cool air duct and disposed at a position corresponding to each of the storage units to discharge cool air;
A cold air control unit provided at the discharge port and controlling a flow of discharged cold air; And
And a control unit that determines a location where food is received in the storage unit, and controls the cold air control unit to supply cold air to the determined location by using difference image information between the first image information and the second image information. and,
The cold air control unit,
A vane rotating to adjust a discharge direction of the cold air discharged through the discharge port;
A rotating shaft connected to the vane;
And a driving unit that generates power so that the rotation shaft rotates,
The control unit,
The area in the storage unit is divided into a center area, a left area and a right area,
Based on the difference image information, when food is received in any one of the plurality of areas, the driving unit is controlled to stop after operating so that cold air is concentrated to the area of the food in which the vane is stored, and the same storage unit When food is received in a plurality of areas within, the drive unit continuously rotates the vanes so that the cold air discharged from the discharge port is supplied to the plurality of areas corresponding to the location of the food. Controlled refrigerator. delete delete delete delete delete The method of claim 1,
The control unit controls the driving unit so that the vane is at a reference position when a predetermined time elapses after the adjustment of the cold air direction starts. The method of claim 1,
The inner wall is provided with a plurality of discharge ports spaced apart in the horizontal direction,
A plurality of cold air control units independently open and close each of the plurality of discharge ports,
The control unit controls at least one of the plurality of cold air control units to open a discharge port corresponding to an area where food is stored. The method of claim 8,
The control unit controls at least one of the plurality of cold air control units such that a predetermined reference discharge port among the plurality of discharge ports is opened when a predetermined time elapses after the adjustment of the cold air direction is started. The method of claim 8,
The control unit controls at least one of the plurality of cold air control units such that all of the plurality of discharge ports are opened when a predetermined time elapses after the adjustment of the cold air direction is started.

Images