KR100764281B1 - Information managing apparatus for refrigerator - Google Patents

Abstract

An information managing apparatus of a refrigerator is provided to input information on stored items by the user's voice and thus to ensure fast and accurate control based on the recognized information. An information managing apparatus of a refrigerator(100) comprises a speech recognition module(30), a display unit(40), a storage unit(60), and a microprocessor(80). The speech recognition module recognizes information corresponding to the voice of the user. The display unit is mounted on a front surface of the refrigerator for displaying the recognized information or user interface corresponding to the recognized information. The storage unit stores the recognized information or user interface. The microprocessor controls the components based on the recognized information and displays user interface according to the control if the recognized information is about control information, and if not, displays the recognized information on the display unit.

Description

Information management device of the refrigerator {INFORMATION MANAGING APPARATUS FOR REFRIGERATOR}

1 is a block diagram of a storage food display control device of a refrigerator according to the prior art.

2 is a block diagram of an information management apparatus of a refrigerator according to the present invention.

3 is a front view and a partially enlarged view of the refrigerator of FIG. 2.

4 is a first embodiment of an information management method of a refrigerator according to the present invention.

5 is a second embodiment of an information management method of a refrigerator according to the present invention.

6A and 6B illustrate embodiments of an initial user interface of the information management service according to FIGS. 4 and 5.

7A to 7C illustrate embodiments of an information storage mode.

8A and 8B illustrate embodiments of an information search mode.

9 is a third embodiment of an information management method of a refrigerator according to the present invention.

10A and 10B are embodiments of information notification.

<Explanation of symbols for main parts of the drawings>

20: input means 30: voice recognition module

40: display means 50: temporary counting means

60: storage means 70: proximity sensor

80: micom

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a refrigerator, and more particularly, to an apparatus and method for managing information of a refrigerator that allows a user to easily control information related to the contents and control thereof.

In order to maintain the freshness of stored foods according to the refrigerator products, a separate freshness maintaining room is prepared to be selectively used by users. Various kinds of foods are stored in these refrigerators. Since the user cannot remember the foods stored in the refrigerator, the user has to go through the effort of opening and closing the refrigerator door every time. Confirmation of the food stored in the refrigerator in this way causes the consumption of electrical energy due to the opening and closing of the refrigerator door, and also caused waste of food because the food is decayed because the storage period is exceeded.

In order to solve this problem, the present applicant discloses a refrigerator which can check the stored food inside from the outside in Korean Patent Registration No. 0377741 (name of the invention: storage food display control device of the refrigerator). This is illustrated in FIG. 1.

As shown in FIG. 1, the conventional refrigerator has an oscillation circuit 10 oscillating a predetermined frequency, and a frequency division circuit generating time by dividing an oscillation frequency output through the oscillation circuit 10 into a specific frequency signal ( 11), a time counting means 12 for inputting an output signal of the frequency divider circuit and counting time, and a date counting means for changing a date when a predetermined time is reached based on the time counted by the time counting means 12; (13), a storage means (14) for storing various information about the food stored in the warehouse, and a selection key section (15) for receiving various information about the food stored by the user, such as the type, quantity, and storage period of the food stored therein. And the stored food date / time display section 16 for displaying and updating the time and date at regular time intervals by the central processing unit 19, the expired food display section 17 for displaying the expired foods, and storing Information of stored food stored in the means 14 Based on the stored food sequential display unit 18, which updates and displays at regular intervals, and the stored food information stored in the storage means 14, the stored food time / date, the expired food information, and the current stored food are sequentially It consists of a central processing unit 19 to be displayed

From this configuration, in the conventional refrigerator, after storing information of the stored food directly input by the user through the selection key unit 15 in the storage means 14, the stored food time / date, the expired food information and the current storage Information about the food is displayed.

In order to obtain the stored food information in the conventional refrigerator, it is inconvenient for a user to manually input names of a plurality of foods. In addition, since the selection key unit 15 must have an input capability similar to that of the keyboard for this input, the configuration of the selection key unit 15 is complicated and there is a problem of increasing the manufacturing cost of the refrigerator. In addition, the time required for the user to perform the input is considerable for such keyboard input.

In order to solve this problem, it is an object of the present invention to provide an information management apparatus and method of a refrigerator that allows a user to store and manage the name of the object and additional information without a direct input such as a keyboard.

In addition, an object of the present invention is to provide an information management apparatus and method of a refrigerator that enables a user to input information through a voice and enables the user to easily identify a voice recognition result by displaying an avatar.

In addition, an object of the present invention is to provide an information management apparatus and method for a refrigerator to perform the confirmation of the recognized information and to perform the control according to the information.

In addition, an object of the present invention is to provide an information management apparatus and method for a refrigerator that facilitates the user's management of the object by informing the user in advance of the information of the object using the avatar.

An information management apparatus of a refrigerator according to the present invention includes a voice recognition unit for recognizing information corresponding to a voice of a user, and a display unit mounted on the front of the refrigerator to display the recognized information or a user interface corresponding to the recognized information. And a storage unit that stores the recognized information or the user interface.

In this case, the display unit preferably includes a plurality of selection units for obtaining input of the displayed information or a user interface from a user.

In addition, the information preferably includes at least one of a name, a quantity, and a storage period of the object.

In addition, the information management method of the refrigerator according to the present invention includes reading the pre-stored information, and displaying the characteristics of the read information through the appearance or behavior of the avatar.

In addition, the information management device of the refrigerator of the present invention is a voice recognition unit for recognizing information corresponding to the user's voice, mounted on the front of the refrigerator, and displays the information recognition result by the avatar, and the recognized information or the And a display unit for displaying a user interface corresponding to the recognized information, and a storage unit for storing the avatar and the recognized information or the user interface.

In the following, the invention is explained in detail on the basis of the embodiments of the invention and the accompanying drawings. However, the scope of the present invention is not limited by the following embodiments and drawings, and the scope of the present invention will be limited only by the contents described in the claims below.

2 is a configuration diagram of an information management apparatus of a refrigerator according to the present invention, and FIG. 3 is a front view and a partially enlarged view of the refrigerator of FIG.

As shown in FIG. 2, the refrigerator 100 according to the present invention includes an input unit 20 for receiving a predetermined command by the user, a voice recognition module 30 for identifying information corresponding to the user's voice, and Frame for display for the information management service (user interface, etc.), display means (40) for displaying information, etc., clockwork means (50) for calculating the year, month, date and / or time, and information management service. Storage means 60 for storing the frames (user interface, etc.) and information to be displayed, the proximity sensor 70 for generating a detection signal by the user's approach, and the above-described components are controlled, It is composed of a microcomputer (80) for receiving information related to the stored matter, etc. stored in the voice to identify the information according to the voice to allow the user to confirm and store. The refrigerator 100 may further include a main microcomputer (not shown) for performing a refrigeration control operation, etc., and a communication line is connected between the main microcomputer and the microcomputer 80 to perform data communication. Alternatively, the refrigerator 100 may perform a refrigeration refrigeration control operation through the microcomputer 80. In addition, the refrigerator 100 includes a power supply means (not shown), and supplies power required for each component, and the matters regarding the power supply are easily recognized by those skilled in the art. It is.

In detail, the input means 20 is a means for receiving a command (for example, general refrigerator operation control, start and end of a voice recognition mode, addition of information, search and deletion, selection of an avatar, etc.) from a user.

The input means 20 is associated with a frame displayed through the display means 40, the selection means 20a made of a kind of button type, touch pad type or electrostatic type, and a microphone for obtaining a voice signal from the user. It comprises 20b.

As shown in FIG. 3, the selecting means 20a is a temperature setting means 21 for setting the temperature of the freezer compartment and the refrigerating compartment, and a dispenser setting for setting the service type of the dispenser (ice ice, water, flake ice, etc.). Means 22, menu means 23 for activating and selecting the user interface displayed on the display means 40, voice recognition selection means 24 for initiating or terminating the speech recognition mode, and other selections (refrigerators). Means 25, 26, 27 for activating the interior light, locking the input means 20, and a menu / selection button 28 for checking and selecting information displayed on the display means 40, and the like.

In addition, the microphone 20b is mounted on the front of the refrigerator 100 to facilitate the acquisition of the user's voice, but the user inputs information in an area in which the display means 40 is mounted. Is mounted on one side.

In addition, the voice recognition module 30 receives the user's voice (or voice signal) from the microphone 20b under the control of the microcomputer 80, and the information corresponding to the voice (for example, text, numbers, and letters) is received. And the like). The speech recognition module 30 may be configured in hardware, in software, or in firmware. The speech recognition module 30 transmits the identified information to the microcomputer 80.

In addition, the display means 40 is preferably a color TFT LCD to display a user interface, an avatar, and information. This user interface may be the background on which the avatar is displayed. In addition, the user interface may additionally display information regarding the refrigerator state simultaneously or separately from the avatar (see FIG. 3). As shown in FIG. 3, the display means 40 displays the avatar (bear figure) 40a and the basic information 41 of the refrigerator on the standby screen, and additionally the weather information (or the weather conditions of the day) 42. ) Is displayed.

This display means 40, as described above, includes not only visual display means, but also audible display means 43. That is, the acoustic display means 43 may be a general speaker.

In addition, the one-time number means 50 is a means for calculating time information such as the date and time and the time, such as when the voice from the microphone 20b is input or when a control command such as storage from the user is received. If there is a request from the microcomputer 80, the time information is provided to the microcomputer 80 when the request is received.

In addition, the storage means 60 stores at least frames (user interface) displayed to the user to provide the information management service provided by the refrigerator 100, information formed by the microcomputer 80, and avatar data. . These frames represent user interface screens for the user to facilitate their use for information management. In addition, the information includes the name of the object, the storage start date or the storage date or the expiration date, and the like. In addition, the storage means 60 stores the avatar and the like displayed on the initial screen, so that the user can select.

In addition, the proximity sensor 70 is a sensor that detects the user's approach to the periphery of the refrigerator. As shown in FIG. 3, the proximity sensor 70 is mounted around the display unit 40 of the front of the refrigerator. The proximity sensor 70 transmits the detection result to the microcomputer 80.

Finally, the microcomputer 80 controls the entire refrigeration / refrigeration process, and additionally provides food management services to be described later. The microcomputer 80 includes at least one central processing unit (not shown), which may be a device including the storage means 60 described above, or a device including only a processor such as the central processing unit. . However, in this specification, in order to describe the data stored in the storage means 60 in more detail, the microcomputer 80 and the storage means 60 will be described as separate elements.

First, in order for the microcomputer 80 to manage information on the contents, the voice recognition mode is performed to acquire the user's voice through the microphone 20b to control the voice recognition module 30 to obtain information corresponding thereto. Acquire. The microcomputer 80 performs an information storage mode, an information search mode, an information deletion mode, and an information notification mode as an information management service. The information security management service is performed in the voice recognition mode, but can be performed by the user's input through the selection means 20a rather than the voice.

First, the information storage mode is a mode in which the microcomputer 80 stores and manages information obtained through the microphone 20b. The information search mode is a mode in which the microcomputer 80 reads the information stored in the storage means 60 so that the user can find the desired information among the read information. The information deleting mode is a mode for allowing a user to delete at least a part of the information stored in the storage means 60. Finally, in the information notification mode, the microcomputer 80 reads the information stored in the storage means 60, and informs the user of information on the contents which have exceeded the expiration date, etc. according to the time information obtained from the one-time clock means 50. The mode to provide. The above-described information storage mode, information search mode and information deletion mode are performed depending on an input from the user, and the information notification mode is the microcomputer 80 after the user or automatically makes a selection for this notification mode. This is a service provided independently.

4 is a first embodiment of an information management method of a refrigerator according to the present invention. The first embodiment is a case where the information management service is performed only in the voice recognition mode.

In detail, in step S41, the microcomputer 80 determines whether the voice recognition mode by the input of the voice recognition selection means 24 is selected by the user. If such a selection has been entered, the process proceeds to step S42.

In step S42, the microcomputer 80 displays the initial user interface for the information management service on the display means 40. This initial user interface may be textually or verbally displayed as a phrase for an avatar to enter "voice recognition mode." In addition, a user interface displaying a mode of storing, searching, and deleting information that allows a user to input voice is displayed.

In step S43, the microcomputer 80 determines whether a voice of the user is input through the microphone 20b. If there is a voice input from the user, the process proceeds to step S44, otherwise the process proceeds to step S49.

In step S44, the microcomputer 80 determines whether the voice input of the user has been recognized. This determination is to determine whether the voice of the user has been acquired to the extent that the microcomputer 80 can recognize it, and if it is recognized, proceed to step S46, otherwise proceed to step S45.

In step S45, the microcomputer 80 displays a text such as "Please input the voice again" or expresses it to the user, and proceeds to step S43.

In step S46, the microcomputer 80 provides the input voice to the voice recognition module 30, causes the voice recognition module 30 to identify information corresponding to the voice, and receives the identified information. Recognize information about voice. At this time, the microcomputer 80 displays that the voice of the user is recognized through the shape or behavior of the avatar. For example, a smiling avatar is a voice recognition, and a crying avatar is not a voice recognition.

In step S47, the microcomputer 80 determines whether the recognized information is control information. This control information relates to the control of the refrigeration cycle of the refrigerator, the control of the information management service, and the like, for example, "save", "find", "delete", "cancel", "complete", "store all" Examples include "view all", "storage complete", "delete freezer", "delete freezer", and "confirm". The non-control information is, for example, "freezer", "freezer", "mackerel", "three days", "pork", "ribs", "celery", "carrot", "strawberry", "two" And so on. If the recognized information is the control information, the process proceeds to step S49. Otherwise, the process proceeds to step S48.

In step S48, the microcomputer 80 causes the recognized information to be displayed on the display means 40. In this case, the display is performed by displaying information on the display means 40 for the first time and, if already displayed, visually distinguishing the information from other parts. The process then proceeds to step S43 again.

In step S49, the microcomputer 80 performs the processing according to the control information since the recognized information is the control information. For example, when the recognized information is "save" which is the selection of the information storage mode on the initial user interface screen, the microcomputer 80 reads the user interface corresponding to the information storage mode from the storage means 60.

In step S50, the microcomputer 80 displays a user interface according to the performed control information. For example, the microcomputer 80 displays on the display means 40 the user interface corresponding to the information storage mode read in step S49.

In step S51, the microcomputer 80 determines the completion of the input depending on whether there is an input completion by the user input from the input means 20 or a voice input from the user for a predetermined time. If the input is complete, the process proceeds to step S52; otherwise, if there is an input, the process proceeds to step S43.

In step S52, the microcomputer 80 ends the information management service and displays the initial screen as shown in FIG. 3 on the display means 40. FIG.

5 is a second embodiment of an information management method of a refrigerator according to the present invention. This second embodiment is a case where the information management service is performed by the voice recognition mode and the input mode by the selecting means 20a.

In detail, steps S61 and S62 are the same as steps S41 and S42 of FIG. 4.

In step S63, the microcomputer 80 determines whether there is a user input by the selecting means 20a of the input means 20 or the microphone 20b. If there is a user input, the process proceeds to step S64, otherwise, the process proceeds to step S72.

In step S64, the microcomputer 80 determines whether the user input is voice through the microphone 20b. If the user input is voice, the process proceeds to step S67. Otherwise, if the user input is input, the process proceeds to step S65.

In step S65, the microcomputer 80 performs control according to an input from the selection unit 20a.

In step S66, the microcomputer 80 displays the user interface according to the performance of the control on the display means 40.

Steps S67 to S71 are the same as steps S46 to S50 of FIG. 4.

In step S72, the microcomputer 80 determines whether there is an input from the selection means 20a or the microphone 20b for a predetermined time, or whether the information corresponding to the voice is the end of the information management service or the selection means. It is judged whether or not the control command from 20a is a command equivalent to the end of the information management service, and judges the completion of the input. If the input is complete, the process proceeds to step S73. Otherwise, if there is an input from the user, the process proceeds to step S64.

4 and 5, even when the microcomputer 80 performs the voice recognition mode, both the control by the voice from the microphone 20b and the control through the voice and the selector 20a can be performed.

6A and 6B illustrate embodiments of an initial user interface of the information management service according to FIGS. 4 and 5.

As shown in FIGS. 6A and 6B, the microcomputer 80 performs steps S41 and S42 of FIG. 4 and the steps of FIG. 5 in response to a user's input through the voice recognition selecting means 24 of the selector 20a. In S61 and S62, the user interface corresponding to the voice recognition mode is read from the storage means 60 and displayed. As an example of the information management method of this refrigerator, it aims at the storage food management which is a thing.

6A shows to confirm to the user that the microcomputer 80 enters the voice recognition mode.

This initial user interface of FIG. 6B corresponds to the initial screen of the voice recognition mode while corresponding to the initial screen of the information management service. The user can manage the information on the storage of the freezer compartment and the information on the storage of the refrigerator compartment, and such information management includes the function of storing information, finding information and deleting information. In addition to this initial user interface, the user interface disclosed below all includes instructions on what order (command order) the user should perform voice input at each step. In this initial user interface, when the user speaks "fridge, store" with a voice, the microcomputer 80 is ready to perform the information storage mode for the refrigerator.

In addition, according to the "cancel" button, a "terminate" button for canceling the user's voice input or terminating the user interface in the current process is also displayed. In particular, this " cancel " button and " end &quot; button relate to control information, so that control is performed accordingly.

In addition, this initial user interface displays an avatar (bear form) together to make the user feel familiar.

This initial user interface can be selected by voice and can also be selected via selection means 20a as shown in FIG.

7A to 7C illustrate embodiments of an information storage mode. 7A to 7C illustrate a case where a user selects an information storage mode.

As shown in FIG. 7A, as the user inputs "3 celery 3 days", "3 carrot 1 week", and "3 strawberry 1 day" according to the input order, the microcomputer 80 displays the display means ( 40). For example, in the case of the input of "three three days of celery", first, the microcomputer 80 receives the "celery" voice, and the steps S43, S44, S46, S47 and S48 of FIG. The display means 40 is displayed by steps S63, S64, S67, S68 and S69. The same is true for "three", "three days" sequentially. At this time, as the user gives a time difference between each word, the microcomputer 80 confirms that three separate voices are input. That is, step S49 of FIG. 4 and step S72 of FIG. 5 also distinguish between these voices. In addition, the storage period is a result of the user input the expiration date of the refrigerated or frozen storage for each storage.

According to step S46, the microcomputer 80 displays a smile of the avatar indicating that voice recognition from the user has been made.

In the case of FIG. 7B, when the microcomputer 80 does not recognize the voice from the user well in step S45, the recognition result is displayed through the frown of the avatar, and an error message such as “Please say it again” is shown. Is displayed.

FIG. 7C illustrates a case in which the user inputs "save completion" in the displayed state of FIG. 7A. When the microcomputer 80 obtains the "storage completed" input through the selector 20a or the microphone 20b, the steps S43, S44, S46, S47, S49, and S50 of FIG. The information indicated by S63, S64, S67, S68, S70, S71 or the steps S63, S64, S65, S66 is stored in the storage means 60. At this time, the microcomputer 80 requests time information at the time when the information is obtained or stored, and the time information provided from the time clock means 50 (that is, the year, month, date and / or time). ) Is stored in the storage means 60 together with each information. This provided time information means the storage start date and time of the object. In addition, the microcomputer 80 may express the completion of storing the user input through the auditory display means 43. For example, you can have an audible signal such as "1 strawberry saved."

8A and 8B illustrate embodiments of an information search mode. 8A and 8B illustrate a case where a user selects an information search mode. That is, in the user interface of FIG. 6, steps S43, S44, S46, S47, S49, and S50 of FIG. 4 and steps S63, S64, S67, S68, S70, and S71 of FIG. 5, or steps S63 and S64. , S65, S66).

As shown in FIG. 8A, the steps S43, S44, S46, S47, S49 and S50 of FIG. 4 and the steps S63, S64, S67, S68, S70 and S71 of FIG. 5 or the steps S63, S64, By S65 and S66, the microcomputer 80 reads the information of the thing stored in the storage means 60, and displays it on the display means 40. FIG. Here, in the calculation and display of the storage period of each storage item, the microcomputer 80 reads the information of the storage items from the storage means 60, and the current date and time (date and date and / or time) from the one-hour clock means 50. The storage period can be calculated and displayed. This storage period is calculated from (current date-date of storage).

In addition, the microcomputer 90 may display a storage period on the basis of the storage start date or time based on the remaining date of the valid period, in order to facilitate confirmation of the contents by the user.

FIG. 8B shows in FIG. 8A that the microcomputer 80 obtains an input of “mackerel” or “two mackerel” from the user and displays this information, but in the information search mode, steps S43, S44 and S46 of FIG. , S47, S48 or the steps S63, S64, S67, S68, and S69 shown in FIG. 5 in the detailed display corresponding to this information.

9 is a third embodiment of an information management method of a refrigerator according to the present invention. A third embodiment according to the present invention relates to an information notification mode for long-term storage.

In detail, the microcomputer 80 reads the information stored by FIGS. 4 and 5 in step S91.

In step S92, the microcomputer 80 determines whether the expiration date or the storage period of each item has been exceeded based on the read information. That is, the information about the stored object is stored for a long time through the determination of the storage period among the information of the stored object. If there is a stolen object, the flow advances to step S93.

In step S93, the microcomputer 80 determines whether a user's approach is detected through the proximity sensor 70. If the user is close, go to step S94, otherwise wait.

In step S94, when there is information on the over-loaded items, the microcomputer 80 displays, via the display means 40, the appearance and behavior of the avatar in the refrigerator compartment through the display means 40. . In particular, the display at this time is not only a visual display, but also an audio display.

In step S95, the microcomputer 80 determines whether the user has obtained an input for the detailed view of the object in the long-term storage state through the selection unit 20a or the microphone 20b. If the user performs the desired input for the detail view, the process proceeds to step S95, otherwise, the process ends. For example, the user may ask "What's up?" Or "What's up?" Voice can be input.

In step S96, the microcomputer 80 displays the information of the received thing on the display means 40 in detail. That is, the name, number of objects, the place where it is stored (such as a refrigerating compartment or a freezing compartment), the elapsed period, and the like are displayed.

Subsequently, the process may proceed to step S43 of FIG. 4 or step S63 of FIG. 5 to perform processing on the information of the object.

In addition, the present invention may be displayed by changing the shape or shape of the avatar according to the storage period of the object. For example, in the case of an object having a storage period of one day or an object having passed one day, shapes or shapes of different avatars may be displayed.

In the embodiment of Fig. 9, without performing steps S93 and S94, and performing steps S92 and S96 simultaneously, that is, when there is an object in a long-term storage state, the detailed information is immediately displayed. It is also possible to display on the means 40.

10A and 10B are embodiments of information notification.

FIG. 10A shows that the microcomputer 80 informs the display means 40 that the microcom 80 has an object in a long-term storage state by an avatar (an abnormally large nose) in step S94 of FIG. 9.

FIG. 10B illustrates a state in which the microcomputer 80 displays the information of the stored object in the long term storage state in step S96 of FIG. 9.

The information management method of the present invention described above can be applied to the case of not only storing, finding and deleting information, but also modifying information and externally transmitting information.

According to the present invention, the name of the object and the additional information can be stored and managed without direct input such as a keyboard, so that the user can conveniently manage the information.

In addition, the present invention allows the user to input the information through the voice, the user can quickly identify the recognition result through the avatar, to confirm the information and to perform the control according to the information, the voice There is an effect to enable the control and information management by.

In addition, the present invention allows the user to inform the user of the contents of the contents in advance by the avatar so that the user can quickly obtain the status of the contents of the contents.

Claims (10)

A voice recognition unit recognizing information corresponding to a voice of a user; A display unit mounted on the front of the refrigerator and configured to display the recognized information or a user interface corresponding to the recognized information; A storage unit for storing the recognized information and the user interface; If the recognized information is control information, control is performed according to the recognized information, and a user interface according to the performed control is displayed on the display unit. If the recognized information is not control information, the recognized information is displayed on the display unit. An information management apparatus for a refrigerator, comprising: a control unit for displaying. The information management apparatus of claim 1, wherein the display unit comprises a plurality of selection units that obtain input from the user from the displayed information or the user interface. The information management apparatus of the refrigerator according to claim 1, wherein the information includes at least one of a name of the object, a quantity, and a storage period. Reading previously stored information; A first displaying step of displaying the temporal characteristics included in the read information through the appearance or behavior of the avatar; Obtaining a voice command from a user; And a second display step of displaying the read information according to the voice command. 5. The method of claim 4, wherein the temporal characteristic is a storage period of an object stored in the refrigerator. 5. The method of claim 4, wherein the temporal characteristic is information on the stored items after the storage period has elapsed. The method of claim 4, wherein the information management method of the refrigerator comprises detecting a user's access, and when the user approaches, performing the first display step. A voice recognition unit recognizing information corresponding to a voice of a user; It is mounted on the front of the refrigerator, and displays the avatar corresponding to the case where the speech recognition is normally performed or the avatar corresponding to the case where the speech recognition is not normally performed, and the recognized information or the recognized information when the speech recognition is normally performed. A display unit displaying a user interface corresponding to the display unit; An information management apparatus of a refrigerator, comprising: a storage unit for storing an avatar and recognized information or a user interface. The information management apparatus of the refrigerator according to claim 8, wherein the information management apparatus of the refrigerator includes a proximity sensor for detecting a user's approach, and the display unit displays an avatar according to the characteristics of information stored in advance in conjunction with the proximity sensor. Device. The information management apparatus of the refrigerator according to claim 9, wherein the characteristic of the pre-stored information is a storage period of the object.

Images