KR20130012624A

KR20130012624A - Controlling method of component

Info

Publication number: KR20130012624A
Application number: KR1020110073873A
Authority: KR
Inventors: 오민진; 강성환
Original assignee: 엘지전자 주식회사
Priority date: 2011-07-26
Filing date: 2011-07-26
Publication date: 2013-02-05

Abstract

The present invention relates to a method of controlling a component. According to an aspect, a method of controlling a component may include: recognizing information of an article in an information recognizer of the component; Extracting the item to be managed from the recognized items; Displaying information on the extracted management object article on a display unit; And selecting one or more items to be managed from among the displayed items.

Description

Controlling method of component

The present specification relates to a control method of a component.

An example of a component is a refrigerator. The refrigerator may include a function for managing food. At this time, according to the refrigerator, the user must manually input the food to be managed through the input unit. For example, the food name, expiration date, storage location, and the like are entered using text.

In this case, it is difficult for a user to input information correctly, and there is a problem of incorrectly inputting information. And, every time the food is purchased, the user has to input as a management target for each food, so that the user is troublesome.

An object of the present embodiment relates to a method of controlling a component that can easily select a food for food management as a management target.

According to an aspect, a method of controlling a component may include: recognizing information of an article in an information recognizer of the component; Extracting the item to be managed from the recognized items; Displaying information on the extracted management object article on a display unit; And selecting one or more items to be managed from among the displayed items.

According to the proposed invention, the product information can be recognized in the information recognizer, the detailed information can be displayed in the case of the article stored in the memory, there is an advantage that the user has to reduce the hassle to enter the food information.

In addition, since the object to be managed is extracted and displayed from the recognized items, there is an advantage in that the user has to delete the unmanaged item one by one.

1 is a perspective view showing a refrigerator as an example of an electric appliance according to a first embodiment of the present invention.
2 is a control block diagram of a refrigerator and a communication component according to a first embodiment of the present invention;
3 is a view showing an example of a screen displayed on the display unit of the present invention.
4 is a view showing an example of a screen displayed when the food management selection unit is selected in FIG.
5 is a diagram illustrating an example of a screen displayed when a category is selected on the screen of FIG. 4.
FIG. 6 is a diagram illustrating an example of a screen displayed when a voice input selection unit is selected on the screen of FIG. 4 or FIG. 5; FIG.
7 is a view showing an example of a screen displayed when the recognition of the input voice fails.
8 is a view showing an example of a screen displayed when the recognition of the input voice is successful, but the search of the food fails.
9 is a diagram illustrating an example of a screen displayed when a voice recognition and a search are successful.
FIG. 10 is a diagram illustrating an example of a screen displayed when a keyboard input selection unit is selected on the screen of FIG. 4 or 5.
FIG. 11 is a diagram illustrating an example of a screen displayed when food information input is completed on the screen of FIG. 10. FIG.
12 is a view showing an example of a food detail information screen.
FIG. 13 is a diagram illustrating an example of a screen displayed when a period selection unit is selected on the screen of FIG. 12. FIG.
14 is a control block diagram of a refrigerator and a communication component according to a second embodiment of the present invention.
15 is a view showing a state in which information recognized by the information recognizer is displayed on the display unit.
16 is a flowchart illustrating a control method of a refrigerator according to a second embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a perspective view illustrating a refrigerator as an example of an electric appliance according to a first embodiment of the present invention, and FIG. 2 is a control block diagram of a refrigerator and a communication component according to the first embodiment of the present invention.

Hereinafter, a refrigerator will be described as an example of an electric product. The refrigerator may also be referred to as a component.

1 and 2, the refrigerator 1 according to the first embodiment of the present invention includes a main body (not shown) in which a storage space is formed, a refrigerating chamber door 2 which opens and closes a space inside the main body, and And a freezer compartment door 3. At least one of the refrigerating compartment door 2 and the freezing compartment door 3 may be provided with a display unit 11 on which information is displayed.

The refrigerator includes a top mount type refrigerator in which the refrigerating compartment is located below the freezing compartment, a side by side type refrigerator in which the freezing compartment and the refrigerating compartment are arranged to the left and right, and the freezer compartment below the refrigerating compartment. The refrigerator may be classified into a bottom freezer type refrigerator and the like, and the present invention is not limited to the type of refrigerator. In the present invention, the refrigerator may include at least one of a refrigerating compartment and a freezing compartment. Hereinafter, a side by side type refrigerator will be described as an example.

In detail, the refrigerator 1 includes a first communication means 13 for communication, a display unit 11 capable of displaying at least one of information of the refrigerator or information received from the outside, and the display unit 11. Is connected to the display unit controller 12, the energy consumption unit 18 that consumes energy for the operation of the refrigerator, and the display unit control unit 12, and controls the energy consumption unit 18. And a control unit 10.

In addition, the refrigerator 1 includes a voice recognition unit 14 for recognizing an external voice, a voice analyzer 15 for analyzing a voice input through the voice recognition unit 14, and a voice externally. It further comprises a speaker 16 for outputting to the memory, and a memory 17 can be stored information.

For example, the display unit 11 may include a touch screen for inputting or selecting information by a touch method. As another example, the display unit 11 may simply display information, and may input information through a separate input unit. Alternatively, some information may be input from the display unit 11 and the remaining information may be input through a separate input unit.

The voice recognition unit 14 may be, for example, a microphone, and a plurality of voice recognition units 14 may be provided. Since the voice analyzer 15 compares and analyzes voices input by the voice recognizers 14, analysis errors due to noise may be reduced. The voice analysis unit 15 analyzes the input voice and extracts information necessary for the operation (cooling function, food management function, memo function, etc.) of the refrigerator, and transmits the extracted information to the display unit controller 12. do.

The display unit controller 12 may recognize at least food information and information necessary for managing food. The food information includes a food classification (category, meat, fruit, aquatic products, dairy products, grains, etc.) or a food name. The information necessary for the management of the food, the storage period information may include one or more of the storage start date, the storage end date, the standard storage period, storage location, the number, weight, storage method. The food control object may be storage location management, storage period management, storage amount management, storage method management, and the like.

In addition, the storage period management target may include one or more of the storage elapsed period from the storage start date to the current date, the remaining storage period from the current date to the storage end date (the expiration date), the storage end date, whether the reference storage institution is reached. Can be. The display unit controller 12 performs food management based on the recognized food information and information necessary for management of the food. Here, whether the reference retention period is reached may be whether the reference retention period is within the reference retention period or whether the reference retention period has been exceeded from the reference date.

The food information and information necessary for managing the food may be selected or input on the display unit 11 or may be input by text or voice through a separate input unit.

On the other hand, the refrigerator 1 can communicate with the communication component 30 by the first communication means 13. The communication component 30 may be, for example, a web server, a mobile phone, another electric appliance, a server of a power company, a server managed by a retailer of a refrigerator, a server of a food purchaser, or the like. For example, the management server managed by the retailer of the refrigerator may receive information from the refrigerator, monitor the status of the refrigerator, and transmit a control command to the refrigerator.

The communication component 30 may comprise a memory 31, a control unit 32, and second communication means 33. When the communication component 30 is an electrical appliance or a mobile phone, the communication component 30 may further include an information recognizer (not shown) for acquiring image information of the food. The image information obtained by the information recognizer may be used as information for distinguishing food (for example, when food names are the same).

The first communication means 13 and the second communication means 33 may communicate by wire or wirelessly. In the present embodiment, there is no limitation on the communication method, and a known communication technology may be used.

The memory 31 of the communication component 30 may store the food information and / or information necessary for the management of the food. The refrigerator 1 may make a request for information transmission to the communication component 30. Then, the information stored in the memory 31 of the communication component 30 may be transmitted to the refrigerator 1, and the refrigerator 1 may recognize the transmitted information. In addition, the memory 17 of the refrigerator 1 may store information transmitted from the communication component 30.

3 is a diagram illustrating an example of a screen displayed on the display unit of the present invention.

Referring to FIG. 3, when the refrigerator is turned on, the main screen 100 may be displayed on the display unit 100. In the main screen 100, selectors 101, 102, 103, 104, 105, 106, and 107, weather information 108, memo information 109 or a schedule for selecting various functions of the refrigerator. Information can be displayed. The selection unit, an environment setting selection unit 101 for setting the operating environment of the display unit 11, a food management selection unit 102 for selecting to manage the food stored in the refrigerator, and recipe generation or inquiry A recipe selector 103 for selecting a food, a shopping list selector 104 for managing food for shopping, a refrigerator management selector 105 for managing a cooling function of a refrigerator, It may include one or more of the schedule selection unit 106 to select to manage the schedule, and the memo selection unit 107 to select to write the memo. Hereinafter, a case where the food control selection unit 102 is selected will be described.

4 is a diagram illustrating an example of a screen displayed when the food management selection unit is selected in FIG. 3.

Referring to FIG. 4, when the food management selection unit 102 is selected on the screen of FIG. 3, the food management screen 110 is displayed on the display unit 11. On the food management screen 110, a food location information screen 210 for displaying the location of the stored food, and a food list information screen 260 including the display information of the food to be added as food management target to be displayed Can be.

In addition, the food management screen 110, the recipe selection unit 221 to select to confirm the recipe information, the shopping list selection unit 222 to select to confirm the shopping list information, and food through the voice input Voice input selection unit 270 for adding as a food management target, and keyboard input selection unit for adding food as a food management target by directly inputting texts (meaning a combination of letters, symbols, and numbers). 290: a text input selection unit) and a trash bin 223 used to remove food from the food to be stored may be further displayed.

The food location information screen 210 and the food list information screen 260 may be arranged in a left or right direction or in a vertical direction. The food location information screen 210 may be displayed in the form of a refrigerator.

That is, the food location information screen 210 may be divided into a refrigerator compartment 211, a refrigerator compartment door 213, a freezer compartment 212, a freezer compartment door 214 and a home bar 215. One or more storage spaces may be displayed in the refrigerating compartment 211, the freezing compartment 212, the refrigerating compartment door 213, the freezing compartment door 214, and the home bar 215. The refrigerator compartment 211, the freezer compartment 212, the refrigerator compartment door 213, the freezer compartment door 214, and the home bar 215 may display one or more stored food information 217 indicating the stored food.

The food list information screen 260 may display a category selection unit 261 and a food information display unit 262 displaying information corresponding to the food category 261. The food information display section 262 may display the food display information 265 or the food classification.

The information indicating the stored food in the present invention may be referred to as stored food information 217, and the information displayed on the food list information screen 260 may be referred to as food display information 265. The stored food information 217 and the food label information 265 may be icons having the shape of the food itself.

The category selector 261 may select one of the frequency-specific category 261a and the food classification category 261b. 4 shows a food information display unit 262 displayed when a category for each frequency is selected. The food information display unit 262 may display one or more food label information 265 in order of storage frequency.

In the present embodiment, the food belonging to the food classification is previously stored in the memory 17, and the food not stored in the memory 17 may be newly added by a user manually inputting.

In addition to the frequency-specific category 261a and the food classification category 261b, a user may add a new category. For example, by adding a user preference category, a user favorite food may be selected and checked.

When the user selects the specific food display information 265 in the food information display unit 262 and drags the selected food display information 265 to the specific storage space of the food location information screen 210, the user selects the specific food display information 265. Stored food information 217 may be added. At this time, the selected food display information 265 is not deleted from the food list information screen 260, and only the stored food information 217 is added to the food location information screen 210.

At this time, the color representing the stored food information 217 located on the food location information screen 210 may vary depending on the storage period information. For example, the color of the stored food information 217, which has reached the end of storage, is red, and the stored food information 217 has an remaining color of 3 days or less, and the color of the stored food information 217 is orange, and the remaining time of storage is 4 days or more. The color of the stored food information 217 may be blue.

On the other hand, after selecting the specific stored food information 217 located on the food location information screen 210 and dragging it to the trash can 223, the specific stored food information 217 on the food location information screen 210 ) Is removed. That is, it is deleted from the food control object.

5 is a diagram illustrating an example of a screen displayed when a category is selected on the screen of FIG. 4.

4 and 5, when the food classification category 261b is selected on the screen of FIG. 4, the food information display unit 262 displays a plurality of food classification information 263. If any one of the plurality of food classification information 263 is selected, the food label information 265 belonging to the food classification may be displayed. At this time, the frequency category 261a and the food classification category 261b may be referred to as an upper category, and a category (eg, food classification) displayed when selecting the upper category (such as a food classification category) is a lower category. It can be said.

In FIG. 4, an area in which an upper category is displayed and an area in which a lower category is displayed are divided, and two areas are displayed together on a single screen. In contrast, when an upper category is selected, the screen is displayed to display a lower category. A screen for displaying a sub category may pop up. That is, the upper category and the lower category may be sequentially displayed.

In addition, the category and the food information belonging to the category may be displayed simultaneously or sequentially.

In FIG. 4, as an example, a method for selecting food information is described. However, the method for selecting food information may be similarly applied to selecting information required for food management. For example, after selecting food information, information on storage location may be selected as an example of information required for food management. The storage location information is categorized and a specific storage location can be selected from a specific category. In this case, the category and the specific storage location may be displayed together by category or sequentially.

As another example, in the food list information screen 260, the food is not categorized, and the food information may be displayed based on a specific sorting criterion. The sorting criteria may be in order of name, frequency of use, or the like. In the food list information screen, it is difficult to display all the food information, and some information may be restricted. Information limited on the information screen 260 of the food list may be confirmed by converting the screen. That is, the scrolled food can be queried using the scroll, or the display can be switched to the next screen to check the restricted food.

FIG. 6 is a diagram illustrating an example of a screen displayed when a voice input selection unit is selected on the screen of FIG. 4 or FIG. 5.

4 to 6, when the voice input selector 270 is selected for voice input, the voice input screen 272 is displayed on the display unit 11. In addition, the speaker 16 outputs a guide voice requesting a voice input. When the guide voice is output, the user may input food information or information necessary for managing food by voice. The food information and the information necessary for the management of the food may be input together or input another after completion of one input.

The cancellation input unit 273 for canceling the voice input may be displayed on the voice input screen 272. When the cancel selector 273 is selected, the screen of FIG. 6 may be switched to any one of the screens of FIGS. 3 to 5.

Hereinafter, a case of inputting food information first will be described.

In this specification, the screen newly displayed on the display unit 11 may be a screen switched from the previous screen or a screen popped up from the previous screen. Alternatively, the previous screen and the area that is a newly displayed screen may be divided and displayed together.

FIG. 7 is a diagram illustrating an example of a screen displayed when a recognition of an input voice fails. FIG. 8 is a diagram illustrating an example of a screen displayed when a recognition of an input voice is successful but a search for food fails. Drawing.

Referring to FIG. 7, when a voice is input but the voice recognition fails, the display 11 may display a recognition failure guide screen 274. The recognition failure guide screen 274 includes a re-entry selection unit 275 for selecting a voice again with information for notifying recognition failure, and a keyboard input selection unit 276 for directly inputting a text or the like. Selector) and a cancel selector 277 for canceling the voice input.

When the input selector 275 is selected again, the screen of FIG. 6 is displayed again, when the keyboard input selector 276 is selected, a text input screen is displayed, and when the cancel selector 277 is selected, FIG. The screen may be switched to any one of 3 to 5.

Referring to FIG. 8, when the voice recognition succeeds, but the search for the food name or the food classification fails, the search unit 11 may display a search failure guide screen 278. The retrieval failure guide screen 278 includes a re-entry selection unit 275 for re-entering a voice together with information for notifying a retrieval failure, and a keyboard input selection unit 276 for directly inputting a text or the like. Selector) and a cancel selector 277 for canceling the voice input.

9 is a diagram illustrating an example of a screen displayed when voice recognition and search are successful.

Referring to FIG. 9, when voice recognition and food search are successful after inputting a voice on the screen of FIG. 6, the search result screen 280 is displayed on the display unit 11. The search result screen 280 may display information related to the input voice information. At this time, the memory 17 stores information related to the food classification or the food name in advance.

For example, when the user inputs "o", the search result screen 280 may display one or more food information 282 including "o". That is, when a food classification or a part of a food name is input for the convenience of the user, the entire information including the input contents may be displayed. As described above, the food information 282 may include a food classification category and a food name.

The food classification or food name not stored in the memory 17 may be added by the user to the memory 17. The food classification or food name added to the memory 17 by the user may be newly generated and displayed on the food list information screen 260, and the user may delete it.

Food information may be determined by selecting a food name from the displayed food information. When a food name is selected, information necessary for managing the selected food may be selected or input.

On the other hand, if a food classification is selected, the food classification can be determined. After determining the food classification, the food name belonging to the food classification is displayed, and the food name can be determined by selecting a specific food name. Thereafter, information necessary for the management of the food can be selected or inputted to determine information necessary for the management of the food.

Information necessary for the management of the food may be input by voice or by text on a text input screen to be described later. The process of inputting information necessary for managing food may be the same as the process of inputting food information.

The search result screen 280 includes a re-input selection unit 275 for re-input, a keyboard input selection unit 276 for directly inputting characters, and a text input selection unit 276 for canceling voice input. The cancel selector 277 may be displayed.

FIG. 10 is a diagram illustrating an example of a screen displayed when a keyboard input selection unit is selected on the screen of FIG. 4 or FIG. 5.

4, 5, and 10, when the user selects the keyboard input selector 290 to input text, the display 11 displays a text input screen 300.

The text input screen 300 includes a text input unit 301 for inputting food information, an input content display unit 302 for displaying the input content, and a completion selection unit 303 for selecting when the input is completed. Can be displayed. The input name may be Korean, English, etc., and the language of the input name is not limited.

FIG. 11 is a diagram illustrating an example of a screen displayed when food information input is completed on the screen of FIG. 10.

10 and 11, when the completion selection unit 303 is selected after inputting text, the search result screen 310 is displayed on the display unit 11. The search result screen 310 may display information related to the input text.

The memory 17 stores information related to a food classification or a food name in advance. For example, when the user inputs "o", the search result screen 310 may display one or more food information 312 including "o". That is, when a food classification or a part of a food name is input for the convenience of the user, the entire information including the input contents may be displayed.

When a food name is selected from the displayed food information 312, information necessary for managing the selected food may be selected or input.

On the other hand, when a food classification is selected, the food name belonging to the food classification is displayed, and after selecting a specific food name, information necessary for managing food can be selected or inputted. Information necessary for the management of the food may be input by text or voice. The process of inputting information necessary for managing food may be the same as the process of inputting food information.

In this embodiment, some or all of the food information or information necessary for the management of the food may be automatically recognized (or set). That is, the refrigerator 1 may receive and recognize some or all of the food information or information necessary for the management of the food from the communication component 30.

Information necessary for management of the food may be set differently according to food classification or food. For example, the food to be stored in the freezer compartment may be set to 10 days from the storage start date to the storage end date, the food to be stored in the refrigerator compartment may be set to 3 days from the storage start date to the end of the storage.

In addition, the storage position of the vegetables, fruits, milk, etc. may be set to the refrigerating chamber, ice cream, fish, etc. may be set to the freezing chamber. In addition, the number of storage for each food may be set to one. In addition, the storage weight may be set for each food.

The user may change food information previously stored in the memory 17 or information necessary for managing food.

12 is a diagram illustrating an example of a food detail information screen.

Referring to FIG. 12, after the input of food information is completed or when the specific stored food information 217 is selected on the food location information screen 210, the detailed information screen 400 including detailed information of the stored food is displayed. Can be displayed.

When a part of information necessary for the management of the food is automatically recognized by receiving from the communication component 30, the specific information on the food information 217 is selected on the food location information screen 210 to display the detailed information screen 400. ), You can change the information required for food control.

The detailed information screen 400 may display one or more of food classification or food name, storage period information 410, storage amount information, and storage location.

The detailed information screen 400 includes at least one of a period selecting unit 411 for changing or selecting storage period information, a storage amount selecting unit 412 for changing or selecting a storage amount, and a storage location selecting unit (not shown). Can be displayed. As another example, when the storage period information is selected, a storage period changing screen (to be described later) for changing or selecting the storage period information may be displayed.

FIG. 13 is a diagram illustrating an example of a screen displayed when a period selection unit is selected on the screen of FIG. 12.

Referring to FIG. 13, when the period selection unit 411 is selected on the detailed information screen 400, the storage period change screen 420 may be displayed on the display unit 11. In the storage period change screen 420, a storage start date selection unit 421 and a storage end date selection unit 422 may be displayed. The year, month, and day may be selected using the storage start date selector 421. The year, month, and day may be selected using the storage end date selector 422. Alternatively, the storage start date selection unit 421 may be omitted. That is, the storage start date is fixed, and it is also possible to change only the storage end date. The storage period change screen 420 may display selection units 423 and 424 for finally selecting the storage period or canceling the storage period selection. When the storage period information is automatically set, the storage period may be changed only for the stored food.

When the storage period management is performed, foods having an elapsed storage period reaching the reference period, foods having the storage remaining period within the reference period, or foods having reached the storage end date may be displayed on the display unit or output through the speaker. .

In FIG. 12, the storage period or storage amount is described as being selected on the screen. Alternatively, voice or text may be input.

That is, in the case of the present invention, the food information and information necessary for the management of the food may be selected on the screen or input by voice or text. In this case, the food information and the information necessary for the management of the food may be input by the same method or may be input by another method.

According to the present invention, since the food information stored in the refrigerator and the information necessary for the management of the food can be confirmed through the display unit, the convenience of the user is improved.

In addition, in the case of inputting a voice or text, even if a part of a word is input, related information including the input content is displayed together, thereby improving user convenience.

In addition, even if the user inputs some of the food information and information necessary for the management of the food, since the uninformed information is matched with the input information, the user's convenience is improved. That is, even if the user inputs some information, the remaining information is automatically recognized, so that the user's input convenience can be improved.

14 is a control block diagram of a refrigerator and a communication component according to a second embodiment of the present invention.

Referring to FIG. 14, the refrigerator 5 according to the second embodiment of the present invention includes an information recognizer 20 for recognizing food information and / or information necessary for managing food. In addition, the refrigerator 5 includes a display unit 11, a display unit control unit 12, a first communication unit 13, a main control unit 10, a memory 17, and an energy consumption unit 18. It may include.

The refrigerator 5 may receive food information or information necessary for the management of the food from the communication component 30. The communication component 30 may comprise a memory 31, a control unit 32 and a second communication means 33. In this embodiment, the communication component 30 may be, for example, a mobile phone.

In detail, the memory 17 may include a first memory 510 for storing food management information, a second memory 520 for storing food information selected by a user, and a second memory 520 for storing food information. Three memory 530 may be included.

The management target food information may be stored in the first memory 510 when the refrigerator 5 is manufactured. The food information stored in the first memory 510 may be updated. The first memory 510 may also store unmanaged item information. Unmanaged item information refers to items that are not appropriate for management in the refrigerator. In this embodiment, the article may be interpreted as a concept including food and non-food. As another example, the refrigerator 5 may further include a fourth memory that stores unmanaged item information.

The second memory 520 stores food information selected by the user as a management target as food information not stored in the first memory 510. Accordingly, the first memory 510 may be referred to as a basic memory, and the second memory 530 may be referred to as a user selection memory.

The information recognizer 20 may include a camera (image acquisition device) and an image information analyzer. As another example, the information recognizer 20 may be a camera, and the display controller 12 may analyze image information. Therefore, the display controller 12 may also be referred to as an image information analyzer.

The camera may be arranged in the main body of the refrigerator 5 or in a door. For example, when storing or withdrawing food in the refrigerator 5, the camera may recognize food information and / or information necessary for managing food.

The camera may acquire image information of an object in which information related to food is described or image information of a purchase receipt of food. The object in which the information related to the food is described may generally be a wrapping paper of the food.

The image information analyzer extracts valid information from image information acquired through a camera, and recognizes food information and / or information necessary for food management by comparing the valid information with information stored in the memory 17.

For example, the acquired image information may include character information, symbol information, color information, QR code (Quick response code), bar code, bar code information, trademark information, etc., and some or all of the information may be extracted as valid information. Can be.

The first memory 510 may store food information corresponding to character information, preference information, QR code, barcode, trademark information, and / or the like, and information necessary for managing food. Alternatively, the valid information itself may be recognized as food information or information necessary for food management. For example, when the food name and the end date of storage are included in the image information obtained through the camera, the food name and the end date of storage are valid information and information necessary for food information and food management.

As another example, the information recognizer 20 may be a QR code reader, a barcode reader, or an RFID reader.

FIG. 15 is a view illustrating a state in which information recognized by an information recognizer is displayed on a display unit, and FIG. 16 is a flowchart illustrating a control method of a refrigerator according to a second embodiment of the present invention.

15 and 16, the product information is recognized by the information recognizer 20 for managing food (S1). Hereinafter, as an example, it will be described that the information recognizer 20 recognizes the purchase receipt.

When the purchase receipt is photographed using the information recognizer 20, the management target article is extracted based on the photographed image information (S2). That is, among the recognized goods except for the unmanaged goods, the goods are extracted as the managed goods. In other words, unstored food information is displayed in the first memory 510 together with food management information stored in the first memory 510.

Then, the extracted management object article is displayed on the display unit 11 as shown in Fig. 15 (S3).

Referring to FIG. 15, when there are a plurality of items to be managed, a plurality of item information display units 600, 610, and 620 may be displayed in a line. The plurality of article information display units 600, 610, and 620 may include a food name information display unit 601. Each item information display unit 600, 610, and 620 may include one or more of a classification name (category) information display unit 602, an expiration date information display unit 603, and a storage location information display unit 604.

In addition, an information display unit 630 for displaying whether or not a displayed article is stored in the first memory 510 is displayed around each article information display unit. For example, when food A and food B are stored in the first memory 510, and food C is not stored in the first memory 510, only the information display unit 630 corresponding to food A and food B is displayed. The symbol, for example "V" may be displayed. That is, the food stored in the first memory 510 and the unsaved food may be displayed separately.

In the case of the food stored in the first memory 510, corresponding information may be displayed on the classification name (category) information display unit 602, the expiration date information display unit 603, and the storage location information display unit 604, respectively.

On the other hand, in the case of the food not stored in the first memory 520, the information is not displayed in the classification name (category) information display unit 602, the expiration date information display unit 603 and the storage location information display unit 604. In this case, the user may manually input information by selecting the corresponding display unit.

In addition, the display unit 11 displays a delete button 642 for deleting the displayed item, and a storage button 640 for selecting the displayed item as a food management target of the refrigerator. When the storage button 640 is selected (S4), management of the article displayed on the display unit 11 is performed (S5).

When the information display unit 630 of the article not stored in the first memory 510 is selected, an indication symbol is displayed, and when the storage button 640 is selected in this state, the information of the unstored article is stored in the second memory 520. ) The article information stored in the second memory 520 may be used as management target information together with the article information stored in the first memory 510. In this case, the information stored in the first memory 510 may not be arbitrarily changed by the user, and the information stored in the second memory 520 may be arbitrarily changed (for example, deleted) by the user.

Meanwhile, as described above, the information stored in the first memory 510 may be updated. For example, food information may be added to the first memory 510. When the food information added during the updating of the information and the information stored in the second memory 520 match, the information stored in the second memory 520 is deleted, and the corresponding information is stored in the first memory 510. Can be stored.

According to the present embodiment as described above, since a plurality of item information can be recognized in the information recognizer, detailed information can be displayed in the case of the item stored in the first memory, the user has to reduce the hassle of having to enter the food information There is this.

In addition, since the information of the article not stored in the first memory may be stored in the second memory by the user's selection, the information stored in the second memory may be displayed on the display unit when the same article is recognized later. There is an advantage that convenience is improved.

In the above embodiment, the article is recognized as being recognized by the information recognizer of the refrigerator, but the article may be recognized by the communication component 30 in the same manner. In this case, the memory 31 of the communication component 30 may include the above-described first memory, second memory, and third memory. When one or more items are selected for management of the refrigerator in the communication component 30, information of the selected items is transmitted to the refrigerator.

1, 5: refrigerator 30: communication component

Claims

Recognizing the information of the article in the information recognizer of the component;
Extracting the item to be managed from the recognized items;
Displaying information on the extracted management object article on a display unit; And
And selecting one or more items to be managed from among the displayed items.

The method of claim 1,
In the memory of the component stores the managed food and unmanaged goods,
A method for controlling a component in which items, except for unmanaged items, are displayed among recognized items.

The method of claim 1,
The component includes a first memory in which the information of the food to be managed is stored in advance,
And the display unit displays a food to be managed stored in the first memory and an article not stored in the first memory.

The method of claim 3, wherein
The control method of the component to display the food to be managed stored in the first memory and the goods not stored in the first memory.

The method of claim 4, wherein
The component further includes a second memory,
And when the article is not stored in the first memory, the selected article is stored in the second memory.

The method of claim 5, wherein
And the information stored in the second memory can be deleted.

The method of claim 4, wherein
Information stored in the first memory may be updated,
And when the item information to be added in the updating process matches the item information stored in the second memory, the information stored in the second memory is stored in the first memory.

The method of claim 1,
The information of the article displayed on the display unit, the control method of the component including at least one of the classification name, expiration date, storage location and the food name.

The method of claim 8,
The information that is not displayed on the display unit can be manually input component control method.

The method of claim 1,
The component is a control method of the component.

The method of claim 1,
The component is a mobile phone capable of communicating with the refrigerator,
If one or more items are selected for management in the mobile phone,
The control method of the component in which the information of the selected article is transmitted to the refrigerator.