KR102295628B1 - Food storage apparatus and method for thereof - Google Patents

Abstract

Disclosed are a food storage device and a method for controlling the same. The food storage apparatus according to the present invention executes an application by executing a UI including a display unit for displaying an execution screen of an application related to the food storage apparatus and at least one icon for controlling an execution screen of the application while the execution screen of the application is displayed and a processor for controlling the display unit to be displayed on a side area of the screen, wherein the application related to the food storage device is a view inside application that provides an image photographed inside the food storage device, and the processor includes an image photographed inside the food storage device The display unit is controlled to display the UI on the . Accordingly, the food storage apparatus can provide more diverse services than the prior art, and provide a UI for service execution in a form that a user can easily and quickly use.

Description

Food storage apparatus and method for controlling the same

The present invention relates to a food storage apparatus and a control method thereof, and more particularly, to a food storage apparatus and a control method thereof for providing various UI environments through the food storage apparatus.

Due to recent technological development, a food storage device such as a smart refrigerator may provide information related to food stored in the food storage device.

In addition, the food storage device may provide various contents by communicating with an external device or an external server.

For example, the food storage device provides a storage possible state of food stored in the food storage device, cooking information using the stored food, or external information through a display screen attached to the front of a door that opens and closes a storage room for storing food. It provides only services such as playing content received from

That is, the conventional food storage apparatus provides a somewhat limited service using information input from a user, information sensed within the food storage apparatus, and data received from the outside.

Meanwhile, the food storage apparatus may display a UI through a display screen and provide the above-described service according to a user's selection command for the displayed UI.

The UI for providing such a service is disposed at the top or bottom of the display screen, or disposed at the center of the display screen and displayed.

When the UI for providing the above-described service is disposed at the top or bottom of the display screen, there is a problem in that a specific user (eg, a tall or small user or a disabled person) cannot easily manipulate the UI displayed on the display screen.

In addition, when the corresponding UI is placed in the center of the display screen, the user suffers inconvenience in viewing contents such as execution screens or videos of various applications displayed through the display screen by the UI displayed in the center of the display screen. I have a problem that needs to be done.

The present invention has been devised in response to the above needs, and an object of the present invention is to provide more diverse services using various information collected or input from a food storage device.

Furthermore, an object of the present invention is to provide a UI for service execution in a form that a user can easily and quickly use.

In a food storage device according to an embodiment of the present invention for achieving the above object, a display unit for displaying an execution screen of an application related to the food storage device and an execution screen of the application while the execution screen of the application is displayed a processor for controlling the display unit to display a UI including at least one icon for controlling the application execution screen in a side area of the application execution screen, wherein the application provides an image photographed inside the food storage device, the The processor controls the display unit to display the UI on an image captured inside the food storage device.

And, when one of the at least one icon is selected, the processor displays an execution screen corresponding to the selected icon and displays the display unit to display a sub UI including an icon for controlling the displayed execution screen. can be controlled

Also, the processor may control the display unit to further display a guide UI for guiding the movable range of the UI.

In addition, when one of a plurality of objects included in the captured image is selected, the processor may control the display unit to display an input UI for inputting information related to the selected object.

In addition, when a first icon included in the input UI is selected, the processor displays a memo UI for inputting information related to the object, and when a user command is input through the memo UI, The display unit may be controlled to generate a tag UI including a memo and display it overlaid on the captured image.

Then, when the tag UI is selected, the processor may display the memo UI again for inputting information related to an object corresponding to the selected tag UI.

In addition, when the second icon included in the input UI is selected, the processor executes a food list application for providing food information for each food stored in the food storage device, and when food information related to the object is input, The input food information may be registered in the food list stored in the executed food list application.

And, when the third icon included in the input UI is selected, the processor executes a shopping list application for purchasing food, and when food information related to the object is input, the processor adds the shopping list to the shopping list stored in the shopping list application. You can register the entered food information.

Also, when a voice command for food purchase is input, the processor may execute a shopping list application and register food information related to the voice command in a shopping list stored in the executed shopping list application.

In addition, when a user command for a specific dish is input in a state in which a recipe application for cooking guidance for each dish is executed, the processor displays material information for the dish, and provides information on food stored in the food storage device. Based on a food list stored in a food list application that provides food information, the display unit may be controlled to display different food-related ingredients and other ingredients in the food storage device among the displayed ingredients.

On the other hand, according to another embodiment of the present invention, the control method of the food storage device includes the steps of displaying an execution screen of an application related to the food storage device and displaying the execution screen of the application while the execution screen of the application is displayed. Displaying a UI including at least one icon for controlling on a side area of the application execution screen, wherein the application provides an image photographed inside the food storage device, and displaying the image on the side area displays the UI on the image taken inside the food storage device.

And, in the displaying, when one of the at least one icon is selected, displaying an execution screen corresponding to the selected icon, and displaying in the side area includes an icon for controlling the displayed execution screen It is possible to display a sub UI including

The method may further include displaying a guide UI guiding the movable range of the UI.

The method may further include, when one of a plurality of objects included in the captured image is selected, displaying an input UI for inputting information related to the selected object.

The method may further include displaying a tag UI according to a user command input through the input UI, wherein the displaying of the tag UI includes: when a first icon included in the input UI is selected, the selected object Displaying a memo UI for inputting information related to, when a user command is input through the memo UI, generating a tag UI including a memo corresponding to the user command, and capturing the generated tag UI It may include the step of superimposing the display on the image.

Also, in the displaying of the tag UI, when the tag UI is selected, the memo UI for inputting information related to an object corresponding to the selected tag UI may be displayed again.

In addition, the method further comprises the step of registering information on food stored in the food storage device according to a user command input through the input UI, wherein the registering includes: when a second icon included in the input UI is selected, Executing a food list application for providing food information for each food stored in the food storage device and when food information related to the object is input, registering the input food information in the food list stored in the food list application Including the step, the food list, may provide information about the food stored in the food storage device.

And, according to a user command input through the input UI, further comprising the step of registering information for food purchase, wherein the registering step, when a third icon included in the input UI is selected, a shopping list application and registering the input food information in the shopping list stored in the shopping list application when food information related to the object is input.

In addition, the method further includes registering food information, wherein, when a voice command for food purchase is input, a shopping list application is executed, and the voice command is added to a shopping list stored in the executed shopping list application. Food information related to can be registered.

And, in the displaying step, when a recipe application for cooking guidance for each dish is executed, when a user command for a specific dish is input, the ingredient information for the dish is displayed, and the food stored in the food storage device is displayed. Based on the food list stored in the food list application that provides food information about the food information, among the displayed ingredients, the food-related ingredients in the food storage device and the remaining ingredients may be displayed differently.

As described above, the food storage device according to the present invention can provide more diverse services than the prior art, and can provide a UI for service execution in a form that a user can easily and quickly use.

1 is an exemplary view of a food storage device according to an embodiment of the present invention;
2 is a schematic block diagram of a food storage device according to an embodiment of the present invention;
3 is a detailed block diagram of a food storage device according to an embodiment of the present invention;
4 is an exemplary view of a UI displayed in a food storage device according to an embodiment of the present invention;
5 is a first exemplary view of controlling a UI displayed in a food storage device according to an embodiment of the present invention;
6 is a second exemplary view of controlling a UI displayed in a food storage device according to another embodiment of the present invention;
7 is an exemplary diagram of displaying an execution screen according to selection of an icon of a UI displayed on a side area in a food storage device according to an embodiment of the present invention;
8 is an exemplary view of providing an input UI according to an application type being executed in a food storage device according to an embodiment of the present invention;
9 is a first exemplary view of editing an application running in a food storage device according to an embodiment of the present invention;
10 is a second exemplary view of editing an application running in a food storage device according to another embodiment of the present invention;
11 to 15 are exemplary views illustrating an execution operation of a view inside application in a food storage device according to an embodiment of the present invention;
16 is an exemplary view showing an execution operation of a shopping list application in a food storage device according to an embodiment of the present invention;
17 is an exemplary view of interlocking a plurality of applications in the food storage device according to an embodiment of the present invention;
18 is an exemplary view of purchasing food registered in a shopping list in a food storage device according to an embodiment of the present invention;
19 to 22 are exemplary views showing an execution operation of a recipe application in a food storage device according to an embodiment of the present invention;
23 is a flowchart of a method for controlling a food storage apparatus according to an embodiment of the present invention.

Terms used in this specification will be briefly described, and the present invention will be described in detail.

Terms used in the embodiments of the present invention have been selected as currently widely used general terms as possible while considering the functions in the present invention, which may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, etc. . In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than the name of a simple term.

Embodiments of the present invention can apply various transformations and can have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, and it should be understood to include all transformations, equivalents and substitutes included in the spirit and scope of the invention. In describing the embodiments, if it is determined that a detailed description of a related known technology may obscure the subject matter, the detailed description thereof will be omitted.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as "comprises" or "consisting of" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, and are intended to indicate that one or more other It is to be understood that this does not preclude the possibility of addition or presence of features or numbers, steps, operations, components, parts, or combinations thereof.

In an embodiment of the present invention, a 'module' or 'unit' performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' are integrated into at least one module and implemented with at least one processor (not shown) except for 'modules' or 'units' that need to be implemented with specific hardware. can be

In an embodiment of the present invention, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element interposed therebetween. also includes In addition, it includes not only a physical connection but also a case of wireless connection. In addition, when a part "includes" a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise stated.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Hereinafter, the present disclosure will be described in detail with reference to the drawings.

1 is an exemplary view of a food storage device according to an embodiment of the present invention.

As shown in FIG. 1 , the food storage device 100 may be a device capable of storing food so that it does not deteriorate, such as a smart refrigerator.

The food storage device 100 displays execution screens for various applications related to food through the display screen 20 attached to the front of the door 10 that opens and closes a storage room for storing food, or each application Provides UI for execution.

Here, the application may be an application that provides an image of the inside of the food storage device 100 . That is, the food-related application may be a view inside application for providing an image of the inside of the food storage device 100 in which food is stored, an application for purchasing food, an application for providing a recipe for each dish, and the like.

In addition, the food storage device 100 displays an execution screen for various applications such as living information, content, schedule management, and memo through the display screen 20 or includes at least one icon for executing each application. UI can be provided.

Meanwhile, the food storage apparatus 100 may display a UI including at least one icon for executing an application or controlling an execution screen of the application on the side of the display screen 20 .

As such, as the UI including at least one icon for executing the application or controlling the execution screen of the application is displayed on the side of the display screen 20 , the execution screen of the application displayed on the display screen 20 corresponds to the corresponding UI. Problems interrupted by the UI can be improved.

In addition, as the UI including at least one icon for executing the application or controlling the execution screen of the application is displayed on the side of the display screen 20 , all users can use the UI displayed on the display screen 20 . can

Meanwhile, the food storage apparatus 100 may move the UI including at least one icon displayed on the side area of the display screen 20 in a direction corresponding to the user command.

For example, the food storage apparatus 100 may move the UI including at least one icon displayed on the side area of the display screen 20 upward or downward according to a user command.

So far, the food storage device 100 according to the present invention has been schematically described. Hereinafter, the configuration of the food storage device 100 according to the present invention will be described in detail.

2 is a schematic block diagram of a food storage device according to an embodiment of the present invention.

As shown in FIG. 2 , the food storage apparatus 100 includes a display unit 110 and a processor 120 .

The display unit 110 displays an execution screen of an application related to the food storage device 100 .

Here, the application related to the food storage device 100 may be a view inside application for providing an image of the inside of the food storage device 100 in which food is stored. However, the present invention is not limited thereto, and the application related to the food storage device 100 may include an application for purchasing food and an application for providing a recipe for each dish.

In addition, applications provided by the food storage device 100 may include life information, content, schedule management, and memo-related applications.

While the execution screen of the application is displayed on the display unit 110 , the processor 120 displays a UI including at least one icon for controlling the execution screen of the corresponding application on the side area of the execution screen of the application being displayed. Controls the display unit 110 .

Accordingly, the display 110 may display a UI including at least one icon for controlling the execution screen of the corresponding application in the side area of the execution screen of the application being displayed.

Meanwhile, when one of at least one icon included in the UI displayed on the side area of the execution screen of the application is selected, the processor 120 displays an execution screen corresponding to the selected icon, and controls the displayed execution screen. The display unit 110 is controlled to display a sub UI including an icon.

In this case, the processor 120 may control the display unit 110 so that the sub UI is displayed on the side area of the displayed execution screen.

According to an exemplary embodiment, the processor 120 may control the display unit 110 to display the sub UI by superimposing it on the side area of the displayed execution screen.

According to another embodiment, the processor 120 may control the display unit 110 to display the sub UI in the side area and display the execution screen in the remaining area.

According to an additional aspect of the present invention, the processor 120 may control the display unit 110 to further display a guide UI that guides the movable range of the UI displayed on the side area.

However, the present invention is not limited thereto, and the processor 120 may control the display 110 to further display a guide UI that guides the movable range of the sub UI displayed on the above-described side region.

Specifically, the processor 120 may control the display unit 110 to display the UI or sub UI displayed on the side area in a direction corresponding to the input of the user command and the inputted user command.

According to an embodiment, when a user's drag command is input, the processor 120 moves the UI or sub UI displayed on the side area in an upward direction or a downward direction corresponding to the input drag command to display the display unit 110 . can be controlled

In this case, when the guide UI is displayed, the processor 120 may control the display 110 to display the UI or sub UI displayed on the side area up to the point where the guide UI is displayed by moving it in a direction corresponding to the user command.

Meanwhile, as described above, when the view inside application is executed, the processor 120 may control the display unit 110 to display an image of the inside of the food storage device 100 in which food is stored.

Accordingly, the display unit 110 may display an image obtained by photographing the inside of the food storage device 100 in which food is stored.

Meanwhile, when one of a plurality of objects included in the captured image is selected, the processor 120 controls the display 110 to display an input UI for inputting information related to the selected object.

Accordingly, the display 110 may display an input UI including a plurality of icons around the selected object.

Accordingly, the processor 120 performs various operations according to a user's selection command for an icon included in the displayed input UI.

According to an embodiment, when a user command for a first icon among a plurality of icons included in the displayed input UI is input, the processor 120 displays a memo UI for inputting information related to a pre-selected object on the display unit 110 . ) to control

Thereafter, when a user command is input through the displayed memo UI, the processor 120 generates a tag UI including a memo corresponding to the input user command. Thereafter, the processor 120 controls the display unit 110 so that the inside of the food storage device 100 in which the food is stored is displayed by superimposing the tag UI on the photographed image.

Accordingly, the display unit 110 may display the tag UI by superimposing the tag UI on the image of the inside of the food storage device 100 in which the food is stored.

On the other hand, when a selection command for the tag UI is input while the tag UI is displayed, the processor 120 controls the display unit 110 to re-display a memo UI for inputting information related to an object corresponding to the selected tag UI. can be controlled

Meanwhile, when a selection command for a second icon among a plurality of icons included in the input UI is input, the processor 120 executes a food list application for providing food information for each food stored in the food storage device 10 . Accordingly, the display 110 displays the execution screen of the food list application.

In this way, when the food information related to the pre-selected object is input while the execution screen of the food application is displayed, the processor 120 registers the food information written in the food list stored in the executed food list application.

Meanwhile, when a selection command for a third icon among a plurality of icons included in the input UI is input, the processor 120 executes a shopping list application for purchasing food. Accordingly, the display unit 110 displays the execution screen of the shopping list application.

As described above, when food information related to a pre-selected object is input while the execution screen of the shopping list application is displayed, the processor 120 registers the entered food information in the shopping list stored in the executed shopping list application.

According to an additional aspect of the present invention, when a voice command for food purchase is input, the processor 120 may execute a shopping list application. Thereafter, the processor 120 may register food information related to the voice command written in the shopping list stored in the executed shopping list application.

However, the present invention is not limited thereto, and when a voice command for food stored in the food storage device 100 is input, the processor 120 executes the food list application and displays the food list stored in the executed food list application. Food information related to the entered voice command can be registered.

According to an additional aspect of the present invention, the processor 120 may execute a recipe application for guiding cooking for each dish according to a user command. Thereafter, when a user command for a specific dish is input, the processor 120 controls the display unit 110 to display material information for the corresponding dish.

Accordingly, the display 110 may display the ingredient information for the dish requested by the user.

On the other hand, the processor 120 is located in the food storage device 100 of the ingredients displayed on the screen based on the food list stored in the food list application that provides food information about the food stored in the food storage device 100. The display unit 110 may be controlled to display food-related ingredients and other ingredients differently.

Accordingly, the display 110 may display material information in which the ingredients stored in the food storage device 100 and the remaining ingredients are displayed differently from the ingredients for cooking requested by the user.

However, the present invention is not limited thereto, and the processor 120 provides food information on the food stored in the food storage device 100. Based on the food list stored in the food list application, the food among the ingredients of the dish requested by the user. The display unit 110 may be controlled to display information on ingredients other than the food stored in the storage device 100 .

Accordingly, the display unit 110 may display material information on the remaining ingredients except for the ingredients stored in the food storage device 100 among ingredients for cooking requested by the user.

3 is a detailed block diagram of a food storage device according to an embodiment of the present invention.

As shown in FIG. 3 , the food storage device 100 includes an input unit 130 , a communication unit 140 , a cold air supply unit 150 , and a photographing unit 160 in addition to the above-described configuration of the display unit 110 and the processor 120 . , a sensing unit 170 , an audio output unit 180 , and a storage unit 190 may be further included.

The input unit 130 receives various user commands. The input unit 130 may include at least one of a manipulation unit, a touch input unit, a user input unit, and a microphone.

The operation unit may be implemented as a keypad (Key Pad) having various function keys, number keys, special keys, character keys, etc., and the touch input unit is a display unit when the above-described display unit 110 is implemented in the form of a touch screen. It may be implemented as a touch pad forming a mutual layer structure with 110 . In this case, the touch input unit may receive a touch command for icons included in various UIs displayed through the aforementioned display unit 110 .

The user input unit receives an IR signal or an RF signal from a remote control device (not shown) that controls the food storage device 100 , and the microphone receives a user's voice command.

The communication unit 140 performs data communication with a web server (not shown) that provides content, a user terminal device (not shown) such as a pre-registered smart phone, and a server (not shown) of a store selling various products.

The communication unit 140 includes a wireless communication module such as a short-range communication module and a wireless LAN module, and a wired such as a High-Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB), and an Institute of Electrical and Eletronics Engineers (IEEE) 1394. It may include a connector including at least one of the communication modules.

The short-distance communication module is a configuration for wirelessly performing short-range communication between the food storage device 100 and the user terminal device (not shown). The short-distance communication module may include at least one of a Bluetooth module, an infrared data association (IrDA) module, a near field communication (NFC) module, a WIFI module, and a Zigbee module. .

In addition, the wireless communication module is a module for performing communication by being connected to an external network according to a wireless communication protocol such as IEEE. In addition, the wireless communication module further includes a mobile communication module that performs communication by accessing a mobile communication network according to various mobile communication standards such as 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evoloution (LTE). You may.

As such, the communication unit 140 may be implemented by the various short-distance communication methods described above, and other communication technologies not mentioned herein may be employed as needed.

On the other hand, the connector is a configuration that provides an interface with various source devices such as USB 2.0, USB 3.0, HDMI, IEEE 1394, and the like. Such a connector may receive content data transmitted from a web server (not shown) through a wired cable connected to the connector. Also, the connector may receive power from a power source through a wired cable physically connected to the connector.

The cold air supply unit 150 is configured to supply cold air so that a preset temperature is maintained in a storage room for storing food in the food storage device 100 . In particular, when different temperatures are set for each region, the cold air supply unit 160 may supply cold air with different intensities to each region so as to maintain the temperature set for each region.

The photographing unit 160 photographs the inside of the food storage apparatus 100 , and the detection unit 170 detects whether the user is close to the food storage apparatus 100 or detects the temperature outside the food storage apparatus 100 . can In addition, the sensing unit 170 may measure a sensing value for determining the state of the food stored in the food storage device 100 .

The audio output unit 180 outputs audio data included in content displayed through the display unit 110 or recipe information for each dish provided through a recipe application, which will be described later, in the form of an audible sound.

The storage unit 190 may store list-related information stored in various applications to be described later. In addition, the storage unit 190 may further store various operating programs for controlling the operation of the food storage apparatus 100 . Here, when the food storage apparatus 100 is turned on, the operation program may be a program that is read from the storage unit 190 and compiled to operate each component of the food storage apparatus 100 .

Meanwhile, the aforementioned processor 120 may include a CPU 121 , a GPU 122 , a ROM 123 and a RAM 124 , and the CPU 121 , the GPU 122 , the ROM 123 and the RAM. 124 may be connected to each other via bus 125 .

The CPU 121 accesses the storage unit 190 and performs booting using the OS stored in the storage unit 190 . In addition, the CPU 121 performs various operations using various programs, contents, data, etc. stored in the storage unit 190 .

The GPU 122 generates a display screen including various objects such as icons, images, texts, and the like. Specifically, the GPU 122 calculates property values, such as coordinate values, shape, size, color, etc., at which each object is to be displayed according to the layout of the screen based on the received control command, and selects the object based on the associated property value. Create display screens of various layouts including

The ROM 123 stores a command set for system booting. When a turn-on command is input and power is supplied, the CPU 121 copies the OS stored in the storage unit 140 to the RAM 124 according to the command stored in the ROM 123, and executes the OS to boot the system. . When booting is completed, the CPU 121 copies various programs stored in the storage unit 190 to the RAM 124 and executes the programs copied to the RAM 124 to perform various operations.

The processor 120 may be implemented as a single-chip system (System-on-a-chip or System on chip, SOC, SoC) in combination with each of the above-described components.

Meanwhile, the above-described operation of the processor 120 may be performed by a program stored in the storage unit 190 . Here, the storage unit 190 includes a ROM 123 , a RAM 124 , or a memory card (eg, SD card, memory stick), non-volatile memory, volatile memory, and hard disk removable/mountable to the food storage device 100 . It may be implemented as at least one of a drive (HDD) and a solid state drive (SSD).

So far, each configuration constituting the food storage device 100 according to the present invention has been described in detail. Hereinafter, the operation of the food storage device 100 according to the present invention will be described in detail.

4 is an exemplary diagram of a UI displayed in a food storage device according to an embodiment of the present invention.

As shown in FIG. 4 , the food storage apparatus 100 may display an execution screen 410 of an application requested by the user. In addition, the food storage apparatus 100 may display a UI 420 for controlling the execution screen of the application on one side area where the execution screen 410 of the application is displayed. Here, the UI 420 displayed on one side area may include at least one icon preset in relation to the running application.

For example, when the running application is a view-in-side application, the UI 420 displayed on one side area is a first icon for returning to a previous execution screen in the view-in-side application, and the current view of the view-in-side application. It may include a second icon for editing or controlling the execution screen and a third icon for providing a sub UI for additionally editing or controlling the execution screen of the view-in-side application being executed.

Meanwhile, when the running application is a recipe application, the UI 420 displayed on one side area may include an icon for searching for a dish.

And, when the running application is a food list application or a shopping list application, the UI 420 displayed on one side area registers information on food stored in the food storage device 100 or registers information on food to be purchased. It may include a first icon for and a second icon for providing a sub UI for additionally editing or controlling an execution screen of a food list or shopping list application being executed.

Meanwhile, the food storage apparatus 100 may further include a fixed UI 430 set to always be displayed on the other side area on which the execution screen 410 of the application is displayed. Here, the fixed UI 430 may be, for example, a UI for returning to a previous screen or returning to an initial screen.

As such, the UI 420 displayed on one side area and the fixed UI 430 displayed on the other side area may be displayed at a preset position.

As illustrated, the UI 420 displayed on one side area and the fixed UI 430 displayed on the other side area may be displayed at a central position of each side area.

Meanwhile, the food storage apparatus 100 may move the UI 420 and the fixed UI 430 respectively displayed on one side and the other side area of the screen according to a user command.

5 is a first exemplary view for controlling the UI displayed in the food storage device according to an embodiment of the present invention, Figure 6 is a first example for controlling the UI displayed in the food storage device according to another embodiment of the present invention 2 is an example diagram.

The food storage apparatus 100 may move the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area of the screen in a direction corresponding to a user command.

As shown in (a) of FIG. 5 , the food storage device 100 moves the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area on the upper side according to the user's drag command. direction can be moved.

In addition, as shown in (b) of FIG. 5 , the food storage apparatus 100 according to a user's drag command, a UI 420 displayed on one side area of the screen and a fixed UI 430 displayed on the other side area of the screen. can be moved downward.

However, the present invention is not limited thereto, and the food storage device 100 displays at least one of the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area of the screen according to the user's drag command. It can be moved up or down.

For example, when a user's drag command is input while the UI 420 displayed on one side area of the screen is touched, the food storage apparatus 100 moves the UI 420 displayed on one side area of the screen to the upper or lower side. direction can be moved.

On the other hand, when the user's drag command is input while the fixed UI 430 displayed on the other side area of the screen is touched, the food storage apparatus 100 moves the fixed UI 430 displayed on the other side area of the screen to the upper or lower side. direction can be moved.

Meanwhile, the food storage device 100 may move at least one of the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area in an upward or downward direction within a preset movable range. have.

According to an embodiment, the food storage apparatus 100 may display first and second guide UIs 610 and 620 in upper and lower regions, respectively, as shown in FIG. 6A . Accordingly, when the user's drag command is input, the food storage apparatus 100 drags the UI 420 and the fixed UI 430 displayed on the side area within the movement range where the first and second guide UIs 610 and 620 are displayed. can be moved in the corresponding direction.

According to another embodiment, the food storage apparatus 100 displays, in the first area of the screen, an execution screen 410 of an application being displayed on the entire screen according to a user command, as shown in FIG. 6B . and an input UI 630 for receiving a user command for the running application may be displayed on the remaining second area. In addition, the food storage apparatus 100 may display the guide UI 610 at a boundary point between the first area where the execution screen 410 of the application is displayed and the second area where the input UI 630 is displayed. Accordingly, when a user's drag command is input, the food storage device 100 moves the UI 420 and the fixed UI 430 displayed on the side area within the movement range where the guide UI 610 is displayed in a direction corresponding to the drag command. can be moved

That is, the food storage apparatus 100 may move the UI 420 and the fixed UI 430 displayed on the side area in the first area where the execution screen 410 of the application is displayed in a direction corresponding to the drag command. .

On the other hand, the present invention is not limited thereto, and the food storage device 100 has a first guide UI ( 610 , and second guide UIs 610 and 620 may be displayed on the upper area of the first area.

In this case, when a user's drag command is input, the food storage apparatus 100 drags the UI 420 and the fixed UI 430 displayed on the side area within the movement range where the first and second guide UIs 610 and 620 are displayed. You can move it in the direction corresponding to the command.

Hereinafter, when an icon included in the UI 420 displayed on the side area of the food storage apparatus 100 is selected, an operation of displaying an execution screen corresponding to the selected icon will be described in detail.

7 is an exemplary diagram of displaying an execution screen according to selection of an icon of a UI displayed on a side area in the food storage device according to an embodiment of the present invention.

As described above, the food storage apparatus 100 may display the execution screen 410 of the application requested by the user. In addition, the food storage apparatus 100 may display a UI 420 for controlling the execution screen of the application on one side area where the execution screen 410 of the application is displayed. Here, the UI 420 displayed on one side area may include at least one icon preset in relation to the running application.

In this way, in a state where the UI 420 for controlling the execution screen of the application is displayed on the one side area where the execution screen 410 of the application is displayed, the food storage device 100 displays the UI 420 displayed on the one side area. ) may receive a selection command for one of the at least one icon included in the .

When one of the at least one icon included in the UI 420 displayed on one side area is selected, the food storage device 100 displays an execution screen corresponding to the selected icon, and displays an icon for controlling the displayed execution screen. The included sub UI 710 may be displayed.

Specifically, as shown in (a) of FIG. 7 , when one of at least one icon included in the UI 420 displayed on one side area is selected, the food storage apparatus 100 executes an execution corresponding to the selected icon. A screen 710 is displayed. In addition, the food storage apparatus 100 displays the sub UI 720 including at least one icon in a partial area of the displayed execution screen 710 .

That is, the food storage device 100 displays an execution screen 710 corresponding to the selected icon, and a sub UI including at least one icon for controlling the corresponding execution screen 710 in a portion of the displayed execution screen. 720 may be overlapped and displayed.

In addition, as shown in FIG. 7B , when one of at least one icon included in the UI 420 displayed on one side area is selected, the food storage device 100 performs an execution screen corresponding to the selected icon. 710 is displayed in the first area. In addition, the food storage apparatus 100 may display the sub UI 720 including at least one icon for controlling the execution screen 710 displayed in the first area on the second area.

Hereinafter, an operation of differently providing the input UI 630 for receiving a user command according to the type of application being executed in the aforementioned food storage device 100 will be described in detail.

8 is an exemplary diagram of providing an input UI according to an application type being executed in a food storage device according to an embodiment of the present invention.

The food storage apparatus 100 may provide an input UI 630 for receiving a user command differently according to the type of application being executed.

Specifically, the food storage apparatus 100 may display the execution screen 810 of the shopping list application as shown in FIG. 8A . In this case, when a user command for editing is input, the food storage device 100 displays the execution screen 810 of the shopping list application being executed in the first area, and is configured to receive the user command in another second area. A keyboard-related input UI 630-1 may be displayed.

Accordingly, when a user command is input through the keyboard-related input UI 630-1 displayed in the second area, the food storage apparatus 100 displays text information corresponding to the input user command in the shopping list displayed in the first area. It may be displayed on the execution screen 810 of the application.

Meanwhile, the food storage device 100 may display an execution screen 820 of the memo application as shown in FIG. 8B . In this case, when a user command for editing is input, the food storage device 100 displays the execution screen 820 of the memo application being executed in the first area and emoticons for receiving the user command in another second area. A related input UI 630 - 2 may be displayed.

Accordingly, when a user command is input through the emoticon-related input UI 630-1 displayed in the second area, the food storage device 100 displays the emoticon corresponding to the input user command in the memo application displayed in the first area. It may be displayed on the execution screen 820 .

Meanwhile, the food storage apparatus 100 may display an execution screen 830 of the whiteboard application as shown in FIG. 8C . In this case, when a user command for editing is input, the food storage device 100 displays the execution screen 830 of the whiteboard application being executed in the first area and for receiving the user command in another second area. A drawing operation related input UI 630 - 3 may be displayed.

Accordingly, when a user command is input through the drawing operation related input UI 630-3 displayed in the second area, the food storage apparatus 100 displays a work tool image corresponding to the input user command in the first area. It may be displayed on the execution screen 830 of the whiteboard application.

Hereinafter, the operation of editing the application being executed in the food storage device 100 will be described in detail.

9 is a first exemplary view of editing an application running in a food storage device according to an embodiment of the present invention.

The food storage device 100 executes a shopping list application according to a user command.

Accordingly, as shown in FIG. 9A , the food storage device 100 executes a shopping list application execution screen including a plurality of shopping lists (hereinafter referred to as first and second shopping lists) 911 and 912 . 910 may be displayed.

Thereafter, when a selection command for the second shopping list 912 among the displayed first and second shopping lists 911 and 912 is input, the food storage device 100 performs a second The execution screen 920 of the shopping list 912 is displayed. Here, the execution screen 920 of the second shopping list 912 may include an object corresponding to each of the products registered in the second shopping list 912 .

Thereafter, the food storage device 100 receives a selection command for an object 921 corresponding to a 'Shower gel' product from among a plurality of objects included in the execution screen 920 of the second shopping list 912, An editing operation of deleting the object 921 on the execution screen 920 of the second shopping list 912 is performed.

Accordingly, the food storage apparatus 100 displays the execution screen 930 of the second shopping list 912 in which the object 921 corresponding to the 'Shower gel' product is deleted, as shown in FIG. 9C . can be displayed.

Thereafter, when a selection command for the fixed UI 931 displayed on the left side area is input, the food storage apparatus 100 is edited together with the first shopping list 911 as shown in FIG. 9( d ). The execution screen 940 of the shopping list application including the second shopping list 912 ′ may be displayed.

10 is a second exemplary view of editing an application running in a food storage device according to another embodiment of the present invention.

As described above, the food storage apparatus 100 displays the execution screen 1010 of the shopping list application including the first and second shopping lists 1011 and 1012 as shown in FIG. can do.

Thereafter, when a selection command for the second shopping list 1012 among the displayed first and second shopping lists 1011 and 1012 is input, the food storage apparatus 100 as shown in FIG. The execution screen 1020 of the second shopping list 1012 is displayed. Here, the execution screen 1020 of the second shopping list 1012 may include an object corresponding to each of the products registered in the second shopping list 1012 .

Thereafter, the food storage device 100 receives a selection command for an object 1021 corresponding to a 'Shower gel' product among a plurality of objects included in the execution screen 1020 of the second shopping list 1012, as shown in FIG. As shown in (c) of 10, an execution screen 1030 of the second shopping list 1012 is displayed in the first area, and a keyboard-related input UI 1040 for receiving a user command is displayed in the second area. do.

Also, the food storage apparatus 100 may display the cursor 1031 at the point where the selection command for the object 1021 is input and the first delete icon 1032 on one side where the object 1021 is displayed.

Thereafter, when a selection command for the first delete icon 1032 located on one side of the object 1021 is input, the food storage apparatus 100 displays the object 1021 on the execution screen of the second shopping list 1012 . In step 1020, an edit operation to delete is performed.

Thereafter, the food storage device 100 displays the execution screen 1050 of the second shopping list 1012 in which the object 1021 corresponding to the 'Shower gel' product is deleted, as shown in FIG. can be displayed.

On the other hand, the food storage device 100 is an object included in the execution screen 1030 of the second shopping list 1012 through the second delete icon 1041 displayed on the keyboard-related input UI 1040 displayed in the second area. can be edited.

Specifically, the food storage device 100 receives a selection command for the second delete icon 1041 displayed on the input UI 1040 in a state where the cursor 1031 is displayed on the object 1021 corresponding to the 'Shower gel' product. When inputted, an editing operation for deleting the object 1021 may be performed according to the input selection command.

In addition, the food storage device 100 includes a second delete icon 1041 and a character icon ( When a selection command for (not shown) is input, an editing operation of deleting at least one character among a plurality of characters constituting the object 1021 and displaying a new character may be performed according to the input selection command.

Hereinafter, the execution operation of the view inside application in the food storage apparatus 100 according to the present invention will be described in detail.

11 to 15 are exemplary views illustrating an execution operation of a view inside application in a food storage device according to an embodiment of the present invention.

As shown in (a) of FIG. 11 , the food storage apparatus 100 may display an execution screen of the view inside application by executing the view inside application in response to a user request. Here, the execution screen of the view inside application may be an image 1110 of the inside of the food storage device 100 in which food is stored.

While the image 1110 photographed inside the food storage apparatus 100 is displayed, the food storage apparatus 10 selects at least one object from among a plurality of objects included in the photographed image 1110 can be input.

As illustrated, the food storage apparatus 100 may receive a selection command for an object 1111 corresponding to a cake.

When a selection command for such an object 1111 is input, the food storage apparatus 100 displays an image 1110 photographed inside the food storage apparatus 100 as shown in FIG. 11( b ). An input UI 1120 for inputting information related to the object 1111 is displayed on the displayed screen.

Here, the input UI 1120 includes a captured image 1121 obtained by capturing the selected object 1111 and a plurality of icons (hereinafter referred to as a, b, c icons) for inputting information related to the selected object 1111 ( 1122 ~ 1124) may be included.

Thereafter, the food storage apparatus 100 may perform various operations related to the selected object 1111 according to a user command input through the displayed input UI 1120 .

Specifically, the food storage apparatus 100 may edit the captured image 1121 according to a user command.

As shown in (a) of FIG. 12 , the food storage apparatus 100 may receive a user command to move outward while a guide line (not shown) displayed around the captured image 1121 is selected.

When such a user command is input, the food storage apparatus 100 enlarges and displays the captured image 1121 in an outward direction corresponding to the input user command as shown in FIG. 12B .

On the other hand, when a user command to move inward in a state in which the captured image 1121 is enlarged in the outward direction is input, the food storage device 100 reduces the captured image 1121 in the inward direction corresponding to the input user command. to display

In addition, as shown in FIG. 13A , the food storage apparatus 100 may receive a user command to move in one direction while the area in which the captured image 1121 is displayed is selected.

In this case, the food storage device 100 may display the captured image 1121 ′ moved in a direction corresponding to the user command on the screen as shown in FIG. 13B .

Meanwhile, the food storage device 100 receives a selection command for the c icon 1124 among the a, b, and c icons 1122 to 1124 included in the input UI 1120 in (b) of FIG. can

When a selection command for the c icon 1124 is input, the food storage apparatus 100 displays an editing screen 1410 for generating the tag UI 1420 for the pre-selected object 1121 .

Specifically, the food storage device 100 displays a captured image 1121 obtained by capturing the pre-selected object 1121 in the first area of the screen, as shown in FIG. 14A , and another second Display the keyboard-related input UI in the area.

Accordingly, the food storage apparatus 100 may display an emoticon or text corresponding to a user command input through the input UI displayed on the second area on the captured image 1121 displayed on the first area.

Thereafter, the food storage apparatus 100 generates a tag UI 1420 for the pre-selected object 1121 according to a user command. Thereafter, the food storage apparatus 100 superimposes the tag UI 1420 for the preselected object 1121 on the image 1110 photographed inside the food storage apparatus 100 and displays it.

In this case, the food storage apparatus 100 may display the tag UI 1420 by superimposing it on a point where the pre-selected object 1121 is located according to a preset condition.

Meanwhile, the food storage apparatus 100 may move and display the displayed tag UI 1420 overlaid on the image 1110 photographed inside the food storage apparatus 100 according to a user command.

Specifically, as shown in (a) of FIG. 15 , the food storage apparatus 100 may receive a user command for moving the tag UI 1420 for the pre-selected object 1121 to the point A.

When such a user command is input, the food storage device 100 changes the tag UI 1420 to a translucent state, and sets the tag UI 1420 ′ in the translucent state to an image of the inside of the food storage device 100 ( 1110) is superimposed and displayed.

Thereafter, as shown in (c) of FIG. 15, when the tag UI 1420' in the translucent state is moved to the point A, the food storage device 100 moves the tag UI 1420' in the translucent state to the point A. ) can be changed to the existing tag UI 1420 and displayed.

Hereinafter, an operation of registering food information in the shopping list in the food storage device 100 will be described in detail.

16 is an exemplary diagram illustrating an execution operation of a shopping list application in the food storage device according to an embodiment of the present invention.

As shown in FIG. 16 , the food storage apparatus 100 may display an execution screen 1610 of the shopping list application according to a user command.

According to an exemplary embodiment, when a selection command for a shopping list application execution related icon among icons corresponding to each of a plurality of applications is input, the food storage apparatus 100 executes the shopping list application and displays the corresponding execution screen 1610 . can be displayed.

According to another embodiment, as shown in (b) of FIG. 11 , a selection command for item b 1123 among items a, b, and c 1122 to 1124 included in the input UI 1120 is input. When done, the shopping list application may be executed and the corresponding execution screen 1610 may be displayed.

In a state in which the execution screen 1610 of the shopping list application is displayed, when a voice command uttered by the user is input, the food storage device 100 registers food information related to the voice command in the shopping list stored in the shopping list application. do.

For example, the food storage apparatus 100 may receive a voice command "Add milk" from the user. When such a voice command is input, the food storage apparatus 100 analyzes the input voice command and extracts utterance elements "Add" and "milk". Thereafter, the food storage device 100 may register food information “milk” in the shopping list based on the extracted utterance element.

17 is an exemplary diagram of interlocking a plurality of applications in the food storage device according to an embodiment of the present invention.

17 , the food storage device 100 executes a recipe application according to a user command. Here, the recipe application may be an application that provides recipes for various foods or recommends dishes suitable for a user.

In a state in which the recipe application is executed, when a user command for "Basil Pasta" food is input, the food storage device 100 provides a recipe screen 1710 for guiding a recipe for cooking "Basil Pasta" food. can do.

Also, when a user command for “Basil Pasta” food is input, the food storage device 100 may provide ingredients necessary for cooking food for “Basil Pasta”.

In addition, the food storage device 100 may register the ingredients required for cooking "Basil Pasta" in the stored shopping list of the shopping list application.

Specifically, when a user command for food "Basil Pasta" is input, the food storage device 100 stores the "Basil Pasta" food in the shopping list 1710' stored in the shopping list application as shown in the figure. can be registered.

Meanwhile, when a user command for the voice “Tomato Soup” is additionally input, the food storage device 100 may provide a recipe screen 1720 that guides a recipe for cooking “Tomato Soup” food.

Also, the food storage device 100 may provide ingredients necessary for cooking food for “Tomato Soup” according to a user command for “Tomato Soup” food.

In addition, the food storage device 100 may register the ingredients required for cooking "Tomato Soup" in the stored shopping list of the shopping list application.

Specifically, when a user command for “Tomato Soup” food is input, the food storage device 100 adds “Tomato” to the shopping list 1720 ′ in which ingredients necessary for “Basil Pasta” food are registered. You can additionally register necessary ingredients related to "Soup" food.

On the other hand, the food storage device 100 may register only the ingredients other than the ingredients stored in the food storage device 100 among the food-related ingredients requested by the user in the shopping list.

Specifically, as in the above-described example, when a user command for "Basil Pasta" food is input, the food storage device 100 refers to the food list stored in the food list application, among the ingredients required to cook "Basil Pasta" food. It is determined whether there are ingredients registered in the food list.

Here, the food list may store food information for each food stored in the food storage device 100 . Accordingly, the food storage device 100 determines whether there are ingredients registered in the food list among ingredients necessary to cook the “Basil Pasta” food with reference to the food information stored in the food list. Thereafter, the food storage device 100 may register the remaining ingredients in the shopping list except for the ingredients registered in the food list among ingredients necessary for cooking the “Basil Pasta” food.

18 is an exemplary view for purchasing food registered in a shopping list in the food storage device according to an embodiment of the present invention.

As illustrated in (a) of FIG. 18 , the food storage apparatus 100 may display an execution screen 1810 of the shopping list application according to a user command.

Here, the execution screen 1810 of the shopping list application may be a screen listing food lists registered in the shopping list.

Also, the food storage apparatus 100 may display a UI 1811 including icons a and b for controlling the execution of the shopping list application on one side area of the execution screen 1810 of the shopping list application. In addition, the food storage apparatus 100 may additionally display a fixed UI (not shown) for returning to the previous screen on the other side area of the execution screen 1810 of the shopping list application.

When the icon a included in the UI 1811 is selected while the execution screen 1810 of the shopping list application is displayed, the food storage device 100 displays the displayed execution screen ( 181), a sub UI 1820 for detailed control is displayed on one side area.

Thereafter, the food storage apparatus 100 may receive a selection command for a D icon 1821 for purchasing food among icons A to E included in the sub UI 1820 . When a selection command for the D icon 1821 is input, the food storage device 100 displays a store for selecting a store where food registered in the shopping list can be purchased, as shown in FIG. 18C . The UI 1830 is displayed.

Thereafter, when one of a plurality of stores (Store1) included in the store UI 1830 is selected, the food storage device 100 sends food information and delivery registered in the shopping list to a server (not shown) of the selected store (Store1). Sends order request information including information. Thereafter, the food storage device 100 performs payment for the requested food based on the pre-registered payment information in response to a payment request from a server (not shown) of the store (Store1).

Here, a method of performing an electronic payment between the food storage device 100 and a server (not shown) of the store (Store1) is a well-known technology, so a detailed description thereof will be omitted in the present invention. Thereafter, when the payment for the food for which the order has been requested is completed, the food storage device 100 may display a payment completion screen 1840 informing that the order has been completed, as shown in (d) of FIG. 18 .

19 to 22 are exemplary views illustrating an execution operation of a recipe application in a food storage device according to an embodiment of the present invention.

The food storage device 100 may execute a recipe application according to a user command. When such a recipe application is executed, the food storage device 100 may provide the following service through the execution screen of the executed recipe application.

According to an embodiment, the food storage apparatus 100 may provide a service of recommending suitable food to the user through the execution screen of the recipe application.

According to another embodiment, the food storage device 100 may provide a service for guiding the recipe of the food requested by the user through the execution screen of the recipe applicator.

First, in relation to the operation of providing a service for recommending food suitable for a user, the food storage apparatus 100 may display a recommendation service screen 1910 for recommending food suitable for the user as shown in FIG. 19 . .

Specifically, the food storage device 100 provides a food recommendation UI 1911 including information on food recommended for each time period in a first area of the displayed recommendation service screen 1910, and provides a food recommendation UI 1911 in the second area. A preferred food UI 1912 including information on the food selected by the user during the period may be provided, and a recipe UI 1913 including recipe information on foods recommended for the user may be provided in the third area. .

Accordingly, the user may be provided with information on food suitable for the current time or a specific time period through the food recommendation UI 1911 displayed on the first area of the recommendation service screen 1910 .

Also, the user may check the type of the recently selected food through the preferred food UI 1912 displayed on the second area of the recommendation service screen 1910 .

Also, the user may be provided with a recipe for the food to be cooked by the user through the recipe UI 1913 displayed on the third area of the recommendation service screen 1910 .

Hereinafter, an operation of providing a recipe for the food selected by the user will be described in detail.

As described above, the food storage apparatus 100 may receive a selection command for at least one of the provided recipes for each food through the recipe UI 1913 displayed on the third area of the recommendation service screen 1910 . When such a selection command is input, the food storage apparatus 100 may provide a recipe for food corresponding to the input selection command.

However, the present invention is not limited thereto, and the food storage apparatus 100 may search for and provide a recipe for food input by a user through an input window (not shown).

Specifically, as shown in FIG. 20 , the food storage device 100 displays a recipe screen 2010 that provides a recipe for the food requested by the user.

For example, the food storage apparatus 100 may display the recipe screen 2010 for "Pasta" food according to a user command.

In detail, the food storage device 100 may display a video guiding a recipe for “Pasta” food through the first area 2020 of the displayed recipe screen 2010 . In this case, the food storage apparatus 100 may display a control UI for controlling a corresponding operation on the first area 2020 in which a moving image is displayed.

In addition, the food storage apparatus 100 displays a UI related to provision of "Pasta" food recipe through the second area 2030 of the displayed recipe screen 2010, and "Pasta" food through the third area 2040 The recipe for each cooking step for cooking is displayed in text form.

Meanwhile, the UI displayed through the second area 2030 may include a “Read Aloud” icon, a “Large Text” icon, and an “Add Time” icon.

The “Read Aloud” icon is an icon for outputting the text related to cooking “Pasta” displayed in the third area as audio.

In addition, "Large Text" is an icon for adjusting the size of the "Pasta" food cooking related text displayed in the third area.

In addition, the "Add Time" icon is an icon for setting the cooking time for each step for cooking the "Pasta" food displayed in the third area.

When a video for cooking “Pasta” food is displayed through the first area 2020, the food storage device 100 shows cooking related to the video currently displayed among the recipes for each step of cooking in the form of text displayed through the third area. Mark the recipe for a step differently from the recipe for the rest of the cooking steps.

Accordingly, the user can easily check which cooking stage the currently displayed video corresponds to the recipe through the first area.

On the other hand, when the "Read Aloud" icon is selected from among the icons included in the UI displayed through the above-described second area 2030, the food storage apparatus 100 displays the "Pasta" displayed through the third area in relation to the food. The recipe for each cooking step is output through audio.

In this case, the food storage apparatus 100 may display a recipe of the cooking stage output as audio among the recipes for each cooking stage displayed through the third area differently from the recipes of the remaining cooking stages.

Accordingly, the user can easily check which cooking stage the recipe being output as audio corresponds to.

Meanwhile, the food storage apparatus 100 may perform the following operation when an "Add Time" icon is selected from among the icons included in the UI displayed through the above-described second area 2030 .

As shown in FIG. 21 , when the “Add Time” icon is selected among the icons included in the UI displayed through the above-described second area 2030, the food storage device 100 provides a video for cooking “Pasta” food. A timer UI 2110 for setting the time for each cooking step may be displayed in the first area 2020 for displaying .

Accordingly, the user may set and confirm the cooking time for each cooking step through the timer UI 2110 displayed in the first area 2020 .

Meanwhile, at least one of the recipes for each cooking stage displayed on the third area 2040 in relation to the "Pasta" food may include time information for each cooking stage.

In this case, when a selection command for time information included in a recipe is input, the food storage apparatus 100 may display the timer UI 2110 for time information included in the recipe in the first area 2020. .

Accordingly, the user may check the cooking time for each cooking step through the timer UI 2110 displayed on the first area 2020 .

Meanwhile, the food storage apparatus 100 may perform the following operation when a "Large Text" icon is selected from among the icons included in the UI displayed through the above-described second area 2030 .

22 , when the “Large Text” icon is selected among the icons included in the UI displayed through the second area 2030 , the food storage device 100 displays the display through the third area 2040 . The size of the text of the recipe for each cooking step for "Pasta" food can be enlarged and displayed.

Accordingly, the user can easily check the cooking step-by-step recipe for the "Pasta" food displayed through the food storage device 100 even when the user is far away from the food storage device 100 .

Up to now, various operations of the food storage apparatus 100 according to the present invention have been described in detail. Hereinafter, a method of controlling the food storage device 100 according to the present invention will be described in detail.

23 is a flowchart of a method for controlling a food storage apparatus according to an embodiment of the present invention.

As shown in FIG. 23 , the food storage apparatus 100 displays an execution screen of an application related to the food storage apparatus 100 ( S2310 ).

In addition, while the execution screen of the application is displayed, the food storage device 100 displays a UI including at least one icon for controlling the execution screen of the application on the side area of the execution screen of the application (S2320) .

Here, the application related to the food storage device 100 may be a view inside application that provides an image captured inside the food storage device 100 . Accordingly, the food storage apparatus 100 may display a UI for controlling the execution screen of the corresponding image in the side area of the image captured inside the food storage apparatus 100 .

According to an additional aspect of the present invention, the food storage apparatus 100 may further display a guide UI for guiding the movable range of the UI displayed on the side area of the execution screen of the application.

Meanwhile, when one of at least one icon included in the UI displayed on the side area is selected, the food storage apparatus 100 displays an execution screen corresponding to the selected icon. Also, the food storage apparatus 100 may display a sub UI including an icon for controlling the execution screen in a side area of the execution screen corresponding to the selected icon.

Meanwhile, the food storage apparatus 100 determines whether a selection command for an object included in the displayed image is input while an image photographed inside the food storage apparatus 100 is displayed ( S2330 ).

As a result of the determination, if it is determined that one of the plurality of objects included in the displayed image is selected, the food storage apparatus 100 displays an input UI for inputting information related to the selected object (S2340).

Thereafter, the food storage apparatus 100 determines whether a first user command is input through the displayed input UI, and when it is determined that the first user command is input, generates and displays a tag UI (S2340, S2350) .

Meanwhile, when it is determined that another user command is input through the displayed input UI, the food storage device 100 registers food information in the food list or the shopping list (S2360).

Specifically, when a user command for selecting a first icon from among a plurality of icons included in the input UI is input, the food storage apparatus 100 displays a memo UI for inputting information related to the selected object. Thereafter, when a user command is input through the displayed memo UI, the food storage apparatus 100 generates a tag UI including a memo corresponding to the input user command. Thereafter, the food storage apparatus 100 superimposes the corresponding tag UI on the image photographed inside the food storage apparatus 100 and displays it.

Meanwhile, when a selection command for the displayed tag UI is input, the food storage apparatus 100 may display a memo UI for inputting information related to an object corresponding to the selected tag UI.

On the other hand, when a user command for selecting a second icon from among a plurality of icons included in the input UI is input, the food storage device 100 provides a food list application for providing food information for each food stored in the food storage device 100 . run

Thereafter, when food information related to the selected object is input, the food storage device 100 may register the food information input in relation to the preselected object in the food list stored in the executed food list application. Here, the food list may be information for providing information on food stored in the food storage device 100 .

Meanwhile, when a user command for selecting a third icon from among a plurality of icons included in the input UI is input, the food storage apparatus 100 executes the shopping list application.

Thereafter, when food information related to a pre-selected object is input, the food storage device 100 may register the corresponding food information in the shopping list stored in the executed shopping list application.

According to an additional aspect of the present invention, the food storage device 100 executes a shopping list application when a user's voice command for food purchase is input. Thereafter, the food storage device 100 may register food information related to the voice command written in the shopping list stored in the executed shopping list application.

Meanwhile, the food storage device 100 may execute a recipe application for guiding cooking for each dish according to a user command. When a user command for a specific dish is input while the recipe application is running, the food storage apparatus 100 may display material information for the corresponding dish.

At this time, the food storage device 100 is based on the food list stored in the food list application that provides food information on the food stored in the food storage device 100, the food storage device 100 among the ingredients for cooking requested by the user. The food-related ingredients and the rest of the ingredients can be displayed differently.

The process performed according to an embodiment of the present invention may be stored in a non-transitory readable medium in the form of a program, which stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc. , means a medium that can be read by a device. Specifically, the above-described various applications or programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: food storage device 110: display unit
120: processor 130: input unit
140: communication unit 150: cold air supply unit
160: photographing unit 170: sensing unit
180: audio output unit 190: storage unit

Claims (20)

In the food storage device,
a display unit for displaying an execution screen of an application related to the food storage device; and
a processor for controlling the display unit to display a UI including at least one icon for controlling the execution screen of the application on the application execution screen area while the execution screen of the application is displayed;
The application provides an image taken inside the food storage device,
The processor is
Controls the display unit to display the UI on the image taken inside the food storage device,
When one of the plurality of objects included in the photographed image is selected, the display unit is controlled to display an input UI for inputting information related to the selected object,
When the first icon included in the input UI is selected, a memo UI for inputting information related to the object is displayed,
When a user input for inputting a memo is received through the memo UI, a tag UI including a memo corresponding to the user input is generated and the display unit is controlled to display the superimposed on the photographed image. storage device. The method of claim 1,
The processor is
When one of the at least one icon is selected, an execution screen corresponding to the selected icon is displayed, and the display unit is controlled to display a sub UI including an icon for controlling the displayed execution screen. food storage device. The method of claim 1,
The processor is
Food storage device, characterized in that for controlling the display unit to further display a guide UI for guiding the movable range of the UI. delete delete The method of claim 1,
The processor is
When the tag UI is selected, the memo UI for inputting information related to an object corresponding to the selected tag UI is displayed again. The method of claim 1,
The processor is
When the second icon included in the input UI is selected, a food list application for providing food information for each food stored in the food storage device is executed,
When food information related to the object is input, the food storage device according to claim 1 , wherein the input food information is registered in a food list stored in the executed food list application. The method of claim 1,
The processor is
When the third icon included in the input UI is selected, a shopping list application for purchasing food is executed,
When food information related to the object is input, the food storage device according to claim 1, wherein the input food information is registered in a shopping list stored in the shopping list application. The method of claim 1,
The processor is
When a voice command for food purchase is input, a shopping list application is executed, and food information related to the voice command is registered in a shopping list stored in the executed shopping list application. The method of claim 1,
The processor is
When a user input for a specific dish is received while the recipe application for cooking guidance for each dish is executed, the ingredient information for the dish is displayed,
Based on the food list stored in the food list application that provides food information for the food stored in the food storage device, the food-related ingredients and the remaining ingredients in the food storage device are displayed differently from among the displayed ingredients. Food storage device, characterized in that for controlling the display unit. A method for controlling a food storage device, comprising:
displaying an execution screen of an application related to the food storage device; and
Displaying a UI including at least one icon for controlling the execution screen of the application on the application execution screen area while the execution screen of the application is displayed;
The application provides an image taken inside the food storage device,
The displaying step is
Characterized in displaying the UI on the image taken inside the food storage device,
displaying an input UI for inputting information related to the selected object when one of a plurality of objects included in the photographed image is selected;
Displaying the tag UI according to the user input received through the input UI; further comprising,
Displaying the tag UI comprises:
displaying a memo UI for inputting information related to the selected object when a first icon included in the input UI is selected;
generating a tag UI including a memo corresponding to the user input when a user input for inputting a memo is received through the memo UI; and
displaying the generated tag UI by superimposing it on the captured image;
Control method comprising a. 12. The method of claim 11,
The displaying step is
When one of the at least one icon is selected, an execution screen corresponding to the selected icon is displayed,
The displaying step is
A control method comprising displaying a sub UI including an icon for controlling the displayed execution screen. 12. The method of claim 11,
displaying a guide UI guiding a movable range of the UI;
Control method, characterized in that it further comprises. delete delete 12. The method of claim 11,
Displaying the tag UI comprises:
When the tag UI is selected, the memo UI for inputting information related to an object corresponding to the selected tag UI is displayed again. 12. The method of claim 11,
Further comprising; registering information on food stored in the food storage device according to the user input received through the input UI;
The registration step is
executing a food list application for providing food information for each food stored in the food storage device when a second icon included in the input UI is selected; and
When food information related to the object is input, registering the input food information in the food list stored in the food list application;
The food list is
Control method, characterized in that for providing information about the food stored in the food storage device. 12. The method of claim 11,
Further comprising; according to the user input received through the input UI, registering information for food purchase;
The registration step is
executing a shopping list application when a third icon included in the input UI is selected; and
when food information related to the object is input, registering the input food information in the shopping list stored in the shopping list application;
Control method comprising a. 12. The method of claim 11,
Further comprising; registering food information;
The registration step is
When a voice command for purchasing food is input, a shopping list application is executed, and food information related to the voice command is registered in a shopping list stored in the executed shopping list application. 12. The method of claim 11,
The displaying step is
When a recipe application for cooking guidance for each dish is executed, when a user input for a specific dish is received, the ingredient information for the dish is displayed,
Based on the food list stored in the food list application that provides food information on the food stored in the food storage device, the food-related ingredients and the remaining ingredients in the food storage device among the displayed ingredients are displayed differently. Characterized control method.

Images