KR102018639B1 - Food storage apparatus and method for thereof - Google Patents

Abstract

A food storage device and a control method thereof are disclosed. The food storage device according to the present invention executes an application including a display unit displaying an execution screen of an application related to the food storage device and a UI including at least one icon for controlling the execution screen of the application while the execution screen of the application is displayed. And a processor for controlling the display unit to be displayed on a side area of the screen, wherein an application related to a food storage device is a view inside application that provides an image of the inside of the food storage device, and the processor is an image of the inside of the food storage device. The display unit is controlled to display a UI on the screen. Accordingly, the food storage device may provide a variety of services in the related art, and may provide a UI for executing a service in a form that a user can easily use quickly.

Description

Food storage apparatus and method for controlling the same

The present invention relates to a food storage device and a control method thereof, and more particularly, to a food storage device and a control method for providing a variety of UI environment through the food storage device.

Due to recent technological developments, a food storage device such as a smart refrigerator can provide information related to food stored in the food storage device.

In addition, the food storage device may provide various contents by communicating with an external device or an external server.

For example, the food storage device provides a storage state of the food stored in the food storage device, cooking information using the stored food, or an external display through a display screen attached to the front of the door that opens and closes the storage room for storing the food. It provides only services such as playing content received from the server.

That is, the conventional food storage device provides a somewhat limited service using information input from the user, information detected in the food storage device, data received from the outside, and the like.

Meanwhile, the food storage device may display the UI through a display screen and provide the above-described service according to a user's selection command for the displayed UI.

The UI for providing such a service is disposed at the top or bottom of the display screen or is disposed at the center of the display screen and displayed.

When the UI for providing the aforementioned service is disposed at the top or bottom of the display screen, a specific user (for example, a user with a large or small key or a disabled person) may not easily manipulate the UI displayed on the display screen.

In addition, when the UI is disposed at the center of the display screen, the user may not be comfortable viewing content such as an execution screen or a video of various applications displayed through the display screen by the UI displayed at the center of the display screen. There is a problem that needs to be done.

The present invention has been made in accordance with the above-described needs, an object of the present invention is to provide a more diverse service using a variety of information collected or input in the food storage device.

Furthermore, an object of the present invention is to provide a UI for service execution in a form that a user can easily use.

Food storage device according to an embodiment of the present invention for achieving the above object is a display unit for displaying the execution screen of the application associated with the food storage device and the execution screen of the application while the execution screen of the application is displayed And a processor configured to control the display unit to display a UI including at least one icon for controlling the screen in a side area of the application execution screen, wherein the application provides an image of the inside of the food storage device. The processor controls the display unit to display the UI on an image photographed inside the food storage device.

If one of the at least one icon is selected, the processor displays the execution screen corresponding to the selected icon and displays the sub UI including an icon for controlling the displayed execution screen. Can be controlled.

In addition, the processor may control the display unit to further display a guide UI for guiding the movable range of the UI.

When one of a plurality of objects included in the captured image is selected, the processor may control the display unit to display an input UI for inputting information related to the selected object.

In addition, when a first icon included in the input UI is selected, the processor displays a memo UI for inputting information related to the object, and when a user command is input through the memo UI, the processor corresponds to the user command. The display unit may be controlled to generate a tag UI including a memo, and display the superimposed image on the photographed image.

When the tag UI is selected, the processor may again display the memo UI for inputting information related to an object corresponding to the selected tag UI.

In addition, when the second icon included in the input UI is selected, the processor executes a food list application for providing food information for each food stored in the food storage device, and when food information related to the object is input, The input food information may be registered in a food list stored in the executed food list application.

When the third icon included in the input UI is selected, the processor executes a shopping list application for food purchase, and when food information related to the object is input, the processor displays the shopping list stored in the shopping list application. Input food information can be registered.

In addition, when a voice command for food purchase is input, the processor may execute a shopping list application and register food information related to the voice command in a shopping list stored in the executed shopping list application.

The processor may display material information for the dish when a user command for a particular dish is input in a state in which a recipe application for cooking guidance is executed, and the processor may display information about the food stored in the food storage device. The display unit may be controlled to display and display different food-related materials in the food storage device and the remaining materials based on the food list stored in the food list application for providing food information.

On the other hand, according to another embodiment of the present invention, the control method of the food storage device, displaying the execution screen of the application associated with the food storage device and the execution screen of the application while the execution screen of the application is displayed; And displaying a UI including at least one icon for controlling in a side area of the application execution screen, wherein the application provides an image of the inside of the food storage device and displays the image in the side area. The UI is displayed on an image photographed inside the food storage device.

The displaying may include displaying an execution screen corresponding to the selected icon when one of the at least one icon is selected, and displaying on the side area may include an icon for controlling the displayed execution screen. It may display a sub UI including a.

The method may further include displaying a guide UI for guiding the movable range of the UI.

If one of a plurality of objects included in the captured image is selected, the method may further include displaying an input UI for inputting information related to the selected object.

The method may further include displaying a tag UI according to a user command input through the input UI. The displaying of the tag UI may include selecting the selected object when a first icon included in the input UI is selected. Displaying a memo UI for inputting information associated with the information; when a user command is input through the memo UI, generating a tag UI including a memo corresponding to the user command; and photographing the generated tag UI. And overlaying the image on the image.

In the displaying of the tag UI, when the tag UI is selected, the memo UI for inputting information related to an object corresponding to the selected tag UI may be displayed again.

The method may further include registering information on the food stored in the food storage device according to the user command input through the input UI, wherein the registering may include selecting a second icon included in the input UI. Executing a food list application for providing food information for each food stored in the food storage device; and if food information related to the object is input, registering the input food information in the food list stored in the food list application. Including the step, the food list, may provide information about the food stored in the food storage device.

The method may further include registering information for food purchase according to a user command input through the input UI. The registering may include a shopping list application when a third icon included in the input UI is selected. And executing food information related to the object, registering the input food information in the shopping list stored in the shopping list application.

The method may further include registering food information. The registering may include executing a shopping list application when a voice command for food purchase is input and executing the voice command on the shopping list stored in the executed shopping list application. Food information related to the registration can be registered.

And, in the displaying step, when a recipe application for cooking guide for each cooking is executed, if a user command for a particular dish is input, it displays the material information for the cooking, the food stored in the food storage device Based on the food list stored in the food list application that provides food information for the food, the food-related material in the food storage device and the remaining materials may be displayed differently.

As described above, the food storage device according to the present invention can provide more various services in the related art, and can provide a UI for executing a service in a form that a user can easily use quickly.

1 is an exemplary view of a food storage device according to an embodiment of the present invention,
2 is a schematic block diagram of a food storage device according to an embodiment of the present invention;
3 is a detailed block diagram of a food storage device according to an embodiment of the present invention;
4 is an exemplary view of a UI displayed in a food storage device according to an embodiment of the present invention;
5 is a first exemplifying diagram for controlling a UI displayed in a food storage device according to an embodiment of the present invention;
6 is a second exemplary view of controlling a UI displayed in a food storage device according to another embodiment of the present invention;
7 is an exemplary view of displaying an execution screen according to selection of an icon of a UI displayed in a side area in a food storage device according to an embodiment of the present invention;
8 is an exemplary view of providing an input UI according to an application type running in a food storage device according to one embodiment of the present invention;
9 is a first exemplary diagram of editing an application running in a food storage device according to an embodiment of the present invention;
10 is a second example of editing an application running in a food storage device according to another embodiment of the present invention;
11 to 15 are exemplary views illustrating an execution operation of a view inside application in a food storage device according to an embodiment of the present invention;
16 is an exemplary diagram illustrating an execution operation of a shopping list application in a food storage device according to one embodiment of the present invention;
17 is an exemplary view of operating in conjunction with a plurality of applications in the food storage device according to an embodiment of the present invention,
18 is an exemplary diagram for purchasing a food registered in a shopping list in a food storage device according to an embodiment of the present invention;
19 to 22 are exemplary diagrams illustrating an execution operation of a recipe application in a food storage device according to one embodiment of the present invention;
23 is a flowchart illustrating a control method of a food storage device according to an embodiment of the present invention.

Terms used herein will be briefly described and the present invention will be described in detail.

The terminology used in the embodiments of the present invention was selected as widely used as possible terms in consideration of functions in the present invention, but may vary according to the intention or precedent of a person skilled in the art, the emergence of new technologies, etc. . In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

Embodiments of the present invention may be variously modified and have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the scope to the specific embodiment, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and technical scope of the invention. In describing the embodiments, when it is determined that the detailed description of the related known technology may obscure the gist, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from another.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "consist" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described in the specification, and one or more other It is to be understood that the present invention does not exclude the possibility of the presence or the addition of features, numbers, steps, operations, components, parts, or a combination thereof.

In an embodiment of the present invention, the module or unit performs at least one function or operation, and may be implemented in hardware or software, or in a combination of hardware and software. In addition, the plurality of modules or the plurality of units may be integrated into at least one module except for the modules or units that need to be implemented with specific hardware, and are implemented as at least one processor (not shown). Can be.

In an embodiment of the present invention, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element in between. Also includes. In addition, not only physical connection but also wireless connection is included. In addition, when a part is said to "include" a certain component, this means that it may further include other components, except to exclude other components unless otherwise stated.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

1 is an exemplary view of a food storage device according to an embodiment of the present invention.

As illustrated in FIG. 1, the food storage device 100 may be a device capable of storing food such that the food is not altered, such as a smart refrigerator.

The food storage device 100 displays an execution screen for various applications related to food or each application through the display screen 20 attached to the front of the door 10 that opens and closes a storage room for storing food. Provide a UI for execution.

Here, the application may be an application that provides an image of the inside of the food storage device 100. That is, the application related to food may be a view inside application for providing an image of the inside of the food storage device 100 in which food is stored, an application for purchasing food, an application for providing recipe for each dish, and the like.

In addition, the food storage device 100 displays an execution screen for various applications such as life information, content, schedule management, and memo through the display screen 20 or includes at least one icon for executing each application. UI can be provided.

Meanwhile, the food storage device 100 may display a UI including at least one icon for executing an application or controlling an execution screen of the application on the side of the display screen 20.

As such, as the UI including at least one icon for executing the application or controlling the execution screen of the application is displayed on the side of the display screen 20, the execution screen of the application displayed on the display screen 20 corresponds to the corresponding screen. You can improve the problem that is hindered by the UI.

In addition, as a UI including at least one icon for executing an application or controlling an execution screen of the application is displayed on the side of the display screen 20, all users may use the UI displayed on the display screen 20. Can be.

Meanwhile, the food storage device 100 may move the UI including at least one icon displayed on the side area of the display screen 20 in a direction corresponding to the user command.

For example, the food storage device 100 may move the UI including at least one icon displayed on the side area of the display screen 20 in an upward or downward direction according to a user command.

So far, the food storage device 100 according to the present invention has been schematically described. Hereinafter, the configuration of the food storage device 100 according to the present invention will be described in detail.

2 is a schematic block diagram of a food storage device according to an embodiment of the present invention.

As shown in FIG. 2, the food storage device 100 includes a display 110 and a processor 120.

The display 110 displays an execution screen of an application related to the food storage device 100.

Here, the application related to the food storage device 100 may be a view inside application for providing an image of the inside of the food storage device 100 in which food is stored. However, the present invention is not limited thereto, and the application related to the food storage device 100 may include an application for purchasing a food and an application for providing a recipe for each dish.

In addition, the application provided by the food storage device 100 may include life information, content, schedule management, memo-related applications.

The processor 120 displays a UI including at least one icon for controlling the execution screen of the corresponding application in a side area of the execution screen of the application being displayed while the execution screen of the application is displayed on the display 110. The display unit 110 is controlled.

Accordingly, the display 110 may display a UI including at least one icon for controlling the execution screen of the application in the side area of the execution screen of the application being displayed.

Meanwhile, when one of at least one icon included in the UI displayed in the side area of the execution screen of the application is selected, the processor 120 displays an execution screen corresponding to the selected icon and controls the displayed execution screen. The display 110 is controlled to display a sub UI including an icon.

In this case, the processor 120 may control the display 110 to be displayed on the side area of the execution screen on which the sub UI is displayed.

According to an embodiment of the present disclosure, the processor 120 may control the display 110 to display the sub UI by overlapping the sub UI on the side area of the displayed execution screen.

According to another embodiment, the processor 120 may control the display 110 to display the sub UI in the side area and the execution screen in the remaining area.

According to an additional aspect of the present invention, the processor 120 may control the display 110 to further display a guide UI for guiding the movable range of the UI displayed in the side area.

However, the present invention is not limited thereto, and the processor 120 may control the display 110 to further display a guide UI for guiding the movable range of the sub UI displayed in the side region.

In detail, the processor 120 may input a user command and control the display 110 to move and display the UI or sub UI displayed in the above-described side area in a direction corresponding to the input user command.

According to an exemplary embodiment, when a drag command of a user is input, the processor 120 displays the display 110 to move and display the UI or sub UI displayed in the side area in an upper direction or a lower direction corresponding to the input drag command. Can be controlled.

In this case, when the guide UI is displayed, the processor 120 may control the display 110 to move and display the UI or sub UI displayed in the side area in a direction corresponding to the user command to the point where the guide UI is displayed.

Meanwhile, as described above, when the view inside application is executed, the processor 120 may control the display 110 to display an image of the inside of the food storage device 100 in which food is stored.

Therefore, the display 110 may display an image of the inside of the food storage device 100 in which food is stored.

Meanwhile, when one of the plurality of objects included in the captured image is selected, the processor 120 controls the display 110 to display an input UI for inputting information related to the selected object.

Accordingly, the display 110 may display an input UI including a plurality of icons around the selected object.

Accordingly, the processor 120 performs various operations according to a user's selection command for an icon included in the displayed input UI.

According to an exemplary embodiment, when a user command for a first icon of a plurality of icons included in the displayed input UI is input, the processor 120 displays the memo UI for inputting information related to a selected object. ).

Then, when a user command is input through the displayed memo UI, the processor 120 generates a tag UI including a memo corresponding to the input user command. Thereafter, the processor 120 controls the display unit 110 to display the tag UI on the image captured by the inside of the food storage apparatus 100 in which the food is stored.

Accordingly, the display 110 may display the tag UI by overlaying the tag UI on an image of the inside of the food storage device 100 in which the food is stored.

Meanwhile, when the selection command for the tag UI is input while the tag UI is displayed, the processor 120 displays the display unit 110 to display the memo UI for inputting information related to an object corresponding to the selected tag UI. Can be controlled.

On the other hand, when the selection command for the second icon of the plurality of icons included in the input UI is input, the processor 120 executes a food list application for providing food information for each food stored in the food storage device 10. Accordingly, the display 110 displays an execution screen of the food list application.

As such, when the food information related to the pre-selected object is input while the execution screen of the food application is displayed, the processor 120 registers the previously input food information in the food list stored in the executed food list application.

Meanwhile, when a selection command for a third icon of a plurality of icons included in the input UI is input, the processor 120 executes a shopping list application for food purchase. Accordingly, the display 110 displays an execution screen of the shopping list application.

As such, when the food information related to the pre-selected object is input while the execution screen of the shopping list application is displayed, the processor 120 registers the previously input food information in the shopping list stored in the executed shopping list application.

According to a further aspect of the present invention, the processor 120 may execute a shopping list application when a voice command for food purchase is input. Subsequently, the processor 120 may register food information related to a voice command previously input to the shopping list stored in the executed shopping list application.

However, the present invention is not limited thereto, and when the voice command for the food stored in the food storage device 100 is input, the processor 120 executes a food list application and stores the food list in the executed food list application. The food information related to the input voice command may be registered.

According to an additional aspect of the present disclosure, the processor 120 may execute a recipe application for cooking guide according to a user according to a user command. Thereafter, when a user command for a particular dish is input, the processor 120 controls the display 110 to display material information for the dish.

Accordingly, the display 110 may display the material information on the dish requested by the user.

On the other hand, the processor 120 is located in the food storage device 100 of the material displayed on the screen based on the food list stored in the food list application for providing food information about the food stored in the food storage device 100 The display 110 may be controlled to display and display the food-related material and the remaining materials differently.

Accordingly, the display 110 may display material information in which the material stored in the food storage device 100 and the remaining materials are different from among the ingredients for cooking requested by the user.

However, the present invention is not limited thereto, and the processor 120 may provide the food among the ingredients of the food requested by the user based on the food list stored in the food list application for providing food information on the food stored in the food storage device 100. The display 110 may be controlled to display information on the remaining materials except for the food stored in the storage device 100.

Accordingly, the display 110 may display material information on the remaining materials other than the materials stored in the food storage device 100 among the ingredients for cooking requested by the user.

3 is a detailed block diagram of a food storage device according to an embodiment of the present invention.

As shown in FIG. 3, the food storage device 100 includes the input unit 130, the communication unit 140, the cold air supply unit 150, and the photographing unit 160 in addition to the above-described display unit 110 and the processor 120. The sensor 170 may further include an audio output unit 180 and a storage unit 190.

The input unit 130 receives various user commands. The input unit 130 may include at least one of an operation unit, a touch input unit, a user input unit, and a microphone.

The operation unit may be implemented as a keypad including various function keys, numeric keys, special keys, and character keys. The touch input unit may include a display unit when the display unit 110 is implemented as a touch screen. It may be implemented as a touch pad forming a rare layer structure with the 110. In this case, the touch input unit may receive a touch command for an icon included in various UIs displayed through the display unit 110 described above.

The user input unit receives an IR signal or an RF signal from a remote control device (not shown) that controls the food storage device 100, and the microphone receives a voice command of the user.

The communication unit 140 performs data communication with a web server (not shown) providing content, a user terminal device (not shown) such as a pre-registered smart phone, and a server (not shown) of a store selling various products.

The communication unit 140 may be a wireless communication module such as a short range communication module or a wireless LAN module, and a wired line such as a high-definition multimedia interface (HDMI), a universal serial bus (USB), or an Institute of Electrical and Eletronics Engineers (IEEE) 1394. It may include a connector including at least one of the communication module.

The short range communication module is a component that wirelessly performs short range communication between the food storage device 100 and a user terminal device (not shown). The short range communication module may include at least one of a Bluetooth module, an infrared data association (IrDA) module, a Near Field Communication (NFC) module, a Wi-Fi (WIFI) module, and a Zigbee module. .

In addition, the wireless communication module is a module connected to an external network and performing communication according to a wireless communication protocol such as IEEE. In addition, the wireless communication module further includes a mobile communication module for accessing and communicating with the mobile communication network according to various mobile communication standards such as 3rd generation (3G), 3rd generation partnership project (3GPP), long term evolution (LTE), and the like. You may.

As such, the communication unit 140 may be implemented by the various short-range communication schemes described above, and may employ other communication techniques not mentioned herein as needed.

Meanwhile, the connector is configured to provide an interface with various source devices such as USB 2.0, USB 3.0, HDMI, and IEEE 1394. Such a connector may receive content data transmitted from a web server (not shown) through a wired cable connected to the connector. In addition, the connector may receive power from a power source through a wired cable physically connected to the connector.

The cold air supply unit 150 is configured to supply cold air to maintain a predetermined temperature in a storage room for storing food in the food storage device 100. In particular, when different temperatures are set for each region, the cold air supply unit 160 may supply cold air of different intensities to each region so as to be maintained at a temperature set for each region.

The photographing unit 160 photographs the inside of the food storage device 100, and the sensing unit 170 detects whether the user is close to the food storage device 100, or detects the temperature at which the food storage device 100 is emitted. Can be. In addition, the sensing unit 170 may measure a sensing value for determining a state of the food stored in the food storage device 100.

The audio output unit 180 outputs audio data included in the content displayed through the display 110 or recipe information for each dish provided through a recipe application to be described later in an audible form.

The storage unit 190 may store list related information stored in various applications to be described later. In addition, the storage unit 190 may further store various operation programs for controlling the operation of the food storage device 100. Here, when the food storage device 100 is turned on (Turn On), the operation program may be a program that is read from the storage unit 190, compiled to operate each component of the food storage device 100.

Meanwhile, the aforementioned processor 120 may include a CPU 121, a GPU 122, a ROM 123, and a RAM 124, and include the CPU 121, the GPU 122, the ROM 123, and the RAM. 124 may be connected to each other via a bus 125.

The CPU 121 accesses the storage 190 and performs booting using an OS stored in the storage 190. In addition, the CPU 121 performs various operations using various programs, contents, data, and the like stored in the storage 190.

The GPU 122 generates a display screen including various objects such as icons, images, texts, and the like. Specifically, the GPU 122 calculates attribute values such as coordinate values, shapes, sizes, colors, and the like in which each object is to be displayed according to the layout of the screen based on the received control command, and calculates objects based on the associated attribute values. Create a display screen with various layouts to include.

The ROM 123 stores a command set for system booting. When the turn on command is input and the power is supplied, the CPU 121 copies the OS stored in the storage 140 to the RAM 124 according to the command stored in the ROM 123, and executes the OS to boot the system. . When the booting is completed, the CPU 121 copies various programs stored in the storage 190 to the RAM 124 and executes the programs copied to the RAM 124 to perform various operations.

The processor 120 may be combined with each of the above-described components and implemented as a single-chip system (System-on-a-chip or System on chip, SOC, SoC).

Meanwhile, the above-described operation of the processor 120 may be performed by a program stored in the storage 190. The storage unit 190 may include a memory card (eg, an SD card, a memory stick), a nonvolatile memory, a volatile memory, and a hard disk that may be attached to or detached from the ROM 123, the RAM 124, or the food storage device 100. At least one of a drive (HDD) or a solid state drive (SSD) may be implemented.

Up to now, each configuration constituting the food storage device 100 according to the present invention has been described in detail. Hereinafter, the operation of the food storage device 100 according to the present invention will be described in detail.

4 is an exemplary view of a UI displayed in a food storage device according to an embodiment of the present invention.

As illustrated in FIG. 4, the food storage device 100 may display an execution screen 410 of an application requested by a user. In addition, the food storage device 100 may display a UI 420 for controlling the execution screen of the corresponding application in one side area where the execution screen 410 of the application is displayed. Here, the UI 420 displayed in one side area may include at least one icon preset in relation to the running application.

For example, if the running application is a view-in-side application, the UI 420 displayed in one side area is a first icon for returning to a previous execution screen in the view-in-side application, the current view of the view-in-side application. A second icon for editing or controlling the execution screen and a third icon for providing a sub UI for additionally editing or controlling the execution screen of the running view inside application may be included.

Meanwhile, when the running application is a recipe application, the UI 420 displayed in one side area may include an icon for cooking search.

If the running application is a food list application or a shopping list application, the UI 420 displayed in one side area may register information about food stored in the food storage device 100 or register information about food to be purchased. And a second icon for providing a sub UI for additionally editing or controlling an execution screen of a running food list or shopping list application.

Meanwhile, the food storage device 100 may further include a fixed UI 430 set to be always displayed on the other side area where the execution screen 410 of the application is displayed. Here, the fixed UI 430 may be, for example, a UI for returning to the previous screen or returning to the initial screen.

As such, the UI 420 displayed on one side area and the fixed UI 430 displayed on the other side area may be displayed at a predetermined position.

As shown, the UI 420 displayed on one side area and the fixed UI 430 displayed on the other side area may be displayed at the center position of each side area.

Meanwhile, the food storage device 100 may move the UI 420 and the fixed UI 430 displayed on one side and the other side area of the screen, respectively, according to a user command.

FIG. 5 is a first exemplary view of controlling a UI displayed in a food storage device according to an embodiment of the present invention, and FIG. 6 is a diagram of controlling a UI displayed in a food storage device according to another embodiment of the present invention. 2 is an illustration.

The food storage device 100 may move the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area in a direction corresponding to a user command.

As shown in (a) of FIG. 5, the food storage device 100 may move the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area according to a user's drag command. Can be moved in a direction.

In addition, as shown in (b) of FIG. 5, the food storage device 100 according to the user's drag command, the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area. Can be moved downward.

However, the present invention is not limited thereto, and the food storage device 100 may control at least one of the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area according to a user's drag command. It can be moved upward or downward.

For example, when a user drag command is input while the UI 420 displayed on one side area of the screen is touched, the food storage device 100 may move the UI 420 displayed on one side area of the screen up or down. Can be moved in a direction.

On the other hand, when the drag command of the user is input while the fixed UI 430 displayed on the other side area of the screen is touched, the food storage device 100 moves the fixed UI 430 displayed on the other side area of the screen up or down. Can be moved in a direction.

Meanwhile, the food storage device 100 may move at least one of the UI 420 displayed on one side area of the screen and the fixed UI 430 displayed on the other side area within the preset movable range in an upward or downward direction. have.

According to an embodiment, the food storage device 100 may display the first and second guide UIs 610 and 620 in the upper and lower regions, respectively, as shown in FIG. 6A. Therefore, when the user drag command is input, the food storage device 100 drags the UI 420 and the fixed UI 430 displayed in the side area within the moving range where the first and second guide UIs 610 and 620 are displayed. It can be moved in the direction corresponding to.

According to another embodiment, the food storage device 100 displays the execution screen 410 of the application being displayed on the entire screen according to a user command in the first area of the screen, as shown in FIG. In addition, the input UI 630 for receiving a user command with respect to the running application may be displayed in the remaining second area. In addition, the food storage device 100 may display the guide UI 610 at a boundary point between the first area in which the execution screen 410 of the application is displayed and the second area in which the input UI 630 is displayed. Therefore, when the user inputs a drag command, the food storage device 100 moves the UI 420 and the fixed UI 430 displayed in the side area in a direction corresponding to the drag command within the moving range where the guide UI 610 is displayed. You can move it.

That is, the food storage device 100 may move the UI 420 and the fixed UI 430 displayed in the side area in a direction corresponding to the drag command within the first area in which the execution screen 410 of the application is displayed. .

Meanwhile, the present invention is not limited thereto, and the food storage device 100 may include a first guide UI in a boundary area between a first area in which the execution screen 410 of the application is displayed and a second area in which the input UI 630 is displayed. 610 may be displayed and second guide UIs 610 and 620 may be displayed in an upper region of the first region.

In this case, when the user drag command is input, the food storage device 100 drags the UI 420 and the fixed UI 430 displayed in the side area within the moving range where the first and second guide UIs 610 and 620 are displayed. It can be moved in the direction corresponding to the command.

Hereinafter, when the icon included in the UI 420 displayed in the side area in the food storage device 100 is selected, an operation of displaying an execution screen corresponding to the selected icon will be described in detail.

FIG. 7 is an exemplary view of displaying an execution screen according to selection of an icon of a UI displayed in a side area in a food storage device according to an embodiment of the present invention.

As described above, the food storage device 100 may display the execution screen 410 of the application requested by the user. In addition, the food storage device 100 may display a UI 420 for controlling the execution screen of the corresponding application in one side area where the execution screen 410 of the application is displayed. Here, the UI 420 displayed in one side area may include at least one icon preset in relation to the running application.

As such, while the UI 420 for controlling the execution screen of the application is displayed on one side area on which the execution screen 410 of the application is displayed, the food storage device 100 may display the UI 420 displayed on one side area. A selection command for one of the at least one icon included in) may be input.

When one of at least one icon included in the UI 420 displayed in one side area is selected, the food storage device 100 displays an execution screen corresponding to the selected icon, and displays an icon for controlling the displayed execution screen. The sub UI 710 may be displayed.

Specifically, as shown in (a) of FIG. 7, when the food storage device 100 selects one of at least one icon included in the UI 420 displayed on one side area, the food storage device 100 executes the execution corresponding to the selected icon. Display screen 710. In addition, the food storage device 100 displays a sub UI 720 including at least one icon on a portion of the displayed execution screen 710.

That is, the food storage device 100 displays the execution screen 710 corresponding to the selected icon and includes at least one icon for controlling the execution screen 710 on a portion of the displayed execution screen. 720 can be superimposed and displayed.

In addition, as illustrated in FIG. 7B, when the food storage device 100 selects one of at least one icon included in the UI 420 displayed in one side area, an execution screen corresponding to the selected icon is displayed. 710 is displayed in the first area. In addition, the food storage device 100 may display the sub UI 720 including at least one icon for controlling the execution screen 710 displayed in the first area in the second area.

Hereinafter, an operation of differently providing an input UI 630 for receiving a user command according to the type of an application executed in the above-described food storage device 100 will be described in detail.

8 is an exemplary diagram for providing an input UI according to an application type running in a food storage device according to one embodiment of the present invention.

The food storage device 100 may differently provide an input UI 630 for receiving a user command according to the type of the application being executed.

In detail, the food storage device 100 may display an execution screen 810 of the shopping list application, as shown in FIG. 8A. In this case, when the user command for editing is input, the food storage device 100 displays the execution screen 810 of the shopping list application being executed in the first area and receives the user command in another second area. The keyboard related input UI 630-1 may be displayed.

Therefore, when the user command is input through the keyboard related input UI 630-1 displayed in the second area, the food storage device 100 displays text information corresponding to the input user command in the shopping list displayed in the first area. It may be displayed on the execution screen 810 of the application.

Meanwhile, the food storage device 100 may display an execution screen 820 of the memo application, as shown in FIG. 8B. In this case, when the user command for editing is input, the food storage device 100 displays the execution screen 820 of the memo application being executed in the first area, and an emoticon for receiving the user command in another second area. The relevant input UI 630-2 may be displayed.

Therefore, when the user command is input through the emoticon related input UI 630-1 displayed in the second area, the food storage device 100 displays the emoticon corresponding to the input user command in the first application. It may be displayed on the execution screen 820.

Meanwhile, the food storage device 100 may display an execution screen 830 of the whiteboard application, as shown in FIG. 8C. In this case, when the user command for editing is input, the food storage device 100 displays the execution screen 830 of the whiteboard application running in the first area, and receives the user command in another second area. The drawing task related input UI 630-3 may be displayed.

Therefore, when the user command is input through the drawing work related input UI 630-3 displayed in the second area, the food storage device 100 displays the work tool image corresponding to the input user command in the first area. It may be displayed on the execution screen 830 of the whiteboard application.

Hereinafter, an operation of editing an application running in the food storage device 100 will be described in detail.

9 is a first exemplary diagram for editing an application running in a food storage device according to an embodiment of the present invention.

The food storage device 100 executes a shopping list application according to a user command.

Accordingly, the food storage apparatus 100 displays an execution screen of the shopping list application including a plurality of shopping lists (hereinafter, referred to as first and second shopping lists) 911 and 912 as shown in FIG. 9A. 910 may be displayed.

Subsequently, when the selection command for the second shopping list 912 is input from the displayed first and second shopping lists 911 and 912, the food storage device 100 displays the second as shown in FIG. 9B. The execution screen 920 of the shopping list 912 is displayed. Here, the execution screen 920 of the second shopping list 912 may include an object corresponding to each of the products registered in the second shopping list 912.

Thereafter, the food storage device 100 selects a selection command for the object 921 corresponding to the 'Shower gel' product among the plurality of objects included in the execution screen 920 of the second shopping list 912. An editing operation of deleting the object 921 on the execution screen 920 of the second shopping list 912 is performed.

Accordingly, the food storage device 100 displays the execution screen 930 of the second shopping list 912 in which the object 921 corresponding to the 'Shower gel' product is deleted, as shown in FIG. 9C. Can be displayed.

Thereafter, when the selection command for the fixed UI 931 displayed in the left side area is input, the food storage device 100 is edited together with the first shopping list 911 as shown in FIG. 9D. The execution screen 940 of the shopping list application including the second shopping list 912 ′ may be displayed.

10 is a second exemplary diagram for editing an application running in a food storage device according to another embodiment of the present invention.

As described above, the food storage device 100 displays the execution screen 1010 of the shopping list application including the first and second shopping lists 1011 and 1012, as shown in FIG. can do.

Subsequently, when the selection command for the second shopping list 1012 is input from the displayed first and second shopping lists 1011 and 1012, the food storage device 100 is as shown in FIG. 10B. The execution screen 1020 of the second shopping list 1012 is displayed. Here, the execution screen 1020 of the second shopping list 1012 may include an object corresponding to each of the products registered in the second shopping list 1012.

Thereafter, when the food storage device 100 receives a selection command for the object 1021 corresponding to the 'Shower gel' product among the plurality of objects included in the execution screen 1020 of the second shopping list 1012, FIG. As shown in (c) of FIG. 10, the execution screen 1030 of the second shopping list 1012 is displayed in the first area, and a keyboard related input UI 1040 for receiving a user command in the second area is displayed. do.

In addition, the food storage device 100 may display the first delete icon 1032 on one side where the cursor 1031 and the corresponding object 1021 are displayed at the point where the selection command for the object 1021 is input.

Subsequently, when the selection command for the first delete icon 1032 is located on one side where the object 1021 is displayed, the food storage device 100 displays the object 1021 on the execution screen of the second shopping list 1012. The editing operation of deleting is performed on 1020.

Thereafter, the food storage device 100 displays the execution screen 1050 of the second shopping list 1012 in which the object 1021 corresponding to the 'Shower gel' product is deleted, as shown in FIG. Can be displayed.

Meanwhile, the food storage device 100 includes an object included in the execution screen 1030 of the second shopping list 1012 through the second delete icon 1041 displayed on the keyboard-related input UI 1040 displayed in the second area. You can edit

Specifically, the food storage device 100 has a selection command for the second delete icon 1041 displayed on the input UI 1040 while the cursor 1031 is displayed on the object 1021 corresponding to the 'Shower gel' product. If input, an editing operation for deleting the object 1021 may be performed according to the input selection command.

In addition, the food storage device 100 may include the second delete icon 1041 and the character icon included in the input UI 1040 while the cursor 1031 is displayed on the object 1021 corresponding to the 'Shower gel' product. If a selection command is input to the user, the editing command may be performed to delete at least one of the plurality of characters constituting the object 1021 and to display a new character according to the input selection command.

Hereinafter, the execution operation of the view inside application in the food storage device 100 according to the present invention will be described in detail.

11 to 15 are exemplary views illustrating an execution operation of a view inside application in a food storage device according to an embodiment of the present invention.

As illustrated in (a) of FIG. 11, the food storage device 100 may display the execution screen of the view inside application by executing the view inside application according to a user request. Here, the execution screen of the view inside application may be an image 1110 photographing the inside of the food storage device 100 in which food is stored.

While the image 1110 photographing the inside of the food storage device 100 is displayed, the food storage device 10 selects at least one object from among a plurality of objects included in the captured image 1110. Can be input.

As shown, the food storage device 100 may receive a selection command for the object 1111 corresponding to the cake.

When the selection command for the object 1111 is input, the food storage device 100 displays an image 1110 of the inside of the food storage device 100 as illustrated in FIG. 11B. The input UI 1120 for inputting information related to the object 1111 is displayed on the screen.

The input UI 1120 may include a capture image 1121 of capturing the selected object 1111 and a plurality of icons (hereinafter, referred to as a, b, and c icons) 1122 to input information related to the selected object 1111. 1124).

Thereafter, the food storage device 100 may perform various operations related to the selected object 1111 according to a user command input through the displayed input UI 1120.

In detail, the food storage device 100 may edit the captured image 1121 according to a user command.

As illustrated in FIG. 12A, the food storage device 100 may receive a user command to move outward in a state in which a guide line (not shown) displayed around the captured image 1121 is selected.

When such a user command is input, the food storage device 100 enlarges and displays the captured image 1121 in an outward direction corresponding to the input user command as shown in FIG.

Meanwhile, when the user command for moving inward is input while the captured image 1121 is enlarged in the outward direction, the food storage device 100 reduces the captured image 1121 in the inward direction corresponding to the input user command. Display it.

In addition, as illustrated in FIG. 13A, the food storage device 100 may receive a user command for moving in one direction while a region where the captured image 1121 is displayed is selected.

In this case, as illustrated in FIG. 13B, the food storage device 100 may display the captured image 1121 ′ moved in the direction corresponding to the user command on the screen.

Meanwhile, the food storage device 100 may receive a selection command for the c icon 1124 among the a, b, and c icons 1122 to 1124 included in the input UI 1120 in FIG. 11 (b). Can be.

When the selection command for the c icon 1124 is input, the food storage device 100 displays the edit screen 1410 for generating the tag UI 1420 for the previously selected object 1121.

In detail, as illustrated in FIG. 14A, the food storage device 100 displays a captured image 1121 of capturing the selected object 1121 in the first area of the screen, and displays another second image. Display keyboard-related input UI in the area.

Therefore, the food storage device 100 may display an emoticon or text corresponding to a user command input through the input UI displayed in the second area on the captured image 1121 displayed in the first area.

Thereafter, the food storage device 100 generates the tag UI 1420 for the pre-selected object 1121 according to the user command. Thereafter, the food storage device 100 displays the tag UI 1420 of the preselected object 1121 on the image 1110 photographing the inside of the food storage device 100.

In this case, the food storage device 100 may display the tag UI 1420 by overlapping the tag UI 1420 at a point where the pre-selected object 1121 is located according to a preset condition.

Meanwhile, the food storage device 100 may move and display the tag UI 1420 displayed by being superimposed on the image 1110 photographing the inside of the food storage device 100 according to a user command.

Specifically, as shown in FIG. 15A, the food storage device 100 may receive a user command for moving the tag UI 1420 for the pre-selected object 1121 to a point A. FIG.

When such a user command is input, the food storage device 100 changes the tag UI 1420 to a translucent state, and the image of the tag UI 1420 'of the translucent state photographing the inside of the food storage device 100 ( Displayed in overlapping with 1110.

Subsequently, as shown in FIG. 15C, when the semi-transparent tag UI 1420 'is moved to the point A, the food storage device 100 moves the tag UI 1420' of the translucent state to the point A. ) May be changed to the existing tag UI 1420 and displayed.

Hereinafter, the operation of registering the food information in the shopping list in the food storage device 100 will be described in detail.

16 is an exemplary view illustrating an execution operation of a shopping list application in a food storage device according to an embodiment of the present invention.

As illustrated in FIG. 16, the food storage device 100 may display the execution screen 1610 of the shopping list application according to a user command.

According to an exemplary embodiment of the present disclosure, when a selection command for a shopping list application execution related icon is input among icons corresponding to each of the plurality of applications, the food storage device 100 executes the shopping list application to execute the execution screen 1610 accordingly. Can be displayed.

According to another embodiment, as shown in FIG. 11B, a selection command for b item 1123 among a, b, and c items 1122 to 1124 included in the input UI 1120 is input. When the shopping list application is executed, the execution screen 1610 may be displayed accordingly.

When the execution screen 1610 of the shopping list application is displayed, the food storage device 100 registers food information related to the voice command in the shopping list stored in the shopping list application when a voice command uttered by the user is input. do.

For example, the food storage device 100 may receive a voice command “Add milk” from the user. When such a voice command is input, the food storage device 100 analyzes the input voice command and extracts the ignition elements "Add" and "milk". Thereafter, the food storage device 100 may register food information “milk” on the shopping list based on the extracted ignition element.

17 is an exemplary view of operating a plurality of applications in a food storage device according to an embodiment of the present invention.

As shown in FIG. 17, the food storage device 100 executes a recipe application according to a user command. Here, the recipe application may be an application that provides a recipe for various foods or recommends a dish suitable for a user.

When the recipe application is executed, the food storage device 100 provides a recipe screen 1710 for guiding a recipe for cooking “Basil Pasta” food when a user command for “Basil Pasta” food is input. can do.

In addition, if the user command for the food "Basil Pasta" is input, the food storage device 100 may provide a material required for cooking food for "Basil Pasta".

In addition, the food storage device 100 may register the ingredients required to cook the "Basil Pasta" food to the stored shopping list of the shopping list application.

In detail, when the user command for the food "Basil Pasta" is input, the food storage device 100 may include the ingredients necessary for the food "Basil Pasta" in the shopping list 1710 'stored in the shopping list application as shown. Can be registered.

Meanwhile, when the user command for the voice "Tomato Soup" is additionally input, the food storage device 100 may provide a recipe screen 1720 guiding a recipe for cooking the food "Tomato Soup".

In addition, the food storage device 100 may provide a material for cooking food for “Tomato Soup” according to a user command for “Tomato Soup” food.

In addition, the food storage device 100 may register the ingredients required to cook the "Tomato Soup" food to the stored shopping list of the shopping list application.

Specifically, when the user command for the food "Tomato Soup" is input, the food storage device 100 displays "Tomato" in the shopping list 1720 'in which necessary ingredients are registered in relation to the food "Basil Pasta". Soup "You can register additional ingredients for food.

Meanwhile, the food storage device 100 may register only the remaining materials except for the material stored in the food storage device 100 among the food-related materials requested by the user in the shopping list.

Specifically, as described above, when a user command for the "Basil Pasta" food is input, the food storage device 100 refers to the food list stored in the food list application, among the ingredients required to cook the "Basil Pasta" food. It is determined whether there are ingredients registered in the food list.

Here, the food list may store food information for each food stored in the food storage device 100. Therefore, the food storage device 100 determines whether there is a material registered in the food list among the ingredients required to cook the "Basil Pasta" food with reference to the food information stored in the food list. Thereafter, the food storage device 100 may register the remaining ingredients except the ingredients registered in the food list among the ingredients necessary to cook the "Basil Pasta" food in the shopping list.

18 is an exemplary diagram for purchasing a food registered in a shopping list in a food storage device according to an embodiment of the present invention.

As illustrated in (a) of FIG. 18, the food storage device 100 may display an execution screen 1810 of the shopping list application according to a user command.

Here, the execution screen 1810 of the shopping list application may be a screen listing the food list registered in the shopping list.

In addition, the food storage device 100 may display a UI 1811 including an a and b icons for controlling the execution of the shopping list application on one side area of the execution screen 1810 of the shopping list application. In addition, the food storage device 100 may further display a fixed UI (not shown) for returning to the previous screen on the other side area of the execution screen 1810 of the shopping list application.

When the icon a included in the UI 1811 is selected while the execution screen 1810 of the shopping list application is displayed, the food storage device 100 displays the displayed execution screen (as shown in FIG. 18). The sub UI 1820 for controlling the details of the display unit 181 is displayed in one side area.

Thereafter, the food storage device 100 may receive a selection command for the D icon 1821 for food purchase among the A to E icons included in the sub UI 1820. When the selection command for the D icon 1821 is input, the food storage device 100 stores a store for selecting a store for purchasing food items registered in the shopping list, as shown in FIG. Display the UI 1830.

Thereafter, when the food storage device 100 selects one of a plurality of stores (Store1) included in the store UI 1830, the food storage apparatus 100 may deliver the food information registered in the shopping list to the server (not shown) of the selected store (Store1) and deliver it. Send order request information including information. Thereafter, the food storage device 100 performs a payment for food for which an order is requested based on previously registered payment information according to a payment request of a server (not shown) of the store Store1.

Here, the method of performing the electronic payment between the food storage device 100 and the server (not shown) of the store (Store1) is a well-known technique, so a detailed description thereof will be omitted. Thereafter, when the payment for the food requesting the order is completed, the food storage device 100 may display a payment completion screen 1840 indicating that the order is completed, as shown in FIG.

19 to 22 are exemplary views illustrating an execution operation of a recipe application in a food storage device according to an embodiment of the present invention.

The food storage device 100 may execute a recipe application according to a user command. When such a recipe application is executed, the food storage device 100 may provide the following services through an execution screen of the executed recipe application.

According to an embodiment of the present disclosure, the food storage device 100 may provide a service for recommending food suitable for a user through an execution screen of a recipe application.

According to another embodiment, the food storage device 100 may provide a service for guiding a recipe of a food requested by a user through an execution screen of a recipe applicator.

First, in connection with an operation of providing a service for recommending a suitable food to a user, the food storage device 100 may display a recommendation service screen 1910 for recommending a suitable food to a user, as shown in FIG. 19. .

In detail, the food storage device 100 provides a food recommendation UI 1911 including information about food recommended for each time zone in a first area of the displayed recommendation service screen 1910 and is preset in the second area. The user may provide a preferred food UI 1912 including information on the food selected by the user during the period, and may provide a recipe UI 1913 including recipe information about foods recommended for the user in the third region. .

Accordingly, the user may be provided with information about food suitable for a current time or a specific time period through the food recommendation UI 1911 displayed in the first area of the recommendation service screen 1910.

In addition, the user may check the type of the food he / she recently selected through the preferred food UI 1912 displayed in the second area of the recommendation service screen 1910.

In addition, the user may be provided with a recipe for the food to be cooked through the recipe UI 1913 displayed in the third area of the recommendation service screen 1910.

Hereinafter, an operation of providing a recipe for a food selected by a user will be described in detail.

As described above, the food storage device 100 may receive a selection command for at least one of the recipes for each food provided through the recipe UI 1913 displayed in the third area of the recommendation service screen 1910. When the selection command is input, the food storage device 100 may provide a recipe for food corresponding to the input selection command.

However, the present invention is not limited thereto, and the food storage device 100 may search for and provide a recipe for food input from a user through an input window (not shown).

Specifically, as shown in FIG. 20, the food storage device 100 displays a recipe screen 2010 that provides a recipe for food requested by a user.

For example, the food storage device 100 may display a recipe screen 2010 for food “Pasta” according to a user command.

In detail, the food storage device 100 may display a video for guiding a recipe for the food “Pasta” through the first area 2020 of the displayed recipe screen 2010. In this case, the food storage device 100 may display a control UI for controlling the corresponding operation on the first area 2020 where the video is displayed.

In addition, the food storage device 100 displays a “Pasta” food recipe and a related UI through the second area 2030 of the displayed recipe screen 2010, and the “Pasta” food through the third area 2040. The recipe for each step for cooking is displayed in text form.

Meanwhile, the UI displayed through the second area 2030 may include a "Read Aloud" icon, a "Large Text" icon, and an "Add Time" icon.

The "Read Aloud" icon is an icon for outputting "Pasta" food cooking related text displayed in the third area as audio.

And, "Large Text" is an icon for adjusting the size of "Pasta" food cooking related text displayed in the third area.

The "Add Time" icon is an icon for setting cooking time for each stage for cooking "Pasta" food displayed in the third area.

When the food storage device 100 displays a video for cooking “Pasta” food through the first area 2020, the food storage device 100 may be cooked related to the video currently displayed among the cooking steps of the text form displayed through the third area. The recipe of the step is displayed differently from the recipe of the remaining cooking steps.

Accordingly, the user can easily check which cooking step recipe corresponds to the video currently being displayed through the first area.

Meanwhile, when the "Read Aloud" icon is selected from the icons included in the UI displayed through the second area 2030, the food storage device 100 is displayed through the third area in relation to the food "Pasta". Recipe recipes are output via audio.

In this case, the food storage device 100 may display the recipe of the cooking step output as audio among the recipes of the cooking step displayed through the third area differently from the recipe of the remaining cooking step.

Accordingly, the user can easily check which cooking step the recipe being output as audio corresponds to.

Meanwhile, when the “Add Time” icon is selected from the icons included in the UI displayed through the second area 2030, the food storage device 100 may perform the following operation.

As shown in FIG. 21, when the "Add Time" icon is selected from the icons included in the UI displayed through the second area 2030, the food storage device 100 displays a video for cooking "Pasta" food. The timer UI 2110 for setting a time for each cooking step may be displayed in the first area 2020 displaying the menu.

Therefore, the user may set and confirm the cooking time for each cooking step through the timer UI 2110 displayed in the first area 2020.

Meanwhile, at least one of the cooking step recipes displayed in the third area 2040 in relation to the food “Pasta” may include time information of each cooking step.

In this case, when the selection command for the time information included in the recipe is input, the food storage device 100 may display the timer UI 2110 for the time information included in the corresponding recipe in the first area 2020. .

Therefore, the user may check the cooking time of each cooking step through the timer UI 2110 displayed in the first area 2020.

 On the other hand, if the "Large Text" icon is selected from the icons included in the UI displayed through the above-described second area 2030, the food storage device 100 may perform the following operation.

As illustrated in FIG. 22, when the "Large Text" icon is selected from the icons included in the UI displayed through the second area 2030, the food storage device 100 is displayed through the third area 2040. The text size of the recipe for each "Pasta" food can be enlarged and displayed.

Accordingly, the user can easily check the cooking step recipe for the "Pasta" food displayed through the food storage device 100 even in a situation far from the food storage device 100.

So far, various operations of the food storage device 100 according to the present invention have been described in detail. Hereinafter, the control method of the food storage device 100 according to the present invention will be described in detail.

23 is a flowchart illustrating a control method of a food storage device according to an embodiment of the present invention.

As illustrated in FIG. 23, the food storage device 100 displays an execution screen of an application related to the food storage device 100 in operation S2310.

In addition, while the execution screen of the application is displayed, the food storage device 100 displays a UI including at least one icon for controlling the execution screen of the application in a side area of the execution screen of the application (S2320). .

Here, the application related to the food storage device 100 may be a view inside application that provides an image of the inside of the food storage device 100. Therefore, the food storage device 100 may display a UI for controlling the execution screen of the image on the side area of the image photographed inside the food storage device 100.

According to an additional aspect of the present invention, the food storage device 100 may further display a guide UI for guiding the movable range of the UI displayed in the side area of the execution screen of the application.

Meanwhile, when one of at least one icon included in the UI displayed in the side area is selected, the food storage device 100 displays an execution screen corresponding to the selected icon. In addition, the food storage device 100 may display a sub UI including an icon for controlling the execution screen in a side area of the execution screen corresponding to the selected icon.

Meanwhile, the food storage device 100 determines whether a selection command for an object included in the displayed image is input while the image photographing the inside of the food storage device 100 is displayed (S2330).

If it is determined that one of the plurality of objects included in the displayed image is selected, the food storage device 100 displays an input UI for inputting information related to the selected object (S2340).

Thereafter, the food storage device 100 determines whether the first user command is input through the displayed input UI, and if it is determined that the first user command is input, generates and displays a tag UI (S2340, S2350). .

Meanwhile, if it is determined that another user command is input through the displayed input UI, the food storage device 100 registers the food information in the food list or the shopping list (S2360).

In detail, when the user command to select the first icon from among the plurality of icons included in the input UI is input, the food storage device 100 displays a memo UI for inputting information related to the selected object. Thereafter, when the user command is input through the displayed memo UI, the food storage device 100 generates a tag UI including a memo corresponding to the input user command. Thereafter, the food storage device 100 displays the tag UI by overlaying the corresponding tag UI on an image photographed inside the food storage device 100.

Meanwhile, when the selection command for the displayed tag UI is input, the food storage device 100 may display a memo UI for inputting information related to an object corresponding to the selected tag UI.

On the other hand, the food storage device 100, if a user command to select a second icon of the plurality of icons included in the input UI is input, the food list application for providing food information for each food stored in the food storage device 100 Run

Thereafter, when the food information related to the selected object is input, the food storage device 100 may register the food information input in relation to the pre-selected object in the food list stored in the executed food list application. Here, the food list may be information for providing information on food stored in the food storage device 100.

Meanwhile, the food storage device 100 executes a shopping list application when a user command for selecting a third icon among a plurality of icons included in the input UI is input.

Thereafter, when the food information related to the pre-selected object is input, the food storage device 100 may register the food information in the shopping list stored in the executed shopping list application.

According to a further aspect of the present invention, the food storage device 100 executes a shopping list application when a voice command of a user for food purchase is input. Thereafter, the food storage device 100 may register the food information related to the voice command inputted in the shopping list stored in the executed shopping list application.

On the other hand, the food storage device 100 may execute the recipe application for cooking guide according to the user command. When a user command for a particular dish is input while the recipe application is executed, the food storage device 100 may display material information for the dish.

At this time, the food storage device 100 is a food storage device 100 of the ingredients for cooking requested by the user based on the food list stored in the food list application for providing food information about the food stored in the food storage device 100. The food-related materials in the interior and the remaining materials may be displayed differently.

In one embodiment of the present invention, a process may be stored in a non-transitory readable medium in the form of a program, which stores data semi-permanently rather than a medium storing data for a short time such as a register, a cache, a memory, and the like. Means a medium that can be read by the device. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: food storage device 110: display unit
120 processor 130 input unit
140: communication unit 150: cold air supply unit
160: recording unit 170: detection unit
180: audio output unit 190: storage unit

Claims (20)

In the refrigerator,
A display for displaying an image of the inside of the refrigerator; And
When one of the plurality of objects included in the image is selected, generate a capture image for the selected object,
When a command for generating a user interface (UI) for providing information related to the selected object is received, the display is controlled to display an input UI for receiving text information related to the selected object.
Generating the UI including the captured image and text information input through the input UI,
And a processor configured to control the display to display the generated UI on the image. The method of claim 1,
The processor,
Control the display to display a guide UI for editing a captured image for the selected object,
A refrigerator which adjusts the size of the captured image based on an operation command for the guide UI. The method of claim 1,
The input UI,
And a first area including a captured image of the selected object and a second area for receiving input of text information related to the selected object. The method of claim 1,
The processor,
And when the input for moving the UI is received, controls the display to display the movement of the UI based on the received input for moving the UI. The method of claim 4, wherein
The processor,
A refrigerator controlling the display such that the UI is displayed in a translucent state while the UI moves. The method of claim 1,
The processor,
And when the UI displayed on the image is selected, controlling the display to display the input UI. In the control method of the refrigerator,
Displaying an image of the inside of the refrigerator;
Generating a captured image of the selected object when one of a plurality of objects included in the image is selected;
Displaying an input UI for receiving text information related to the selected object when a command to generate a user interface (UI) providing information related to the selected object is received;
Generating the UI including the captured image and text information input through the input UI; And
Displaying the generated UI on the image. The method of claim 7, wherein
Displaying a guide UI for editing a captured image of the selected object; And
And adjusting the size of the captured image based on an operation command for the guide UI. The method of claim 7, wherein
The input UI,
And a first area including a captured image for the selected object and a second area for receiving input of text information associated with the selected object. The method of claim 7, wherein
If an input for moving the UI is received, displaying the movement of the UI based on the received input for moving the UI. The method of claim 10,
Displaying the movement of the UI,
While the UI is moving, displaying the UI in a translucent state. The method of claim 7, wherein
If the UI displayed on the image is selected, displaying the input UI. delete delete delete delete delete delete delete delete

Images