KR102434867B1 - Refrigerator and method for controlling the same - Google Patents

Abstract

The present invention relates to a refrigerator and a method for controlling a refrigerator, comprising: a main body having a storage compartment including at least one storage space; a door coupled to the main body and formed to open and close the storage compartment; A touch screen that is transparently formed so that the foods stored in the storage space can be identified, and graphic objects corresponding to the foods stored in the storage space, respectively, are displayed on the transparent display unit, and at least one of the graphic objects is displayed on the transparent display unit. A control unit for executing a purchase function for purchasing a specific food corresponding to the at least one graphic object in response to a touch of a preset method for When it is dragged to a preset area on the touch screen by a touch of , a function of purchasing food corresponding to the dragged at least one graphic object is performed.

Description

Refrigerator and method of controlling the refrigerator

The present invention relates to a refrigerator and a method for controlling the refrigerator.

BACKGROUND ART In general, a refrigerator is a device for freezing or refrigerated storage of food or the like by discharging cold air generated by a refrigeration cycle including a compressor, a condenser, an expansion valve, an evaporator, and the like to lower the temperature in a refrigerator.

Recently, the function of the refrigerator has been diversified from the original function of refrigeration or freezing of food. That is, a dispenser is installed on the door of the refrigerator to provide purified water and ice, and a display is installed on the front of the door to show and manage the state of the refrigerator.

In general, the door of the refrigerator is made to be opaque and is provided to open and close the storage compartment of the main body. Such a door may be formed so that a user can open and close it in order to access the refrigerating compartment or the freezing compartment. Therefore, it is common for the user to not know the type and location of the food stored in the refrigerator before opening the door.

A display area capable of displaying image information may be formed on the outside of the refrigerator door that is manufactured in such a way that it is opaque. Accordingly, a menu and various information for controlling a function of the refrigerator may be displayed through the display area, and various functions of the refrigerator may be controlled according to a user input applied through the display area.

On the other hand, when the door of the refrigerator is made to be opaque as described above, there is a problem in that the user cannot check the food stored in the refrigerator without opening the door of the refrigerator. To solve this problem, a refrigerator in which the door is transparent so that a user can check the food in the refrigerator without opening the door has appeared. However, when the door of the refrigerator is transparent as described above, there is an advantage in that the state of the stored food can be checked without opening the door, but there is a problem in that it is difficult to display information related to the function of the refrigerator due to the absence of the display area.

Accordingly, a method for maintaining the advantages of using a transparent door and having all the advantages of the display area provided through the door is currently being actively researched.

An object of the present invention is to solve the above and other problems, and a refrigerator capable of checking food stored in the refrigerator without opening the door while displaying various image information through a display area formed on the door, and a refrigerator therefor To provide a method for controlling a refrigerator.

It is another object of the present invention to provide a refrigerator and a control method of the refrigerator that allow food stored in the refrigerator or a user input corresponding to each storage space to be displayed through a display area formed on the door.

Another object of the present invention is to provide a refrigerator and a control method of the refrigerator, which provide various information related to a specific food item selected by a user so that the user can more efficiently use the food currently stored in the refrigerator.

According to one aspect of the present invention in order to achieve the above or other object, a refrigerator according to an embodiment of the present invention includes a main body having a storage compartment, a door coupled to the main body and formed to open and close the storage compartment, A touch screen disposed on one surface of the door and formed to switch from one state to another in one of a transparent first state and an opaque second state, and while the touch screen is in the transparent first state , a controller configured to control the touch screen to output a management menu related to management of food stored in the storage room in response to a touch applied to the touch screen for a preset time or longer, wherein the controller includes: When any one is selected, the touch screen is controlled so that a graphic object related to the selected menu is output to an area to which the touch is applied among the touch screens.

In an embodiment, the controller controls the touch screen so that the graphic object disappears on the touch screen when the touch screen is switched from the transparent first state to the opaque second state, When the touch screen is switched back from the opaque second state to the transparent first state, the touch screen is controlled so that the graphic object is re-positioned in the touched area of the touch screen. do.

In an embodiment, the display position of the graphic object output to the touch screen is changed based on a preset type of touch applied to the graphic object, and the preset type of touch includes a drag touch, The graphic object is characterized in that it is moved on the touch screen according to a drag touch applied to the graphic object.

In an embodiment, the display device further includes at least one camera disposed inside the storage compartment, wherein the controller is configured to apply an image input through the camera to a region to which the touch is applied among the foods disposed in the storage compartment using an image input through the camera. It is characterized in that the position of the specific food is sensed, and the management menu is configured as a management menu related to the specific food.

In an embodiment, the controller monitors the state of the specific food from the image input through the camera at a preset time interval, and when the state of the specific food is changed, the changed state information of the specific food Controls the touch screen so that is reflected in the graphic object.

In an embodiment, when the specific food is no longer located in the storage compartment as a result of the monitoring, the controller controls the touch screen so that the graphic object disappears.

In an embodiment, when the arrangement position of the specific food is changed as a result of the monitoring, the controller controls the touch screen so that the display position of the graphic object is changed according to the changed position of the specific food. do it with

In an embodiment, the graphic object includes management information related to the selected management menu.

In an embodiment, when the management information is information related to at least one of an expiration date and a storage institution, the control unit updates the management information based on the lapse of time, and the updated information is the graphic object It is characterized in that to control the touch screen to be included in the.

According to one aspect of the present invention in order to achieve the above or other object, a refrigerator according to an embodiment of the present invention includes a main body having a storage compartment, a door coupled to the main body and formed to open and close the storage compartment, A touch screen disposed on one side of the door and configured to switch from one state to the other in one of a transparent first state and an opaque second state, and based on a user request, the transparent first state Controls the touch screen so that a graphic object corresponding to the timer function is output on the touch screen of the and a controller configured to set a counting target time and perform time counting corresponding to the counting target time, wherein the counting target time is the distance from the one point where the drag touch is started to the point where the drag touch is released. It is characterized in that it is determined based on

In an embodiment, the graphic object may correspond to a circular shape, and the preset path may correspond to a peripheral area of the graphic object corresponding to the circular shape.

In an embodiment, the graphic object includes information related to the time counting.

In an embodiment, when the time counting corresponding to the counting target time is completed, the controller controls the touch screen to output notification information indicating that the time counting is completed.

In an embodiment, when the time counting is completed while the touch screen is in the opaque second state, the control unit switches the touch screen to the transparent first state and outputs the notification information do it with

In an embodiment, when the time counting is completed while the touch screen is in the opaque second state, the control unit includes only a region corresponding to the output position of the graphic object of the touch screen in the transparent first state It is characterized by converting to .

In an embodiment, when a touch input is not applied to the touch screen for a preset time in the transparent first state, the touch screen is switched to the opaque second state.

In an embodiment, the display device further includes at least one camera disposed in an area of the door, wherein the control unit controls the touch screen to display the touch screen when a user located near the door is not detected through the camera. It is characterized in that the transition from the first transparent state to the second opaque state.

In an embodiment, the user request corresponds to a touch input for selecting the timer function through the touch screen, and the control unit outputs the graphic object at a point where the touch input is applied. characterized in that it controls.

According to one aspect of the present invention to achieve the above or other objects, a refrigerator according to an embodiment of the present invention includes a main body having a storage compartment including at least one storage space, and coupled to the main body, the storage compartment is provided. A door formed to open and close, a touch screen disposed on one surface of the door and transparently formed to identify foods stored in the storage space, and graphic objects respectively corresponding to the foods stored in the storage space, the Display on the transparent display unit, in response to a preset type of touch on at least one of the graphic objects, comprising a control unit that executes a purchase function for purchasing a specific food corresponding to the at least one graphic object, , the control unit, when the at least one graphic object is dragged to a predetermined area on the touch screen by the predetermined type of touch, a function of purchasing food corresponding to the dragged at least one graphic object characterized by performing.

In one embodiment, when the at least one graphic object is dragged to a preset area on the touch screen according to a user's input, the control unit is configured to select foods corresponding to each of the dragged graphic objects on the touch screen. A purchase list including information is displayed, a purchase function is performed for at least one of the foods included in the purchase list, and screen information related to purchase is displayed on the touch screen.

According to one aspect of the present invention in order to achieve the above or other objects, a refrigerator according to an embodiment of the present invention includes a main body having a storage compartment partitioned into a plurality of storage spaces, and is coupled to the main body to open and close the storage compartment. A door formed to do so, a first state disposed on one surface of the door and transparently displayed so that the inside of the storage compartment divided into the plurality of storage spaces is identifiable, and opaque so that the inside of the storage compartment is indistinguishable Among the displayed second states, a touch screen formed to be switched from one state to another state, a memory for storing recipes for a plurality of different foods, and, when any one of the recipes is selected, the selected and a control unit that analyzes the food ingredient of the food corresponding to the recipe and displays information related to the storage space in which the food ingredient is stored among the plurality of storage spaces on the touch screen.

In an embodiment, the control unit divides the touch screen into a plurality of regions corresponding to each of the plurality of storage spaces, and displays information related to the storage space in which the food ingredients are stored, the food ingredients among the plurality of regions. It is characterized in that it is displayed in one area corresponding to the stored storage space.

The effects of the refrigerator and its control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the present invention controls the display area formed on the refrigerator door to be switched to a transparent state according to a desired function or a user's selection, so that food stored in the refrigerator can be displayed without opening the door. There is an effect that various information can be provided to the user through the display area formed on the door while allowing the user to check the information.

In addition, according to at least one of the embodiments of the present invention, the present invention allows the user to select the specific food or the specific storage space by displaying the specific food or the specific storage space set by the user through the display area formed on the door. It has the effect of making it easier and more efficient to manage.

In addition, according to at least one of the embodiments of the present invention, the present invention provides the residual amount information and recipe information related to the food stored in the refrigerator, thereby providing a higher convenience to the user in utilizing the food currently stored in the refrigerator. have.

1A is a block diagram illustrating a structure of a refrigerator related to the present invention.
1B and 1C are exemplary views illustrating a refrigerator related to the present invention.
1D is an exemplary view illustrating a refrigerator according to another embodiment related to the present invention.
2A to 2E are cross-sectional views illustrating a door provided in a refrigerator according to the present invention.
3 is a flowchart illustrating an operation process of displaying a graphic object selected by a user at a location according to a user's touch input in the refrigerator according to an embodiment of the present invention.
4 is a flowchart illustrating an operation process of performing a time counting function according to a timer set by a user in a refrigerator according to an embodiment of the present invention.
5 is a flowchart illustrating an operation process of classifying time counting according to an object for which a timer is set in a refrigerator according to an embodiment of the present invention.
6 is a flowchart illustrating an example of an operation process in which recipe information according to a selected food item is output in a refrigerator according to an embodiment of the present invention.
7 is a flowchart illustrating an operation process of displaying information related to food ingredients according to a user's selection from a list of ingredients of a selected recipe in a refrigerator according to an embodiment of the present invention.
8 is an exemplary diagram illustrating an example in which tag information is generated according to a user's touch input and the generated tag information is displayed in the refrigerator according to an embodiment of the present invention.
9 is an exemplary diagram illustrating an example of generating tag information by a single touch input by a user in a refrigerator according to an embodiment of the present invention.
10 is an exemplary view illustrating an example in which a state of a touch screen formed on one door of a refrigerator is changed according to a user's selection according to an embodiment of the present invention.
11 is an exemplary diagram illustrating an example in which an image of a storage space according to a user's selection is displayed through the touch screen in the refrigerator according to an embodiment of the present invention.
12 is an exemplary diagram illustrating an example in which the displayed position of tag information corresponding to a specific food is changed according to the movement of the position of the food in the refrigerator according to the embodiment of the present invention.
13A and 13B illustrate examples in which tag information indicating an arbitrary time limit set by a user is generated in a refrigerator according to an embodiment of the present invention, and examples in which information displayed on the tag information is changed over time are one example.
13C is an exemplary diagram illustrating an example in which a graphic object displayed on a touch screen is moved according to a user's drag input in the refrigerator according to an embodiment of the present invention.
14A and 14B are exemplary views illustrating an example in which a timer function is set for a specific food or a specific storage room in a refrigerator according to an embodiment of the present invention.
15 is an exemplary diagram illustrating an example in which information about the remaining amount of food stored in a specific storage compartment is displayed in a refrigerator according to an embodiment of the present invention.
16 is an exemplary diagram illustrating an example in which a purchase function for at least one food item is performed in the refrigerator according to an embodiment of the present invention.
17 is an exemplary diagram illustrating an example in which recipe information for a specific food is displayed in the refrigerator according to an embodiment of the present invention.
18 is an exemplary diagram illustrating an example in which information related to any one of ingredients of a selected recipe is displayed in a refrigerator according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar reference numerals are assigned to the same or similar components, and overlapping descriptions thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

The order of explanation of the drawings below is described in clockwise order, starting with the upper left drawing, the upper left drawing is 'first drawing', the upper right drawing is 'second drawing', and the lower right drawing is ' The third drawing' and the lower left drawing will be described as 'fourth drawing'.

First, referring to FIG. 1A , FIG. 1A is a block diagram illustrating a refrigerator 100 related to the present invention.

The refrigerator 100 may include a communication unit 130 , a sensing unit 140 , a display unit 150 , a user input unit 160 , and a memory 170 . The components shown in FIG. 1 are not essential in implementing the refrigerator 100 , so the refrigerator 100 described herein may have more or fewer components than those listed above.

More specifically, among the above components, the communication unit 130 may be configured between the refrigerator 100 and a preset communication system, between the refrigerator 100 and at least one external device, or between the refrigerator 100 and a specific external server. It may include one or more modules that enable wireless communication of In addition, the communication unit 130 may include one or more modules for connecting the refrigerator 100 to one or more networks.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the refrigerator 100 , surrounding environment information surrounding the refrigerator 100 , and user information. For example, the sensing unit 140 may include a camera 141 capable of sensing the inside of each storage compartment of the refrigerator 100 and an image of food stored in the storage compartment. For example, the image may be an image sensed in a direction from the refrigerator door toward the inside of each storage compartment. For example, the camera 141 may be provided on the door or the front portion of the refrigerator 100 provided with the door, and may be formed to sense an image in a direction looking into each storage compartment from the front of the refrigerator.

In addition, the sensing unit 140 includes a weight sensor 142 capable of detecting the weight of each of at least one storage space in the refrigerator 100 and a proximity sensor 143 capable of detecting a user adjacent to the refrigerator 100 . sensor), a pressure sensor 144 capable of measuring a pressure applied through the touch input when a user's touch input is sensed through the touch sensor, an infrared sensor (IR sensor), and a fingerprint recognition sensor (finger scan) sensor), an ultrasonic sensor, a microphone, an environmental sensor (eg, a hygrometer, a thermometer, an odor sensor, etc.), and at least one of biometric sensors such as an iris recognition sensor. Meanwhile, the refrigerator 100 disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

Meanwhile, the display unit 150 may be implemented in the form of a transparent liquid crystal display panel. Such a display unit 150 may implement a touch screen by forming a mutual layer structure with the touch sensor or by being integrally formed. Such a touch screen may function as a user input unit 160 providing an input interface between the refrigerator 100 and a user, and may provide an output interface between the refrigerator 100 and a user.

The user input unit 160 may be formed of a microphone for inputting an audio signal, or an audio input unit, and at least one key for receiving information from a user. These keys are made of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a touch key disposed on a part other than the touch screen. key). On the other hand, the virtual key or the visual key, it is possible to be displayed on the touch screen while having various forms, for example, graphic (graphic), text (text), icon (icon), video (video) or these can be made by a combination of

In addition, the memory 170 stores data supporting various functions of the refrigerator 100 . The memory 170 may store a plurality of application programs (or applications) driven in the refrigerator 100 , data for operation of the refrigerator 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. Also, at least some of these application programs may exist on the refrigerator 100 from the time of shipment for a basic function (eg, a temperature management function for each storage area) of the refrigerator 100 .

Meanwhile, the controller 180 controls the overall operation of the refrigerator 100 . The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170 .

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1A in order to drive an application program stored in the memory 170 . Furthermore, in order to drive the application program, the controller 180 may operate by combining at least two or more of the components included in the refrigerator 100 with each other.

Also, even if the touch input is applied to the same point on the touch screen, the controller 180 may classify the touch input into different inputs based on the time the touch input is maintained or the pressure measured through the touch input. . That is, when a touch input (first touch input) is first applied to a point on the touch screen, the controller 180 performs a function corresponding to the applied touch input, and the touch input is maintained for a preset time or longer, When the pressure applied through the touch input is changed, the touch input may be sensed as the second touch input. In addition, another function corresponding to the second touch input may be performed.

Meanwhile, when a plurality of touch inputs continuously applied within a preset time are applied, the controller 180 determines that the plurality of touch inputs are preset touch inputs for controlling one or more functions of the refrigerator 100 . can That is, when a plurality of touch inputs continuously applied within a preset time are sensed, the controller 180 may detect a predefined pattern that matches a pattern formed by points on the touch screen in which the touch input is sensed. As a result of detection, if there is a pattern matching the pattern formed from the plurality of touch inputs, the controller 180 controls the refrigerator 100 to execute at least one function according to a specific pattern matching the plurality of touch inputs. You can control each component of

At least some of the respective components may operate in cooperation with each other to implement the operation, control, or control method of the refrigerator 100 according to various embodiments described below. In addition, the operation, control, or control method of the refrigerator 100 may be implemented on the refrigerator 100 by driving at least one application program stored in the memory 170 .

Meanwhile, FIGS. 1B and 1C are exemplary views for explaining the refrigerator 100 related to the present invention.

The refrigerator 100 according to an embodiment of the present invention may include a main body 200 having a storage compartment therein, and at least one door formed on at least one surface of the main body 200 to selectively open and close the storage compartment. can

Here, the transparency of any one of the doors 210 can be adjusted from a completely opaque state to a transparent state by adjusting the transparency. In addition, the door 210 may include a display area 201 including a transparent liquid crystal display to display various image information such as text, images, or moving pictures. As described above, the transparent display area 201 may form a touch screen by forming a mutual layer structure with the touch sensor or by being integrally formed. In the following description, it is assumed that the transparent display area 201 forms a touch screen.

The touch screen 201 may be formed on the entire front surface of the door 210 or a portion of the front surface of the door 210 . In addition, a plurality of touch screens 201 form a plurality of different touch screens on the door 210 , or any one touch screen 201 formed on the front surface of the door 210 is divided into a plurality of the plurality of touch screens. It is also possible to form two different touch screens.

Meanwhile, when a plurality of touch screens are formed, the plurality of touch screens may correspond to the front area of each storage area partitioned by a shelf or the like in the storage room. That is, the vertical width of any one of the plurality of touch screens corresponds to the height between shelves adjacent in the vertical direction inside the storage area, and the left and right width of the one touch screen is the door 210 . It may correspond to the width of the door 210 excluding the frame portion of . However, the present invention is not limited to this partitioning method, and it goes without saying that any one of the touch screens may be formed to be smaller than the front area of a specific storage space or to correspond to an area combined with the front areas of a plurality of storage areas.

Meanwhile, when a preset touch input is applied to the touch screen 201 , the controller 180 may detect the touch input as a touch input for changing the state of the touch screen 201 . Here, the preset touch input may be a touch input applied to a specific region of the touch screen 201 , a touch input in which a touch state is maintained for a preset period of time, or a touch input in which an applied pressure is equal to or greater than a certain level. Alternatively, it may be a plurality of touch inputs applied in a preset pattern.

Meanwhile, when a preset touch input is applied to the touch screen 201 , the controller 180 may change the state of the touch screen 201 . That is, as shown in FIG. 1B , when the touch screen 201 is in a state where food stored in the corresponding storage space is identifiable, the controller 180 controls the touch screen 201 as shown in FIG. 1C . It is possible to switch to a state in which the stored food cannot be identified and is displayed opaquely. Conversely, if the touch screen 201 is in an opaque state, the controller 180 may switch the touch screen 201 to a transparent state based on the preset touch input.

Meanwhile, the preset touch input may be a touch input in which a plurality of continuously input touch inputs form a specific pattern as described above. In this case, the controller 180 may perform at least one function of the refrigerator 100 corresponding to the plurality of touch inputs. For example, the controller 180 may change the transparency of the touch screen of a specific door to which the plurality of touch inputs are applied according to a pattern formed from the plurality of touch inputs. Alternatively, the controller 180 may display specific information corresponding to a pattern formed from the plurality of touch inputs among various pieces of information related to food stored in the refrigerator 100 on the touch screen. For example, the various information related to the food may include information on measuring the remaining amount of food stored in a specific storage space or information on the expiration date of the food. In addition, the remaining amount measurement information and the validity period information may be information corresponding to different patterns, respectively.

Meanwhile, the preset touch input may be a touch input for displaying a management menu for controlling various functions of the refrigerator 100 . In this case, the controller 180 may display, on the touch screen, a management menu capable of controlling various functions provided by the refrigerator 100 centered on a point to which the touch input is applied. In addition, a specific function may be executed based on another input of the user applied to the management menu.

Meanwhile, in FIGS. 1B to 1C , the case in which the touch screen is formed on any one of the doors formed in the refrigerator 100 has been described as an example, but unlike this, the touch screen is formed in each of the doors formed in the refrigerator 100 . Of course it could be. 1D shows an example of the refrigerator 100 according to another embodiment of the present invention.

As shown in FIG. 1D , when the refrigerator 100 is formed including a plurality of doors 210 , 220 , 230 , and 240 formed on at least one surface of the main body 200 , each door 210 , 220 , 230 is formed. , 240 , the touch screens 201 , 221 , 231 , and 241 may be formed independently. In addition, the controller 180 may independently control each of the touch screens 201 , 221 , 231 , and 241 . That is, the controller 180 controls the touch screens 221 , 231 , 241 formed on the other doors 220 , 230 , 240 to be switched to a transparent state or an opaque state, like the door 210 shown in FIG. 1B . Each can be controlled. In addition, the storage spaces corresponding to the doors 201 , 221 , 231 , and 241 are set independently of each other so that various functions related to food in the storage spaces corresponding to the doors 201 , 221 , 231 and 241 are performed. can be controlled In this case, the controller 180 may display a management menu on each touch screen formed on each door, and a function that can be performed in each storage space may be selected by the user through the displayed management menu.

Meanwhile, FIGS. 2A to 2E are cross-sectional views illustrating a cross-section of a door 210 on which a touch screen is formed in the refrigerator 100 related to the present invention.

First, referring to FIG. 2A , when a specific voltage V3 is applied to the first electrode 211b and the second electrode 212b, all three lights 210a, 210b, and 210c may be reflected. Accordingly, when the second electrode substrate 212a is implemented to be flat, the touch screen 201 of the door 210 may be viewed as a mirror. In particular, when the electric field dependent layer 217 is made of a photonic crystal, the touch screen of the door 210 may have a higher reflectivity.

Meanwhile, the electric field-dependent layer 217 may be formed by charging each cell with an electric-field-dependent material.

The electric field-dependent material charged in the electric-field-dependent layer 217 is a material whose properties are changed by the electric field formed between the first electrode 211b and the second electrode 212b, and is a liquid crystal material, a fluorescent material , a photonic crystal material, an electrophoresis material, and an electrowetting material may be at least one selected from the group consisting of.

Here, the electrophoretic material may refer to a material exhibiting an electrophoretic phenomenon, the electrowetting material may refer to a material exhibiting an electrowetting phenomenon, and the photoelectrochromic material may refer to a material exhibiting a photoelectrochromic phenomenon. Briefly describing some electric field-dependent materials, a photonic crystal is a structure in which a photonic band gap is formed by a regular arrangement of spatially repeated microstructures and only a specific wavelength of external incident light is reflected. The color expressed by the color is called the structure color.

The formation of the optical bandgap is determined by the size, spacing, and refractive index difference of the particles constituting the photonic crystal. Therefore, by changing the characteristics of the photonic crystal by adjusting the intensity or direction of the electric field, the color expressed can be controlled.

Electrophoresis is a phenomenon in which charged particles are moved by an electric field formed between two electrodes. If a colored charged particle is dispersed in a fluid with high resistance and low viscosity and a voltage is applied to the two electrodes, the charged particle can move and display color.

The electrowetting type display adopts the principle that a conductive fluid (water) and a non-conductive fluid (oil) do not mix. When the surface tension of the conductive fluid is controlled by applying a voltage from the outside, the contact angle of the conductive fluid and the interface between the two fluids The wavelength of the reflected light changes as the shape of

In the description of the refrigerator 100 according to an embodiment of the present invention, any of the electric field-dependent materials may be used. However, for convenience of explanation, in the following description, a cholesteric liquid crystal material is used as an example among liquid crystal materials capable of implementing excellent light transmittance.

Meanwhile, FIG. 2B shows a liquid crystal arrangement in a homeotropic state. The homeotropic liquid crystal refers to a state in which the helical structure is untwisted and liquid crystal molecules are arranged in the direction of the electric field. The arrangement of the liquid crystal molecules in the homeotropic state is the arrangement when a high electric field is formed between the first electrode 211b and the second electrode 212b, and has a property of transmitting light. Accordingly, as shown in FIG. 2B , incident light is transmitted as it is, and the touch screen 201 of the door 210 can be viewed transparently. Accordingly, in this case, the user can identify the foods stored in the refrigerator through the door 210 .

Meanwhile, FIG. 2C shows a liquid crystal arrangement in a planar state. The planar state refers to a state in which the spiral axis of the cholesteric liquid crystal is arranged substantially perpendicular to the substrate, for example, the first electrode substrate 211a. The liquid crystal layer 217 in the planar state is an arrangement formed when the high electric field applied to the liquid crystal in the homeotropic state is sharply lowered, and when the cholesteric liquid crystal is in the planar state, it emits light of a specific wavelength can reflect.

At this time, the specific wavelength is determined according to the helical pitch in the helical structure of the cholesteric liquid crystal. That is, since the wavelength of the reflected light can be determined by adjusting the spiral pitch, the reflected color can be adjusted by adjusting the spiral pitch of the cholesteric liquid crystal. Accordingly, a desired color can be displayed without a separate color filter.

2D shows the liquid crystal arrangement in a focal conic state. The focal conic state may mean a state in which the spiral axis of the cholesteric liquid crystal is arranged substantially parallel to the first electrode substrate 211a. The liquid crystal structure in the focal conic state is an arrangement formed when the high electric field applied to the liquid crystal in the homeotropic state is slowly lowered, and has a property of scattering or diffusely reflecting light. Accordingly, when the liquid crystal is in a focal conic state, the touch screen 201 may be in an opaque state.

For example, when an electric field is applied to the cholesteric liquid crystal in a planar state, the spiral axis perpendicular to the first electrode substrate 211a changes to a state parallel to the first electrode substrate 211a, resulting in a focal conic state. . Here, the electric field applied to the cholesteric liquid crystal may be 10-20V.

When a larger electric field is applied to the cholesteric liquid crystal in the focal conic state, the helical structure may be untwisted to become a homeotropic state in which liquid crystal molecules are aligned in the electric field direction. Here, the electric field applied to the cholesteric liquid crystal may be 30-50V. And if the electric field is gradually removed from the homeotropic state, it can return to the focal conic state, and when the electric field is rapidly removed, the planar state can be achieved.

On the other hand, in order to convert the cholesteric liquid crystal in the focal conic state to the planar state, as described above, a larger electric field is applied to the cholesteric liquid crystal to make the cholesteric liquid crystal into a homeotropic state, and then two steps of rapidly removing the electric field are performed. can

Accordingly, when the user applies a preset touch input, the controller 180 may apply a high voltage to the first electrode 211b and the second electrode 212b to put the cholesteric liquid crystal into a homeotropic state. Then, the touch screen 201 may be displayed transparently by transmitting light.

In this state, the controller 180 may receive another touch input from the user. Here, the other touch input may be a touch input having a different duration of a touch or a touch input having a different applied pressure. When another touch input is applied as described above, the controller 180 may gradually or rapidly remove the high electric field formed in the cell to make the focal conic state or the planar state. Then, the liquid crystal may be switched from a transparent state to an opaque state or a state in which image information such as graphic objects can be displayed.

Meanwhile, FIG. 2E shows an example in which the door 210 according to an embodiment of the present invention has a laminate structure of a polymer dispersed liquid crystal (PDLC) and a transparent display panel (T-LCD).

Referring to FIG. 2E , in the door 210 according to an embodiment of the present invention, a PDLC layer 260 is laminated between the first and second tempered glass layers 250a and 250b, and the second tempered glass layer ( 250b) and the third tempered glass layer 250c may have an add-on structure in which a T-LCD layer 270 and a touch film 280 are stacked.

Hereinafter, embodiments related to a control method that can be implemented in the refrigerator 100 configured as described above will be described with reference to the accompanying drawings. It is apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

In the following description, for convenience of description, the case in which the touch screen 201 is formed on the door 210 will be described as an example. However, it goes without saying that the present invention is not limited thereto. That is, the touch screen may be formed on any one of the other doors 220 , 230 , and 240 of the refrigerator 100 , or the touch screen may be formed on each of the other doors 220 , 230 , 240 . Of course. In this case, it goes without saying that any one of the other doors or the touch screen formed on each of the other doors may be controlled similarly to the description below.

Meanwhile, the touch screen 201 formed on the refrigerator 100 according to an embodiment of the present invention may be switched to a transparent state or an opaque state depending on whether a preset condition is satisfied. Here, the preset condition may be set in various ways. For example, the preset condition may be satisfied when there is a person within a preset distance from the refrigerator 100 . To this end, the controller 180 may detect a person close to the refrigerator 100 through the camera 141 or the proximity sensor included in the sensing unit 140 .

Meanwhile, the preset condition may be satisfied when a preset touch input is sensed. For example, while maintaining the display panel of the touch screen 201 in an inactive state, the controller 180 consumes a minimum current or power for sensing a user's touch input applied to the touch screen 201 . It can be operated in doze mode. In addition, when a preset touch input of a user is applied in a state of being driven in the doze mode, the display panel of the touch screen 201 may be switched to an activated state. In this case, the display panel may output preset image information or be switched to a transparent state. In the following description, a case in which the display panel is changed to be transparent according to the touch input will be described as an example. And when the display panel is switched to the transparent state as described above, since the touch screen 201 becomes transparent, the door on which the touch screen 201 is formed, that is, food inside the storage compartment corresponding to the door 210 can be identified. can be viewed through the touch screen 201 .

3 is a flowchart illustrating an operation process of displaying a graphic object selected by a user at a location according to a user's touch input in the refrigerator 100 according to an embodiment of the present invention.

Referring to FIG. 3 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may detect a user's touch input (first touch input) applied to the touch screen 201 ( S300 ). ). In addition, when the first touch input is detected in step S300 , the controller 180 may switch the touch screen 201 to a transparent state as described above. Then, in response to the first touch input, the controller 180 may display on the touch screen 201 a management menu that allows the user to select various functions that can be performed in the refrigerator 100 ( S302).

The management menu 800 may include items corresponding to a plurality of different functions. For example, the management menu may include items corresponding to a function of displaying various information related to food stored in the refrigerator or a specific storage room. Here, the information related to the specific food or specific storage room may mean information related to the name or expiration date of the specific food, or information related to the remaining amount or component of the specific food or foods stored in the specific storage room. For example, such information may be displayed on at least one point on the touch screen 201 according to a user's selection as a graphic object in the form of a sticker corresponding to each information.

Meanwhile, the management menu may include an item corresponding to a function of generating tag information including text information or voice information written by a user for a specific food or a storage space in which the specific food is stored. Alternatively, the management menu may include an item corresponding to a timer function for setting a specific food or a time or a deadline that the user wants to set arbitrarily for a specific food or a storage space in which the specific food is stored. In addition, the management menu may include a memo function that allows a user to memo useful information using the touch screen.

Meanwhile, the management menu displayed according to the user's touch input as described above may be configured differently depending on whether the touch input is applied to a specific food or not. For example, the controller 180 may sense food corresponding to an area to which the touch input is applied from an image sensed from each storage compartment of the refrigerator 100 to determine whether the touch input is applied to a specific food. have. And as a result of the determination, if the touch input is applied to a specific food, it goes without saying that a management menu including functions related to the currently selected specific food may be displayed in response to the touch input.

Such a management menu may be displayed in a preset area on the touch screen 201 . For example, the controller 180 may display the management menu on a predetermined area of the touch screen 201 . Alternatively, the controller 180 may display the management menu according to a touch input point applied on the touch screen 201 . In this case, the management menu may be displayed on an area on the touch screen 201 based on the point to which the touch input, that is, the first touch input is applied.

Meanwhile, when the management menu is displayed in step S302, the controller 180 may receive a selection from the user from among the items included in the management menu. The controller 180 may identify any one function selected by the user according to another touch input (second touch input) applied to any one of the items included in the management menu.

Here, the second touch input may be a touch input differentiated from the first touch input. For example, in the second touch input, the duration of the touch is different from the first touch input, or the pressure sensed through the touch input is different from the pressure sensed from the first touch input by a preset level or more. it could be As such, when the touch holding time or the touch pressure time are different, the controller 180 may classify the currently applied touch input into a touch input different from the first touch input, that is, a second touch input, and Accordingly, it may be determined that any one item of the management menu is selected by the user.

Meanwhile, in response to the second touch input, when any one function from the management menu displayed in step S302 is selected, the controller 180 may display a graphic object related to the selected function on an area on the touch screen 201 . (S304). Here, one area on the touch screen 201 may be an area according to a point on the touch screen 201 to which the first touch input is applied. That is, the controller 180 may display a graphic object related to the selected function based on a point on the touch screen 201 to which the first touch input is applied ( S304 ). Accordingly, the user may display a graphic object related to a specific function selected by the user at a point on the touch screen 201 to which the user first applies a touch input.

Meanwhile, as described above, the second touch input may be classified according to a time for which the first touch input and the touch input are maintained or a touch pressure applied. Therefore, even if the touch input point is the same, if the pressure at which the touch input is maintained varies by more than a preset level or if the touch input is maintained for more than a preset time, the controller 180 receives the currently applied touch input. Needless to say, it may be recognized as a second touch input.

In addition, the user may set items included in the management menu such that a specific item of the management menu displayed by the first touch input, that is, the first touch input, is displayed at a position corresponding to the first touch input. Accordingly, when the user applies a first touch input to a specific point, a management menu in which a specific item preset by the user is displayed may be displayed at the first touch input point. In this state, if the user continues to maintain the first touch input for a preset time or longer or changes the applied pressure, the controller 180 may determine that the second touch input is applied to the specific item, A function corresponding to a specific item can be executed. Accordingly, a graphic object according to a function corresponding to the specific item may be displayed at the first touch input point. Therefore, the user may execute a function according to any one of the items included in the management menu with only one touch input.

As such, examples of displaying a management menu according to a user's first touch input and displaying a graphic object according to any one function included in the displayed management menu will be described in more detail with reference to FIGS. 8 and 11 below. .

Meanwhile, when the graphic object according to the function selected by the user is displayed on the touch screen 201 in step S304 , the controller 180 may store a position where the graphic object is displayed on the touch screen 201 . Accordingly, even when the display panel included in the touch screen 201 is deactivated and then activated again, the controller 180 may display the graphic object again at the same location.

Also, of course, the position of the graphic object may be changed according to a user's input. For example, the controller 180 may detect a user's drag input applied to the graphic object while the graphic object is displayed. In addition, the position at which the graphic object is displayed may be changed according to the direction and length to which the drag input is applied.

Meanwhile, a position where the graphic object is displayed may correspond to a specific food item in the storage room currently displayed through the touch screen 201 . For example, when the user inputs information related to any one food at a point on the touch screen 201 corresponding to any one of the foods identifiable through the touch screen 201, the controller 180 ) may determine that the graphic object corresponds to any one of the foods. Alternatively, when a function for displaying information related to any one of the foods (eg, residual amount information) is selected by the user, the controller 180 displays the measured residual amount information, and the displayed information corresponds to the one food. can be judged as

In this case, the graphic object including the information input by the user or information related to the one food item may be displayed at a position corresponding to the one food item. In this case, the controller 180 may detect a change in the state of food corresponding to the graphic object, and reflect the detected state change in the graphic object. For example, the change in the state of the food may include a movement of the position of the food.

For example, the controller 180 may track the position of the food corresponding to the graphic object whenever a preset condition is satisfied, and may change the position where the graphic object is displayed according to the tracked position. Also, when the food is no longer detected, the controller 180 may no longer display the graphic object.

Here, the preset condition is a state change of the touch screen 201 (eg, a change from a transparent state to an opaque state, or a change from an opaque state to a transparent state) or one of the doors of the refrigerator 100 is opened. ) and close are detected, or may be satisfied in various cases such as expiration of a preset period. In this way, when a graphic object corresponding to a specific food is displayed, an example of the refrigerator 100 according to an embodiment of the present invention in which the position at which the graphic object is displayed is changed according to the position of the corresponding food will be described with reference to FIG. 12 below. Let's take a look in detail.

Meanwhile, in the above description, the case where the touch screen 201 is switched to a transparent state and the inside of the storage compartment corresponding to the door 210 can be identified has been described as an example, but even when the touch screen 201 is in an opaque state It goes without saying that foods stored in the refrigerator 100 may be displayed through the touch screen 201 to be identifiable. For example, the controller 180 may control the camera 141 to display an image sensed from the inside of a specific storage room through the touch screen 201 . That is, the controller 180 may sense an image of the storage room corresponding to any one of the other doors 220 , 230 , 240 according to the user's selection, and display the sensed image on the touch screen 201 . can Then, the user can check the image of the storage room corresponding to any one of the other doors 220, 230, and 240 through the touch screen 201. Accordingly, each door 220, 230, 240 is not opened. Foods stored in the storage compartment can be checked through the touch screen 201 .

On the other hand, when an image of another storage room is displayed as described above, of course, the process of FIG. 3 may be similarly performed for a specific touch screen 201 on which an internal image is displayed on the touch screen 201 . That is, the controller 180 may display a management menu according to a user's touch input while the images of food stored in the other storage compartment are displayed on the touch screen 201 . In addition, any one function may be selected by the user through the management menu, and a graphic object according to the selected function may be displayed on an area on the touch screen 201 .

Meanwhile, the graphic object displayed in this way may correspond to the storage room currently displayed through the touch screen 201 . That is, when a storage room different from the storage room currently displayed on the touch screen 201 is selected by the user, the controller 180 stores the location information of the currently displayed graphic object and stores the location information of the graphic object. You can end the display.

In this case, the location information of the graphic object may include information of a corresponding storage room. Accordingly, when the image of the storage chamber corresponding to the graphic object is displayed again on the touch screen 201 , the graphic object may be displayed again on the touch screen 201 .

Meanwhile, the functions included in the management menu may include a function of automatically displaying information related to food or storage without a separate input applied from the user. For example, the information related to food or storage that can be displayed automatically may include information on the remaining amount of food or information related to the shelf life or storage period of pre-stored food, and an internal image displayed on the current touch screen 201 . This may include operation state information such as humidity or temperature of the displayed storage room.

Meanwhile, the storage rooms according to an embodiment of the present invention may be divided into at least one storage space in which different types of food are stored. In this case, the controller 180 may sense the weight of each storage space. Then, the weight of each storage space may be the total weight of food stored in the storage space. In addition, the total weight may be information on the remaining amount of food stored in the storage space. Alternatively, of course, the controller 180 may measure the remaining amount of each food based on the result of sensing the weight of each stored food (for example, when the storage space is divided into smaller areas, etc.) .

Alternatively, the controller 180 may measure the remaining amount of each food stored in the refrigerator 100 using an image sensed by the camera 141 or the like. For example, in the case of food stored in a container made of a transparent material, such as a glass bottle, and whose residual amount can be measured through the outside, the controller 180 may measure the residual amount of the food based on a result of sensing the container of the corresponding food. Alternatively, even if the food is stored in a container that is not made of a transparent material, the controller 180 determines the degree to which food is filled in the container by using the difference in frequency between the ultrasonic waves outputted from the ultrasonic sensor and the reflected sound reflected from each region of the container. can be measured In addition, the residual amount of food stored in the container may be calculated according to the measured result.

Meanwhile, the calculated information on the amount of food or the remaining amount of each storage space may be displayed according to a function selected through the management menu. For example, the management menu may include a residual amount display function for displaying the remaining amount measured from each food item or storage space, and according to the selection of the remaining amount display function, the measured residual amount information corresponds to each food item or each storage space It can be displayed at a position on the touch screen 201 that becomes In addition, when a user's input for the food or the remaining amount information displayed in each storage space is sensed, the controller 180 may perform a specific function on the food or the storage space according to the user's input. For example, the controller 180 may perform a purchase function for specific foods or foods stored in a specific storage space.

15 and FIG. 15 and FIG. 15 and FIG. 15 and FIG. 15 and FIG. Referring to 16, we will look at it in more detail.

Meanwhile, the management menu may include a function of displaying information directly input from the user in addition to the information automatically displayed according to the user's selection as described above. For example, the controller 180 may receive text information or image information from the user through the touch screen 201 , and display such information on the touch screen 201 in the form of memo or tag information. . In addition, the memo or tag information may be displayed at a location corresponding to a specific food or a specific storage space.

Meanwhile, the controller 180 may perform a preset function according to a specific time limit or a specific numerical value, that is, a set value directly set by the user, and may display the operating state of the performed function. To this end, the controller 180 may display screen information for receiving the input of the specific time limit or a specific setting value on the touch screen 201, and the refrigerator 100 according to a user input through the screen information. can also be controlled. For example, the screen information may be for receiving a setting value related to a specific storage space or a specific storage room including at least one storage space. In this case, the controller 180 may adjust the refrigeration temperature or humidity of the specific storage space or storage compartment according to the input setting value.

Meanwhile, the screen information may receive a specific time limit set by the user. This specific deadline may be created in units of days. In addition, if there is a set value set together with the specific time limit, the controller 180 may adjust a specific storage space or a specific storage room according to the input set value by the number of days according to the specific time limit.

Meanwhile, when such deadline information is input, the controller 180 may display a graphic object for displaying the input deadline information on at least one point of the touch screen 201 corresponding to the food or storage space. These graphic objects may be updated based on a preset specific time point of the day. And according to the updated result, information on calculating the number of days that have elapsed from when the deadline information is input to the present time according to the updated result, or remaining day information obtained by subtracting the number of days elapsed from the set deadline after the deadline information is input may include

Meanwhile, the specific deadline may be set not only for a specific storage room or storage space, but also for specific foods. When a function for setting the specific time limit is selected from a user's touch input applied to an area on the touch screen 201 corresponding to a specific food, the controller 180 may display screen information for receiving the set time limit from the user. can

As such, when a specific time limit is set for a specific food, the controller 180 may display a graphic object for indicating the set time limit according to the screen information on an area on the touch screen 201 corresponding to the specific food. have. As described above, the graphic object may be updated based on a specific time point, and may include the number of days elapsed from the time when a deadline is set to the current time point, or information about the remaining days according to the number of elapsed days. An example in which expiration date information is received from a user for a specific food as described above and remaining day information updated according to the input expiration date information is displayed will be described in more detail with reference to FIGS. 13A and 13B below.

On the other hand, unlike the time limit information, of course, the controller 180 may receive a specific time value set from the user. In this case, the controller 180 may perform time counting according to a timer function driven according to a set time value, so that a specific storage space or a specific storage room is adjusted according to the user's setting for a time set by the user.

4 is a flowchart illustrating an operation process in which a time counting function is performed according to a timer set by a user in the refrigerator 100 according to an embodiment of the present invention.

Referring to FIG. 4 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may display the management menu when a touch input is sensed from the user. In addition, when a timer function is selected through the management menu, a graphic object related to the selected timer function may be displayed on an area on the touch screen 201 ( S400 ).

In this case, the graphic object related to the timer function may be displayed based on the point at which the initial touch input is sensed, that is, the point at which the user touches the touch screen 201 to select the timer function through the management menu. In addition, the controller 180 may set a time value, that is, a time to be counted according to another user's touch input applied to the graphic object. Here, the controller 180 may detect a user input starting at a point around the graphic object, and set the counting time based on the user's drag touch applied along a preset path on the graphic object. can Here, the graphic object may correspond to a circular shape, and the preset path may correspond to a peripheral area of the graphic object corresponding to the circular shape.

Meanwhile, the graphic object related to the timer function may further display at least one other object for displaying a time value set by the user. The at least one graphic object includes a clock-shaped object in which a time according to a user's input is displayed in analog or digital form, or a circle or arc-shaped object whose length or size is changed according to a user's input can do. In addition, the controller 180 may visually display a time set according to a user's input, that is, a counting time, using the at least one other object.

Meanwhile, if the counting time is set in step S402, the controller 180 may count the set time (S404). In addition, the graphic object for displaying the counting time may be changed and displayed according to the counting result. That is, the controller 180 may represent the time reduced according to the time counting in step S404 as a change in the graphic object set in step S402. In addition, when the time counting is completed, notification information for notifying that the time counting is completed may be output (S406).

Meanwhile, the notification information may be displayed as a state change of the touch screen 201 . For example, when the time counting is completed, the controller 180 may change the state of the touch screen 201 from an opaque state to a transparent state and display it. Conversely, when the touch screen is in a transparent state, the controller 180 may opaquely display only one region on the touch screen 201 in which a graphic object for displaying the time counting is displayed. In addition, when the time counting is completed, only one area on the touch screen 201 on which notification information for notifying of this is displayed may be displayed opaquely. When the notification information is displayed in this way, the controller 180 detects a user's input (eg, a touch input) for the notification information, and makes the area in which the notification information is displayed to a transparent state again based on the user's input. can be switched

Meanwhile, the time value may be set for a specific food rather than a specific storage room or storage space. For example, the time value may be used to ripen food stored in the refrigerator for a preset time. In this case, the time counting may be used to accurately display the aging time of the food.

Meanwhile, the controller 180 may display the time counting result differently according to whether the time value set by the user is for a specific food or for a specific storage room or storage space. For example, when the time value is set for a specific food, the controller 180 may display a graphic object corresponding to the time counting result on an area on the touch screen 201 corresponding to the specific food. On the other hand, when the time value is set for a specific storage room or a specific storage space, a graphic object corresponding to the time counting result may be displayed to be distinguished from that set for the specific food.

5 is a flowchart illustrating an operation process of classifying time counting according to a target for which a timer is set in the refrigerator 100 according to an embodiment of the present invention.

Referring to FIG. 5 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention is an area on the touch screen 201 corresponding to each of the foods that are currently identifiable through the touch screen 201 . can be identified (S500). To this end, the controller 180 may use images sensed from each storage room of the refrigerator 100 . That is, the controller 180 may analyze the images sensed from each storage room, and may distinguish regions corresponding to food from each image and an area in which food is not stored, that is, an empty region.

Meanwhile, the controller 180 may receive a timer function selection based on a touch input applied from the user. For example, the controller 180 may display the management menu on the touch screen based on the user's touch input (first touch input). In addition, the timer function may be selected from another user's other touch input (second touch input) applied to the displayed management menu. In addition, the counting time may be set according to a user's input to the graphic object displayed according to the selection of the timer function (S502).

On the other hand, when the counting time is set in this way, the controller 180 can determine whether the currently set counting time is for a specific food or for a storage room that is currently displayed through the touch screen 201 ( S504).

For the determination of step S504, the controller 180 compares a point to which a touch input applied to receive selection of the timer function is applied, and regions on the touch screen 201 corresponding to foods that are currently identifiable and displayed. can For example, when the touch screen 201 is in a transparent state, the controller 180 may identify the region corresponding to the food from the image of the storage room corresponding to the door 210 on which the touch screen 201 is formed. have. On the other hand, if the touch screen 201 is not in a transparent state but displays an image inside a specific storage room, the controller 180 selects an area corresponding to the food from the image of the storage room displayed through the touch screen 201 . can be identified. Meanwhile, the touch input applied to select the timer function may be the first touch input applied to the touch screen 201 , that is, the first touch input.

On the other hand, if the first touch input point is applied to an area on the touch screen 201 corresponding to any one of the identifiable food items, the controller 180 determines that the counting time set in step S504 is specified. It may be determined as food, that is, any one food corresponding to a point to which the first touch input is applied. Then, the controller 180 may perform time counting according to the currently set time, and display a graphic object representing a time decreasing according to the counted time on an area on the touch screen 201 corresponding to the specific food ( S506).

On the other hand, if the first touch input point is not applied to an area on the touch screen 201 corresponding to any one of the identifiable foods, the controller 180 controls the counting time set in step S502. It can be determined that this is for a specific storage room whose interior is currently shown on the touch screen 201 . Then, the controller 180 may perform time counting according to the currently set time, and display a graphic object indicating a time decreasing according to the counted time on a preset area on the touch screen 201 . Here, the preset area may be a touch input applied for the timer function, that is, an area formed around a first touch input point.

Meanwhile, in steps S504 and S506, a graphic object displaying a time decreasing according to the counted time may be displayed differently depending on whether the counting time is set for a specific food or not. An example in which time counting is performed according to a time value set by a user in a specific food or a specific storage room will be described in more detail with reference to FIGS. 14A and 14B below.

Meanwhile, in the above description, when the point to which the touch input is applied is not a region corresponding to a specific food, the currently set time value is determined to be for a specific storage room as an example. Of course, in the case of being divided, the controller 180 may further determine whether the currently set time value is for any one of the plurality of storage spaces.

For example, when the first touch input is applied to an area on the touch screen 201 corresponding to a partition wall for dividing the storage room into a plurality of storage spaces, the controller 180 may set a currently set time value to the entire storage room. It can be determined that it is set for On the other hand, the controller 180, in a state in which the first touch input is not applied to an area on the touch screen 201 corresponding to a specific food, the first touch input is a touch corresponding to any one of the plurality of storage spaces. When applied to an area on the screen 201 , it may be determined that the currently set time value is set for any one of the storage spaces.

Accordingly, when it is determined that the first touch input is not applied to a specific food item, the controller 180 determines that the current It is possible to distinguish whether the set time value is set for the entire storage room or is set for any one storage space included in the storage room. In addition, according to the divided result, time counting according to the currently set time value for the entire storage room or a specific storage space may be performed and a process of performing the time counting may be displayed differently.

On the other hand, as described above, the controller 180 of the refrigerator 100 according to the embodiment of the present invention can be identifiable through the touch screen 201 from the image inside the storage room shown on the touch screen 201 . It is possible to sense the food selected by the user's touch input among the lost foods. For example, the controller 180 identifies a region corresponding to each food from the image inside the storage compartment displayed on the touch screen 201, and selects the food selected by the user from the region corresponding to the touch input point applied from the user. can be identified.

As such, when any one food is selected, the controller 180 of the refrigerator 100 according to an embodiment of the present invention may display various information related to the selected food. As described above, the information may be information on the amount of the selected food, that is, the remaining amount, or information related to the expiration date or storage period of the selected food. When there is preset shelf life information or storage expiration date information for the selected food as described above, the controller 180 may display the expiration date information or storage expiration date information on the area on the touch screen 201 corresponding to the selected food. have.

For example, when a deadline according to a preset date, such as the expiration date or storage deadline, is designated in advance, the controller 180 may set the designated deadline for the currently selected food. In this case, the controller 180 may set the expiration date of the currently selected product based on the date set according to the expiration date or the storage duration. In addition, information on the number of remaining days may be displayed based on the number of days between the date corresponding to the set deadline and the current date. In addition, the information related to the number of days remaining may be displayed on one area of the touch screen 201 corresponding to the selected food. In addition, the controller 180 may update the information on the number of remaining days as time elapses and display the updated information.

Meanwhile, various information as well as residual amount information of the selected food, purchase information, or information related to the expiration date or storage period, may be further displayed according to the user's selection. For example, the controller 180 of the refrigerator 100 according to an embodiment of the present invention may output information on at least one food recipe on the touch screen 201 according to a user's selection. The recipe information may be any one selected by the user from among recipes pre-stored in the memory 170 .

Meanwhile, as described above, the controller 180 of the refrigerator 100 according to an embodiment of the present invention may detect a user's selection of any one of the foods displayed through the touch screen 201 . Using this, the controller 180 extracts, from among the recipes stored in the memory 170 , only recipes of food containing the currently selected food as a food ingredient from the memory 170 , and displays the extracted recipe information on the touch screen ( 201) can be displayed.

6 is a flowchart illustrating an example of an operation process in which recipe information according to the selected food is output in the refrigerator 100 according to an embodiment of the present invention in this case.

Referring to FIG. 6 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may detect a touch input sensed in an area on the touch screen 201 ( S600 ). In addition, the controller 180 may identify a specific food corresponding to the touch input in step S600 from among the foods identifiable through the touch screen 201 ( S602 ). On the other hand, if the touch screen 201 is in an opaque state, the touch screen 201 receives a specific food selection from the user according to an additional touch input applied from the user while the touch screen 201 is converted to a transparent state according to the touch input. may be

Meanwhile, when any one of the foods displayed through the touch screen 201 is selected according to the touch input in step S602, the controller 180 displays a management menu for selecting a function related to the selected food on the touch screen ( 201) may be displayed in one area (S604). Here, the management menu may include a function of outputting a recipe corresponding to the currently selected food.

In addition, when a recipe function is selected through the management menu 800 , the controller 180 may display a list of at least one recipe related to the currently selected food on the touch screen 201 ( S604 ). For example, the controller 180 may detect at least one recipe including the currently selected food as a food ingredient from among the food recipes pre-stored in the memory 170 and output it on the touch screen 201 .

In addition, the controller 180 may detect the user's selection of any one of the output recipes. And information on any one of the selected recipes may be displayed on the touch screen 201 (S608). Here, the controller 180 may classify the currently selected recipe into a plurality of stages, and display information on the divided recipe for each stage on the touch screen 201 . As described above, an example in which a list of recipes related to a specific food is displayed according to the user's selection and any one of the recipe lists according to the user's selection is displayed on the touch screen 201 in more detail with reference to FIG. 17 below. do it with

Meanwhile, it goes without saying that the recipe displayed in step S608 may be transmitted to at least one preset external device according to a user's selection. For example, the controller 180 may transmit the currently selected recipe information to an external device such as a specific mobile terminal according to a user's request. Then, the same recipe information as the recipe information displayed through the touch screen 201 may be displayed in the mobile terminal. In this case, the controller 180 may transmit recipe information divided into stages according to the user's selection, and the step-by-step recipe information may be sequentially transmitted to the mobile terminal according to the user's selection. Alternatively, the controller 180 may transmit only recipe information of a specific step among the recipes divided into steps according to a user's selection.

Meanwhile, when a specific recipe is selected, the refrigerator 100 according to an embodiment of the present invention may display various information related to the selected recipe on the touch screen 201 . For example, the related information may include a list of ingredients necessary for cooking food corresponding to the recipe.

In this case, the controller 180 according to an embodiment of the present invention displays a storage room in which food corresponding to the ingredient food is stored among foods currently stored in the refrigerator or a storage space in which the food is estimated to be stored on the touch screen 201 . can also be displayed. 7 is a flowchart illustrating an operation process of displaying information related to a food ingredient according to a user's selection from a list of ingredients of a selected recipe in the refrigerator 100 according to an embodiment of the present invention in this case.

Referring to FIG. 7 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention displays a list of ingredients included in the selected recipe as related information on the selected recipe on the touch screen 201 . You can (S700).

Meanwhile, when any one of the food ingredients is selected by the user from the list of ingredients, the controller 180 may display information on food related to the selected ingredient food on the touch screen 201 ( S702 ). Here, the food information related to the selected food ingredient may be information on a specific storage room in the refrigerator 100 in which food corresponding to the selected ingredient food is stored. That is, when the user selects any one of the food ingredients, the controller 180 controls the inside of the storage compartment in which the corresponding food among the foods stored in the refrigerator 100 can be identified through the touch screen 201 . The touch screen 201 may be controlled.

For example, if the food corresponding to the selected food ingredient is stored in the storage room corresponding to the door 210 on which the touch screen 201 is currently formed, the controller 180 switches the touch screen 201 to a transparent state. can do. Accordingly, the user can immediately check the remaining amount of the food ingredient selected by the user through the touch screen 201 converted to the transparent state.

On the other hand, the food corresponding to the selected food material is stored in a storage room different from the storage room corresponding to the door 210 on which the touch screen 201 is currently formed, that is, for example, any one of the other doors 220 , 230 , and 240 . If it is stored in a storage room corresponding to the door, the controller 180 may display an image of the storage room in which the food is stored through the touch screen 201 . Accordingly, the user can immediately check the remaining amount of the food ingredient selected by the user through the image displayed through the touch screen 201 .

And in a state where the remaining amount of food ingredients selected by the user can be identified through the touch screen 201 , the controller 180 may perform various functions based on a touch input applied to the touch screen 201 . For example, the controller 180 may detect a user's touch input for any one of the foods currently displayed through the touch screen 201 . In response to the user's touch input, a function of purchasing food corresponding to the touch input may be performed (S704).

For example, in step S704 , the controller 180 may display information related to a place of purchase from which the selected food can be purchased on the touch screen 201 . For example, information for ordering the selected food by phone or online or an online purchase site for directly purchasing the selected food or a screen of the connected site may be displayed on the touch screen 201 . In addition, according to a user input applied through the touch screen 201 , the purchase process of the selected food may be performed.

Meanwhile, the purchase process may include a process of transmitting the remaining amount information to a preset external device. For example, the step S704 may be a process of transmitting information related to the selected remaining amount of food to a preset other user or a user's mobile terminal. In this case, the remaining amount-related information may include information sensing an image of a storage room or storage space in which the food is stored. Accordingly, the user who has received the remaining amount information may accurately check the remaining amount of food ingredients based on the image included in the remaining amount information, and purchase accordingly.

Meanwhile, in a state where the remaining amount of food ingredients selected by the user can be identified through the touch screen 201, the controller 180 may proceed to step S700 in which the food ingredient list is displayed again when the user's preset input is input. . Here, the preset input may be a touch input that forms a preset pattern, maintains a touch state for more than a preset time, or a touch input that applies a pressure equal to or greater than a preset level.

Meanwhile, in the above description, an example in which any one of the recipes stored in the memory 170 is selected and displayed on the touch screen 201 has been described, but the present invention is not limited thereto. That is, the recipe information may be transmitted to the refrigerator 100 from any external device. That is, for example, when recipe information is received from an external device such as a user's mobile terminal, the controller 180 performs mirroring with the mobile terminal, so that the recipe information displayed through the mobile terminal can be touched. Of course, it is also possible to display the same on the screen 201 .

Meanwhile, in the above description, the operation flow of the refrigerator 100 according to an embodiment of the present invention has been described in detail with reference to a plurality of flowcharts.

In the following description, in the refrigerator 100 according to an embodiment of the present invention, an example in which a management menu including various functions is displayed according to a user's touch input and a graphic object according to a function selected through the management menu are displayed on the touch screen. Various examples displayed on 201 will be described in more detail with reference to a plurality of exemplary drawings.

First, FIG. 8 is an exemplary diagram illustrating an example in which tag information is generated according to a user's touch input and the generated tag information is displayed in the refrigerator 100 according to an embodiment of the present invention.

First, referring to the first drawing of FIG. 8 , the first drawing of FIG. 8 shows a management menu displayed on the touch screen 201 formed on one door 210 of the refrigerator 100 according to an embodiment of the present invention. it is showing an example. When a first touch input is applied to the touch screen 201 in a state in which the touch screen 201 is converted to transparent, the controller 180 controls the management menu 800 as shown in the first diagram of FIG. 8 . ) may be displayed on one area on the touch screen 201 .

The management menu 800 may include items 802.804, 806, and 808 corresponding to various functions as described above. For example, these items are a graphic object in the form of a sticker, and the first item 802 corresponding to a function capable of displaying the name of a specific food, information related to the expiration date or storage period, or information on the ingredient or residual amount of the food. ) may be included. Alternatively, a second item 804 corresponding to a function of generating specific food or tag information including text information or voice information written by a user with respect to a storage space in which the specific food is stored may be included. In addition, the management menu may include a third item 806 corresponding to a memo function that allows a user to memo useful information using the touch screen. Alternatively, the management menu may include a fourth item 808 corresponding to a timer function for setting a specific food or a time or a deadline that the user wants to set arbitrarily for a specific food or a storage space in which the specific food is stored.

Meanwhile, the management menu 800 illustrated in FIG. 8 is only an example of a management menu displayed on the refrigerator 100 according to an embodiment of the present invention, and the present invention is not limited thereto. That is, the management menu 800 may include items corresponding to any number of different functions, or may include more or fewer items.

Meanwhile, in the state in which the management menu 800 including the first to fourth items 802 to 808 is displayed, as shown in the first drawing of FIG. When a touch input is applied, the controller 180 may display a graphic object related to a function corresponding to the first item 802 on the touch screen 201 .

Meanwhile, as in the first item 802, when a sticker function capable of including a variety of different information is selected, the controller 180 provides screen information for receiving a user's selection of content to be displayed through the sticker function. It can be displayed on the touch screen 201 . The second diagram of FIG. 8 shows an example of screen information for receiving the user's selection of information to be displayed through the sticker function when the user selects the sticker function.

As shown in the second drawing of FIG. 8 , when the user selects a sticker function, the controller 180 receives information that can be displayed at a point on the touch screen 201 according to the sticker function from the user. A sticker page 810 for this purpose may be displayed on an area on the touch screen 201 . And, as shown in the second drawing of FIG. 8 , the user through the sticker page 810 , a tag sticker 812 , or a heart health-related component, generated according to voice information or text information that can be arbitrarily inputted. : 814), High Protein: 816, Gluten free (Gluten free: 818) You can select a sticker to indicate that it is a component.

In this case, as shown in the second drawing of FIG. 8 , if the user selects the tag sticker 812 from the sticker page 810 , the controller 180 generates the tag sticker in FIG. 8 . As shown in the third figure of , screen information 820 for receiving voice information or text information from a user may be displayed on the touch screen 201 .

Meanwhile, as shown in the third drawing of FIG. 8 , when screen information 820 for receiving the user's voice information or text information is displayed, the controller 180 controls the text input means displayed on the touch screen 201 . Text can be input through (eg, English or Korean keyboard). Alternatively, the controller 180 may recognize the user's voice detected through the microphone as text according to the user's selection and receive the recognized text. In addition, as shown in the fourth drawing of FIG. 8 , a tag sticker 830 including the input text may be displayed on an area on the touch screen 201 . In this case, the tag sticker 830 may be displayed based on the first applied touch input, that is, the point at which the first touch input is applied.

Meanwhile, according to the above description, the refrigerator 100 according to an embodiment of the present invention displays a graphic object according to a function selected from the management menu 800 on the touch screen 201 based on a point at which a touch input is applied. It has been explained that it can be displayed in the area. Also, as described above, the controller 180 may display the management menu 800 so that a specific item included in the management menu 800 corresponds to a point where the touch input is applied, and the touch input It has been mentioned that a function corresponding to the specific item is executed based on the maintained time or the pressure applied from the touch input, so that the user can execute the specific function of the management menu 800 by one-touch input. have.

9 is an exemplary diagram illustrating an example of generating tag information by a single touch input by a user in the refrigerator 100 according to an embodiment of the present invention.

First, referring to the first drawing of FIG. 9 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may detect a touch input applied to a point 900 on the touch screen 201 . have. In this case, the controller 180 may display the management menu 800 on the touch screen 201 based on the touch input point 900 .

For example, the controller 180 manages the touch input point 900 to correspond to a specific item previously designated by the user among the items 802 , 804 , 806 , and 808 included in the management menu 800 . The menu 800 may be displayed on the touch screen 201 . In this case, if the specific item is the first item 802 corresponding to the sticker function, as shown in the second diagram of FIG. 9 , the touch input point 900 is set to the first item 802 . The management menu 800 may be displayed on the touch screen 201 to include the area.

In this state, the controller 180 may sense the user's touch input again. For example, if the user selects another item in the management menu 800 within a preset time, the controller 180 may execute a function corresponding to the other selected item. In addition, a graphic object according to the executed function may be displayed on the touch screen 201 .

However, if the user continues to maintain the touch input, the controller 180 executes a function corresponding to a specific item of the management menu 800 corresponding to the touch input point 900 , that is, the first item 902 . can Accordingly, the controller 180 may display the sticker page 810 on the touch screen 201 as shown in the third drawing of FIG. 9 .

Meanwhile, the sticker page 810 may also be displayed to correspond to a sticker previously designated by the user, similarly to the management menu 800 . For example, if the user has designated a tag sticker in advance, the controller 180 controls the touch input point 900 so that the area corresponding to the tag sticker includes the sticker page ( 810) can be displayed. And in this state, if the user continues to keep the touch input, the controller 180 may execute a function of generating the currently selected sticker, that is, a tag sticker, and may display a tag sticker including voice information or text information input from the user. can create And, as shown in the fourth drawing of FIG. 9 , the generated tag sticker 910 may be displayed on one area on the touch screen 201 .

Meanwhile, the tag sticker 910 may be displayed based on the touch input point 900 . That is, as shown in the fourth drawing of FIG. 9 , the controller 180 maintains the input point of the touch input until the area 812 corresponding to the tag sticker is selected in the state where the first touch input is applied. The tag sticker 910 may be displayed around 900 . Accordingly, the present invention allows a user to select a specific function from the management menu 800 through a one-touch input, and a graphic object related to the selected function is displayed at a point on the touch screen 201 to which the one-touch input is applied. can make it happen

Meanwhile, in the description of FIGS. 8 and 9 , the case in which the touch screen 201 is in a transparent state has been described as an example, but the touch screen 201 formed in the refrigerator 100 according to an embodiment of the present invention is not provided under a preset condition. It is possible to switch to a transparent state or an opaque state depending on whether

10 is an exemplary diagram illustrating an example in which the state of the touch screen 201 formed on one door of the refrigerator according to an embodiment of the present invention is changed according to a user's selection.

As described above, the touch screen 201 may be switched to a transparent state or an opaque state when a preset condition is satisfied. In addition, it may be determined whether this condition is satisfied depending on whether there is a user adjacent to the refrigerator 100 . Alternatively, it may be satisfied when a touch input applied on the touch screen 201 is applied.

Meanwhile, the preset condition may be satisfied according to a preset input of the user. In addition, the preset input may be a plurality of touch inputs forming a preset pattern or a touch input applied to at least one preset graphic object on the touch screen 201 . For example, the at least one graphic object may be displayed on a preset area of the touch screen 201 . 10 (a) and (b) show an example in which a graphic object 1000 or 1010 capable of receiving a selection of state transition of the touch screen 201 is displayed in an area adjacent to the vertex of the bottom edge of the touch screen 201 are assumed to be

First, referring to FIG. 10A , the first diagram of FIG. 10A shows an example in which the entire area of the touch screen 201 is in an opaque state. In this case, the controller 180 may maintain the display panel included in the touch screen 201 in an inactive state or display preset screen information.

For example, the screen information may include an area in which text characters related to the current date and weather are displayed. The weather information may include current temperature and humidity (Humidity, 'HUM.'), and information related to a current weather situation. That is, if the current weather is rainy weather, the controller 180 transmits weather information including rainfall amount (Rainfall, 'RAIN') information as information related to the current weather situation, that is, a rain situation, to an area of the screen information. can be displayed

Meanwhile, the screen information may include an area in which at least one graphic object corresponding to current weather information is displayed. Therefore, if the current weather condition is a rainy condition as described above, the controller 180 may display at least one graphic object having various different sizes simulating a raindrop shape on one area of the screen information. . In this case, the number of the graphic objects may be determined according to the current amount of precipitation. That is, the controller 180 may display more raindrop-shaped graphic objects when the amount of precipitation is large than when the amount of precipitation is small.

Meanwhile, the screen information may include an area in which information related to a subject preset by the user is displayed. For example, the controller 180 may display information related to the preset topic through image information such as text, image, or video. Accordingly, when news information is selected by the user, the controller 180 may display news information broadcast through a news broadcasting channel through the screen information.

In addition, graphic objects 1000 and 1010 for changing the state of the touch screen 201 may be displayed in regions of both ends of the bottom edge of the touch screen 201 .

First, the first object 1000 may be for receiving a user selection for converting the entire touch screen 201 to a transparent state. Accordingly, as shown in the first drawing of FIG. 10 ( a ), when a user input is sensed in the area on the touch screen 201 where the first object 1000 is displayed, the controller 180 controls FIG. 10 (a) ), the entire area of the touch screen 201 may be switched to a transparent state. Then, the entire touch screen 201 may become transparent, and the user may check the food stored in the storage compartment corresponding to the door 210 through the entire area of the touch screen 201 .

On the other hand, the second object 1010 may be for receiving a user selection for converting the entire touch screen 201 to an opaque state. Therefore, as shown in the first drawing of FIG. 10( b ), a user enters an area on the touch screen 201 where the second object 1010 is displayed in a state in which the entire area of the touch screen 201 is converted to transparent. When the input of is applied, the controller 180 may convert the entire area of the touch screen 201 to an opaque state. Then, the entire area of the touch screen 201 may be opaque so that the food stored in the refrigerator 100 is not visible, and the controller 180 displays preset image information as shown in the second drawing of FIG. 10 ( b ). Alternatively, the display panel may be kept in an inactive state.

Meanwhile, in the above description, an example has been described in which graphic objects 1000 and 1010 for converting the touch screen 201 to a transparent state or an opaque state are respectively displayed on the touch screen 201 , but differently Of course, only one graphic object may be displayed on the touch screen 201 .

For example, the controller 180 may display only one first object 1000 on the touch screen 201 in the first drawing of FIG. 10A . In this state, when the user selects the first object 1000 , the controller 180 may convert the touch screen 201 to a transparent state as shown in the second drawing of FIG. 10A .

In this state, the controller 180 may detect whether a user input is applied to the first object 1000 . And when the first object 1000 is selected again, the controller 180 may change the state of the touch screen 201 back to the opaque state. In this case, the controller 180 may display preset screen information on the touch screen 201 or maintain the display panel in an inactive state.

Meanwhile, when only one graphic object is displayed as described above, it goes without saying that the controller 180 may display different graphic objects according to the current state of the touch screen 201 . For example, when the touch screen 201 is in a transparent state, the controller 180 displays a graphic object having the same shape as the first object 1000 as a graphic object for receiving a selection of a state transition of the touch screen 201 . can do. On the other hand, when the touch screen 201 is in an opaque state, the controller 180 displays a graphic object having the same shape as the second object 1010 as a graphic object for receiving a selection of a state transition of the touch screen 201 . can

Meanwhile, even when the user's touch input is not applied as described above, the controller 180 may switch the display panel of the touch screen 201 to an inactive state. For example, the controller 180 may maintain the display panel in an inactive state when a preset time elapses in a state in which no user is detected in the vicinity. Then, the touch screen 201 may be switched to an opaque state.

Meanwhile, according to the above description, the refrigerator 100 according to an embodiment of the present invention displays, through the touch screen 201 , an image of a storage room corresponding to another door other than the door 210 on which the touch screen 201 is formed. It has been described that it can be displayed on the touch screen 201 .

11 illustrates an example in which an image corresponding to a specific storage room is displayed through the touch screen 201 according to a user's selection as described above.

First, referring to the first and second drawings of FIG. 11 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention responds to a touch input applied to the touch screen 201 in an opaque state. In response, the touch screen 201 may be switched to a transparent state. Then, as shown in the second drawing of FIG. 11 , the interior 1100a of the first storage compartment 1100 corresponding to the door 210 on which the touch screen 201 is formed is identified through the transparent touch screen 201 . can be shown as possible.

Meanwhile, in this state, when a preset input is applied by the user, the controller 180 controls each of the doors 210 , 220 , 230 , and 240 of the refrigerator 100 as shown in the third diagram of FIG. 11 . A graphic object 1110 for selecting any one of the storage rooms 1100 , 1102 , 1104 , and 1106 corresponding to may be displayed. And in this state, when an area 1120 corresponding to a specific storage room is selected from the graphic object 1110 by the user, the controller 180 displays an image sensed from the specific storage room corresponding to the selected area 1120 on the touch screen. (201) can be displayed.

For example, when one region 1120 of the graphic object 1110 corresponds to the third storage compartment 1104 of the refrigerator 100 , the controller 180 controls the third storage compartment 1104 through the touch screen 201 ( 1104) may display an image sensed. Then, on the touch screen 201 , as shown in the fourth drawing of FIG. 11 , the internal image 1104a of the third storage chamber 1104 may be displayed on the touch screen 201 .

Meanwhile, according to the above description, in the refrigerator 100 according to an embodiment of the present invention, a graphic object may be generated to correspond to a specific food, and in this case, the position of the corresponding graphic object may be changed according to the position of the specific food. It has been mentioned that it can

In this case, in the refrigerator 100 according to an embodiment of the present invention, FIG. 12 is an exemplary diagram illustrating an example in which the displayed position of tag information corresponding to a specific food is changed according to the movement of the position of the food.

First, the controller 180 of the refrigerator 100 according to an embodiment of the present invention may display a graphic object corresponding to a specific food on the touch screen 201 according to a function selected by the user. For example, when a sticker function including information related to a specific food is selected by the user while a specific food is selected by the user, the controller 180 converts the food-related information into a graphic object in the form of a sticker to correspond to the specific food. It can be displayed at a position on the touch screen 201 that becomes The first drawing of FIG. 12 shows such an example, in which a sticker object 1200 including information on the residual amount of a specific food ('olive oil': 1210) is a touch screen 201 corresponding to the food 1210. It shows an example displayed in the position of the image.

In this state, when a preset condition is satisfied, the controller 180 may track the position of the food corresponding to the graphic object 1200 . For example, when the preset condition is satisfied, such as when the state of the touch screen 201 is changed, when the preset time expires, or when it is detected that the refrigerator 100 door is opened and closed For example, by re-sensing the image inside the storage room, and comparing the newly sensed image with the image sensed before the preset condition is satisfied, the position movement of the food 1210 may be detected. That is, as shown in the second drawing of FIG. 12 , when the position of the food 1210 to which the graphic object 1200 is set is moved to the side, the controller 180 detects the movement of the food 1210 . can

On the other hand, when the position movement of the food 1210 is detected, the controller 180 may detect the current position of the food 1210 . For example, the controller 180 may detect the position of the food 1210 from an image of a storage room in which the food 1210 is currently stored. On the other hand, when the position of the food 1210 is not detected from the current storage compartment, the controller 180 may also detect the position of the food 1210 from other storage compartments. In addition, if the food 1210 is not detected even from other storage rooms, the controller 180 may not display the graphic object 1200 corresponding to the food 1210 any longer.

Meanwhile, when the changed position of the food 1210 is detected, the controller 180 may change the display position of the graphic object 1200 according to the current position of the food 1210 . That is, as shown in the third drawing of FIG. 12 , when the food 1210 moves to the empty space on the left, the controller 180 moves the graphic object 1200 to the left according to the food 1210 . can do it Therefore, as shown in the fourth drawing of FIG. 12 , the graphic object 1200 set in the food 1210 is displayed on the area on the touch screen 201 corresponding to the position of the food 1210 moved to the left. can

Meanwhile, if the location of the food 1210 is changed to another storage room, the controller 180 may display the graphic object 1200 at a location corresponding to the food 1210 moved to the other storage room. is of course In this case, when the inside of the storage compartment in which the food 1210 is currently stored is viewed through the touch screen 201 , the controller 180 controls the graphic object at a position on the touch screen 201 corresponding to the food 1210 . (1200) can be displayed.

Meanwhile, according to the above description, it has been mentioned that the refrigerator 100 according to the embodiment of the present invention can receive an arbitrary time limit set from the user and change and display information indicating the set time limit as time elapses.

13A and 13B show an example in which tag information indicating an arbitrary time limit set by a user is generated in the refrigerator 100 according to an embodiment of the present invention, and information displayed in the tag information is changed over time. Exemplary diagrams showing examples of

First, referring to FIG. 13A , the first diagram of FIG. 13A is a diagram showing an example in which any one of the foods displayed on the touch screen 201 is selected by the user. As shown in the first drawing of FIG. 13A , the user touches a region on the touch screen 201 on which a specific food 1300 is displayed or a graphic object 1310 corresponding to the specific food 1300, The food 1300 for which information is to be set may be selected.

Then, as shown in the second drawing of FIG. 13A , the controller 180 may display screen information 1320 for receiving the deadline information on the touch screen 201 . For example, the screen information 1320 for receiving the deadline information includes graphic objects for which an increase or decrease of a deadline can be selected, and an area 1324 where a deadline selected by the graphic objects can be displayed. may include In addition, the screen information 1320 may include calendar information displayed based on the current date, and the deadline information may be input according to a user's touch input applied to the calendar information.

Meanwhile, as shown in the second drawing of FIG. 13A , in the calendar information, one area 1322 on the touch screen 201 corresponding to the current date (11 days) may be displayed to be distinguished from other dates. In this state, when a touch input applied to the region 1322 corresponding to the current date is sensed, the controller 180 may set deadline information based on dates set from the touch input. That is, as shown in the third drawing of FIG. 13A , when the user applies a drag input 1332 from the area 132 corresponding to the current date to the area corresponding to '13 days' 3 days later, that is, The controller 180 may receive the deadline information as 3 days based on the drag input. In this case, the controller 180 may separately display the area 1330 of dates corresponding to the drag input 1332 so that the dates set according to the drag input 1332 can be distinguished from other dates. of course there is

Meanwhile, as shown in the third drawing of FIG. 13A , when the deadline is set to 3 days, the controller 180 may display deadline information indicating the currently set deadline on one area on the touch screen 201 . More preferably, as shown in the fourth diagram of FIG. 13A , the controller 180 may display the expiration date information 1340 on the area on the touch screen 201 corresponding to the currently selected food 1300 . Accordingly, the controller 180 can set a time limit for a specific food by the user arbitrarily, and this time limit can be used as information on the expiration date or storage period for the food.

Meanwhile, when the deadline information is set in this way, the controller 180 may update the deadline included in the deadline information as time elapses and display the updated deadline. 13B shows an example of such a case.

Referring to FIG. 13B , the controller 180 according to an embodiment of the present invention may display expiration information 1350 set for a specific food 1300 in a manner similar to that described with reference to FIG. 13A . In this state, the controller 180 may update the deadline included in the deadline information 1350 as time elapses and display the updated deadline.

The controller 180 may update the deadline information 1350 based on a specific time point, for example, midnight. That is, each time midnight passes, the controller 180 may display the number of days displayed through the time limit information 1350 by subtracting 1 from the number of days. That is, in the first drawing of FIG. 13B , if the deadline included in the deadline information 1350 indicates the number of days of 5 days, the controller 180 controls when midnight has elapsed twice, that is, after 2 days have elapsed. may be displayed through the information 1350 from which 2 days have been subtracted, that is, the deadline of 3 days is left, as shown in the second drawing of FIG. 13B .

Meanwhile, the controller 180 may continuously update the time limit information 1350 as time elapses. Therefore, when all the days included in the deadline information 1350, that is, 5 days have elapsed, the controller 180 controls the deadline information 1350 indicating that the remaining deadline is 0 days as shown in the third diagram of FIG. 13B . ) can be displayed. In this state, when the deadline has elapsed, the controller 180 may display, on the touch screen 201, deadline information 1350 for indicating that the set deadline has elapsed, as shown in the fourth diagram of FIG. 13B . can Accordingly, the controller 180 may display, through the expiration date information 1350 , that the expiration date for storing the food corresponding to the expiration date information 1350 has passed the currently set expiration date.

Meanwhile, in the above description, it has been mentioned that the position of the graphic object displayed on the touch screen 201 may be moved according to the user's drag input. 13C below shows such an example.

First, the first drawing of FIG. 13C shows an example in which a graphic object 1350 according to a user's input is displayed on the touch screen 201 . As such, when the graphic object 1350 is displayed on the touch screen 201 , the controller 180 may detect a user input applied to the graphic object 1350 .

The second diagram of FIG. 13C shows an example in which a user's touch input is applied to the graphic object 1350 as described above. As shown in the second drawing of FIG. 13C , when a user's touch input applied to the graphic object 1350 is sensed, the controller 180 may perform various functions according to the touch input. For example, the controller 180 may cause another function related to the graphic object 1350 to be performed according to the touch input.

On the other hand, the user's touch input 1360 applied to the graphic object 1350, as shown in the third diagram of FIG. 13C , is another second input on the touch screen 201 from a point 1360 to which the current touch input is applied. It may be a drag input applied to two points 1370 . And as shown in the third drawing of FIG. 13C , when a drag input is applied following a user's touch input, the controller 180 may change a position at which a graphic object is displayed according to the drag input. Therefore, as shown in the fourth drawing of FIG. 13C , the controller 180 can move the position where the graphic object 1350 is displayed to the second point 1370 on the touch screen 201 according to a drag input. have.

Meanwhile, according to the above description, it has been mentioned that the refrigerator 100 according to an embodiment of the present invention can receive a timer function selection from a user and display a graphic object related to the selected timer function on the touch screen 201 . have.

14A and 14B are exemplary views illustrating an example in which a timer function is set for a specific food or a specific storage room in the refrigerator 100 according to an embodiment of the present invention.

First, referring to the first drawing of FIG. 14A , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may sense a user's touch input applied to the touch screen 201 . Then, the controller 180 may display on the touch screen 201 a management menu 800 from which the user can select a timer function based on the touch input.

Meanwhile, the management menu 800 may be displayed on an area on the touch screen 201 based on the point 1410 to which the touch input is applied. For example, as shown in the second drawing of FIG. 14A , the controller 180 may display the management menu 800 centered on the touch input point 1410 . In this state, the controller 180 may detect a user's input to the timer function item included in the management menu 800 and execute the timer function according to the sensed user's input.

Meanwhile, when the timer function is executed, the controller 180 may display a graphic object 1430 related to the timer function on the touch screen 201 . In addition, a time to be counted may be set according to a user input applied to the graphic object 1430 . For example, the graphic object 1430 may have a clock or circle shape, as shown in the third drawing of FIG. 14A , and the user's input applied to the graphic object 1430 is the graphic object It may be a user's drag input 1420 applied along the circumference of 1430 . In addition, the controller 180 may receive a time set based on the drag input 1420 and perform counting of the set time.

On the other hand, when time counting is performed after the time setting is completed as described above, the controller 180 displays the current time counting state through the time counting object 1440 as shown in the fourth drawing of FIG. 14A. can In this case, the time counting object 1440 may include information on the current remaining time (eg, 45 minutes), and a state in which the remaining time decreases with the lapse of time may be displayed.

Meanwhile, as shown in the first drawing of FIG. 14A , the touch input may be applied to a region on the touch screen 201 corresponding to a specific food 1400 . In this case, the controller 180 may determine that the timer function selected in the second drawing of FIG. 14A is set for the food 1400 corresponding to the touch input point 1410 . Accordingly, as shown in the third drawing of FIG. 14A , the controller 180 sets the graphic object 1410 for receiving the counting time setting based on the touch input point 1410, that is, the food 1400 It can be displayed on the displayed area on the touch screen 201 . In addition, the counting object 1440 may be displayed on the area on the touch screen 201 where the food 1400 is displayed to indicate that the time counting currently being performed is being performed with respect to the food 1400 .

Meanwhile, as described above, the timer function may be set not only for a specific food but also for the entire storage room or any one of a plurality of storage spaces constituting the storage room. The controller 180 may determine whether the timer function is for a specific food or a storage room or storage space based on a touch input point applied on the touch screen 201 . 14B shows an example in which the timer function is set in the storage room in this case.

First, referring to the first drawing of FIG. 14B , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may sense a touch input applied to the touch screen 201 . In addition, as shown in the second drawing of FIG. 14B , the management menu 800 including at least one item may be displayed on the touch screen 201 centered on the point 1450 to which the touch input is applied.

On the other hand, as shown in the second drawing of FIG. 14B , if the user selects the timer function from the management menu 800 , the controller 180 displays a graphic object 1460 related to the timer function on the touch screen 201 . can be displayed on the In addition, a time to be counted may be set according to a user input applied to the graphic object 1460 . For example, the graphic object 1460 may have a clock or circle shape, as shown in the third drawing of FIG. 14B , and the user's input applied to the graphic object 1460 is the graphic object It may be a user's drag input 1462 applied along the circumference of 1460 . In this case, the controller 180 may change the graphic object in the form of a minute hand displayed on the graphic object 1462 based on the time set according to the drag input 1462 , and convert the currently set time into text information 1460 . You can show more. In addition, the controller 180 may perform counting of a set time according to the drag input 1462 .

In addition, the controller 180 may display the current time counting state through the time counting object 1480 as shown in the fourth drawing of FIG. 14B . In this case, the time counting object 1480 may include information 1482 about the current remaining time (eg, 45 minutes), and may display a state in which the remaining time decreases with the lapse of time.

Meanwhile, the controller 180 may detect whether the point 1450 to which the touch input is applied is a region corresponding to a specific food. And, as shown in the first drawing of FIG. 14B , if the point 1450 to which the touch input is applied is not applied to an area corresponding to a specific food, the controller 180 determines whether the currently selected timer function is stored in the storage room or storage area. It can be determined that the space is set.

For example, as shown in the first drawing of FIG. 14B , if the touch input is applied to an area corresponding to the partition wall between the storage spaces constituting the storage room, the controller 180 determines that the currently selected timer function is It can be determined that the storage room is set on the touch screen 201, the inside of which is shown. Then, the controller 180 may display different time counting objects for displaying the operation state of the timer function currently being performed according to the target to which the timer function is set.

For example, as shown in FIG. 14A , when a timer function is set for a specific food, the controller 180 displays the time counting object 1440 (a first time counting object) on a touch screen ( 201) can be displayed on the top. On the other hand, when the currently set timer function is set for a specific storage room or storage space, the controller 180 operates the timer function as a graphic object (second time counting object: 1480) distinguished from the first time counting object 1440 . status can be displayed. Accordingly, the controller 180 allows the user to more easily identify the currently set operation state of the timer function and the current timer target through the time counting object.

Meanwhile, according to the above description, the controller 180 of the refrigerator 100 according to an embodiment of the present invention selects each food item or each storage space when a function for displaying information on the remaining amount of currently stored food is selected by the user. It has been mentioned that the residual amount information measured for each can be displayed.

15 is an exemplary diagram illustrating an example in which information about the remaining amount of food stored in a specific storage compartment is displayed in the refrigerator 100 according to an embodiment of the present invention.

First, referring to the first drawing of FIG. 15 , the controller 180 of the refrigerator 100 according to an embodiment of the present invention may receive a selection of an item 802 corresponding to a sticker function according to a user's selection. In addition, the controller 180 may receive information displayed by the sticker function, and information about the amount of remaining amount measured from each food item or each storage space may be selected.

In this case, the control unit 180 may display, on the touch screen 201 , information on the amount of remaining amount measured for each specific food or food in the storage room, the inside of which is currently displayed through the touch screen 201 , according to the user's selection. can For example, when the user selects to display the remaining amount information for all the food items in the storage compartment, the controller 180 , as shown in the second view of FIG. 15 , the remaining amount measured from each food stored in the storage compartment. Information may be displayed at a position on the touch screen 201 corresponding to each food item.

On the other hand, it goes without saying that the control unit 180 may receive a selection from the user to display the remaining amount information on any one of the foods stored in the storage compartment. For example, the controller 180 may determine whether any one food item currently displayed on the touch screen 201 is selected based on a touch input point applied on the touch screen 201 . And when it is determined that any one food is selected, as shown in the first drawing of FIG. 15 , the remaining amount information measured from the selected specific food is displayed on the touch screen 201 according to the selection of the sticker function for displaying the remaining amount information. ) can be displayed on the In this case, the information on the remaining amount of the specific food may be displayed on one area on the touch screen 201 corresponding to the selected food, as shown in the third drawing of FIG. 15 .

Meanwhile, according to the above description, the controller 180 may measure the residual amount of food stored in each of the plurality of storage spaces constituting the storage room and display the measurement result. In this case, as shown in the fourth diagram of FIG. 15 , the controller 180 may output information on the amount of residual amount measured in each storage space together with information on food stored in each storage space.

Referring to the fourth drawing of FIG. 15 , the specific storage room currently viewed through the touch screen 201 may consist of four storage spaces, and each storage space is a first storage in which milk is stored, respectively. It may be composed of a space 1510 , a second storage space 1520 in which eggs are stored, a third storage space 1530 in which wine is stored, and a fourth storage space 1540 in which oils are stored. In this case, the controller 180 may detect the remaining amount of 1500 ml from the result of measuring the weight (eg, 1500 g) of the first storage space 1510 . Then, the detected residual amount information 1512 is displayed on the touch screen 201 corresponding to the first storage space 1510 together with the type of food stored in the first storage space 1510, that is, 'milk'. area can be displayed.

Similarly, the controller 180 may measure the remaining amount of eggs stored in the second storage space 1520 . For example, when the user sets that eggs are stored in the second storage space 1520 , the controller 180 may detect the weight of the eggs stored in the second storage space 1520 . In addition, the number of eggs stored in the second storage space 1520 may be estimated by dividing the detected weight by the weight of a general egg, for example, an average egg weight. In addition, the estimated information can be displayed on an area on the touch screen 201 corresponding to the first storage space 1510 together with the type of food stored in the second storage space 1520, that is, 'egg'. have.

Meanwhile, the controller 180 may measure the remaining amount of wine and oils stored in the third storage space 1530 or the fourth storage space 1540 . For example, when the wine or oil is stored in the transparent container as described above, the controller 180 may measure the remaining amount from the image sensed from the container containing the wine or oil. Alternatively, the controller 180 includes information previously input from the user, that is, the capacity information input together when the container containing wine or oil is stored in the third storage space 1530 or the fourth storage space 1540, The storage amount of the wine or oil stored in the third storage space 1530 or the fourth storage space 1540 may be determined based on the weight measured when the container containing the wine or oil is accommodated. And it is possible to calculate the remaining amount of the remaining wine or oil based on the weight reduced when the user uses the wine or oil. And the calculated residual amount is stored in the third storage space 1530 or the fourth storage space 1540 together with the type of food stored in the third storage space 1530, that is, 'wine' or 'oil'. Alternatively, the display may be displayed on each area on the touch screen 201 corresponding to the fourth storage space 1540 .

Meanwhile, when information related to food is displayed on the touch screen 201 , the controller 180 performs a related function according to a user input applied to the information displayed on the touch screen 201 . can For example, the controller 180 may perform a purchase function for at least one food based on a user's touch input applied to the remaining amount information displayed in FIG. 15 .

16 is an exemplary diagram illustrating an example in which a purchase function for at least one food item is performed in the refrigerator 100 according to an embodiment of the present invention.

First, referring to the first drawing of FIG. 16 , the first drawing of FIG. 16 shows an example in which the residual amount information 1600 of a specific food among the foods stored in the refrigerator 100 is selected by the user.

As shown in the first drawing of FIG. 16 , when the residual amount information 1600 for a specific food is selected, the controller 180 may identify the food 1602 corresponding to the selected residual amount information 1600 . For example, when the food is stored, the controller 180 may identify the food 1602 based on tag information stored together or a barcode displayed on the container of the food. Alternatively, the controller 180 may recognize the image or text information displayed on the container of the food 1602 from the image of the food 1602 sensed by the camera. In addition, the type or name of the food 1602 may be identified based on the recognized image or text.

Meanwhile, as shown in the first drawing of FIG. 16 , when the residual amount information 1600 of a specific food 1602 is selected, the controller 180 displays the selected residual amount information 1602 in one area on the touch screen 201 . ), a graphic object related to a shopping function of the food 1600 may be displayed. In addition, the graphic object related to the shopping function may be formed in an area 1610 adjacent to a specific vertex on the touch screen 201 .

In addition, as shown in the second diagram of FIG. 16 , the controller 180 may detect a user's drag input applied to the currently selected remaining amount information 1600 . And when the user drops the dragged remaining amount information 1600 to the area 1610 where the graphic object related to the shopping function is displayed, the food 1602 corresponding to the currently selected remaining amount information 1600 is displayed. It may be determined that the purchase has been selected.

Then, the controller 180 can add the food item 1602 corresponding to the residual amount information 1600 as the food item to be purchased, and display information on the screen related to the purchase function of the food item to be purchased on the touch screen 201 . can

First, the third drawing of FIG. 16 shows an example in which a shopping list 1620 including a list 1630 of foods set as foods to be purchased so far is displayed on the touch screen 201 . In this state, the controller 180 may perform a function to purchase at least one of the foods included in the shopping cart list 1620 according to the user's selection.

Here, the purchase function may include a function of accessing a specific server or purchase site where the currently selected food can be purchased and displaying screen information related to the purchase of the corresponding food. That is, if the food 1602 corresponding to the currently selected residual amount information 1600 is wine, the controller 180 controls a wine purchase site through which wine can be purchased as shown in the fourth drawing of FIG. 16 . The screen 1660 of the connected wine purchase site may be displayed in an area on the touch screen 201 .

On the other hand, when the shopping cart list 1620 is displayed, the control unit 180 shows a graphic object 1650 that can be selected to end a purchase function including the shopping cart list 1620 in the fourth drawing of FIG. It can be displayed on the touch screen 201 as shown. Here, the graphic object 1650 for receiving a selection to terminate the purchase function may be displayed in an area 1610 on the touch screen 201 instead of the graphic object related to the shopping function. In addition, based on the user's input to the end object 1650 , the currently executed purchase function may be terminated.

Meanwhile, in FIG. 16 , an example of accessing a specific purchase site and displaying a screen according to the connection on the touch screen 201 has been described. Of course, this is not limited thereto. For example, the controller 180 may display information on a place of purchase, such as a mart where the selected food can be purchased or a seller of the selected food, on the touch screen 201 . And when there is a user's selection for the information of the place of purchase, a telephone order is made by attempting to connect to the place of purchase through a communication network or by sending an incoming signal to the place of purchase through a preset external terminal, that is, the user's mobile terminal. Of course, you can make it go away.

Meanwhile, in the above description, it has been described as an example that the user adds a graphic object corresponding to a specific food to purchase target food, regardless of the remaining amount, and a purchase function is performed according to the user's selection of the added items. Of course, in the case of the insufficient food, a purchase function for the corresponding food may be executed immediately.

That is, in the case of food having a residual amount of less than or equal to a preset level, the controller 180 may display the corresponding residual amount information to be distinguished from other residual amount information such as different colors. Accordingly, the user can easily recognize the food with insufficient remaining amount. Also, in the case of food with insufficient residual amount, if the user selects a graphic object corresponding to the food, the controller 180 may immediately execute a function related to the purchase of the food. In this case, screen information related to the purchase function may be displayed on one area of the touch screen 201 .

Meanwhile, according to the above description, it has been mentioned that the refrigerator 100 according to an embodiment of the present invention can provide various recipe information. In addition, the recipe information provided in the present invention may be related to food selected by the user. In the following description, an example of providing recipe information according to a case in which a specific food is selected from the user will be described with reference to a plurality of illustrative drawings.

Meanwhile, in the above description, it has been described as an example that a purchase function for at least one food is executed according to a user's touch input applied to the graphic object in a state in which a graphic object including information on the remaining amount of food is displayed. However, it goes without saying that the present invention is not limited to these embodiments. That is, the controller 180 of the refrigerator 100 according to an embodiment of the present invention can perform the function of purchasing food according to the user's selection as many times as possible even on the display on which the graphic object including the remaining amount information is not displayed.

For example, when a user's touch input is applied to a graphic object such as deadline information or timer information set for a specific food, the controller 180 performs a function of purchasing a specific food corresponding to the expiration date information or the timer information. can do. The user's touch input may be a drag input applied from one area on the touch screen 201 in which the time limit information or timer information is displayed to one area 1610 adjacent to a specific vertex on the touch screen 201 .

Here, a graphic object (eg, a shopping cart image) for performing a shopping function (a product purchase function) may be output to the one area 1610 .

In this case, the controller 180 may display image information related to the purchase of a specific food corresponding to the graphic object (eg, purchase target list information, etc.) on the touch screen 201 .

Meanwhile, it goes without saying that the control unit 201 of the refrigerator 100 according to an embodiment of the present invention may perform a function of purchasing a specific food according to a user's selection even in a state where a graphic object is not displayed. For example, the controller 180 may detect a user's touch input (first touch input) applied on the touch screen 201 . Then, the controller 180 may detect whether there is food corresponding to a point on the touch screen 201 where the first touch input is sensed. As a result of the detection, if there is food corresponding to the first touch input, the controller 180 determines a specific value corresponding to the first touch input point according to a user's second touch input applied subsequent to the first touch input. It can also perform a function of purchasing food.

First, FIG. 17 is an exemplary diagram illustrating an example in which recipe information on food selected by a user among food stored in the refrigerator 100 is displayed in the refrigerator 100 according to an embodiment of the present invention.

First, referring to the first drawing of FIG. 17 , the controller 180 according to an embodiment of the present invention may detect a user's touch input 1700 applied to the touch screen 201 . In this case, the touch screen 201 may be in a state in which a plurality of divided storage spaces are identifiable. That is, the touch screen 201 is switched to a transparent state, so that the inside of the storage compartment corresponding to the door 210 on which the touch screen 201 is formed is identifiable, or the other doors 220, 230, 240 ) may be in a state in which an image sensed from a storage corresponding to any one of the above is displayed.

In this state, the controller 180 may identify a storage space in which a specific food or a specific type of food corresponding to the user's touch input 1700 is stored. For example, as shown in the first drawing of FIG. 17 , when the storage room shown through the touch screen 201 is divided into a plurality of storage spaces 1510 , 1520 , 1530 , 1540 , the controller 180 . may identify the storage space 1520 corresponding to the touch input 1700 . In addition, it may be determined that food stored in the identified storage space 1520, that is, eggs, is selected by the user.

Then, the controller 180 may detect recipe information related to the currently selected food, that is, an egg, from among the recipe information stored in the memory 170 . For example, the recipe information detected here may be recipe information including the currently selected food, that is, an egg as the ingredient food. In addition, the controller 180 may display a list 1710 of detected recipe information on the touch screen 201 as shown in the second drawing of FIG. 17 .

Meanwhile, while the recipe list is displayed as described above, the controller 180 may detect the user's selection of any one recipe. That is, as shown in the third drawing of FIG. 17 , when the user selects any one recipe 1720 , the controller 180 displays information on the currently selected recipe 1720 on the touch screen 201 . can be displayed in The fourth diagram of FIG. 17 shows an example in which recipe information selected by the user is displayed in this way.

Meanwhile, the controller 180 may divide the currently selected recipe information into a plurality of steps. And, as shown in the fourth drawing of FIG. 17 , recipe information divided into each step may be sequentially displayed according to a user's selection. That is, the controller 180 outputs the recipe of the next step on the touch screen 201 in turn whenever the user applies a touch input, so that the user can cook food according to the recipe for each step without being pressed for time. .

Meanwhile, as a matter of course, recipe information displayed on the touch screen 201 may be transmitted to a preset external device. For example, the controller 180 may transmit recipe information currently displayed on the touch screen 201 to a specific mobile terminal according to a user's request. In this case, the controller 180 may transmit recipe information when there is a user's selection in each step. In this case, the recipe information transmitted to the mobile terminal may be recipe information of a specific step currently displayed on the touch screen. That is, the controller 180 may transmit recipe information of the same step as the step displayed on the touch screen 201 to the mobile terminal to be displayed on the mobile terminal.

Meanwhile, according to the above description, the controller 180 of the refrigerator 100 according to the embodiment of the present invention may display information related to the ingredient food of the currently selected recipe on the touch screen 201, Accordingly, information related to any one food ingredient may be displayed on the touch screen 201 .

18 is an exemplary diagram illustrating an example in which information related to any one of ingredients of a currently selected recipe is displayed in the refrigerator 100 according to an embodiment of the present invention in this case.

First, referring to the first drawing of FIG. 18 , the first drawing of FIG. 18 illustrates an example in which a recipe list 1710 including recipes related to the currently selected food is displayed on the touch screen 201 . From the recipe list 1710 , the controller 180 may detect a user's selection of any one recipe 1800 .

Meanwhile, if any one recipe 1800 is selected, the controller 180 may display a list of ingredients included in the selected recipe as shown in the second drawing of FIG. 18 . And it is possible to detect the user's input applied to any one of the list of ingredients food. For example, as shown in the second drawing of FIG. 18 , if '2 Eggs' is selected from among the food ingredients included in the selected recipe, the controller 180 controls information related to the selected ingredient food. may be displayed on the touch screen 201 .

For example, the information related to the selected food ingredient may be information about a storage room in the refrigerator 100 in which the selected food ingredient is stored. That is, when the user selects a specific food ingredient, the controller 180 may control the touch screen 201 so that a storage room in which food corresponding to the selected ingredient food is stored is displayed through the touch screen 201 . . For example, if the storage compartment corresponding to the food ingredient is the storage compartment corresponding to the door 210 , the controller 180 converts the touch screen 201 to transparent so that the inside of the storage compartment corresponding to the door 210 is displayed. You can also make it visible. On the other hand, if the storage room corresponding to the food ingredient is a storage room corresponding to any one of the door 210 on which the touch screen 201 is formed and the other doors 220, 230, 240, the touch screen 201 It is also possible to display the image of the storage room in which the food ingredient is stored. In this case, the controller 180 further displays a graphic object, etc. corresponding to the storage room currently displayed through the touch screen 201 on the touch screen 201, so that the user can access the inside through the current touch screen 201. Of course, it is possible to more easily recognize which storage room the displayed storage room is.

On the other hand, when the inside of the storage compartment in which the food ingredient is stored is viewed through the touch screen 201 , the controller 180 sets the specific food corresponding to the ingredient food or the storage space in which the food corresponding to the ingredient food is stored in another of the storage compartment. Of course, it is also possible to display it separately from the area. For example, when the currently selected food ingredient is 'egg' as shown in the second drawing of FIG. 18 , the controller 180 corresponds to the 'egg' among the storage rooms currently displayed through the touch screen 201 . An area corresponding to the 'egg' or a storage space in which the 'egg' is stored may be displayed to be distinguished from other areas.

For example, as shown in the third drawing of FIG. 18 , the controller 180 controls the touch screen 201 so that only an area corresponding to a specific storage space in which food corresponding to the selected ingredient food is stored can be identifiable. can do. That is, the controller 180 converts only one area on the touch screen 201 corresponding to the specific storage space to a transparent state, or converts the display panel to an inactive state in the remaining area except for the specific storage space, It is also possible to control not to display the image of

On the contrary, as shown in the fourth drawing of FIG. 18 , the controller 180 can control the touch screen 201 so that only the area corresponding to the specific storage space in which the food corresponding to the selected ingredient food is stored is not shown. have. That is, the controller 180 converts only one area on the touch screen 201 corresponding to the specific storage space to an opaque state, or an image inside the storage room in an area on the touch screen 201 corresponding to the specific storage space. You can also control it not to be displayed. In this case, as shown in the fourth diagram of FIG. 18 , the controller 180 places various pieces of information measured from the specific storage space in an area on the touch screen 201 corresponding to the specific storage space, for example, the remaining amount. Further information and the like may be displayed.

Meanwhile, when information on the currently selected food ingredient is displayed through the touch screen 201 , the controller 180 may perform a function related to the food ingredient. For example, the controller 180 may display a graphic object 1832 related to a purchase function on an area 1830 on the touch screen 201, a touch input applied to the currently selected food ingredient, and the graphic object Based on a touch input applied to an area 1830 in which 1832 is displayed, a purchase function for the food ingredient may be performed. For example, such a touch input is a user's touch input applied to an area on the touch screen 201 corresponding to the food ingredient, and a user's touch input applied to an area 1830 on the touch screen 201 from the touch input. It may be a drag-and-drop input.

Meanwhile, information measured from the refrigerator 100 in relation to the selected food ingredient may be transmitted to an external device such as a preset mobile terminal according to a user's selection. In this case, the user of the external device may recognize, from the residual amount information received from the external device, the amount of a specific food ingredient currently stored in the refrigerator 100 among ingredients included in the currently selected recipe. Here, the residual amount information transmitted to the external device may include an image sensed from a storage room in which food corresponding to the currently selected food ingredient is stored or a storage space in which the food is stored. Accordingly, the user of the external device may more accurately recognize the residual amount of the specific food ingredient currently stored in the refrigerator 100 through the image included in the residual amount information.

The present invention described above can be implemented as computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that includes implementation in the form of. Also, the computer may include the controller 180 of the refrigerator 100 . Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (8)

a main body having a storage compartment including at least one storage space;
a door coupled to the body and formed to open and close the storage compartment;
a touch screen disposed on one surface of the door and transparently formed so that food stored in the storage space can be identified, and whose transparency is changed in response to a preset touch input; and,
Graphic objects corresponding to the foods stored in the storage space, respectively, are displayed on the touch screen, and corresponding to the at least one graphic object in response to a preset type of touch on at least one of the graphic objects. Includes a control unit that executes a purchase function for the purchase of a specific food,
The control unit is
When the at least one graphic object is dragged to a preset area on the touch screen by the preset type of touch, a function of purchasing food corresponding to the dragged at least one graphic object is performed. refrigerator to do. According to claim 1, wherein the control unit,
When the at least one graphic object is dragged to a preset area on the touch screen according to a user input, a purchase list including information on foods corresponding to each of the dragged graphic objects is displayed on the touch screen,
and performing a purchase function for at least one of the foods included in the purchase list, and displaying purchase-related screen information on the touch screen. According to claim 2, wherein the control unit,
and a preset graphic object for indicating that the preset region is a region related to a food purchase function is further displayed on a preset region on the touch screen. According to claim 1,
The storage room is
Each includes a plurality of storage spaces in which different types of food are stored,
The control unit is
Refrigerator, characterized in that according to a result of measuring the remaining amount of food stored in each storage space through the weight of the food stored in each storage space, screen information related to food having a remaining amount of less than or equal to a preset level is displayed on the touch screen. . 5. The method of claim 4,
Further comprising a camera for sensing the image of the food stored in the at least one storage space,
The control unit is
Refrigerator, characterized in that the residual amount of the food stored in the at least one storage space is measured based on the image sensed by the camera. According to claim 5, wherein the control unit,
When the measurement of the remaining amount of food stored in each of the plurality of storage spaces is requested from a preset external device, in response to the received request, screen information related to food having the residual amount of less than or equal to a preset level is transmitted to the external device Refrigerator made with The method of claim 6, wherein the image information transmitted to the external device comprises:
The refrigerator, characterized in that it further includes information related to a place of purchase of the food having the remaining amount below a preset level. According to claim 6, wherein the control unit,
The refrigerator according to claim 1, wherein screen information further including an image of a storage space in which the weight of the stored food is less than or equal to a preset level is transmitted to the external device.

Images