WO2022220427A1

WO2022220427A1 - Refrigerator and controlling method thereof

Info

Publication number: WO2022220427A1
Application number: PCT/KR2022/004020
Authority: WO
Inventors: 강동경; 최수지; 정한섬; 홍성진; 홍주환
Original assignee: 삼성전자주식회사
Priority date: 2021-04-12
Filing date: 2022-03-23
Publication date: 2022-10-20
Also published as: KR20220141182A

Abstract

A refrigerator is disclosed. The refrigerator according to the present disclosure comprises a body including a storage compartment, a door coupled to the body, a touch display disposed on the door, a camera disposed to capture an image of the storage compartment, and a processor, wherein the processor: controls the touch display to display a waiting screen; when a pre-configured first touch input is obtained through the touch display while the waiting screen is displayed, controls the touch display to display a captured image obtained by the camera; and when a pre-configured second touch input is obtained through the touch display while the waiting screen is displayed, controls the touch display to display a home screen including multiple UI elements corresponding to multiple applications.

Description

Refrigerator and its control method

The present disclosure relates to a refrigerator and a method for controlling the same, and more particularly, to a refrigerator for providing a photographed image of the inside of the refrigerator and a method for controlling the same.

BACKGROUND ART A refrigerator is a device for long-term storage of stored items, such as food and beverage, without spoilage. Meanwhile, an opaque door, not a transparent window, is applied to a general refrigerator (eg, a home refrigerator) other than a refrigerator used in a specific place such as a restaurant or a grocery store. Accordingly, when the user wants to check the stored material stored in the refrigerator, the user must open the door. Accordingly, there is a need for a technology capable of checking stored items without opening the refrigerator door.

One technical problem to be solved by the present invention is to provide a method for checking stored items stored in a refrigerator without opening a door.

Another technical problem to be solved by the present invention is to provide a refrigerator that displays a photographed image of the interior of the refrigerator.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to an exemplary embodiment of the present disclosure for solving the above-described technical problem, there is provided a refrigerator, comprising: a main body including a storage compartment; a door coupled to the main body to open and close the storage compartment; a touch display provided on the door; a camera arranged to photograph the storage room; and a processor, wherein the processor controls the touch display to display a standby screen, and when a preset first touch input is obtained through the touch display while the standby screen is displayed, the image is captured by the camera a home screen including a plurality of UI elements corresponding to a plurality of applications when the touch display is controlled to display the captured image, and a preset second touch input is obtained through the touch display while the standby screen is displayed A refrigerator for controlling the touch display to display may be provided.

The preset first touch input includes at least one of a double tap input and an input for dragging in a predetermined direction after touching two arbitrary points on the touch display, and the preset second touch input includes a tap input can do.

The standby screen may include a monochromatic first standby screen and a second standby screen including time information and date information.

The refrigerator further includes a proximity sensor, and the processor is configured to, when a user is detected through the proximity sensor while the first standby screen is displayed, convert the first standby screen to the second standby screen and display it The touch display can be controlled.

When a touch input for selecting a first UI element for stopping display of the captured image displayed on the touch display is obtained while the captured image is displayed, the processor stops displaying the captured image and The touch display may be controlled to display

The processor may control the touch display to display the captured image when an input for dragging in a predetermined direction is obtained after touching any two points of the touch display while the home screen is displayed.

When a pinch-out input is obtained through the touch display while the captured image is displayed, the processor may control the touch display to enlarge and display the captured image.

According to another exemplary embodiment of the present disclosure for solving the above-described technical problem, there is provided a method for controlling a refrigerator including a camera and a touch display arranged to photograph a storage room, the method comprising: displaying a standby screen; displaying a captured image captured by the camera when a preset first touch input is obtained through the touch display while the standby screen is displayed; and displaying a home screen including a plurality of UI elements corresponding to a plurality of applications when a preset second touch input is obtained through the touch display while the standby screen is displayed; can be

The refrigerator further includes a proximity sensor, and the displaying of the standby screen may include displaying the first standby screen as the second standby screen when a user is detected through the proximity sensor while the first standby screen is displayed. It may include the step of converting to and displaying.

The control method may include, when a touch input for selecting a first UI element for stopping display of the captured image displayed on the touch display is obtained while the captured image is displayed, stops displaying the captured image and waits Displaying the screen; may further include.

The control method may further include displaying the captured image when an input for dragging in a predetermined direction is obtained after touching any two points of the touch display while the home screen is displayed.

The control method may further include, when a pinch-out input is obtained through the touch display while the captured image is displayed, enlarging and displaying the captured image.

The solutions of the problems of the present disclosure are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the present specification and the accompanying drawings. will be able

According to various embodiments of the present disclosure as described above, the refrigerator may display a photographed image captured inside the refrigerator. Accordingly, the user can check the stored items stored in the refrigerator without opening the door.

In addition, the effects obtainable or predicted by the embodiments of the present disclosure are to be disclosed directly or implicitly in the detailed description of the embodiments of the present disclosure. For example, various effects predicted according to embodiments of the present disclosure will be disclosed in the detailed description to be described later.

1 is a diagram illustrating a refrigerator according to an embodiment of the present disclosure.

2 is a view illustrating an open state of the door of the refrigerator according to an embodiment of the present disclosure.

3 is a block diagram illustrating a configuration of a refrigerator according to an embodiment of the present disclosure.

4 is a diagram illustrating a screen displayed by a touch display according to an embodiment of the present disclosure.

5 is a diagram illustrating a screen displayed by a touch display according to another embodiment of the present disclosure.

6 is a diagram illustrating a screen displayed by a touch display according to another embodiment of the present disclosure.

7 is a diagram illustrating a screen displayed by a touch display according to another embodiment of the present disclosure.

8 is a diagram illustrating a screen displayed by a touch display according to another embodiment of the present disclosure.

9 is a diagram illustrating a screen displayed by a touch display according to another embodiment of the present disclosure.

10 is a diagram illustrating a screen displayed by a touch display according to another embodiment of the present disclosure.

11 is a flowchart illustrating a method for controlling a refrigerator according to an embodiment of the present disclosure.

Terms used in this specification will be briefly described, and the present disclosure will be described in detail.

Terms used in the embodiments of the present disclosure have been selected as currently widely used general terms as possible while considering the functions in the present disclosure, but this may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, etc. . In addition, in specific cases, there are also terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding disclosure. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the contents of the present disclosure, rather than the simple name of the term.

Embodiments of the present disclosure may apply various transformations and may have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, and it should be understood to include all transformations, equivalents and substitutions included in the spirit and scope of the disclosure. In describing the embodiments, if it is determined that a detailed description of a related known technology may obscure the subject matter, the detailed description thereof will be omitted.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as "comprises" or "consisting of" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, but one or more other It is to be understood that this does not preclude the possibility of addition or presence of features or numbers, steps, operations, components, parts, or combinations thereof.

Hereinafter, with reference to the accompanying drawings, embodiments of the present disclosure will be described in detail so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be implemented in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

1 is a diagram illustrating a refrigerator according to an embodiment of the present disclosure. 2 is a view illustrating an open state of the door of the refrigerator according to an embodiment of the present disclosure. The refrigerator 100 includes a main body 10 ,

storage compartments

11 , 12 , 13 , a plurality of

doors

20 , 30 , 40 , 50 , and a hinge 60 connecting each door 20 to 50 to the main body 10 . ) may be included. The number of doors is only an example, and the number of doors may be one, two, three, or the like.

The touch display 110 may be located in at least one of the plurality of

doors

20 , 30 , 40 , and 50 (eg, at least one of the left door 20 and the right door 30 ). For example, the touch display 110 may be located on the front side of the second door 30 (eg, in the +y-axis direction). The touch display 110 may be a touch screen capable of receiving a touch input. Meanwhile, the touch display 110 may display various screens. For example, the touch display 110 may display functions of the refrigerator 100 and stored settings. Also, the touch display 110 may display execution screens of various applications (or widgets included).

A proximity sensor (not shown) may be located in at least one of the plurality of

doors

20 , 30 , 40 , and 50 . In addition, each of the plurality of

doors

20 , 30 , 40 , and 50 may include a plurality of grippable handles 21 , 31 , 41 and 51 .

The main body 10 has an inner case (not shown) forming the storage compartments 11 to 13, an outer case (not shown) forming the exterior of the refrigerator, and a temperature difference between the inner case and the outer case. It may include an insulating material (insulator, not shown) to maintain. The heat insulating material (not shown) may prevent the outflow of cold air inside the storage chambers 11 to 13 and prevent the inflow of external warm air into the storage chambers 11 to 13 .

The main body 10 may include a cold air supply unit (not shown) for supplying cold air to the storage chambers 11 to 13 . The cold air supply unit (not shown) includes a compressor (not shown) for compressing the refrigerant, a condenser (not shown), an expansion value (not shown), an evaporator (not shown), and a pipe (not shown). ) may be included.

The storage rooms 11 to 13 may be divided by a partition 14 . The storage compartments 11 to 13 may be divided into the freezing

compartments

12 and 13 below and the refrigerating compartment 11 above the freezing

compartments

12 and 13 . Among the storage compartments 11 to 13 divided by the partition 14 , the refrigerating compartment 11 may include one or a plurality of shelves 15 and one or a plurality of storage boxes 16 . A dispenser (not shown) providing water, ice, or sparkling water may be located on the front side of the first door 20 (eg, in the +y-axis direction).

A rotating bar 70 may be rotatably mounted to the first door 20 . The rotating bar 70 may be rotatably coupled to the first door 20 to seal a gap between the first door 20 and the second door 30 . In FIG. 2 , the rotating bar 70 is illustrated as being mounted on the first door 20 , but this is only an exemplary embodiment, and the rotating bar 70 may be mounted on the second door 30 .

At least one camera 130 may be disposed on the rotation bar 70 . The camera 130 may face the refrigerating compartment 11 when the rotating bar 70 is positioned to seal the gap between the first door 20 and the second door 30 . Accordingly, the camera 130 may be arranged to photograph the inside of the refrigerating compartment 11 .

The freezing compartment 12 may have a third door 40 on one side. In addition, the freezing compartment 13 may have a fourth door 50 on one side. The freezing compartments 12 and 13 may be combined into one storage compartment (eg, like the refrigerating compartment 11 ). One freezing compartment may have doors on the left and right sides, respectively, like the refrigerating compartment 11 . In this case, the third door 40 or the fourth door 50 may have a rotating bar like the refrigerating compartment 11, and the rotating bar may include a camera disposed to photograph the inside of the freezing

compartments

12 and 13. .

The schematic structure of the refrigerator 100 according to an embodiment of the present disclosure has been described above. Hereinafter, components of the refrigerator 100 will be described.

3 is a block diagram illustrating a configuration of a refrigerator according to an embodiment of the present disclosure. Referring to FIG. 3 , the refrigerator 100 includes a touch display 110 , an input unit 120 , a camera 130 , a sensor unit 140 , a communication interface 150 , a memory 160 , and a processor 170 . can do.

The touch display 110 may display various screens under the control of the processor 170 . For example, the touch display 110 may display a standby screen. The standby screen means a screen including brief information. For example, the standby screen may include current time information, date information, and weather information. In addition, the standby screen may include a screen of a single color (eg, black). Also, the touch display 110 may display a home screen. The home screen means a screen including a plurality of UI elements corresponding to a plurality of applications. Meanwhile, the standby screen and the home screen may be classified according to power consumption. For example, the amount of power consumed while the touch display 110 displays the standby screen may be less than the amount of power consumed while the touch display 110 displays the home screen.

Meanwhile, the touch display 110 is a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display (eg, AMOLED ( active-matrix organic light-emitting diode), passive-matrix OLED (PMOLED), or microelectromechanical systems (MEMS) displays.

The input unit 120 may receive a user input and transmit it to the processor 170 . The input unit 120 may include at least one of a touch sensor, a pen sensor, a pressure sensor, and a key. The key may be implemented as a physical button, an optical key, or a keypad.

The camera 130 may be arranged to photograph at least one of the storage compartments included in the refrigerator 100 . For example, as described with reference to FIG. 2 , the camera 130 may be disposed on the rotation bar 70 for sealing between the doors. However, this is only an embodiment, and the camera 130 may be disposed at any position as long as it can photograph the inside of the storage compartment with the door of the refrigerator 100 closed. For example, the camera 130 may be disposed on the inner wall of the storage room. Meanwhile, the refrigerator 100 may include a plurality of cameras 130 . The plurality of cameras 130 may be disposed at positions corresponding to a plurality of areas in the storage compartment divided by shelves.

The sensor unit 140 may include various sensors. For example, the sensor unit 140 may include a proximity sensor. The proximity sensor may be used to detect an object near the refrigerator 100 . In particular, the processor 170 may detect the user based on the sensing value of the proximity sensor. Meanwhile, the proximity sensor may be disposed on a front surface of at least one of the doors. In addition, the proximity sensor may be implemented as an optical proximity sensor (eg, an IR sensor), a capacitive proximity sensor, an inductive proximity sensor, or the like.

In addition, the sensor unit 140 includes a temperature sensor for acquiring the temperature of the storage room, a fingerprint sensor for recognizing a user's fingerprint, and a pressure sensor for acquiring the weight of an object disposed on a shelf of the refrigerator 100 and placed on the shelf may include

The communication interface 150 includes at least one circuit and may communicate with various types of external devices. The communication interface 150 may transmit a photographed image captured by the camera 130 to the user terminal. The user terminal may receive and display the captured image. Meanwhile, the communication interface 150 may include a wireless communication module. For example, the communication interface 150 may include at least one of a Wi-Fi module, a Bluetooth communication module, a cellular communication module, a 4th generation Long Term Evolution (LTE) communication module, and a 5G communication module.

The memory 160 may store various data, control programs, or applications for driving and controlling the refrigerator 100 . For example, the memory 160 includes a control program for controlling the refrigerator 100 or the processor 170 and an application provided by a manufacturer or downloaded from the outside (eg, a food management application, a food recognition application, or a food purchase). application, food reminder application, morning brief application, etc.) related graphical user interface (GUI), images corresponding to the GUI, food information, user information, documents, databases, or related data may be stored. Also, the memory 160 may store computer executable instructions for performing the method of controlling the refrigerator according to the present disclosure. The memory 160 is accessed by the processor 170 , and reading/writing/modification/deletion/update of data by the processor 170 may be performed.

Meanwhile, the memory 160 may include an internal memory or an external memory. The built-in memory includes, for example, a volatile memory (eg, dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (eg, OTPROM (one time programmable ROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash), hard drive, or a solid state drive (SSD).

External memory is a flash drive, for example, CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), It may include a multi-media card (MMC) or a memory stick. The external memory may be functionally and/or physically connected to the refrigerator 100 through various interfaces.

The processor 170 may control the overall operation of the refrigerator 100 . For example, the processor 170 may control the touch display 110 to display a standby screen. The standby screen may include a monochromatic first standby screen and a second standby screen including time information and date information. When a user is detected through the proximity sensor while the first standby screen is displayed, the processor 170 may control the touch display 110 to display the first standby screen by switching to the second standby screen.

The processor 170 may control the touch display 110 based on a user input obtained through the touch display 110 while the standby screen is displayed.

For example, if a preset first touch input is obtained while the standby screen is displayed, the processor 170 may control the touch display 110 to display a captured image captured by the camera 130 . Here, the preset first touch input may include a double tap and a drag. A double tap refers to an input for continuously performing taps within a preset time period (eg, 0.5 seconds). Dragging may include an input of touching two arbitrary points on the touch display 110 and then dragging in a predetermined direction.

As another example, when a preset second touch input is obtained while the standby screen is displayed, the processor 170 controls the touch display 110 to display a home screen including a plurality of UI elements corresponding to a plurality of applications. can do. Here, the preset second touch input may include a tap. When an input of dragging in a predetermined direction is obtained after touching any two points of the touch display 110 while the home screen is displayed, the processor 170 may control the touch display 110 to display a photographed image. have.

Meanwhile, the processor 170 may control the touch display 110 based on a user input obtained through the touch display 110 while the captured image is displayed. As an example, if a pinch out input is obtained through the touch display 110 while the photographed image is displayed, the processor 170 enlarges and displays the photographed image based on the dragged length by the pinch-out input. The touch display 110 may be controlled to do so. Also, when a pinch-in input is obtained, the processor 170 may control the touch display 110 to display the captured image by reducing it.

As another example, when a touch input for selecting the first UI element for stopping the display of the captured image displayed on the touch display 110 is obtained while the captured image is displayed, the processor 170 stops the display of the captured image and control the touch display 110 to display a standby screen.

In the above, the configuration of the refrigerator 100 according to an embodiment of the present disclosure has been described. Hereinafter, various screens displayed by the touch display 110 under the control of the processor 170 will be described.

4 to 10 are diagrams illustrating screens displayed by a touch display according to various embodiments of the present disclosure. Referring to FIG. 4 , the touch display 110 may display a standby screen 111 , a home screen 112 , and a photographed image 113 . The standby screen 111 may include current time information, date information, and weather information. When a preset first touch input is acquired while displaying the standby screen 111 , the touch display 110 may display a photographed image 113 obtained by photographing the storage room of the refrigerator 100 ( S41 ). The preset first touch input may include a double tap input 52 as shown in FIG. 5 . For example, when an input of the user tapping the touch display 110 in succession twice within 0.5 seconds is sensed, the touch display 110 may display the captured image 113 . Also, the preset first touch input may include a drag input 62 as shown in FIG. 6 . For example, when an input of dragging in a predetermined direction is sensed while the user touches the touch display 110 with the index and middle fingers, the touch display 110 may display the captured image 113 .

The touch display 110 may display the first UI element 43 for stopping the display of the captured image 113 on the captured image 113 . When a user input for selecting the first UI element 43 is obtained, the touch display 110 may stop displaying the captured image 113 and display the standby screen 111 ( S42 ).

Meanwhile, if a preset second touch input is acquired while displaying the standby screen 111 , the touch display 110 may display the home screen 112 ( S43 ). The preset second touch input may include a tap input. The home screen 112 may include a plurality of UI elements 42 corresponding to a plurality of applications stored in the refrigerator 100 . For example, the plurality of applications may include a food management application, a food recognition application, an application for food purchase, a food reminder application, and a morning brief application.

Referring to FIG. 7 , the standby screen 111 may include a monochromatic first standby screen 111-1 and a second standby screen 111-2 including time information and date information. The first power consumption for displaying the first standby screen 111 - 1 may be less than the second power consumption for displaying the second standby screen 111 - 2 . Accordingly, in order to reduce power consumption, the touch display 110 may display the second standby screen 111-2 when a specific event occurs while displaying the first standby screen 111-1 (S71). For example, if a user is detected through the proximity sensor while displaying the first standby screen 111-1, the touch display 110 may display the second standby screen 111-2. If a preset first touch input is obtained while displaying the second standby screen 111-2, the touch display 110 may display the captured image 113 on the second standby screen 111-2 (S72). ). Since step S72 corresponds to the above-described step S41, a redundant description thereof will be omitted.

Meanwhile, the second standby screen 111 - 2 may be deactivated by a user setting. At this time, the touch display 110 may display the captured image 113 while displaying the first standby screen 111-1 (S73). Specifically, when a preset first touch input is acquired while displaying the first standby screen 111-1, the touch display 110 may display the first standby screen 111-1 and the captured image 113. have. When a user input for selecting the first UI element 43 is obtained, the touch display 110 may stop displaying the captured image 113 and display the first standby screen 111-1.

Meanwhile, in FIG. 7 , it has been described that the touch display 110 displays the captured image 113 when a preset first touch input is obtained, but this is only an exemplary embodiment, and the touch display 110 may display a preset first touch input. Even if a touch input is not obtained, the captured image 113 may be displayed. For example, if a user is detected by the proximity sensor while the first standby screen 111-1 or the second standby screen 111-2 is displayed, the touch display 110 may display the captured image 113. .

Referring to FIG. 8 , when a user is detected through the proximity sensor while the first standby screen 111-1 is displayed, the touch display 110 displays the first standby screen 111-1 to the second standby screen 111 . -2) to display it (S81). And, when a preset second touch input is obtained while displaying the second standby screen 111-2, the touch display 110 converts the second standby screen 111-2 to the home screen 112 and displays it. It can be done (S82).

Meanwhile, in the above description, the touch display 110 displays the captured image 113 when a touch input is obtained while displaying the standby screen 111, but this is only an embodiment, and the touch display 110 is While displaying the home screen 112 , the captured image 113 may be displayed. If a drag input is obtained while displaying the home screen 112 , the touch display 110 may display the captured image 113 ( S83 ). For example, when an input of dragging in a predetermined direction is sensed while the user touches the touch display 110 with the index and middle fingers, the touch display 110 may display the captured image 113 .

Meanwhile, the second standby screen 111 - 2 may be deactivated by a user setting. At this time, if a user is detected through the proximity sensor while the first standby screen 111-1 is displayed, the touch display 110 converts the first standby screen 111-1 to the home screen 112 and displays it It can be done (S84).

Referring to FIG. 9 , the touch display 113 may obtain a user's pinch-out input 91 . When the pinch-out input 91 is obtained, the processor 170 may enlarge and display the captured image 113 based on the length L at which the drag is made by the pinch-out input 91 ( S91 ). Accordingly, user convenience and satisfaction may be improved. In addition, when a pinch-in input is obtained, the touch display 113 may reduce and display the captured image.

Meanwhile, the touch display 113 may display only a partial region of the captured image captured by the camera 130 based on the touch input. For example, as shown in FIG. 10 , when a touch input 92 for dragging in a specific direction (ie, +z direction) is obtained, the touch display 110 displays the touch input 92 in the area of the captured image 113 . Only the area corresponding to (that is, the upper area) may be displayed (S92). However, this is only an example, and the touch display 113 may identify and display a partial region of the captured image based on various types of touch inputs set by the user.

11 is a flowchart illustrating a method for controlling a refrigerator according to an embodiment of the present disclosure. The refrigerator 100 may display a standby screen (S1110). When a preset first touch input is acquired through the touch display while the standby screen is displayed, the refrigerator 100 may display an image captured by the camera (S1120). On the other hand, if a preset second touch input is obtained through the touch display while the standby screen is displayed, the refrigerator 100 may display a home screen including a plurality of UI elements corresponding to a plurality of applications (S1130). ). The operation of the refrigerator 100 in each step (S1110, S1120, S1130) can be clearly understood with reference to FIGS. 4 to 10 , and a detailed description thereof will be omitted.

Meanwhile, the various embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. According to the software implementation, embodiments such as the procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

Meanwhile, computer instructions for performing the processing operation according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in the non-transitory computer-readable medium are executed by the processor, the processing operation according to the various embodiments described above may be performed by a specific device.

The non-transitory computer-readable medium refers to a medium that stores data semi-permanently, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc., and can be read by a device. Specific examples of the non-transitory computer-readable medium may include a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

Meanwhile, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' is a tangible device and only means that it does not contain a signal (eg, electromagnetic wave). It does not distinguish the case where it is stored as For example, the 'non-transitory storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly or online between smartphones (eg smartphones). In the case of online distribution, at least a portion of the computer program product (eg, a downloadable app) is stored at least in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server. It may be temporarily stored or temporarily created.

In the above, preferred embodiments of the present disclosure have been illustrated and described, but the present disclosure is not limited to the specific embodiments described above, and is commonly used in the technical field pertaining to the present disclosure without departing from the gist of the present disclosure as claimed in the claims. Various modifications may be made by those having the knowledge of

Claims

in the refrigerator,

a body including a storage compartment;

a door coupled to the main body to open and close the storage compartment;

a touch display provided on the door;

a camera arranged to photograph the storage room; and

processor; including;

The processor is

controlling the touch display to display a standby screen;

When a preset first touch input is obtained through the touch display while the standby screen is displayed, controlling the touch display to display a photographed image captured by the camera,

When a preset second touch input is obtained through the touch display while the standby screen is displayed, controlling the touch display to display a home screen including a plurality of UI elements corresponding to a plurality of applications

refrigerator.
The method of claim 1,

The preset first touch input is

At least one of a double tap input and an input of dragging in a predetermined direction after touching any two points of the touch display,

The preset second touch input is

with tap input

refrigerator.
The method of claim 1,

The standby screen is

a monochromatic first standby screen, and

and a second standby screen including time information and date information.

refrigerator.
4. The method of claim 3,

Proximity sensor; further comprising,

The processor is

When a user is detected through the proximity sensor while the first standby screen is displayed, controlling the touch display to display the first standby screen by switching to the second standby screen

refrigerator.
The method of claim 1,

The processor is

If a touch input for selecting a first UI element for stopping display of the captured image displayed on the touch display is obtained while the captured image is displayed, stop displaying the captured image and display the standby screen; to control the touch display

refrigerator.
The method of claim 1,

The processor is

When an input of dragging in a predetermined direction is obtained after touching any two points of the touch display while the home screen is displayed, controlling the touch display to display the captured image

refrigerator.
The method of claim 1,

The processor is

When a pinch-out input is obtained through the touch display while the captured image is displayed, controlling the touch display to enlarge and display the captured image

refrigerator.
A method for controlling a refrigerator including a camera and a touch display disposed to photograph a storage room, the method comprising:

displaying a standby screen;

displaying a captured image captured by the camera when a preset first touch input is obtained through the touch display while the standby screen is displayed; and

Displaying a home screen including a plurality of UI elements corresponding to a plurality of applications when a preset second touch input is obtained through the touch display while the standby screen is displayed;

control method.
9. The method of claim 8,

The preset first touch input is

At least one of a double tap input and an input of dragging in a predetermined direction after touching any two points of the touch display,

The preset second touch input is

with tap input

control method.
9. The method of claim 8,

The standby screen is

a monochromatic first standby screen, and

and a second standby screen including time information and date information.

control method.
11. The method of claim 10,

The refrigerator further includes a proximity sensor;

The step of displaying the standby screen comprises:

When a user is detected through the proximity sensor while the first standby screen is displayed, converting the first standby screen to the second standby screen and displaying the same

control method.
9. The method of claim 8,

When a touch input for selecting a first UI element for stopping display of the captured image displayed on the touch display is obtained while the captured image is displayed, stopping the display of the captured image and displaying the standby screen; further containing ;

control method.
9. The method of claim 8,

Displaying the captured image when an input of dragging in a predetermined direction is obtained after touching any two points of the touch display while the home screen is displayed;

control method.
9. The method of claim 8,

When a pinch-out input is obtained through the touch display while the captured image is displayed, enlarging and displaying the captured image; further comprising

control method.