WO2016021751A1

WO2016021751A1 - Refrigerator including transparent display and control method therefor

Info

Publication number: WO2016021751A1
Application number: PCT/KR2014/007308
Authority: WO
Inventors: 이도영; 천시내
Original assignee: 엘지전자 주식회사
Priority date: 2014-08-07
Filing date: 2014-08-07
Publication date: 2016-02-11
Also published as: CN106574816B; CN106574816A

Abstract

The present specification discloses a refrigerator including a transparent display and a control method therefor. When a user is in contact with a contact sensor for a predetermined time or more, a display becomes transparent. When the contact disappears or a door is opened, the display becomes non-transparent. Meanwhile, even when the user makes a sliding-input or a knocking input to the contact sensor, the display may become transparent or non-transparent. The intention of a user who wants to see the interior of the refrigerator can be accurately discerned through an active action such as a contact. Thus, the present invention prevents the display from being unnecessarily switched to be transparent.

Description

Refrigerator and control method with transparent display

The present disclosure relates to a refrigerator and a control method including the transparent display.

Due to technological advances in the semiconductor field, multimedia devices have been deployed throughout modern life. Among the technologies in the semiconductor field, a particularly prominent field is the display field. A new type of display device has been researched to meet the needs of the consumer, and one of those developed by the research is a transparent display device.

A display device providing a transparent display screen (hereinafter referred to as a transparent display device) refers to a device having a transparent property so that the background behind the device is reflected. Conventionally, display panels are manufactured using opaque semiconductor compounds such as silicon (Si) and gallium arsenide (GaAs). However, the transparent display device is implemented in a form including a transparent oxide semiconductor film, thereby having a transparent property. When the transparent display device is used, the user can view the necessary background while looking at the rear background located at the rear of the device, and can view necessary information on the transparent display device screen. Therefore, it is possible to solve the spatial and temporal constraints of existing display devices.

The transparent display device may be used in various environments for various purposes. For example, US Patent Publication No. US2014-0035850 discloses a refrigerator in which a transparent display is attached to the front. The document discloses that when the user approaches the refrigerator, the user stops the screen being displayed and transparently controls the display device so that the user can look into the refrigerator.

However, even when a general user has no work in the refrigerator, that is, when the user passes the front of the refrigerator with a different purpose or performs other tasks in front of the refrigerator due to space limitations, the refrigerator disclosed in the document makes the display device transparent. do. Therefore, in the case of a refrigerator equipped with a transparent display device, it is necessary to more clearly grasp the intention of the user to control the transparency of the display device. In particular, there is a need for a control method that can grasp the user's intention based on the user's experience.

The present specification is conceived by recognizing the prior art as described above, and an object thereof is to provide a refrigerator and a control method capable of confirming the inside reflecting an active intention of a user.

In accordance with one aspect of the present invention, a refrigerator includes a display unit configured to switch to a transparent or opaque state by a control signal; A touch sensor for detecting a touch of a user and outputting a first signal; An open / close sensor configured to detect an open / close state of the refrigerator door and output a second signal; And a controller configured to receive the first signal to determine whether a user is in contact, to receive the second signal to determine an open / closed state of the door, and to output a control signal for controlling a transparent or opaque state of the display unit. Can be.

The refrigerator according to the present specification may further include a memory unit for storing a preset threshold time.

According to an embodiment of the present disclosure, the control unit may provide a control signal for maintaining the display unit in an opaque state when there is no user's contact or the user's contact but the contact holding time is less than the threshold time or the door is open. You can print

On the other hand, the controller may output a control signal for switching the display unit to a transparent state when the contact holding time is more than the threshold time and the door is closed from the time when the user's contact is started.

According to an embodiment of the present disclosure, the control unit may output a control signal for maintaining the display unit in the transparent state while the contact of the user is maintained after switching the display unit to the transparent state.

According to another embodiment, the control unit may output a control signal for switching the display unit to an opaque state after a preset switching time after the display unit is switched to the transparent state.

According to another embodiment, the control unit may output a control signal for switching the display unit to an opaque state when the contact of the user disappears or the door is opened after switching the display unit to the transparent state. Can be. In this case, after the user's contact disappears in the state where the door is closed, the control unit switches to the opaque state, and when there is a user's recontact within a preset recontact time, the controller starts from the point of time of the user's recontact. It is also possible to output a control signal for switching the display unit back to the transparent state.

According to another embodiment of the present disclosure, the touch sensor may further output a third signal corresponding to the first sliding input of the user. In this case, the control unit may output a control signal for switching the display unit to a transparent state when receiving the third signal. In this case, when the control unit outputs a control signal for switching the display unit to the transparent state, the control unit may output a control signal for switching the display unit to the transparent state by sliding the opaque portion of the display unit. Preferably, when the control unit outputs a control signal for switching the display unit to a transparent state, the control unit switches the display unit to the transparent state by sliding the opaque portion of the display unit in the same direction as the first sliding input direction of the third signal. Can output a control signal.

The touch sensor may further output a fourth signal corresponding to a second sliding input having a direction opposite to the first sliding input of the user. In this case, when the control unit receives the fourth signal after switching the display unit to the transparent state, the controller may output a control signal for switching the display unit to the opaque state. In this case, when the control unit outputs a control signal for switching the display unit to an opaque state, the control unit may output a control signal in which the display unit is in an opaque state by sliding the transparent portion of the display unit. Preferably, when the control unit outputs a control signal for switching the display unit into an opaque state, the control unit slides the transparent portion of the display unit in the same direction as the second sliding input direction of the fourth signal to switch the display unit to the opaque state. Can output a control signal.

The control unit may output a control signal for switching the display unit to an opaque state after a preset switching time passes after the display unit is switched to the transparent state.

According to another embodiment of the present disclosure, the touch sensor may further output a fifth signal corresponding to the knock input of the user. In this case, the control unit may output a control signal for switching the display unit to a transparent state when receiving the fifth signal. In this case, when the control unit outputs a control signal for switching the display unit to the transparent state, the opaque portion gradually disappears from a portion close to any one point of the display unit, and may output a control signal for switching the display unit to the transparent state. .

The control unit may output a control signal for switching the display unit to an opaque state when the fifth signal is re-received after switching the display unit to the transparent state. In this case, when the control unit outputs a control signal for switching the display unit to an opaque state, the control unit may output a control signal for switching the display unit to an opaque state by gradually disappearing the transparent part from a part far from any one point of the display unit. have.

According to an aspect of the present invention, there is provided a refrigerator control method, including: (a) receiving a first signal output by a touch sensor that senses a touch of a user and determining whether the touch of the user is performed; (b) determining an open / closed state of the door by receiving a second signal output by the open / close sensor detecting a open / closed state of the refrigerator door; And (c) outputting a control signal for controlling a transparent or opaque state of the display unit by determining whether the user is in contact and whether the door is opened or closed.

According to an aspect of the present disclosure, it is possible to more accurately grasp the user's intention through the user's action of maintaining the contact for a predetermined time or more. Since the transparent display can be controlled based on this, unnecessary display control can be prevented and power consumption can be further prevented.

According to another aspect of the present disclosure, it is possible to more accurately grasp the user's intention by detecting active behaviors in addition to simple contact such as sliding or knocking. Since the transparent display can be controlled based on this, unnecessary display control can be prevented and power consumption can be further prevented.

According to another aspect of the present disclosure, it is possible to check the inside of the refrigerator without opening the refrigerator door to prevent unnecessary cold air outflow.

The following drawings attached to this specification are illustrative of the preferred embodiments of the present specification, and together with the detailed description to serve to further understand the technical spirit of the present specification, the present specification is limited only to the matters described in the drawings. It should not be interpreted.

1 is a block diagram schematically showing the configuration of a refrigerator according to the present disclosure.

2 is an exemplary view in which the display unit is attached to the front of the refrigerator door.

3 is an exemplary diagram in which the display unit is switched to a transparent state according to a sliding input.

4 is an exemplary diagram in which the display unit is switched to an opaque state according to a sliding input.

5 is an exemplary diagram in which the display unit is switched to an opaque state according to the knock input.

6 is an exemplary diagram in which the display unit is switched to an opaque state in response to knock re-entry.

FIG. 7 is a flowchart illustrating a control flow of an embodiment of switching the display unit to a transparent state when the contact time is maintained for a predetermined time or more.

FIG. 8 is a flowchart illustrating a control flow of an embodiment in which the display unit is switched to the transparent state and the switching time elapses so that the display unit is changed to the opaque state.

FIG. 9 is a flowchart illustrating a control flow of an embodiment in which the display unit is switched to the opaque state and the display unit is switched to the transparent state when there is recontact.

10 is a flowchart illustrating a control flow of an embodiment in which the display unit is switched to a transparent state by a sliding input.

FIG. 11 is a flowchart illustrating a control flow of an embodiment in which the display unit is switched to the transparent state and the switching time elapses so that the display unit is changed to the opaque state.

12 is a flowchart illustrating a control flow of an embodiment in which the display unit is switched to a transparent state by a knock input.

13 is an exemplary view schematically showing a configuration of a refrigerator according to the present specification.

14 is an exemplary view of a refrigerator provided with a camera unit therein.

15 is an exemplary view schematically showing a configuration of a refrigerator according to the present specification.

16 is an exemplary view in which an internal image is shown as an augmented reality image to a user wearing a wearable display device.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings. At this time, the configuration and operation of the embodiments shown in the drawings and described by this description will be described as at least one embodiment, by which the technical spirit of the present specification and its core configuration and operation is not limited. .

1 is a block diagram schematically showing the configuration of a refrigerator 100 according to the present specification.

Referring to FIG. 1, the refrigerator 100 according to the present specification may include a display 101, a contact sensor 102, an open / close sensor 103, and a controller 104.

The display unit 101 may be switched to a transparent or opaque state by a control signal. The display unit 101 is a so-called 'transparent display', and has a transparent property, so that the background behind the display is reflected. The control signal is output from the controller 104.

The touch sensor 102 may detect a user's touch and output a first signal. The refrigerator 100 according to the present disclosure may grasp the active intention that the user intends to use the refrigerator or look into the refrigerator through the contact sensor 102. The prior art has a disadvantage in that the display is transparently controlled even when the user simply passes near the refrigerator without using an intention of using the refrigerator by using a sensor that senses the user's approach. However, the refrigerator 100 according to the present disclosure has an advantage of more accurately identifying a user's intention through an active action of the user who contacts the touch sensor 102.

The touch sensor 102 may be any device that can output a signal to the controller 104 by sensing various inputs of a user such as a mechanical switch, a pressure sensor, a capacitive sensor, and the like.

In addition, the touch sensor 102 may be connected to a handle of a refrigerator door, may form a mutual layer structure with the display unit 101, and may be included as a component of the display unit 101. That is, the touch sensor 102 may be connected to various parts of the refrigerator 100 and is not limited by the embodiments disclosed herein.

The open / close sensor 103 may detect an open / close state of the refrigerator door and output a second signal.

As used herein, the 'first signal' and 'second signal' are names for distinguishing the signal output from the contact sensor 102 and the signal output from the open / close sensor 103, respectively. Accordingly, the first signal and the second signal do not mean temporal priority or importance.

The controller 104 may determine whether the user is in contact by receiving the first signal, and determine the open / closed state of the door by receiving the second signal. The controller 104 may output a control signal for controlling the transparent or opaque state of the display unit 101 based on whether the user is in contact with the door and whether the door is opened or closed.

The control signal may be directly output to the display unit 101 as a signal output from the control unit 104 or may be output to a separate device for adjusting the transparent state of the display unit 101.

2 is an exemplary view in which the display unit 101 is attached to the front of the refrigerator door.

Preferably, the display unit 101 may be attached to the front surface of the refrigerator door so that the inside of the refrigerator can be seen when the display unit 101 is in a transparent state. 2 illustrates an embodiment in which the display unit 101 is attached to only two doors positioned at the upper end of the refrigerator 100. The display attached to the left door of the display 101 is currently in an opaque state, and the display attached to the right door is in a transparent state. However, the example of the refrigerator 100 illustrated in FIG. 2 is not limited to the scope of the present disclosure as an embodiment for the convenience of understanding.

Meanwhile, the method of switching to the transparent or opaque state of the display unit 101 may vary. Switching methods include a wink method that switches from an opaque state to a transparent state at once, a dimming method that gradually switches from an opaque state to a transparent state, and a sliding method that slides an opaque portion into a transparent state. It can vary. Of course, the transition from the transparent state to the opaque state can also vary.

According to one embodiment of the present specification, the control unit 104 may switch the display unit 101 to a transparent state when the contact of the user is maintained for a predetermined time or more.

To this end, the refrigerator 100 according to the present disclosure may further include a memory unit 105 that stores a preset threshold time T _th . The memory unit 105 may record and erase data such as flash memory, random access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), and solid state drive (SSD). As a known mass storage medium such as a semiconductor device or a hard disk, it is a generic term for a device for storing information regardless of the type of device and does not refer to a specific memory device.

The threshold time T _th is a reference time for determining the intention to switch the display unit 101 to be transparent and may be variously set. That is, if the user maintains the contact sensor 102 in contact with the threshold time T _th or more, it may be determined that the user intends to transparently switch the display 101.

Therefore, the controller 104 maintains the display unit 101 in an opaque state when there is no user's contact or when there is a user's contact but the contact holding time is less than or equal to the threshold time T _th or the door is open. Can output a control signal. If there is no contact with the user, it may be determined that the user does not want to see the inside of the refrigerator. In addition, even if there is user contact, if it is less than the threshold time T _th , it may be determined that there is no intention of the user who wants to see the inside of the refrigerator. In addition, if the door is open, there is no need to switch the display unit 101 to the transparent state because the inside of the refrigerator is already visible.

On the other hand, the control unit 104 controls the display unit 101 to switch to the transparent state when the contact holding time is more than the threshold time (T _th ) from the time when the user's contact is started and the door is closed. You can output When all of the above conditions are satisfied, it may be determined that the user wants to see the inside of the refrigerator, so that the display unit 101 needs to be switched to a transparent state.

According to an embodiment of the present disclosure, the control unit 104 may output a control signal for maintaining the display unit 101 in a transparent state while the user's contact is maintained after the display unit 101 is switched to a transparent state. have. If the user keeps contact with the touch sensor 102 even after the display unit 101 is switched to the transparent state, it may be determined that the user wants to keep looking in the refrigerator. Therefore, it is necessary to keep the display unit 101 in a transparent state while the contact is maintained.

According to another exemplary embodiment, the control unit 104 may output a control signal for switching the display unit 101 to an opaque state after a predetermined switching time passes after the display unit 101 is switched to a transparent state. have.

According to another embodiment of the present disclosure, the control unit 104 controls the display unit 101 when the user's contact disappears or the door is opened after switching the display unit 101 to a transparent state. A control signal for switching to the opaque state can be output. If the user's contact disappears, it can be determined that the user no longer wants to look inside the refrigerator. In addition, if the door is open, since the inside of the refrigerator is already visible, it is not necessary to keep the display unit 101 in a transparent state.

Meanwhile, when the user's contact disappears in the state where the door is closed and the display unit 101 is switched to an opaque state, the controller 104 reconnects the user when there is a user's recontact within a preset recontact time. From this point of time, a control signal for switching the display unit 101 to a transparent state can be output. Since the user no longer needs to look inside the refrigerator, the contact with the contact sensor 102 is stopped, but a situation may occur where the user wants to see the refrigerator again. In this case, if the user re-contacts within a preset re-contact time after switching the display unit 101 to an opaque state, it may be determined that the user wants to see the inside of the refrigerator again. Therefore, it is necessary to switch the display unit 101 back to the transparent state from the point of time when the recontact occurs.

After the display unit 101 is switched to the transparent state, an embodiment of switching to an opaque state when the contact disappears and an embodiment of switching to an opaque state after the switching time elapse may be applied to the refrigerator 100 together. Furthermore, an embodiment in which the display unit 101 is converted to a transparent state by recontacting after being converted to an opaque state may also be applied together with the above-described embodiment to enable various combinations of embodiments.

According to another embodiment of the present specification, the controller 104 may switch the display 101 to a transparent state through a sliding input of a user.

To this end, the touch sensor 102 may further output a third signal corresponding to the first sliding input of the user. The control unit 104 may output a control signal for switching the display unit 101 to a transparent state when receiving the third signal. That is, if the user has an aggressive action such as an input sliding to the touch sensor 102, it may be determined that the user wants to see the inside of the refrigerator. Therefore, in this case, it is necessary to switch the display unit 101 to a transparent state. The third signal is a name for distinguishing the first signal from the second signal. In addition, the first sliding input means a sliding input having a direction different from that of the second sliding input to be described below.

3 is an exemplary diagram in which the display unit 101 is switched to a transparent state according to a sliding input.

Referring to FIG. 3, it can be seen that the user slides the handle formed in the middle of the right door from the left to the right by hand. In the embodiment shown in FIG. 3, the contact sensor 102 is connected to a handle formed in the door. Therefore, when the user grabs the handle of the door and makes a first sliding input, the contact sensor 102 connected to the handle outputs a third signal.

Meanwhile, when the control unit 104 outputs a control signal for switching the display unit 101 to the transparent state, the control unit 104 slides the opaque portion of the display unit 101 to switch the display unit 101 to the transparent state. Can output a control signal.

Preferably, when the control unit 104 outputs a control signal for switching the display unit 101 to the transparent state, the opacity of the display unit 101 in the same direction as the first sliding input direction of the third signal. By sliding a portion, a control signal for converting the display unit 101 into a transparent state may be output.

On the other hand, if the control unit 104 switches the display unit 101 to a transparent state through a user's sliding input, the control unit 104 switches the display unit 101 to an opaque state through a user's sliding input. You can.

To this end, the touch sensor 102 may further output a fourth signal corresponding to a second sliding input having a direction opposite to the first sliding input of the user. The control unit 104 may output a control signal for switching the display unit 101 to an opaque state when receiving the fourth signal after converting the display unit 101 to a transparent state. The fourth signal is a name for distinguishing it from the first to third signals described above.

4 is an exemplary diagram in which the display unit 101 is switched to an opaque state according to a sliding input.

Referring to FIG. 4, it can be seen that the user slides a handle formed in the middle of the right door from right to left. The right to left sliding input is the second sliding input. The second sliding input refers to a sliding input having a direction different from that of the first sliding input. That is, if the user has made an active and opposite behavior such as the second sliding input having the opposite direction to the first sliding input to the touch sensor 102, the user may no longer wish to see the inside of the refrigerator. Can be. Therefore, in this case, it is necessary to switch the display unit 101 to an opaque state.

In the embodiment shown in FIG. 4, the contact sensor 102 is connected to a handle formed in the door, as in the embodiment of FIG. 3. Therefore, when the user grabs the door handle and makes a second sliding input, the contact sensor 102 connected to the handle outputs a fourth signal.

Likewise, when the control unit 104 outputs a control signal for switching the display unit 101 to an opaque state, the control unit 104 slides the transparent portion of the display unit 101 so that the display unit 101 is in an opaque state. The control signal can be output.

Preferably, when the control unit 104 outputs a control signal for switching the display unit 101 to an opaque state, the control unit 104 is transparent of the display unit 101 in the same direction as the second sliding input direction of the fourth signal. By sliding the part, a control signal for switching the display unit 101 to an opaque state may be output.

On the other hand, the control unit 104 may output a control signal for switching the display unit 101 to an opaque state after a predetermined switching time after the display unit 101 is converted to a transparent state.

Meanwhile, an embodiment in which the display unit 101 is converted to an opaque state by the second sliding after the display unit 101 is converted to the transparent state and an embodiment in which the display unit 101 is converted to the opaque state after the switching time have been applied are also applied to the refrigerator 100. Can be.

According to another embodiment of the present disclosure, the control unit 104 may switch the display unit 101 to a transparent state through a knock input of a user.

To this end, the touch sensor 102 may further output a fifth signal corresponding to the knock input of the user. The controller 104 may output a control signal for switching the display 101 to a transparent state when the fifth signal is received.

5 illustrates an example in which the display 101 is switched to an opaque state according to a knock input.

Referring to FIG. 5, a user's hand knocking as if knocking the display 101 may be confirmed. In the embodiment illustrated in FIG. 5, the touch sensor 102 has a mutual layer structure with the display 101. Therefore, the display unit 101 has a form of a so-called touch display. Therefore, when the user knocks the display unit 101 like knocking, the touch sensor 102 outputs a fifth signal. The fifth signal is a name for distinguishing it from the first to fourth signals described above.

According to an embodiment, when the control unit 104 outputs a control signal for switching the display unit 101 to a transparent state, the opaque portion gradually disappears from a portion close to one point of the display unit 101. A control signal for switching the display unit 101 to a transparent state can be output. The one point may be a point at which the knock input is applied in the display unit 101.

The control unit 104 may output a control signal for switching the display unit to an opaque state when the fifth signal is re-received after the display unit 101 is converted to a transparent state. If the user repeats an aggressive action such as a knock input, it may be determined that the user no longer wants to see the refrigerator. Therefore, in this case, it is necessary to switch the display unit 101 to an opaque state.

6 is an exemplary diagram in which the display unit 101 is switched to an opaque state according to the knock re-input.

Referring to FIG. 6, a user's hand knocking as if knocking the display unit 101 in a transparent state may be checked. In the embodiment shown in FIG. 6, the touch sensor 102 has a mutual layer structure with the display unit 101, similarly to the embodiment shown in FIG. 5. Therefore, when the user knocks the display unit 101 like knocking, the contact sensor 102 re-outputs the fifth signal.

In this case, when the control unit 104 outputs a control signal for switching the display unit 101 to an opaque state, the transparent part gradually disappears from a part far from any one point of the display unit 101 so that the display is gradually disappeared. A control signal for switching the unit 101 to an opaque state can be output. The one point may be a point at which the knock input is applied.

Hereinafter, the method of controlling the display unit 101 of the refrigerator 100 described above will be described. Since each component of the refrigerator 100 has been described in detail, repeated description of each component will be omitted.

FIG. 7 is a flowchart illustrating a control flow of an embodiment in which the display unit 101 is switched to a transparent state when the contact time is maintained for a predetermined time or more.

Referring to FIG. 7, first, in step S200, the controller 104 receives a first signal output from the touch sensor 102 that detects a user's touch and determines whether the user has a touch. If the controller 104 determines that there is user contact (YES in S200), the control proceeds to step S210. On the other hand, if the controller 104 determines that there is no user contact (NO in S200), the process proceeds to step S240.

In step S210, the controller 104 determines whether the contact holding time is greater than or _equal to the threshold time T _th from the time point at which the user's contact is started. The threshold time T _th may be stored in the memory unit 105. The controller 104 proceeds to step S220 when the contact holding time is equal to or greater than the threshold time T _th (YES in S210). On the other hand, if the contact holding time is not greater than the threshold time T _th or more (NO in S210), the control unit 104 proceeds to step S240.

In step S220, the controller 104 receives the second signal output by the open / close sensor 103 for detecting the open / closed state of the refrigerator door to determine the open / closed state of the door. If the door is closed (YES in S220), the controller 104 proceeds to step S230. On the other hand, if the door is not closed (YES in S220), the controller 104 proceeds to step S240.

In step S230. The control unit 104 outputs a control signal for switching the display unit 101 to a transparent state. The controller 104 proceeds to step S200 after performing step S230. Therefore, if the user maintains contact with the touch sensor while the refrigerator door is closed, the controller 104 repeatedly maintains the display unit 101 in a transparent state while repeatedly performing steps S200 to S230.

On the other hand, when the controller 104 proceeds to step S240 in the process of performing steps S200 to S220, the controller 104 transmits a control signal for switching the display unit 101 to an opaque state in step S240. Output After the control unit 104 performs step S240, the control unit 104 proceeds to step S200. The control unit 104 repeatedly performs steps S200 to S240.

Therefore, as long as the control unit 104 is supplied with power to the refrigerator 100 according to the present specification, the control unit 104 repeatedly performs steps S200 to 240 to determine a transparent or opaque state of the display unit 101. You can switch according to the user's intention.

FIG. 8 is a flowchart illustrating a control flow of an embodiment in which the display unit 101 is switched to the transparent state and the switching time has elapsed, thereby switching the display unit to the opaque state.

Referring to FIG. 8, it can be seen that the embodiments shown in FIG. 7 and steps S200 to S240 are the same. However, in the embodiment illustrated in FIG. 8, it may be confirmed that step S250 is further added, unlike the embodiment illustrated in FIG. 7. Therefore, description will be made focusing on the added step S250.

The control unit 104 performs step S230, and proceeds to step S250. In step S250, the controller 104 determines whether a preset switching time has elapsed. The switching time may be stored in the memory unit 105. If the preset switching time has elapsed (YES in step S250), the control unit 104 proceeds to step S240. In operation S240, the controller 104 outputs a control signal for switching the display 101 to an opaque state. On the other hand, if the preset switching time has not elapsed (NO in step S250), the controller 104 proceeds to step S200. The control unit 104 repeatedly performs steps S200 to S250.

FIG. 9 is a flowchart illustrating a control flow of an embodiment in which the display 101 is switched to a transparent state when the display 101 is switched to an opaque state and there is a recontact.

Referring to FIG. 9, it can be seen that the embodiment shown in FIG. 7 and steps S200 to S240 are the same. However, the embodiment shown in FIG. 9 may also verify that step S260 is further added, unlike the embodiment shown in FIG. 7. Therefore, description will be made focusing on the added step S260.

The control unit 104 performs step S240, and the process proceeds to step S260. In step S260, the controller 104 determines whether there is a recontact of the user within a preset recontact time. The recontact time may be stored in the memory unit 105. If there is a recontact within the recontact time (YES in step S260), the controller 104 proceeds to step S230. In step S230, the controller 104 outputs a control signal for switching the display 101 to a transparent state. On the other hand, if there is no recontact within the recontact time (NO in step S260), the controller 104 proceeds to step S200. The controller 104 repeatedly performs steps S200 to S240 and S260.

FIG. 10 is a flowchart illustrating a control flow of an embodiment in which the display unit 101 is switched to a transparent state by a sliding input.

Referring to FIG. 10, first, in step S300, the controller 104 determines an open / closed state of a refrigerator door from the open / close sensor 103. If the door is in the closed state (YES in step S300), the controller 104 proceeds to step S310. On the other hand, when the door is in the open state (NO in step S300), the controller 104 repeats step S300.

In operation S310, the controller 104 determines whether a third signal corresponding to the first sliding input of the user is received from the touch sensor 102. If the controller 104 has received the third signal (YES in step S310), the process proceeds to step S320. On the other hand, if the controller 104 has not received the third signal (NO in step S310), the process proceeds to step S300 to repeat steps S300 and S310. Accordingly, the display unit 101 may maintain an opaque state while the controller 104 repeatedly performs steps S300 and S310.

In step S320, the controller 104 outputs a control signal for switching the display 101 to a transparent state. The controller 104 performs step S320 and proceeds to step S330.

According to the exemplary embodiment of the present specification, when the control unit 104 outputs a control signal for switching the display unit 101 to a transparent state, the control unit 104 slides the opaque portion of the display unit 101 to display the display unit ( A control signal for switching 101 to a transparent state can be output.

Preferably, when the control unit 104 outputs a control signal for switching the display unit 101 to the transparent state, the opacity of the display unit 101 in the same direction as the first sliding input direction of the third signal. By sliding a portion, a control signal for converting the display unit 101 into a transparent state may be output. Since the embodiment has been described with reference to FIG. 3, repeated descriptions thereof will be omitted.

In step S330, the controller 104 determines the open / closed state of the refrigerator door from the open / close sensor 103. If the door is in the closed state (YES in step S330), the controller 104 proceeds to step S340. On the other hand, when the door is in the open state (NO in step S330), the controller 104 proceeds to step S350.

In operation S340, the controller 104 determines whether the controller 104 receives a fourth signal corresponding to the second sliding input of the user from the touch sensor 102. If the controller 104 receives the fourth signal (YES in step S340), the process proceeds to step S350. On the other hand, if the controller 104 has not received the fourth signal (NO in step S340), the process proceeds to step S330 to repeat steps S340 and S350. Accordingly, the display 101 may maintain a transparent state while the controller 104 repeatedly performs steps S340 and S350.

In operation S350, the controller 104 outputs a control signal for switching the display 101 to an opaque state. The control unit 104 performs step S350, and the process proceeds to step S300. Therefore, the controller 104 repeatedly performs steps S300 to S350.

According to the exemplary embodiment of the present specification, when the control unit 104 outputs a control signal for switching the display unit 101 to an opaque state, the control unit 104 slides the transparent portion of the display unit 101 to display the display unit ( A control signal for turning 101) into an opaque state can be output.

Preferably, when the control unit 104 outputs a control signal for switching the display unit 101 to an opaque state, the control unit 104 is transparent of the display unit 101 in the same direction as the second sliding input direction of the fourth signal. By sliding the part, a control signal for switching the display unit 101 to an opaque state may be output. Since the embodiment has been described with reference to FIG. 4, repeated description thereof will be omitted.

Referring to FIG. 11, it can be seen that the embodiment shown in FIG. 10 and steps S300 to S330 and S350 are the same. However, in the embodiment illustrated in FIG. 11, it may be confirmed that step S340 is replaced with step S340-1, unlike the embodiment illustrated in FIG. 10. Therefore, description will be made with respect to the replaced step S340-1.

In step S340-1, the controller 104 determines whether a preset switching time has elapsed. The switching time may be stored in the memory unit 105. If the preset switching time has not elapsed (NO in step S340-1), the controller 104 proceeds to step S330 and repeats steps S340 and S350. Accordingly, the display 101 may maintain a transparent state while the controller 104 repeatedly performs steps S340 and S350. On the other hand, if the preset switching time has elapsed (YES in step S340-1), the controller 104 proceeds to step S350. In operation S350, the controller 104 outputs a control signal for switching the display 101 to an opaque state.

Referring to FIG. 12, first, in step S400, the controller 104 determines an open / closed state of a refrigerator door from the open / close sensor 103. If the door is in the closed state (YES in step S4000), the control unit 104 proceeds to step S410. On the other hand, when the door is in the open state (NO in step S400), the controller 104 proceeds to step S440. Therefore, when the refrigerator door is open, the display unit 101 may maintain an opaque state.

In operation S410, the controller 104 determines whether the fifth signal corresponding to the knock input of the user is received from the touch sensor 102. If the controller 104 has received the fifth signal (YES in step S410), the controller 104 proceeds to step S420. On the other hand, if the controller 104 has not received the fifth signal (NO in step S410), the controller 104 proceeds to step S400 and repeats steps S400 and S410.

In operation S420, the controller 104 determines whether the display 101 is in an opaque state. If the display unit 101 is in an opaque state (YES in step S420), the control unit 104 proceeds to step S430. In operation S430, the controller 104 converts the display 101 to transparent. On the other hand, if the display unit 101 is not in an opaque state (NO in step S420), the controller 104 proceeds to step S440. In operation S440, the controller 104 switches the display 101 to opaque. The controller 104 performs step S430 or step S440, and the process proceeds to step S400. The controller 104 repeats steps S400 to S440.

According to the exemplary embodiment of the present specification, when the control unit 104 outputs a control signal for converting the display unit 101 to a transparent state, an opaque portion starts from a portion close to any one point of the display unit 101. This gradually disappears to output a control signal for switching the display unit 101 to a transparent state. Since the embodiment has been described with reference to FIG. 5, repeated description thereof will be omitted.

According to an embodiment of the present disclosure, when the control unit 104 outputs a control signal for switching the display unit 101 to an opaque state, the control unit 104 is transparent from a part far from any point of the display unit 101. The portion may gradually disappear to output a control signal for switching the display unit 101 to an opaque state. Since the embodiment has been described with reference to FIG. 6, repeated description thereof will be omitted.

Meanwhile, according to one embodiment of the present specification, the control unit 104 controls to switch the display unit 101 to an opaque state after a preset switching time after the display unit 101 is switched to a transparent state. Can output a signal. Since the embodiment has already been described, repetitive description will be omitted.

13 is an exemplary view schematically showing a configuration of a refrigerator 500 according to the present specification.

Referring to FIG. 13, the refrigerator 500 according to the present specification may include a display unit 501, a contact sensor 502, an open / close sensor 503, a controller 504, and a camera unit 505.

The display unit 501 outputs an image captured by the camera unit 505 as an image. The image output of the display unit 501 may be controlled by the control signal of the controller 504.

Since the touch sensor 502 is the same as the above-described touch sensor 102, repeated description thereof will be omitted.

Since the open / close sensor 503 is the same as the open / close sensor 103, repeated description thereof will be omitted.

The controller 504 may receive the first signal to determine whether the user is in contact, and receive the second signal to determine the open / closed state of the door. The controller 504 may output a control signal for outputting an image captured by the camera unit 505 as an image to the display unit 101 based on whether the user is in contact and whether the door is opened or closed.

The camera unit 505 is located inside the refrigerator, and photographs an inside image of the refrigerator (hereinafter, referred to as an 'inside image'). The camera unit 505 may include a plurality of camera apparatuses in order to photograph various parts of the refrigerator.

14 is an exemplary view of a refrigerator 500 in which a camera unit 505 is installed.

Referring to FIG. 14, two camera devices installed therein may be identified through an open right door. 14 illustrates an embodiment in which the camera unit 505 includes two camera devices, but the present disclosure is not limited to the above embodiment.

Meanwhile, FIG. 14 illustrates an embodiment in which the display unit 501 is attached to the left side of the upper end of the refrigerator 500. The display unit 101 outputs an internal image as an image according to a control signal of the controller 504.

According to an embodiment of the present disclosure, the controller 504 may control the internal image to be output as an image to the display unit 101 when the user's contact is maintained for a predetermined time or more.

To this end, the refrigerator 500 according to the present specification may further include a memory unit 506 for storing a predetermined threshold time T _th . The threshold time T _th is a reference time for determining the user's intention to see the inside of the refrigerator and may be variously set. That is, if the user maintains contact with the touch sensor 502 for more than the threshold time T _th , it may be determined that the user intends to see an internal image through the display unit 501.

Accordingly, the controller 504 may not transmit the internal image to the display unit 501 when there is no user's contact or when there is a user's contact but the contact holding time is less than the threshold time T _th or the door is open. Control not to output video. If there is no contact with the user, it may be determined that the user does not want to see the inside of the refrigerator. In addition, even if there is user contact, if it is less than the threshold time T _th , it may be determined that there is no intention of the user who wants to see the inside of the refrigerator. In addition, if the door is open, since the inside of the refrigerator is already visible, there is no need to output the internal image to the display unit 501.

On the other hand, the controller 504 outputs the internal image as an image to the display unit 501 when the contact holding time is greater than the threshold time T _th and the door is closed from the time when the user's contact is started. Can be controlled. When all of the above conditions are satisfied, it may be determined that the user wants to see the inside of the refrigerator.

According to an embodiment, the controller 504 controls the internal image to be output as an image to the display unit 501, and then the image is displayed on the display unit 501 while the user's contact is maintained. You can control the output to continue. If the user keeps contact with the touch sensor 502 even after the display unit 501 outputs the internal image, it may be determined that the user intends to keep looking in the refrigerator. Therefore, it is necessary to maintain the internal image as an image on the display unit 501 while the contact is maintained.

According to another embodiment, the controller 504 controls the internal image to be output as an image to the display unit 501, and then the internal image is no longer displayed on the display unit 501 after a preset switching time. You can control it so that it is not output.

According to another embodiment, the controller 504 controls the internal image to be output as an image to the display unit 501 and then the user's contact disappears or the door is opened, the internal The image may be controlled not to be output to the display unit 501 as an image. If the user's contact disappears, it can be determined that the user no longer wants to look inside the refrigerator. In addition, if the door is open, since the inside of the refrigerator is already visible, there is no need to output the internal image to the display unit 501.

On the other hand, the control unit 504 controls the user's contact disappears in the state in which the door is closed so that the internal image is not output to the display unit 501 as an image and there is a user's re-contact within a preset re-contact time The internal image may be controlled to be output as an image to the display unit 501 from the point of time when the user is in contact again. Since the user no longer needs to look inside the refrigerator, the contact with the touch sensor 502 is interrupted, but a situation in which the user wants to see the refrigerator again may occur. In this case, after controlling the internal image not to be output to the display unit 501 as an image, if the user has a recontact within a preset recontact time, it may be determined that the user intends to see the inside of the refrigerator again. Therefore, it is necessary to output the internal image as an image to the display unit 501 without delay from the point of time of the recontact.

According to another exemplary embodiment of the present specification, the controller 504 may control the internal image to be output as an image to the display unit 501 through a sliding input of a user.

To this end, the touch sensor 502 may further output a third signal corresponding to the first sliding input of the user. The controller 504 may control the internal image to be output as an image to the display unit 501 when the third signal is received. That is, if the user has an aggressive action such as an input sliding to the touch sensor 502, it may be determined that the user intends to see the inside of the refrigerator. Therefore, in this case, it is necessary to output the internal image to the display unit 501 as an image. The third signal is a name for distinguishing the first signal from the second signal. In addition, the first sliding input means a sliding input having a direction different from that of the second sliding input to be described below.

Meanwhile, if the controller 504 controls the internal image to be output as an image to the display unit 501 through a sliding input of the user, the controller 504 displays the internal image through the sliding input of the user. The controller 501 may be controlled to not output an image to the unit 501.

To this end, the touch sensor 502 may further output a fourth signal corresponding to the second sliding input having a direction opposite to the first sliding input of the user. The controller 504 controls the internal image to be output as an image to the display unit 501 and then receives the fourth signal so that the internal image is not output to the display unit 501 as an image. Can be controlled. The fourth signal is a name for distinguishing it from the first to third signals described above.

The controller 504 controls the internal image to be output as an image to the display unit 501 through a sliding input of the user. After a preset switching time, the internal image is displayed on the display unit 501. You can control the video not to be output.

According to another embodiment of the present specification, the controller 504 may control the image to be output to the display unit 501 through the knock input of the user.

To this end, the touch sensor 502 may further output a fifth signal corresponding to the knock input of the user. The controller 504 may control the internal image to be output as an image to the display unit 501 when the fifth signal is received.

Meanwhile, the controller 504 controls the internal image to be output as an image to the display unit 501 and then outputs the internal image to the display unit 501 as an image when the fifth signal is re-received. Can be controlled to prevent If the user repeats an aggressive action such as a knock input, it may be determined that the user no longer wants to see the refrigerator. Therefore, it is not necessary to output the internal image to the display unit 501 as an image.

Meanwhile, the controller 504 controls the internal image to be output as an image to the display unit 501 after the preset switching time elapses after controlling the internal image as an image to the display unit 501. You may.

15 is an exemplary view schematically showing a configuration of a refrigerator 600 according to the present specification.

Referring to FIG. 15, the refrigerator 600 according to the present specification may include a communication unit 601, a contact sensor 602, an open / close sensor 603, a control unit 604, and a camera unit 605.

The communication unit 601 transmits the image photographed by the camera unit 605 as image data. Image data transmission of the communication unit 601 may be controlled by a control signal of the control unit 604.

The communication unit 601 may include an RF electric circuit network considering a wireless connection to an external communication network such as the Internet, a local area network (LAN), a wide area network (WAN), or the like. The wireless communication network connected by the communication unit 601 includes Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (W-CDMA), and Time Division (TDMA). Various communication standards and protocols including but not limited to Multiple Access, Bluetooth, Wi-Fi, Short Message Service (SMS) text, and other related communications considering wireless communication by voice recognition capable device 100 Standards and conventions can be followed.

Since the touch sensor 602 is the same as the touch sensor 102 described above, repeated description thereof will be omitted.

Since the open / close sensor 603 is the same as the open / close sensor 103, repeated description thereof will be omitted.

The controller 604 may receive the first signal to determine whether a user is in contact, and receive the second signal to determine an open / closed state of the door. The control unit 604 may output a control signal for controlling the communication unit 601 to transmit the image photographed by the camera unit 601 as image data based on whether the user is in contact and whether the door is opened or closed. have.

The camera unit 605 is located inside the refrigerator, and photographs an inside image of the refrigerator (hereinafter, referred to as an 'internal image'). The camera unit 605 may include a plurality of camera devices in order to photograph various parts of the refrigerator.

FIG. 16 is an exemplary diagram in which an internal image is shown as an augmented reality image to a user wearing the wearable display device 700.

Referring to FIG. 16, two camera devices installed in the refrigerator may be identified. 16 illustrates an embodiment in which the camera unit 605 includes two camera devices, but the present specification is not limited to the above embodiment.

Meanwhile, FIG. 16 may identify a user who wears the wearable display device 700. The wearable display device 700 may receive image data transmitted from the communication unit 601. In addition, the received image data may be displayed to the user as an augmented reality image 701.

The wearable display device 700 illustrated in FIG. 16 is a device of a head type, and may provide augmented reality to a user by overlapping a virtual image in real time as seen by the user in real time. However, in FIG. 16, the wearable display device 700 is shown as an example of a device worn on the head, but the above example does not limit the scope of the present specification. The wearable display device 700 refers to any device that can be attached to the user's body to perform a computing action. At the time of filing the present specification, various types of wearable devices such as glasses, hair bands, wristwatches, arm bands, shoes, neckbands, rings, contact lens types, etc. have been disclosed, but are not limited to the type of wear.

According to one embodiment of the present specification, the control unit 604 may control the internal image to be transmitted as image data from the communication unit 601 when the user's contact is maintained for a predetermined time or more.

To this end, the refrigerator 600 according to the present disclosure may further include a memory unit 606 for storing a preset threshold time T _th . The threshold time T _th is a reference time for determining the user's intention to see the inside of the refrigerator and may be variously set. That is, if the user maintains contact with the touch sensor 602 for more than the threshold time T _th , it may be determined that the user intends to see an internal image through the augmented reality image 701.

Accordingly, the controller 604 may display the internal image in the communication unit 601 when there is no user's contact or when there is a user's contact but the contact holding time is less than the threshold time T _th or the door is open. Control not to transmit data. If there is no contact with the user, it may be determined that the user does not want to see the inside of the refrigerator. In addition, even if there is user contact, if it is less than the threshold time T _th , it may be determined that there is no intention of the user who wants to see the inside of the refrigerator. In addition, if the door is open, since the inside of the refrigerator is already visible, there is no need to check the internal image through the augmented reality image 701.

On the other hand, the controller 604 transmits the internal image as image data from the communication unit 601 when the contact holding time is greater than the threshold time T _th and the door is closed from the time when the user's contact is started. Can be controlled. When all of the above conditions are satisfied, it may be determined that the user wants to see the inside of the refrigerator.

According to an embodiment, the control unit 604 controls the internal image to be output as image data from the communication unit 601, and then the image is transmitted from the communication unit 601 to the internal image while the user's contact is maintained. Can be controlled to continue transmission. If the user keeps contact with the touch sensor 602 even after the user checks the inside image of the refrigerator using the augmented reality image 701, it may be determined that the user intends to keep looking in the refrigerator. Therefore, it is necessary to maintain the internal image to be transmitted as image data from the communication unit 601 while the contact is maintained.

According to another embodiment, the controller 604 controls the internal image to be transmitted as the image data from the communication unit 601, and then passes the internal image from the communication unit 601 to the image data after a preset switching time. You can control it so that it is no longer sent.

According to another embodiment, the control unit 604 controls the internal image to be transmitted as the image data from the communication unit 601 after the user's contact disappears or the door is opened, the internal The image may be controlled so that the communication unit 601 does not transmit the image data. If the user's contact disappears, it may be determined that the user no longer wishes to see the inside of the refrigerator through the augmented reality image 701. In addition, if the door is open, since the inside of the refrigerator is already visible, there is no need to check the internal image through the augmented reality image 701.

On the other hand, the control unit 604 controls the user's contact disappears in the state that the door is closed so that the internal image is not transmitted to the image data from the communication unit 601 and there is a user's re-contact within a preset re-contact time The internal image may be controlled to be transmitted as the image data from the communication unit 601 from the point of time when the user is in contact again. Since the user no longer needs to look inside the refrigerator, the contact with the touch sensor 602 is stopped, but a situation in which the user wants to see the refrigerator again may occur. In this case, after the internal image is controlled not to be transmitted as the image data by the communication unit 601, if the user has a recontact within a preset recontact time, it may be determined that the user intends to see the inside of the refrigerator again. Therefore, it is necessary to control the internal image to be transmitted as image data from the communication unit 601 without delay from the point of time of the recontact.

According to another embodiment of the present specification, the controller 604 may control the internal image to be transmitted as image data from the communication unit 601 through a sliding input of a user.

To this end, the touch sensor 602 may further output a third signal corresponding to the first sliding input of the user. In addition, the controller 604 may control the internal image to be transmitted as image data from the communication unit 601 when the third signal is received. That is, if the user has an aggressive action such as an input sliding to the touch sensor 602, it may be determined that the user intends to see the inside of the refrigerator. Therefore, in this case, it is necessary to control the internal image to be transmitted as image data from the communication unit 601. The third signal is a name for distinguishing the first signal from the second signal. In addition, the first sliding input means a sliding input having a direction different from that of the second sliding input to be described below.

Meanwhile, if the controller 604 controls the internal image to be transmitted as image data from the communication unit 601 through a sliding input of the user, the controller 604 transmits the internal image to the communication unit through a sliding input of the user. In operation 601, the control may not be transmitted as image data.

To this end, the touch sensor 602 may further output a fourth signal corresponding to a second sliding input having a direction opposite to the first sliding input of the user. The controller 604 controls the internal image to be transmitted as the image data in the communication unit 601 and then receives the fourth signal so that the internal image is not transmitted as the image data in the communication unit 601. Can be controlled. The fourth signal is a name for distinguishing it from the first to third signals described above.

In addition, after the control unit 604 controls the internal image to be transmitted as the image data from the communication unit 601 through a sliding input of the user, a predetermined switching time elapses, and the internal image is transmitted from the communication unit 601. It can be controlled so as not to be transmitted as image data.

According to another embodiment of the present specification, the controller 604 may control the image to be transmitted from the communication unit 601 as image data through a knock input of a user.

To this end, the touch sensor 602 may further output a fifth signal corresponding to the knock input of the user. The controller 604 may control the internal image to be transmitted as image data from the communication unit 601 when the fifth signal is received.

Meanwhile, when the control unit 604 controls the internal image to be transmitted as the image data from the communication unit 601 and then re-receives the fifth signal, the control unit 604 transmits the internal image as the image data from the communication unit 601. Can be controlled to prevent If the user repeats an aggressive action such as a knock input, it may be determined that the user no longer wants to see the refrigerator. Therefore, it is not necessary to control the internal image to be transmitted as image data from the communication unit 601.

On the other hand, the controller 604 controls the internal image to be transmitted as the image data after a preset switching time after controlling the internal image to be transmitted as the image data from the communication unit 601. You may.

Meanwhile, the controller may include a processor, an application-specific integrated circuit (ASIC), another chipset, a logic circuit, a register, a communication modem, a data processing device, and the like, which are known in the art to execute calculation and various control logic. It may include. In addition, when the above-described control logic is implemented in software, the control unit may be implemented as a set of program modules. In this case, the program module may be stored in the memory unit and executed by a processor.

The terminology used herein is a general term that has been widely used as far as possible while considering the functions of the embodiments disclosed herein, but may vary according to the intention or custom of a person skilled in the art or the emergence of a new technology. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the specification. Therefore, it is to be understood that the terminology used herein is to be defined based on the meaning of the term and the contents throughout the specification, rather than on the name of the term.

In addition, specific structural to functional descriptions of the embodiments disclosed herein are illustrated for the purpose of describing the embodiments only, and the embodiments may be embodied in various forms. It should not be construed as limiting the scope of rights.

Embodiments according to the concepts of the present disclosure may be variously modified and may have various forms, and specific embodiments are illustrated in the drawings and described in detail herein. However, this is not intended to limit the embodiments in accordance with the concepts herein to the specific form disclosed, it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present specification.

In addition, throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding the other components unless otherwise stated. In addition, the term "~ part" described in the specification means a unit for processing at least one function or operation, which may be implemented by hardware or software, or a combination of hardware and software.

In the above description, the present specification has been described through specific embodiments, but those skilled in the art may make modifications and changes without departing from the spirit and scope of the present specification. Therefore, what can be easily inferred by the person belonging to the field which belongs to the technology disclosed by the detailed description and embodiment of this specification is interpreted as belonging to the scope of this specification.

In addition, in the description of the embodiments of the present disclosure, for convenience of understanding, the dependent configuration has been described based on the example of adding only one, but an embodiment in which two or more dependent configurations are added in combination is also possible. Accordingly, the scope of the present specification is not limited to the embodiments disclosed herein.

Various embodiments have been described in the best mode for carrying out the present specification.

It will be apparent to those skilled in the art that various modifications and variations can be made herein without departing from the spirit and scope of this specification. Accordingly, this specification is intended to cover the modifications and variations of this specification provided within the scope of the appended claims and their equivalents.

The present specification may apply to the refrigerator in whole or in part.

Claims

A display unit which is switched to a transparent or opaque state by a control signal;

A touch sensor for detecting a touch of a user and outputting a first signal;

An open / close sensor configured to detect an open / close state of the refrigerator door and output a second signal; And

A control unit configured to receive the first signal to determine whether a user is in contact, and to receive the second signal to determine an open / closed state of the door to output a control signal for controlling a transparent or opaque state of the display unit; .
The method of claim 1,

The memory unit further stores a preset threshold time.

And the control unit outputs a control signal for maintaining the display unit in an opaque state when there is no user's contact or user's contact but the contact holding time is less than the threshold time or the door is open.
The method of claim 1,

The memory unit further stores a preset threshold time.

And the control unit outputs a control signal for switching the display unit to a transparent state when the contact holding time is more than the threshold time and the door is closed from the time point of contact of the user.
The method of claim 3,

And the control unit outputs a control signal for maintaining the display unit in a transparent state while the contact of the user is maintained after switching the display unit to the transparent state.
The method of claim 3,

And the control unit outputs a control signal for switching the display unit to an opaque state after a predetermined switching time passes after the display unit is switched to the transparent state.
The method of claim 3,

And the control unit outputs a control signal for switching the display unit to an opaque state when the contact of the user disappears or the door is opened after switching the display unit to the transparent state.
The method of claim 6,

The control unit, after the user's contact disappears in the closed state of the door to switch to the opaque state, if there is a user's re-contact within a preset re-contact time, the display unit from the time of the user's re-contact A refrigerator, characterized in that for outputting a control signal for switching back to a transparent state.
The method of claim 1,

The touch sensor may further output a third signal corresponding to the first sliding input of the user,

And the control unit outputs a control signal for switching the display unit to a transparent state when receiving the third signal.
The method of claim 8,

And the control unit outputs a control signal for switching the display unit to a transparent state by sliding an opaque portion of the display unit when outputting a control signal for switching the display unit to a transparent state.
The method of claim 9,

The control unit controls to switch the display unit to the transparent state by sliding the opaque portion of the display unit in the same direction as the first sliding input direction of the third signal when outputting a control signal for switching the display unit to the transparent state. A refrigerator characterized by outputting a signal.
The method of claim 8,

The touch sensor further outputs a fourth signal corresponding to a second sliding input having a direction opposite to the first sliding input of the user,

And the control unit outputs a control signal for switching the display unit to an opaque state when receiving the fourth signal after switching the display unit to a transparent state.
The method of claim 11,

The control unit, when outputting a control signal for switching the display unit to the opaque state, the refrigerator characterized in that for sliding the transparent portion of the display unit to output a control signal that the display unit is in an opaque state.
The method of claim 12,

The control unit controls to switch the display unit to an opaque state by sliding a transparent portion of the display unit in the same direction as a second sliding input direction of the fourth signal when outputting a control signal for switching the display unit to an opaque state. A refrigerator characterized by outputting a signal.
The method of claim 8,

And the control unit outputs a control signal for switching the display unit to an opaque state after a predetermined switching time passes after the display unit is switched to the transparent state.
The method of claim 1,

The touch sensor further outputs a fifth signal corresponding to a knock input of the user,

And the control unit outputs a control signal for switching the display unit to a transparent state when receiving the fifth signal.
The method of claim 15,

When the control unit outputs a control signal for switching the display unit to a transparent state, the control unit for outputting a control signal for switching the display unit to a transparent state gradually disappears from the portion close to any one point of the display unit. Refrigerator.
The method of claim 15,

And the control unit outputs a control signal for switching the display unit to an opaque state when the fifth signal is re-received after switching the display unit to a transparent state.
The method of claim 17,

When the control unit outputs a control signal for switching the display unit to an opaque state, the control unit outputs a control signal for switching the display unit to an opaque state by gradually disappearing the transparent part from a part far from any one point of the display unit. Refrigerator.
The method of claim 15,

And the control unit outputs a control signal for switching the display unit to an opaque state after a predetermined switching time passes after the display unit is switched to the transparent state.
(a) receiving a first signal output by a touch sensor detecting a user's touch to determine whether the user has touched it;

(b) determining an open / closed state of the door by receiving a second signal output by the open / close sensor detecting a open / closed state of the refrigerator door; And

and (c) outputting a control signal for controlling a transparent or opaque state of the display unit by determining whether the user is in contact and whether the door is opened or closed.