WO2015080339A1

WO2015080339A1 - Display device and method of controlling the same

Info

Publication number: WO2015080339A1
Application number: PCT/KR2014/000400
Authority: WO
Inventors: Jongho Kim; Sinae Chun; Doyoung Lee
Original assignee: Lg Electronics Inc.
Priority date: 2013-11-28
Filing date: 2014-01-14
Publication date: 2015-06-04
Also published as: KR102208112B1; KR20150061790A

Abstract

A display device and a method of controlling the same are disclosed. The display device includes a display unit configured to display visual information, a sensor unit configured to sense gesture input, and a processor configured to control the display unit and the sensor unit. The processor detects first gesture input when the display device is in a standby mode, determines a matching ratio between a pattern of the detected first gesture input and an unlock pattern, activates a pattern recognition interface if the matching ratio exceeds a predetermined ratio, wherein the pattern recognition interface displays position marks on the display unit, detects second gesture input for the displayed position marks, and unlocks the display device if the pattern of the first gesture input and the second gesture input matches the unlock pattern.

Description

DISPLAY DEVICE AND METHOD OF CONTROLLING THE SAME

The present disclosure relates to a display device and a method of controlling the same, and more particularly, to a method of activating a pattern recognition interface via gesture input in a standby mode of a display device without input of a physical button to switch the display device to an unlock mode.

A display device such as a smartphone or a personal digital assistant (PDA) includes a function for switching to a standby mode when not used for a predetermined time. In this case, in order to utilize the display device again, the display device needs to be switched from a standby mode to an unlock mode. A method of unlocking a display device may vary according to device type.

An unlock method may include a pattern recognition method, a face recognition method, a password method, etc. For example, the pattern recognition method refers to a method of displaying lattice points on a screen of a display device and drawing a predetermined pattern to unlock the display device. In addition, the face recognition method refers to a method of recognizing the face of a user which is pre-stored in a display device via a camera located on a front surface of the device to unlock the display device. In addition, the password method refers to a method of enabling a user to input a predetermined password to unlock the display device.

An object of one embodiment devised to solve the problem lies in a display device which activates a sensor unit via gesture input for a display unit without input of a physical button such as a home button or a power button to unlock the display device.

Another object of another embodiment devised to solve the problem lies in a display device which determines whether an unlock pattern interface is activated via a matching ratio between a pattern of first gesture input and an unlock pattern.

Another object of another embodiment devised to solve the problem lies in a display device which determines at least one of the display position and size of an unlock pattern interface based on at least one of the length and position of first gesture input.

Another object of another embodiment devised to solve the problem lies in a display device which maintains the display device in a standby mode if a pattern of continuous second gesture input is different from an unlock pattern even when a matching ratio between a pattern of first gesture input and the unlock pattern exceeds a predetermined ratio.

Another object of another embodiment devised to solve the problem lies in a display device which does not activate a pattern recognition interface if a starting point of first gesture input does not correspond to a starting area of a unlock pattern.

The object of the present disclosure can be achieved by providing a display device including a display unit configured to display visual information, a sensor unit configured to sense gesture input, and a processor configured to control the display unit and the sensor unit, wherein the processor is further configured to: detect a first gesture input when the display device is in a standby mode, determine a matching ratio between a pattern of the detected first gesture input and an unlock pattern, activate a pattern recognition interface if the matching ratio exceeds a predetermined ratio, wherein the pattern recognition interface displays position marks on the display unit, detect a second gesture input for the displayed position marks, and unlock the display device if the pattern of the first gesture input and the second gesture input matches the unlock pattern.

In another aspect of the present disclosure, provided herein is a method of controlling a display device including detecting a first gesture input in a standby mode of the display device, determining a matching ratio between a pattern of the detected first gesture input and an unlock pattern, activating a pattern recognition interface if the matching ratio exceeds a predetermined ratio, wherein the pattern recognition interface displays position marks on the display unit, detecting a second gesture input for the displayed position marks, and unlocking the display device if the pattern of the first gesture input and the second gesture input matches the unlock pattern.

According to one embodiment, a display device may activate a sensor unit via gesture input for a display unit without input of a physical button such as a home button or a power button to unlock the display device.

According to another embodiment, a display device may determine whether an unlock pattern interface is activated via a matching ratio between a pattern of a first gesture input and an unlock pattern.

According to another embodiment, a display device may determine at least one of the display position and size of an unlock pattern interface based on at least one of the length and position of first gesture input.

According to another embodiment, a display device may maintain the display device in a standby mode if a pattern of continuous second gesture input is different from an unlock pattern even when a matching ratio between a pattern of the first gesture input and the unlock pattern exceeds a predetermined ratio.

According to another embodiment, a display device may not activate a pattern recognition interface if a starting point of first gesture input does not correspond to a starting area of a unlock pattern.

The accompanying drawings, which are included to provide a further understanding of the disclosure, illustrate embodiments of the disclosure and together with the description serve to explain the principle of the disclosure.

In the drawings:

FIG. 1 is a block diagram showing a display device of the present disclosure;

FIG. 2 is a diagram showing an embodiment of an unlock pattern of a display device of the present disclosure;

FIG. 3 is a diagram showing a first embodiment of a method of controlling a display device of the present disclosure;

FIG. 4 is a diagram showing a second embodiment of a method of controlling a display device of the present disclosure;

FIG. 5 is a diagram showing a third embodiment of a method of controlling a display device of the present disclosure;

FIG. 6 is a diagram showing an embodiment of gesture input of a display device of the present disclosure;

FIG. 7 is a diagram showing an embodiment of a pattern recognition interface of a display device of the present disclosure;

FIG. 8 is a diagram showing an embodiment of a starting area of an unlock pattern of a display device of the present disclosure;

FIG. 9 is a diagram showing an embodiment of a use mode of a display device of the present disclosure; and

FIG. 10 is a flowchart illustrating a method of controlling a display device of the present disclosure.

Although the terms used in the present disclosure are selected from generally known and used terms, terms used herein may be variable depending on operator’s intention or customs in the art, appearance of a new technology, or the like. In addition, some of the terms mentioned in the description of the present disclosure have been selected by the applicant at his or her discretion, the detailed meanings of which are described in relevant parts of the description herein. Furthermore, the present disclosure must be understood, not simply by the actual terms used but by the meanings of each term lying within.

Although embodiments are described in detail with reference to the accompanying drawings, the present disclosure is not limited by the embodiments.

FIG. 1 is a block diagram showing a display device of the present disclosure. FIG. 1 shows one embodiment, from which some components may be deleted or to which new components may be added as necessary.

As shown in FIG. 1, the display device 100 according to one embodiment may include a display unit 110, a sensor unit 120 and a processor 130.

The display unit 110 may display visual information. The visual information may include content, an application, an image, a moving image, etc. In addition, the display unit 100 may output the visual information on a screen based on a control command of the processor 130.

In the present disclosure, the display unit 110 may correspond to a touch screen. The touch screen may detect the position of a person’s hand or an object which touches characters displayed on a screen or a specific part of the screen without using a separate keyboard and directly receive input data on the screen. Accordingly, in the present disclosure, the display unit 110 may include a sensor unit 120.

The sensor unit 120 may sense a surrounding environment of the display device 100 using at least one sensor mounted in the display device 100 and send the sensed result to the processor 130 in the form of a signal.

The sensor unit 120 may include at least one sensor. In one embodiment, at least one sensor may include a gravity sensor, a geomagnetic sensor, a motion sensor, a gyroscopic sensor, an acceleration sensor, an infrared sensor, an inclination sensor, a brightness sensor, an altitude sensor, an olfactory sensor, a temperature sensor, a depth sensor, a pressure sensor, a bending sensor, an audio sensor, a video sensor, a global positioning system (GPS) sensor, a touch sensor, a grip sensor, etc.

In addition, the sensor unit 120 includes the above-described sensors, senses the environment of the display device 100 and a variety of user input, and sends the sensed result to the processor 130 such that the processor 130 operates according to the sensed result.

In the present disclosure, the sensor unit 120 may sense gesture input. In addition, as described above, the sensor unit 120 may be included in the display unit 110 to sense gesture input. In particular, a touch sensor may be included in the display unit 110 as the sensor unit 120. Here, gesture input may include input by a user’s hand or input by an object (e.g., a pen). For example, gesture input may include single touch input, multi touch input, drag (slide) input, hovering input, etc.

Single touch input may indicate that a user touches the display device 100 once. Multi touch input may indicate that a user touches the display device 100 two times or more. Drag (slide) input may indicate that a user touches the display device 110 once and moves by a predetermined length or more. Hovering input is not direct touch input to the display device 110 but is proximity touch input to the display unit 110 at a predetermined distance from the display unit 110.

The processor 130 may process data, control the units of the display device 100 and control data transmission/reception between the units. In the present disclosure, the processor 130 may detect first gesture input in a standby mode. In addition, the processor 130 may determine a matching ratio between a pattern of the detected first gesture input and an unlock pattern. If the matching ratio exceeds a predetermined ratio, the processor 130 may activate a pattern recognition interface. The processor 130 may detect second gesture input for displayed position marks. In addition, if the pattern of the first gesture input and the second gesture input matches the unlock pattern, the processor 130 may unlock the display device 100. The operation of the processor 130 will be described in detail with reference to FIGs. 2 to 9.

In one embodiment of the present disclosure, operations of the display device 100 may be controlled by the processor 130. For convenience, in the drawings and the following description, assume that such operations are performed/controlled by the display device 100.

Although not shown in FIG. 1, the display device 100 may include a communication unit, a power unit, a storage unit, etc. The communication unit may perform communication with an external device using various protocols and transmit and receive data. In addition, the communication unit may access a network by wires or wirelessly and transmit and receive digital data such as content. For example, the communication unit may use wireless LAN (WLAN)(Wi-Fi), wireless broadband (Wibro), World Interoperability for Microwave Access (WiMax), high speed downlink packet access (HSDPA) communication standard, for connection to wireless networks.

The power unit is a power source connected to a battery of the display device 100 or an external power supply to supply power to the display device 100. In addition, the storage unit may store a variety of digital data such as audio, pictures, moving images or applications. The storage unit may indicate a variety of digital data storage spaces such as a flash memory, a random access memory (RAM) or a solid state drive (SSD). The storage unit may be located inside or outside the display device 100.

The display device 100 shown in FIG. 1 is exemplary and blocks shown in FIG. 1 correspond to logically divided elements of the display device 100. Accordingly, the elements of the display device 100 may be mounted in one chip or a plurality of chips according to device design.

FIG. 2 is a diagram showing an embodiment of an unlock pattern of a display device of the present disclosure. More specifically, FIG. 2 shows a pattern recognition interface 200 and a predetermined unlock pattern 220 of the display device 100.

The display device 100 may include various modes. For example, the display device 100 may include an unlock mode, a lock mode and a standby mode. In one embodiment, the unlock mode indicates a mode that the display unit 110 is activated and a user may use applications, content, etc. included in the display device 100. In another embodiment, the lock mode indicates a mode that the display unit 110 is activated but applications, content, etc. included in the display device 100 may not be used via the display unit 110. Also, in another embodiment, the standby mode indicates that the display unit 110 is activated and a user may not view applications, content, etc. included in the display device 100.

The pattern recognition interface 200 shown in FIG. 2 may be displayed for unlock if the display device 100 is in a lock mode. The pattern recognition interface 200 is used to unlock the display device 100 if a pattern pre-set by a user is recognized. In addition, the pattern recognition interface 200 may display position marks 210 on the display unit 110. The position marks 210 enable a user to easily draw a pattern and the number or shape of position marks may be variously changed. As shown in FIG. 2, in the present disclosure, a total of 9 position marks 210 are displayed.

The pattern recognition interface 200 shown in FIG. 2 may be activated if first gesture input of a user is detected in the standby mode. Here, activation of the pattern recognition interface 200 may refer to activation of a pattern recognition function of the display device 100. That is, the display device 100 may activate the pattern recognition function to detect user input for the pattern recognition interface 200.

The unlock pattern may be predetermined in the display device 100 or may be variously set by a user. In addition, the unlock pattern may have at least two bending parts. For example, as shown in FIG. 2, the unlock pattern may have two bending parts. Hereinafter, in the present disclosure, assume that the unlock pattern shown in FIG. 2 is predetermined. In addition, the unlock pattern may correspond to a pattern formed using at least a half of the position marks. In the embodiment of FIG. 2, the unlock pattern may be formed using seven of nine position marks.

FIGs. 3 and 4 show an embodiment of the case in which a matching ratio between a pattern of first gesture input and an unlock pattern exceeds a predetermined ratio in a method of controlling a display device of the present disclosure. In addition, FIG. 5 shows an embodiment of the case in which a matching ratio between a pattern of first gesture input and an unlock pattern does not exceed a predetermined ratio in a method of controlling a display device of the present disclosure.

First, FIG. 3 is a diagram showing a first embodiment of a method of controlling a display device of the present disclosure. More particularly, FIG. 3 shows the case in which first gesture input to the display device 100 is detected in a standby mode and a matching ratio between the pattern of the detected first gesture input and the unlock pattern exceeds the predetermined ratio.

First, as shown in the first drawing of FIG. 3, the display device 100 may be in the standby mode. In this case, as described with reference to FIG. 2, the display unit 110 may be deactivated such that a user 10 may not use content via the display device 100. Accordingly, the user 10 may wish to activate the display unit 110 to use content.

The display device 100 may detect the first gesture input in the standby mode as shown in the first drawing of FIG. 3. In this case, the display device 100 may detect the first gesture input in a state in which the sensor unit included in the display unit 110 is activated. Here, the sensor unit may be activated by third gesture input. The third gesture input will be described with reference to FIG. 6.

As shown in FIG. 3, the first gesture input may correspond to slide (drag) input having at least one bending part. That is, the first gesture input may start upon input by the user 10 shown in the left of FIG. 3 and end upon input by the user 10 shown in the right of FIG. 3. In FIG. 3, the first gesture input may start on the left of the display unit, straightly move to the right and move in a left lower direction at an angle of 45?.

Meanwhile, the display device 100 may enable the user to recognize the first gesture input on the display unit 110 using graphic effects. That is, the display device 100 may display indicators along positions, through which gesture input of the user 10 pass, to indicate that the unlock pattern is formed. For example, as shown in FIG. 3, the display device 100 may display indicators such as arrows or circles along positions, through which gesture input of the user 10 pass.

Next, the display device 100 may determine a matching ratio between the pattern of the detected first gesture input and the predetermined unlock pattern. In the present disclosure, assume that the predetermined unlock pattern corresponds to the unlock pattern shown in FIG. 2. The predetermined ratio may be set by the user 10 or may be predetermined by the display device 100. For example, the matching ratio may correspond to 20% to 50%. If the pattern of the first gesture input shown in FIG. 3 and the predetermined unlock pattern are compared, the matching ratio may correspond to 50%.

Meanwhile, the display device 100 may determine the matching ratio between the pattern of the first gesture input and the unlock pattern if a pattern corresponding to a minimum length of the unlock pattern is formed by the first gesture input. For example, the minimum length of the unlock pattern may correspond to a length longer than a distance between two of the plurality of position marks. Accordingly, if the first gesture input is recognized, the display device 100 may determine the matching ratio between the pattern of the first gesture input and the unlock pattern.

FIG. 4 is a diagram showing a second embodiment of a method of controlling a display device of the present disclosure. More particularly, FIG. 4 shows unlock of the display device 100 if the matching ratio exceeds the predetermined ratio in FIG. 3.

If the matching ratio exceeds the predetermined ratio, the display device 100 may activate the pattern recognition interface 200. As described with reference to FIG. 2, activation of the pattern recognition interface 200 may refer to activation of a pattern recognition function of the display device 100. As shown in the first drawing of FIG. 4, when the display device 100 activates the pattern recognition interface 200, the position marks may be displayed on the display unit 110. The display device 100 may activate the pattern recognition interface 200 not only when the matching ratio exceeds the predetermined ratio but also when the matching ratio is equal to the predetermined ratio.

Here, the position marks may be displayed based on the position and size of the detected first gesture input in FIG. 3. That is, as shown in the first drawing of FIG. 3, nine position marks may be displayed on the display unit 110 in consideration of the position and size of the detected first gesture input. This will be described again with reference to FIG. 7.

Next, the display device 100 may detect second gesture input for the displayed position marks. The second gesture input may correspond to continuous input of the first gesture input and correspond to drag (slide) input. As shown in the second drawing of FIG. 4, the second gesture input may correspond to input which starts at a point where the first gesture input ends.

Next, if the pattern of the first gesture input and the second gesture input matches the unlock pattern, the display device 100 may unlock the display device 100. As shown in the second drawing of FIG. 4, the pattern of the first gesture input and the second gesture input may correspond to the same pattern as the unlock pattern shown in FIG. 2. Although the size and position of the pattern of the first gesture input and the second gesture input may be different from those of the unlock pattern, the display device 100 may compare the pattern of the first gesture input and the second gesture input and the unlock pattern in terms of shape to determine that the pattern of the first gesture input and the second gesture input matches the unlock pattern.

In this case, as shown in the third drawing of FIG. 4, the display device 100 may be unlocked. That is, the display device 100 may be unlocked to display a home screen or a screen of content which was previously executed.

The display device 100 may maintain the standby mode if the pattern of the first gesture input and the second gesture input does not match the unlock pattern. That is, although the matching ratio between the pattern of the first gesture input and the unlock pattern exceeds the predetermined ratio, if the detected second gesture input does not match the unlock pattern, the display device 100 may not activate the pattern recognition interface. In other words, in the embodiments of FIGs. 3 and 4, the display device 100 may activate the pattern recognition interface if the same gesture input as a part of the unlock pattern is detected but may not unlock the display device 100 if the pattern of the gesture input does not match the unlock pattern.

In the embodiments of FIGs. 3 and 4, the display device 100 may determine similarity between a pattern of gesture input recognized in a state in which the position marks are not displayed and the unlock pattern and display the position marks to enable the user 10 to easily draw the unlock pattern. In addition, the display device 100 may display the position marks through only gesture input without input of a physical button such as a home button or a power button. The user may easily unlock and use the display device 100 if the pattern recognition interface is activated.

FIG. 5 is a diagram showing a third embodiment of a method of controlling a display device of the present disclosure. More particularly, FIG. 5 shows the case in which first gesture input to the display unit 110 is detected and the matching ratio between a pattern of the first gesture input and an unlock pattern does not exceed a predetermined ratio.

First, as shown in the first drawing of FIG. 5, the display device 100 may be in the standby mode. In addition, the display device 100 may detect first gesture input in the standby mode. In this case, the display device 100 may detect the first gesture input in a state in which the sensor unit of the display unit is activated. Here, the sensor unit may be activated by third gesture input. That is, the sensor unit included in the display unit may be activated without input of a separate physical button. The third gesture input will be described with reference to FIG. 6.

Referring to the first and second drawings of FIG. 5, the first gesture input may correspond to slide (drag) input having at least one bending part. That is, the first gesture input may start at input of the user 10 shown in the first drawing of FIG. 5 and end at input of the user 10 shown in the second drawing of FIG. 5. The first gesture input shown in FIG. 5 start on the left of the display unit, straightly move to the right and move in a lower direction at an angle of 90?. In this case, as described above with reference to FIG. 3, the display device 100 may inform the user 10 that the first gesture input has been detected via graphic effects.

Next, the display device 100 may determine the matching ratio between the pattern of the detected first gesture input and the predetermined unlock pattern. Here, the predetermined unlock pattern may correspond to the unlock pattern shown in FIG. 2. In addition, the display device 100 may determine whether the matching ratio between the pattern of the detected first gesture input and the predetermined unlock pattern exceeds the predetermined ratio. For example, the predetermined ratio may correspond to 50%.

Referring to the second drawing of FIG. 5, the matching ratio between the pattern of the first gesture input and the unlock pattern may correspond to about 40%. That is, in this case, the display device 100 may determine that the matching ratio between the pattern of the first gesture input and the unlock pattern does not exceed the predetermined ratio.

Accordingly, the display device 100 may be switched to the standby mode again. More particularly, the display device 100 may be switched from the lock mode for detecting the first gesture input to the standby mode again. In addition, the display device 100 may not activate the pattern recognition interface on the display unit 110, unlike FIG. 4.

In the embodiment of FIG. 5, if the matching ratio between the pattern of the first gesture input and the unlock pattern does not correspond to the predetermined ratio, the display device may be switched to the standby mode again regardless of presence/absence of the second gesture input. In addition, the user 10 can easily recognize whether the gesture input corresponds to the unlock pattern.

FIG. 6 is a diagram showing an embodiment of gesture input of a display device of the present disclosure. More specifically, FIG. 6 shows third gesture input for activating the sensor unit included in the display unit 110 in the display device 100 in the standby mode.

As described above with reference to FIGs. 3 and 5, the display device may detect the first gesture input in a state of activating the sensor unit. In the present disclosure, the sensor unit included in the display unit 110 may be activated by gesture input to the display unit 110 without using the physical button such as the home button or the power button.

In addition, the sensor unit may be activated by the third gesture input. The third gesture input is input for activating the sensor unit and may be implemented in various manners. Referring to FIG. 6(a), the third gesture input may correspond to a single touch input and the first gesture input may correspond to a drag (slide) input. In this case, the display device 100 may activate the sensor unit via the third gesture input which is single touch input. In addition, the display device 100 may recognize a pattern to be expressed by the user by the first gesture input which is continuous input of the third gesture input. In the embodiments of FIGs. 3 and 5, the sensor unit may be activated by the third gesture input shown in FIG. 6(a).

Referring to FIG. 6(b), both the third gesture input and the first gesture input may correspond to single touch input. In this case, the display device 100 may activate the sensor unit via continuous touch input and activate the pattern recognition interface 200 on the display unit 110, unlike FIG. 6(a). Accordingly, the user 10 may perform gesture input in a state of viewing the position marks displayed on the pattern recognition interface 200. Although not shown in FIG. 6, the third gesture input may correspond to multi touch input, drag input, hovering touch input, etc.

In the present embodiment, the user 10 may activate the sensor unit included in the display unit via gesture input without input through the physical button and activate the pattern recognition interface.

FIG. 7 is a diagram showing an embodiment of a pattern recognition interface of a display device of the present disclosure. More particularly, FIG. 7 shows the size and position of the pattern recognition interface 200 determined based on the first gesture input.

First, as described with reference to FIG. 3, the display device 100 may detect the first gesture input of the user 10 and display the pattern recognition interface 200 if the matching ratio between the pattern of the first gesture input and the unlock pattern exceeds the predetermined ratio. At this time, at least one of the size and position of the displayed pattern recognition interface 200 may be determined based on at least one of the length and position of the first gesture input.

In one embodiment, the display device 100 may determine the size of the pattern recognition interface 200 based on the length of the movement path of the detected first gesture input. For example, the display device 100 may determine the width and length of the plurality of position marks to be displayed in the pattern recognition interface 200 based on the length of the movement path of the first gesture input to display the position marks. Accordingly, when the lengths of the movement paths of the first gesture input of FIGs. 7(a) and 7(b) are different, the sizes of the displayed position marks may be different.

In another embodiment, the display device 100 may determine the size of the pattern recognition interface 200 based on the length of a part in which the pattern of the first gesture input and the unlock pattern match. More specifically, the display device 100 may determine the part in which the pattern of the first gesture input and the unlock pattern match and determine the size of the plurality of position marks to be displayed based on the length where the pattern of the first gesture input and the unlock pattern matches.

Also, in another embodiment, the display device 100 may determine the position of the pattern recognition interface 200 based on the position of the first gesture input. Referring to FIG. 7(a), since the first gesture input is located on the left upper side of the display unit 110, the display device 100 may display the pattern recognition interface 200a on the left upper side of the display unit 110. Referring to FIG. 7(b), since the first gesture input is located near the center of the display unit 110, the display device 100 may display the pattern recognition interface 200b at the center of the display unit 110.

As another example, the display device 100 may determine the position and size of the pattern recognition interface 200 based on the position of the first gesture input and the length of the movement path of the first gesture input.

That is, in the present embodiment, the size and position of the pattern recognition interface 200 displayed on the display device 100 may be variously changed according to the size and position of the first gesture input by the user 10.

FIG. 8 is a diagram showing an embodiment of a starting area of an unlock pattern of a display device of the present disclosure. More particularly, the pattern recognition interface is activated depending on whether the starting point of the first gesture input corresponds to the starting area of the unlock pattern.

First, as described above with reference to FIG. 6, the display device 100 may activate the sensor unit by the third gesture input. Accordingly, the display device 100 may detect the first gesture input on the activated display unit 110.

In this case, the display device 100 may determine whether the starting point of the first gesture input corresponds to the starting area of the unlock pattern. That is, if the starting point of the first gesture input corresponds to the starting area of the unlock pattern and the matching ratio between the pattern of the first gesture input and the unlock pattern exceeds the predetermined ratio, the display device 100 may activate the pattern recognition interface 200. If the starting point of the first gesture input does not correspond to the starting area of the unlock pattern, the display device 100 may not activate the pattern recognition interface 200 regardless of whether the matching ratio between the pattern of the first gesture input and the unlock pattern exceeds the predetermined ratio. In this case, the display device may be switched to the standby mode again.

The starting area 20 of the unlock pattern may be determined based on at least one of the starting point of the unlock pattern and the shape of the unlock pattern. Here, the starting point of the unlock pattern indicates a point where the unlock pattern starts on the display unit 110. The starting area 20a of the unlock pattern 220a shown in FIG. 8(a) may correspond to the left upper side of the display unit 110 because the starting point corresponds to the left upper side of the display unit. The starting area 20b of the unlock pattern 220b shown in FIG. 8(b) may correspond to the right lower side of the display unit 110 because the starting point corresponds to the right lower side of the display unit.

In addition, the starting pint of the first gesture input may indicate a first point where the first gesture input starts on the display unit 110. For example, if the unlock pattern is the pattern of FIG. 8(a), the starting point of the first gesture input may correspond to the starting area 20a of the unlock pattern. In this case, since the plurality of position marks are displayed on the display unit 110, as shown in the right of FIG. 8(a), if the starting point of the first gesture input is detected in a region located within a distance d1 from the right side of the display unit 110 and a region located within a distance d2 from the lower side of the display unit 110, the display device 100 may be switched to the standby mode.

In one embodiment, in FIG. 8(a), if the starting point of the first gesture input is located at a point where the remaining unlock pattern is sufficiently drawn within the starting area 20a of the unlock pattern, the display device 100 may display the pattern recognition interface in consideration of the matching ratio when the first gesture input is completed. For example, in FIG. 8(a), the starting point of the first gesture input may be located at the left upper side within the starting area 20a of the unlock pattern. In another embodiment, if the starting point of the first gesture input is located within the starting area 20a of the unlock pattern but is located at a position where the remaining unlock pattern is not sufficiently drawn, that is, if the determined pattern recognition interface is too large to be displayed on the display unit 110 when the first gesture input is completed, the display device 100 may not activate the pattern recognition interface. For example, in FIG. 8(a), the starting point of the first gesture input may be located at the right lower side within the starting area 20a of the unlock pattern.

Meanwhile, even when the starting point is located within the distance d1 from the right side of the display unit 110 or within the distance d2 from the lower side of the display unit, if the movement path of the first gesture input is short, since the size of the displayed position marks decreases, the starting area 20a of the unlock pattern may increase.

For example, if the unlock pattern 220b is the pattern of FIG. 8(b), the starting point of the first gesture input may be located within the starting area 20b of the unlock pattern. In this case, since the plurality of position marks are displayed on the display unit 110, as shown in the right side of FIG. 8(b), if the starting point of the first gesture input is detected in a region located within a distance d4 from the left side of the display unit 110 and a region located within a distance d3 from the upper side of the display unit 110, the display device 100 may be switched to the standby mode. Even when the starting point is located within the distance d3 from the upper side of the display unit 110 or within the distance d4 from the left side of the display unit, if the movement path of the first gesture input is short, since the size of the displayed position marks decreases, the starting area 20a of the unlock pattern may increase.

In the present embodiment, the display device 100 may compare the predetermined unlock pattern and the starting point of the first gesture input of the user 10 to rapidly determine whether the pattern recognition interface 200 is activated.

FIG. 9 is a diagram showing an embodiment of a use mode of a display device of the present disclosure. More particularly, FIG. 9 shows a recognition direction of an unlock pattern according to a use mode of the display unit 110.

First, the use mode of the display unit 110 may include a portrait mode and a landscape mode. The portrait mode refers to a mode in which the display device 100 is oriented such that the longer axis thereof is vertical and corresponds to the embodiments of FIGs 2 to 8. The landscape mode refers to a mode in which the display device 100 is oriented such that the longer axis thereof is horizontal and corresponds to the embodiment of FIG. 9.

That is, the display device 100 may determine the recognition direction of the unlock pattern based on the use mode of the display unit 110. As shown in the embodiment of FIG. 9, if the use mode of the display unit 110 is a landscape mode, the display device 100 may recognize the recognition direction of the unlock pattern based on the landscape mode.

First, the display device may detect the first gesture input when the display device is in the standby mode (S1010). As described above with reference to FIG. 3, the display device may detect the first gesture input in a state of activating the sensor unit. In addition, the sensor unit may be activated by the third gesture input shown in FIG. 6. That is, the display device may sequentially detect the third gesture input and the first gesture input.

Next, the display device may determine the matching ratio of the pattern of the detected first gesture input and the unlock pattern (S1020). As described above with reference to FIG. 3, the matching ratio may be variously set.

Next, the display device may determine whether the matching ratio exceeds the predetermined ratio (S1030). In step S1030, if the matching ratio exceeds the predetermined ratio, the display device may activate the pattern recognition interface (S1040). As described above with reference to FIG. 4, activation of the pattern recognition interface 200 may refer to activation of a pattern recognition function of the display device 100. In addition, the pattern recognition interface may display the position marks on the display unit.

Next, the display device may detect the second gesture input for the displayed position marks (S1050). As described above with reference to FIG. 4, the second gesture input may correspond to continuous input of the first gesture input.

Next, the display device may determine whether the pattern of the first gesture input and the second gesture input matches the unlock pattern (S1060).

If the pattern of the first gesture input and the second gesture input matches the unlock pattern in step S1060, the display device may unlock the display device (S1070).

If the matching ratio does not exceed the predetermined ratio in step S1030 and if the pattern of the first gesture input and the second gesture input does not match the unlock pattern in step S1060, the display device may maintain the standby mode (S1080). As shown in FIG. 5, if the matching ratio between the pattern of the first gesture input and the unlock pattern exceeds the predetermined ratio, the display device may maintain the standby mode regardless of presence/absence of the second gesture input. As shown in FIG. 8, if the starting point of the first gesture input does not correspond to the starting area of the unlock pattern, the display device may maintain the standby mode regardless of the pattern of the first gesture input and the second gesture input.

Further, although the embodiments are respectively described with reference to the respective drawings for convenience of description, the embodiments may be combined to implement a new embodiment. A computer readable recording medium having a program recorded therein for implementing the above-described embodiments is also within the spirit of the present disclosure.

The display device and the method of controlling the same according to one embodiment are not limited to the configurations and methods of the above-described embodiments and all or some of the embodiments may be combined and modified.

The display device and the method of controlling the same according to the foregoing embodiments may be implemented as code that can be written to a computer-readable recording medium and can thus be read by a processor. The computer-readable recording medium may be any type of recording device in which data can be stored in a computer-readable manner. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage, and a carrier wave (e.g., data transmission over the Internet). The computer-readable recording medium can be distributed over a plurality of computer systems connected to a network so that computer-readable code is written thereto and executed therefrom in a decentralized manner. Functional programs, code, and code segments needed to realize the embodiments herein can be construed by one of ordinary skill in the art.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present disclosure without departing from the spirit or scope of the disclosure. Thus, it is intended that the present disclosure cover the modifications and variations of this disclosure provided they come within the scope of the appended claims and their equivalents.

Both apparatus and method inventions are mentioned in this disclosure and descriptions of both of the apparatus and method inventions may be complementarily applicable to each other.

As described above, a related description has sufficiently been discussed in the above “Best Mode” for implementation of the present disclosure.

As described above, the present disclosure may be wholly or partially applied to a display device and a method of setting group information.

Claims

A display device comprising:

a display unit configured to display visual information;

a sensor unit configured to sense gesture input; and

a processor configured to control the display unit and the sensor unit,

wherein the processor is further configured to:

detect a first gesture input when the display device is in a standby mode,

determine a matching ratio between a pattern of the detected first gesture input and an unlock pattern,

activate a pattern recognition interface if the matching ratio exceeds a predetermined ratio, wherein the pattern recognition interface displays position marks on the display unit,

detect a second gesture input for the displayed position marks, and

unlock the display device if the pattern of the first gesture input and the second gesture input matches the unlock pattern.
The display device according to claim 1, wherein the processor is further configured to detect the first gesture input in a state of activating the sensor unit.
The display device according to claim 2, wherein the sensor unit is further activated by a third gesture input.
The display device according to claim 3, wherein the processor is further configured to sequentially detect the third gesture input and the first gesture input.
The display device according to claim 3, wherein, if the third gesture input is a single touch input and the first gesture input is a drag input, the processor is further configured to activate the pattern recognition interface when the matching ratio between the pattern of the detected first gesture input and the unlock pattern exceeds the predetermined ratio.
The display device according to claim 3, wherein the processor is further configured to activate the pattern recognition interface if the third gesture input and the first gesture input are single touch input.
The display device according to claim 1, wherein the processor is further configured to maintain the standby mode of the display device if the matching ratio does not exceed the predetermined ratio.
The display device according to claim 1, wherein a size of the pattern recognition interface is determined based on a length of a movement path of the detected first gesture input.
The display device according to claim 1, wherein a size of the pattern recognition interface is determined based on a length where the detected first gesture input and the unlock pattern matches.
The display device according to claim 1, wherein a position of the pattern recognition interface is determined based on a position of the first gesture input.
The display device according to claim 1, wherein the first gesture input and the second gesture input are continuous.
The display device according to claim 1, wherein the processor is further configured to activate the pattern recognition interface if a starting point of the first gesture input corresponds to a starting area of the unlock pattern and maintain the standby mode if the starting point of the first gesture input does not correspond to the starting area of the unlock pattern.
The display device according to claim 12, wherein the starting area of the unlock pattern is determined based on at least one of a shape of the unlock pattern and the starting point of the unlock pattern.
The display device according to claim 1, wherein the processor is further configured to determine a recognition direction of the unlock pattern based on a use mode of the display unit, wherein the use mode includes a portrait mode and a landscape mode.
The display device according to claim 1, wherein the first gesture input includes at least one bending part.
The display device according to claim 1, wherein the processor is further configured to provide the pattern of the detected first gesture input and second gesture input on the display unit as graphic effects.
The display device according to claim 1, wherein determining the matching ratio between the pattern of the detected first gesture input and the unlock pattern corresponds in a case that the length of the first gesture input exceeds a minimum length of the unlock pattern.
The display device according to claim 17, wherein the minimum length of the unlock pattern is longer than a distance between two marks of the position marks.
The display device according to claim 1, wherein the processor is further configured to maintain the standby mode of the display device if the pattern of the first gesture input and the second gesture input does not match the unlock pattern.
A method of controlling a display device, the method comprising:

detecting a first gesture input in a standby mode;

determining a matching ratio between a pattern of the detected first gesture input and an unlock pattern;

activating a pattern recognition interface if the matching ratio exceeds a predetermined ratio, wherein the pattern recognition interface displays position marks on the display unit;

detecting a second gesture input for the displayed position marks; and

unlocking the display device if the pattern of the first gesture input and the second gesture input matches the unlock pattern.