KR20160048466A - Wearable device and method for controlling thereof - Google Patents

Wearable device and method for controlling thereof Download PDF

Info

Publication number
KR20160048466A
KR20160048466A KR1020140145142A KR20140145142A KR20160048466A KR 20160048466 A KR20160048466 A KR 20160048466A KR 1020140145142 A KR1020140145142 A KR 1020140145142A KR 20140145142 A KR20140145142 A KR 20140145142A KR 20160048466 A KR20160048466 A KR 20160048466A
Authority
KR
South Korea
Prior art keywords
display
finger
wearable device
user
touch interaction
Prior art date
Application number
KR1020140145142A
Other languages
Korean (ko)
Inventor
윤민경
김윤경
김지현
곽지연
김현석
윤여준
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to KR1020140145142A priority Critical patent/KR20160048466A/en
Publication of KR20160048466A publication Critical patent/KR20160048466A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Abstract

Provided are a wearable device and a control method thereof. According to one embodiment of the present invention, the wearable device comprises: a display unit displaying a user interface (UI) for controlling the wearable device; a touch sensing unit positioned on a palm of a user to sense a finger touch interaction using at least one finger of a user; and a control unit controlling the wearable device by using the UI based on the at least one sensed finger touch interaction. Therefore, the wearable device can be controlled with one hand.

Description

[0001] WEARABLE DEVICE AND METHOD FOR CONTROLLING THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a wearable apparatus and a control method thereof, and more particularly to a wearable apparatus and a control method thereof,

Recently, various types of wearable devices have been released according to the development of electronic technology. As a method for inputting a control command to a wearable device, a method of inputting by a touch screen or a method of inputting by pressing a mounted hard key is used. However, since the wearable device has to be miniaturized due to its characteristics, there is a problem that the size of the display unit for implementing the touch screen is small. In addition, there is a problem that even when inputting using a hard key, there is a shortage of space for arranging the hard key.

In addition, since the wearer can use the opposite hand of the hand wearing the wearable device in the conventional method, the wearable device can not be operated in a situation where the opposite hand can not be used.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a wearable device and a control method thereof that can intuitively control functions with only a hand wearing a wearable device.

According to an aspect of the present invention, there is provided a wearable device including: a display unit for displaying a UI for controlling the wearable device; A touch sensing unit for sensing a finger touch interaction using at least one finger of the user on the palm of a user; And a controller for controlling the wearable device using the UI based on the sensed at least one finger touch interaction.

The UI may include at least one display item corresponding to the positions of the four fingers excluding the thumb of the user.

When the UI includes four display items, the controller detects a finger touch interaction in which one of the four fingers is tapped through the touch sensing unit, The corresponding display item can be selected.

If the UI includes two display items, the control unit may detect a finger touch interaction in which at least one finger of the four fingers is tapped through the touch sensing unit, The display item corresponding to the position can be selected.

In addition, the controller may control the display unit to display a display item of another page according to the sensed sliding direction, when a finger touch interaction to slide the thumb of the user through the touch sensing unit is detected .

The controller may display an option menu icon together with the display item in one area of the UI when a finger touch interaction for long press the thumb of the user on the side of the touch sensing unit is detected through the touch sensing unit The display unit can be controlled.

When the finger touch interaction that taps the thumb of the user to the side of the touch sensing unit is detected through the touch sensing unit while the option menu icon is being displayed, the control unit displays the lower display item of the option menu as a pop- And to control the display unit to display the display unit.

The controller may control the display unit to display a previous screen when a finger touch interaction for flipping the thumb of the user through the touch sensing unit is detected.

In addition, the controller may control the power of the wearable device to be turned on / off when a finger touch interaction for long pressing all the five fingers of the user is sensed through the touch sensing unit.

And a communication unit for communicating with the external device, wherein the control unit generates a control command for controlling the external device based on the sensed at least one finger touch interaction, and transmits the generated control command to the external It is possible to control the communication unit to transmit the data to the device.

According to another aspect of the present invention, there is provided a method of controlling a wearable device, the method comprising: displaying a UI for controlling the wearable device; Sensing a finger touch interaction with the user's at least one finger; And controlling the wearable device using the UI based on the sensed at least one finger touch interaction.

The UI may include at least one display item corresponding to the positions of the four fingers excluding the thumb of the user.

In addition, when the UI includes four display items, the controlling step may include: when a finger touch interaction in which one of the four fingers is tapped is detected, a display corresponding to the position of the detected one finger You can choose an item.

If the UI includes two display items, the controlling step may include a step of, when detecting a finger touch interaction in which at least one finger of the four fingers is tapped, corresponding to the detected position of the at least one finger Can be selected.

In addition, the controlling step may display a display item of another page according to the sensed sliding direction when a finger touch interaction to slide the thumb of the user is detected.

Then, when a finger touch interaction for long pressing the thumb of the user is detected, an option menu icon may be displayed together with the display item in one area of the UI.

Also, while the option menu icon is being displayed, if a finger touch interaction that taps the user's thumb is detected, the lower display item of the option menu may be popped up and displayed.

The controlling step may display a previous screen when a finger touch interaction for flipping the thumb of the user is detected.

In addition, the controlling step may control the power of the wearable device to be turned on / off when a finger touch interaction for long pressing all the five fingers of the user is sensed.

The controlling step may further include generating a control command for controlling an external device based on the sensed at least one finger touch interaction and transmitting the generated control command to the external device have.

According to various embodiments of the present invention as described above, it is possible to intuitively operate the wearable device and to map various functions by distinguishing the contact state of the finger, the contact time, and the like.

FIG. 1A is a schematic block diagram for explaining a configuration of a wearable device according to an embodiment of the present invention, FIG.
1B is a detailed block diagram illustrating a configuration of a wearable device according to an embodiment of the present invention,
2A and 2B are views showing a wearable device according to an embodiment of the present invention worn in a user's hand,
FIGS. 3A to 5 are views for explaining an operation of selecting a display item included in a UI of a wearable device according to an embodiment of the present invention;
6 to 7D are diagrams for explaining an operation of multiple selection of a display item included in a UI of a wearable device according to an embodiment of the present invention;
8 is a diagram for explaining page movement in a UI of a wearable device according to an embodiment of the present invention;
9 and 10 are views for explaining an option menu call in a UI of a wearable device according to an embodiment of the present invention;
11 is a view for explaining an operation of returning to a previous screen of a UI of a wearable device according to an embodiment of the present invention;
FIG. 12 is a view for explaining an operation of terminating / canceling a function in execution of a wearable device according to an embodiment of the present invention; FIG.
13A and 13B are views for explaining a home / lock function of a wearable device according to an embodiment of the present invention,
FIGS. 14A and 14B are views for explaining an operation of turning on / off a power supply of a wearable device according to an embodiment of the present invention; FIG.
15A and 15B are schematic block diagrams for explaining a configuration of a wearable device according to another embodiment of the present invention,
16A to 16C are views for explaining interlocking with an external device according to another embodiment of the present invention,
17 and 18 are flowcharts for explaining a wearable apparatus control method according to various embodiments of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention, and may vary depending on the user, the operator, or the convention. Therefore, the definition should be based on the contents throughout this specification.

FIG. 1A is a schematic block diagram for explaining a configuration of a wearable device 100 according to an embodiment of the present invention. Referring to FIG. 1A, a wearable device 100 includes a display unit 110, a touch sensing unit 120, and a controller 130. The wearable device 100 is made of a flexible material and can be worn by a user. For example, various types of devices such as clothes, shoes, gloves, watches, glasses, hats, ornaments, etc. that can be worn by a person or an animal can be a wearable device 100.

Hereinafter, a band-type wearable device 100 will be described with reference to FIGS. 2A and 2B. The wearer wears the wearable wearable device 100 on his or her wrist and wears the wearable wearable device 100 with his or her hand when he / she wants to input a touch with one hand. For example, the display unit 110 may be located on the user's hand, and the touch sensing unit 120 may be positioned on the palm of the user. However, it is not necessarily required to be limited to the wearable device 100 of the type shown in FIG.

The display unit 110 displays a UI for controlling the wearable device 100. In addition, the display unit 110 may display various content screens including an application execution screen.

The touch sensing unit 120 senses a finger touch interaction using at least one finger of the user. For example, the touch sensing unit 120 may be located on the palm of the user as shown in FIG. 2B. The touch sensing unit 120 senses the contact state, contact time, moving direction, and the like of the five fingers. The touch sensing unit 120 may transmit the detected content of the finger touch interaction to the control unit 130. For example, the touch sensing unit 120 may determine which one of the five fingers has input a finger touch interaction based on a position at which the user's finger touch interaction is input.

The controller 130 controls the overall configuration of the wearable device 100. When the finger touch interaction is detected through the touch sensing unit 120, the control unit 130 may generate a control command for controlling the wearable device 100 corresponding to the sensed finger touch interaction. For example, the control unit 130 may control the wearable device 100 using the UI displayed on the display unit 110. For example, The control unit 130 controls the display unit 110 to display a UI screen corresponding to the finger touch interaction and to display the changed UI screen.

1B is a detailed block diagram illustrating a configuration of a wearable device 100 according to an embodiment of the present invention. 1B, the wearable apparatus 100 includes a display unit 110, a touch sensing unit 120, a controller 130, a communication unit 140, an audio output unit 150, a storage unit 160, (Not shown).

The display unit 110 displays various control screens and contents including the UI. The display unit 110 may be designed with various display panels. That is, the display unit 110 may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an electronic paper, a plasma display panel (PDP) (Vacuum Fluorescet Display), FED (Field Emission Display), and ELD (Electro Luminescence Display). The display panel is mainly made of a light emitting type, but does not exclude a reflective type display. Also, the display unit 110 may be implemented as a flexible display, a transparent display, or the like.

The touch sensing unit 120 senses a finger touch interaction using at least one finger of the user. The touch sensing unit 120 is composed of a touch sensor, and detects the contact state, the contact time, and the moving direction of the user's five fingers. The touch sensing unit 120 may be a touch sensor, a proximity sensor, a fingerprint recognition sensor, or the like. For example, in the case of a proximity sensor, a user command may be input through a method of approaching the touch sensing unit 120 without necessarily touching the finger. As another example, in the case of a fingerprint recognition sensor, each finger can be directly distinguished, and it can be determined which finger interacts with the finger regardless of the touched position. It is also available in terms of security such as user authentication.

The communication unit 140 transmits / receives data to / from the external device 200. The communication unit 140 is configured as a wireless module and performs a wireless communication function with the external device 200. The communication unit 140 may include various communication chips such as a WiFi chip, a Bluetooth chip, an NFC chip, and a wireless communication chip. When a WiFi chip or a Bluetooth chip is used, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip means a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE)

The audio output unit 150 outputs various kinds of audio data processed by the audio processing unit (not shown) as well as various kinds of notifications and voice messages. For example, when a guidance message is displayed on the display unit 110 of the wearable device 100 through a pop-up window, the same guidance message may be provided by voice.

The storage unit 160 stores various modules for driving the wearable device 100. For example, the storage unit 160 may store software including a base module, a sensing module, a communication module, a presentation module, and a service module. The base module is a base module for processing a signal transmitted from each hardware included in the wearable device 100 and transmitting the signal to the upper layer module. The sensing module is a module for collecting information from various sensors constituting the touch sensing unit 120 and analyzing and managing the collected information. The presentation module is a module for constituting a display screen. The presentation module may include a UI rendering module that performs UI and graphic processing. The communication module is a module for performing communication with the outside. A service module is a module including various applications for providing various services. As described above, the storage unit 160 may include various program modules, but it goes without saying that the various program modules may be omitted, modified or added depending on the type and characteristics of the wearable device 100.

The wearer 170 is configured to allow the wearable device 100 to be worn by the user. For example, in the case of a wearable device 100 implemented as a band type, the wearable portion 170 may be embodied as a band surrounding the wrist. As another example, in the case of a wearable device 100 implemented as a watch, the wearable portion 170 may be implemented as a watch band. The wearable device 100 differs from a general smart device in that it can be worn by a user.

The control unit 130 controls the overall operation of the wearable device 100 by using various programs stored in the low-

1B, the control unit 130 includes a CPU 131, a RAM 133, a ROM 135, a graphics processing unit 137, and a bus 139. At this time, the respective components can be connected to each other via the bus 139.

The CPU 131 accesses the storage unit 160 and performs booting using the OS stored in the storage unit 160. [ The CPU 131 performs various operations using various programs, contents, data stored in the storage unit 160, and the like.

The ROM 135 stores a command set for booting the system and the like. When the turn-on command is input and power is supplied, the CPU 131 copies the OS stored in the storage unit 160 to the RAM 133 according to the command stored in the ROM 135, and executes the OS to boot the system. When the booting is completed, the CPU 131 copies various application programs stored in the storage unit 160 to the RAM 133, executes the application program copied to the RAM 133, and performs various operations.

The graphic processing unit 137 generates a screen including various objects such as a pointer, an icon, an image, and text using an operation unit (not shown) and a rendering unit (not shown). The operation unit calculates an attribute value such as a coordinate value, a shape, a size, and a color to be displayed by each object according to the layout of the screen using the received control command. The rendering unit generates screens of various layouts including the objects based on the attribute values calculated by the operation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 110.

The specific operation of the control unit 130 will be described below with reference to FIG. 3 to FIG.

According to an embodiment of the present invention, the controller 130 may select a display item included in the UI based on the position. Thus, the UI may include at least one display item corresponding to the position of the four fingers except the user's thumb. In order to intuitively select a display item corresponding to the input position of the finger touch interaction, the number of display items included in the UI is preferably 4, 2,

According to an embodiment of the present invention, when a finger touch interaction in which one of the four fingers except for the thumb is tapped is detected through the touch sensing unit 120, the control unit 130 determines the position Can be selected. The tapping finger touch interaction means an operation of pressing the touch sensing part 120 briefly. Figure 3 shows an embodiment in which the UI includes four display items. Referring to FIG. 3A, the display unit 110 displays a UI in which no display item is selected. The UI includes four display items (310, 320, 330, 340). The user wears the wearable device 100 on his / her left hand, and the appearance shown in Fig. 3 corresponds to the palm of the hand.

3B, when the user touches the touch sensing unit 120 located on the palm of the hand and detects a finger touch interaction, the control unit 130 displays a display item The display item 310 representing the function is selected. The control unit 130 may control the display unit 110 to indicate that the display item 310 representing the telephone function is selected. For example, the control unit 130 may control the display unit 110 to additionally display a rectangle surrounding the selected display item 310. For example, In addition, the control unit 130 may control the display unit 110 to display the changed display item type such as highlight processing, enlargement of the display item, and so on, indicating that the display item is selected.

Similarly, in FIG. 3C, when a finger touch interaction in which the user taps the finger touch sensing unit 120 is detected, the control unit 130 selects the contact item 320, which is the second display item corresponding to the finger ring . In response to the detected finger touch interaction in FIGS. 3D and 3E, the control unit 130 can select the e-mail item 330 and the message item 340, respectively, corresponding to the stop and detection of the user.

According to another embodiment of the present invention, even if the UI includes two display items, a finger touch interaction that taps at least one finger among the four fingers excluding the thumb of the user through the touch sensing unit 120 is detected The controller 130 may select a display item corresponding to the detected position of the at least one finger. As shown in FIGS. 4A and 4B, the UI includes two display items 410, 420. For example, the control unit 130 may display the display item 410 corresponding to the "cancel" function and the display item 420 corresponding to the " 110). As shown in FIG. 4A, when the touch sensing unit 120 senses a finger touch interaction in which the user folds the finger and the finger, the control unit 130 selects the 'cancel' display item 410 at the corresponding position. By selecting the "cancel" display item 410 using the UI, the control unit 130 can control the wearable device 100 not to delete the file. Conversely, as shown in FIG. 4B, when the touch sensing unit 120 senses the finger touch interaction in which the user folds the finger and the stop, the control unit 130 selects the "OK" display item 420 at the corresponding position. In this case, the control unit 130 can control the wearable device 100 to delete the file.

In the case where the UI includes two display items, a touch interaction that does not necessarily tap two fingers at the same time is input. For example, the controller 130 may select the "cancel" display item 410 even if the touch sensing unit 120 senses a finger touch interaction in which the user only taps the possession in FIG. 4A.

According to another embodiment of the present invention, the UI may include one display item. When the touch sensing unit 120 senses a finger touch interaction in which all four fingers are tapped, the control unit 130 can select one display item 510 included in the UI. For example, as shown in FIG. 5, while the wearable device 100 performs an operation of loading a specific function, the controller 130 displays a message "Loading" and a message " The display unit 110 may be controlled to display the display unit 510. When the finger touch interaction is sensed by the touch sensing unit 120, the control unit 130 can select the "cancel" In the case where the UI includes one display item, a finger touch interaction which necessarily taps all four fingers as shown in Fig. 5 is not necessarily required. For example, even when a finger touch interaction in which one finger is tapped is detected, the control unit 130 can select the "cancel" display item 510 as when all four fingers are tapped.

According to an embodiment of the present invention, when a plurality of sequential finger touch interactions are sensed by the touch sensing unit 120, the control unit 130 can select multiple display items corresponding to the sensed finger touch interaction. 6 shows an embodiment in which the control unit 130 selects multiple display items in a manner of selecting the display items one by one. Referring to FIG. 6, the UI may include four display items 610, 620, 630, and 640 that are multi-selectable. In the case of multiple selection, the control unit 130 may control the display unit 110 to additionally display an indication indicating whether or not to select one area of the display item.

FIG. 6 shows an embodiment for selecting from the first display item 610 to the fourth display item 640 sequentially. For example, when the finger touch interaction in which the user taps the possession is sensed by the touch sensing unit 120, the control unit 130 selects the first display item 610 corresponding to the position of the possession. The control unit 130 may control the display unit 110 to display a check box at the upper right of the first display item 610 to indicate that the first display item 610 has been selected. After the first display item 610 is selected and the finger touch interaction in which the user taps the finger is detected by the touch sensing unit 120, the controller 130 selects the second display item 620 corresponding to the finger position do. Likewise, the control unit 130 may control the display unit 110 to display a check box on the upper right of the second display item 620. The controller 130 sequentially selects the third display item 630 and the fourth display item 640 when the finger touch interaction is sequentially detected by the touch sensing unit 120. In this case,

If the finger touch interaction at the position corresponding to the selected display item is input again, the control unit 130 can change the selected display item to the non-selected state.

According to another embodiment of the present invention, when the finger touch interaction in which a plurality of fingers are tapped is sensed by the touch sensing unit 120, the control unit 130 can simultaneously select a plurality of display items at corresponding positions. 7A to 7D illustrate an embodiment for selecting a plurality of display items through a finger touch interaction that taps a plurality of fingers.

Referring to FIG. 7A, the UI may include four display items 710, 720, 730, and 740 that are multi-selectable. When the finger touch interaction is simultaneously detected by the touch sensing unit 120, the control unit 130 simultaneously selects the first and second display items 710 and 720, which are the display items of the corresponding positions, . For example, to indicate that a display item has been selected, the control unit 130 may control the display unit 110 to display a check box additionally displayed at the upper right of the display item. 7B, if the finger touch interaction in which the user simultaneously taps the stop and the finger ring is detected by the touch sensing unit, the controller 130 displays the second and third display items 720 and 730, which are the display items of the corresponding positions, Can be selected.

FIGS. 7C and 7D show a case in which there is a finger touch interaction in which three fingers are tapped in the communication, and a case in which there is a finger touch interaction in which both four fingers are tapped simultaneously. 7C, the control unit 130 multiples the display items 720, 730, 740 of the three corresponding positions, corresponding to the finger touch interaction tapping the detection and stop finger. 7D, the control unit 140 selects all of the display items 710, 720, 730, and 740 corresponding to the finger touch interaction that simultaneously taps all four fingers. Similarly, when the finger touch interaction at the position corresponding to the selected display item is sensed by the touch sensing unit 120, the control unit 130 can change the selected display item to the non-selected state. For example, in a state selected as shown in FIG. 7C, when the touch sensing unit 120 senses a finger touch interaction in which a stop and a finger is tapped, the control unit 130 displays the second and third display items 720 and 730 Cancel the selection.

According to an embodiment of the present invention, when a finger interaction to slide a thumb of a user is sensed through the touch sensing unit 120, the controller 130 displays a display item of a different page in accordance with the sensed slide direction The control unit 110 can control the display unit. The slide means an operation of moving to the side while the touch sensing unit 120 is pressed.

8, initially the UI includes four display items 810, 820, 830 and 840, and a circular display 850-1 indicating that it is one page at the bottom of the display item . When the touch sensing unit 120 senses a finger interaction that slides the thumb from the center to the hand direction, the control unit 130 displays the display items 815, 825, 835, and 845 on the next page of the UI 110). In addition, the control unit 130 may control the display unit 110 to change the display item to a circular display 850-2 indicating 2 pages at the lower end of the display item and display the changed display. When the touch sensing unit 120 senses a finger interaction that slides the thumb from the center to the detection direction, the control unit 130 displays the display items 810, 820, 830, and 840 on the previous page of the UI, (110). Also, the control unit 130 may control the display unit 110 to change the display item to a circular display 850-1 indicating that the display item is at the bottom of the display item.

According to an embodiment of the present invention, when a finger touch interaction for long pressing the side of the touch sensing unit 120 with a user's thumb through the touch sensing unit 120 is detected, the control unit 130 displays an option menu icon It is possible to control the display unit 110 to display together with the display item in one area of the UI. For example, the control unit 130 may control the display unit 110 to display an option menu icon overlaid on the display item. The long press means an operation of pressing the touch sensing unit 120 for more than a predetermined time. For example, assuming that the predetermined time is 2 seconds, an operation of shortly pressing less than 2 seconds is recognized as a tap, and an operation of pressing longer than 2 seconds is recognized as a long press. If a finger touch interaction is detected during the display of the option menu icon and the user's thumb is tapped to the side of the touch sensing unit 120 through the touch sensing unit 120, The display unit 110 can be controlled to pop up and display the display item.

9 and 10 are diagrams for explaining an embodiment related to an option menu call. 9, in the initial state, only the display items 910, 920, 930, and 940 included in the UI are displayed on the display unit 110, and the option menu icon 950 is not displayed. The controller 130 controls the display unit 110 to display the option menu icon 950 in one area of the UI when the touch sensing unit 120 detects the finger touch interaction in which the thumb is long pressed in the initial state . For example, as shown in FIG. 9, the option menu item 950 may be displayed overlapping with the fourth display item 940 at the bottom right of the UI. While the option menu icon 950 is being displayed, if the finger touch interaction for long-pressing the thumb is detected by the touch sensing unit 120, the control unit 130 displays the option menu item 950 on the display unit 110).

10, when the finger touch interaction in which the thumb is tapped is detected by the touch sensing unit 120 while the option menu item 1050 is being displayed, the control unit 130 displays the sub menu of the option menu It is possible to control the display unit 110 to display the display items 1051, 1053, 1055, and 1057 in a pop-up form.

According to an embodiment of the present invention, when a finger touch interaction for flipping a thumb of a user through the touch sensing unit 120 is detected, the control unit 130 may control the display unit 110 to display a previous screen have. The flip refers to touching the touch sensing unit 120 in a flicker manner. However, the present invention is not limited to touching the front surface of the touch sensing unit 120. For example, when the wearable device 100 is implemented as a band-type wearable device 100, the user may input a finger touch interaction to flip by inserting a finger into the band.

For example, referring to FIG. 11, when the touch sensing unit 120 detects a finger touch interaction in which the four display items 1110, 1120, 1130, and 1140 are displayed in the initial state in which the finger is tapped, Selects the contact display item 1120, which is the second display item of the corresponding position. When the contact display menu item 1120 is selected to enter the contact menu, the lower display items 1121, 1123, 1125, and 1127 corresponding to the contact can be displayed. When the touch sensing unit 120 senses a finger touch interaction by flipping the thumb by putting the thumb inside the band, the control unit 130 returns to the initial state, which is the previous screen, The control unit 110 can control the display unit.

According to another embodiment of the present invention, when the finger touch interaction for flipping the user's thumb through the touch sensing unit 120 is detected, the control unit 130 may terminate the function being executed in the wearable device 100 . For example, referring to FIG. 12, when a telephone call is received, the control unit 110 displays a display item 1210 corresponding to "telephone reception" and a display item 1220 corresponding to & 110). When the touch sensing unit 120 detects a finger touch interaction that simultaneously taps the phoneme and the bezel, the control unit 130 controls the display unit 1210 to display the first display item of the two display items included in the UI, . If the finger touch interaction that flips the thumb is detected by the touch sensing unit 120 while the "call received" display item 1210 is selected and the call function is running in the wearable device 100, the control unit 130 executes It is possible to terminate the call function.

According to an embodiment of the present invention, when a finger touch interaction for long-pressing four fingers except for the thumb is detected through the touch sensing unit 120, the control unit 130 exits from the currently executing application menu, The display unit 110 can be controlled. In addition, when the touch sensing unit 120 senses a finger touch interaction in which five fingers are tapped, the control unit 130 can turn on / off the screen. In another embodiment, when the touch sensing unit 120 senses a finger touch interaction in which four fingers are tapped while the Lock screen is being displayed, the control unit 130 controls the display unit 110 to switch from the Lock screen to the Home screen, Can be controlled.

Referring to FIG. 13A, when a finger touch interaction for long-pressing four fingers is detected while the execution screen 1310 of the contact application is displayed, the control unit 130 displays the home screen 1320 on the display unit 110 Can be controlled. If the previous screen of the contact application execution screen 1310 is the Home screen 1320, the control unit 130 controls the display unit to display the Home screen 1320 through the finger touch interaction that flips It might be. The control unit 130 controls the display unit 110 to turn off the screen 1330 and locks the wearable device 100 in a locked state State.

13B shows an embodiment in which the screen is turned on and the lock screen is changed to the Home screen. When the touch sensing unit 120 senses a finger touch interaction that simultaneously taps five fingers while the screen is in the off state 1330, the control unit 130 turns on the screen to display the lock screen 1340, ). The controller 130 switches the lock screen 1340 to the home screen 1320 and displays the lock screen 1340 on the display screen 1320. In this case, The display unit 110 can be controlled.

According to another embodiment of the present invention, when a finger touch interaction for long pressing all the five fingers of a user is sensed through the touch sensing unit 120, the controller 130 controls the power of the wearable device 110 to be turned on / off Can be controlled. 14A and 14B are diagrams for explaining an embodiment of turning on / off the power.

As shown in FIG. 14A, when the touch sensing unit 120 senses a finger touch interaction in which all the five fingers are pressed while the contact application displays the execution screen 1410, The display unit 110 may be controlled to display the screen 1420. For example, the Power Off confirmation screen 1420 may include a confirmation message such as " Do you really want to power off? &Quot; and a "Cancel" display item 1421 and an & As another example, the process of displaying the power off confirmation screen 1420 may be omitted. While the power off confirmation screen 1420 is being displayed, if the user touches the detection and stop button to select the second display item "OK" display item 1423, the control unit 130 turns off the power of the wearable device 100 .

14B, when the touch sensing unit 120 senses a finger touch interaction in which all the five fingers are pressed in the state 1430 in which the power of the wearable device 100 is off, the control unit 130 The power supply of the wearable device 100 is changed to the On state. The control unit 130 may control the display unit 110 to display a screen 1440 indicating that the wearable device 100 is booting. When the booting is completed, the lock screen 1450 is displayed on the display unit 110.

It is possible to input intuitive control commands using only the hand wearing the wearable device 100 through the wearable device 100 as described above so that the user can more easily control the wearable device 100 having a small screen have.

The wearable devices 100-1 and 100-2 according to another embodiment of the present invention can operate not only alone but also in cooperation with other external devices 200. [ 15A and 15B are schematic block diagrams for explaining the configuration of the wearable devices 100-1 and 100-2 according to another embodiment of the present invention.

Referring to FIG. 15A, the wearable device 100-1 includes a touch sensing unit 120, a controller 130, and a communication unit 140. This case corresponds to an embodiment in which the wearable device 100-1 is used only for the purpose of controlling the external device 200. [ Referring to FIG. 15B, the wearable device 100-2 includes a display unit 110, a touch sensing unit 120, a controller 130, and a communication unit 140. In the embodiment as shown in FIG. 15B, the wearable device 100-2 itself has the display unit 110, and the user can control the external device 200 while viewing the screen on which the UI for controlling the external device is displayed.

The communication unit 140 transmits / receives data to / from the external device 200. The communication unit 140 is configured as a wireless module and performs a wireless communication function with the external device 200. Specifically, the communication unit 140 can transmit the control command generated by the control unit 130 to the external device 200. [ The communication unit 140 can use various methods such as NFC (Near Field Communication), wireless LAN (Wireless LAN), IR (InfraRed) communication, Zigbee communication, WiFi, Bluetooth and the like.

According to an embodiment of the present invention, the control unit 130 may generate a control command for controlling the external device 200 based on the sensed at least one finger touch interaction. Also, the control unit 130 may control the communication unit 140 to transmit the generated control command to the external device 200. 16A to 16C illustrate an embodiment of transmitting a control command for inputting text to the external device 200 using the text input UI displayed on the display unit 110. [ Referring to FIG. 16A, the external device 200 may be a smart watch, which is a wearable device of another type. When the text input UI is displayed on the display unit of the external device 200 itself, the screen may be small and there may be a problem in discrimination. One embodiment of the text input UI displayed on the wearable device 100 will be described with reference to Figs. 16B and 16C.

16B is a diagram showing an initial screen of the text input UI. The initial screen can be provided by grouping alphabets based on vowels. For example, the control unit 130 may control the display unit 110 to display six display items 1610, 1620, 1630, 1640, 1650, and 1660 on the initial screen. The control unit 130 can generate a text input control command using the finger-touch interaction.

For example, when the touch sensing unit 120 senses a finger touch interaction that taps the substrate while the initial screen of FIG. 16B is displayed, the control unit 130 displays the corresponding display item "a" ). The control unit 130 may control the display unit 110 to display a screen 1615 in which the consonants grouped in the 'a' collection of FIG. 16C are displayed together. Then, when a finger-touch interaction for selecting one of "a", "b", "c", and "d" is detected, the control unit 130 generates a control command for inputting the text, To the external device (200). In another example, when the touch sensing unit 120 senses a finger touch interaction that simultaneously tentatively binds the finger and the bezel while the initial screen of FIG. 16B is displayed, the control unit 130 displays the "u" (1650). Similarly, the control unit 130 may control the display unit 110 to display a screen 1655 in which consonants grouped in the 'u' collection of FIG. 16C are displayed together.

16B and 16C, only the input for the English input is described as an example, but the present invention can also be applied to inputting other characters such as Korean.

Hereinafter, a method of controlling the wearable device 100 according to various embodiments of the present invention will be described with reference to FIGS. 17 and 18. FIG.

17 is a flowchart illustrating a method of controlling the wearable device 100 according to an embodiment of the present invention. First, the wearable device 100 displays a UI for function control and the like (S1710). Then, the wearable device 100 senses the finger touch interaction and receives a user command (S1720). There are various kinds of finger touch interaction such as tap, long press, slide, flip. In addition, the wearable device 100 may map the same tap operation to perform another operation depending on the position. The wearable device 100 can determine which finger touch interaction is input based on the touched finger, the touch time, and the touch type.

The wearable device 100 may then control the wearable device 100 using the UI based on the sensed finger touch interaction (S1730). For example, in the case where the UI includes at least one display item corresponding to the position of four fingers excluding the user's thumb, if a touched finger touch interaction is detected, a display item corresponding to the position of the detected finger You can choose. As another example, if a finger touch interaction is detected that presses the user's thumb long, the wearable device 100 may display an option menu icon with a display item in one area of the UI. While the option menu icon is displayed, if the finger touch interaction that taps the user's thumb is detected, the wearable device 100 can pop up and display the lower display item of the option menu. As another example, if a finger touch interaction that flips the user's thumb is detected, the wearable device 100 may display the previous screen. As another example, when a finger touch interaction in which all the five fingers of a user are pressed is detected, the power of the wearable device 100 can be turned on / off.

18 is a flowchart for explaining a control method of the wearable device 100 according to another embodiment of the present invention. The embodiment shown in Fig. 18 corresponds to an embodiment for the purpose of controlling the external device 200. Fig.

First, the wearable device 100 detects finger touch interaction and determines what the user command is (S1810). Then, the wearable device 100 generates a control command for controlling the external device based on the sensed finger touch interaction (S1820). An example of the control command mapped to the sensed finger touch interaction is the same as that described above, and a description thereof will be omitted. Thereafter, the wearable device 100 can control the external device 200 by transmitting the generated control command to the external device 200 (S1830).

Through the control method of the wearable device 100 according to various embodiments of the present invention as described above, the wearable device itself and the external device can be intuitively controlled with only one hand.

In addition, the program code for performing the control method according to various embodiments as described above can be stored in various types of recording media. More specifically, it may be a random access memory (RAM), a flash memory, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an Electrically Erasable and Programmable ROM (EEPROM), a register, a hard disk, a removable disk, And may be stored in various types of recording media readable by a terminal, such as a memory, a CD-ROM, and the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

100: wearable appliance 110: display part
120: touch sensing unit 130:
140:

Claims (20)

In a wearable device,
A display unit for displaying a UI for controlling the wearable device;
A touch sensing unit for sensing a finger touch interaction using at least one finger of the user on the palm of a user; And
And a controller for controlling the wearable device using the UI based on the sensed at least one finger touch interaction. The method according to claim 1,
The UI includes:
And at least one display item corresponding to a position of the four fingers excluding the thumb of the user. 3. The method of claim 2,
If the UI includes four display items,
Wherein,
Wherein the controller selects a display item corresponding to the detected position of the one finger when a finger touch interaction is detected by tapping one of the four fingers through the touch sensing unit. 3. The method of claim 2,
If the UI includes two display items,
Wherein,
Wherein the controller selects a display item corresponding to the detected position of the at least one finger when a finger touch interaction of tapping at least one of the four fingers is detected through the touch sensing unit. 3. The method of claim 2,
Wherein,
And controls the display unit to display a display item of another page according to the sensed sliding direction when a finger touch interaction to slide the thumb of the user through the touch sensing unit is detected. 3. The method of claim 2,
Wherein,
And controlling the display unit to display an option menu icon together with the display item in one area of the UI when a finger touch interaction for long pressing the user's thumb on the side of the touch sensing unit is detected through the touch sensing unit Wearable device that features. The method according to claim 6,
Wherein,
When the finger touch interaction in which the thumb of the user is tapped to the side of the touch sensing unit is detected through the touch sensing unit while the option menu icon is displayed, the display unit displays the lower display item of the option menu And controls the wearable device. The method according to claim 1,
Wherein,
And controls the display unit to display a previous screen when a finger touch interaction to flip the thumb of the user through the touch sensing unit is detected. The method according to claim 1,
Wherein,
Wherein the controller controls the power of the wearable device to be turned on / off when a finger touch interaction for long pressing all the five fingers of the user is sensed through the touch sensing unit. The method according to claim 1,
And a communication unit for communicating with an external device,
Wherein,
Generates a control command for controlling the external device based on the sensed at least one finger touch interaction, and controls the communication unit to transmit the generated control command to the external device. A method of controlling a wearable device,
Displaying a UI for controlling the wearable device;
Sensing a finger touch interaction with the user's at least one finger; And
And controlling the wearable device using the UI based on the sensed at least one finger touch interaction. 12. The method of claim 11,
The UI includes:
And at least one display item corresponding to a position of the four fingers excluding the thumb of the user. 13. The method of claim 12,
If the UI includes four display items,
Wherein the controlling comprises:
Wherein when a finger touch interaction in which one of the four fingers is tapped is detected, a display item corresponding to the position of the detected one finger is selected. 13. The method of claim 12,
If the UI includes two display items,
Wherein the controlling comprises:
Wherein when a finger touch interaction is detected that taps at least one finger among the four fingers, a display item corresponding to the detected position of the at least one finger is selected. 13. The method of claim 12,
Wherein the controlling comprises:
And when a finger touch interaction to slide the thumb of the user is sensed, the display item of the other page is displayed according to the detected sliding direction. 13. The method of claim 12,
And when the finger touch interaction detecting the long press of the user's thumb is detected, an option menu icon is displayed together with the display item in one area of the UI. 17. The method of claim 16,
Wherein when the finger touch interaction to tap the thumb of the user is detected while the option menu icon is being displayed, the lower display item of the option menu is popped up and displayed. 12. The method of claim 11,
Wherein the controlling comprises:
And when a finger touch interaction to flip the user's thumb is detected, displays the previous screen. 12. The method of claim 11,
Wherein the controlling comprises:
And controls the power of the wearable device to be turned on / off when a finger touch interaction in which all the five fingers of the user are pressed is detected. 12. The method of claim 11,
Wherein the controlling comprises:
Generating a control command for controlling an external device based on the sensed at least one finger touch interaction,
And transmitting the generated control command to the external device.
KR1020140145142A 2014-10-24 2014-10-24 Wearable device and method for controlling thereof KR20160048466A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140145142A KR20160048466A (en) 2014-10-24 2014-10-24 Wearable device and method for controlling thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140145142A KR20160048466A (en) 2014-10-24 2014-10-24 Wearable device and method for controlling thereof

Publications (1)

Publication Number Publication Date
KR20160048466A true KR20160048466A (en) 2016-05-04

Family

ID=56021993

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140145142A KR20160048466A (en) 2014-10-24 2014-10-24 Wearable device and method for controlling thereof

Country Status (1)

Country Link
KR (1) KR20160048466A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975078A (en) * 2016-05-11 2016-09-28 上海墨百意信息科技有限公司 Gesture identification method and device applied to wearable equipment
US10516741B2 (en) 2017-05-11 2019-12-24 Samsung Electronics Co., Ltd. Control device and method for controlling function thereof
EP4141635A4 (en) * 2020-06-05 2023-10-25 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Wearable device interaction method and apparatus, wearable device, and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105975078A (en) * 2016-05-11 2016-09-28 上海墨百意信息科技有限公司 Gesture identification method and device applied to wearable equipment
CN105975078B (en) * 2016-05-11 2019-02-22 上海墨百意信息科技有限公司 Gesture identification method and device for wearable device
US10516741B2 (en) 2017-05-11 2019-12-24 Samsung Electronics Co., Ltd. Control device and method for controlling function thereof
EP4141635A4 (en) * 2020-06-05 2023-10-25 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Wearable device interaction method and apparatus, wearable device, and storage medium

Similar Documents

Publication Publication Date Title
JP5370374B2 (en) Information processing device
KR102119843B1 (en) User terminal device and method for displaying thereof
US11269486B2 (en) Method for displaying item in terminal and terminal using the same
CN103080887B (en) Apparatus and method for proximity based input
KR20160128739A (en) Display apparatus and user interface providing method thereof
US20140368442A1 (en) Apparatus and associated methods for touch user input
CN111522436A (en) Radar-based gesture recognition through wearable devices
KR102367184B1 (en) Method and apparatus for inputting information by using a screen keyboard
AU2013360585A1 (en) Information search method and device and computer readable recording medium thereof
JP2013524311A (en) Apparatus and method for proximity based input
CN104199604A (en) Electronic device with touch display screen and information processing method thereof
MX2015004840A (en) Display apparatus and method for inputting characters thereof.
KR20120126255A (en) Method and apparatus for controlling display of item
US20150248213A1 (en) Method to enable hard keys of a device from the screen
TW201342121A (en) Mechanism to provide visual feedback regarding computing system command gestures
KR20170085826A (en) Apparatus and method for displaying data in an eletronic device
EP2998838B1 (en) Display apparatus and method for controlling the same
KR20160048466A (en) Wearable device and method for controlling thereof
CN104951140A (en) Touch screen menu displaying method and system
EP2634673A1 (en) Remote control and remote control program
KR102295823B1 (en) Method of providing an interface using a mobile device and a wearable device
KR20140130798A (en) Apparatus and method for touch screen panel display and touch key
KR101363661B1 (en) Smart Remote Controller Using Edge Sliding UI
CN108700990A (en) A kind of screen locking method, terminal and screen locking device
KR102300102B1 (en) User terminal device and method for displaying thereof

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination