KR20150146377A - Method for controlling device and the device - Google Patents

Abstract

A method for controlling a device which obtains information related to a type of a hovering input unit transmitting hovering input to the device and displays a user interface corresponding to information related to a type of a hovering input means obtained among the user interfaces related to an application executed on the device.

Description

[0001] METHOD FOR CONTROLLING DEVICE AND THE DEVICE [0002]

The present invention relates to a method and a device for controlling a device.

As networks and multimedia technologies evolve, users of devices can receive various services from service providing servers. In addition, with the development of networks and multimedia technologies, studies on devices have been actively conducted, and devices can provide various types of user interfaces to users.

As the types of the service and the user interface that can be provided by the device are varied, the form of the user input that can be input when the device is controlled in order to receive the service desired by the user has also been diversified. 2. Description of the Related Art [0002] In recent years, there has been a demand for a technique of recognizing various types of input devices and controlling the devices so that the sensors included in the devices are diversified so as to provide a more suitable input form to services available to the user.

An embodiment of the present invention can provide a method and device for controlling a device so that a user can more easily utilize a service available in the device by providing a user interface according to user input means for transmitting information to the device .

A method of controlling a device in accordance with one embodiment of the present invention includes: obtaining information about a type of hovering input means for sending a hovering input to a device; And displaying a user interface corresponding to information on the type of the obtained hovering input means among a plurality of user interfaces related to an application executed in the device.

In a method of controlling a device according to an embodiment of the present invention, the step of displaying may include determining, based on the type of hovering input means, a resolution indicating the degree to which information about different operations can be identified ; And a user interface for outputting information on at least one operation performed in the application according to the determined precision.

In a method of controlling a device according to an embodiment of the present invention, the step of displaying includes displaying a user interface corresponding to an accuracy at which a position at which information on operations that can be performed when an application is executed is output .

In a method of controlling a device according to an embodiment of the present invention, the step of displaying comprises the steps of: when the determined precision is equal to or greater than a threshold value, information about at least one operation is output from the screen of the device Lt; RTI ID = 0.0 > UI < / RTI >

In a method of controlling a device according to an embodiment of the present invention, the step of displaying includes the steps of: determining a unit of performance of an operation selected at the time of execution of an application based on the type of hovering input means; And displaying a user interface in which information on an operation is displayed according to a unit of performance determined among a plurality of user interfaces.

A method of controlling a device according to an exemplary embodiment of the present invention is a method for controlling a device in which a plurality of user interfaces are classified into a plurality of user interfaces by classifying operations performed at the time of application execution according to the precision of hovering input means required to perform each operation, .

In a method of controlling a device according to an embodiment of the present invention, the step of displaying includes a step of preferentially displaying a user interface displaying information on operations corresponding to the type of the hovering input means at the time of executing the application .

In a method of controlling a device in accordance with an embodiment of the present invention, the step of displaying comprises: if the hovering inputs receivable from the hovering input means do not correspond to each of the operations that can be performed when the application is executed, And displaying the output user interface by classifying the information into groups.

In a method of controlling a device according to an embodiment of the present invention, a plurality of user interfaces are arranged in a group in accordance with at least one of the number of times an operation has been performed and the degree of association between operations And includes a user interface classified and displayed.

A method of controlling a device according to an embodiment of the present invention includes: acquiring position information of one side and another side of a hovering input means; Determining a slope of the hovering input means for the device, using the obtained location information; And determining an action to be performed when the application is executed according to the determined slope.

A device according to an embodiment of the present invention includes: a sensing unit for acquiring information about a type of hovering input means for transmitting a hovering input to a device; A control unit for controlling the output of a user interface corresponding to the type of the obtained hovering input means among a plurality of user interfaces related to an application executed in the device; And a display unit for displaying a corresponding user interface.

In the device according to the embodiment of the present invention, the control unit may determine, based on the type of the hovering input means, a resolution indicating the degree to which information on different operations can be identified, , Information on at least one operation performed in the application is output.

In the device according to the embodiment of the present invention, the control unit selects a user interface corresponding to the determined accuracy of the position at which the information on the operations that can be performed when the application is executed is determined.

In the device according to the embodiment of the present invention, when the determined precision is equal to or greater than the threshold value, the control unit selects a user interface from which information on at least one operation is output in accordance with the difference in distance between the hovering input means and the screen of the device .

In the device according to the embodiment of the present invention, the control unit may determine the execution unit of the selected operation at the execution of the application based on the type of the hovering input means, Select the user interface to be displayed.

In the device according to the embodiment of the present invention, the plurality of user interfaces classify the operations performed at the time of application execution according to the precision of the hovering input means necessary to perform each of the operations.

In the device according to the embodiment of the present invention, when executing the application, the control section preferentially selects the user interface displaying the information on the operations corresponding to the type of hovering input means.

In the device according to the embodiment of the present invention, when the hovering inputs receivable from the hovering input means do not correspond to each of the operations that can be performed when the application is executed, the control unit classifies the information on the plurality of operations into groups Select the output user interface.

In a device according to an embodiment of the present invention, a plurality of user interfaces may be classified into a group according to at least one of the number of times the operation has been performed for a predetermined period and the relation between the operations, Includes one user interface.

In the device according to the embodiment of the present invention, the sensing unit acquires positional information of one side and the other side of the hovering input means, and the control unit uses the obtained positional information to determine the inclination of the hovering input means And determines an operation to be performed when the application is executed according to the determined slope.

1 is a conceptual diagram for explaining a method of controlling a device according to an embodiment of the present invention.
2 is a flow chart illustrating a method of controlling a device in accordance with an embodiment of the present invention.
3 is a flowchart illustrating a method of selecting a user interface according to input precision of a device according to an embodiment of the present invention.
4 is a view for explaining a plurality of user interfaces according to an embodiment of the present invention.
5 is a diagram for explaining how a device according to an embodiment of the present invention changes information about an operation displayed on a user interface according to the type of the hovering input means 510,
6 is a flowchart for explaining a method for displaying a user interface in which information about an operation is displayed in accordance with an operation unit of an operation determined based on a type of hovering input means, according to an embodiment of the present invention.
FIG. 7 is a diagram for explaining a user interface in which information on an operation is displayed according to an execution unit of an operation selected based on a type of hovering input means when a moving image playback application is executed according to an embodiment of the present invention;
8A and 8B are diagrams for explaining a user interface in which information on an operation is displayed according to an execution unit of an operation selected based on a type of a hovering input means when a photo folder application is executed according to an embodiment of the present invention .
9 is a diagram for explaining a method of changing a user interface according to hovering input sensed by a device having a large display according to an embodiment of the present invention.
10 is a flowchart illustrating a method of displaying a user interface that outputs information on operations corresponding to the type of hovering input means when an application is executed in a device according to an embodiment of the present invention.
11 is a diagram for explaining how a device selects a user interface according to the type of hovering input means when a document creating application is executed according to an embodiment of the present invention.
12 is a flowchart for explaining a method of determining an operation performed when an application is executed according to a slope of a hovering input means for a device according to an embodiment of the present invention.
13 is a diagram for explaining a method for determining an operation performed when an application is executed according to a slope of hovering input means for a device according to an embodiment of the present invention.
14 and 15 are block diagrams for explaining the configuration of a device according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, an application refers to a set of computer programs for performing a specific task. The applications described herein may vary. For example, there may be a music playback application, a movie playback application, a photo folder application, a camera application, a document editing application, a memo application, a diary application, a phonebook application, a broadcast application, a motion support application, It is not.

On the other hand, the hovering input throughout the specification can be generated when the hovering input means approaches within a predetermined distance from the device. The hovering input generated as the hovering input means approaches the device may be changed according to at least one of the distance between the device and the hovering input means, the movement of the hovering input means, and the type of the hovering input means. The manner in which the device senses the hovering input generated by the hovering input means may vary.

According to one embodiment of the present invention, when the hovering input means accesses the device, the flow of the voltage generated inside the panel of the device can be changed. As the flow of voltage generated within the device changes, a signal can be generated. The device can recognize the coordinates of the position where the hovering input means approaches according to the generated signal. The coordinates herein may include coordinates on a two-dimensional plane as well as coordinates on a three-dimensional space.

According to another embodiment, the device recognizes the signal which is changed in accordance with the static electricity generated in the hovering input means, and can recognize the coordinates of the position where the hovering input means approaches.

According to yet another embodiment, as the hovering input means approaches the device, the device detects the phenomenon that the light is blocked and can not proceed, thereby recognizing the coordinates of the position where the hovering input means approaches.

According to yet another embodiment, as the hovering input means approaches, the device may sense the changing magnetic field and recognize the coordinates of the position to which the hovering input means has approached.

According to yet another embodiment, the device may sense ultrasonic waves of a specific frequency generated in the hovering input means. The device can recognize the coordinates of the position where the hovering input means approaches using the position where the ultrasonic wave is sensed. On the other hand, a method in which the above-described device senses the hovering input means is only an example, and a general proximity sensing technique capable of sensing the non-contact input means can be used as a method of sensing the hovering input means in the device have.

The type of the hovering input means can be determined according to type and performance. The hovering input means may include a pen, a finger or the like, but this is merely an embodiment, and the hovering input means of the present invention is not limited to the above-described example.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram for explaining a method of controlling a device 100 according to an embodiment of the present invention.

The device 100 may display a user interface for outputting information on at least one action that can be performed in an executed application. Here, the information about at least one operation may include an icon 20 indicating an operation, and a content 30 such as an image, text, and moving image outputted on the screen of the device 100 as an operation is executed.

1, when a document editing application is executed in the device 100, icons 20 indicating an operation of copying text constituting a document, an operation of cutting text, and an operation of pasting text are displayed on a user interface Lt; / RTI > Icons 20 indicating the operation are displayed on the three-dimensional space separated from the device 100 in Fig. 1, but this is only an example of the present invention. On the screen of the device 100, icons 20 ) May be displayed. Meanwhile, the selected text 30 may be displayed on the user interface by performing an operation of copying text in the device 100. [

The device 100 according to an embodiment of the present invention may store a plurality of user interfaces related to an executed application. In a plurality of user interfaces, the positions of hovering inputs that must be obtained in order to select information about the operation may be different from each other.

For example, when the first user interface is displayed, when the hovering input means 10 is located at a point where the distance between the device 100 and the device is a predetermined value (D1, D2, D3), the hovering input means 10 can be selected. According to another example, when the second user interface is displayed, the device 100 can perform a corresponding operation according to the distance between the hovering input means 10 and the device and the position of the hovering input means 10 in the two-dimensional plane You can choose. However, this is only one example of a plurality of user interfaces according to an embodiment of the present invention, and the user interface is not limited according to the above-described example.

In a plurality of user interfaces according to an exemplary embodiment of the present invention, information on operations that can be performed when an application is executed may be output to different locations.

On the other hand, the device 100 can select any one of a plurality of user interfaces according to the type of the hovering input means 10 transmitting the hovering input. The type of the hovering input means 10 can be determined according to the type and performance of the hovering input means. The hovering input means may include a pen, a finger, or the like.

Further, the performance of the hovering input means can be determined according to the accuracy that indicates whether the hovering input means can identify the different information output on the user interface and map the hovering input to the intended information.

For example, when the fingers and the pens are compared, the precision may differ depending on the difference between the thickness of the fingers and the thickness of the pen. For example, the fingers may not respectively map the hovering input to the intended information by identifying information located at 2 mm spacing on the device 100, but the pen identifies the information located at 2 mm spacing from the device 100 , The hovering input may be mapped to the intended information. In this specification, the degree to which the hovering input received from the hovering input means can identify different information on the user interface is described with precision. In the above example, it can be explained that the precision of the pen is higher than that of the finger.

The device 100 according to the embodiment of the present invention can select a user interface among the plurality of user interfaces that can correspond to the precision of the hovering input means 10 in which the position of the information about the outputted operation is determined. For example, when the type of the hovering input means 10 is determined with a finger, the device 100 can select a user interface whose information on operation is output according to a distance of an interval exceeding 2 mm.

According to another example, the device 100 may store a plurality of user interfaces corresponding to a performance unit in which the selected operation is performed when the application is executed. For example, when a moving picture playback application is executed, a user interface having a frame unit of 10% of the total frame count and a user interface having 1% of a moving picture frame to be searched can be stored in the device 100. [

The device 100 may select any one of a plurality of user interfaces for outputting information for each execution unit of operation according to the type of the obtained hovering input means 10. [ For example, in the case of a finger having relatively low precision, the device 100 can select a user interface in which the frame unit of the moving picture to be searched is 10% of the total number of frames. Further, in the case of a pen with a relatively high precision, the device 100 can select a user interface whose frame unit of the moving picture to be searched is 1% of the total number of frames.

The device 100 may be a wearable device such as a smart phone, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a global positioning system (GPS) device, a smart watch, ), Laptops, and other mobile or non-mobile computing devices.

2 is a flow chart illustrating a method of controlling a device 100 in accordance with an embodiment of the present invention.

In step S210, the device 100 obtains information about the type of the hovering input means 10 that sends the hovering input to the device 100.

The device 100 according to an embodiment of the present invention can determine the type of the hovering input means 10 according to the degree of capacitance that is changed as the hovering input means 10 is detected. The device 100 compares the information about the degree of change in capacitance according to the type of the hovering input means previously stored and the degree of the changed capacitance as the hovering input means 10 is detected, Can be determined.

According to another example, the device 100 may identify the signal transmitted from the hovering input means 10 to determine the type of hovering input means 10. According to another example, the device 100 may sense the type of the hovering input means 10 and determine the type of the hovering input means 10.

In step S220, the device 100 displays a user interface corresponding to information on the type of hovering input means obtained among a plurality of user interfaces related to an application executed in the device 100. [

The device 100 according to an embodiment of the present invention may store a plurality of user interfaces related to an executed application. The plurality of user interfaces may be different from each other in the location of the hovering input, which must be obtained in order to select any one of the information regarding the plurality of operations.

For example, when a moving image playback application is executed, related operations may include an operation of playing back a moving image, an operation of stopping a moving image, an operation of moving a moving image forward, and an operation of moving a moving image backward. In the first user interface among the plurality of user interfaces related to the moving image playback application, when the hovering input means 10 is located at a position where the distance from the device is D1, D2, D3, D4, the position of the hovering input means 10 Can be selected. According to another example, when the hovering input means 10 is located at a point where the distances to the device are D1, D3, D5, and D7 in the second user interface among the plurality of user interfaces related to the moving image playback application, The operation corresponding to the position of the display unit 10 can be selected.

The device 100 may select any of a plurality of user interfaces, depending on the capabilities of the hovering input means 10. [ The performance of the hovering input means 10 may differ for each type of hovering input means 10. The performance of the hovering input means 10 can be determined according to the accuracy that indicates how much the hovering input means can identify the different information output on the user interface and map the hovering input to the intended information.

According to another example, the device 100 may store a plurality of user interfaces corresponding to a performance unit in which the selected operation is performed when the application is executed. For example, when a moving picture playback application is executed, a user interface having a frame unit of 10% of the total frame count and a user interface having 1% of a moving picture frame to be searched can be stored in the device 100. [

The device 100 may select any one of a plurality of user interfaces for outputting information for each execution unit of operation according to the type of the obtained hovering input means 10. [ This will be described later in detail with reference to Figs. 7 to 9.

The device 100 may select, on the displayed user interface, an action corresponding to the received hovering input. For example, the device 100 may select a cut operation based on the hovering input transmitted by the hovering input means 10 held at position D2 on the selected user interface.

According to another example, the device 100 may display a user interface that outputs information for each performance unit of an operation. For example, in the case of a moving picture reproducing application, the device 100 may display on the screen a user interface displaying a unit in which the fast forwarding operation of the moving picture is performed by the number of 10% of the total number of frames.

3 is a flowchart illustrating a method of selecting a user interface according to the input precision of the device 100 according to an embodiment of the present invention.

At step 310, device 100 obtains information about the type of hovering input means 10 that sends the hovering input to device 100.

Meanwhile, step 310 may correspond to step 210 described above with reference to FIG.

In step 320, the device 100 may determine the precision of the hovering input means 10 based on the type of the hovering input means 10. The accuracy can be determined according to the difference in position of the information required for the hovering input means 10 to identify each of the information output on the user interface.

For example, the fingers may not respectively map the hovering input to the intended information by identifying information located at 2 mm spacing on the device 100, but the pen identifies the information located at 2 mm spacing from the device 100 , The hovering input may be mapped to the intended information. According to the example described above, it can be confirmed that the precision of the pen is higher than the precision of the finger.

In step 330, the device 100 selects a user interface from which information regarding at least one operation performed in the application is output, in accordance with the determined input precision.

The plurality of user interfaces that can be output at the device 100 may each be different in the position at which the hovering input should be received to select information about the operations. For example, in the case of a first user interface, the difference in position where the hovering input should be received in order to identify information about the different operations and select one operation may be 2 mm apart. On the other hand, in the case of the second user interface, the difference in position where the hovering input should be received in order to identify information on different operations and select one operation may be 3 mm intervals.

The device 100 according to an embodiment of the present invention identifies information about an operation output at intervals of 2 mm, and when the accuracy of the hovering input means 10 is low, information about the operation is output at intervals of 3 mm You can select the user interface. For example, when the hovering input means is a finger, the device 100 can select a user interface for outputting information on the operation in accordance with the accuracy of the finger at intervals of 3 mm.

According to another example, the device 100 is configured such that the accuracy of the hovering input means 10 is low, as in the example described above, so that if the hovering inputs receivable from the hovering input means do not correspond to information, respectively, Can be classified into groups and output the user interface. Here, the information on the operations can be classified into two or more groups according to at least one of the number of times the operation has been performed for a predetermined period and the relation between the operations.

On the other hand, when the accuracy of the hovering input means 10 is equal to or greater than the threshold value, the device 100 can select the user interface to be output according to the distance difference between the hovering input means 10 and the device 100 have. The device 100 determines whether the accuracy of the hovering input means 10 is less than the threshold value by comparing the information about the operations with the distance difference between the hovering input means 10 and the device 100, And may select a user interface to be output according to positional information on the plane. This will be described later in more detail with reference to FIG.

In step 340, the device 100 displays the selected user interface. The device 100 may select, on the displayed user interface, an action corresponding to the received hovering input.

Meanwhile, step 340 may correspond to step 230 described above with reference to FIG.

4 is a view for explaining a plurality of user interfaces according to an embodiment of the present invention.

Referring to Figure 4 (a), the device 100 may receive a hovering input from a finger 410 that is a hovering input means. The device 100 may determine the precision of the finger 410 as a hovering input means. For example, the device 100 may obtain information about the precision of the finger 410 from pre-stored data.

The device 100 may select a user interface on which the hovering inputs received from the finger 410 may be mapped to information regarding each intended action based on the precision of the finger 410. [ Here, the precision of the finger 410 is assumed to be less than a preset threshold value in the device 100. [

4A, since the precision of the finger 410 is less than the threshold value, the device 100 can perform the execution of the application in accordance with the distance between the device and the hovering input means and the position information on the two- And may output a user interface from which any one of the information regarding the operations can be selected.

In the case where the distance between the device 100 and the finger 410 is D1, the device 100 can perform the operations of reproducing the moving image included in the first group 420, stopping the moving image, You can choose either one. The device 100 can select any one of an operation to reproduce a moving image, an operation to stop a moving image, and a operation to pause a moving image using the position information of the finger 410 on a two-dimensional plane. For example, when the coordinate of the position of the hovering input means on the two-dimensional plane is (x1, y1), the device 100 selects the operation of reproducing the moving image corresponding to the position of the coordinate (x1, y1) .

If the distance between the device 100 and the finger 410 is D3, the device 100 can select any one of the forward and backward movements of the moving image included in the second group 430. [ The device 100 can select any one of the forward and backward movements of the moving image using the position information of the finger 410 on the two-dimensional plane.

On the other hand, the device 100 may classify the operations into groups according to the number of times each operation has been performed for a predetermined period and the degree of relation between the operations. For example, the device 100 may classify operations with a high number of uses into the same group. In addition, the device 100 may classify the forward and backward operations, which are operations for changing the frame to be reproduced, into the same group, among the operations for reproducing the moving image.

4B, device 100 may receive a hovering input from pen 440, which is hovering input means. The device 100 can determine the precision of the pen 440, which is the hovering input means. For example, the device 100 may obtain information about the precision of the pen 440 from pre-stored data.

The device 100 may select a user interface on which the hovering inputs received from the pen 440 may be mapped to information regarding each intended action, based on the precision of the pen 440. [ Here, the precision of the pen 440 is assumed to be equal to or greater than a preset threshold value in the device 100. [

4B, since the precision of the pen 440 is equal to or greater than the threshold value, the device 100 can select any one of the information on the operations that can be performed when the application is executed according to the distance between the device and the hovering input means You can output the user interface.

When the distance between the device 100 and the pen 440 is D1, the device 100 can select an operation to reproduce the moving image. In addition, when the distance between the device 100 and the pen 440 is D2, the device 100 can select an operation to stop the moving image. When the distance between the device 100 and the pen 440 is D3, the device 100 can select an operation to pause the moving image. In addition, when the distances between the device 100 and the pen 440 are D4 and D5, respectively, the device 100 can select an operation of fast forwarding the moving image backward and fast forwarding the moving image.

5 is a diagram for explaining a method in which a device 100 according to an embodiment of the present invention outputs information on an operation displayed on a user interface according to the type of the hovering input means 510 and 520.

The device 100 according to an embodiment of the present invention can classify the operations performed at the time of application execution according to the precision of the hovering input means necessary to perform each of the operations. For example, the device 100 may classify high-precision operations of the hovering input means necessary to perform an operation. And generate a first user interface for outputting information on the classified operations. As another example, the device 100 may classify low-precision operations of the hovering input means necessary to perform an operation. And generate a second user interface for outputting information on the classified operations.

5 (a) shows different user interfaces output according to the type of hovering input means 510, 520 when a call application is executed. When the device 100 receives the hovering input from the finger 510 at the time of execution of the call application, the device 100 may output the user interface 530 in which the missed transmission / reception list is displayed, from the information related to the related operations. In addition, when receiving a hovering input from the pen 520, the device 100 outputs a user interface 540 displaying a list of contacts stored in the device 100, out of information on related operations, can do.

5B shows different user interfaces output depending on the type of the hovering input means 510 and 520 when the mail application is executed. The device 100 may output a user interface 550 displaying a list of unread mails among information regarding related operations when receiving a hovering input from the finger 510 at the time of execution of the mail application. When receiving a hovering input from the pen 520 at the time of execution of the mail application, the device 100 displays a list of all mail received from the device 100 for a predetermined period of time (560).

FIG. 5C shows different user interfaces output according to the type of the hovering input means when the web 510, 520 application is executed. When the device 100 receives the hovering input from the finger 510 at the time of execution of the web application, the device 100 may output the user interface 570 in which the sites visited by the user are displayed, from the information related to the related operations. In addition, when the device 100 receives the hovering input from the pen 520 at the time of executing the web application, the device 100 may output the user interface 580 in which the favorite list is displayed, from the information related to the related operations.

Figure 6 is a flow chart illustrating a method of displaying a user interface in which information about an action is displayed in accordance with an execution unit of an action determined based on the type of hovering input means, in accordance with an embodiment of the present invention.

In step 610, the device 100 obtains information about the type of hovering input means 10 that sends the hovering input to the device 100.

Meanwhile, step 610 may correspond to step 210 described above with reference to FIG.

In step 620, the device 100 determines the unit of performance of the selected operation upon execution of the application, based on the type of the hovering input means 10. [ Here, the execution unit of the operation can be determined according to the amount of information to be changed as the operation is performed. For example, when the device 100 performs an operation of moving the moving image forward, the number of frames changed according to the determined unit of operation may be 10% of the total number of frames, or 1% have.

On the other hand, the accuracy of the hovering input means 10 can be determined according to the type of the hovering input means 10. The device 100 can determine the unit of performance of the operation corresponding to the precision of the hovering input means 10. [ For example, when the relatively low-precision finger is hovering input means, the device 100 can determine the number of frames of the moving image to be changed to be 10% of the total number of frames. According to another example, the device 100 may determine the number of frames of the moving picture to be changed to be 1% of the total number of frames, when the relatively high-precision pen is the hovering input means.

In step 630, the device 100 selects a user interface among the plurality of user interfaces, in which information on the operation is displayed according to the determined performance unit.

For example, if the number of changed frames is determined to be 10% of the total number of frames, the device 100 can select a user interface in which the process bar divided by 10% is displayed. According to another example, when the moving image playback application is executed, the device 100 may select a user interface in which a process bar divided by 1% is displayed when the number of changed frames is determined as 1% of the total number of frames.

Meanwhile, the above-described example is only one example for explaining a method for the device 100 to select a user interface displayed with information on the operation in accordance with the determined execution unit, but the present invention is not limited thereto

In step 640, the device 100 displays the selected user interface. The device 100 may select, on the displayed user interface, an action corresponding to the received hovering input.

Meanwhile, step 640 may correspond to step 230 described above with reference to FIG.

FIG. 7 is a diagram for explaining a user interface in which information on an operation is displayed according to an execution unit of an operation selected based on a type of hovering input means when a moving image playback application is executed according to an embodiment of the present invention;

Referring to Figure 7 (a), the device 100 may obtain information about the type of hovering input means that sends the hovering input to the device 100. The device 100 can confirm that the hovering input means is the finger 710 based on the acquired information on the type of the hovering input means.

The device 100 can determine a unit of performing an operation of fast forwarding a moving image corresponding to the finger 710 in the forward direction. Here, the unit of operation may be determined according to the amount of frames to be changed as the moving image is fast-forwarded.

The device 100 according to an exemplary embodiment can determine a unit of performing an operation of fast forward moving a moving image according to the precision of a finger. The device 100 can determine information on a unit of performing an operation of fast forwarding a moving image when a finger is a hovering input means from a database stored in advance. In FIG. 7A, when the finger is a hovering input means, the device 100 can determine the unit of the number of frames of moving images to be changed to be 10% of the total number of frames.

If the number of frames to be changed is determined to be 10% of the total number of frames, the device 100 can select a user interface displayed with the process bar 720 divided by 10% of the plurality of user interfaces.

The device 100 may display the selected user interface. Further, the device 100 can change the frame reproduced in the frame displayed at the position corresponding to the finger on the user interface. For example, on the user interface, if the position of the finger corresponds to an image marked 50%, the device 100 may change the frame being reproduced to a frame at a position corresponding to 50% of the total frames.

Referring to FIG. 7 (b), the device 100 may obtain information about the type of hovering input means that sends the hovering input to the device 100. The device 100 can confirm that the hovering input means is the pen 730 based on the acquired information about the type of the hovering input means.

The device 100 can determine a unit of performing an operation of fast forwarding a moving picture corresponding to the pen 730 in the forward direction. Here, the unit of operation may be determined according to the amount of frames to be changed as the moving image is fast-forwarded.

The device 100 according to one embodiment can determine a unit of performing an operation of fast forward moving a moving image according to the precision of the pen 730. The device 100 can acquire information on a unit of performing an operation of fast forwarding a moving image in the case where the pen is hovering input means from a previously stored database. 7B, when the pen is a hovering input means, the device 100 can determine the unit of the number of frames of moving images to be changed to be 1% of the total number of frames.

If the number of frames to be changed is determined to be 1% of the total number of frames, the device 100 can select a user interface displayed with the process bar 740 divided by 1% of the plurality of user interfaces.

The device 100 may display the selected user interface. Further, the device 100 can change the frame reproduced in the frame displayed at the position corresponding to the finger on the user interface. For example, on the user interface, if the position of the finger corresponds to an image labeled 4%, the device 100 may change the frame being reproduced to a frame at a position corresponding to 4% of the total frames.

8A and 8B are diagrams for explaining a user interface in which information on an operation is displayed according to an execution unit of an operation selected based on a type of a hovering input means when a photo folder application is executed according to an embodiment of the present invention.

 Referring to FIG. 8A, the device 100 may obtain information about the type of hovering input means that sends the hovering input to the device 100. The device 100 can confirm that the hovering input means is the finger 810 based on the obtained information on the type of the hovering input means.

The device 100 may determine a unit of operation of searching for a picture corresponding to the finger 810. [ Here, the unit of performing an action may be determined according to the number of pictures displayed on the screen by performing an operation of searching for a picture.

The device 100 according to one embodiment may determine the unit of action of searching for a photograph according to the precision of the finger 810. [ The device 100 can determine information about the performance unit of the operation of searching for a picture if the finger is a hovering input means from a previously stored database. The device 100 may determine three types of performance units that can select the number of the outputted photographs when an operation of searching for a photograph is performed according to the precision of the finger 810. [ 8A, the device 100 can select a user interface for outputting n photographs when the distance between the device 100 and the finger 810 is D1. In addition, the device 100 can select a user interface for outputting n / 3 pictures when the distance between the device 100 and the finger 810 is D3. The device 100 can select a user interface for outputting n / 5 pictures when the distance between the device and the finger 810 is D5.

Referring to FIG. 8B, the device 100 may obtain information about the type of hovering input means that sends the hovering input to the device 100. The device 100 can confirm that the hovering input means is the pen 820 based on the acquired information on the type of the hovering input means.

The device 100 can determine the unit of action of searching for a picture corresponding to the pen 820. [ Here, the unit of performing an action may be determined according to the number of pictures displayed on the screen by performing an operation of searching for a picture.

The device 100 according to one embodiment may determine the unit of performance of the operation of searching for photographs according to the precision of the pen 820. [ The device 100 may determine information about the performance unit of the operation of searching for a picture if the pen 820 is a hovering input means from a previously stored database.

The device 100 may determine three types of performance units that can select the number of photos to be output when an operation of searching for a photograph is performed according to the precision of the pen 820. [ 8B, the device 100 can select a user interface for outputting n photographs when the distance between the device 100 and the pen 820 is D1. In addition, the device 100 can select a user interface for outputting n / 2 photographs when the distance between the device 100 and the pen 820 is D2. The device 100 can select a user interface for outputting n / 3 pictures when the distance between the device and the pen 820 is D3. The device 100 can select a user interface for outputting n / 4 photographs when the distance between the device 100 and the pen 820 is D4. The device 100 can select a user interface for outputting n / 5 pictures when the distance between the device and the pen 820 is D5.

9 is a diagram for explaining a method of changing a user interface according to hovering input sensed by a device 900 having a large display according to an embodiment of the present invention.

 9A, a device 900 is a device 900 that, when the hovering input means 910 is located over a portion of a large display of the device 900 for a certain period of time, It is possible to generate the mini-map 920 to display. The device 900 may also determine the size of the minimap 920 generated according to the distance between the location where the hovering input means 910 is located over a certain period of time and the device 900.

9B, the device 900 may change a portion of the UI displayed on the mini-map 920 according to the distance between the hovering input means 910 and the device 900. [ For example, if the hovering input means 910 is located at a distance of D1 from the device 900, the device 900 may transmit a portion of the user interface that has moved 10 cm from the portion of the currently displayed user interface to the upper left side, 920). The device 900 also receives a portion of the user interface that has moved 20 centimeters from the portion of the currently displayed user interface to the top left corner of the mini-map 920 when the hovering input means 910 is located at a distance of D2 from the device 900. [ Can be displayed.

On the other hand, the unit in which the moving distance of the mini-map 920 is changed may be determined according to the type of the hovering input means 910. For example, when the hovering input means 910 is a finger, the device 100 may change the distance the mini-map 920 moves by 10 cm according to the distance difference between the finger and the device 900. On the other hand, according to another example, when the hovering input means 910 is a pen, the device 900 can change the distance by which the mini map 920 moves by 5 cm according to the distance difference between the pen and the device 900.

In addition to the mini-map 920, the device 900 according to an exemplary embodiment of the present invention may determine a moving distance of a mouse pointer or a cursor displayed on a screen according to a hovering input.

10 is a flowchart illustrating a method of displaying a user interface that outputs information on operations corresponding to the type of hovering input means when an application is executed in the device 100 according to an embodiment of the present invention.

At step 1010, the device 100 obtains information about the type of hovering input means 10 that sends the hovering input to the device 100.

On the other hand, step 1010 may correspond to step 210 described above with reference to FIG.

In step 1020, the device 100 may select a user interface from which information about the operation corresponding to the type of hovering input means is output. Here, the operation corresponding to the type of the hovering input means can be determined depending on whether or not the hovering input necessary for performing the operation can be transmitted by the hovering input means.

For example, when the device 100 performs the operation of writing a text as the memo application is executed, the accuracy of the hovering input means must be high in order to accurately record the text. Therefore, the operation of writing text can be matched with a pen with high precision. The device 100 can select a user interface for outputting information on the operation of writing text when the pen is detected as a hovering input when executing a document creation application.

On the other hand, the operation of selecting any one of the previously created documents can be performed even if the precision of the input means is not high. The device 100 can match the operation of selecting any one of the documents with a finger having a low precision. The device 100 can select a user interface to which information about an operation of selecting one of the documents is output when a finger is detected as a hovering input when executing a document creation application.

 At step 1030, the device 100 displays the selected user interface. The device 100 may select, on the displayed user interface, an action corresponding to the received hovering input.

On the other hand, the step 1030 may correspond to the step 230 described above with reference to FIG.

11 is a diagram for explaining a method in which a device 100 selects a user interface according to the type of hovering input means when a document creation application is executed according to an embodiment of the present invention.

Referring to Figure 11 (a), the device 100 may obtain information about the type of hovering input means that sends the hovering input to the device 100. The device 100 can confirm that the hovering input means is the finger 1110 based on the acquired information on the type of the hovering input means.

The device 100 according to an exemplary embodiment of the present invention may select a user interface on which information related to an operation corresponding to the type of hovering input means is output. Here, the operation corresponding to the type of the hovering input means can be determined depending on whether or not the hovering input necessary for performing the operation can be transmitted from the hovering input means.

For example, the operations corresponding to the pen 1110 may include an operation of inputting a formula, an operation of inputting text, an operation of drawing a figure, and the like. The above-described operations are operations requiring high precision, and a hovering input can be transmitted to the device 100 from the pen 1110, which is a high-precision hovering input means.

When a pen 1110 is sensed on the screen of the device 100 according to an embodiment of the present invention, the device 100 displays an icon representing an operation of inputting a formula, an operation of inputting text, The user interface 1120 can be displayed.

Referring to FIG. 11 (b), the device 100 may obtain information about the type of hovering input means that sends the hovering input to the device 100. The device 100 can confirm that the hovering input means is the finger 1130 based on the acquired information on the type of the hovering input means.

The device 100 according to an exemplary embodiment of the present invention may select the user interface 1140 from which information relating to the operation corresponding to the type of the hovering input means is output. For example, the operations corresponding to the finger 1130 may include an operation of selecting one of a plurality of documents, an operation of canceling execution of a text input, and the like. The above-described operations are operations that do not require high precision, and a hovering input can be transmitted to the device 100 from a finger 1130, which is a less precise hovering input means.

When a finger 1130 is detected on the screen of the device 100 according to an exemplary embodiment of the present invention, the device 100 may select one of a plurality of documents, cancel an execution of text input And display a user interface 1140 that outputs an icon representing each of them.

12 is a flowchart illustrating a method for determining an operation performed when an application is executed according to a slope of hovering input means for a device 100 according to an embodiment of the present invention.

In step 1210, the device 100 may obtain location information on one side and on the other side of the hovering input means. For example, the device 100 may acquire positional information of the other side farthest from the device 100 from one side closest to the device 100 at the hovering input means. According to another example, the device 100 may obtain position information of any two sides of the hovering input means.

In step 1220, the device 100 may use the obtained location information to determine the slope of the hovering input means for the device 100. For example, the slope of the hovering input means may be determined according to the angle between the line connecting the one side of the hovering input means and the other side of the hovering input means and the screen on the device 100.

At step 1230, the device 100 may determine an action to be performed upon application execution according to the determined slope. For example, when performing a line drawing operation in a drawing application, the device 100 may determine the thickness of the line according to the slope of the hovering input means. According to another example, when performing a line drawing operation in a drawing application, the device 100 may determine the color of the line according to the slope of the hovering input means. This will be described later in more detail with reference to FIG.

 13 is a diagram for explaining a method for determining an operation performed when an application is executed according to a slope of hovering input means for a device 100 according to an embodiment of the present invention.

Referring to FIG. 13A, the device 100 can obtain positional information of one side and the other side of the hovering input means. The device 100 can acquire positional information of one side 1320 closest to the device 100 at the hovering input means and the other side 1330 farthest from the device 100. [

The device 100 may determine the slope of the hovering input means using an angle 1340 between a line connecting one side of the hovering input means and the other side and a screen on the device 100. [

Referring to FIG. 13 (b), the device 100 may determine an operation to be performed when an application is executed according to a determined slope. In the device 100, when performing a line drawing operation in a drawing application, the device 100 may determine the thickness of the line according to the slope of the hovering input means 1310.

14 and 15 are block diagrams for explaining the configuration of the device 100 according to an embodiment of the present invention.

14, the device 100 according to an exemplary embodiment of the present invention may include a sensing unit 110, a control unit 120, and an output unit 130. As shown in FIG. However, not all illustrated components are required. The device 100 may be implemented by more components than the components shown, and the device 100 may be implemented by fewer components.

For example, as shown in FIG. 15, the device 100 according to an embodiment of the present invention may include a user input unit 140, a communication unit 130, a control unit 120, and an output unit 130 in addition to the sensing unit 110, An audio / video (A / V) input unit 160, and a memory 170.

Hereinafter, the components will be described in order.

The sensing unit 110 obtains information about the type of hovering input means for transmitting a hovering input to the device. Also, the sensing unit 110 may acquire positional information of one side and the other side of the hovering input means.

The sensing unit 110 includes a magnetism sensor 141, an acceleration sensor 142, an on / humidity sensor 143, an infrared sensor 144, a gyroscope sensor 145, (GPS) 146, an air pressure sensor 147, a proximity sensor 148, and an RGB sensor (illuminance sensor) 149. However, the present invention is not limited thereto. The function of each sensor can be intuitively deduced from the name by those skilled in the art, so a detailed description will be omitted.

The control unit 120 typically controls the overall operation of the device 100. For example, the control unit 120 may include a user input unit 140, an output unit 130, a sensing unit 110, a communication unit 150, an A / V input unit 160 ) Can be generally controlled.

The control unit 120 selects any one of a plurality of user interfaces related to the application executed in the device 100 based on the acquired information on the type of the hovering input means 10. [

The control unit 120 can determine the resolution indicating the degree to which the hovering input means can identify the information about the different operations and transmit the hovering input based on the type of the hovering input means 10. [ The control unit 120 may select a user interface for outputting information on at least one operation performed in the application according to the determined precision.

In addition, the controller 120 can select a user interface corresponding to the determined accuracy of the position at which the information on the operations that can be performed when the application is executed, among the plurality of user interfaces.

The control unit 120 can select a user interface in which information on at least one operation is output according to the difference in distance between the screen of the device 100 and the hovering input means 10 when the determined precision is equal to or greater than the threshold value.

According to another example, the control unit 120 may preferentially select a user interface that displays information on the operations corresponding to the type of the hovering input means 10 when the application is executed.

The control unit 120 can determine the unit of performance of the selected operation upon execution of the application based on the type of the hovering input means. The control unit 120 may select a user interface in which information on the operation is displayed according to the determined execution unit among the plurality of user interfaces.

If the hovering inputs that can be received from the hovering input means do not correspond to each of the operations that can be performed when the application is executed, the control unit 120 may classify the information on the plurality of operations into groups and select the output user interface.

According to another example, the controller 120 may determine the slope of the hovering input means 10 with respect to the device 100, using the position information obtained from the sensing unit 110. [ The controller 120 may determine an operation to be performed when the application is executed according to the determined slope.

The output unit 130 is for displaying a user interface selected by the control unit 120. The output unit 130 may include a display unit 131, an acoustic output unit 132, a vibration motor 133, and the like.

The display unit 131 outputs information processed by the device 100. [ For example, the display unit 131 may display a user interface selected by the control unit 120. Also, the display unit 131 may output a result of performing the selected operation according to the hovering input received in the selected user interface.

Meanwhile, when the display unit 131 and the touch pad have a layer structure and are configured as a touch screen, the display unit 131 may be used as an input device in addition to the output device. The display unit 131 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display A 3D display, and an electrophoretic display. In addition, the device 100 may include two or more display units 131 according to the implementation of the device 100. At this time, the two or more display units 121 may be arranged to face each other using a hinge.

The sound output unit 132 outputs audio data received from the communication unit 150 or stored in the memory 170. [ Also, the sound output unit 132 outputs sound signals related to the functions (e.g., call signal reception sound, message reception sound, notification sound) performed in the device 100. [ The sound output unit 132 may include a speaker, a buzzer, and the like.

The vibration motor 133 can output a vibration signal. For example, the vibration motor 133 may output a vibration signal corresponding to an output of audio data or video data (e.g., a call signal reception tone, a message reception tone, etc.). In addition, the vibration motor 133 may output a vibration signal when a touch is input to the touch screen.

The user input unit 140 means means for the user to input data for controlling the device 100. For example, the user input unit 140 may include a key pad, a dome switch, a touch pad (a contact type capacitance type, a pressure type resistive type, an infrared detection type, a surface ultrasonic wave conduction type, A tension measuring method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto.

The communication unit 150 may include one or more components that allow the device 100 and the external device 200 or the device 100 and the server 300 to communicate with each other. For example, the communication unit 150 may include a short-range communication unit 151, a mobile communication unit 152, and a broadcast reception unit 153.

The short-range wireless communication unit 151 includes a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a Near Field Communication unit, a WLAN communication unit, a Zigbee communication unit, IrDA, an infrared data association) communication unit, a WFD (Wi-Fi Direct) communication unit, an UWB (ultra wideband) communication unit, an Ant + communication unit, and the like.

The mobile communication unit 152 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The broadcast receiving unit 153 receives broadcast signals and / or broadcast-related information from outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The device 100 may not include the broadcast receiving unit 153 according to the embodiment.

The communication unit 150 may share the result of performing the operation corresponding to the generated input pattern information with the external device 200. [ At this time, the communication unit 150 may transmit the result of performing the operation corresponding to the input pattern information to the external device 200 through the server 300, or may directly transmit the operation corresponding to the input pattern information to the external device 200 The result of the execution can also be transmitted.

The communication unit 150 may receive a result of performing an operation corresponding to the input pattern information generated by the external device 200. [ At this time, the communication unit 150 may receive the result of performing the operation corresponding to the input pattern information of the external device 200 through the server 300 from the external device 200, And may receive a result of performing an operation corresponding to the input pattern information of the device 200. [

The communication unit 150 can receive a call connection request from the external device 200. [

The A / V (Audio / Video) input unit 160 is for inputting an audio signal or a video signal, and may include a camera 161 and a microphone 162. The camera 161 can obtain an image frame such as a still image or a moving image through the image sensor in a video communication mode or a photographing mode. The image captured through the image sensor can be processed through the control unit 120 or a separate image processing unit (not shown).

The image frame processed by the camera 161 can be stored in the memory 170 or transmitted to the outside through the communication unit 150. [ The camera 161 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 162 receives an external acoustic signal and processes it as electrical voice data. For example, the microphone 162 may receive acoustic signals from an external device or speaker. The microphone 162 may use various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The memory 170 may store a program for processing and controlling the control unit 120 and may store data to be input / output (e.g., a plurality of menus, a plurality of first hierarchical submenus corresponding to each of the plurality of menus, A plurality of second layer submenus corresponding to each of the plurality of first layer submenus, and the like).

The memory 170 may store biometric information of the user regarding at least one content and context information of the user. In addition, the memory 170 may store a reference emotion information database. Memory 170 may store content summary information.

The memory 170 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , An optical disc, and the like. In addition, the device 100 may operate a web storage or a cloud server that performs a storage function of the memory 170 on the Internet.

The programs stored in the memory 170 may be classified into a plurality of modules according to their functions, for example, a UI module 171, a touch screen module 172, a notification module 173, .

The UI module 171 can provide a specialized UI, a GUI, and the like that are interlocked with the device 100 for each application. The touch screen module 172 senses a touch gesture on the user's touch screen and can transmit information on the touch gesture to the control unit 120. [ The touch screen module 172 according to an embodiment of the present invention can recognize and analyze the touch code. The touch screen module 172 may be configured as separate hardware including a controller.

Various sensors may be provided in or near the touch screen to sense the touch or near touch of the touch screen. An example of a sensor for sensing the touch of the touch screen is a tactile sensor. A tactile sensor is a sensor that detects the contact of a specific object with a degree or more that a person feels. The tactile sensor can detect various information such as the roughness of the contact surface, the rigidity of the contact object, and the temperature of the contact point.

In addition, a proximity sensor is an example of a sensor for sensing the touch of the touch screen.

The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. Examples of proximity sensors include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. The user's touch gestures can include tap, touch & hold, double tap, drag, panning, flick, drag and drop, swipe, and the like.

The notification module 173 may generate a signal for notifying the occurrence of an event of the device 100. [ Examples of events that occur in the device 100 include receiving a call signal, receiving a message, inputting a key signal, receiving a schedule notification, and obtaining a user input. The notification module 173 may output a notification signal in the form of a video signal through the display unit 121 or may output a notification signal in the form of an audio signal through the sound output unit 122, It is possible to output a notification signal in the form of a vibration signal.

The method according to an embodiment of the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

The device 100 according to one embodiment of the present invention provides user interaction that can create and share an image card that represents the status of the user.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

100: device
110: sensing unit
130:
150:

Claims (21)

Obtaining information about the type of hovering input means for sending a hovering input to the device; And
Displaying a user interface corresponding to information about a type of the obtained hovering input means among a plurality of user interfaces related to an application executed in the device. 2. The method of claim 1,
Determining, based on the type of the hovering input means, a resolution indicative of the extent to which information about different actions can be identified; And
And displaying a user interface on which information regarding at least one operation performed in the application is output, according to the determined precision. 3. The method of claim 2,
And displaying a user interface corresponding to the determined precision at a location where information about operations that can be performed when the application is executed is output. 3. The method of claim 2,
And displaying a user interface in which information regarding the at least one operation is output according to a distance difference between the screen of the device and the hovering input means when the determined precision is equal to or greater than a threshold value. 2. The method of claim 1,
Determining an execution unit of an operation selected at the execution of the application based on the type of the hovering input means; And
And displaying a user interface in which information regarding the operation is displayed according to the determined performance unit among the plurality of user interfaces. 2. The apparatus of claim 1,
And a user interface for classifying and outputting operations performed at the time of executing the application according to the precision of the hovering input means necessary to perform each of the operations. 2. The method of claim 1,
Preferentially displaying a user interface displaying information about the operations corresponding to the type of the hovering input means when the application is executed. 2. The method of claim 1,
And displaying the user interface, wherein the hovering inputs received from the hovering input means are classified into groups and outputted when the hovering inputs that can be received from the hovering input means do not correspond to each of the operations that can be performed when the application is executed. How to control. 9. The apparatus of claim 8,
And a user interface for classifying and displaying information on the operations in a group according to at least one of the number of times the operation has been performed for a predetermined period and the relation between the operations. The method according to claim 1,
Acquiring positional information of a side of the hovering input means and another side of the hovering input means;
Determining a slope of the hovering input means for the device using the obtained position information; And
And determining an action to be performed upon execution of the application according to the determined slope. A sensing unit for acquiring information about a type of hovering input means for transmitting a hovering input to the device;
A control unit for controlling the output of a user interface corresponding to the type of the obtained hovering input means among a plurality of user interfaces related to an application executed in the device; And
And a display unit for displaying the corresponding user interface. 12. The apparatus according to claim 11,
Determining a resolution indicating an extent to which information on different operations can be identified based on the type of the hovering input means, and determining, based on the determined accuracy, information about at least one operation performed in the application Lt; RTI ID = 0.0 > a < / RTI > 13. The apparatus according to claim 12,
Wherein a position at which information on operations that can be performed when the application is executed is output corresponds to the determined precision. 13. The apparatus according to claim 12,
And when the determined precision is equal to or greater than a threshold value, information on the at least one operation is output in accordance with a distance difference between the screen of the device and the hovering input means. 12. The apparatus according to claim 11,
A unit for performing a selected operation upon execution of the application based on the type of the hovering input means, and selecting a user interface on which information on the operation is displayed according to the determined execution unit among the plurality of user interfaces. 12. The method of claim 11,
And a user interface for classifying and outputting operations performed at the time of executing the application according to the precision of the hovering input means necessary to perform each of the operations. 12. The apparatus according to claim 11,
Wherein when the application is executed, the user interface preferentially selects a user interface displaying information on operations corresponding to the type of the hovering input means. 12. The apparatus according to claim 11,
Wherein the device classifies the information related to the plurality of operations into groups and outputs the output when hovering inputs receivable from the hovering input unit do not correspond to each of the operations that can be performed when the application is executed. 19. The apparatus of claim 18,
And a user interface for classifying and displaying information on the operations in a group according to at least one of the number of times the operation has been performed for a predetermined period and the relation between the operations. The apparatus of claim 11, wherein the sensing unit comprises:
Acquiring positional information of one side and the other side of the hovering input means,
Wherein,
Using the acquired location information to determine a slope of the hovering input means for the device and to determine an action to be performed upon execution of the application according to the determined slope. A computer-readable recording medium having recorded thereon a program for causing a computer to execute the method according to any one of claims 1 to 10.

Images