KR101971067B1 - Method and apparatus for providing of user interface in portable device - Google Patents

Abstract

The present invention provides a method and apparatus for providing a user interface of a mobile terminal that outputs an affordance image to guide a touch screen to perform a specific function at a location where the touch input device is detected. The method of claim 1, further comprising: checking whether a touch input device is detected on the touch screen; Determining a type of the detected touch input device when the touch input device detects an approach; And if the touch input device is a stylus, outputting a first affordance image corresponding to at least one function that may be performed using the stylus to an area where the approach of the stylus is detected. .

Description

METHOD AND APPARATUS FOR PROVIDING OF USER INTERFACE IN PORTABLE DEVICE}

The present invention relates to a method and an apparatus for providing a user interface of a mobile terminal, and more particularly, to a method and apparatus for providing a user interface of a mobile terminal that provides a user interface for the touch input device when a touch input device is detected on a touch screen. It is about.

Recently, thanks to the remarkable development of information and communication technology and semiconductor technology, the spread and use of portable terminals is increasing rapidly. In particular, recent portable terminals have reached the stage of mobile convergence that encompasses the range of other terminals instead of staying in their own traditional areas. In the case of a mobile communication terminal, in addition to general communication functions such as voice call and message transmission and reception, a TV viewing function (for example, a mobile broadcast such as Digital Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)) and a music playback function (for example, It provides various functions such as MP3 (MPEG Audio Layer-3), picture taking function, data communication function, internet access function and short range wireless communication function. As a result, portable terminals having a touch screen have been increasing in recent years, and the touch screen can detect a touch of a touch input device such as a finger or a stylus and calculate a touched position. For example, a capacitive touch screen is used to determine the touched point when a touch occurs. When the total amount changes, and when the change exceeds a preset threshold, it is determined that the touch event has occurred, and the position where the touch event occurs can be calculated through an algorithm for calculating the position where the capacitance changes.

Meanwhile, in the conventional portable terminal, the same user interface is provided without distinguishing a finger or a stylus which is a touch input method of a touch screen. Accordingly, there is a problem in that a function of a user interface provided on the touch screen or an image of the corresponding function is unnecessarily complicated. For example, when a touch input is performed with a finger, unnecessary functions specialized for a stylus having a small touch area may be displayed.

In addition, the conventional portable terminal is inconvenient to perform a plurality of touch operations such as a touch for displaying a function screen of a user interface and a touch for executing a desired function on a function screen in order to execute a desired function.

Accordingly, the present invention has been made to solve the above-mentioned problems of the prior art, and an object of the present invention is to provide a method and apparatus for providing a user interface of a mobile terminal for outputting an affordance image when detecting an approach of a touch input device. There is.

Another object of the present invention is to provide a method and apparatus for providing a user interface of a mobile terminal for outputting different affordance images according to the type of touch input device accessed.

According to an aspect of the present invention, there is provided a method for providing a user interface of a mobile terminal, the method including: checking whether a touch input device is detected on a touch screen; Determining a type of the detected touch input device when the touch input device detects an approach; And if the touch input device is a stylus, outputting a first affordance image corresponding to at least one function that may be performed using the stylus to an area where the approach of the stylus is detected. .

According to an aspect of the present invention, there is provided a user interface providing apparatus for a mobile terminal, including: a touch panel configured to recognize an approach and a touch of a touch input device; When the touch input device detects an approach, the type of the detected touch input device is determined, and if the touch input device is a stylus, when the touch input device is a stylus, at least one side of the region where the access of the stylus is detected may be performed using the stylus. A controller which controls to output a first affordance image corresponding to one function; And a display panel configured to output the first affordance image.

According to another aspect of the present invention, there is provided a method of providing a user interface of a mobile terminal, the method including: providing a user interface of a mobile terminal including a touch screen, the method comprising: detecting an approach of a stylus; And outputting an affordance image corresponding to at least one function that can be performed by using the stylus in a region where the approach of the stylus is detected when the approach of the stylus is detected.

In accordance with another aspect of the present invention, an apparatus for providing a user interface of a mobile terminal includes: a touch screen sensing the approach of a stylus; And a controller configured to control the touch screen to output an affordance image corresponding to at least one function that can be performed using the stylus in a region where the stylus is detected when the approach of the stylus is detected.

As described above, the method and apparatus for providing a user interface of a mobile terminal according to an embodiment of the present invention output an affordance image when a touch input device is detected on a touch screen, and one of the icons included in the affordance image. Touch to perform the desired function. Thus, the present invention can quickly perform a desired function without going through a number of steps. In addition, the present invention may output the affordance image corresponding to the type of the touch input device. For this reason, the present invention can improve the user's convenience by providing an appropriate affordance image according to the situation.

1 is a diagram schematically illustrating a configuration and a stylus of a portable terminal according to an exemplary embodiment of the present invention.
FIG. 2 is a diagram for describing a method of detecting an approach of a touch input device according to an exemplary embodiment.
3 is a flowchart illustrating a user interface providing method of a portable terminal according to an exemplary embodiment of the present invention.
4 is an exemplary view illustrating an interface for providing an affordance image when a stylus approaches a schedule management screen according to an embodiment of the present invention.
FIG. 5 illustrates an example of an interface for providing an affordance image when a stylus approaches a home screen according to an exemplary embodiment of the present invention.
6 is an exemplary screen diagram illustrating an example of an interface for providing an affordance image when a stylus is accessed from an address book screen according to an exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this case, it should be noted that like elements are denoted by like reference numerals as much as possible. In addition, detailed descriptions of well-known functions and configurations that may blur the gist of the present invention will be omitted.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to easily explain the technical contents of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

Prior to the detailed description, a portable terminal according to an embodiment of the present invention is an electronic device having a touch screen, and includes a mobile communication terminal, a personal digital assistant (PDA), a smart phone, and a tablet PC ( Personal Computer), PMP (Portable Multimedia Player) and the like.

1 is a diagram schematically illustrating a configuration of a mobile terminal 100 and a stylus 200 according to an exemplary embodiment of the present invention, and FIG. 2 is a method of detecting proximity of a touch input device according to an exemplary embodiment of the present invention. It is a figure for demonstrating.

1 and 2, the mobile terminal 100 according to an embodiment of the present invention may include a configuration of a wireless communication unit 140, a touch screen 130, a storage unit 120, and a controller 110. Can be. The touch screen 130 may include a display panel 131 and a touch panel 132.

The stylus 200 is a pen-type touch input device that can be used in an electromagnetic induction touch panel. To this end, the stylus 200 may include a resonant circuit. The resonant circuit is resonated by an electromagnetic field generated by the touch screen 130, and may generate an induced current due to the resonance. Induced current generated by the resonance may cause a current change in the touch screen 130. That is, the touch screen 130 may recognize the approach and the touch of the stylus 200 through the change of the current caused by the induced current. Such stylus 200 is apparent to those skilled in the art of the present invention, it will be known and will not be described in detail.

The wireless communication unit 140 may form a communication channel for a call (including a voice call and a video call) and a data communication channel for data transmission with the base station. To this end, the wireless communication unit 140 includes a radio frequency transmitter (not shown) for up-converting and amplifying a transmitted signal, a radio frequency receiver (not shown) for low noise amplifying and down-converting a received signal, and a received signal. It may include a transmission and reception separation unit (not shown) for separating the transmission signal.

The touch screen 130 may perform an input function and an output function. To this end, the touch screen 130 may include a display panel 131 that performs an output function and a touch panel 132 that performs an input function. The touch panel 132 may be formed as a composite touch panel in which an electromagnetic induction method and a capacitive method are combined. Alternatively, the touch panel 132 may be formed as a composite touch panel in which an electromagnetic induction method and a pressure reduction method are combined.

The touch panel 132 is mounted on the front surface of the display panel 131, generates a touch event according to a touch of a touch input device such as a user's finger or stylus 200, and controls the generated touch event to be controlled by the controller 110. Can be delivered to. The touch panel 132 recognizes a touch through a change in physical quantity (eg, capacitance, current, etc.) according to the touch of the touch input device, and types of touch (tap, drag, flick, double touch, long touch, multi-touch). And the like) and the touched location information may be transmitted to the controller 110. Since the touch panel 132 is obvious to those skilled in the art, a detailed description thereof will be omitted. In particular, the touch panel 132 according to the present invention may detect an approach, a touch, an access release, and a touch release of the touch input device. In contrast, referring to FIG. 2, the capacitance C or the current I of the touch panel 132 is shown in FIG. 2 when the touch input device is gradually approached and the contact is released after the contact is made. The graph changes as shown. Here, if the change in the capacitance (C) or current (I) is greater than or equal to the first reference value (A), the touch panel 132 recognizes the approach (for example, 1 ~ 2 cm) of the touch input device, and the electrostatic When the change in the capacitance C or the current I is greater than or equal to the second reference value B, the touch input device may be recognized as being in contact with the touch panel 132.

On the other hand, a change in capacitance (C) and a change in current (I) have been described using the same graph of FIG. 2, but this is for convenience of explanation, and in fact, the change graph of capacitance (C) and current (I) It will be apparent to those of ordinary skill in the art that the graph of change of the present invention has a similar form but is not completely the same as that of FIG. In this case, when the touch panel 132 is a composite touch panel formed of a capacitive touch panel and an electromagnetic induction touch panel, the capacitive touch panel may be touched, touched (touched), or touched (touched) by a finger. Detecting the release, the electromagnetic induction type touch panel may detect the approach, contact (touch) and contact (touch) release of the stylus 200.

On the other hand, when it is desired to output the affordance image only when the stylus 200 approaches detection, the touch panel 132 may be a composite touch panel in which an electromagnetic induction type touch panel and a pressure sensitive type touch panel are combined. The display panel 131 displays various menus of the mobile terminal 100, information input by the user, or information provided to the user. That is, the display panel 131 may provide various screens according to the use of the mobile terminal 100, for example, a standby screen (home screen), a menu screen, a message writing screen, a call screen, a schedule management screen, and an address book screen. Can be. In particular, the display panel 131 of the present invention can output an affordance image when the touch input device detects an approach under the control of the controller 110. The description thereof will be described later with reference to the screen example. The display panel 131 may be formed of a liquid crystal display (LCD), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AMOLED), or the like.

The storage unit 120 may include an operating system (OS) of the mobile terminal 100, an application program required for other option functions such as a sound play function, an image or video play function, a broadcast play function, and the like. User data and data transmitted / received during communication may be stored. For example, the storage unit 120 may store a key map or a menu map for operating the touch screen 130. Here, the key map and the menu map may be configured in various forms. For example, the key map may be a keyboard map, a 3 * 4 key map, a QWERTY key map, or the like, or may be a control key map for operation control of an currently activated application program. In addition, the menu map may be a menu map for controlling an application program currently being activated. In addition, the storage unit 120 may store text messages, game files, music files, movie files, contacts, and the like. In particular, the storage unit 120 according to the present invention may store a program for outputting the affordance image when the touch input device approaches. The affordance image may vary depending on the type of an item accessed by the touch input device and the type of the touch input device. For example, when the stylus 200 approaches a specific schedule of a schedule management screen, the affordance image becomes a due date change image in which a deadline change function of a schedule is set, and when the stylus 200 approaches a specific icon on a home screen. The affordance image may be a moving affordance image in which an icon moving function is set. Alternatively, when the stylus 200 approaches a specific contact on the address book screen, the affordance image may be a function affordance image including a frequently used function, that is, a call icon, a text icon, an email icon, and an instant message icon. . Meanwhile, when a finger approaches a specific schedule of the schedule management screen, the affordance image becomes a delete affordance image with a schedule delete function set, and when the finger approaches a specific icon on a home screen, the affordance image sets an icon copy function. It may be a copy affordance image, and when the finger approaches a specific contact on the address book screen, the affordance image may not be output. However, this is merely an example and does not limit the present invention. That is, the function set in the affordance image output when the touch input device approaches may be variously changed according to a designer's intention, and the affordance image may be output only when the approach of the stylus 200 is detected.

On the other hand, the storage unit 120 may set the ON / OFF of the affordance display mode for displaying the affordance image, and may store a program for changing a function set in the affordance image. That is, the program may output the affordance image when the touch input device approaches only when the user activates the affordance image display mode. In addition, the program may change the function set in the affordance image to a function requested by the user.

The controller 110 may control an overall operation of the mobile terminal 100 and a signal flow between internal blocks of the mobile terminal 100 and perform a data processing function for processing data. In particular, the control unit 110 according to the present invention outputs a predetermined affordance image when the touch input device detects an access, and when the touch event occurs on the affordance image, the controller 110 performs the respective functions to perform the function set in the affordance image. Can be controlled. In this case, the controller 110 may output different affordance images according to the type (eg, finger or stylus 200) of the touch input device approaching the touch screen 130. The detailed description of the control unit 110 will be described with reference to FIGS. 2 to 6.

Although not shown in FIG. 1, the portable terminal 100 may include a short range communication module for short range wireless communication, a broadcast receiving module for broadcast reception, a digital sound source reproducing module such as an MP3 module, and an internet communication module for performing Internet functions. Optionally, further include components having additional functions such as. These components may not be enumerated because all of them vary according to the convergence trend of digital devices. However, the mobile terminal 100 according to the present invention may further include components of the same level as those mentioned above. It may include.

3 is a flowchart illustrating a user interface providing method of a portable terminal according to an exemplary embodiment of the present invention. Hereinafter, a composite touch panel in which a capacitive type touch panel and an electromagnetic induction type touch panel are combined will be described as an example.

1 to 3, the control unit 110 of the portable terminal 100 according to an embodiment of the present invention controls to supply power supplied from the power supply unit to each component of the portable terminal 100 in step 301. Can be. In operation 303, the controller 110 may determine whether an approach of the touch input device (eg, the stylus 200 or a finger) is detected. In detail, when the touch input device approaches the touch screen 130, a change in capacitance or current occurs. The touch panel 132 detects a change in capacitance or current and transfers it to the controller 110. When the received capacitance or current change is greater than or equal to the first reference value, the controller 110 may determine that the touch input device approaches a predetermined region of the touch screen 130. In this case, the controller 110 may calculate a position where the approach of the touch input device is detected.

If the proximity of the touch input device is not detected, the controller 110 may maintain step 303. On the other hand, when the approach of the touch input device is detected, the controller 110 may determine the type of the touch input device from which the approach is detected in step 305. For example, the controller 110 may determine whether the detected touch input device is the stylus 200 or the finger. The determination of the type of the touch input device may use various known techniques. To this end, the controller 110 determines that a finger has approached when approaching is detected in the capacitive touch panel, and that the stylus 200 has approached when approaching is detected in the electromagnetic induction touch panel. can do. However, the present invention is not limited thereto. That is, the present invention may use various techniques known as techniques for determining the type of the touch input device.

As a result of the determination, in the case of the stylus 200, that is, when the approach of the stylus is detected through the electromagnetic induction type touch panel, the controller 110 may output the first affordance image at a position where the approach is detected in step 307. have. The first affordance image may include at least one icon that induces the performance of a function specific to the stylus 200 (that is, a function requiring a sophisticated touch). Detailed description thereof will be described later with reference to FIGS. 4 to 6.

On the other hand, when the determination result is not the stylus 200, that is, when a finger approach is detected through the capacitive touch panel, the control unit 110 separates the second affordance image from the first affordance image in step 309. You can output The second affordance image may include a function that does not require elaborate touch, such as the stylus 200.

Next, the controller 110 may check whether a touch input signal is generated in step 311. To this end, the controller 110 may determine whether a change in capacitance or current occurs above the preset second reference value in order to determine that the touch has occurred. In this case, in step 307, step 311 is a step of checking whether a touch event occurs in the first affordance image display area or another area, and in step 309, step 311 is a second affordance image display area. Or checking whether a touch event occurs in another area.

If the touch input signal does not occur, the controller 110 may determine whether a signal corresponding to the access release of the touch input device is input in step 315. When the signal corresponding to the access release of the touch input device is input, the controller 110 may remove the first affordance image or the second affordance image in step 317, and return to step 303 to repeat the above-described process. .

On the other hand, when the touch input signal is generated, the controller 110 may control to perform a function corresponding to the touch signal input in step 313. For example, when the touch event occurs in the first affordance image, the controller 110 performs a function set in the first affordance image. When the touch event occurs in the second affordance image, the controller 110 performs a function on the second affordance image. When the touch event occurs in the other area (for example, an item), the user may perform the function set in the other area. When the execution of the function corresponding to the input touch signal is completed, the controller 110 may return to step 303 to repeatedly perform the above-described process.

In the meantime, when the touch input device is approached and the first affordance image or the second affordance image is output, the touch of the touch screen 130 is not detected and the movement of the touch input device is sensed. ) May control the first affordance image or the second affordance image to be moved according to the movement of the touch input device. Alternatively, when the touch input device is moved, the affordance image may be changed according to an attribute of an item existing at a position where the approach of the touch input device is detected. For example, when the touch input device detects an access on a music file item, an affordance image including a function related to music playback (play, pause, add to a play file list, etc.) is output, and the touch input device is output. Is moved onto a shortcut item for an individual user's contact, it is possible to output an affordance image including a function related to the contact (call, text, email, etc.).

In addition, in FIG. 3, when the touch input device approaching the touch screen 130 is not the stylus 200, that is, when a finger approaching is detected through the capacitive touch panel, the controller 110 has a second affordance. Although described as controlling to output an image, in another embodiment of the present invention, the touch input device (for example, a finger) other than the stylus may be processed to be ignored. For example, the controller 110 may control not to output any image when the touch input device other than the stylus 200 approaches. That is, the controller 110 according to another embodiment of the present invention may control the preset affordance image to be output only when the approach of the stylus 200 is detected. When the affordance image is output only when the approach of the stylus 200 is detected as described above, the touch panel 132 may sense a touch of an electromagnetic induction type touch panel and a finger for sensing the approach of the stylus 200. The touch panel of various methods (eg, capacitive type, pressure sensitive type) may be formed as a combined touch panel.

The present invention may further include checking whether the affordance image display mode is activated after step 301 or after step 303. If the affordance image display mode is activated, the controller 110 performs the following process. If the affordance image display mode is not activated, the controller 110 detects only a touch event occurring in the touch screen 130 and detects the detected touch event. A function according to a touch event can be performed.

4 is an exemplary view illustrating an interface for providing an affordance image when a stylus approaches a schedule management screen according to an embodiment of the present invention.

1 to 4, the display panel 131 according to an exemplary embodiment may support displaying a schedule management screen. The schedule management screen may display a plurality of schedules pre-registered by the user by date and time as shown in the screen example of the identification code 410.

When the approach of the stylus 200 is detected at the location where the meal schedule 1 is displayed on the schedule management screen, the controller 110 sets the time limit of the meal schedule 1 as shown in the screen example of the identification code 420. The display panel 131 may be controlled to output an adjustable term-changing affordance image 41. The period-changing affordance image 41 is not limited to being displayed in the form of "-". That is, the period-changing affordance image 41 may be expressed in various forms according to the intention of the designer.

When the deadline of the meal schedule 1 is to be changed while the due date change affordance image 41 is output, the user may change the due date change affordance image 41 as shown in the screen example of the reference numeral 430. By touching with the stylus 200 and then moving the touch (for example, dragging), the end time of the meal schedule 1 may be changed. On the other hand, if a touch is detected in a region other than the due date change image 41 of the display area of the meal schedule 1, the controller 110 may control to perform a corresponding function (eg, view details). have.

On the other hand, in the above description, when the period-changing affordance image 41 is touched, the controller 110 controls to perform the function of changing the term, and the period-changing affordance image 41 of the display area of the meal schedule 1 is not output. When the area is touched, the control is performed to perform a function (detailed detail output) corresponding to the selection of the meal schedule 1. However, the present invention is not limited thereto. For example, in another example of the present invention, the display area of the meal schedule 1 is set as a first virtual area from a border of the display area of the meal schedule 1 to a first distance, and the display area of the meal schedule 1 is selected. The second virtual area may be included in the second virtual area except for the first virtual area. When it is determined that the stylus 200 approaches the first virtual region, the controller 110 may control to display the due date change affordance image 41 indicating that the due date can be changed. When it is determined that the stylus 200 approaches the second virtual region, the controller 110 may control to display a selection affordance image indicating that the selection of the meal schedule 1 is possible or to omit displaying the affordance image. have.

The present invention described above can easily change the duration of the meal schedule by displaying the modified affordance image 41 on one side of the display area of the meal schedule 1 when the stylus 200 approaches detection. In the past, however, the schedule had to be changed in a number of steps. For example, in the related art, a long touch of the schedule was required to activate a time limit change mode to change the due date of the schedule. Alternatively, in the related art, a detailed history was output by touching the schedule, and the deadline of the schedule was changed on the details screen. That is, the present invention can change the time limit of the schedule faster, easier, and more convenient than in the related art, thereby improving user convenience.

Meanwhile, in FIG. 4, only the period-changing affordance image for changing the end time of the schedule is displayed, but the present invention is not limited thereto. That is, for example, the controller 110 may further output a due date change affordance image that can change the start time, start date, and end date of the schedule when the stylus 200 approaches detection.

In addition, although not illustrated in FIG. 4, when an approach of a touch input device (for example, a finger) other than the stylus 200 is detected, the controller 110 may ignore the approach detection. That is, the controller 110 may control not to output any image when the touch input device (for example, a finger) approaches the stylus 200. This is because it is difficult to touch the affordance image having a relatively small size displayed on one side of the predetermined display area using a finger. In this case, the user may touch the schedule to check the details, or activate the schedule due date change mode by long touching the schedule.

As another example of the present invention, when an approach of a touch input device (for example, a finger) other than the stylus 200 is detected, the controller 110 may display an affordance image (eg, a time limit change image) displayed when the approach of the stylus 200 is detected. You can output different affordance images that are distinct from). For example, the controller 110 may output an affordance image corresponding to the selection of the schedule. FIG. 5 illustrates an example of an interface for providing an affordance image when a stylus approaches a home screen according to an embodiment of the present invention. An example of the screen shown.

Referring to FIG. 5, the controller 110 according to an exemplary embodiment of the present disclosure may control the display panel 131 to display a home screen. The home screen may be arranged by displaying a plurality of icons in a multi-column manner as shown in the screen example of the identification code 510.

"와 같은 형태를 가지며 음악 재생 아이콘(2)의 우측 하단에 표시되는 것으로 도시하였지만, 본 발명이 이에 한정되지는 않는다. 즉, 상기 이동 어포던스 이미지(51)의 형태 및 표시 위치는 다양하게 설정될 수 있다.When the approach of the stylus 200 is detected on the home screen, the controller 110 displays an icon on one side of the music play icon 2 to which the stylus 200 is accessed as shown in the screen example of the identification code 520. The movement function may be controlled to output the set movement affordance image 51. In FIG. 5, the moving affordance image 51 is "

Although the present invention is illustrated as being displayed on the lower right side of the music play icon 2, the present invention is not limited thereto. That is, the shape and the display position of the moving affordance image 51 may be variously set. Can be.

In the state where the moving affordance image 51 is output to one side of the music play icon 2, the user moves the moving affordance image 51 to the stylus 200 as shown in the screen example of the reference numeral 530. By touching and moving the touch (for example, dragging), the position of the music play icon 2 can be changed. Meanwhile, when a touch is detected in the display area of the music play icon 2, the controller 110 may control to perform a music play function set in the music play icon 2.

As described above, the present invention can easily perform icon movement without going through a plurality of steps as in the prior art. In detail, in the related art, a long touch of the music play icon 2 was activated to activate the icon moving function, and then the icon must be moved by dragging. However, the present invention can perform the icon moving function quickly, easily and conveniently by touching and dragging the moving affordance image displayed on one side of the icon when the stylus 200 approaches the detection.

Meanwhile, as described above with reference to FIG. 4, the music reproduction icon 2 is divided into a first virtual area and a second virtual area, and when the approach of the stylus 200 is detected in the first virtual area, the controller ( The controller 110 outputs a moving affordance image, and when the approach of the stylus 200 is detected in the second virtual area, the control unit 110 outputs a selection affordance image corresponding to the selection or controls to not output any image. In FIG. 5, the location of the icon displayed on the home screen is changed, but the present invention is not limited thereto. For example, the controller 110 may display a size change affordance image that changes the size of the icon when the stylus 200 approaches the detection. The resize affordance image may be applied to a widget that can be resized such as a weather widget or a schedule widget on a home screen.

In addition, although not illustrated in FIG. 5, when an approach of a touch input device (for example, a finger) other than the stylus 200 is detected, the controller 110 may ignore the approach detection. That is, the controller 110 may control not to output any image when the touch input device (for example, a finger) approaches the stylus 200. This is because it is difficult to touch the affordance image having a relatively small size displayed on one side of the display area of the icon using a finger. In this case, the user may long touch the icon to perform an icon moving function.

As another example of the present invention, when approaching a touch input device (for example, a finger) other than the stylus 200 is detected, the control unit 110 displays an affordance image (for example, a moving affordance image) displayed when the stylus 200 approaches the touch. You can output another affordance image that is distinct from. For example, the controller 110 may output an affordance image corresponding to the selection of the music play icon.

6 is an exemplary screen diagram illustrating an example of an interface for providing an affordance image when a stylus is accessed from an address book screen according to an exemplary embodiment of the present invention.

Referring to FIG. 6, the controller 110 according to an exemplary embodiment of the present disclosure may control the display panel 131 to display an address book screen. As illustrated in the screen example of the identification code 610, the address book screen may display a contact registered in the portable terminal 100 in a list form.

When the stylus 200 approaches the first contact field 3 on the address book screen, the control unit 110 displays one side of the first contact field 3 as shown in the screen example of the identification code 620. The function affordance image 61 may be controlled to be output. The function affordance image 61 is an icon representing a function that can be performed using information (telephone number, email address, instant message ID, etc.) registered in the corresponding contact, for example, a call icon, a text icon, an email icon, an instant message icon. It may include.

In the state in which the function affordance image 61 is output, the user may touch one of the icons included in the function affordance image 61 with the stylus 200 to perform a corresponding function. For example, when a user touches a call icon, the controller 110 may request a call using a phone number of the corresponding contact. On the other hand, when touching a region in which the function affordance image 61 is not displayed among the display regions of the first contact field 3, the controller 110 may output a detailed information screen of the first contact. When the user moves the stylus 200 to another contact field without touching an icon included in the function affordance image 61, the controller 110 may move the function affordance image 61 to another contact field. have. For example, when the user moves the stylus 200 to the second contact field 4, as illustrated in the screen example of the identification code 630, the controller 110 may move the function affordance image 61 to the second. The contact field 4 may be controlled to be displayed on one side.

The present invention as described above can easily perform a specific function without going through a number of steps as in the prior art. In detail, conventionally, the contact field has to be touched or long touched to output a function list in the form of a popup window, and then a desired function (text, call, email, etc.) has to be selected. However, the present invention can perform a desired function quickly, easily and conveniently by touching any one of the icons included in the function affordance image displayed on one side of the contact field when the stylus 200 approaches detection. .

In addition, although not illustrated in FIG. 6, when an approach of a touch input device (for example, a finger) other than the stylus 200 is detected, the controller 110 may ignore the approach detection. That is, the controller 110 may control not to output any image when the touch input device (for example, a finger) approaches the stylus 200. This is because it is difficult to touch the affordance image having a relatively small size displayed on one side of the display area of the icon using a finger. For example, when a user attempts to touch a text message icon by using a finger, a problem of first touching the call icon may occur due to a finger having a relatively large size.

The method for providing a user interface of a mobile terminal according to the embodiment of the present invention as described above may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable recording medium. In this case, the computer-readable recording medium may include program instructions, data files, data structures, and the like, alone or in combination. On the other hand, the program instructions recorded on the recording medium may be those specially designed and constructed for the present invention, or may be known and available to those skilled in computer software. The computer-readable recording media may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs, DVDs, and magnetic disks such as floppy disks. -Magneto-Optical Media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. In addition, program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention.

When the approach of the stylus 200 is detected as described above, the present invention outputs an affordance image including a controllable function through a stylus having a small touch area, that is, a function requiring precise touch, and not the stylus 200. In other words, when the approach of a finger is sensed, the display panel 131 may be controlled to output an affordance image including a function that does not require a precise touch. Therefore, according to the present invention, only the appropriate affordance image is output according to the situation, and unnecessary images are not output to the screen, thereby improving user convenience. In addition, the present invention outputs the affordance image when the touch approach is detected, not when the touch is detected, so that the user may execute a function more quickly.

In the above description, preferred embodiments have been described through the specification and the drawings with respect to a method and a device for providing a user interface of a mobile terminal according to an embodiment of the present invention. Although specific terms are used, this merely describes the technical contents of the present invention. And only to be used in a general sense to help understand the invention, the present invention is not limited to the above-described embodiment. That is, various embodiments based on the technical idea of the present invention are possible to those skilled in the art.

100: mobile terminal 110: control unit
120: storage unit 130: display unit
140: wireless communication unit 200: stylus

Claims (25)

In the method of providing a user interface of a mobile terminal including a touch screen,
Checking whether a touch input device is detected on the touch screen;
Determining a type of the detected touch input device when the touch input device detects an approach; And
If the touch input device is a stylus as a result of the determination, outputting a first affordance image corresponding to at least one function that may be performed using the stylus to a region where the approach of the stylus is detected;
And the first affordance image comprises at least one function icon set with a specific function. The method of claim 1,
The process of checking whether the touch input device is detected on the touch screen is
And determining whether the touch input device approaches one of the items displayed on the touch screen. The method of claim 1,
The process of determining the type of the detected touch input device
Determining that the stylus is approaching when the touch input device is detected through an electromagnetic induction touch panel; And
And determining by a finger when the touch input device approaches the touch input device through the capacitive touch panel. The method of claim 1,
If a touch event is detected on the first affordance image, performing one of the at least one function in response to the touch event. The method of claim 3,
As a result of the determination, if the touch input device is a finger, the touch input device is distinguished from at least one function that can be performed using the stylus in an area where the approach of the finger is detected, and corresponds to at least one other function that can be performed using the finger. Outputting a second affordance image; And
If the touch input device is a finger as a result of the determination, the method of providing a user interface of the mobile terminal further comprising the step of ignoring the access of the finger. The method of claim 5,
And if a touch event is detected on the second affordance image, performing one of the at least one other function in response to the touch event. The method of claim 5,
The second affordance image is
And at least one function icon set with a specific function. The method of claim 7, wherein
The function icon included in the first affordance image and the second affordance image is
The user interface providing method of the mobile terminal, characterized in that it is changed according to the type of the item located in the area where the touch input device is approached. The method of claim 5,
And moving the first affordance image or the second affordance image according to the movement of the touch input device when the movement of the touch input device is detected in the state of approaching the touch screen. Method of providing a user interface of a terminal. The method of claim 1,
Checking whether an affordance image display mode for displaying an affordance image in an area where an approach of the touch input device is detected is activated; And
And determining a type of the touch input device when the affordance image display mode is activated. A touch panel to recognize an approach and a touch of the touch input device;
When the touch input device detects an approach, the type of the detected touch input device is determined, and if the touch input device is a stylus, when the touch input device is a stylus, at least one side of the region where the access of the stylus is detected may be performed using the stylus A controller which controls to output a first affordance image corresponding to one function; And
A display panel configured to output the first affordance image;
And the first affordance image includes at least one function icon set with a specific function. The method of claim 11,
The control unit
And determining whether the touch input device approaches one of the items displayed on the touch panel. The method of claim 11,
The control unit
And when a touch event is detected on the first affordance image, executing one of the at least one functions in response to the detected touch event. The method of claim 11,
The control unit
If the touch input device is not a stylus as a result of the determination, a second affordance image corresponding to at least one other function distinguished from at least one function that can be performed using the stylus is output at a position where the touch input device is approached. Apparatus for providing a user interface of a mobile terminal, characterized in that. The method of claim 14,
The control unit
And when a touch event is detected on the second affordance image, performing one of the at least one other function in response to the detected touch event. The method of claim 14,
The second affordance image is
And at least one function icon set with a specific function. The method of claim 16,
The control unit
And a function icon included in the first affordance image or the second affordance image according to a type of an item located in an area where the touch input device is accessed. The method of claim 14,
The control unit
When the movement of the touch input device is detected in a state in which the touch panel is approached, the user interface of the mobile terminal may be moved according to the movement of the touch input device. Device. The method of claim 11,
The control unit
And determining that the touch input device is not accessible when the touch input device is not a stylus. The method of claim 11,
The control unit
Checking whether an affordance image display mode for displaying an affordance image in an area where the touch input device is detected is activated, and determining the type of the detected touch input device when the affordance image display mode is activated; Apparatus for providing a user interface of a mobile terminal, characterized in that. The method of claim 11,
The touch panel
Device for providing a user interface of a portable terminal, characterized in that the combined touch panel of the capacitive touch panel and the electromagnetic induction touch panel combined. The method of claim 21,
The control unit
If the touch input device is detected through the electromagnetic induction type touch panel, the stylus determines that the approach is made, and if the touch input device is detected through the capacitive type touch panel, the finger approaches. Apparatus for providing a user interface of a mobile terminal, characterized in that judged one. The method of claim 11,
The touch panel
Device for providing a user interface of a mobile terminal, characterized in that the combined touch panel is a combination of a pressure sensitive touch panel and an electromagnetic induction touch panel. In the method of providing a user interface of a mobile terminal including a touch screen,
Sensing the approach of the stylus on the touch screen; And
Outputting an affordance image corresponding to at least one function that can be performed using the stylus in a region where the approach of the stylus is detected when the approach of the stylus is detected;
And the affordance image comprises at least one function icon set with a specific function. touch screen; And
And a controller configured to control the touch screen to output an affordance image corresponding to at least one function that can be performed using the stylus in a region where the stylus is detected when the approach of the stylus is detected on the touch screen.
And the affordance image comprises at least one function icon with a specific function set therein.

Images