KR20120056118A - Method, system and computer-readable recording media for providing user interface capable of selecting graphical object without touch on the touch-based os - Google Patents

Abstract

PURPOSE: A system and a method for supplying a user interface which selects a graphic object are provided to freely select a graphic object of various sizes without directly touching a touch screen of a user. CONSTITUTION: A graphic object detecting unit(210) detects a graphic object of various displayed objects. A pointing segment setting unit(220) sets up one or more pointing segment areas. A selection user interface supplying unit(230) supplies a selection user interface. A user selects the graphic object in a pointing segment unit through the selection user interface.

Description

METHOD, SYSTEM AND COMPUTER-READABLE RECORDING MEDIA FOR PROVIDING USER INTERFACE CAPABLE OF SELECTING GRAPHICAL OBJECT WITHOUT TOUCH ON THE TOUCH-BASED OS}

The present invention relates to a method, a system and a computer readable recording medium for providing a user interface for selecting a graphic object without a touch in a touch-based OS, and more particularly, provided by a touch-based OS. By detecting at least one graphic object selectable on the display screen and setting a pointing segment corresponding to each of the at least one graphic object, a jog stick or jog can be made without the user directly touching the touch screen or the like. A method, system, and computer-readable recording medium for allowing a graphic object to be conveniently selected on a pointing segment basis using a direction manipulation device such as a jog dial.

In recent years, as graphic user interfaces (GUIs) have become commonplace in terminal devices such as PCs, mobile phones, smart phones, and PDAs, various user operation interface technologies for controlling GUI screens have been introduced. For example, a technique of pointing an arbitrary position on a display screen by moving a cursor using a mouse, a technique of directly pointing an arbitrary position on a display screen using a touch screen, and the like may be exemplified. .

However, according to the conventional user manipulation interface technology as described above, since a pointing manipulation device such as a mouse or a touch screen is required, it has a limitation that it is difficult to apply when the pointing manipulation device is not provided. In particular, in the case of a telematics system of a car, a high level of stability is required, so that the operating radius of the driver can be minimized rather than the touch screen, which can increase the risk of an accident when the driver is operating while driving. Manipulators such as jog sticks and jog dials are commonly used (e.g., DIS systems of modern cars, BMW iDrive systems, etc.), and accordingly, operating techniques via touch screens, etc. Has a problem that it is not suitable to be applied to the telematics system of the car.

In spite of this situation, in the car telematics system, a program requiring a high degree of freedom GUI such as navigation, a web browser, an audio / video content player, and the like must be driven, so that an icon existing in an arbitrary position on a screen such as a touch screen, There is still a need for a manipulation technique that allows free selection of graphical objects such as hyperlinks.

Of course, although a user operation interface based on an operation device such as a keypad has been applied to a portable terminal device itself, such as a mobile phone, such a conventional user operation interface can be operated only within a preset scenario or in a board form. Because it is a user manipulation interface capable of formal manipulation such as only selecting icons regularly listed, there is a limitation that it is not suitable for navigation on a map or web browser in which hyperlinks are displayed at an arbitrary position.

It is an object of the present invention to solve all the problems described above.

The present invention also detects at least one graphic object selectable on a display screen provided by a touch-based OS and sets a pointing segment corresponding to each of the at least one graphic object, thereby allowing the user to touch screen or the like. Another object of the present invention is to enable a user to conveniently select graphic objects in units of a pointing segment using a direction control device such as a jog stick or a jog dial without directly touching.

In order to accomplish the above object, a representative structure of the present invention is as follows.

According to an aspect of the present invention, a method for providing a user interface for selecting a graphic object without a touch in a touch-based OS, the method comprising: (a) at least a selectable graphic object among objects displayed on a display screen; Detecting one and setting at least one pointing segment corresponding to each of the at least one graphic object, and (b) allowing the pointing segment to be carried in units of the set pointing segment. A method comprising providing a selection UI for supporting selection of at least one of the graphic objects without directly touching the display screen through an operation device linked with a pointing segment.

According to another aspect of the present invention, there is provided a method for providing a user interface that supports graphical object selection, the method comprising: (a) at least one corresponding process can be executed when selected by a user among objects being displayed on a display screen; Detecting a graphic object, (b) setting and displaying at least one pointing segment corresponding to each detected graphic object, and (c) a direction or rotation input from a predetermined operating device Based on the manipulation signal, providing a selection UI that allows the pointing segment to be moved based on the displayed pointing segment so that at least one of the graphic objects can be selected; A method is provided.

According to another aspect of the present invention, a system for providing a user interface that supports the selection of a graphic object without a touch in a touch-based OS, detecting at least one selectable graphic object among the objects displayed on the display screen A graphic object detection unit, a pointing segment setting unit for setting at least one pointing segment corresponding to each of the at least one graphic object, and the pointing segment on a basis of the set pointing segment. A selection user interface for providing a selection UI that allows at least one of the graphic objects to be selected without directly touching the display screen through an operation device linked to the pointing segment. A system is provided that includes a case provider.

According to still another aspect of the present invention, there is provided a system for providing a user interface supporting graphic object selection, the system comprising: at least one graphic on which a corresponding process can be executed when selected by a user among objects being displayed on a display screen; A graphic object detection unit for detecting an object, a pointing segment setting unit for setting and displaying at least one pointing segment corresponding to each of the detected graphic objects, and a direction or rotation operation signal input from a predetermined operation device. On the basis of the above, the selection user interface is provided to provide a selection UI that enables the user to move the pointing segment on the basis of the displayed pointing segment so that at least one of the graphic objects can be selected. A system is provided that includes a portion.

In addition, there is further provided a computer readable recording medium for recording another method for implementing the present invention, a mobile terminal device, a server, and a computer program for executing the method.

According to the present invention, even when a user uses a direction control device such as a jog stick, jog dial, keypad, etc. without directly touching a touch screen, etc. It is possible to freely select each graphic object displayed in various sizes at any position, so that it is possible to freely operate a program such as a navigation and web browser even in an environment where safety is strictly required such as a car telematics system. Is achieved.

Further, according to the present invention, a process of moving the cursor from the first graphic object to the second graphic object can be simplified by adopting a selection user interface for moving the cursor on the basis of the pointing segment corresponding to each graphic object. Even when using a direction manipulation device, the effect of being able to quickly and accurately select each graphic object irregularly displayed at an arbitrary position on the display screen is achieved.

1 is a diagram schematically illustrating a configuration of an entire system for providing a user interface supporting graphic object selection according to an embodiment of the present invention.
2 is a diagram illustrating an internal configuration of a user interface providing system 200 according to an embodiment of the present invention.
3 is a diagram exemplarily illustrating a configuration for supporting selection of a graphic object on a display screen according to an embodiment of the present invention.
4 is a diagram exemplarily illustrating a configuration for supporting selection of a graphic object on a display screen according to another exemplary embodiment of the present invention.
5 is a diagram exemplarily illustrating a configuration of an operation device 300 according to an embodiment of the present invention.
6 is a diagram exemplarily illustrating a configuration of an operation apparatus 300 according to another embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects.

DETAILED DESCRIPTION Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

[Preferred Embodiments of the Invention]

In the present specification, a graphic object refers to any type of graphic element that can be displayed on a display screen and selected by a user. When a specific graphic object is selected, an execution operation is inputted with the graphic object. Any process that is connected may be executed. According to an embodiment of the present invention, a graphic object should be understood as the broadest concept including all icons, menu buttons, tool buttons, and various other hyperlinks.

Configuration of the entire system

1 is a diagram schematically illustrating a configuration of an entire system for providing a user interface supporting graphic object selection according to an embodiment of the present invention.

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a communication network 100, a user interface providing system 200, an operation device 300, and a service providing web server 400. Can be.

First, according to an embodiment of the present invention, the communication network 100 may be configured as an aspect of wireless communication and may be configured with various communication networks, such as a mobile communication network, a satellite communication network. More specifically, the communication network 100 according to the present invention is known World Wide Web (WWW), Wireless LAN (WLAN), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA) or GSM. (Global System for Mobile communications) It should be understood that the concept includes all the networks and the like.

Next, according to an embodiment of the present invention, the user interface providing system 200 recognizes a selectable graphic object displayed on a display screen and sets a pointing segment area for each recognized graphic object. Function can be performed.

In addition, according to an embodiment of the present invention, the user interface providing system 200 provides a function of providing a selection interface that allows a user to select a graphic object in units of a pointing segment through a direction key or a dial operation. Can be performed.

On the other hand, the user interface providing system 200 according to an embodiment of the present invention is a digital device including a function to enable communication after connecting to the communication network 100, a personal computer (for example, desktop, laptop computer) , A tablet computer or the like), a PDA, a web pad, a mobile phone, a vehicle telematics device, and the like, as long as a digital device equipped with a computing device with a memory means and equipped with a microprocessor can provide a user interface system according to the present invention ( 200). On the other hand, the user interface providing system 200 according to an embodiment of the present invention has a variety of programs, such as applications, web browsers, widgets for allowing the user to receive various types of information from the service providing web server 400 It may be included. The internal configuration of the user interface providing system 200 will be described in more detail in the section "Configuration of the user interface providing system" to be described later.

Next, according to an embodiment of the present invention, the operation device 300 may function to process an operation performed by a user to generate an operation signal and transmit it to the user interface providing system 200. The operation device 300 according to an embodiment of the present invention may include a jog stick, a jog dial, a keyboard, a keypad, and the like.

Meanwhile, according to an embodiment of the present invention, the service providing web server 400 may communicate with the user interface providing system 200 and another web server (not shown) through the communication network 100, and the user interface providing system. According to the request of 200, a function of providing various types of information may be performed.

user  Configuration of Interface Provision System

Hereinafter, the internal configuration of the user interface providing system 200 performing important functions for the implementation of the present invention and the function of each component will be described.

2 is a diagram illustrating an internal configuration of a user interface providing system 200 according to an embodiment of the present invention.

2, a user interface providing system 200 according to an exemplary embodiment of the present invention may include a graphic object detector 210, a pointing segment setting unit 220, a selection user interface providing unit 230, and a communication unit 240. ) And the controller 250. According to an embodiment of the present invention, the graphic object detector 210, the pointing segment setting unit 220, the selection user interface providing unit 230, the communication unit 240, and the control unit 250 are at least some of which are user interfaces. Program modules communicating with the providing system 200. Such program modules may be included in the user interface providing system 200 in the form of an operating system, an application module, and other program modules, and may be physically stored on various known storage devices. In addition, such program modules may be stored in a remote storage device that can communicate with the user interface providing system 200. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

First, according to an embodiment of the present invention, the graphic object detection unit 210 performs a function of detecting a selectable graphic object among various objects displayed at an arbitrary position on the display screen. As described above, graphic objects refer to all types of graphic elements that can be displayed on the display screen and can be selected by a user. Certain processes may be performed, for example, graphical objects may include icons, menu buttons, tool buttons, various other hyperlinks, and the like.

Next, according to an embodiment of the present invention, the pointing segment setting unit 220 has a function of setting at least one pointing segment area corresponding to each of the at least one graphic object detected by the graphic object detecting unit 210. To perform.

Here, the pointing segment is a display set in correspondence with the graphic object to support the user to freely select each graphic object displayed in various sizes at any position on the display screen without directly touching the touch screen. It means the area on the screen. According to an embodiment of the present invention, the shape and size of the pointing segment may be determined according to the shape and size of the corresponding graphic object displayed on the display screen. In addition, the pointing segment may be visually represented as a predetermined graphic element displayed to overlap at least a portion of the corresponding graphic object, and the graphic element may be displayed to partition the boundary of the pointing segment.

Next, according to an embodiment of the present invention, the selection user interface providing unit 230 performs a function of providing a selection user interface for supporting a user to select a graphic object on a pointing segment basis. . According to the selection user interface according to an embodiment of the present invention, a cursor may be moved in units of a pointing segment in response to a user's operation signal, and when the cursor is located in a specific pointing segment, The specific graphic object corresponding to the pointing segment may be recognized as being selected. The detailed configuration of the selection user interface will be described in detail below.

According to the selection user interface according to one embodiment of the present invention, the user inputs an operation signal using the operation device 300 to move the cursor in units of a pointing segment, thereby selecting any one of a plurality of pointing segments displayed on the display screen. Can be selected, which means that the user can select a graphic object corresponding to the pointing segment.

For example, the operation signal input from the operation device 300 is a direction operation signal of up, down, left, right, left, right, left, right, bottom, etc. input from a jog stick or a keypad, or a clock input from the jog dial. Direction, counterclockwise rotation and the like. More specifically, when the upward direction manipulation signal is input, the cursor staying in the first pointing segment may move to the second pointing segment located above the first pointing segment, and when the clockwise rotation manipulation signal is input, the cursor The cursor that was staying in the first pointing segment may move to the third pointing segment located at the nearest position clockwise with respect to the first pointing segment or may simply move to the fourth pointing segment existing on the right side. However, the cursor movement method in units of the above-described pointing segment is an example to help understanding of the present invention, and the cursor movement method according to the present invention is not necessarily limited to the above-listed range, and the scope of the present invention can be achieved. Note that it can be changed as much as possible.

Further, according to the selection user interface according to an embodiment of the present invention, a graphic segment for visually emphasizing a pointing segment where the cursor is currently staying, that is, a pointing segment that is currently selected, overlaps or corresponds to the pointing segment. It may be displayed in combination with, for example, a shadow effect, an inversion effect, and the like for the corresponding pointing segment may be assumed.

On the other hand, graphic elements that display the pointing segment itself or highlight the pointing segment can be immediately called as needed and synthesized or overlaid on any position on the display screen by a technique such as alpha blending. Is distinguished from a simple graphical user interface for calling and displaying a conventional pre-stored and fixed image according to a preset scenario.

In general, in order to easily select each graphic object having various sizes at any position on the display screen, it is necessary to directly point the position where the graphic object is displayed by using a pointing means such as a mouse or a touch screen. As described above, according to the present invention, each pointing segment can be recognized only by the direction or dial operation without directly pointing the position where the corresponding graphic object is displayed by recognizing and selecting the pointing segments correspondingly to each selectable graphic object. The effect is that you can easily select the corresponding graphic object by moving from.

On the other hand, according to the selection user interface according to another embodiment of the present invention, the graphic object detected on the display screen according to a predetermined pattern (for example, straight, lattice, annular, etc.) in units of each pointing segment Separate screens may be provided that are arranged and displayed in a list. That is, according to the selection user interface according to another embodiment of the present invention, the user inputs an operation signal using the operation device 300 to move the cursor in units of a pointing segment to sequentially display a plurality of graphic objects displayed in a list form. Can be selected.

FIG. 3 is a diagram exemplarily illustrating a configuration for supporting selection of respective graphic objects scattered in various sizes at arbitrary positions on a display screen according to an embodiment of the present invention.

Referring to FIG. 3, it can be seen that a total of 16 graphic objects are detected and displayed on the display screen. Specifically, the weather widget 301, the banner advertisement 302, the advertisement widget 303, and the application execution are performed. It may be assumed that graphic objects such as the dragon icons 304 to 310, the video 311, the menu buttons 312 to 315, and the tool button 316 are displayed. In this case, the pointing segments 317 to 332 corresponding to each of the graphic objects 301 to 316 displayed on the display screen may be set, and each of the pointing segments 317 to 332 is a corresponding graphic object 301 as an example. 316 may be displayed in the form of a rectangular border surrounding the rectangle 316, and a shadow may be displayed on the pointing segment 302 where the cursor is currently positioned, indicating that the graphic object 301 is selected. According to an embodiment of the present invention, in the above state, the user inputs an operation signal through a predetermined operation device and moves the cursor in units of the pointing segments 317 to 332 to various positions at arbitrary positions on the display screen. Any one of each of the graphic objects 301 to 316 displayed interspersedly can be freely selected.

4 is a diagram exemplarily illustrating a configuration for supporting selection of a graphic object on a display screen according to another exemplary embodiment of the present invention.

Referring to FIG. 4, a separate display screen may be provided in which graphic objects 401 to 416 detected on the display screen are arranged and displayed in various types of lists. In this case, the user can input the operation signal using a predetermined operation device to sequentially select the graphic objects 401 to 416 arranged in a list according to the grid pattern.

Next, FIG. 5 is a diagram exemplarily illustrating a configuration of an operation device 300 according to an embodiment of the present invention.

Referring to FIG. 5, a manipulation device 300 according to an exemplary embodiment of the present invention includes a jog stick 510 for inputting a direction manipulation signal and a jog dial for inputting a rotation manipulation signal. dial 520, at least one keypad 530 capable of inputting an execution manipulation signal for a process corresponding to the graphic object.

On the other hand, according to another embodiment of the present invention, the operation device 300 may be a virtual operation device implemented by an application or the like on a separate terminal device. That is, according to another embodiment of the present invention, each graphic object scattered in various sizes on the touch screen screen by using a terminal device such as a smart phone that the user has without using a physical manipulation device It is possible to perform operations related to the selection of. In this case, the communication between the user interface providing system 200 and a separate terminal device implementing the virtual operation device 300 may be short-range wireless communication technology such as Wi-Fi, Bluetooth, or serial. ) And wired communication technology through a USB connection.

On the other hand, Figure 6 is a view showing the configuration of an operating device 300 according to another embodiment of the present invention by way of example.

Referring to FIG. 6, it may be assumed that an operation device 300 according to another embodiment of the present invention is implemented on a touch screen of a touch-based terminal device. In this case, a user may display a virtual display on the terminal device. A direction manipulation signal, a rotation manipulation signal, an execution manipulation signal, and the like may be input by directly touching the manipulation device 610.

Next, according to an embodiment of the present invention, the communication unit 240 has a function to enable the user interface providing system 200 to communicate with an external system such as the operation device 300, the service providing web server 400, and the like. To perform.

Finally, according to an embodiment of the present invention, the controller 250 controls the flow of data between the graphic object detector 210, the pointing segment setting unit 220, the selection user interface providing unit 230, and the communication unit 240. Function to control. That is, the controller 250 controls the flow of data to and from the outside or between the components of the user interface providing system 200, thereby making the graphic object detection unit 210, the pointing segment setting unit 220, and the selection. The user interface providing unit 230 and the communication unit 240 control each to perform a unique function.

Embodiments according to the present invention described above may be implemented in the form of program instructions that may be executed by various computer components, and may be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Accordingly, the spirit of the present invention should not be limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the appended claims, fall within the scope of the spirit of the present invention. I will say.

100: Network
200: user interface providing system
210: graphic object detection unit
220: pointing segment setting unit
230: selection user interface provider
240: communication unit
250:
300: operation device
400: service providing web server
301 to 316: graphic object
317 to 332: pointing segment
401 to 416: graphic object
510: jog stick
520: jog dial
530: keypad
610: virtual operating device

Claims (29)

As a method for providing a user interface that supports the selection of graphic objects without touch in a touch-based OS,
(a) detecting at least one selectable graphic object among objects being displayed on the display screen and setting at least one pointing segment corresponding to each of the at least one graphic object, and
(b) at least one of the graphic objects may be selected without directly touching the display screen through an operation device linked with the pointing segment to move the pointing segment on the basis of the set pointing segment. Providing a selection UI that supports the user
≪ / RTI > The method of claim 1,
And wherein each graphical object is present at any location on the display screen at any size. The method of claim 1,
The shape and the size of the pointing segment are respectively determined according to the shape and size of the area occupied by the corresponding graphic object on the display screen. The method of claim 1,
The selection user interface is,
Displaying on the display screen a graphic element partitioning a boundary of each of the at least one pointing segment. The method of claim 1,
The selection user interface is,
And determining a selection state of the graphic object based on the cursor moving in units of the pointing segment. The method of claim 5,
The selection user interface is,
And determining that a graphic object corresponding to the pointing segment where the cursor is located is selected. The method of claim 5,
The selection user interface is,
Displaying a graphic element on the display screen that highlights the pointing segment at which the cursor is located. The method of claim 5,
The selection user interface is,
And move the cursor from the first pointing segment to the second pointing segment based on a direction or rotation manipulation signal input from the manipulation device. The method of claim 8,
And the operating device comprises at least one of a jog stick, a jog dial and a keypad. The method of claim 8,
The operation device is characterized in that the virtual implementation on the touch screen of the separate terminal device. The method of claim 1,
The selection user interface is,
And providing a separate display screen in which the at least one graphic object is arranged and displayed in a list form on the basis of each pointing segment. The method of claim 1,
(c) allowing a process corresponding to the specific graphic object to be executed when an execution operation signal is input while a specific pointing segment corresponding to the specific graphic object is selected.
≪ / RTI > The method of claim 1,
The graphic object,
And at least one of an application execution icon, a menu button, a tool button, and a hyperlink. A method for providing a user interface that supports graphical object selection,
(a) detecting at least one graphic object from which the corresponding process can be executed when selected by the user among objects being displayed on the display screen;
(b) setting and displaying at least one pointing segment corresponding to each of the detected graphic objects, and
(c) a selection for allowing at least one of the graphic objects to be selected by allowing the pointing segment to be moved based on the displayed pointing segment based on a direction or rotation manipulation signal input from a predetermined manipulation device; Providing a user interface (selection UI)
≪ / RTI > A system for providing a user interface that supports the selection of graphic objects without a touch in a touch-based OS,
A graphic object detector for detecting at least one selectable graphic object among objects displayed on the display screen;
A pointing segment setting unit configured to set at least one pointing segment corresponding to each of the at least one graphic object, and
Supporting at least one of the graphic objects to be selected without directly touching the display screen through an operation device linked with the pointing segment to move the pointing segment on the basis of the set pointing segment A selection user interface provider that provides a selection UI.
System comprising a. 16. The method of claim 15,
And wherein each graphical object is present at any location on the display screen at any size. 16. The method of claim 15,
The shape and the size of the pointing segment are respectively determined according to the shape and size of the area occupied by the corresponding graphic object on the display screen. 16. The method of claim 15,
The selection user interface is,
Displaying a graphical element on the display screen partitioning a boundary of each of the at least one pointing segment. 16. The method of claim 15,
The selection user interface is,
And a selection state of a graphic object is determined based on a cursor moving in units of the pointing segment. 20. The method of claim 19,
The selection user interface is,
And determine that a graphic object corresponding to the pointing segment at which the cursor is located is selected. 20. The method of claim 19,
The selection user interface is,
And display a graphic element on the display screen that highlights the pointing segment where the cursor is located. 20. The method of claim 19,
The selection user interface is,
And move the cursor from the first pointing segment to the second pointing segment based on a direction or rotation manipulation signal input from the manipulation device. The method of claim 22,
And said operating device comprises at least one of a jog stick, a jog dial, and a keypad. The method of claim 22,
The operating device is a system, characterized in that the virtual implementation on the touch screen of the separate terminal device. 16. The method of claim 15,
The selection user interface is,
And providing a separate display screen in which the at least one graphic object is arranged and displayed in a list form on the basis of each pointing segment. 16. The method of claim 15,
The selection user interface is,
And when an execution manipulation signal is input while a specific pointing segment corresponding to a specific graphic object is selected, a process corresponding to the specific graphic object is executed. 16. The method of claim 15,
The graphic object,
And at least one of an icon for executing an application, a menu button, a tool button, and a hyperlink. A system for providing a user interface that supports graphical object selection.
A graphic object detector for detecting at least one graphic object on which a corresponding process may be executed when the object is selected by the user among objects displayed on the display screen;
A pointing segment setting unit configured to set and display at least one pointing segment corresponding to each of the detected graphic objects, and
A selection user interface configured to move the pointing segment on a basis of the displayed pointing segment based on a direction or rotation manipulation signal input from a predetermined manipulation device to support selection of at least one of the graphic objects; Selection user interface provider
System comprising a. A computer-readable recording medium having recorded thereon a computer program for executing the method according to any one of claims 1 to 14.

Images