KR101080526B1 - Method and apparatus for providing user interface - Google Patents

Abstract

A method of providing a UI and an apparatus for providing the same are provided. The method for providing a UI may include selecting a message by a control UI, determining whether the control UI performs a specific action by the UI providing apparatus, and when the control UI performs the specific action, based on the message. Performing a designated function.

Description

GI providing method and apparatus therefor {Method and apparatus for providing user interface}

The present invention relates to a method for providing a user interface (UI) and a device thereof, and more particularly, to a method and a device for performing a function desired by a user, in particular, a search and / or browsing function as easily as possible. It is about.

Computing environments are gradually evolving toward user convenience. A user may process, collect, and / or utilize information through a computing device (eg, a computer, etc.). For example, a user performs various tasks through his computer. These various types of tasks may be different for each user.

Meanwhile, a user may use one or more input devices (eg, a keyboard or a mouse) while using a computing device (eg, a computer). In this case, the user may need to perform a task using different input devices according to the characteristics or the type of the task.

For example, a user may perform many tasks of searching for specific information. According to the conventional method, in order to perform a search, a user first needs to load a specific search tool or access a site of a service provider that provides a search service. This approach is accomplished using a mouse or equivalent device (eg, a touch pad) in modern computing systems, where most operating systems employ a graphical user interface (GUI) environment.

After accessing the search tool and / or search site, the user performs a process of inputting information to be searched into a predetermined location (eg, a text box). In this case, a keyboard or a corresponding device capable of inputting text and / or characters may be used.

If there are tasks that are frequently performed by the user as well as the search task, it is very inconvenient to load (execute) a tool or application to perform the task and to use another input device to perform a desired task after loading. .

Therefore, there is an urgent need for a method and apparatus for solving such a problem.

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide a method and apparatus for easily performing a task based on a message (eg, a web search) without changing an input device.

The UI providing method for achieving the technical problem is a step in which a message is selected by a control UI, the UI providing device determines whether the control UI performs a specific action, and if the control UI performed the specific action And performing a designated function based on the message.

The control UI may include a mouse pointer.

Selecting a message by the control UI may include dragging the message by the control UI or forming a closed curve while the trace of the control UI includes the message.

The message may include at least one of text, image, audio, or video information.

The specific action may be an action including shaking the control UI from side to side or drawing a specific figure.

The performing of the designated function may include searching the selected message using a predetermined search engine.

The performing of the designated function may include determining whether the selected message corresponds to a web address, and if the message corresponds to a web address, browsing the web address, and not a message corresponding to the web address. In this case, the method may include searching the selected message using a predetermined search engine.

The UI providing method for achieving the technical problem comprises the steps of the UI providing apparatus determines whether the control UI performs a specific action, if the determination result is the specific action, selecting a message based on the specific action, and the selected Performing a designated function based on the message.

When the specific action is an action in which the trace of the control UI forms a closed curve, selecting a message based on the specific action may include selecting a message included in the closed curve.

When the specific action is shaking the control UI from side to side, selecting a message based on the specific action may include selecting a message located below the control UI.

The UI providing method for achieving the technical problem comprises the steps of the UI providing apparatus determines whether the control UI performs a specific action, when the determination result is the specific action, activating a program UI, a message to the activated program UI It may include receiving an input, and performing a designated function based on the input message.

When the specific action is a drag, inputting a message to the program UI may include placing the control UI in a dragged state on the program UI.

The designation function may be a function of performing a search based on the message. The UI providing method may be stored in a computer readable recording medium recording a program.

The apparatus for providing a UI for achieving the technical problem is a control module for determining whether a control UI having a message selected has a specific action, and if the control UI has a specific action as a result of the determination of the control module, designation based on the message. It may include a function module for performing a function.

The designation function may be a function of searching for the selected message using a predetermined search engine.

The function module determines whether the selected message corresponds to a web address, browses the web address if the message corresponds to the web address, and if the message corresponds to the web address, determines the selected message if the message corresponds to the web address. You can search using any search engine.

The UI providing apparatus further includes a DNS DB, and the function module may determine whether the selected message corresponds to a web address based on information stored in the DNS DB.

The UI providing method for achieving the technical problem is a control module for determining whether the trace of the control UI forms a closed curve, and when the determination result of the control module forms a closed curve, performing a designated function based on the message included in the closed curve It may include a function module for.

The UI providing apparatus for achieving the technical problem includes a control module for determining whether a control UI performs a specific action and a message selected based on the specific action from the control module when the control module determines the specific action. And a function module for performing a designated function based on the received message.

The apparatus for providing a UI for achieving the technical problem includes a control module for determining whether a control UI performs a specific action and a function module for performing a designated function based on an input message, wherein the control module includes the control UI. When it is determined that a specific action is performed, the program UI is activated. When a message is input to the activated program UI, the function module performs a designated function based on the input message.

The method and apparatus for providing a UI according to the present invention have an effect that a user can conveniently perform a desired task only by an action of a control UI (eg, a mouse pointer).

In addition, when a specific message or information is required to perform the task, such as a search task, loading of a program (or activation of a loaded program) and input of the specific message or information can be performed at once.

The UI providing method according to an embodiment of the present invention can be particularly advantageously used for a search operation, and since a message to be searched can be input using a control device such as a mouse, not only a search based on existing text, but also an image. In addition, the video file itself can be used as a search keyword.

In order to fully understand the present invention, the operational advantages of the present invention, and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings which illustrate preferred embodiments of the present invention and the contents described in the accompanying drawings.

Also, in this specification, when any one element 'transmits' data to another element, the element may transmit the data directly to the other element, or may be transmitted through at least one other element And may transmit the data to the other component.

Conversely, when one element 'directly transmits' data to another element, it means that the data is transmitted to the other element without passing through another element in the element.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in the drawings denote like elements.

In addition, the technical spirit and the contents disclosed in the Korean patent application (Application No. 10-2008-0065722, "UI providing method and apparatus") filed by the applicant of July 07, 2008 may be included in the description of the present specification. And may be included as a reference of the present invention.

1 is a schematic block diagram of an apparatus for providing a UI according to an embodiment of the present invention.

Referring to FIG. 1, the UI providing apparatus 100 according to an exemplary embodiment of the present invention includes a control module 110 and a function module 120. The UI providing apparatus 100 may further include a DNS DB 130.

Each of the components of the UI providing apparatus 100 are separately shown in the drawings to indicate that they may be functionally and logically separated, and do not necessarily mean that they are physically separate components or implemented as separate codes. .

In this specification, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for performing the predetermined code, and means a physically connected code or does not necessarily mean one kind of hardware. It can be easily inferred by the average expert in the art.

In addition, the term "DB" in the present specification may mean a functional structural combination of software and hardware that stores information corresponding to each DB. The DB may be implemented as at least one table, and may further include a separate DBMS (Database Management System) for searching, storing, and managing information stored in the DB. In addition, it may be implemented in various ways such as a linked-list, a tree, a relational DB, and includes all data storage media and data structures capable of storing information corresponding to the DB.

The control module 110 may control a data flow for implementing a UI providing method according to an embodiment of the present invention, perform a necessary operation, and control / control a resource accordingly. In addition, the control module 110 may control other components of the UI providing apparatus 100.

In addition, the control module 110 monitors the control UI controlled by the user and collects information on the action of the control UI, such as whether the control UI performs a specific action and / or whether the trace drawn by the control UI is a closed curve. And can be determined.

The control UI may vary according to the type of computing device or input device, and may be used to mean all UIs used by a user to input, instruct, or select predetermined information. For example, a mouse pointer indicating a UI of a mouse used as one of user input devices in a Windows® system or a MacOS® system may be included in the control UI. The control UI may be used to mean a UI including a state in which a specific message is selected. For example, it may be used as a meaning including a state in which a specific message (eg, text) is selected through a mouse pointer through a specific action (eg, drag) or a state in which the selected specific message is moved to a specific position. Of course, it may also mean a control UI (eg, a mouse pointer) in a state in which a specific message is not selected.

The user can select a specific message through the control UI. For example, a user may select at least a portion of a web document displayed on the web client by dragging. Alternatively, the specific message may be selected by drawing a predetermined closed curve (eg, a square or a circle) to include a message to be selected using the control UI. Of course, the selection process may be performed while pressing a specific interface (eg, a left click button or a right click button) of an input device (eg, a mouse or a touch pad) corresponding to the control UI.

Thereafter, the control module 110 may determine whether an action taken by the control UI is included in a predetermined specific action. The control module 110 receives information on the position of the control UI from the OS of the computing device on which the UI providing device 100 is installed, and determines which action the control UI is based on. It may be.

The specific action may also be set by the user.

2A to 2D are diagrams for describing a UI providing method according to an exemplary embodiment of the present invention.

2A to 2D, FIG. 2A illustrates a case where a specific message (eg, 'ABC', 2) is selected in a specific application (eg, a web browser or a word processor) through the control UI 1.

Thereafter, as shown in FIG. 2B, the user may take a swing action, that is, an action of shaking a predetermined width from side to side with the message 2 selected. Then, the UI providing apparatus 100 may perform a designated function.

In addition, as illustrated in FIG. 2C, when a specific figure or a specific shape is drawn while the message 2 is selected, the UI providing apparatus 100 may perform a designated function.

Meanwhile, as illustrated in FIG. 2D, the user may select the message 2 by various methods as well as dragging. FIG. 2D illustrates an example of drawing a closed curve to include a specific message. Of course, at this time, a closed curve may be drawn while pressing a predetermined interface (eg, a left / right click button) provided in an input device (eg, a mouse or a touch pad) corresponding to the control UI 1. Then, as described above, if the user draws a swing action or a specific figure or shape, the UI providing apparatus 100 may perform a designated function.

As a result of the determination of the control module 110, when the control UI performs a specific action, the function module 120 may perform a designated function based on the selected message.

The designation function is a function or task mainly used by the user and may be a function previously set or predetermined by the user through the UI providing apparatus 100. For example, it may be a function of searching for a file including a selected message in a local system in which the UI providing apparatus 100 is installed, or a predetermined function used in a specific application.

The designation function may be a function of searching the selected message using a predetermined search engine. Accordingly, the UI providing apparatus 100 may transmit the message selected by the control UI to a specific search engine or search site set as a default.

On the other hand, to perform a designation function based on the message selected in the present specification, when the designation function is a search function and the message is text may mean that the text is searched by a search keyword. When the designation function is a search function and the message is a file such as an image, a sound source, a video, or a video, performing the designation function based on the message may include extracting and extracting at least a part of the meta information of the file. It may mean that the search is performed using the information as a search keyword.

On the other hand, if the selected message is text, the function module 120 does not merely perform a web search function, but determines whether the selected message is a message corresponding to a web address, and determines that the message corresponds to a web address. If the web address is browsed, and if it is determined that the message is not a message corresponding to the web address, the selected message may be searched using a predetermined search engine.

For example, when the selected message is Korean text of 'Naver', the text of 'Naver' may be mapped to a specific web address. Therefore, when the selected message is mapped to a specific web address, browsing is performed by accessing the mapped specific web address. Otherwise, the search can be performed. To this end, the UI providing apparatus 100 may further include a domain name server (DNS) DB 140, and the function module may include the selected message on a web address based on information stored in the DNS DB 140. It can be determined whether it is a corresponding message. Of course, the DNS DB 140 may be used to include a domain name server (DNS) provided by a conventional Internet service provider (ISP). That is, the above-described function may be performed through the DNS without separately providing the DNS DB 140 in the UI providing apparatus 100.

However, the DNS DB 140 may be included locally in the computing device where the UI providing apparatus 100 is installed. As described above, the DNS DB 140 is installed on a local device, and when the specific text is a web address, browsing is performed. Otherwise, the technical idea and effect thereof are Korean registered patents filed by the present applicant. No. 10-0456225, "Internet keyword access service using a local domain name server, which is disclosed in detail 'registered patent'), the technical spirit and description disclosed in the registered patent may be included in the description of the present invention It may also be incorporated by reference herein.

That is, the control module 110 determines whether the trace of the control UI forms a closed curve, and when the determination result is a closed curve, the control module 110 performs the designated function based on the message included in the closed curve. The function module 120 may be controlled.

Meanwhile, when there are a plurality of predetermined specific actions, the designated functions corresponding to the specific actions may be different. For example, when a user performs a swing action through the control UI 1, a web search is performed on the selected message using a keyword, and when a user draws a rectangular figure, a file search of a local system including the selected message is performed, and a prototype is performed. In the case of drawing, a function of storing the selected message in a specific location may be performed.

When the designated function is a web search, the UI providing method according to an exemplary embodiment of the present invention is compared with the conventional method as follows. For example, in the related art, a user needs to execute a specific web search tool or access a web search site while using a specific application with a mouse, and then input a specific text through a keyboard. . However, the conventional method is inconvenient, such as changing the position of the hand to use the keyboard while using the mouse, and as described above, it is necessary to execute a web search tool or access a web search site. However, in the UI providing method according to an exemplary embodiment of the present invention, if a web search function that is frequently used is set in advance, input through a keyboard and web search are performed by simply selecting a text to be searched from a predetermined application or a desktop and taking a specific action. It is effective to execute the tool or connect to the web search site at once.

Meanwhile, as disclosed in the previous application, the user selectable message may be not only text but also a multimedia file such as an image, a video, an audio, a video, and the like. The multimedia file may be used to include a multimedia file, information indicating the multimedia file (eg, a link file), or an icon corresponding to the multimedia file.

In the case where the designation function is a web search as an example, it was not possible to perform a search using an image file because the information to be searched had to be input.

However, since the UI providing method according to an embodiment of the present invention can select information (eg, a search keyword) to be searched by the control device (eg, a mouse), the text information does not necessarily have to be a search keyword and the control device (eg, Search information can be any information or file that can be selected with the mouse.

3 is a diagram illustrating a case where a message is a multimedia file in a UI providing method according to an exemplary embodiment of the present invention.

Referring to FIG. 3, for example, the user may select the multimedia file 3 through the control UI 1, and then the control UI 1 and 3 itself, in which the multimedia file is selected, may be another control UI. . Thereafter, the control module 110 monitors whether the control UIs 1 and 3 take a specific action, and if it is determined that a specific action is taken, the control module 110 may perform a designated function.

Performing a search based on the multimedia file may mean performing a search based on at least some of meta information included in the multimedia file. For example, the meta information may store various information such as a title, a producer, or a production time of the multimedia file, and any one and / or combination thereof may be a search keyword.

For example, if a specific action is performed after the image file 3 is selected, a web search can be performed. Then, a search may be performed using the title of the image file as a keyword. The title may be a search keyword, and the creation time may be a predetermined search condition. For example, only information created or posted before or after creation time can be searched for. How to perform the search based on which information of the meta information may vary according to implementation.

In addition, as described above, when the control UI 1 is controlled such that the trace of the control UI 1 forms a closed curve while including the image file 3, the UI providing apparatus 100 is included in the closed curve. It is also possible to perform a web search based on the image file 3. The trace of the control UI 1 may or may not be displayed separately.

4 is a view for explaining a UI providing method according to another embodiment of the present invention.

Referring to FIG. 4, the control module 110 of the UI providing apparatus 100 according to an exemplary embodiment may monitor whether the control UI 1 performs a specific action in a state in which a specific message is not selected. As described above, the specific action may be a swing action or an action of drawing a specific figure.

If the control UI 1 determines that the control UI 1 performs a specific action, the control module 110 may activate a predetermined predetermined program UI 4. When the program UI 4 is activated, a predetermined animation effect (eg, the program UI 4 flies in a specific direction, etc.) may be inserted. The program UI 4 is preferably activated at a distance away from the position where the control UI 1 is located so that the user can easily input a predetermined message.

The program UI 4 may be a UI for receiving a predetermined message. For example, the program UI 4 may be a text box in which a user may input a text message. Therefore, when a user inputs a text message to the program UI 4, the UI providing apparatus 100 may perform a designation function (eg, a search function) based on the input message.

5 is a diagram illustrating an example of a drag action in a UI providing method according to an exemplary embodiment of the present invention.

Referring to FIG. 5, the specific action monitored by the control module 110 may be an action of dragging a predetermined message. As described above with reference to FIG. 2, when the user drags a predetermined message, the UI providing apparatus 100 may determine that the message is selected, but may also determine that a predetermined specific action has been performed.

For example, the user may drag the message 'ABC' 2 using the control UI 1. Then, since the UI providing apparatus 100 has an action of dragging, the UI providing apparatus 100 may activate a predetermined program UI 4. According to the implementation example, when there is an action called drag, the designation function may be performed based on the dragged message (2). However, since the dragging is a common operation in general document operations or web browsing, the user can specify the designation function. It is to activate the program UI (4) to see if there is an intention to perform. Therefore, when the user places the control UI 1 on the program UI 4 while the message 2 is dragged, it is determined that the user intends to perform a designated function and the UI providing apparatus 100 ) May perform a designated function based on the message (2).

Meanwhile, according to another embodiment of the present disclosure, the UI providing apparatus 100 may determine whether the control UI performs a specific action and select a message based on the specific action itself. For example, in the case of an action of drawing a closed curve to include a specific message as described in FIG. 2D, the UI providing apparatus 100 may be regarded as selecting the specific message included in the closed curve. Therefore, the designation function may be directly performed without a separate message selection process.

That is, the UI providing apparatus 100 determines whether the control UI 1 performs a specific action, and when the determination result is the specific action, selects a message based on the specific action and based on the selected message. You can perform the designated function. An example of this is shown in FIG. 6 as well as FIG. 2D.

6 is a view for explaining a UI providing method according to another embodiment of the present invention.

Referring to FIG. 6, a user may place a control UI on a predetermined text message (eg, 'ABC') and perform a swing action (shake left and right). Then, the UI providing apparatus 100 may determine and select what is a message (eg, 'ABC') located below the control UI. Of course, in the process of selecting a message, the UI providing apparatus 100 selects a text located under the control UI in a word unit, or parses the selected word based on a predetermined criterion, so that only the message except the ending or the survey is used as the message. You can also choose. Then, the designation function (eg, web search, etc.) may be directly performed based on the selected message.

On the other hand, according to the UI providing method according to another embodiment of the present invention, the user can control the control UI to perform a specific action. Then, when the specific action is a predetermined action, the control module 110 may change the control UI to an active mode. The change in the control UI to the active mode may mean that the control UI enters or changes to a mode for performing a designated function according to an embodiment of the present invention. The control UI changed into the active mode may be displayed to have a different shape, color, and / or shape from the control UI in the inactive mode so that the user may know that the active UI is in the active mode. For example, in the active mode, the predetermined mark may be displayed more than the control UI in the inactive mode.

For example, when the designated function is a search function, the change to the active mode may mean that the search is directly performed based on the selected message when the message is selected by the control UI changed to the active mode. Therefore, there is no need to access a specific search engine or search site, and there is no need to enter a search keyword separately.

The method of selecting a message in the active mode may vary. For example, when dragging a specific message to the control UI of the active mode, the user can determine that the intention is to search for the specific message dragged, so that the search can be performed immediately after the dragging operation is completed.

Alternatively, even when the control UI of the active mode is located on a specific message, it may be determined that there is an intention to search for the specific message in some cases. However, there may be a case where the user does not have a search intention even when the control UI of the active mode is located on a specific message. For example, there may be a case where the control UI of the active mode is moved while passing on a message without a search intention. Therefore, in this case, the control module 110 may activate a predetermined program UI in order to confirm whether the user is truly search intent.

For example, when the control UI of the active mode is located on the message 'ABC', the control module 110 may activate a predetermined program UI. The program UI may be a program UI 4 as shown in FIG. 5. Thereafter, when the user selects the activated program UI as the control UI in the active mode (for example, clicking or placing the control UI on the program UI), the user determines that the user really intends to perform a search. The search may be performed based on the message 'ABC'.

Meanwhile, in order to return the control UI changed to the active mode to the original state, that is, to change to the inactive mode, the user may perform a specific action again. Of course, the action for changing the control UI to the inactive mode and the action for changing the control UI to the active mode may be the same or different.

Meanwhile, although the user may perform a specific action to change the control UI to the active mode as described above, the user may input a predetermined button from a specific user input device (eg, a mouse or a keyboard). For example, when a specific key or button of a keyboard is input, the control UI may be changed to an active mode. In addition, the control UI may be changed to the active mode by pressing a specific button a few times with the mouse. Alternatively, when a specific button (for example, a search button) is provided in a predetermined input device (for example, a mouse or a keyboard) for implementing a UI providing method according to an embodiment of the present invention, when the user presses the specific button, the control The UI may be changed to the active mode. When the control UI is changed to the active mode, a search may be performed by selecting a message as described above.

The UI providing method according to an exemplary embodiment of the present invention may be implemented as computer readable codes on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include USB storage devices, ROMs, RAM, CD-ROMs, magnetic tapes, hard disks, floppy disks, optical data storage devices, and the like. Transmission). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. And functional programs, codes and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

Although the present invention has been described with reference to one embodiment shown in the drawings, this is merely exemplary, and those skilled in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS In order to better understand the drawings cited in the detailed description of the invention, a brief description of each drawing is provided.

1 is a schematic block diagram of an apparatus for providing a UI according to an embodiment of the present invention.

2A to 2D are diagrams for describing a UI providing method according to an exemplary embodiment of the present invention.

3 is a diagram illustrating a case where a message is a multimedia file in a UI providing method according to an exemplary embodiment of the present invention.

4 is a view for explaining a UI providing method according to another embodiment of the present invention.

5 is a diagram illustrating an example of a drag action in a UI providing method according to an exemplary embodiment of the present invention.

6 is a view for explaining a UI providing method according to another embodiment of the present invention.

Claims (25)

Selecting, by the control UI, a multimedia file including at least one of an image, a video, an audio, and a video as a message; Determining, by a UI providing apparatus, whether the control UI performs a specific action; And If the control UI performs the specific action, searching for the selected message using a predetermined search engine, The searching of the selected message using a predetermined search engine may include: And performing a search with the search engine using at least a part of meta information included in the multimedia file as a search keyword. The method of claim 1, wherein at least some of the meta information includes: UI providing method comprising at least one of a title, a producer, or a production time of the multimedia file. The method of claim 1, wherein the selecting of the message by the control UI comprises: And dragging the message by the control UI or forming a closed curve while the trace of the control UI includes the message. delete The method of claim 1, wherein the specific action comprises: Action-in UI providing method comprising shaking the control UI from side to side or drawing a specific figure. delete Selecting a message by the control UI; Determining, by a UI providing apparatus, whether the control UI performs a specific action; And If the control UI performs the specific action, performing a designated function based on the message; Performing the designation function, Determining whether the selected message corresponds to a web address; And Browsing the web address when the message corresponds to the web address; and searching for the selected message using a predetermined search engine when the message does not correspond to the web address. delete Determining, by the UI providing apparatus, whether the control UI performs a specific action; And Selecting a message based on the specific action when performing the specific action as a result of the determination; And Performing a designated function based on the selected message; When the specific action is an action in which the trace of the control UI forms a closed curve, Selecting a message based on the specific action, UI providing method comprising the step of selecting a message included in the closed curve. Determining, by the UI providing apparatus, whether the control UI performs a specific action; And Selecting a message based on the specific action when performing the specific action as a result of the determination; And Performing a designated function based on the selected message; If the specific action is shaking the control UI from side to side, Selecting a message based on the specific action, The UI providing method comprising the step of selecting a message located below the control UI. Determining, by the UI providing apparatus, whether the control UI performs a specific action; Activating a program UI when the specific action is performed as a result of the determination; Receiving a message in the activated program UI; And Performing a designated function based on the input message; If the specific action is a drag, Inputting a message to the program UI, Positioning the control UI of the dragged state on the program UI. delete Determining, by the UI providing apparatus, whether the control UI performs a specific action; Changing the control UI to an active mode when the specific action is performed as a result of the determination; Selecting a message by the control UI changed to an active mode; And And providing a designation function based on the selected message. The method of claim 13, wherein the selecting of the message by the control UI changed to the active mode comprises: And dragging the message by the control UI changed to the active mode. The method of claim 13, wherein the UI providing method, If a message is selected by the control UI, further comprising loading a program UI, And when the loaded program UI is selected by the control UI, performing a designated function based on the selected message. The method of claim 13, wherein the UI providing method, And when the control UI changed to the active mode performs the second action, changing the control UI changed to the active mode to the inactive mode. Receiving, by the UI providing apparatus, an active mode change signal from the user input apparatus; Changing the control UI to an active mode in response to the received active mode change signal; Selecting a message by the control UI changed to an active mode; And And providing a designation function based on the selected message. A computer having recorded a program for performing the method according to any one of claims 1, 2, 3, 5, 7, 7, 9-11, and 13-17. Readable record carrier. A control module for determining whether a control UI for which a message, which is a multimedia file including at least one of an image, a video, an audio, or a video, performs a specific action; And And a function module for performing a function of searching for the selected message using a predetermined search engine when the control UI performs a specific action as a result of the determination of the control module. The function module, And a search engine using at least a part of meta information included in the multimedia file as a search keyword. The method of claim 19, wherein at least some of the meta information includes: UI providing apparatus comprising at least one of a title, a producer, or a production time of the multimedia file. A control module for determining whether the control UI in which the message is selected performs a specific action; And And a function module for performing a designated function based on the message when the control UI performs a specific action as a result of the determination of the control module. The function module, Determine whether the selected message corresponds to a web address; If the determination result is a message corresponding to the web address, the web address is browsed. And determining that the selected message is searched using a search engine when the message is not a message corresponding to a web address. The apparatus of claim 21, wherein the UI providing apparatus is provided. Further includes a DNS DB, The function module is a UI providing apparatus for determining whether the selected message is a message corresponding to a web address based on the information stored in the DNS DB. A control module for determining whether the control UI performs a specific action; And And a function module for receiving a message selected based on the specific action from the control module and performing a designated function based on the received message when the control module determines that the specific action is performed. The control module, If the specific action is an action in which the trace of the control UI forms a closed curve, selects a message included in the closed curve, or A UI providing apparatus for selecting a message located below the control UI when the specific action is shaking the control UI from side to side. A control module for determining whether the control UI performs a specific action; And It includes a function module for performing a designated function based on the input message, The control module, If it is determined that the control UI has performed the specific action, activate the program UI, The function module, when a message is input to the activated program UI, performs a designated function based on the input message. If the specific action is a drag, The function module, The UI providing apparatus for performing a designated function based on the message when the control UI of the dragged state is located on the program UI. A control module for determining whether the control UI performs a specific action; And It includes a function module for performing a designated function based on the input message, The control module, If the control UI determines that the specific action, the control UI is changed to the active mode, And when the message is selected by the control UI changed to the active mode, the function module performs a designated function based on the selected message.

Images