RU2635045C2 - Method and device for application execution - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: method and device for application execution includes operations of displaying of the object of interest on the device screen in response to the selection of the object of interest, obtaining of metadata consistent with the object of interest, determination of an associated application associated with the object of interest, execution of the associated application using the metadata as the input value for the associated application and display of the window on the screen indicating the result of associated application execution, performed through the use of metadata.

EFFECT: expanded arsenal of tools.

15 cl, 21 dwg

Description

FIELD OF THE INVENTION

[1] Methods and devices in accordance with exemplary embodiments relate to a method and apparatus for executing an application associated with an object displayed on a device screen.

State of the art

[2] Due to the improvement of multimedia technology and data processing technology, the device has the ability to simultaneously execute many applications and process various types of information. However, since the device has the ability to simultaneously execute many applications, it is difficult for the user to easily select the application that should be used from among the simultaneously executed applications, and to choose the function that should be used from among the various functions of the selected application.

[3] In order to enable the user to effectively receive the information that the user is interested in, there is a need for an application execution technology capable of efficiently executing an application related to a user's interest and effectively presenting a result of an execution regarding a user's interest through an executable application.

SUMMARY OF THE INVENTION

The solution of the problem

[4] One or more exemplary embodiments includes a method and apparatus for displaying an application execution result, such that an associated application associated with an object of interest can be efficiently executed by using metadata consistent with the object of interest that is displayed on the device screen.

Brief Description of the Drawings

[5] The above and / or other aspects should become more apparent and apparent from the following description of embodiments, considered in conjunction with the accompanying drawings, in which:

[6] FIG. 1 is a diagram illustrating a method for displaying an execution result of an associated application associated with an object of interest according to an exemplary embodiment;

[7] FIG. 2 is a flowchart of a method for executing an associated application associated with an object of interest and displaying a result of execution of an associated application, according to an exemplary embodiment;

[8] FIG. 3 illustrates an example table regarding metadata and associated application that are associated with an object of interest;

[9] FIG. 4 illustrates an object of interest and associated applications associated with an object of interest, according to an exemplary embodiment;

[10] FIG. 5 is a flowchart of a method for generating an object of interest, the method being carried out by means of a device according to an exemplary embodiment;

[11] FIG. 6 is a flowchart of a method for mapping an object of interest to an associated application, the method being carried out by means of a device according to an exemplary embodiment;

[12] FIG. 7 illustrates an example in which a device maps an associated application and metadata to an object of interest based on user input, according to an exemplary embodiment;

[13] FIG. 8 is a flowchart of a method for generating a window indicating an execution result of an associated application according to an exemplary embodiment;

[14] FIG. 9 illustrates an example in which the size of a window indicating the result of execution of associated applications is determined according to the number of associated applications associated with the object of interest, according to an exemplary embodiment;

[15] FIG. 10 illustrates an example in which a device adjusts the size of a window indicating the result of execution of associated applications based on user input, according to an exemplary embodiment;

[16] FIG. 11 illustrates an example in which objects of interest are displayed on a lock screen according to an exemplary embodiment;

[17] FIG. 12 is a block diagram of an apparatus according to an exemplary embodiment; and

[18] FIG. 13 is a block diagram of a device according to another embodiment.

The implementation of the invention

[19] According to an aspect of an exemplary embodiment, there is provided a method for displaying an application execution result on a device screen, the method including displaying an object of interest on a device screen, in response to selecting an object of interest; obtaining metadata consistent with the object of interest; determining an associated application associated with an object of interest; executing the associated application by using metadata as an input to the associated application; and displaying, on the screen, a window indicating the result of execution of the associated application executed by using metadata.

[20] An associated application may be associated with an object of interest according to at least one of a category of the object of interest, a metadata element of the object of interest, and metadata of the object of interest.

[21] The method may further include an operation of matching the object of interest with at least one function of the plurality of functions of the associated application, and the operation of executing the associated application may include the operation of performing at least one function that maps to the object of interest.

[22] At least one function of the associated application may be mapped to metadata and an object of interest, and when an object of interest is selected, the execution operation may include an operation to execute the associated application that is mapped to metadata and the object of interest.

[23] After the object of interest is selected, the result of the execution of the associated application can be updated.

[24] The result of the execution of the associated application may be displayed in a window in real time.

[25] Metadata may be updated according to a predetermined period.

[26] A user interface may be provided to map the associated application to the object of interest, and the associated application may be mapped to the object of interest based on user input through the user interface.

[27] The partial area may be selected from the common area of the executable screen of the associated application based on user input, and the selected partial area may be mapped to the object of interest.

[28] The object of interest can be displayed on the device lock screen, and in response to the selection of the object of interest displayed on the lock screen, the device can be unlocked and an associated application matching the object of interest can be executed.

[29] The object of interest can be displayed on at least one of the lock screen, the home screen and the application screen of the device, and based on user input, the object of interest can be moved between the lock screen, the home screen and the application screen.

[30] The category of interest may include at least one of a user, location, multimedia, and a keyword.

[31] When the execution result of the associated application is updated, the image of the object of interest may change.

[32] According to an aspect of an exemplary embodiment, there is provided a device including a storage device configured to store at least one program for a method of displaying an application execution result on a device screen; and a processor configured to implement at least one program, wherein the method includes displaying an object of interest on a device screen; in response to the selection of the object of interest by the device user, obtaining metadata consistent with the object of interest; determining an associated application associated with an object of interest; executing the associated application by using metadata as an input to the associated application; and displaying, on the screen, a window indicating the result of execution of the associated application executed by using metadata.

[33] An associated application may be associated with an object of interest according to at least one of a category of the object of interest, a metadata element of the object of interest, and metadata of the object of interest.

[34] The method may further correlate an object of interest and at least one function of a plurality of functions of the associated application, and the operation of executing the associated application may include an operation of performing at least one function that maps to the object of interest.

[35] At least one function of the associated application may be mapped to metadata and the object of interest, and in response to the selection of the object of interest, the execution operation may include an operation to execute the associated application that is mapped to metadata and the object of interest.

[36] After the object of interest is selected, the result of the execution of the associated application can be updated.

[37] The result of the execution of the associated application may be displayed in a window in real time.

[38] Metadata may be updated according to a predetermined period.

[39] A user interface may be provided in order to map the associated application to the object of interest, and the associated application may be mapped to the object of interest based on user input through the user interface.

[40] The partial area may be selected from the common area of the executable screen of the associated application based on user input, and the selected partial area may be mapped to the object of interest.

[41] The object of interest can be displayed on the device lock screen, and in response to the selection of the object of interest displayed on the lock screen, the device can be unlocked, and an associated application matching the object of interest can be executed.

[42] The object of interest can be displayed on at least one of the lock screen, the home screen and the application screen of the device, and based on user input, the object of interest can be moved between the lock screen, the home screen and the application screen.

[43] The category of interest may include at least one of a user, location, multimedia, and a keyword.

[44] After the execution result of the associated application is updated, the image of the object of interest can change.

[45] According to an aspect of an exemplary embodiment, a permanent computer-readable recording medium having a program recorded thereon for implementing the method is provided.

Optimum Mode for Carrying Out the Invention

[46] Exemplary embodiments are described in more detail below with reference to the accompanying drawings. However, exemplary embodiments can be implemented in many different forms and should not be construed as limited to the exemplary embodiments set forth herein; on the contrary, these exemplary embodiments are provided in such a way that this disclosure is exhaustive and comprehensive and fully conveys the principles of the invention to those skilled in the art. In the description below, known functions or constructions are not described in detail so as not to obscure the exemplary embodiments due to optional details. In addition, throughout the detailed description, like reference numerals in the drawings indicate like elements.

[47] It should also be understood that in the entire detailed description, when an element is referred to as “connected” to another element, the element can be directly connected to another element or electrically connected to another element, while intermediate elements can also be present.

[48] Throughout the detailed description, the term "object of interest" indicates an object displayed on the screen of a device for executing an application according to information of interest to a user. For example, an object of interest may include at least one of an image, icon, and text.

[49] In this detailed description, an object of interest can be classified according to categories. For example, categories of an object of interest may include, but are not limited to, "Person," "Location," "Multimedia," and "Search." In addition, one object of interest may be associated with at least one category.

[50] Throughout the detailed description, the term "metadata associated with an object of interest" indicates data that a user is interested in that is associated with an object of interest. The metadata associated with the object of interest can be, but not limited to, a value that the user enters. The metadata associated with the object of interest may include a read value obtained by the device through the use of the sensor in the device, and various types of data obtained by the device from the external device or external server.

[51] Throughout the detailed description, the term "associated application matching an object of interest" indicates an application that is executed in response to a selection of an object of interest. One object of interest may coincide with at least one associated application. In addition, in response to the selection of the object of interest, the device can execute the associated application based on the metadata of the selected object of interest.

[52] Throughout the detailed description, the term “lock screen” indicates a software screen for unlocking a device. When the device receives the proper user input to unlock the device displaying the lock screen, the device can unlock.

[53] In addition, the term “home screen” indicates, from among the program screens of the device, the main screen that controls the pre-installed operation of the device or executes the pre-installed application from among the applications installed in the device, and controls the pre-installed application. The initial screen may display the icons of some applications from the number of applications installed on the device, the results of application execution, etc.

[54] In addition, the term "application screen" indicates a program screen including a list of applications installed on the device. The application screen may include icons for all applications installed on the device. In addition, the user can select the icon displayed on the application screen to run the application of the selected icon or move the selected icon to the home screen.

[55] Expressions such as "at least one of" preceding the list of items modify the entire list of items and do not modify individual items of the list.

[56] Exemplary embodiments are described in more detail below with reference to the accompanying drawings.

[57] FIG. 1 is a diagram illustrating a method for displaying an execution result of an associated application associated with an object of interest according to an exemplary embodiment.

[58] Referring to FIG. 1 (a), objects of interest can be displayed on the screen of the device 1000, and the user can touch an area of the screen of the device in which one of the objects of interest is displayed. The object of interest may be an icon that includes text and an image, but one or more exemplary embodiments are not limited to this.

[59] Referring to FIG. 1 (b), in response to a user selecting one of the objects of interest displayed on the screen of the device 1000, the device 1000 may receive metadata associated with the selected object of interest, and may execute one or more associated applications associated with the selected object of interest based on metadata . In addition, the device 1000 may display, on the screen of the device 1000, a window that displays the real-time execution results of the associated applications. A window that displays real-time execution results of associated applications may include multiple subwindows. In addition, each of the subwindows can display the result of a relatively partial area selected from the full area of the executable screen of the associated application.

[60] FIG. 2 is a flowchart of a method for executing an associated application associated with an object of interest and displaying a result of execution of an associated application, according to an exemplary embodiment.

[61] In step S200, the device 1000 displays the object of interest on the screen of the device 1000. The object of interest can be preformed by the device 1000, and the associated application and metadata that are associated with the object of interest can be predefined.

[62] An object of interest may include at least one of text, icon, and image. For example, if the object of interest is used to provide information regarding the location of "Paris (Paris)" to the user, the object of interest may be an icon associated with the location information, the image of Paris and the text "Paris".

[63] The object of interest can be displayed on at least one of the lock screen, the home screen and the application screen of the device 1000. In this case, the device 1000 can pre-determine which of the lock screen, the home screen and the application screen should be displayed . In addition, device 1000 can move an object of interest between the lock screen, the home screen, and the application screen.

[64] In step S210, in response to the selection of the object of interest, the device 1000 obtains metadata associated with the object of interest. The device 1000 may predefine metadata elements associated with the object of interest. The metadata associated with the object of interest can be updated according to a predefined period.

[65] When an object of interest is selected, the device 1000 may check the metadata elements associated with the object of interest and may collect real-time metadata values. In this case, the metadata may be a plurality of pieces of data regarding the device 1000 and the current situation of the device 1000. For example, the metadata may include, but not limited to, many pieces of data indicating the location of the device 1000, an application running in the device 1000, a user schedule devices 1000, temperature and time.

[66] If the category of the object of interest indicates “People,” the metadata elements associated with the object of interest may include “User”, “Phone”, and “Email” (E-mail). In addition, the device 1000 may receive, as a metadata value for the User metadata element, another user’s name and social network communication service identification information (SNS identifier) of another user. In addition, device 1000 may obtain another user's telephone number as the metadata value for the Phone metadata element.

[67] If the category of the object of interest indicates "Location", the metadata element associated with the object of interest may include "Location". In this case, the device 1000 may obtain a global positioning system (GPS) value of the current location of the device 1000 as the metadata value for the Location metadata element.

[68] However, one or more exemplary embodiments is not limited to this, and metadata associated with an object of interest may not be collected in real time. For example, metadata associated with an object of interest may be a fixed value that has been previously entered by the user.

[69] Regardless of whether an object of interest is selected or not, device 1000 can update metadata according to a predetermined period. In this case, the device 1000 can perform the function of collecting metadata in the background of the device 1000. In addition, when the object of interest is formed, the function of collecting metadata associated with the object of interest can be automatically activated.

[70] In step S220, the device 1000 determines an application that matches the object of interest. When the device 1000 forms an object of interest, the device 1000 can associate the application and the object of interest. Alternatively, after the object of interest is selected, device 1000 may determine an associated application that matches the object of interest.

[71] The associated application may automatically match the object of interest based on at least one of the category of the object of interest, metadata elements associated with the object of interest, and metadata. For example, if the category of the object of interest indicates "People" and the metadata elements associated with the object of interest correspond to "User" and "Phone", a phone book application, a messaging application and an SNS application can be defined as matching the object of interest. As another example, if the category of the object of interest indicates “People,” and the metadata element associated with the object of interest corresponds to “Email,” the mail application can be defined as matching the object of interest.

[72] The associated application may match the object of interest based on user input. If the device 1000 forms an object of interest, the device 1000 can display a list of associated applications to be selected by the user, and can map the object of interest to at least one application that is selected by the user. In this case, the list of associated applications may include titles of associated applications recommended by device 1000 based on the category of the object of interest, the metadata element associated with the object of interest, and metadata.

[73] In step S230, the device 1000 executes the associated application determined in step S220 by using metadata. The device 1000 may execute the associated application determined in step S220 by using metadata as input to the application. For example, if the metadata of an object of interest corresponds to “010-1234-5678,” and the associated application associated with the object of interest includes a phone book application and a messaging application, and device 1000 can run a phone book application and a messaging application, and can enter metadata “010-1234-5678” into the phone book application and the messaging application. In addition, device 1000 may search for content information in an associated application by using metadata as an input to the application. In addition, the device 1000 may search for a functional menu of an associated application by using metadata as an input value.

[74] In addition, at least one function among the functions of the associated application may be pre-installed with the ability to be performed according to the selection of the object of interest. In this case, the device 1000 can only perform at least one pre-installed function of the associated application.

[75] In step S240, the device 1000 displays a window indicating the result of the execution of the associated application. The device 1000 may execute a plurality of associated applications and may display, on the screen of the device 1000, a window including a plurality of windows, which indicate the results of the execution of the plurality of associated applications, respectively. For example, if the associated applications associated with the object of interest correspond to a phone book application and a messaging application, the device 1000 may run a phone book application and a messaging application and may display a window including subwindows indicating the results of running the phone book application and the messaging application, respectively.

[76] In addition, at least one function among the functions of the associated application may be pre-installed with the ability to be performed according to the selection of the object of interest. In this case, the device 1000 may form a subwindow indicating the result of at least one pre-installed function of the associated application.

[77] The sizes of the subwindow and window can be adjusted according to the number of associated applications and the amount of data included in the execution of the associated application. Alternatively, the dimensions of the subwindow and window can be adjusted based on drag and drop input by the user.

[78] The result of the execution of the associated application may include data running on the device 1000, data received from another device over the network, and data collected via the World Wide Web or the Internet (hereinafter, the “web”).

[79] FIG. 3 illustrates an example table regarding metadata and associated application that are associated with an object of interest.

[80] Referring to FIG. 3, a table including information regarding metadata and an associated application that are associated with an object of interest may include a field of interest 30, a category field 32, a metadata element field 34, a metadata field 36, and an associated application field 38.

[81] In the field 30 of objects of interest, the identifiers of the objects of interest can be recorded. In addition, a plurality of pieces of link information used to retrieve objects of interest from a storage device can be recorded in the field 30 of objects of interest.

[82] In the category field 32, the category of the object of interest can be recorded. A category of interest may include, but not limited to, People, Location, Multimedia, and Search.

[83] In the field 34 metadata elements can be recorded metadata elements associated with the object of interest. For example, if the category of the object of interest indicates “People,” the metadata element associated with the object of interest may include “User,” “Phone,” and “Email.” As another example, if the category of the object of interest indicates “Location,” the metadata element for metadata associated with the object of interest may include “Location”. As another example, if the category of the object of interest indicates “Multimedia,” the metadata element associated with the object of interest may include “Music” and “Movie”. As another example, if the category of the object of interest indicates “Search,” the metadata element associated with the object of interest may include “News,” “Books,” and “Shopping.”

[84] A plurality of metadata fragments may be recorded in the metadata field 36 according to metadata elements that are obtained by the device 1000. For example, if the metadata element indicates “User”, the metadata may include another user's name and SNS. As another example, if the metadata element matches “Phone,” the metadata may include the phone number of another user. As another example, if the metadata element matches "Email", the metadata may include another user's mailing address.

[85] If the metadata element corresponds to "Location", the metadata may include the name of the area and the GPS value indicating the location of the device 1000. If the metadata element corresponds to "Music", the metadata may include the name of the song and the name of the artist.

[86] If the metadata element corresponds to "News," "Books," or "Purchases," the metadata may include a predefined keyword value.

[87] One or more metadata values recorded in the metadata field 36 may be fixed values that are preset by the user. However, exemplary embodiments are not limited to this, and the metadata values recorded in the metadata field 36 can be obtained in real time by the device 1000. For example, if the category of the object of interest indicates “People,” the device 1000 can record the name, SNS ID, telephone the number and mailing address of another user with whom the user often contacts, in the 36 metadata field. As another example, if the category of interest indicates “Location”, device 1000 may receive a real-time GPS value indicating the current location of device 1000 and may record the GPS value in metadata field 36.

[88] As another example, if the category of interest shows “Multimedia”, device 1000 may determine music or a movie to be recommended to the user based on information regarding music or a movie that the user plays frequently or recently. The device 1000 may record metadata regarding a specific music and movie to be recommended in a metadata field 36. In this case, information regarding music or a movie that a user plays frequently or recently, may include information regarding a genre, director, actors or actresses, etc. music or film, and context information (e.g., location, temperature, time, etc.) in which the user plays the music or film.

[89] If the category of interest indicates “Search,” device 1000 may record a keyword regarding a user's recent interest in metadata field 36. In this case, the keyword to be recorded in the metadata field 36 may be determined based on the user's call history, the user's search history, the use history of the user's content, or the user's shopping history. The keyword can be entered into an associated application (e.g., search application, web browser, e-book reader, price comparison application, etc.) and therefore can be used by the device 1000 when searching for predetermined information. In addition, the keyword category value may be entered into the associated application.

[90] In the associated application field 38, the type or value of the identifier of the associated application corresponding to the object of interest can be recorded. In addition, at least one of a category of an object of interest, a metadata element of an object of interest, and metadata of an object of interest and an associated application associated with the object of interest may be recorded in the associated application field 38.

[91] For example, if the category of the object of interest indicates “People,” and the metadata element of the object of interest indicates “User” or “Phone,” a phone book application, a messaging application, an SNS application, and a content sharing application may recorded in field 38 of the associated applications. If the category of interest of the object indicates "Location", the application using the location information can be recorded in the field 38 of the associated applications. For example, a weather application, a watch application, a map application, and a navigation application may be recorded in the associated application field 38.

[92] The associated application associated with the object of interest can be defined by the user, but one or more exemplary embodiments are not limited to this. The device 1000 may recommend an associated application based on the category of the object of interest, the metadata element of the object of interest, and the metadata of the object of interest. Alternatively, device 1000 may select some associated applications recommended by the user.

[93] At least one function among the functions of the associated application may coincide with the object of interest. For example, among the functions of a messaging application, the function for chatting with a device of a particular user may coincide with the object of interest. In this case, the chat window for chatting with a specific user can be included in the window as a result of running the messaging application.

[94] For example, a partial area from an executable screen of an associated application that is selected by a user may coincide with an object of interest. In this case, the execution result displayed in the partial area selected by the user can be included in the window as the result of the execution of the associated application.

[95] FIG. 4 illustrates an object of interest 40 and associated applications 42, 44, 46, and 48 associated with an object of interest 40, according to an exemplary embodiment.

[96] Referring to FIG. 4, the object of interest 40 may coincide with the associated applications 42, 44, 46, and 48. The object of interest 40 may be displayed on the screen of the device 1000 to help the user obtain information related to the Paris location.

[97] The category of the object of interest 40 may indicate that the "Location" and the location "Paris" and "GPS value of Paris" correspond to the metadata associated with the object of interest 40. For example, when the object of interest 40 is selected, the device 1000 may execute the mapping application 44 and may mark the location of Paris on a map that is provided by the mapping application 44 by using the GPS value of Paris as an input value.

[98] As another example, when an object of interest 40 is selected, the device 1000 may execute a music playback application 46, may scan music related to Paris by using Paris as an input to a search application to find related music, and then may play music.

[99] FIG. 5 is a flowchart of a method for generating an object of interest, the method being carried out by device 1000 according to an exemplary embodiment.

[100] In step S500, the device 1000 selects an associated application to be mapped to the object of interest. The device 1000 may select an associated application to be mapped to an object of interest based on an executable application screen or user input to the application. For example, when a user touches an application icon for a predetermined period of time, a menu for selecting an associated application may be displayed, and based on user input in the menu, device 1000 may define the application as an associated application. As another example, when a user selects a category of interest to an object, one or more applications associated with the selected category can be recommended by device 1000, and based on user input to select at least one application from among one or more recommended applications, the device 1000 may define an associated application. However, one or more exemplary embodiments is not limited to this, and device 1000 may provide, to a user, various user interfaces for defining an associated application.

[101] In step S510, the device 1000 selects one or more metadata elements to be mapped to the object of interest. In response to selecting an associated application, device 1000 may display a selection menu for selecting metadata items associated with the associated application. Based on user input in the selection menu, device 1000 may select a predefined metadata item. For example, when a user selects a category of interest to an object, one or more metadata elements associated with the selected category can be recommended by device 1000, and based on user input, device 1000 can select at least one metadata element from among one or more recommended elements metadata. However, one or more exemplary embodiments is not limited to this, and device 1000 may provide, to a user, various user interfaces for defining metadata elements.

[102] In step S520, the device 1000 generates an object of interest that matches the selected associated application and the selected metadata element. The device 1000 may generate an object of interest and may map the object of interest to the selected associated application and the selected metadata element.

[103] An object of interest may include an icon of at least one associated application associated with the object of interest. In addition, the object of interest may include text indicating at least one of a category of the object of interest, a metadata element, and metadata associated with the object of interest. In addition, the object of interest may include an image indicating a partial area of the execution screen of the associated application, which is performed by using metadata as an input value. For example, device 1000 may correlate an object of interest with a phone book application and the People category.

[104] In addition, device 1000 may correlate an object of interest with metadata associated with the object of interest. For example, if the object of interest is associated with a connection with another Amanda user, device 1000 may match the object of interest with Amanda, which is the name of another user. As another example, if the object of interest is connected to another Amanda user, the device 1000 may map the object of interest to a phone book application, messaging application, and SNS application.

[105] The device 1000 may store the object of interest in the storage device of the device 1000. However, one or more exemplary embodiments is not limited to this, and the device 1000 may store the object of interest in another device or on an external server. For example, device 1000 may store an object of interest on a service providing server (not shown) and may receive a service associated with the object of interest from a service providing server.

[106] In step S530, the device 1000 displays an object of interest on the screen. The device 1000 may display an object of interest on at least one of the lock screen, the home screen, and the application screen. If the user touches the object of interest displayed on the lock screen, the device 1000 can be unlocked, and the associated application associated with the object of interest can be executed.

[107] In step S540, the device 1000 updates the object of interest. The metadata consistent with the object of interest and the result of the execution of the associated application matching the object of interest can be updated in real time. Accordingly, the device 1000 can update at least one of the image, icon, and text that configure the object of interest. For example, if the object of interest is operable to run an application associated with the current location of the device 1000, the name of the region of the current location of the device 1000 may be included in the object of interest. In addition, when the current location of the device 1000 changes, the name of the region included in the object of interest can be updated. In addition, when the execution result of the associated application is updated, the image of the object of interest may change. For example, the image of the object of interest may correspond to the image obtained by capturing a window displaying the result of the execution of the associated application, and therefore, when the result of the execution of the associated application is updated, the image of the object of interest can also be updated.

[108] FIG. 6 is a flowchart of a method for mapping an object of interest to an associated application, the method being carried out by device 1000, according to an exemplary embodiment.

[109] In step S600, the device 1000 selects at least one function of the associated application, which is selected by the user. The device 1000 may select at least one function from among the functions of the associated application in order to map at least one function to the object of interest. For example, if the associated application is a map application that provides a map search function, a bus search function, and a metro search function, the device 1000 may select a map application search function on a map to match the map search function to an object of interest.

[110] In step S610, the device 1000 selects a partial region from the full area of the executable screen of the associated application. The device 1000 may select a partial area from an executable screen of an associated application, based on a tap and drag input by a user. For example, if the associated application is a map application, and the executable screen of the map application includes a field for searching on a map, a field for a map for performing a search, and a field for obtaining additional information regarding a point of interest (POI) on the map, device 1000 may select a field to search on the map in the executable screen of the map application. As another example, if the associated application is a video playback application, and the executable screen of the video playback application includes an area in which the playback video is displayed, and an area in which the video playback is controlled, the device 1000 can select only the area in which displays the video being played.

[111] In step S620, the device 1000 matches at least one of the selected associated application of the at least one selected function and the selected partial area to the object of interest. After the object of interest is selected by the user, the full area or partial area of the executable screen of the associated application may be displayed, or at least one selected function of the associated application may be performed.

[112] FIG. 7 illustrates an example in which device 1000 maps an associated application and metadata to an object of interest based on user input, according to an exemplary embodiment.

[113] Referring to FIG. 7 (a), the executable screen of the phone book application may be displayed on the screen of the device 1000. Based on the touch input and drag by the user, the device 1000 may select a partial area 70 from the executable screen of the phone book application. After the partial region 70 is selected, the device 1000 may display a menu 72 for selecting a category of interest.

[114] After a predefined category (for example, the "People" category) is selected from menu 72 to select the category of the object of interest, as illustrated in FIG. 7 (b), the device 1000 may display a menu 74 for selecting metadata elements of a subject of interest.

[115] After a predefined metadata element (for example, the “User” metadata element) is selected from menu 74 to select metadata elements of the object of interest, as illustrated in FIG. 7 (c), device 1000 may display a window 76 for receiving metadata input. A user may enter another user name (for example, the name "Amanda") in window 76 to accept metadata input.

[116] Accordingly, the device 1000 may generate an object of interest that matches a partial area 70 selected from an executable screen of the phone book application, the People category, the User metadata element, and the Amanda metadata.

[117] After the generated object of interest is selected, the device 1000 may display a window that corresponds to a partial area 70 selected from the executable screen of the phone book application. In addition, only the required Amanda call function can be activated from among the functions of the phone book application.

[118] FIG. 8 is a flowchart of a method for generating a window indicating an execution result of an associated application according to an exemplary embodiment.

[119] In step S800, the device 1000 executes a plurality of associated applications that match the object of interest. For example, based on the table shown in FIG. 3, device 1000 may determine associated applications matching an object of interest, and then may execute matching associated applications.

[120] If at least one function of the associated application is mapped to an object of interest, device 1000 may activate only at least one function of the associated application. In addition, if the partial area of the executable screen of the associated application is mapped to the object of interest, the device 1000 can only activate a function associated with the partial area of the executable screen of the associated application.

[121] In step S810, the device 1000 forms a plurality of subwindows indicating the results of the execution of associated applications, respectively. For example, device 1000 may determine the size of the subwindow based on the amount of data included in the execution result of the associated application and the size of the image indicating the execution result. As another example, device 1000 may determine the size of a subwindow based on how often the associated application runs. However, one or more exemplary embodiments is not limited to this, and the device 1000 may generate a subwindow indicating the result of the execution of the associated application according to the determined size of the subwindow.

[122] In step S820, the device 1000 determines the size of the main window. The device 1000 may determine the size of the main window based on the number and size of the window sills.

[123] In step S830, the device 1000 determines the location of the window sill. The device 1000 can determine the location of the windowsill so that the windows can be placed in the main window according to a predefined order. For example, based on how often the associated application runs, device 1000 may determine at what location the subwindow should be displayed in the main window.

[124] In step S840, the device 1000 places subwindows in a specific order in the main window. The device 1000 may display the subwindows at the locations determined in step S830 in the main window.

[125] FIG. 9 illustrates an example in which the size of a window indicating the result of execution of associated applications is determined according to the number of associated applications associated with the object of interest, according to an exemplary embodiment.

[126] Turning to FIG. 9 (a), a first object of interest 90, a second object of interest 91, and a third object of interest 92 may be displayed on the screen of the device 1000. In this regard, a user of the device 1000 may touch a screen area of the device 1000 in which the first object of interest 90 is displayed.

[127] As illustrated in FIG. 9 (b), when two associated applications are associated with the first object of interest 90, a window 93 indicating the result of two associated applications can be displayed in a partial area of the screen of the device 1000. A window 93 indicating the result of two associated applications can include two subwindows that are placed in a specific order according to a pre-established standard. Since the first object of interest 90 concerns the user, the result of the execution of the two associated applications can be updated in real time.

[128] As illustrated in FIG. 9 (b), since a window 93 is displayed in a partial area of the screen of the device 1000, the locations of the second object of interest 91 and the third object of interest 92 may change. The second object of interest 91 and the third object of interest 92 can be displayed in the area in the full area of the screen of the device 1000, while the window 93 is not displayed in the area.

[129] When one of the two subwindows in the window 93 is selected, the screen of the associated application that corresponds to the selected subwindow may be displayed in the full area of the screen of the device 1000.

[130] As illustrated in FIG. 9 (c), when four associated applications are associated with the first object of interest 90, a window 94 indicating the result of the execution of the four associated applications may be displayed in the full area of the screen of the device 1000. A window 94 indicating the result of the execution of the four associated applications may include four subwindows that are placed in a specific order according to a pre-established standard.

[131] When one of the four subwindows in the window 94 is selected, the screen of the associated application that corresponds to the selected subwindow may be displayed in the full area of the screen of the device 1000.

[132] FIG. 10 illustrates an example in which device 1000 adjusts the size of a window indicating the result of execution of associated applications based on user input, according to an exemplary embodiment.

[133] Turning to FIG. 10 (a), the first object of interest 90, the second object of interest 91, and the third object of interest 92 may be displayed on the screen of the device 1000. In this regard, the user of the device 1000 can interact with the screen of the device 1000 so as to touch and drag the edge of the first object of interest 90. As illustrated in FIG. 10 (b) and 10 (c), when the edge of the first object of interest 90 is dragged, a window 95 indicating the result of the execution of associated applications associated with the first object of interest 90 can be gradually expanded.

[134] In more detail, referring to FIG. 10 (b), since the edge of the first object of interest 90 is touched and dragged, the area of the first object of interest 90 is expanded so that a window 95 may be displayed indicating the result of the execution of associated applications associated with the first object of interest 90. Window 95 may be displayed in a partial area of the screen devices 1000 and then can be gradually deployed. Window 95 may include two subwindows that are placed in a specific order according to a predefined standard.

[135] Referring to FIG. 10 (c), since the edge of the first object of interest 90 is continuously dragging, the size of window 95 can be continuously expanded, and then window 95 can be displayed in the full area of the screen of device 1000. Window 95 can include four subwindows that are arranged in a specific order according to a preliminary established standard.

[136] FIG. 11 illustrates an example in which objects of interest are displayed on a lock screen according to an exemplary embodiment.

[137] Turning to FIG. 11 (a), the first object of interest 90, the second object of interest 91, and the third object of interest 92 may be displayed on the lock screen of the device 1000. In this regard, the user of the device 1000 may touch the screen position of the device 1000 in which the first object of interest 90 is displayed.

[138] Turning to FIG. 11 (b), since the first object of interest 90 displayed on the lock screen is user selectable, the device 1000 can be unlocked, and a window indicating the execution result of the associated applications associated with the first object of interest 90 can be displayed on the initial screen of the device 1000. Since the first the object of interest 90 is selected by the user, the result of the execution of associated applications can be updated in real time.

[139] FIG. 12 is a block diagram of an apparatus 1000 according to an exemplary embodiment.

[140] As illustrated in FIG. 12, the device 1000 may include a display unit 1100, a user input unit 1200, a memory 1300, a communication unit 1400, and a control unit 1500 (hereinafter, also referred to as “processor 1500”).

[141] The display unit 1100 is controlled by the control unit 1500 and thereby displays, on the screen of the device 1000, an object of interest and a window indicating the execution result of the associated application associated with the object of interest.

[142] The user input unit 1200 receives user input with respect to the device 1000. The user input unit 1200 may receive touch input of the user with respect to the screen of the device 1000 and user input with respect to the button of the device 1000.

[143] The storage device 1300 stores a plurality of pieces of data that are used by the device 1000 to form the object of interest and display the object of interest and a window indicating the execution result of the associated application associated with the object of interest.

[144] The communication unit 1400 exchanges, with an external device (not shown) or an external server (not shown), a plurality of pieces of data that are used by the device 1000 to form the object of interest and display the object of interest and a window indicating the result of the execution of the associated application associated with the object of interest.

[145] The control unit 1500 controls the operations of the device 1000. The control unit 1500 can control the display unit 1100, the user input unit 1200, the storage device 1300, and the communication unit 1400 so that the device 1000 can form an object of interest and can display an object of interest and a window, indicating the result of the execution of the associated application associated with the object of interest on the screen.

[146] In more detail, the control unit 1500 controls the display unit 1100 so as to display an object of interest on the screen of the device 1000. The object of interest can be preformed by the control unit 1500, and the associated application and metadata that are associated with the object of interest can be preliminarily installed.

[147] An object of interest may include at least one of an image, an icon, and text. For example, if the object of interest is used to provide information about the location of Paris to the user, the object of interest can be configured from an icon indicating that the object of interest is location information, images of Paris and the text Paris.

[148] An object of interest may be displayed on at least one of the lock screen, the home screen, and the application screen of the device 1000. In this case, the control unit 1500 may predetermine which screen from among the lock screen, the home screen, and the application screen should The object of interest is displayed. In addition, the control unit 1500 can move an object of interest between the lock screen, the initial screen, and the application screen based on user input.

[149] Since the object of interest is selected, the control unit 1500 obtains metadata associated with the object of interest. The control unit 1500 may predetermine metadata elements associated with the object of interest.

[150] After the object of interest is selected, the control unit 1500 may check the metadata elements associated with the object of interest, and may collect real-time metadata values based on the verified metadata elements.

[151] If the category of the object of interest indicates “People,” the metadata elements associated with the object of interest may include “User”, “Phone”, and “Email”. In addition, the control unit 1500 may obtain, as a metadata value for the "User" metadata element, another user name and another user SNS. In addition, the control unit 1500 may obtain another user's telephone number as the metadata value for the Phone metadata element.

[152] If the category of the object of interest indicates "Location," the metadata element associated with the object of interest may include "Location." In this case, the control unit 1500 may obtain the GPS value of the current location of the device 1000 as the metadata value for the Location metadata element.

[153] However, one or more exemplary embodiments is not limited to this, and metadata associated with an object of interest may not be collected in real time. For example, metadata associated with an object of interest may be a fixed value that has been previously entered by the user.

[154] The control unit 1500 determines an associated application that matches the object of interest. When the control unit 1500 forms an object of interest, the control unit 1500 can map the associated application and the object of interest. Alternatively, after the object of interest is selected, the control unit 1500 may determine that the associated application matches the object of interest.

[155] The associated application may automatically match the object of interest based on at least one of the category of the object of interest, metadata elements associated with the object of interest, and metadata. For example, if the category of the object of interest indicates "People" and the metadata elements associated with the object of interest correspond to "User" and "Phone", the phone book application, the messaging application, and the SNS application may match the one of interest object. As another example, if the category of the object of interest indicates “People,” and the metadata element associated with the object of interest corresponds to “Email,” the mail application may match the object of interest.

[156] The associated application may match the object of interest based on user input. After the control unit 1500 forms an object of interest, the control unit 1500 can display a list of associated applications to be selected by the user, and can map the object of interest to at least one application that is selected by the user. In this case, the list of associated applications may include headers of associated applications recommended by the control unit 1500, based on the category of the object of interest, the metadata element associated with the object of interest, and metadata.

[157] The control unit 1500 executes the associated application through the use of metadata. The control unit 1500 may execute the associated application by using metadata as an input to the associated application. For example, if the metadata of the object of interest corresponds to “010-1234-5678,” and the associated application associated with the object of interest includes a phone book application and a messaging application, the control unit 1500 may execute a phone book application and a messaging application, and can enter metadata “010-1234-5678” into the phone book application and the messaging application.

[158] In addition, at least one function from among the functions of the associated application may be pre-installed with the ability to be executed after the object of interest is selected. In this case, the control unit 1500 may perform only at least one pre-installed function of the associated application.

[159] The control unit 1500 controls the display unit 1100 in such a way as to display a window including the result of the execution of the associated application. The control unit 1500 may execute a plurality of associated applications and may display, on the screen of the control unit 1500, a window including a plurality of subwindows that indicate the results of the execution of the plurality of associated applications, respectively. For example, if the associated application associated with the object of interest corresponds to the phone book application and the messaging application, the control unit 1500 may execute the phone book application and the messaging application and may display a window including subwindow, indicating the results of a phone book application and a messaging application, respectively.

[160] In addition, at least one function from among the functions of the associated application may be pre-installed with the ability to be executed after the object of interest is selected. In this case, the control unit 1500 may form a subwindow indicating the result of at least one pre-installed function of the associated application.

[161] The dimensions of the subwindow and window can be adjusted according to the number of associated applications and the amount of data included in the execution of the associated application. Alternatively, the dimensions of the subwindow and window can be adjusted based on drag and drop input by the user.

[162] The control unit 1500 may generate an object of interest that matches the selected associated application and the selected metadata element. In more detail, the control unit 1500 selects an associated application to be mapped to the object of interest. The control unit 1500 may select an associated application to be mapped to the object of interest based on the executed application screen or user input relative to the application icon.

[163] The control unit 1500 selects one or more metadata elements to be mapped to the object of interest. When the associated application is selected, the control unit 1500 may display a selection menu for selecting metadata items associated with the associated application on the screen. Based on user input regarding the selection menu, the control unit 1500 may select a predetermined metadata item.

[164] The control unit 1500 forms an object of interest that matches the selected associated application and the selected metadata element. The control unit 1500 may generate an object of interest configured from at least one of the image, icon, and text, and may map the object of interest to the selected associated application and the selected metadata element. In addition, the control unit 1500 may correlate the object of interest and metadata associated with the object of interest.

[165] The control unit 1500 displays an object of interest on the screen. The control unit 1500 may control the display unit 1100 so as to display an object of interest on at least one of the lock screen, the home screen, and the application screen. If the object of interest displayed on the lock screen is selected by the user, the control unit 1500 can be unlocked, and the associated application associated with the object of interest can be executed.

[166] The control unit 1500 updates the object of interest. The metadata consistent with the object of interest and the result of the execution of the associated application matching the object of interest can be updated in real time. Accordingly, the control unit 1500 may update at least one of the image, icon, and text that configure the object of interest.

[167] The control unit 1500 may correlate an object of interest with at least one function of the associated application and a partial area of the executable screen of the associated application. In more detail, the control unit 1500 selects at least one function of the associated application. The control unit 1500 may select at least one function from among the functions of the associated application in order to map at least one function to the object of interest.

[168] The control unit 1500 selects a partial area from the full area of the executable screen of the associated application. The control unit 1500 may select a partial area from the executable screen of the associated application, based on input of a touch and drag by the user.

[169] The control unit 1500 maps at least one of the associated application of the at least one function and partial area to the object of interest. After that, in response to the selection of the object of interest, the full area or partial area of the executed screen of the associated application may be displayed, or at least one function of the associated application may be performed.

[170] The control unit 1500 may generate a window indicating the result of the execution of the associated application. In more detail, the control unit 1500 executes a plurality of associated applications that match the object of interest. For example, based on the table shown in FIG. 3, the control unit 1500 may check associated applications matching an object of interest, and may execute verified associated applications.

[171] If at least one function of the associated application is mapped to an object of interest, the control unit 1500 may activate only at least one function of the associated application. In addition, if the partial area of the executable screen of the associated application is mapped to the object of interest, the control unit 1500 can only activate a function associated with the partial area of the executable screen of the associated application.

[172] The control unit 1500 generates a plurality of subwindows indicating the results of the execution of associated applications, respectively. For example, the control unit 1500 may determine the size of the subwindow, based on the amount of data included in the execution result of the associated application and the size of the image indicating the execution result. As another example, the control unit 1500 may determine the size of the subwindow based on how often the associated application runs. However, exemplary one or more embodiments are not limited to this, and the control unit 1500 may form a subwindow indicating the result of the execution of the associated application according to the determined size of the subwindow.

[173] The control unit 1500 determines the size of the main window. The control unit 1500 may determine the size of the main window based on the number and size of the window sills.

[174] The control unit 1500 determines the location of the window sill. The control unit 1500 may determine the location of the windows so that the windows can be placed in the main window according to a predefined order. The control unit 1500 places subwindows in a specific order in the main window.

[175] FIG. 13 is a block diagram of an apparatus 1000 according to another exemplary embodiment.

[176] The mobile communication unit 1001 performs call setup, data transmission, and the like. with a base station through a cellular network, for example, through a third generation (3G) or fourth generation (4G) network. The communication subunit 1002 performs a function for short-range communication, for example, using Bluetooth or NFC technology. Broadcast unit 1003 receives a digital multimedia broadcast (DMB) signal.

[177] The camera unit 1004 includes a lens and optical elements used to capture a still image or a moving image.

[178] The sensor unit 1005 may include a gravity sensor for sensing the motion of the host device 1000, a brightness sensor for sensing a light intensity, a proximity sensor for sensing a person’s proximity, a motion sensor for sensing a person’s motion, and the like.

[179] The GPS receiving unit 1006 receives a GPS signal from a satellite. By using the GPS signal, various services can be provided to the user.

[180] The I / O unit 1010 provides an interface for an external device or person and includes a button 1011, a microphone 1012, a speaker 1013, a vibrating electric motor 1014, a connector 1015, and a keypad 1016.

[181] The touch screen 1018 receives touch input by a user. The touch screen controller 1017 transmits to the control unit 1050 (also called a "processor") a touch input that is input through the touch screen 1018. The power unit 1019 is connected to a battery or an external power source in order to supply power to the device 1000.

[182] The control unit 1050 can execute programs stored in the storage device 1060, so that the device 1000 can generate an object of interest and can display the object of interest and the execution result of the associated application associated with the object of interest.

[183] Programs stored in memory 1060 may be divided into multiple modules according to their functions. In other words, the programs stored in the storage device 1060 can be divided into a mobile communication module 1061, a Wi-Fi module 1062, a Bluetooth module 1063, a DMB module 1064, a camera module 1065, a sensor module 1066, a GPS module 1067, moving picture reproducing module 1068, audio reproducing module 1069, power supply module 1070, touch screen control module 1071, user interface (UI) module 1072, application module 1073, and the like.

[184] An object of interest can be displayed on at least one of the lock screen, the home screen and the application screen of the device 1000. In this case, the application module 1073 can pre-determine which screen from among the lock screen, the home screen and the application screen should The object of interest is displayed. In addition, application module 1073 can move an object of interest between the lock screen, the start screen, and the application screen.

[185] After the object of interest is selected, application module 1073 obtains metadata associated with the object of interest. Application module 1073 may predefine metadata elements associated with an object of interest.

[186] After the object of interest is selected, the application module 1073 can check the metadata elements associated with the object of interest, and can collect real-time metadata values based on the verified metadata elements.

[187] The application module 1073 defines an associated application that matches an object of interest. After the application module 1073 generates an object of interest, the application module 1073 can map the associated application and the object of interest. Alternatively, after the object of interest is selected, application module 1073 may determine an associated application matching the object of interest.

[188] The application module 1073 executes the associated application through the use of metadata. An application module 1073 can execute an associated application by using metadata as an input value.

[189] In addition, at least one function among the functions of the associated application may be pre-installed with the ability to be performed according to the selection of the object of interest. In this case, the application module 1073 can only perform at least one pre-installed function of the associated application.

[190] The application module 1073 displays a window including the result of the execution of the associated application. The application module 1073 can execute a plurality of associated applications and can display, on the screen of the application module 1073, a window including a plurality of subwindows that indicate the results of the execution of the plurality of associated applications, respectively.

[191] In addition, at least one function among the functions of the associated application may be pre-installed with the ability to execute according to when the object of interest is selected. In this case, the application module 1073 may generate a subwindow indicating the result of at least one pre-installed function of the associated application.

[192] The dimensions of the subwindow and window can be adjusted according to the number of associated applications and the amount of data included in the execution of the associated application. Alternatively, the dimensions of the subwindow and window can be adjusted based on drag and drop input by the user.

[193] The application module 1073 may generate an object of interest that matches the selected associated application and the selected metadata element. In more detail, application module 1073 selects an associated application to be mapped to the object of interest. The application module 1073 may select an associated application to be mapped to an object of interest based on an executable application screen or user input relative to an application icon.

[194] The application module 1073 selects one or more metadata elements to be mapped to the object of interest. After the associated application is selected, the application module 1073 may display a selection menu for selecting metadata items associated with the associated application on the screen. Based on user input regarding the selection menu, application module 1073 can select a predefined metadata item.

[195] The application module 1073 generates an object of interest that matches the selected associated application and the selected metadata element. Application module 1073 may generate an object of interest configured from at least one of an image, icon, and text, and may map the object of interest to a selected associated application and a selected metadata element. In addition, application module 1073 can map an object of interest to metadata associated with the object of interest.

[196] The application module 1073 displays an object of interest on a screen. An application module 1073 may display an object of interest on at least one of the lock screen, the home screen, and the application screen. If the object of interest displayed on the lock screen is selected by the user, the application module 1073 can be unlocked, and the associated application associated with the object of interest can be executed.

[197] The application module 1073 updates the object of interest. The metadata consistent with the object of interest and the result of the execution of the associated application matching the object of interest can be updated in real time.

[198] Application module 1073 can map an object of interest to at least one function of the associated application and a partial area of the executable screen of the associated application. In more detail, application module 1073 selects at least one function of an associated application. Application module 1073 may select at least one function from among the functions of the associated application in order to map at least one function to an object of interest.

[199] The application module 1073 selects a partial region from the full execution area of the associated application screen. The application module 1073 can select a partial area from the executable screen of the associated application, based on a tap and drag input by the user.

[200] The application module 1073 maps at least one of the associated application of at least one function and partial region to an object of interest. After that, in response to the selection of the object of interest, the full area or partial area of the executed screen of the associated application may be displayed, or at least one function of the associated application may be performed.

[201] The application module 1073 may generate a window indicating the result of the execution of the associated application. In more detail, the control unit 1500 executes a plurality of associated applications that match the object of interest.

[202] If at least one function of the associated application is mapped to an object of interest, application module 1073 can only activate at least one function of the associated application. In addition, if the partial area of the executable screen of the associated application is mapped to the object of interest, the application module 1073 can only activate the function associated with the partial area of the executable screen of the associated application.

[203] The application module 1073 forms a plurality of subwindows indicating the results of associated applications, respectively.

[204] The application module 1073 determines the size of the main window.

[205] The application module 1073 may determine the size of the main window based on the number and size of the sub windows.

[206] The application module 1073 determines the location of the subwindow. The application module 1073 can determine the location of the windows so that the windows can be placed in the main window according to a predefined order. Application module 1073 places subwindows in a specific order in the main window.

[207] The functions of the exemplary embodiments may be implemented as a recording medium, for example, a software module, which is to be executed on computers that include computer-readable instructions. A computer-readable recording medium may include any applicable medium that can be accessed by computers, volatile and non-volatile media, and removable and non-removable media. In addition, the computer-readable recording medium may include computer storage medium and communication medium. A computer storage medium includes all volatile and non-volatile media and removable and non-removable media that are designed to store information including computer-readable instructions, data structures, program modules or other data. The communication medium includes machine-readable instructions, a data structure, a software module, and other transmission mechanisms, and includes other information transmission media.

[208] It should be understood that the exemplary embodiments described herein are to be considered only in a descriptive sense and not for purposes of limitation. Descriptions of features or aspects in each exemplary embodiment typically should be considered available for other similar features or aspects in other exemplary embodiments. For example, configuration items that are singular may be performed in a distributed manner, and configuration items that are distributed can be combined and then performed.

[209] Although exemplary embodiments are shown and described in detail, those skilled in the art should understand that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention as defined by the appended claims.

Claims (37)

1. A method of displaying the result of execution of an application on a device screen, the method comprising the steps of: forming an object of interest associated with the metadata and at least one associated application based on user input; display the object of interest on the device screen; in response to the selection of an object of interest by the device user, metadata associated with the object of interest is obtained; determining an associated application associated with an object of interest; executing the associated application by using metadata as an input to the associated application; and displaying a window on the screen indicating the result of the execution of the associated application executed by using metadata; moreover, the object of interest is displayed on at least one of the screen that is locked, the main screen that controls the preset operation of the device, and the application screen of the device. 2. The method of claim 1, wherein the associated application is associated with the object of interest according to at least one of a category of the object of interest, a metadata element of the object of interest, and metadata of the object of interest. 3. The method of claim 1, further comprising the step of: mapping an object of interest to at least one function of a plurality of functions of the associated application, and wherein the execution of the associated application comprises the step of executing this at least one function that is mapped to the object of interest. 4. The method of claim 3, wherein the at least one function of the associated application is mapped to metadata and an object of interest, and however, in response to the selection of the object of interest, said execution comprises the step of executing the associated application, which is mapped to metadata and the object of interest. 5. The method according to claim 1, in which, in response to the choice of the object of interest, the result of the execution of the associated application is updated. 6. The method according to claim 1, in which the result of the execution of the associated application is displayed in a window in real time. 7. The method of claim 1, wherein the metadata is updated according to a predetermined period. 8. The method of claim 1, wherein providing a user interface for mapping the associated application to the object of interest, and the associated application is mapped to the object of interest based on user input through the user interface. 9. The method of claim 8, wherein the partial region is selected from a common area of the executable screen of the associated application based on user input, and the selected partial region is mapped to the object of interest. 10. The method of claim 1, wherein the object of interest is displayed on the device’s lock screen, and at the same time, in response to the choice of the object of interest displayed on the lock screen, the device is unlocked, and the associated application matching the object of interest is executed. 11. The method according to p. 1, in which based on user input, the object of interest moves between the screen that is locked, the main screen and the application screen. 12. The method of claim 2, wherein the category of interest contains at least one of a user, location, media, and keyword. 13. The method of claim 1, wherein, after the execution result of the associated application is updated, the image of the object of interest changes. 14. A device for displaying the result of execution of an application on a device screen, comprising: a storage device configured to save at least one program for a method of displaying an application execution result on a device screen; and a processor configured to execute at least one program, wherein the method contains: the formation of the object of interest associated with the metadata, and at least one associated application, based on user input; displaying an object of interest on the device screen; in response to the selection of the object of interest by the device user, obtaining metadata associated with the object of interest; determining an associated application associated with an object of interest; executing the associated application by using metadata as an input to the associated application; and displaying a window on the screen indicating the result of the execution of the associated application executed by using metadata; moreover, the object of interest is displayed on at least one of the screen that is locked, the main screen that controls the preset operation of the device, and the application screen of the device. 15. A permanent computer-readable recording medium on which a program for implementing the method according to claim 1 is recorded by using a computer.

Images