RU2628139C2 - Method and system for displaing object and method and system for providing the object - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: method is implemented by controlling the communication means in order to request information from the server related to the content reproduced by the second device based on the detection of the output of the first device from the service area of the second device and to receive the requested information related to the content from the server, and control the display of the first device to display information related to the content received from the server.

EFFECT: ensuring continuous playback of content for the user in a public place on his personal terminal.

15 cl, 31 dwg

Description

FIELD OF THE INVENTION

[1] Methods and devices in accordance with exemplary embodiments relate to a method for displaying on the screen an object that is associated with content reproduced by the second device, and a method and system for providing an object associated with content reproduced by the second device to the first device moreover, the method and system are implemented by a second device or management server.

State of the art

[2] Due to the development of communication and display technologies, users see various types of content that are provided in public places. For example, a user may observe various administrative procedures, product information, information regarding the use of various means, tourist information regarding surrounding areas, etc., on a display device (eg, a self-service terminal) installed in public places such as a government agency , municipal facility, department store, airport or train station. In addition, the user can view video content on a display device available on an airplane or on an express bus, or can view broadcast content such as news on a display device available on a platform or in the waiting room.

[3] Since the user cannot remain in a public place, the user must stop viewing content played in the public place, and then move to another location.

[4] Thus, there is a need for a system that enables the user, after the user leaves the public place, to continuously use the service that is provided in the public place on the user's personal terminal.

SUMMARY OF THE INVENTION

The solution of the problem

[5] One or more exemplary embodiments provide a method and system for providing, through a first device, a recommended item related to content reproduced by the second device to a user of the first device when the user views the content and then leaves the service area of the second device.

Advantages of the Invention

[6] According to one or more exemplary embodiments, the first device, which is the user's personal device, enables the user of the first device to again perceive through the first device a service that the user previously received through another device other than the first device.

Brief Description of the Drawings

[7] These and / or other aspects should become more apparent and apparent from the following description of exemplary embodiments, considered in conjunction with the accompanying drawings, in which:

[8] FIG. 1 is a diagram of an object providing system according to an exemplary embodiment;

[9] FIG. 2 is a flowchart of a method for displaying a recommended item, the method being carried out by a first device according to an exemplary embodiment;

[10] FIG. 3 illustrates a method for displaying a recommended item, the method being carried out by a first device according to another exemplary embodiment;

[11] FIG. 4 is a flowchart of a method for displaying a recommended item after the first device performs context analysis, the method being performed by the first device according to an exemplary embodiment;

[12] FIG. 5 is a flowchart of a method for providing a recommended item, the method being implemented by a management server according to an exemplary embodiment;

[13] FIG. 6 is a flowchart of a method for displaying a recommended item, the method being carried out by a first device according to another exemplary embodiment;

[14] FIG. 7 is a flowchart of a method for displaying a recommended item, the method being carried out by a first device according to another exemplary embodiment;

[15] FIG. 8 is a flowchart of a method for providing a recommended item, the method being carried out by a second device according to an exemplary embodiment;

[16] FIG. 9 illustrates a method for displaying a recommended item, the method being carried out by a first device according to another exemplary embodiment;

[17] FIG. 10 is a flowchart of a method for displaying a recommended item, the method being carried out by a first device according to another exemplary embodiment;

[18] FIG. 11A and 11B illustrate screens for displaying one or more recommended items, according to an exemplary embodiment;

[19] FIG. 12A, 12B, and 12C illustrate a method for receiving a recommended item from an external device and displaying the recommended item, the method being performed by a first device according to an exemplary embodiment;

[20] FIG. 13A-13C illustrate a method for sharing a recommended item with an external device, the method being implemented by a first device according to an exemplary embodiment;

[21] FIG. 14A and 14B illustrate a method of providing a recommended item related to content reproduced by public transport, the method being carried out by a first device according to an exemplary embodiment;

[22] FIG. 15A, 15B, and 15C illustrate a method of providing a recommended item associated with video content shown in a movie theater, the method being implemented by a first device according to an exemplary embodiment;

[23] FIG. 16A, 16B, 16C and 16D illustrate a method of providing a recommended item related to sports content reproduced in a sports complex according to an exemplary embodiment;

[24] FIG. 17A and 17B are block diagrams illustrating a configuration of a first device according to an exemplary embodiment;

[25] FIG. 18 is a block diagram illustrating a configuration of a second device according to an exemplary embodiment; and

[26] FIG. 19 is a block diagram illustrating a configuration of a management server according to an exemplary embodiment.

Optimum Mode for Carrying Out the Invention

[27] According to one or more exemplary embodiments, the first device is configured to display at least one object related to content reproduced by the second device, the first device comprises a sensor configured to detect the output of the first device from the service area of the second devices during playback of content by the second device; a communication device configured to request, from the control server, an object associated with the content, the object including link information for receiving information regarding content reproduced by the second device at a time when the sensor detects the output of the first device, and configured to receive an object associated with the content from the management server; and a controller configured to control the display so as to display the received object associated with the content on a predetermined screen of the first device.

[28] According to another aspect of exemplary embodiments, the control server includes a communication device configured to, if the first device leaves the coverage area of the second playback content of the device, receive request information from the first device for requesting the content related object to request from the second device information regarding the content reproduced by the second device at a time when the first device leaves the service area of the second device ystva, and receive information regarding the content from the second device; and a controller configured to generate an object associated with the content based on information regarding the content and transmit the generated object associated with the content through the communication device to the first device.

[29] According to another aspect of exemplary embodiments, the first device configured to display an object associated with content reproduced by the second device includes a communication device configured to receive an object associated with content reproduced by the second device from the second device in a predetermined cycle, the object including link information for receiving information regarding the content; and a sensor configured to detect the output of the first device from the service area of the second device during playback of content by the second device; and a controller configured to control the display so as to display an object associated with the content on a predetermined screen of the first device at a time when the output of the first device is detected.

[30] According to another aspect of exemplary embodiments, the first device configured to display an object associated with content reproduced by the second device includes a communication device configured to receive information regarding content reproduced by the second device from the second device when the first device is in the service area of the second device; a sensor configured to detect the output of the first device from the service area of the second device during playback of content by the second device; a controller configured to form an object associated with the content based on the received information regarding the content at the time when the output is detected; and a display configured to display the generated object associated with the content on a predetermined screen of the first device.

[31] According to another aspect of exemplary embodiments, the method implemented by the first device for displaying an object associated with content reproduced by the second device comprises detecting the output of the first device from the coverage area of the second device during playback of the content by the second device; a request from the management server for an object associated with the content, the object including link information for receiving information regarding content reproduced by the second device at a time when the sensor detects the output of the first device from the coverage area of the second device; receiving an object associated with the content from the management server; and displaying the received content related object on a predetermined screen of the first device.

[32] According to another aspect of exemplary embodiments, the method implemented by the management server for providing an object comprises, if the first device leaves the coverage area of the second playback content of the device, receiving from the first device request information for requesting an object related to the content; a request from the second device for information regarding content reproduced by the second device at a time when the first device leaves the coverage area of the second device; receiving information regarding the content from the second device; the formation of an object associated with the content based on information regarding the content; and transferring the generated content-related object to the first device.

Optimum Mode for Carrying Out the Invention

[33] All terms, including descriptive or technical terms that are used in this document, should be construed as having meanings that are obvious to specialists in this field of technology. However, the terms may have different meanings according to the intention of those skilled in the art, precedent cases or the advent of new technologies. In addition, some terms may be arbitrarily selected by the applicant, and in this case, the meaning of the selected terms is explained in detail in the detailed description of exemplary embodiments. Thus, the terms used herein should be defined based on the meaning of the terms along with the explanation throughout the detailed description.

[34] In addition, when the part "includes" or "contains" an element, if there is no specific description other than the one indicated, the part may further include other elements, without excluding other elements. In the description below, terms such as “block” and “module” indicate a unit for processing at least one function or step, wherein the module and block can be implemented as hardware or software, or can be implemented by combining hardware and software.

[35] In the detailed description, the term "first screen" means a screen that is first displayed on the device when the device is turned on, the device is locked, or the operating mode of the device switches from standby to active mode. In one or more exemplary embodiments, the first screen may be, but not limited to, a device home screen, a device menu screen, or a device background screen. In one or more exemplary embodiments, the first screen may represent a gateway to a device in order to provide services. For example, a device may provide recommended services through the initial screen.

[36] The following describes in more detail one or more exemplary embodiments with reference to the accompanying drawings. However, one or more exemplary embodiments may be implemented in many different forms and should not be construed as limited to the exemplary embodiments set forth herein; on the contrary, these exemplary embodiments are provided in such a way that this disclosure is exhaustive and comprehensive and fully conveys the principle of one or more exemplary embodiments for those skilled in the art. In the description below, well-known functions or constructions are not described in detail, since they make it difficult to understand one or more exemplary embodiments with unnecessary details, and similar reference numbers in the drawings indicate similar or similar elements throughout the detailed description.

[37] Expressions such as "at least one of" preceding the list of elements modify the entire list of elements and do not modify individual elements of the list.

[38] FIG. 1 is a diagram of an object providing system according to an exemplary embodiment.

[39] As illustrated in FIG. 1, an object providing system may include a first device 100, a second device 200, and a management server 300. However, not all items shown are required items. In other words, the system for providing objects can be implemented with more or fewer elements than the elements shown. For example, in other exemplary embodiments, the management server 300 may or may not be included in the facility providing system. Firstly, an exemplary embodiment in which the object providing system includes a management server 300 is described below, and then another exemplary embodiment in which the object providing system does not include a management server 300, with reference to FIG. 6-10.

[40] The first device 100 may be a device that displays an object associated with content reproduced by an external device (eg, a public device). Hereinafter, the “content related item” may be expressed as the “recommended content related item”. In the present exemplary embodiment, an object associated with the content may include link information for receiving information related to the content. Here, “information related to content” may be expressed “as information regarding content”.

[41] The first device 100 may be a personal mobile device. The first device 100 may be implemented in various ways. For example, in the entire detailed description, the first device 100 can be, but not limited to, a mobile phone, a smartphone, a laptop computer, a tablet PC, an e-book terminal, a digital broadcast terminal, a personal digital device (PDA), a portable multimedia player (PMP), navigation device, MP3 player and digital camera. The first device 100 may be a wearable device that a user may wear. For example, the first device 100 may be a watch, glasses, ring, bracelet, necklace, etc., but is not limited to this.

[42] The first device 100 may be positioned in the service area of the second device 200 and may exit the service area. The service area of the second device 200 means the area in which the second device 200 can provide services to a user or other device. For example, the service area of the second device 200 may include an area in which the second device 200 can provide a communication service, an area in which the second device 200 can provide a content playback service, and the like.

[43] When the first device 100 is positioned in the coverage area of the second device 200, the first device 100 can communicate with the second device 200. For example, the first device 100 can communicate with the second device 200. Examples of short distance communication may include, but not be only a wireless local area network (LAN) (e.g. Wi-Fi), near field communication (NFC), Bluetooth technology, low power Bluetooth (BLE) technology, ZigBee, WiFi Direct (WFD) standard and ultra wideband standard Communications (UWB). The first device 100 may be connected wired or wirelessly to the management server 300.

[44] The first device 100 may request a recommended item from a second device 200 or control server 300 and may receive a recommended item. In the present exemplary embodiment, the recommended element may be associated with content reproduced by the second device 200. For example, the recommended element may include, but is not limited to, an application element, a renewal element, additional information element and an advertising element, which correspond to content reproduced by the second device 200.

[45] The recommended element may be configured from an image of content and link information or index information, each of which is associated with an image, or may be configured in the form of an object for using the service.

[46] Throughout the detailed description, the term "object to use the service" indicates a user interface for using the services of the service provider. An object for using a service may be a user interface for using a service that is provided from a server or content provider. For example, an object for using the service may include a user interface including an icon, text, image and link information, as well as a description associated with the function of the object.

[47] The first device 100 may receive an object from a server and may use a service of a service provider by using the object. For example, by using an object, the first device 100 may receive content from an application in the first device 100, a data source, server, or content provider and may process the content. In addition, the object may be a user interface corresponding to a package of services that are provided based on the contextual information of the user (or the first device 100).

[48] In the present exemplary embodiment, the object may not be installed or may not be executed by the first device 100, but may be analyzed by the host program of the first device 100, so that the object can be displayed on the screen of the first device 100 and can be used by the user. An object can be a gadget, but an example of an object is not limited to this.

[49] When the first device 100 leaves the service area of the second device 200, the first device 100 can display, on the screen, a recommended item related to the content reproduced by the second device 200.

[50] In the first device 100, the transparent detection platform (SSP) may operate separately from the application processor (AP). The first device 100 may connect sensors to an SSP sensor hub and, therefore, may collect a plurality of pieces of detection information and may recognize a state without activating the AP in standby mode. When a predefined circumstance occurs, a sensor concentrator (e.g. MCU) SSP activates the AP in standby mode. Each of the SSP and AP can be implemented as hardware, software, or as a combination of hardware and software. SSP is described in detail with reference to FIG. 17.

[51] The second device 200 may be a display device that reproduces content. In particular, the second device 200 may be a public device. Throughout the detailed description, the second device 200 may indicate, but not limited to, a display device and a self-service terminal (e.g., a device with a digital information display (DID) or a device with a widescreen display (LFD)) that are available in public transport (e.g., in bus, plane, subway train, passenger train, etc.), a device with a movie screen installed in the cinema, and a light board used in the sports complex.

[52] The second device 200 may be connected to the first device 100 via short-range communication. In addition, the second device 200 may communicate wired or wirelessly with the management server 300.

[53] The second device 200 may transmit, to the first device 100 or to the control server 300, information regarding the reproduced content, for example, identification data (identifier), content information, content reproduction position information, a captured content image, application information corresponding to the content, etc. In another exemplary embodiment, the second device 200 may generate a recommended element associated with the reproduced content, and then may transmit the recommended element to the first device 100 or to the management server 300.

[54] The management server 300 may control at least one second device 200 that provides a content rendering service, and may provide a recommended item to the first device 100 related to content reproduced by the second device 200.

[55] The management server 300 may communicate with the first device 100 or with the second device 200. For example, when the management server 300 receives, from the first device 100, a request for a recommended item related to content reproduced by the second device 200, the management server 300 may request content related information from the second device 200. Then, the management server 300 can generate a recommended item based on information related to content that is received from the second device 200 and can transmit the recommended item to the first device 100.

[56] The control server 300 may include an intelligent mechanism that can analyze a plurality of pieces of event information that are collected by the first device 100. For example, the control server 300 can analyze the event information and, therefore, can calculate the level of interest of the user of the first device 100 to content reproduced by the second device 200, the likelihood that a user of the first device 100 may view content reproduced by the second stroystva 200, etc.

[57] Hereinafter, a method for providing a recommended item to a user through communication between the first device 100, the second device 200 and the management server 300 is described in detail with reference to FIG. 2-5.

[58] FIG. 2 is a flowchart of a method for displaying a recommended item, the method being carried out by the first device 100 according to an exemplary embodiment.

[59] In step S210, the first device 100 may detect the output of the first device 100 from the coverage area of the second device 200 that reproduces the content. For example, if the position of the first device 100 leaves the service area of the second device 200, since the user of the first device 100 moves to a different location while the user wears the first device 100, the first device 100 can detect the exit from the service area.

[60] In the present exemplary embodiment, the service area of the second device 200 may include a communication area in which the first device 100 is able to communicate with the second device 200, a viewing area in which a user of the first device 100 can directly view the content reproduced by the second device 200, and the like. If the second device 200 is an advertising sign that reproduces content on the bus, the service area of the second device 200 may be an internal area of the bus in which the user can view the content reproduced by the advertising sign, or the communication area of the advertising sign in which the advertising a sign can exchange data with another device.

[61] When communication with the second device 200 is terminated, the first device 100 may detect the output of the first device from the coverage area of the second device 200. Here, the coverage area of the second device 200 may be the communication range of the second device.

[62] The first device 100 may connect to an access point in the service area of the second device 200. Here, when a user moves while wearing the first device 100, the first device 100 may detect that the connection with the access point in the service area of the second device 200 is disconnected.

[63] In another exemplary embodiment, when the first device 100 recognizes an external device located outside or at the boundary of the service area of the second device 200, the first device 100 can detect the exit of the first device 100 from the service area of the second device 200. For example, when the first device 100 receives through short-distance communication the identification information of an external device or the position information of an external device from an external device that is located outside the service area of the second device roystva 200, the first device 100 can detect the output of the first device from the service area of the second device 200, based on the identification information or the position information of the external device.

[64] In the present exemplary embodiment, the external device may include, but is not limited to, a near field communication (NFC) tag, a ZigBee tag, and a low power consumption Bluetooth (BLE) tag.

[65] For example, the first device 100 may be a portable user terminal, the second device 200 may be a display device used in a bus, and the external device may be an NFC terminal that detects when a user of the first device exits the bus. Here, when a user scans a portable terminal on an NFC terminal when disembarking from the bus (which is an external device located at the boundary of the coverage area of the display device), the portable terminal can recognize the NFC terminal for disembarkation, and therefore can detect the output of the portable terminal from the service area of the display device on the bus.

[66] When the first device 100 stores information in advance regarding the service area of the second device 200, the first device 100 can detect the exit of the first device 100 from the service area of the second device 200 by using the current position information. Here, the first device 100 can obtain current position information by using at least one of a technology based on beacon radio signals using radio frequency (RF) or infrared rays, ultrasound based position recognition technology, and Wi- Fi-signal, position recognition technology based on ZigBee and technology based on the signals of the global positioning system (GPS).

[67] For example, the first device 100 can detect how far (for example, about N km) the first device 100 is from the coverage area of the second device 200, using Wi-Fi information, GPS, a base station of a communication network, etc. .

[68] In the present exemplary embodiment, when a user of the first device performs a registration operation in the service area of the second device 200, the first device 100 can estimate the travel distance that the first device 100 moves from the registration position by using an acceleration sensor. In the present exemplary embodiment, registration may mean an operation in which a user intentionally leaves notes about visiting a particular area or using a particular service.

[69] In step S220, the first device 100 may request a recommended element from the control server 300 related to content reproduced by the second device 200. In other words, when the first device 100 leaves the coverage area of the second device 200, the first device 100 may request a recommended element management server 300 in order to recommend an element related to the content reproduced by the second device 200 to the user of the first device 100.

[70] The first device 100 may request a recommended item from the control server 300, while the first device 100 transmits information regarding the second device 200 and information regarding the coverage area of the second device 200 to the control server 300.

[71] For example, the first device 100 may request a recommended item from the control server 300, while the first device 100 transmits at least one of the position information of the first device 100, the position information of the second device 200, and identification information to the control server 300 the second device 200. The position information of the first device 100 may include information regarding the service area of the second device 200 (for example, an identifier value for identifying a service area).

[72] The first device 100 may receive information about the management server 300, which broadcasts from the second device 200. Information about the management server 300 may include link information (eg, a uniform resource locator (URL)) for accessing the server 300 controls.

[73] In other words, the second device 200 may periodically broadcast information on the control server 300 via short-range communication, while the control server 300 may receive a recommended item related to content reproduced by the second device 200. The short-range communication may include , but not only, BLE, NFC, UWB and ANT +. In addition, the second device 200 may provide information regarding the control server 300 capable of receiving a recommended item related to content reproduced by the second device 200 through a two-dimensional bar code (e.g., a QR bar code), a color code, a Gray code, touch code, etc. When the first device 100 leaves the coverage area of the second device 200, the first device 100 may request a recommended item from the management server 300 based on information regarding the management server 300 that is received from the second device 200.

[74] The control server 300 may define a second device 200 or a service area of the second device 200 based on at least one of the position information of the first device 100, the position information of the second device 200, and the identification information of the second device 200. For example, when the first device 100 sends the position information of the first device 100 to the control server 300 at the time the first device leaves the service area of the second device, the control server 300 can specify the second device 200 or service area Bani second device 200 located within range of the first device 100.

[75] The management server 300 may request information from the second device 200 regarding content reproduced by the second device 200, and may generate a recommended item by using information regarding content that is received from the second device 200.

[76] The control server 300 may transmit information to the second device 200 regarding the point in time when the control server 300 receives the request information of the recommended item from the first device 100. In other words, the control server 300 may request information from the second device 200 regarding content reproduced by the second device 200 at a point in time when the management server 300 receives request information of a recommended item from the first device 100.

[77] The difference between the time when the management server 300 receives the recommended item request information and the time when the first device 100 leaves the coverage area of the second device 200 may not be significant. Thus, in the present exemplary embodiment, the point in time when the first device 100 leaves the coverage area of the second device 200 may correspond to the point in time when the management server 300 or the second device 200 receives a request for a recommended item.

[78] When the first device 100 periodically receives from the second device 200, at least one of the reproduction position information (eg, time stamp, index, etc.) of the content that is reproduced by the second device 200 and the content link information, the first device 100 may request a recommended item from the management server 300, while the first device 100 transmits at least one of the content reproduction position information and the content link information to the management server 300.

[79] The control server 300 may generate a recommended element associated with the content reproduced by the second device 200 by using the content reproduction position information or the content link information that is received from the first device 100.

[80] In another exemplary embodiment, the management server 300 may request from the second device 200 a recommended item associated with content reproduced by the second device 200, and may receive the recommended item from the second device 200.

[81] In the present exemplary embodiment, when the first device 100 detects a user gesture of the first device 100 that requests the recommended item, the first device 100 can request from the control server 300 the recommended item related to the content that is provided from the second device 200. User gesture that is associated with the request for a recommended item may vary. For example, a gesture in which a specific button (go to the home screen, power button, etc.) is pressed for a predetermined period of time, a gesture in which a specific area of the screen is touched, etc.

[82] When a gesture is detected by a user who requests the recommended item, although the device 100 is located in the coverage area of the second device 200, the first device can request the recommended item from the management server 300.

[83] In step S230, the first device 100 may receive a recommended content-related item from the management server 300. In the present exemplary embodiment, the first device 100 may receive a recommended content-related item from the management server 300. Here, in the present exemplary embodiment, the first device 100 may receive a recommended item that is generated by the control server 300. In another exemplary embodiment, the first device 100 may receive a recommended element from the control server 300, which is formed by the second device 200.

[84] In the present exemplary embodiment, the recommended item may include, but is not limited to, an application item, a renewable item, an additional information item, and an advertising item that are relevant to the content.

[85] An application item may be an item associated with an application that accesses a content provider that provides content reproduced by the second device 200.

[86] The renewal element may be an element for enabling playback of content that is reproduced by the second device 200, by the first device 100 after a point in time when the first device 100 leaves the coverage area of the second device 200.

[87] The additional information element may be an element for providing a plurality of additional information fragments (for example, in the case of video content, presentation of the cast and crew, summary, rating, announcement, original soundtrack (OST) information, etc.) associated with the content reproduced by the second device 200. The advertising element may be an element to stimulate the user to acquire content or an additional service related to ontentom.

[88] In step S240, the first device 100 may display a recommended content-related item on the screen of the first device 100.

[89] The screen of the first device 100 may include, but not limited to, a first screen that is first displayed on the first device 100 when the operating mode of the first device 100 is switched from the standby mode to the active mode (for example, when the first device 100 is unlocked, the power the first device 100 is turned on, etc.). For example, the first device 100 may display a recommended element on a particular page of a plurality of pages having icons lined thereon, or may display a recommended element in a predetermined area of the background screen.

[90] When the recommended item includes many recommended items, the first device 100 may display a list of recommended items on the screen.

[91] The recommended item displayed on the first device 100 may be configured from image content and link information or index information, each of which is associated with an image. For example, the recommended element may be formed in such a way that the captured image of the content reproduced by the second device 200 at the time when the first device 100 leaves the coverage area of the second device 200 (hereinafter, the “last screen image”) is connected to information of the playback position indicating the playback position of the content at the time when the first device 100 leaves the service area of the second device.

[92] Playback position information may include link information (eg, a URL) for accessing content played by the second device 200 at a time when the first device 100 leaves the coverage area of the second device, index information (eg, universal resource identifier (URI)) for accessing still image content displayed by the second device 200 at a time when the first device 100 leaves the service area of the second of devices, etc.

[93] In another exemplary embodiment, the recommended item may be configured from text indicating the content and information of the playback position that is associated with the text. Text may be provided through a content provider.

[94] In the present exemplary embodiment, the management server 300 can transmit the recommended content-related item to a cloud server that connects to the first device 100. In this case, if necessary, the first device 100 can receive the recommended item from the cloud server and can display the recommended item on the screen.

[95] When the first device 100 leaves the service area of the second device 200, the user of the first device 100 can no longer view the content played by the second device 200, so that the first device 100 displays the recommended item on the screen in order to recommend information to the user associated with the content reproduced by the second device 200. This is described in detail with reference to FIG. 3.

[96] FIG. 3 illustrates a method for displaying a recommended item, the method being carried out by the first device 100, according to another exemplary embodiment. In the exemplary embodiment of FIG. 3, it is assumed that the first device 100 is a personal mobile device, and the second device 200 is a public device.

[97] The publicly available device 200-1 'A' may play back cartoon content (step 1). Here, a user of the first device 100 in the coverage area of the public device 200-1 'A' can view the cartoon content played by the public device 200-1 'A'. When the user of the first device 100 remains in the service area of the public device 200-1 'A' for a predetermined period of time, and then leaves the service area, the user of the first device 100 can no longer view the cartoon content played by the public device 200-1 ' A '.

[98] Thus, when the first device 100 detects the exit of the first device 100 from the coverage area of the public device 200-1 'A' (step 2), the first device 100 may request from the control server 300 a recommended item related to the cartoon content reproduced by a public device 200-1 'A' (step 3). Step 2, in which the first device 100 detects the exit from the service area of the public device 200-1 'A', corresponds to step S210 of the exemplary embodiment shown in FIG. 2, and therefore, a detailed description thereof is omitted here.

[99] The management server 300 may have a database regarding the service areas of the second device 200. Thus, when the management server 300 receives a request for a recommended item from the first device 100, the management server 300 can set the public device 200-1 'A' as the second devices 200, based on the position of the first device 100.

[100] The management server 300 may request information from the public device 200-1 'A' regarding the content of the cartoons played by the public device 200-1 'A' at the time when the first device 100 leaves the coverage area of the public device 200-1 ' A '(or when the management server 300 receives a request for a recommended item from the first device 100). Here, in response to a request from the control server 300, the public device 200-1 'A' may transmit at least one of the cartoon content image reproduced by the public device 200-1 'A' to the control server 300, when the first device 100 leaves the coverage area of the public device 200-1 'A' (or when the management server 300 receives a request for a recommended item from the first device 100), playback position information (eg, link information or index information) the content played back by the public device 200-1 'A' at the time when the first device 100 leaves the coverage area of the public device 200-1 'A' (or when the management server 300 receives a request for a recommended item from the first device 100), information applications corresponding to the content played by the public device 200-1 'A' at the time when the first device 100 leaves the coverage area of the public device 200-1 'A' (or when the management server 300 receives a request for recommended element from the first device 100), additional information and advertising information related to the content reproduced by the public device 200-1 'A' at the time when the first device 100 leaves the coverage area of the public device 200-1 'A' (or when the management server 300 receives a request for a recommended item from the first device 100) (step 4).

[101] The public device 200-1 'A' may transmit to the control server 300 a captured image (i.e., a last screen image) of a screen displaying content at a time when the first device 100 leaves the coverage area of the public device 200-1 ' A '(or when the management server 300 receives a request for a recommended item from the first device 100).

[102] The management server 300 may generate a recommended element by using a plurality of pieces of information received from a public device 200-1 'A' (step 5). For example, the management server 300 may generate a renewal element as a recommended element by using information received from a public device 200-1 'A', i.e. by using the captured image (i.e., the image of the last screen), and the information of the playback position of the content that was reproduced at the time when the first device 100 leaves the coverage area of the public device 200-1 'A'. In addition, the control server 300 may generate an additional information item by using additional information received from a public device 200-1 'A', or may generate an application item by using application information received from a public device 200-1 'A'. Here, the management server 300 may generate a recommended item in the form of an object (eg, a gadget) for using the service or in the form of a list.

[103] The management server 300 may provide a recommended item to the first device 100 (step 6). The first device 100 may display a recommended item received from the management server 300 on a screen (for example, on a first screen) (step 7).

[104] Thus, according to the present exemplary embodiment, when the user of the first device 100 views the content reproduced by the public device, and then leaves the service area of the public device, the first device 100 may provide the user with a recommended item (eg, a renewable item), associated with the content played through the public device, so that although the user leaves the service area of the public device, the gender zovatel can continuously use services provided through a public unit.

[105] Hereinafter, when the first device 100 performs a context analysis and recognizes that the user of the first device 100 has a high level of interest in the content reproduced by the second device 200, a method for displaying a recommended item on the screen of the first device 100 is described below. the method is carried out by means of the device 100.

[106] FIG. 4 is a flowchart of a method for displaying a recommended item after the first device 100 performs context analysis, the method being performed by the first device 100, according to an exemplary embodiment.

[107] In step S405, the second device 200 may reproduce the content. Content may include, but not limited to, training content, video content, broadcast content, game content, advertising content, still image content and news content.

[108] In step S410, the first device 100 can collect event information regarding an event that occurs in the first device 100. In other words, the first device 100 can detect various types of events that occur in the first device 100, and can collect many pieces of event information regarding different types of events detected.

[109] For example, the first device 100 may collect position information or network information (eg, GPS coordinate information, cell identifier information, Wi-Fi access point information, etc.) that relates to the first device 100.

[110] In addition, the first device 100 may collect state information regarding a user state of the first device 100. The user state information may indicate movement, lifestyle, etc. user and may include many pieces of information regarding the state of walking, the state of the training, state, state of sleep, etc. user. For example, when the user connects the first device 100 to the stand of the house, the first device 100 can determine that the user is in a sleep state, taking into account position information, tilt information, travel information, current time information, alarm setting information, etc. the first device 100. In addition, when the user connects the first device 100 to the stand in the car, the first device 100 can determine that the user is in a driving state, taking into account position information, tilt information, movement information, etc. first device 100.

[111] The first device 100 may collect content that is input through the user input device. For example, the first device 100 may collect a plurality of pieces of information regarding texts, drawings, characters, etc. that are entered by the user through the touch screen, or may recognize the voice of the user and may collect vocal content input by the user.

[112] The first device 100 may collect information on transmitted / received messages, information on transmitted / received mail messages, information on call history, information on the use of social networking services (SNS), and information on the use of web pages. For example, the first device 100 may collect the transmission and reception times of messages or mail messages, the content included in the transmitted / received messages or mail messages, the call content, the call time, the information of the caller or receiver, the access time to the SNS server, the history of use SNS, information received from the SNS server, access time to the web page, history of the use of the web page, etc.

[113] The first device 100 may collect a plurality of pieces of usage information regarding applications in the first device 100. For example, when a user executes and uses a homework book application, the first device 100 may collect a lot of pieces of usage information regarding expenses, income, investments, etc., which are recorded in the housekeeping book, or when the user runs the schedule management application and enters the schedule, the first device Property 100 may collect user schedule information. In addition, when the user runs the application for capturing and capturing content, the first device 100 can collect content information regarding the captured content, or when the user runs the application for playing music and plays music, the first device 100 can collect music information regarding music played by the user.

[114] The first device 100 may collect identification information, type information, usage time information, usage period information, etc. regarding the applications that the user has installed, uses or searches for. In addition, when the user completes the transaction by using the mobile card in the first device 100, the first device 100 can collect transaction information, purchase template information, etc., regarding the user.

[115] In other words, the first device 100 can collect, through various sensors, a plurality of pieces of event information regarding events occurring in the first device 100, a plurality of pieces of information regarding a user of the first device 100, and the like. Here, the first device 100 may periodically collect a plurality of pieces of event information, or may collect real-time event information when a particular event occurs.

[116] The first device 100 may collect a plurality of pieces of event information through an SSP and, therefore, can significantly reduce power consumption for collecting a plurality of pieces of event information.

[117] In step S415, the first device 100 may detect the exit of the first device 100 from the coverage area of the second device 200. The first device 100 may detect the exit of the coverage area of the second device 200 by using a plurality of pieces of event information.

[118] For example, when the communication connection with the second device 200 is terminated, the first device 100 may detect the output of the first device from the coverage area of the second device 200.

[119] Furthermore, when the first device 100 recognizes an external device (for example, an NFC tag, a BLE tag, etc.) located outside the service area of the second device 200 or at the border of the service area of the second device 200, the first device 100 can detect the exit of the first device from the service area of the second device 200.

[120] When the first device 100 stores information in advance regarding the service area of the second device 200, the first device 100 can detect the output of the first device from the service area of the second device 200 by using the current position information. Step S415 corresponds to step S210, whereby a detailed description thereof is omitted here.

[121] In step S420, the first device 100 may calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on the plurality of pieces of event information. The first device 100 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on user input information, user status information, current position information, reservation history information, etc.

[122] For example, when a user of the first device 100 performs a registration operation with respect to the second device 200 or the service area of the second device 200 by using the first device 100, the first device 100 can calculate the high level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[123] The first device 100 may calculate the likelihood that a user of the first device 100 may view content reproduced by the second device 200, and therefore, may calculate the level of interest of the user of the first device 100.

[124] Here, the first device 100 may calculate the likelihood that a user of the first device 100 may view content reproduced by the second device 200 based on user state information, current position information, application information regarding an application running in the first device 100, and t .P.

[125] For example, when a user of the first device 100 downloads data that is provided by the second device 200 to the first device 100, or inputs recommendation information to the first device 100 so as to recommend content played by the second device 200 to another user via SNS, the first device 100 can calculate a high probability (for example, approximately 95%) that a user of the first device 100 can view content reproduced by the second device 200.

[126] Furthermore, when the user of the first device 100 remains in the service area of the second device 100 for a predetermined period of time, and while the user of the first device 100 remains in the service area, if the user of the first device 100 performs operations with the first device 100 the number of times or over a period of time that is less than a predetermined reference value, the probability that a user of the first device 100 can view the content played back means of the second device 200 can be high.

[127] In other words, when the position of the first device 100 does not change in the service area of the second device 100 for a predetermined period of time, and the first device 100 does not detect user input for a predetermined period of time, the first device 100 can calculate a high probability (for example , approximately 90%) that the user of the first device 100 may want to view content reproduced by the second device 200.

[128] Although the first device 100 is positioned in the service area of the second device 100 for a predetermined period of time, while the first device 100 is positioned in the service area of the second device 100, if the first device 100 receives a request from the user of the first device 100 regarding applications that are irrelevant to the content played by the second device 200, the first device 100 can calculate a low probability (for example, approximately 30%) then of the user of the first device 100 may want to view the content reproduced by the second device 200. Here, the second device 200 may broadcast the information about the content reproduced by the second device 200.

[129] In the present exemplary embodiment, the first device 100 can detect the user's eyes through the camera and, therefore, can calculate the likelihood that the user of the first device 100 can view content reproduced by the second device 200.

[130] For example, as a result of detecting the user's eyes, if the user continues to look at the screen of the first device 100, the first device 100 may calculate a low probability (for example, approximately 10%) that the user of the first device 100 may view content reproduced by the second device 200. On the other hand, as a result of detecting the user's eyes, if the user does not look at the screen of the first device 100, the first device 100 can calculate the probability of at least 70% of what The host of the first device 100 may view content reproduced by the second device 200.

[131] If the user of the first device 100 purchased a movie ticket by using the first device 100, and the first device 100 is positioned in the movie theater while the movie corresponding to the movie ticket is shown, the first device 100 can calculate a high probability (for example, approximately 98%) that a user of the first device 100 can watch a movie played by the second device 200 (e.g., a movie screen device).

[132] For example, if a user booked a movie ticket for a particular movie that is shown in a particular movie theater at 5:00 p.m. March 1, 2013, using the first device 100, or the user downloaded the purchased movie ticket from the server, the first device 100 can collect and analyze information regarding an event related to the purchase of a movie ticket. Then, when the first device leaves the particular cinema at 18:30 on March 1, 2013, the first device 100 can calculate a high probability (for example, approximately 99.9%) that a user of the first device 100 is watching a particular movie. According to the present exemplary embodiment, the first device 100 can analyze the event information collected on the basis of the ontology, and therefore can receive information regarding the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[133] Ontology means a formal and explicit indication of the conceptualization of public access. An ontology can mean a type of dictionary consisting of words and the relationships between them, in which words associated with a particular subject area are hierarchically expressed, and there is a logical rule for additional expansion.

[134] In the present exemplary embodiment, the first device 100 may analyze text or voice that is input from the user based on the ontology. In other words, the first device 100 may receive information regarding the correlation between text / voice input from the user and the content reproduced by the second device 200 based on the ontology. Here, the second device 200 can broadcast information regarding the content reproduced by the second device 200. Based on the information regarding the correlation between text / voice input from the user and the content reproduced by the second device 200, the first device 100 can calculate the level of interest of the user of the first device 100 to the content reproduced by the second device 200.

[135] For example, the second device 200 may show a specific animation, and the first device 100 may receive information (eg, type of content, content title, content playback position, scene information, etc.) regarding a specific animation from the second device 200. Here , the first device 100 can extract keywords after analyzing a user's voice, which is obtained through a microphone, and can calculate the correlation between the extracted keywords and a plurality of pieces of information regarding a specific an Missions that are received from the second device 200, based on the ontology.

[136] If the user of the first device 100 often mentions words related to a particular animation while the user is talking directly to another or in a phone call, the first device 100 may determine that the user has a high level of interest in a particular animation reproduced by second device 200.

[137] In step S425, the first device 100 may determine whether the user’s interest in the first device 100 is equal to or higher than the content reproduced by the second device 200 of a predetermined value (for example, the user is equal to or higher or not the first device 100 can view content reproduced by the second device 200, 85%). A predetermined value may be set in the first device 100, may be set by the user, or may be set by the control server 300.

[138] In the present exemplary embodiment, the first device 100 in a predetermined context can evaluate, without calculating the level of interest, that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher than the predetermined value.

[139] For example, when the first device 100 has a browsing history of purchase tickets relative to content reproduced by the second device 200, or has a registration history of the coverage area of the second device 200, the first device 100 may determine that the level of interest of the user of the first device 100 is content reproduced by the second device 200 is equal to or higher than a predetermined value.

[140] In other words, when a user of the first device 100 intentionally purchased a ticket to view specific content, the first device 100 can analyze that the level of interest of the user of the first device 100 in the content played by the second device 200 is high. Thus, the first device 100 may not specifically calculate the likelihood that a user of the first device 100 may view content reproduced by the second device 200.

[141] In step S430, when the level of interest of the user of the first device 100 in the content played by the second device 200 is equal to or higher than the predetermined value, the first device 100 may request from the control server 300 a recommended item related to the content played by the second device 200. For example, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher than 85%, the first device 100 may request from management server 300 is a recommended item.

[142] The first device 100 may request a recommended item, while the first device 100 transmits to the control server 300 at least one of the position information of the first device 100, the position information of the second device 200, the identification information of the second device 200, position information reproducing content and content link information.

[143] When the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is less than a predetermined value, the first device 100 may not request a recommended item from the control server 300.

[144] In step S435, in order to generate a recommended item, the control server 300 may request information from the second device 200 regarding content played by the second device 200 at a time when the first device 100 leaves the coverage area.

[145] In step S440, in response to a request from the management server 300, the second device 200 may transmit information to the management server 300 regarding the content that was reproduced at a time when the first device 100 leaves the coverage area.

[146] For example, the second device 200 may capture a screen that plays content at a point in time when the first device 100 leaves the coverage area, and may transmit the captured image (ie, the image of the last screen) to the control server 300. In addition, the second device 200 may transmit to the control server 300 at least one of the reproduction position information (e.g., link information or index information) of content reproduced by the second device 200 at a time when the first device 100 leaves the coverage area the second device 200, application information corresponding to the content reproduced by the second device 200 at a time when the first device 100 leaves the coverage area of the second device 200, d additionally information and advertisement information related to the content reproducible by the second device 200, at a time point when the first device 100 exits from the service area 200 of the second device.

[147] In step S445, the management server 300 may generate a recommended content-related item. For example, the control server 300 may generate a renewal element as a recommended element by using the captured image (ie, the image of the last screen) and playback position information (eg, link information or index information) that are received from the second device 200. In addition , the control server 300 may generate an additional information element by using additional information received from the second device 200, or may form an element nt in the form of an application by using application information received from the second device 200. Here, the control server 300 may generate a recommended element in the form of an object (eg, a gadget) for using the service or in the form of a list.

[148] In step S450, the control server 300 can provide the recommended item to the first device 100. According to the present exemplary embodiment, the control server 300 can provide the recommended item to the first device 100 via wired or wireless.

[149] In step S455, the first device 100 may display a recommended item on the screen. Here, the first device 100 may display a recommended item on the screen, taking into account the contextual information of the user.

[150] For example, when the first device 100 detects a user gesture of the first device 100 that requests the recommended item, the first device 100 may display the recommended item on the screen. The user's gesture that is associated with the request for the recommended item may vary.

[151] In addition, the first device 100 may display a recommended item on the screen based on luminance information, tilt information, etc. For example, when the brightness of the first device 100 is less than a predetermined value, the first device 100 may not display the recommended item on the screen, and when the brightness of the first device 100 is equal to or higher than the predetermined value, the first device 100 may display the recommended item on the screen.

[152] In other words, if the user of the first device 100 holds the first device 100 in the user's pocket or does not carry the first device 100 in the user's hand, this may mean that the user does not intend to accept the recommended item. Thus, the first device 100 may not display a recommended item on the screen based on luminance information or tilt information.

[153] On the other hand, when the first device 100 leaves the coverage area of the second device 200, if the user of the first device 100 is looking at the screen while the user is holding the first device 100 in the user's hand, the first device 100 may display a recommended item on the screen associated with the content reproduced by the second device 200.

[154] Thus, according to the present exemplary embodiment, the first device 100 considers the contextual information of the user, and therefore, when the user does not want the recommended item or cannot view the recommended item, the first device 100 may not display the recommended item on the screen.

[155] The first device 100 may display a recommended item according to a setting specified by users. For example, the first device 100 may provide a recommended item in the form of a pop-up window or may display the recommended item on a specific page.

[156] The first device 100 may scan the service area of the second device 200 that the first device 100 has previously visited, and scanning may be performed within a predetermined range from the current position. When the service area of the second device 200, which was previously visited by the first device 100, is scanned, the first device 100 can retrieve the recommended item associated with the content that was previously played by the second device 200 and can display the recommended item on the screen.

[157] For example, if the gallery that the user of the first device 100 visited one month ago is located in a building next to the department store where the first device 100 is currently located, the first device 100 can retrieve a recommended element related to content that the user viewed in the gallery one month ago, and can display the recommended item on the screen.

[158] In other words, according to the present exemplary embodiment, if the service area that the user previously visited is located next to the user and the user is viewing content in the service area, the first device 100 may provide a recommended item associated with the content that was viewing user.

[159] Step S455 corresponds to step S240 shown in FIG. 2, and by virtue of this, its repeating detailed description is omitted here.

[160] According to the present exemplary embodiment, the first device 100 may perform context analysis and, therefore, may provide the user with a recommended element related to content having a high probability that the user will be able to view from a plurality of pieces of content that are reproduced by a public device . Thus, you can prevent the provision of many unnecessary recommended elements for the user through the first device 100.

[161] In another exemplary embodiment, the order of steps S405-S455 may change, or some steps may be skipped.

[162] FIG. 5 is a flowchart of a method for providing a recommended item, the method being implemented by the control server 300, according to an exemplary embodiment.

[163] In step S505, the second device 200 may reproduce the content. Here, the first device 100 may be positioned in the coverage area of the second device 200.

[164] In step S510, the first device 100 can collect event information regarding an event that occurs in the first device 100. In other words, the first device 100 can detect various types of events that occur in the first device 100, and can collect many pieces of event information regarding various types of detected events. For example, the first device 100 may collect position information, network information, user status information, messages sent / received, message sent / received information, call history information, SNS usage information, application usage information and web page usage information, transaction information etc. first device 100.

[165] In step S515, the first device 100 may transmit a plurality of pieces of event information to the management server 300. The first device 100 may transmit all or part of a plurality of pieces of event information to the management server 300. For example, the first device 100 may not transmit to the management server 300 a plurality of pieces of personal financial information (e.g., bank account, credit card number, etc.) that are entered by the user.

[166] The first device 100 may periodically transmit multiple pieces of event information to the management server 300, or may transmit event information to the management server 300 when a particular event occurs. The first device 100 may encrypt the event information by using a pre-agreed encryption code, and then may transmit the encrypted event information to the management server 300.

[167] In step S520, the first device 100 may detect the output of the first device 100 from the coverage area of the second device 200. Here, in step S525, the first device 100 may request a recommended element from the control server 300 related to content reproduced by the second device 200 In other words, when the first device 100 leaves the service area of the second device 200 that reproduces the content, the control server 300 may receive a request for a recommended item from the first device 100.

[168] In step S530, the control server 300 can calculate the level of user interest in the content played by the second device 200. For example, when the user of the first device 100 performs the registration procedure with respect to the second device 200 or the coverage area of the second device 200 by using the first device 100, the server 300, the control can receive registration information from the first device 100. Here, the control server 300 can calculate a high level of user interest in the first device Twa 100 to the content reproduced by the second device 200.

[169] The control server 300 can calculate the probability that a user of the first device 100 can view content reproduced by the second device 200 based on a plurality of pieces of event information collected by the first device 100, and therefore can calculate the level of interest of the user of the first device 100 to content reproduced by the second device 200.

[170] Here, the control server 300 can calculate the probability that a user of the first device 100 can view content reproduced by the second device 200 based on user input information, user status information, current position information, reservation history information, etc. which is received from the first device 100.

[171] For example, when the control server 300 receives a plurality of pieces of event information regarding events in which a user of the first device 100 downloads data to the first device 100 that is provided by the second device 200, or enters recommendation information into the first device 100 so as to recommend content reproduced by the second device 200 to another user, the control server 300 can calculate a high probability (for example, approximately 95%) that the user of the second device 100 may view content reproduced by the second device 200.

[172] Furthermore, when the position of the first device 100 does not change in the service area of the second device 200 for a predetermined period of time, and the user input is not detected for a predetermined period of time, the control server 300 can calculate a high probability (for example, approximately 90 %) that a user of the first device 100 can view content reproduced by the second device 200.

[173] Although the first device 100 is positioned in the service area of the second device 200 for a predetermined period of time, while the first device 100 is positioned in the service area of the second device 200, if the user of the first device 100 performs, by using the first device 100, the step that is irrelevant for the content reproduced by the second device 200, the management server 300 can calculate a low probability (for example, approximately 30%) of what Vatel first device 100 may browse the content reproduced by the second device 200.

[174] If the user of the first device 100 purchased a movie ticket by using the first device 100, and the first device 100 is positioned in the movie theater while the movie corresponding to the purchased movie ticket is shown, the control server 300 can calculate a high probability (for example , approximately 98%) that the user of the first device 100 can watch a movie being played by the second device 200 (for example, a movie screen device).

[175] In the present exemplary embodiment, the control server 300 can calculate the probability that a user of the first device 100 can view content reproduced by the second device 200 based on information that is obtained by the first device 100 by detecting the user's eyes through the camera.

[176] According to the present exemplary embodiment, the control server 300 can analyze the event information collected by the first ontology device 100, and therefore can receive information regarding the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[177] For example, the control server 300 may obtain information regarding the correlation between the text / voice inputs of the user and the content reproduced by the second device 200 based on the ontology. Based on the information regarding the correlation between the text / voice input of the user and the content reproduced by the second device 200, the control server 300 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[178] In step S535, the control server 300 can determine whether or not the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is predetermined (for example, the probability of the user being the first or the same is higher or not device 100 can view content reproduced by the second device 200, 85%). A predetermined value may be set by the user or by the management server 300.

[179] In the present exemplary embodiment, the control server 300 in a predetermined context can evaluate (or can determine), without calculating the level of interest, that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher predefined value.

[180] For example, when a user of the first device 100 has a history of buying a ticket to view content played by the second device 200, or has a history of registrations regarding the coverage area of the second device 200, the control server 300 may determine that the level of interest of the user of the first device 100 to the content reproduced by the second device 200 is equal to or higher than a predetermined value.

[181] In step S540, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher than the predetermined value, the control server 300 may request information from the second device 200 regarding the content reproduced by the second device 200. Here , the control server 300 can transmit information to the second device 200 regarding the point in time when the first device 100 leaves the coverage area of the second device 200.

[182] In step S545, the control server 300 may receive information regarding the content from the second device 200. For example, the control server 300 may receive from the second device 200 at least one of the captured image information obtained by capturing an image of content reproduced by the second device 200 at a time when the first device 100 leaves the service area of the second device 200, information of the playback position of the content reproduced by the second device 200 at a time when the first device 100 leaves the service area of the second device 200, application information corresponding to the content, additional information regarding the content information and advertising information corresponding to the content.

[183] In step S550, the control server 300 may generate a recommended element related to content reproduced by the second device 200 at a time when the first device 100 leaves the coverage area of the second device 200 based on information regarding content that is received from the second devices 200.

[184] For example, the control server 300 may generate an element for resuming by using captured image information obtained by capturing an image of content reproduced by the second device 200 at a time when the first device 100 leaves the coverage area of the second device and the playback position information ( for example, a time stamp, index information, etc.) with respect to content reproduced by the second device 200 at a time when the first oystvo 100 exits from the service area of the second device.

[185] In step S555, the control server 300 can transmit the generated recommended item to the first device 100. Here, in the present exemplary embodiment, the first device 100 can store the recommended item in its storage device.

[186] In step S560, the first device 100 may detect a user gesture of the first device 100 that requests the recommended item. For example, the first device 100 can detect a gesture in which the user presses a specific button (for example, the home button), touches a specific area of the screen, stops locking the device, and the like.

[187] In step S565, when the first device 100 detects a gesture of a user who requests a recommended item, the first device 100 can display a recommended item that is received from the control server 300 on the screen. The screen may be a first screen.

[188] In another exemplary embodiment, the order of steps S505-S565 may change, or some steps may be skipped. For example, in other exemplary embodiments, steps S530 and S535 may be performed after step S545 or after step S550.

[189] Hereinafter, the method for receiving the recommended item from the second device 200 without using the control server 300 and displaying the recommended item on a predetermined screen is described in detail, the method being carried out by the first device 100, with reference to FIG. 6-8.

[190] FIG. 6 is a flowchart of a method for displaying a recommended item, the method being carried out by the first device 100, according to another exemplary embodiment.

[191] In step S610, the second device 200 may reproduce the content. Here, the first device 100 may be positioned in the service area 600 of the second device 200. In the present exemplary embodiment, the service area 600 includes a communication area in which the first device 100 is able to communicate with the second device 200, or a viewing area in which the user of the first device 100 can directly view content reproduced by the second device 200.

[192] In step S620, the first device 100 may request a recommended item from the second device 200 related to content reproduced by the second device 200. Here, the first device 100 may request a recommended item from the second device 200, provided that the first device 100 is positioned in the service area 600 of the second device 200 for a predetermined period of time (e.g., 5 minutes).

[193] For example, when the first device 100 receives, via short-range communication, a signal that is broadcast in the second device 200 over a predetermined period of time, the first device 100 may request a recommended element from the second device 200 related to the content reproduced by the second devices 200. Additionally, when the first device 100 recognizes an NFC terminal that detects the first device and allows the user of the first device to board the bus, and then ekaet predetermined period of time (e.g., 3 minutes), the first device 100 may request the second device 200 the recommended item associated with the content reproduced by the second device 200, which may be a display device installed in the bus.

[194] In step S630, the second device 200 may generate a recommended element associated with content reproduced by the second device 200. In the present exemplary embodiment, the second device 200 may generate the recommended element in real time at a time when the second device 200 receives the request to the recommended item from the first device. For example, the second device 200 may capture a screen that plays content at a point in time when the second device 200 receives the request. Then, the second device 200 may form a renewal element by associating the captured image with the playback position information indicating the playback position of the content that is reproduced while capturing.

[195] Before the second device 200 receives a request for a recommended item from the first device 100, the second device 200 may pre-generate the recommended item associated with the reproduced content. In this case, when the second device 200 receives the request for a recommended item from the first device 100, the second device 200 can retrieve the recommended item associated with the reproduced content from its storage device.

[196] In step S640, the second device 200 may provide a recommended item related to the reproduced content to the first device 100. For example, the second device 200 may transmit at least one of the renewal element, the application element, the additional information element, and the advertising element to the first device 100 via short-distance communication.

[197] After the second device 200 transmits the recommended item, if the recommended item is then updated, the second device 200 can transmit the updated recommended item to the first device 100. In the case of the item to resume, since the playback position of the content changes according to the expiration of time, the second device 200 may update the item to resume according to the changed position of the playback of content and may transmit the updated item to resume to the first device 100. When the second device 200 receives a request for the recommended item from the first device 100, second device 200 may periodically transmit the recommended item.

[198] The first device 100 may receive a recommended item from the second device 200 related to content reproduced by the second device 200.

[199] In step S650, the first device 100 may store a recommended item received in the second device 200 from the second device 200. Here, since the first device 100 is positioned in the service area 600 of the second device 200, the first device 100 can only store the recommended item in the storage device received from the second device 200, and may not display the recommended item on the screen.

[200] In step S660, the first device 100 may detect the output of the first device 100 from the service area 600 of the second device 200. In this case, in step S670, the first device 100 may display a recommended item on the screen.

[201] In other words, while the first device 100 is positioned in the service area 600 of the second device 200, the first device 100 may not display the recommended item received from the second device 200, and then when the first device 100 leaves the service area 600 of the second device 200, the first device 100 may display a recommended item on the screen related to content reproduced by the second device 200. In another exemplary embodiment, the order of steps S610-S670 may change more steps may be skipped. For example, if the second device 200 periodically broadcasts the recommended element in the broadcast mode, the step of requesting by the first device 100 from the second device 200 for the recommended element may not be required.

[202] With reference to FIG. 7, a method for providing a recommended item without using a control server 300 is described below, the method being implemented by the first device 100 and the second device 200.

[203] FIG. 7 is a flowchart of a method for displaying a recommended item, the method being carried out by the first device 100, according to another exemplary embodiment.

[204] In step S710, the first device 100 and the second device 200 may be able to communicate with each other. For example, the first device 100 and the second device 200 can connect to each other via a short-range network, such as Wi-Fi, Bluetooth, NFC, ZigBee, WFD, UWB, etc.

[205] In step S720, the second device 200 may reproduce the content. In the present exemplary embodiment, the content may include, but not limited to, training content, video content, broadcast content, game content, advertising content, still image content and news content.

[206] In another exemplary embodiment, the order of steps S710 and S720 may change. In other words, the second device 200 can play the content, while the second device 200 connects to the first device 100 via the communication network, or the second device 200 can connect to the first device 100 via the communication network after the second device 200 plays the content.

[207] In step S730, the first device 100 may calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on the plurality of pieces of event information. For example, the first device 100 may calculate the likelihood that a user of the first device 100 may view content reproduced by the second device 200 based on user input information, user status information, current position information, reservation history information, etc., and, therefore, it can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200. Since step S730 corresponds to step S420 shown in FIG. 4, a detailed description thereof is omitted here.

[208] In step S740, the first device 100 may determine whether or not the user level of the first device 100 has interest in the content reproduced by the second device 200 of a predetermined value (for example, whether the user is the first or the same is higher or not device 100 can view content reproduced by the second device 200, 85%). A predetermined value may be set in the first device 100, or may be set by a user.

[209] Since step S740 corresponds to step S425 shown in FIG. 4, a detailed description thereof is omitted here.

[210] In step S750, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher than the predetermined value, the first device 100 may request a recommended item from the second device 200. For example, when the likelihood that a user of the first device 100 can view content reproduced by the second device 200 is equal to or higher than 85%, the first device 100 may request a recommended item from the second device 200 related to the reproduced content.

[211] On the other hand, when the likelihood that a user of the first device 100 may view content reproduced by the second device 200 is less than a predetermined value, the first device 100 may not request a recommended item from the second device 200.

[212] In the present exemplary embodiment, the first device 100 in a predetermined context can evaluate (or can determine), without calculating the level of interest, that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher predefined value. In this case, the first device 100 may request a recommended item from the second device 200.

[213] For example, when the first device 100 has a purchase history regarding the purchase of a ticket to view content reproduced by the second device 200, or has a registration history regarding registration in the service area of the second device 200, the first device 100 may determine what level the interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or higher than a predetermined value, and may request from the second device 200 p Featured item.

[214] In step S760, the second device 200 may generate a recommended element related to content reproduced by the second device 200. For example, the second device 200 may form an element for renewal by using the captured image (ie, the image of the last screen) obtained by screen capturing, and playback position information (e.g., link information or index information) of the content. In addition, the second device 200 may generate an additional information item by using additional information of the reproduced content, or may form the element as an application by using application information corresponding to the reproduced content. Here, the second device 200 may form a recommended item in the form of an object for using the service or in the form of a list. However, the method for forming the recommended element is not limited to this.

[215] In step S770, the first device 100 may receive a recommended item. In the present exemplary embodiment, the first device 100 may periodically receive a recommended item from the second device 200.

[216] In step S780, the first device 100 may detect the exit of the first device 100 from the coverage area of the second device 200. If the first device 100 does not leave the coverage area of the second device 200, the first device 100 may not display the recommended item on the screen and may request again and receive the recommended item from the second device 200 (repeating steps S750-S770).

[217] In step S790, when the first device 100 detects the exit of the first device 100 from the coverage area of the second device 200, the first device 100 may display on the screen a recommended item related to content played through the second device 200. In case the first device 100 is periodically receives the recommended item from the second device 200, the first device 100 can display on the screen the recommended item that was last received by the first device before the first device 100 is detected output of the first device 100 of the second device 200. The service area in the present exemplary embodiment, the screen may include a first screen.

[218] According to the present exemplary embodiment, the first device 100 can perform context analysis, and then only when there is a high probability that the user of the first device 100 is viewing content reproduced by the second device 200, the first device 100 can request from the second device 200 the recommended an element associated with the content reproduced by the second device 200.

[219] The first device 100 may display a recommended item on a screen, taking into account contextual information.

[220] For example, when the first device 100 detects a user gesture of the first device 100 that requests the recommended item, the first device 100 may display the recommended item on the screen. The gesture for requesting a recommended item may vary.

[221] Additionally, the first device 100 may display a recommended item on the screen based on luminance information, tilt information, etc. For example, when the brightness of the first device 100 is less than a predetermined value, the first device 100 may not display the recommended item on the screen, and when the brightness of the first device 100 is equal to or higher than the predetermined value, the first device 100 may display the recommended item on the screen.

[222] In other words, if the user of the first device 100 holds the first device 100 in the user's pocket or does not carry the first device 100 in the user's hand, this may mean that the user does not intend to accept the recommended item. Thus, the first device 100 may not display a recommended item on the screen based on luminance information or tilt information.

[223] On the other hand, when the first device 100 leaves the service area of the second device 200, if the user of the first device 100 looks at the screen of the first device, while the user holds the first device 100 in the user's hand, the first device 100 can display on the screen a recommended item related to content reproduced by the second device 200.

[224] The first device 100 may display a recommended item according to a user-specified setting. For example, the first device 100 may provide a recommended item in the form of a pop-up window or may display the recommended item on a specific page.

[225] The first device 100 may scan the service area of the second device 200 that the first device 100 previously visited, and scanning may be performed within a predetermined range relative to the current position of the first device. When the service area of the second device 200, which was previously visited by the first device 100, is scanned, the first device 100 can retrieve the recommended item associated with the content that was previously played by the second device 200 and can display the recommended item on the screen.

[226] FIG. 8 is a flowchart of a method for providing a recommended item, the method being carried out by the second device 200 according to an exemplary embodiment. In this regard, repeated detailed descriptions of the identical steps of the method of FIG. 7 are omitted here.

[227] In step S810, the first device 100 and the second device 200 may be able to communicate with each other. In step S820, the second device 200 may reproduce the content. In step S830, the second device 200 may receive from the first device 100 a request for a recommended item related to content reproduced by the second device 200.

[228] In step S840, the second device 200 may form a recommended element. For example, the second device 200 may form an element in the form of an application, an element for renewal, an additional information element or an advertising element as a recommended element corresponding to the reproduced content, but one or more exemplary embodiments are not limited to this.

[229] In step S850, the second device 200 may transmit the recommended item to the first device 100.

[230] In step S860, the first device 100 may detect the output of the first device 100 from the coverage area of the second device 200. If the first device 100 does not leave the coverage area of the second device 200, the first device 100 may again request and receive a recommended item from the second device 200 ( repeating steps S830-S850). For example, when the first device 100 does not leave the service area of the second device 200, the first device 100 may periodically receive a recommended item that is updated in the second device 200.

[231] In step S870, when the first device 100 detects the exit of the first device 100 from the coverage area of the second device 200, the first device 100 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on the plurality of pieces of event information, which are received by the first device 100.

[232] In step S880, the first device 100 can determine whether the user’s interest in the first device 100 is equal to or higher than the content reproduced by the second device 200 of a predetermined value.

[233] For example, the first device 100 may determine whether or not the probability that the user of the first device 100 is able to view content reproduced by the second device 200 is 90%. When the likelihood that a user of the first device 100 may view content reproduced by the second device 200 is less than a predetermined value (for example, less than 90%), the first device 100 may not display a recommended item received from the second device 200 on the screen.

[234] In step S890, when the calculated level of user interest is equal to or higher than a predetermined value (eg, 90%), the first device 100 may display on the screen a recommended item received from the second device 200.

[235] According to the present exemplary embodiment, if the recommended item is periodically received, the first device 100 may display on the screen the recommended item that was last received by the first device before the first device 100 detects the exit of the first device 100 from the coverage area of the second device 200.

[236] The first device 100 may display a recommended item on the screen, taking into account contextual information. Step S890 corresponds to step S790 of the method of FIG. 7, whereby its detailed description is omitted here.

[237] Hereinafter, a case is described in detail in which when the first device 100 leaves the coverage area of the second device 200, the first device 100 directly generates and displays a recommended element related to content reproduced by the second device 200, with reference to FIG. 9 and 10.

[238] FIG. 9 illustrates a method for displaying a recommended item, the method being carried out by the first device 100, according to another exemplary embodiment.

[239] In step S910, the second device 200 may reproduce the content. Then, in step S920, the second device 200 may broadcast information regarding content reproduced by the second device 200. For example, the second device 200 may periodically broadcast at least one of a captured image obtained by capturing a screen that reproduces content, playback position information (e.g., URI, URL, etc.) indicating a playback position or location of content that is reproduced when simultaneously capturing application information corresponding to the content, additional information regarding the content information and advertising information corresponding to the content.

[240] In step S930, the first device 100, positioned in the service area 900 of the second device 200, can obtain information regarding the content reproduced by the second device 200. In other words, according to the present exemplary embodiment, the first device 100 can be registered in the information on the content, reproduced by the second device 200, while the first device 100 is positioned in the service area 900 of the second device 200.

[241] In step S940, the first device 100 may detect the output of the first device 100 from the service area 900 of the second device 200.

[242] For example, when communication with the second device 200 is terminated, the first device 100 may detect the output of the first device from the service area 900 of the second device 200.

[243] Further, when the first device 100 recognizes or detects an external device (eg, an NFC tag, a BLE tag, etc.) located outside the service area 900 of the second device 200 or at the boundary of the service area 900 of the second device 200, the first device 100 may determine that the first device has left the service area 900 of the second device 200.

[244] When the first device 100 stores information in advance about the service area 900 of the second device 200 or receives information about the service area 900 of the second device 200 from the second device 200, the first device 100 can detect the output of the first device from the service area 900 of the second device 200 by using the information the position of the first device 100.

[245] In step S950, the first device 100 may generate a recommended item based on information regarding content that is received from the second device 200. For example, the first device 100 may generate a renewal image associated with content reproduced by the second device 200 by using the captured images and information of the playback position, which are last accepted before the output of the first device is detected. Then, the first device 100 may form an element in the form of an application, an additional information element, and an advertising element that are associated with content reproduced by the second device 200.

[246] The first device 100 may display a recommended item on the screen of the first device 100. In the present exemplary embodiment, the screen may include a first screen.

[247] The first device 100 may generate a recommended item and then can immediately display the recommended item on the screen or can display the recommended item on the screen only when the first device 100 detects a gesture from a user who requests the recommended item.

[248] In other words, according to the present exemplary embodiment, the first device 100 may be registered in information regarding content reproduced by the second device 200, while the first device 100 is positioned in the service area 900 of the second device 200 and when the first device 100 exits of the service area 900 of the second device 200, the first device 100 may display on the screen (for example, the first screen) a recommended element associated with the content reproduced by the second device trinity 200. This process is described in detail with reference to FIG. 10.

[249] FIG. 10 is a flowchart of a method for displaying a recommended item, the method being carried out by the first device 100, according to another exemplary embodiment. In this regard, repeated detailed descriptions of the identical steps of the method of FIG. 9 are omitted here.

[250] In step S1010, the second device 200 may reproduce the content.

[251] In step S1020, the second device 200 may broadcast information (for example, an image, playback position information, additional information, advertising information, application information, etc.) regarding the reproduced content.

[252] In step S1030, the first device 100, positioned in the coverage area of the second device 200, can obtain information regarding the content reproduced by the second device 200. The first device 100 can control the received information regarding the content.

[253] In step S1040, the first device 100 can detect the exit of the first device 100 from the coverage area of the second device 200. The detection method performed by the first device 100 is already described above, and therefore, detailed descriptions thereof are omitted here.

[254] If the first device 100 does not leave the service area of the second device 200, the first device 100 may continue to collect a plurality of pieces of information regarding the content that are broadcast in the second device 200.

[255] In step S1050, when the first device 100 detects the output of the first device 100 from the coverage area of the second device 200, the first device 100 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on the plurality of pieces of event information, which are received by the first device 100.

[256] In step S1060, the first device 100 may determine whether or not the user level of the first device 100 has interest in the content reproduced by the second device 200 at a predetermined value (eg, 70%). As a result of the determination, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is less than a predetermined value (for example, 70%), the first device 100 cannot form a recommended element.

[257] In step S1070, when the calculated level of interest is equal to or higher than a predetermined value (for example, 70%), the first device 100 may generate a recommended item based on information regarding content that is received from the second device 200.

[258] In step S1080, the first device 100 may display a recommended item on the screen (for example, on the first screen).

[259] In the present exemplary embodiment, while the first device 100 is in the coverage area of the second device 200, the first device 100 may continue to receive information regarding content reproduced by the second device 200, and when the first device 100 leaves the coverage area of the second of the device 200, the first device 100 may form a recommended element associated with the content reproduced by the second device 200, and may display the recommended element on the screen.

[260] Furthermore, according to the present exemplary embodiment, the first device 100 can perform context analysis, and therefore, when it is highly likely that a user of the first device 100 can view content reproduced by the second device 200, the first device 100 can generate the recommended element associated with the content reproduced by the second device 200, and can display the recommended element on the screen so as to enable the user to continuously use the content reproduced by the second device 200, although the user goes out of the service area 200 of the second device.

[261] FIG. 11A and 11B illustrate screens for displaying one or more recommended items, according to an exemplary embodiment.

[262] As illustrated in FIG. 11A, the first device 100 may display recommended elements in a list form on the screen, wherein the recommended elements are associated with a plurality of pieces of content that are reproduced by a plurality of second devices 200. In other words, the recommended elements may be associated with a plurality of pieces of content reproduced by a plurality of second devices 200, each of which is different from each other. For example, if a user goes to the cinema by bus, watches a movie and then returns home by metro, the first device 100 may display a list of the first recommended item related to the cartoon content played on the bus, the second recommended item related to the video content shown in the cinema hall, and the third recommended element related to advertising content played at the subway station or subway train.

[263] The first device 100 may arrange a list of recommended items sequentially in time according to the times of formation of recommended elements or may arrange a list of recommended items in order according to the time periods in which the first device 100 remains in service areas.

[264] The first device 100 may identify a user selection regarding a recommended item 1100 associated with video content called “Kung Fu Panda” from a list of recommended items. The recommended element 1100 associated with video content called "Kung Fu Panda" may be a renewal element in which link information or index information is connected to a captured image that is obtained at a time when the first device 100 leaves the coverage area of the second device 200.

[265] For example, when a user of the first device 100 watches "Kung Fu Panda" video content on an airplane and then leaves the airplane at the user's destination, the first device 100 can detect that the user has left the airplane and then can display a renewal element for enabling the user to resume playing the Kung Fu Panda video content that the user was watching before leaving the plane. In one or more exemplary embodiments, a renewal element may be formed by the management server 300, the second device 200, or the first device 100.

[266] As illustrated in FIG. 11B, when the user of the first device 100 selects the recommended element 1100 associated with video content called “Kung Fu Panda”, the first device 100 can observe the link information or index information included in the recommended element 1100. Thereafter, based on the observed link information or the observed of index information, the first device 100 may resume playing content after a point in time when the first device 100 leaves the service area of the second device 200. For example, the first device 100 may to update the playback of video content "Kung Fu Panda", the viewing of which the user did not complete due to the departure from the plane

[267] FIG. 12A, 12B, and 12C illustrate a method of receiving a recommended item from an external device and displaying the recommended item, the method being performed by the first device 100, according to an exemplary embodiment.

[268] As illustrated in FIG. 12A, the first device 100 may detect a user gesture to request recommended items that are displayed on one or more external devices 400-1, 400-2, and 400-3. Here, in response to a user gesture, the first device 100 may transmit signals to one or more external devices 400-1, 400-2, and 400-3 in order to request recommended elements.

[269] As illustrated in FIG. 12B, the first device 100 may receive from one or more external devices 400-1, 400-2, and 400-3 recommended elements that are displayed on one or more external devices 400-1, 400-2, and 400-3. Then, the first device 100 can add recommended items received from one or more external devices 400-1, 400-2 and 400-3 to a predefined screen (or a predefined page) and can display recommended items.

[270] The user can observe recommended items (for example, recommended item 1, recommended item 2 and recommended item 3) received from one or more external devices 400-1, 400-2 and 400-3, and may delete some recommended items ( e.g. recommended item 2). In other words, in the event that the first device 100 detects a delete request gesture with respect to the recommended item 2, the first device 100 can remove the recommended item 2 from the list of recommended items. The delete request gesture may vary. For example, an example of a delete request gesture may include, but is not limited to, a swipe gesture, a scroll gesture, a quick touch gesture, and a drag and drop gesture.

[271] As illustrated in FIG. 12C, the first device 100 may remove the recommended item 2 from the list of recommended items for which a delete request gesture is detected, and may re-build the list of recommended items.

[272] FIG. 13A-13C illustrate a method for sharing a recommended item with an external device, the method being performed by the first device 100 according to an exemplary embodiment.

[273] As illustrated in FIG. 13A, the first device 100 may receive, from a user, a request for sharing for a recommended item that is shared with an external device.

[274] As illustrated in FIG. 13B, in response to a request for sharing from a user, the first device 100 may display a list of one or more external devices (e.g., a TV in the living room, a TV 1300 in the room, a refrigerator display, a brother’s mobile phone, etc.), Allow sharing of the recommended item. One or more external devices can be scanned next to the first device 100 via short-range communication (e.g., Bluetooth, Wi-Fi, etc.). In addition, according to the present exemplary embodiment, one or more external devices may be scanned based on universal automatic configuration of connected devices (UPnP).

[275] The first device 100 may detect a custom selection of a television 1300 in the living room from a list of one or more external devices (eg, television 1300 in the living room, television in the room, refrigerator display, sister's mobile phone, etc.).

[276] As illustrated in FIG. 13C, the first device 100 may transmit to the television 1300 in the living room a recommended item to which the user wants to share. Here, the first device 100 may perform the authentication procedure of the television 1300 in the living room. For example, the first device 100 can authenticate whether or not the television 1300 in the living room allows the display of a recommended item based on the authentication information, the identification information of the television 1300 in the living room, etc., which is received from the television 1300 in the living room.

[277] A living room television 1300 that receives the recommended item from the first device 100 may display the received recommended item on its screen. Then, the television 1300 in the living room can accept a user choice regarding the recommended item. If the recommended item received from the first device 100 is a renewable item, the living room TV 1300 may resume playing the content.

[278] If the recommended element received from the first device 100 is an additional information element associated with video content, the television 1300 in the living room can display on the screen many pieces of additional information, such as buying video on demand (VoD), buying an original audio track (OST), view movie details, etc. that are related to video content.

[279] FIG. 14A and 14B illustrate a method of providing a recommended item related to content reproduced by public transport, the method being carried out by the first device 100, according to an exemplary embodiment.

[280] As illustrated in FIG. 14A, if the user views the content by using the display device 1400 available on the plane and then leaves the plane at the destination, the user can no longer view the content.

[281] Here, as illustrated in FIG. 14B, the first device 100 may detect that the first device 100 is leaving the coverage area of the display device 1400 available on the aircraft and may display on the screen a recommended item related to the content reproduced by the display device 1400.

[282] FIG. 15A, 15B, and 15C illustrate a method of providing a recommended item associated with video content shown in a movie theater, the method being implemented by the first device 100 according to an exemplary embodiment.

[283] As illustrated in FIG. 15A, a user can watch a movie through the second device 200 in the movie theater and then can exit the movie theater before the movie is completed. In this case, the first device 100 can recognize an external device (for example, an NFC tag, a BLE tag, etc.) positioned at the entrance to the cinema hall, and, therefore, can determine that the first device 100 has left the service area second device 200.

[284] As illustrated in FIG. 15B, the first device 100 may provide an element for resuming to the screen of the first device 100 so as to enable the user of the first device 100 to resume playing content from the point in time when the user of the first device 100 leaves the coverage area of the second device 200, while the content is reproduced by the second device 200. Due to this, the user can continue to view the rest of the content that the user cannot watch in the cinema.

[285] As illustrated in FIG. 15C, the first device 100 may transmit recommended items (e.g., an additional information item and an advertising item) to an external device (e.g., a home TV 1500). In this case, the user can observe additional information related to the content shown in the cinema through the home TV 1500.

[286] FIG. 16A, 16B, 16C and 16D illustrate a method of providing a recommended item related to sports content reproduced in a sports complex according to an exemplary embodiment.

[287] As illustrated in FIG. 16A, a user can watch a baseball game in a baseball stadium. The user can then watch the details of the baseball game through the light board 1610 at the baseball stadium.

[288] As illustrated in FIG. 16B and 16C, when a user leaves the stands for some time in the middle of a baseball game, the first device 100 can recognize an external device 1620 (e.g., NFC tag, BLE tag, etc.) located outside the stands or at the border of the stands , and therefore can detect that the user has left the stands. In this case, the first device 100 may display an additional information item associated with the details of the baseball game that are displayed on the light board 1610, an application element for relaying the baseball game, and the like. as a recommended item on the screen.

[289] As illustrated in FIG. 16D, although the user leaves the stands, the user can continue to monitor the baseball game through the first device 100.

[290] FIG. 17A and 17B are block diagrams illustrating a configuration of a first device 100 according to an exemplary embodiment.

[291] As illustrated in FIG. 17A, the first device 100 may include a communication device 110, a sensor 130, and a controller 160 (also called a processor 160). However, not all items shown are required items. In other words, the first device 100 may be implemented with more or fewer elements than the elements shown.

[292] For example, as illustrated in FIG. 17B, the first device 100 may include a communication device 110, an output device 120, a sensor 130, a user input device 140, an audio / video (A / V) input device 150, a controller 160, and a storage device 170.

[293] Hereinafter, the above elements are described.

[294] The communication device 110 may include one or more elements for enabling communication between the first device 100 and the second device 200 or communication between the first device 100 and the management server 300. For example, the communication device 110 may include a mobile communication device 111, a short-range communication device 112, a position information determination device 113, and a wireless communication device 114.

[295] In addition, the mobile communication device 111 exchanges a wireless signal with at least one of the base station, the external terminal, and the server via the mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to text / multimedia messaging.

[296] The short-range communication device 112 is configured to short-range communication. In the present exemplary embodiment, examples of short-range communications may include, but are not limited to, Wi-Fi, Bluetooth technology, ZigBee, WFD, UWB, the IrDA standard, and BLE.

[297] The position information determining device 113 is configured to check or obtain the position of the first device 100. An example of the position information determining device 113 may include a GPS module. The GPS module receives multiple pieces of position information from multiple satellites. Here, each of the plurality of pieces of position information may include coordinate information consisting of latitude and longitude. In particular, the GPS module can obtain from the position information not only the position of latitude, longitude and altitude, but can also receive three-dimensional speed information and accurate time.

[298] The wireless communication device 114 is used to access the Internet or other networks wirelessly and can be integrated into the first device 100 or can be located outside the first device 100.

[299] The output device 120 may be operable to output an audio signal, a video signal, or a vibration signal, and may include a display 121, an audio output device 122, a vibration motor 123, etc.

[300] The display 121 displays and displays information that is processed in the first device 100. For example, the display 121 may display on the screen (for example, on the first screen) a recommended item associated with the content reproduced by the second device 200. In addition, the display 121 may display on the screen another recommended item that is received from an external device.

[301] When the display 121 and the touch panel form a mutual multi-layer structure, and then are formed as a touch screen, the display 121 can be used both as an output device and as an input device. The display 121 may include at least one of a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional display, and an electrophoretic display, but not limited to this. Furthermore, according to the type of the first device 100, the first device 100 may include at least two displays 121. Here, at least two displays 121 can be facing each other by using a hinge.

[302] In the present exemplary embodiment, the display 121 may be housed in an external device connected to the first device 100. The external device may include an input device, an output device, a control device, and the like.

[303] The display 121 may be included in the user's glasses. In this case, the first device 100 may display the recommended item through the user's glasses.

[304] The audio output device 122 may output audio data that is received from the communication device 110 or stored in the storage device 170. The audio output device 122 may also output an audio signal (for example, a ringtone, a message, etc.) associated with the characteristics performed by the first device 100. The audio output device 122 may include a speaker, a buzzer, and the like.

[305] The vibration motor 123 may output a vibration signal. For example, the vibration motor 123 may output a vibration signal that corresponds to the output of the audio data (for example, the sound of receiving a call signal, the sound of receiving a message, etc.) or video data. In addition, when a touch is entered into the touch screen, the vibration motor 123 can output a vibration signal, and when the first device 100 leaves the coverage area of the second device 200, the vibration motor 123 can output a vibration signal.

[306] The sensor 130 may collect a plurality of pieces of event information regarding events that occur in the first device 100. For example, the sensor 130 may detect the position of the first device 100, user state information, application information regarding at least one application used in the first device 100, information of transmitted / received messages, information of transmitted / received mail messages, call history information, SNS usage information, web page usage information anits, transaction information, position of the user's eyes, etc.

[307] The sensor 130 may also detect whether or not the first device 100 is leaving the coverage area of the second device 200. For example, the sensor 130 may detect that communication with the second device 200 is broken. In addition, the sensor 130 can recognize an external device located outside the service area or at the border of the service area of the second device 200.

[308] The sensor 130 can detect how far (for example, about N km) the first device 100 is from the coverage area of the second device 200 by using Wi-Fi information, GPS, a base station of a communication network, etc. In addition, when the user performs the registration procedure in the service area of the second device 200 by using the first device 100, the sensor 130 can estimate the travel distance that the first device 100 moves from the registration position by using the acceleration sensor.

[309] The sensor 130 may include various sensors so as to collect a plurality of pieces of event information. For example, the sensor 130 may include, but is not limited to, an acceleration sensor, a tilt sensor, a gyro sensor, a three-axis magnetic sensor, a voice recognition sensor, a brightness sensor, a temperature sensor, an image sensor (e.g., a camera), and a touch sensor.

[310] The sensor 130 may interact with a transparent detection platform (SSP) 10. SSP 10 may include a sensor concentrator and an SSP manager. Here, the sensor 130 may be connected to a sensor hub, and the SSP manager may be included in the infrastructure of the application processor 161 (AP).

[311] Thus, the sensor concentrator can collect a plurality of pieces of detection information (that is, a plurality of pieces of event information regarding events occurring in the first device 100) through the sensor 130. Here, in the event that the AP 161 is in standby mode ( for example, if the sensor 130 detects an exit from the coverage area of the second device 200), the sensor concentrator may transmit an interrupt signal to the SSP manager in order to inform the SSP manager of the data to be transmitted.

[312] The SSP manager may transmit a signal requesting from the sensor concentrator the type and length of data to be transmitted by the sensor concentrator. In this case, the sensor concentrator may transmit a signal to the SSP manager including the type and length of data to be transmitted. The SSP manager can send the detection start message to the sensor hub, and when the sensor hub receives the detection start message, the sensor hub can process the detection data as a predefined packet, and then it can transmit the packet to the SSP manager.

[313] In the present exemplary embodiment, the sensor 130 may be located in an external device that is connected to the first device 100. The external device may be associated with an application that runs in the first device 100. In another exemplary embodiment, one or more external devices. The first device 100 may control an external device by using an application.

[314] The first device 100 may receive data from an external device that is detected by a sensor 130 located in an external device. For example, if the temperature sensor is integrated into the watch and the acceleration sensor is integrated into the belt, the first device 100 may receive temperature information from the watch and may receive acceleration information from the belt. Here, the watch and belt can be controlled through an application installed in the first device 100.

[315] According to the present exemplary embodiment, various sensors can be separately integrated into peripheral devices, so that the power consumption of the first device 100 can be reduced.

[316] The user input device 140 may be a device by which a user inputs data in order to control the first device 100. For example, the user input device 140 may include a keyboard, a dome switch, a touch panel (touch-based capacitive touch panel) , resistive touch panel based on pressure, touch panel based on detection of infrared rays, touch panel on surface acoustic waves, touch panel based on nera Removable strain gauges, the touch pad on the piezoelectric effect, etc.), rotating the wheel and the rotary switch, but is not limited thereto.

[317] The A / V input device 150 may be configured to receive input of an audio signal or video signal, and may include a camera 151, a microphone 152, and the like. The camera 151 may receive a frame with an image, for example, a still image or a moving image, through an image sensor in a video call mode or a photo mode. An image captured through an image sensor may be processed by a controller 160 or a separate image processing device (not shown). The processed image frame may be displayed on display 121, may be stored in memory 170, or may be transmitted to an external source through communication device 110. According to the configuration of the first device 100, at least two cameras 151 can be placed.

[318] The microphone 152 may receive input of an external voice signal in a call mode, a recording mode, or a voice recognition mode, and may process the voice signal into electrical voice data. In call mode, the processed voice data can be converted in such a way as to be transmitted to the mobile communication base station via the mobile communication device 111, and then can be output.

[319] The controller 160 can, in general, control all the operations of the first device 100. In other words, the controller 160 can execute programs stored in the storage device 170, and therefore, can control the communication device 110, the output device 120, the sensor 130, the device 140 user input, an A / V input device 150, a storage device 170, and the like.

[320] The controller 160 may include an AP 161 and a communication processor 162. The AP 161 may control the execution of various applications stored in the storage device 170. The communication processor 162 may control various communication functions. In the present exemplary embodiment, the AP 161 and the communication processor 162 may be integrally implemented as a single hardware device or separately implemented as independent hardware devices.

[321] The storage device 170 may store a program to process and control the controller 160, or may store a plurality of pieces of data (eg, recommended item, content information, detection information, etc.) that are input / output.

[322] The storage device 170 may include at least one storage medium from flash memory based storage media, hard disk storage media, multimedia microcard storage media, memory cards based memory cards (e.g., SD card, XD storage device, etc.), random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable software toyannogo memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk. In addition, the first device 100 can manage web storage, which performs the function of storing the storage device 170 via the Internet.

[323] Programs stored in the memory 170 may be classified into a plurality of modules according to their functions, for example, a UI module 171, a touch screen control module 172, a context analysis module 173, recommended item control module 174, and the like.

[324] The UI module 171 may provide a UI or graphical user interface (GUI) that are specialized according to the applications. The touch screen control module 172 can detect a user's touch gesture on the touch screen and can transmit information related to the touch gesture to the controller 160. The touch screen control module 172 can be configured as a separate controller (hardware).

[325] Various sensors may be placed in / near the touch screen in order to detect touch or contactless touch on the touch sensor. An example of a sensor for detecting a touch on the touch screen 1503 may be a tactile sensor. The tactile sensor detects the contact of a specific object, at least as much as the user can detect. The tactile sensor can detect various types of information, such as contact surface roughness, contact object hardness, or contact point temperature.

[326] A user's touch gesture may include a quick touch gesture, a touch and hold gesture, a double quick touch gesture, a drag gesture, a pan gesture, a scroll gesture, a drag and drop gesture, and the like.

[327] “Quick Touch” is the movement of the user to touch the screen by using a finger or a touch tool, such as an electronic pen, and then immediately lifting a finger or touch tool from the screen without moving.

[328] “Touch and Hold” is the movement of the user to touch the screen by using a finger or a touch tool, such as an electronic pen, and then maintaining the above motion with touch for a critical time (for example, 2 seconds) after touching the screen. For example, the time difference between the start time of the touch and the end time of the touch is greater than or equal to the critical time, for example, 2 seconds. When the touch input lasts for more than a critical time, in order to inform the user that the touch input is a quick touch or touch and hold, the feedback signal may be provided in a visual, acoustic or tactile manner. Critical time may vary according to exemplary embodiments.

[329] “Double quick touch” is the movement of the user to touch the screen twice by using a finger or a touch tool (such as a stylus pen).

[330] Dragging is the movement of the user to touch the screen by using a finger or touch tool and moving the finger or touch tool to another position on the screen while continuing to move with the touch. A drag and drop motion may provide movement to move or pan an object.

[331] "Panning" is the movement of the user to perform a drag movement without selecting an object. Since the object is not selected when panning, the object does not move on the page, and the page itself moves on the screen, or a group of objects can move on the page.

[332] “Scrolling” is the movement of a user to perform a drag movement above a critical speed, for example, 100 pixels / s, by using a finger or a touch tool. The drag-and-drop (panning) movement or the scrolling movement may differ based on whether or not the finger or sensor tool moves faster than a critical speed, for example, 100 pixels / s.

[333] “Drag and Drop” is the movement of a user to drag an object to a predetermined position on the screen by using a finger or a touch tool, and then releasing the object at that position.

[334] "Pinch" is the movement of the user to move two fingers touching the screen in opposite directions. A constriction movement is a gesture to enlarge (dilute) or contract (reduce) an object or page. The magnification value or reduction value is determined according to the distance between two fingers.

[335] “Swipe” is the movement of the user to touch an object on the screen by using a finger or a touch tool and simultaneously moving the object horizontally or vertically at a predetermined distance. The swipe movement in the diagonal direction may not be recognized as a swipe event.

[336] The storage device 170 may include a voice recognition module (not shown) that recognizes a user's voice by using a voice recognition mechanism and transmits the recognized voice to the controller 160.

[337] The context analysis module 173 may analyze the context based on a plurality of pieces of event information collected by the sensor 130. For example, the context analysis module 173 may calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200. In the present exemplary embodiment , the context analysis module 173 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on the information and user input information, user state, current position information, history information, etc. reservations

[338] For example, when the user of the first device 100 performs the registration procedure with respect to the second device 200 or the service area of the second device 200 by using the first device 100, the context analysis module 173 can calculate the high level of interest of the user of the first device 100 in the content reproduced by the second device 200 .

[339] The context analysis module 173 can calculate the likelihood that a user of the first device 100 can view content reproduced by the second device 200, and therefore, can calculate the level of interest of the user of the first device 100. Here, the context analysis module 173 can calculate the probability of that the user of the first device 100 can view content reproduced by the second device 200 based on the user state information, current position information, information and applications regarding the application running in the first device 100, and the like.

[340] For example, when a user of the first device 100 downloads data to the first device 100 that is provided by the second device 200, or inputs recommendation information to the first device 100 so as to recommend content played by the second device 200 to another user via SNS, the context analysis module 173 can calculate a high probability (for example, approximately 95%) that a user of the first device 100 can view content reproduced by the second device wa 200.

[341] Furthermore, when the position of the first device 100 does not change in the coverage area of the second device 200 for a predetermined period of time, and the user input is not detected for a predetermined period of time, the context analysis module 173 can calculate a high probability (for example, approximately 90%) that a user of the first device 100 can view content reproduced by the second device 200.

[342] On the other hand, although the first device 100 is positioned in the service area of the second device 200 for a predetermined period of time, while the first device 100 is positioned in the service area of the second device 200, if the first device 100 receives from the user the first device 100 a request for execution regarding an application that is irrelevant for content reproduced by the second device 200, the context analysis module 173 may calculate a low probability (e.g. an example, approximately 30%) that a user of the first device 100 can view content reproduced by the second device 200.

[343] In the present exemplary embodiment, the context analysis module 173 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200 based on the information obtained by detecting the user's eyes through the camera 151.

[344] When the first device 100 has a purchase history regarding the purchase of a ticket regarding content reproduced by the second device 200, or has a registration history regarding the service area of the second device 200, the context analysis module 173 may determine that the level of interest of the user of the first device 100 to the content reproduced by the second device 200 is equal to or higher than a predetermined value.

[345] In the present exemplary embodiment, the context analysis module 173 can analyze the event information collected on the basis of the ontology, and therefore can receive information regarding the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[346] For example, the context analysis module 173 may obtain information regarding the correlation between the user's text / voice inputs and the content reproduced by the second device 200 based on the ontology. Based on the information regarding the correlation between the user's text / voice input and the content reproduced by the second device 200, the context analysis module 173 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[347] Recommended item management module 174 can manage recommended items that are received from control server 300, second device 200, or an external device. In addition, the recommended item management module 174 can directly generate the recommended item based on information regarding content that is received from the second device 200.

[348] FIG. 18 is a block diagram illustrating a configuration of a second device 200 according to an exemplary embodiment.

[349] As illustrated in FIG. 18, the second device 200 may include a communication device 210, an output device 220, a user input device 230, a controller 240 (also called a processor 240) and a storage device 250. However, not all elements shown are required elements. In other words, the second device 200 may be implemented with more or fewer elements than the elements shown.

[350] Hereinafter, the above elements are described.

[351] The communication device 210 may include one or more elements for enabling communication between the second device 200 and the first device 100 or communication between the second device 200 and the management server 300. For example, the communication device 210 may include a mobile communication device 211, a short-range communication device 212, a position information determination device 213, and a wireless communication device 214.

[352] In the present exemplary embodiment, examples of short distance communications may include, but are not limited to, Wi-Fi, Bluetooth technology, ZigBee, WFD, UWB, the IrDA standard, and BLE.

[353] The communication device 210 may transmit information regarding the content to the first device 100 or to the management server 300. In addition, the communication device 210 may transmit the recommended content-related item to the first device 100 or to the management server 300.

[354] The communication device 210 may periodically broadcast, via short-distance communications, information regarding the management server 300 to which a recommended element associated with content reproduced by the second device 200 corresponds. Information regarding the management server 300 may include reference information ( e.g. URL) to access the management server 300.

[355] The output device 220 may be operable to output an audio signal, a video signal, or a vibration signal, and may include a display 221, an audio output device 222, a vibration motor 223, etc.

[356] The display 221 displays and outputs information that is processed in the second device 200. For example, the display 221 may display content reproduced by the second device 200 on the screen.

[357] In addition, the display 221 may display information regarding the control server 300, which corresponds to the recommended element associated with the content reproduced by the second device 200, through a two-dimensional bar code (eg, QR bar code), color code, code Gray, etc.

[358] When the display 221 and the touch panel form a mutual multi-layer structure, and then are formed as a touch screen, the display 221 can be used both as an output device and as an input device. The display 221 may include at least one of an LCD, a TFT LCD, an organic light emitting diode display, a flexible display, a three-dimensional display, and an electrophoretic display. In addition, according to the type of the second device 200, the second device 200 may include at least two displays 221.

[359] The audio output device 222 outputs audio data that is received from the communication device 210 or stored in the storage device 250. The audio output device 222 outputs an audio signal associated with functions that are performed by the second device 200. The audio output device 222 may include speaker, buzzer, etc.

[360] The vibration motor 223 may output a vibration signal. For example, the vibration motor 223 may output a vibration signal that corresponds to the output of audio data or video data. In addition, when a touch is entered into the touch screen, the vibration motor 223 can output a vibration signal.

[361] The user input device 230 may be a device by which a user inputs data in order to control the second device 200. For example, the user input device 230 may include a keyboard, a dome switch, a touch panel (touch-based capacitive touch panel) , resistive touch panel based on pressure, touch panel based on detection of infrared rays, touch panel on surface acoustic waves, touch panel based on nera Removable strain gauges, the touch pad on the piezoelectric effect, etc.), rotating the wheel and the rotary switch, but is not limited thereto.

[362] The controller 240 can, in general, control all the operations of the second device 200. In other words, the controller 240 can execute programs stored in the storage device 250, and therefore, can control the communication device 210, the output device 220, the user input device 230 storage device 250 and the like

[363] The storage device 250 may store a program for processing and controlling the controller 240, or may store a plurality of pieces of data (eg, recommended item, content information, detection information, etc.) that are input / output.

[364] The storage device 250 may include at least one data storage medium from a flash memory data storage medium, hard disk data storage medium, multimedia micro-card data storage medium, card-based memory devices memory (for example, an SD card, an XD storage device, and the like), RAM, SRAM, ROM, EEPROM, PROM, a magnetic storage device, a magnetic disk, and an optical disk. In addition, the second device 200 can manage web storage, which performs the function of storing the storage device 250 via the Internet.

[365] Programs stored in memory 250 may be classified into a plurality of modules according to their functions, for example, a UI module 251, a content reproducing module 252, a recommended item generation module 253, a content management module 254, and the like.

[366] The UI module 251 may provide UIs, GUIs, and the like that are specialized according to a plurality of pieces of content or applications. The content reproducing unit 252 may reproduce the content. The functions of the UI module 251 and the content reproducing module 252 can be intuitively derived by those skilled in the art with reference to the names of the sensors, whereby a detailed description thereof is omitted here.

[367] Recommended item generation module 253 may generate a recommended item associated with reproduced content. For example, the recommended element generating unit 253 may generate an element for resuming by using the captured image of the content reproduction screen and information of the reproduction position indicating the reproduction position of the content at the time the image is captured. In addition, the module 253 of the formation of recommended elements can form an element in the form of an application, an advertising element, an additional information element, etc., which correspond to the reproduced content.

[368] The content management module 254 may control content reproduced by the second device 200, information regarding the content, and the like.

[369] FIG. 19 is a block diagram illustrating a configuration of a management server 300 according to an exemplary embodiment.

[370] As illustrated in FIG. 19, the control server 300 may include a communication device 310, a controller 320, and a storage device 330. However, not all elements shown are mandatory elements. In other words, the control server 300 may be implemented with more or fewer elements than the elements shown.

[371] Hereinafter, the above elements are described.

[372] The communication device 310 may include one or more elements for enabling communication between the management server 300 and the first device 100 or communication between the management server 300 and the second device 200.

[373] The communication device 310 may receive, from the first device 100, a request for a recommended item related to content reproduced by the second device 200. The communication device 310 may request information from the second device 200 regarding content reproduced by the second device 200, and may receive the requested information. The communication device 310 may transmit to the first device 100 a recommended item related to content reproduced by the second device 200.

[374] The communication device 310 may transmit a recommended content-related item to a cloud server that connects to the first device 100.

[375] The controller 320 may, in general, control all operations of the management server 300. In other words, the controller 320 may execute programs stored in the storage device 330, and therefore, may provide the first element 100 with a recommended element associated with the content reproduced by the second device 200.

[376] The storage device 330 may store a program to process and control the controller 320, or may store a plurality of pieces of data (eg, recommended item, content information, detection information, etc.) that are input / output.

[377] Programs stored in memory 330 may be classified into a plurality of modules according to their functions, for example, context analysis module 331, recommended elements generation module 332, service area management module 333, and the like.

[378] The context analysis module 331 may analyze the context based on a plurality of pieces of event information collected by the first device 100. For example, the context analysis module 331 may calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200, the probability that a user of the first device 100 can view content reproduced by the second device 200, and the like. The context analysis module 331 can calculate the probability that a user of the first device 100 can view content reproduced by the second device 200 based on user input information, user status information, position information, reservation history information, etc.

[379] When the first device 100 has a purchase history regarding the purchase of a ticket to view the content played by the second device 200, or has a registration history regarding the coverage area of the second device 200, the context analysis module 331 may determine that the level of interest of the user of the first device 100 to the content reproduced by the second device 200 is equal to or higher than a predetermined value.

[380] According to the present exemplary embodiment, the context analysis module 331 can analyze a plurality of pieces of event information collected by the first ontology device 100, and therefore can analyze the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

[381] For example, the context analysis module 331 may obtain correlation information regarding the correlation between the user’s text / voice inputs and the content reproduced by the second device 200 based on the ontology, and then can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200, by using correlation information.

[382] Recommended item generation module 332 may generate a recommended item related to content reproduced by the second device 200 at a time when the first device 100 leaves the coverage area of the second device 200, based on information regarding the content received from the second device 200.

[383] Recommended item generation module 332 may generate an item to resume by using captured image information obtained by capturing an image of content reproduced by the second device 200 at a time when the first device 100 leaves the coverage area of the second device 200 and the playback position information relative to the playback position of the content reproduced by the second device 200 at a time when the first device 1 00 leaves the service area of the second device 200. In addition, the module 332 for the formation of recommended elements can form an element in the form of an application, an advertising element, an additional information element, etc., as a recommended element that corresponds to the reproduced content.

[384] The service area management module 333 may control a plurality of pieces of information regarding the service area of the second device 200, which provides a content rendering service. For example, service area management module 333 may control the position of the second device 200, the location of the service area of the second device 200, the identification information of the second device 200, information regarding content reproduced by the second device 200, and the like.

[385] According to one or more exemplary embodiments, the first device 100, which is the user's personal device, enables the user of the first device 100 to perceive again through the first device 100 a service that the user previously perceived through another device other than the first device 100 .

[386] One or more exemplary embodiments may also be implemented as programmable instructions that must be executed in various computer tools and then can be written to a computer-readable recording medium. A computer-readable recording medium may include one or more of programmable instructions, data files, data structures, and the like. Programmable instructions recorded on a computer-readable recording medium may be specifically designed or configured for one or more exemplary embodiments, or may be known to those skilled in the art. Examples of computer-readable recording media include magnetic media including hard disks, magnetic tapes and floppy disks, optical media including CD-ROMs and DVDs, magneto-optical media including floppy disks and hardware devices designed to to save and execute programmable commands in ROM, RAM, flash memory, etc. Examples of programmable instructions include not only machine codes generated by the compiler, but also include voluminous codes that must be executed on the computer through the use of an interpreter. A hardware device may be configured to act as one or more software modules in order to perform the steps of one or more exemplary embodiments, and vice versa.

[387] It should be understood that the exemplary embodiments described herein are to be considered only in a descriptive sense and not for purposes of limitation. Descriptions of features or aspects in each exemplary embodiment typically should be considered available for other similar features or aspects in other exemplary embodiments.

[388] Although one or more exemplary embodiments are described with reference to the drawings, those skilled in the art should understand that various changes in form and detail can be made to them without departing from the spirit and scope of the inventive concept defined by the appended claims.

Claims (25)

1. The first device, configured to display information related to content reproduced by the second device, the first device comprising: - a sensor configured to detect the output of the first device from the service area of the second device; - a communication tool configured to exchange data with a server; and - a controller configured to control the communication means in order to request from the server information related to the content reproduced by the second device based on the detection of the output of the first device from the service area of the second device and to receive the requested information related to the content from the server, and control the display of the first device to display information related to content received from the server. 2. The first device according to claim 1, wherein the sensor is configured to detect a disconnection of communication between the first device and the second device. 3. The first device according to claim 1, wherein the sensor is configured to detect the output of the first device from the service area of the second device based on recognition by an external device located outside the service area of the second device or located on the border of the service area of the second device. 4. The first device according to claim 1, in which the controller is configured to obtain the level of interest of the user of the first device in the content reproduced by the second device based on event information collected by the first device and to control the communication means to request information from the server, associated with the content through the communication device, if the received level of interest is equal to or higher than a predetermined value. 5. The first device according to claim 4, in which the controller is configured to calculate the probability that a user of the first device will view content reproduced by the second device based on event information collected by the first device. 6. The first device according to claim 1, wherein the controller is configured to control the communication means to request information related to the content from the server by transmitting at least one of information regarding the second device and information regarding the service area of the second device to the control server . 7. The first device according to claim 1, wherein the information related to the content comprises an image of the content connected to at least one of the link information and the index information. 8. The first device according to claim 1, in which the information related to the content contains at least one of an element in the form of an application corresponding to the content, a renewal element corresponding to the content, an additional information element corresponding to the content, and an advertising element corresponding to to the content. 9. The first device according to claim 1, in which the controller is configured to control the display so as to display information related to the content on the first screen, which is displayed when the operating mode of the first device is switched from standby to active mode. 10. The first device according to claim 1, in which the service area of the second device comprises at least one of a communication area in which the first device communicates with the second device, and a viewing area in which the user of the first device views content reproduced by the second device . 11. A server containing: - communication means configured to exchange data with the first device and the second device; a controller configured to control the communication means so that when the first device leaves the service area of the second device that reproduces the content, receive request information from the first device requesting an object related to the content, and request information on the content from the second device, reproduced by the second device at a time when the first device leaves the service area of the second device and receive information regarding the content of the second device; and - generate an object associated with the content based on information regarding the content and transmit the generated object associated with the content through the communication medium to the first device. 12. The server according to claim 11, in which the controller is configured to obtain the level of interest of the user of the first device in the content reproduced by the second device based on event information collected by the first device, and to form an object associated with the content if the received level of interest equal to or higher than a predetermined value. 13. The server of claim 11, wherein the request information comprises at least one of information regarding a second device and information regarding a service area of a second device. 14. The server according to claim 11, in which the controller is configured to control the communication means to request information from the second device regarding content reproduced by the second device at a time when the request information is received from the first device. 15. A method of displaying information related to content reproduced by a second device, the method being carried out by the first device and comprising the steps of: - detect the output of the first device from the service area of the second device; - request information from the server related to the content reproduced by the second device based on the detection of the output of the first device from the service area of the second device and receive the requested information related to the content from the server; - receive information related to content from the server; and - display information related to the content received from the server.

Images