ES2736408T3 - Procedure and apparatus for displaying an object related to content reproduced by a second device - Google Patents

Abstract

A first device (100) configured to display an object related to content played by a second device (200), the first device (100) comprising: a sensor (130) configured to detect an output of the first device (100) from a zone the second device (200); a communicator (110) configured to communicate with a server (300); and a controller (160) configured to control the communicator (110) to transmit a request to the server (300) for the object related to the content played by the second device (200) when the output of the first device (100) is detected from the service area of the second device (200) and to receive the requested object related to the content of the server (300), and control a screen of the first device (100) to display the object related to the content received from the server (300) ; wherein the service area is an area where the second device (200) provides a service to the first device (100); wherein the request comprises at least one of service area ID information, location information of the second device (200), and ID information of the second device (200); and wherein the controller (160) is configured to obtain a level of interest from a user of the first device (100) in the content played by the second device (200), based on event information collected by the first device (100). ), and controlling the communicator (110) to transmit the request to the server (300) for the content related object if the level of interest obtained is equal to or greater than a predetermined value.

Description

DESCRIPTION

Procedure and apparatus for displaying an object related to content reproduced by a second device

Related Requests

This application claims priority of Korean Patent Applications No. 10-2013-0011492, filed on January 31, 2013, and 10-2013-0085680, filed on July 19, 2013 at the Korean Intellectual Property Office.

Background

1. Field

The procedures and apparatus consistent with the exemplary embodiments refer to a display procedure, on a screen, of an object that is related to content reproduced by a second device, and a procedure and system for providing the object related to the content reproduced by the second device to the first device, the procedure and system performed by the second device or a management server.

2. Description of the related technique

Due to developments in communication and visualization technologies, users observe various types of content that are provided in public places. For example, a user can check various administrative procedures, product information, information about the use of various facilities, tourist information about surrounding areas, or the like in a display device (for example, a kiosk) equipped in public places such as a government agency, a local government entity, a department store, an airport, or a train station. Also, the user can display movie content on an available display device on an airplane or an express bus, or can display broadcast content such as news on an available display device on a platform or a waiting room.

Since the user may not remain in the public place, the user has to stop viewing the content played in the public place, and then move to a different location.

Therefore, there is a demand for a system to allow a user, after the user leaves the public place, to continuously use a service that was provided in the public place, in a personal user terminal.

US 2012/254347 A1 discloses a system and procedure for providing complementary content associated with an information device, which includes a user device that detects the information device and that the information device has associated complementary content. A next stage includes requesting a delivery of the complementary content. A next stage includes the delivery of complementary content to a remote device, such as a domestic television. A next step includes presenting the complementary content to a user on the remote device.

Document US 2010/042235 A1 discloses systems, procedures, and computer-readable media for adaptive content representation, the method comprising receiving media content for playback to a user, adapting media content for playback on a first device at the user's first location, receive a notification when the user changes to a second position, adapting the media content for playback on a second device at the second location, and transfer the media content playback from the first device to the second device . One aspect conserves energy by optionally turning off the first device after switching to the second device. Another aspect includes playback devices that are "dumb devices" that receive media content already prepared for playback, "smart devices" that receive media content in a less than available way and prepare media content for playback, or Smart devices and silly hybrids. A single device can be replaced by a plurality of devices. Adapting media content for playback is based on a user profile that stores user preferences and / or usage history in one aspect.

Daisaku Komiya, Xu Mingqiang, Eunsoo Shim, Panasonic: "Use cases for Session Mobility in Multimedia Applications" (MMUSIC Working Group; Internet Draft "summarizes the use cases for session mobility in multimedia applications.

Summary

One or more exemplary embodiments provide a method and system for providing through a first device a recommendation element related to the content played by a second device to a user of the first device, in which the user has been viewing the content and then exits a service area of the second device.

In accordance with a first aspect of the present invention, a first device configured to display an object related to content reproduced by a second device is provided. The first device comprises: a sensor configured to detect an output of the first device from a service area of the second device; a communicator configured to communicate with a server; a controller configured to control the communicator to transmit a request to the server for the object related to the content played by the second device when the output of the first device is detected from the service area of the second device and to receive the requested object related to the server content, and control a screen of the first device to display the object related to the content received from the server; in which the service zone is an area where the second device provides a service to the first device; wherein the request comprises at least one of service area ID information, position information of the second device, and ID information of the second device; and in which the controller is configured to obtain a level of interest of a user of the first device in the content played by the second device, based on event information collected by the first device, and control the communicator to transmit the request to the server for the object related to the content if the level of interest obtained is equal to or greater than a predetermined value.

In accordance with a second aspect of the present invention, there is provided a method of displaying an object related to content reproduced by a second device, the procedure performed by a first device and comprising: detecting an output of the first device from an area of second device service; transmitting a request to a server for the object related to the content played by the second device when the output of the first device from the service area of the second device is detected; receive the object related to the content of the server; and display the object related to the content received from the server; wherein the request comprises at least one of service area ID information, position information of the second device, and ID information of the second device; wherein the procedure further comprises obtaining a level of interest of a user of the first device in the content reproduced by the second device, based on event information collected by the first device; and in which transmitting the request comprises transmitting the request to the server for the object related to the content if the level of interest obtained is equal to or greater than a predetermined value.

In accordance with a third aspect of the present invention, there is provided a non-transient computer readable recording medium having a computer program recorded therein to execute a procedure performed by a first device comprising: detecting an output of the first device of a service area of the second device; transmitting a request to a server for the object related to the content played by the second device when the output of the first device from the service area of the second device is detected; receive the object related to the content of the server; and display the object related to the content received from the server; wherein the request comprises at least one of service area ID information, position information of the second device, and ID information of the second device; wherein the procedure further comprises obtaining a level of interest of a user of the first device in the content reproduced by the second device, based on event information collected by the first device; and in which transmitting the request comprises transmitting the request to the server for the object related to the content if the level of interest obtained is equal to or greater than a predetermined value.

A first device configured to display at least one object related to content reproduced by a second device is also disclosed, the first device comprises a sensor configured to detect an output of the first device from a service area of the second device during content playback by the second device; a communication device configured to request, from a management server, an object related to the content, including the link information object to receive information about the content played by the second device at a time point when the sensor detects the output of the first device, and configured to receive the object related to the content of the management server; and a controller configured to control a screen to display the received object related to the content on a predetermined screen of the first device.

A management server is also disclosed that includes a communication device configured to, if a first device leaves a service area of a second device that reproduces content, receiving first request information from the first device to request an object related to the content , requesting the second device information about the content played by the second device at a time point when the first device leaves the service area of the second device, and receiving information about the content of the second device; and a controller configured to generate the content-related object based on the information about the content, and transmit the generated object related to the content through the communication device to the first device.

A first device configured to display an object related to content reproduced by a second device that includes a communication device configured to receive an object related to content reproduced by the second device, of the second device in a predetermined cycle, including the object is also disclosed. link information to receive information about the content; and a sensor configured to detect an output of the first device from a service area of the second device during content playback by the second device; and a controller configured to control a screen to display the object related to the content on a predetermined screen of the first device at a time point when Detects the output of the first device.

A first device configured to display an object related to content reproduced by a second device that includes a communication device configured to receive information about content reproduced by the second device, of the second device when the first device is in a zone of unveiling is also disclosed. second device service; a sensor configured to detect an output of the first device from the service area of the second device during content playback by the second device; a controller configured to generate the content-related object based on the information received about the content at a time point when the output is detected; and a screen configured to display the generated object related to the content on a predetermined screen of the first device.

A method, performed by a first device, of displaying an object related to content reproduced by a second device is also disclosed, comprising detecting an output of the first device from a service area of the second device during content playback by the second device. ; request from a management server an object related to the content, including the link information object to receive information about the content played by the second device at a time point when a detector detects the output of the first device from the service area of the second device; receive the object related to the content of the management server; and display the received object related to the content on a predetermined screen of the first device.

A procedure, performed by a management server, of providing an object is also disclosed, comprising, if a first device leaves a service area of a second device that reproduces content, receiving request information from the first device to request a object related to the content; requesting the second device information about the content played by the second device at a time point when the first device leaves the service area of the second device; receive information about the content of the second device; generate the object related to the content based on the information about the content; and transmit the generated object related to the content to the first device.

Brief description of the drawings

These and / or other aspects will become apparent and will be more readily appreciated from the following description of the exemplary embodiments, taken in conjunction with the accompanying drawings in which:

Figure 1 is a diagram of a system that provides the object according to an exemplary embodiment; Figure 2 is a flow chart of a procedure for displaying a recommendation element, the procedure performed by a first device, in accordance with an exemplary embodiment;

Figure 3 illustrates a procedure for displaying a recommendation element, the procedure performed by the first device, in accordance with another exemplary embodiment;

Figure 4 is a flow chart of a procedure for displaying a recommendation element after the first device performs a context analysis, the procedure performed by the first device, in accordance with an exemplary embodiment;

Figure 5 is a flow chart of a procedure for supplying a recommendation element, the procedure performed by a management server, in accordance with an exemplary embodiment;

Figure 6 is a flow chart of a procedure for displaying a recommendation element, the procedure performed by the first device, in accordance with another exemplary embodiment;

Figure 7 is a flow chart of a procedure for displaying a recommendation element, the procedure performed by the first device, in accordance with another exemplary embodiment;

Figure 8 is a flow chart of a method of supplying a recommendation element, the procedure performed by a second device, in accordance with an exemplary embodiment; Figure 9 illustrates a procedure for displaying a recommendation element, the procedure performed by the first device, in accordance with another exemplary embodiment;

Figure 10 is a flow chart of a procedure for displaying a recommendation element, the procedure performed by the first device, in accordance with another exemplary embodiment;

Figures 11A and 11B illustrate screens for displaying one or more recommendation elements, according to an exemplary embodiment;

Figures 12A, 12B and 12C illustrate a procedure of receiving a recommendation element from an external device and displaying the recommendation element, the procedure performed by the first device, in accordance with an exemplary embodiment;

Figures 13A to 13C illustrate a procedure for sharing a recommendation element with an external device, the procedure performed by the first device, in accordance with an exemplary embodiment; Figures 14A and 14B illustrate a method of supplying a recommendation element related to the content reproduced by public transport, the procedure performed by the first device, in accordance with an exemplary embodiment;

Figures 15A, 15b, and 15C illustrate a method of supplying a recommendation element related to film content shown in a cinema, the procedure performed by the first device, in accordance with an exemplary embodiment;

Figures 16A, 16B, 16C and 16D illustrate a method of supplying a recommendation element related to sports content reproduced in a sports complex, according to an exemplary embodiment;

Figures 17A and 17B are block diagrams illustrating a configuration of the first device, in accordance with an exemplary embodiment;

Figure 18 is a block diagram illustrating a configuration of the second device according to an exemplary embodiment; Y

Figure 19 is a block diagram illustrating a configuration of a management server according to an exemplary embodiment.

Detailed description of exemplary embodiments

All terms including descriptive or technical terms used herein should be construed as having meanings that are apparent to one skilled in the art. However, the terms may have different meanings according to an intention of an expert in the field, previous cases, or the emergence of new technologies. Also, some terms can be selected arbitrarily by the applicant, and in this case, the meaning of the selected terms will be described in detail in the detailed description of the exemplary embodiments. Therefore, the terms used in this document have to be defined based on the meaning of terms along with the description throughout the specification.

Also, when a part "includes" or "comprises" an element, unless there is a particular description contrary to it, the part may additionally include other elements, not excluding the other elements. In the following description, terms such as "unit" and "module" indicate a unit for processing at least one function or operation, in which the unit and the block can be performed as hardware or software or can be performed by combining hardware and software.

Throughout the descriptive memory, the expression "first screen" means a screen that is first displayed on a device when the device is turned on, a block is unlocked in the device, or a mode of operation of the device is switched from a standby mode to an active mode. In one or more exemplary embodiments, the first screen may be, but not limited to, a device home screen, a device menu screen, or a device background screen. In one or more exemplary embodiments, the first screen may be a gateway for the device to provide a service. For example, the device can provide a recommended service through the first screen.

One or more exemplary embodiments will now be described more fully with reference to the attached drawings. However, the one or more exemplary embodiments may be performed in many different ways, and should not be construed as being limited to the exemplary embodiments set forth herein; instead, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the one or more exemplary embodiments to those skilled in the art. In the following description, well-known functions or constructions are not described in detail since they would obscure the one or more exemplary embodiments with unnecessary detail, and similar reference numbers in the drawings indicate similar or similar elements throughout the entire specification.

Expressions such as "at least one of", when they precede a list of elements, modify the entire list of elements and do not modify the individual elements of the list.

Figure 1 is a diagram of a system that provides the object according to an exemplary embodiment.

As illustrated in Figure 1, the system providing the object may include a first device 100, a second device 200, and a management server 300. However, not all items shown are necessary items. That is, the system that provides the object can be made with more or less elements than the elements shown. For example, in other exemplary embodiments, the management server 300 may or may not be included in the system that provides the object. First, the exemplary embodiment in which the system providing the object will now be described includes the management server 300, and then another exemplary embodiment in which the system providing the object does not include the management server 300 will be further described. forward with reference to Figures 6 to 10.

The first device 100 may be a device that displays an object related to content reproduced by an external device (for example, a public device). Hereinafter, 'the object related to the content' can be expressed as a 'recommendation element related to content'. In the present exemplary embodiment, the object related to the content may include link information to receive information related to the content. At this point, 'information related to content' can be expressed as 'information about content'.

The first device 100 may be a personal mobile device. The first device 100 can be made in a different way. For example, throughout the descriptive memory, the first device 100 can be, but not limited to, a mobile phone, a smartphone, a laptop, a tablet PC, an electronic book terminal, a terminal for digital broadcasting, a personal digital assistant (PDA), a portable media player (PMP), a navigation device, an MP3 player, and a digital camera. The first device 100 may be a wearable device that a user can carry. For example, the first device 100 may be a wrist watch, glasses, a ring, a bracelet, a necklace, or the like, but not limited to the same.

The first device 100 may be located in a service area of the second device 200 and may leave the service area. The service area of the second device 200 means an area where the second device 200 can provide a service to a user or other device. For example, the service area of the second device 200 may include an area where the second device 200 can provide a communication service, an area where the second device 200 can provide a content playback service, or the like.

When the first device 100 is located in the service area of the second device 200, the first device 100 can communicate with the second device 200. For example, the first device 100 can perform short distance communication with the second device 200. Examples Short distance communication may include, but is not limited to, a wireless local area network (LAN) (for example, Wi-Fi), near field communication (NFC), Bluetooth, Bluetooth Low Energy (BLE), ZigBee , Wi-Fi Direct (WFD), and ultra-broadband (UWB). The first device 100 may be wired or wirelessly connected to the management server 300.

The first device 100 may request a recommendation element from the second device 200 or the management server 300 and may receive the recommendation element. In the present exemplary embodiment, the recommendation element may be related to the content reproduced by the second device 200. For example, the recommendation element may include, but is not limited to, an application element, a resumption element, an element of additional information, and an advertisement element corresponding to the content reproduced by the second device 200.

The recommendation element may be configured of an image of the content, and link information or index information each of which are connected to the image, or it may be configured in the form of an object to use a service.

Throughout the specification, the expression 'object to use a service' indicates a user interface to use a service from a service provider. The object for using a service can be a user interface for using a service that is provided from a server or the service provider. For example, the object to use a service may include the user interface that includes an icon, text, an image, and link information, and description related to a function of the object.

The first device 100 can receive the object from the server and can use the service of the service provider using the object. For example, using the object, the first device 100 can obtain content from an application program on the first device 100, a data source, server, or content provider and can process the content. Also, the object may be a user interface that corresponds to a package of services that are provided based on user context information (or the first device 100).

In the present exemplary embodiment, the object may not be installed in, or may not be executed by, the first device 100, but may be analyzed by a host program of the first device 100, so that the object may be displayed on a screen of the first device 100 and can be used by the user. The object may be a gadget but an example of the object is not limited to the same.

When the first device 100 leaves the service area of the second device 200, the first device 100 can display, on a screen, the recommendation element related to the content reproduced by the second device 200.

In the first device 100, an uninterrupted detection platform (SSP) can operate, separately from an application processor (AP). The first device 100 can connect sensors to a sensor hub of the SSP, and therefore can collect a plurality of pieces of detection information and can recognize a state, without reactivating the AP in an idle mode. When a predetermined circumstance occurs, the sensor hub (for example, an MCU) of the SSP reactivates the AP in idle mode. Each of the SSP and AP can be implemented as hardware, software, or combination of hardware and software. The SSP will be described in detail with reference to Figure 17.

The second device 200 may be a display device that plays content. In particular, the second device 200 may be a public device. Throughout the entire specification, the second device 200 may indicate, but not limited to, a display device and a kiosk (for example, a digital information display device (DID) or a large format display device (LFD )) that are available by public transport (for example, a bus, an airplane, an underground train, an underground train, or the like), a movie display device installed in a cinema, and an electric sign used in a sports complex .

The second device 200 may be connected to the first device 100 by short distance communication. Also, the second device 200 can perform wired or wireless communication with the management server 300.

The second device 200 can transmit, to the first device 100 or to the management server 300, information about reproduced content (eg, identification (ID), content information, position information of content playback, an image captured from the content, application information corresponding to the content, or the like In another exemplary embodiment, the second device 200 may generate a recommendation element related to the content reproduced and then transmit the recommendation element to the first device 100 or the management server 300.

The management server 300 can manage at least a second device 200 that provides the content playback service, and can provide the first device 100 with the recommendation element related to the content played by the second device 200.

The management server 300 may communicate with the first device 100 or the second device 200. For example, when the management server 300 receives, from the first device 100, a request for the recommendation element related to the content played by the second device 200, the management server 300 may request information related to the content from the second device 200. Next, the management server 300 can generate the recommendation element based on the information related to the content received from the second device 200, and can transmit the recommendation element to the first device 100.

The management server 300 may include an intelligence engine that can analyze a plurality of pieces of event information that are collected by the first device 100. For example, the management server 300 can analyze event information and therefore can calculate a level of interest of the user of the first device 100 in the content reproduced by the second device 200, a probability that the user of the first device 100 can display the content reproduced by the second device 200, or the like.

Hereinafter, a method of supplying a recommendation element to a user by communication between the first device 100, the second device 200, and the management server 300 will be described in detail with reference to Figures 2 to 5.

Figure 2 is a flow chart of a procedure for displaying a recommendation element, the procedure performed by the first device 100, in accordance with an exemplary embodiment.

In operation S210, the first device 100 can detect an output of the first device 100 from a service area of the second device 200 that plays content. For example, in a case where a position of the first device 100 leaves the service area of the second device 200 since a user of the first device 100 moves to another location while the user carries the first device 100, the first device 100 Can detect the exit of the service area.

In the present exemplary embodiment, the service area of the second device 200 may include a communication area where the first device 100 can communicate with the second device 200, a display area where the user of the first device 100 can directly display the reproduced content by the second device 200, or the like. In a case where the second device 200 is an advertisement panel that reproduces content on a bus, the service area of the second device 200 may be in an internal area of the bus where the user can view the content reproduced by the advertisement panel, or a communication area of the announcement panel where the announcement panel can communicate with another device.

When communication with the second device 200 is left, the first device 100 can detect the output of the first device from the service area of the second device 200. At this point, the service area of the second device 200 may be a communication range of the second device.

The first device 100 may be connected to an access point in the service area of the second device 200. At this point, when the user moves while wearing the first device 100, the first device 100 can detect that the connection with the point in the service area of the second device 200 is disconnected.

In another exemplary embodiment, when the first device 100 recognizes an external device located outside, or within a limit of the service area of the second device 200, the first device 100 can detect the output of the first device 100 from the service area of the second device 200. For example, when the first device 100 receives by way of short distance communication information of the external device ID or position information of the external device of the external device that is located outside the service area of the second device 200, the First 'device 100 can detect the output of the first device from the service area of the second device 200, based on the ID information or the position information of the external device.

In the present exemplary embodiment, the external device may include, but is not limited to, a Near Field Communication (NFC) tag, a ZigBee tag, and a Low Energy Bluetooth (BLE) tag.

For example, the first device 100 may be a portable terminal of a user, the second device 200 may be a display device used in a bus, and the external device may be an NFC terminal that detects when the user of the first device is getting off the bus. At this point, when the user explores the portable terminal in the NFC terminal when disembarking from the bus, (which is the external device located in a boundary of a service area of the display device), the portable terminal can recognize the NFC that disembarks the terminal and therefore can detect an exit of the portable terminal from the service area of the display device on the bus.

When the first device 100 previously stores information about the service area of the second device 200, the first device 100 can detect the output of the first device 100 from the service area of the second device 200, using current position information. At this point, the first device 100 can obtain the current position information using at least one of a beacon signal based technique using radio frequency (RF) or an infrared ray, an ultrasonic based position recognition technique, a position recognition technique using a Wi-Fi signal fingerprint, a ZigBee based position recognition technique, and a global positioning system (GPS) signal based technique.

For example, the first device 100 can detect how far away (for example, approximately N km) the first device 100 from the service area of the second device 200, using Wi-Fi, GPS information, a base station communication network , etc.

In the present exemplary embodiment, when the user of the first device performs a registration operation in the service area of the second device 200, the first device 100 can estimate a movement distance at which the first device 100 moves from a position of the registration, using an acceleration sensor. In the present exemplary embodiment, registration can mean an action in which a user intentionally leaves records about the visitation of a specific area or using a specific service.

In operation S220, the first device 100 may request from the management server 300 a recommendation element related to content reproduced by the second device 200. That is, when the first device 100 leaves the service area of the second device 200, the First device 100 may request from the management server 300 the recommendation element to recommend an element related to content played by the second device 200 to the user of the first device 100.

The first device 100 may request from the management server 300 the recommendation element while the first device 100 transmits information about the second device 200 and information about the service area of the second device 200 to the management server 300.

For example, the first device 100 may request from the management server 300 the recommendation element while the first device 100 transmits to the management server 300 at least one of position information of the first device 100, position information of the second device 200, and ID information of the second device 200. The position information of the first device 100 may include information about the service area of the second device 200 (for example, an ID value to identify the service area).

The first device 100 may receive information about the management server 300 that is disseminated from the second device 200. The information about the management server 300 may include link information (for example, a uniform resource locator (URL)) to access the Management server 300

That is, the second device 200 may periodically disseminate the information about the management server 300 via short distance communication, in which the management server 300 can obtain the recommendation element related to the content reproduced by the second device 200. The Short distance communication may include, but is not limited to, BLE, NFC, uW b, and ANT +. Also, the second device 200 can provide the information about the management server 300 that the recommendation element related to the content reproduced by the second device 200 can obtain, by means of a two-dimensional (2D) barcode (for example, a code of QR bars), a color code, a Gray code, a touch code, etc., when the first device 100 leaves the service area of the second device 200, the first device 100 can request the management element 300 from the management element 300 recommendation, based on information about the management server 300 that is received from the second device 200.

The management server 300 may define the second device 200 or the service area of the second device 200, based on at least one of the position information of the first device 100, the position information of the second device 200, and the ID information of the second device 200. For example, when the first device 100 transmits to the management server 300 position information of the first device 100 at a time point of the output of the first device in the service area of the second device, the server 300 of management can define the second device 200 or the service area of the second device 200 located within a range of the first device 100.

The management server 300 may request from the second device 200 information about the content played by the second device 200, and may generate the recommendation element using the information about the content received from the second device 200.

The management server 300 may transmit information about a time point to the second device 200 when the management server 300 receives request information about the recommendation element of the first device 100. That is, the management server 300 may request the second device 200 for information about the content played by the second device 200 at the time point when the management server 300 receives the request for information about the recommendation element of the first device 100

A difference between the time point when the management server 300 receives the request information about the recommendation element and the time point when the first device 100 leaves the service area of the second device 200 may not be large. Therefore, in the present exemplary embodiment, the time point when the first device 100 leaves the service area of the second device 200 may correspond to a time point when the management server 300 or the second device 200 receives a request for the recommendation element.

When the first device 100 periodically receives from the second device 200 at least one of the playback position information (for example, a time indication, an index, etc.) of content that is reproduced by the second device 200 and link information of the content, the first device 100 may request the recommendation element from the management server 300 while the first device 100 transmits at least one of the content playback position information and the content link information to the management server 300.

The management server 300 may generate a recommendation element related to the content reproduced by the second device 200, using the content playback position information or the content link information that is received from the first device 100.

In another exemplary embodiment, the management server 300 may request from the second device 200 the recommendation element related to the content reproduced by the second device 200, and may receive the recommendation element from the second device 200.

In the present exemplary embodiment, when the first device 100 detects a gesture from the user of the first device 100 requesting the recommendation element, the first device 100 may request from the management server 300 the recommendation element related to the content provided by the second device 200. The gesture of the user that is related to requesting the recommendation item may vary. For example, a gesture in which a specific button (a start button, a power button, etc.) is pressed for a predetermined period of time, a gesture in which a specific area of a screen is touched, or the like .

When the gesture of the user requesting the recommendation element is detected, although the device 100 is located in the service area of the second device 200, the first device may request the recommendation element from the management server 300.

In operation S230, the first device 100 may receive the recommendation element related to the content of the management server 300. In the present exemplary embodiment, the first device 100 may receive the recommendation element related to the content of the management server 300. At this point, in the present exemplary embodiment, the first device 100 may receive the recommendation element that is generated by the management server 300. In another exemplary embodiment, the first device 100 may receive from the management server 300 a recommendation element that is generated by the second device 200.

In the present exemplary embodiment, the recommendation element may include, but is not limited to, an application element, a resume element, an additional information element, and an advertisement element corresponding to the content.

The application element may be an element related to an application that accesses a content provider that provides the content reproduced by the second device 200.

The resume element may be an element to allow the content that was played by the second device 200 to be played by the first device 100 after the time point when the first device 100 leaves the service area of the second device 200.

The additional information element may be an element for providing a plurality of pieces of additional information (for example, in a case of film content, an introduction of a cast and crew, a synopsis, ratings, a preview, soundtrack information original (OST), etc.) related to the content played by the second device 200. The advertisement element may be an element to induce the user to purchase the content or an additional service related to the content.

In operation S240, the first device 100 can display the recommendation element related to the content on a screen of the first device 100.

The screen of the first device 100 may include, but is not limited to, a first screen that is first displayed on the first device 100 when an operating mode of the first device 100 is switched from a standby mode to an active mode (for example , when the first device 100 is unlocked, the first device 100, or the like is turned on). For example, the first device 100 can display the recommendation element in a specific page of a plurality of pages that have icons arranged therein, or you can display the recommendation element in a predetermined area of a background screen.

When the recommendation element includes a plurality of recommendation elements, the first device 100 can display a list of the recommendation elements on the screen.

The recommendation element displayed on the first device 100 may be configured of an image of the content, and link information or index information each of which are connected to the image. For example, the recommendation element may be formed in a manner that an image captured from the content reproduced by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200 (hereinafter, a 'last screen image') is connected with playback position information indicating a playback position of the content at the time point when the first device 100 leaves the service area of the second device.

The play position information may include link information (for example, a URL) to access the content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device, information of index (for example, a uniform resource identifier (URI)) for accessing still image content displayed by the second device 200 at the time point when the first device 100 leaves the service area of the second device, or the like.

In another exemplary embodiment, the recommendation element may be configured from a text indicating the content and reproduction position information that is connected to the text. The text can be provided by a content provider.

In the present exemplary embodiment, the management server 300 may transmit the content-related recommendation element to a cloud server that is connected to the first device 100. In this case, when required, the first device 100 may receive the recommendation element of the server in the cloud and you can display the recommendation element on the screen.

When the first device 100 leaves the service area of the second device 200, the user of the first device 100 may no longer display the content reproduced by the second device 200, so that the first device 100 displays the recommendation element in the screen to recommend, to the user, information related to the content reproduced by the second device 200. This is described in detail with reference to Figure 3.

Figure 3 illustrates a procedure for displaying a recommendation element, the procedure performed by the first device 100, in accordance with another exemplary embodiment. In the exemplary embodiment of Figure 3, it is assumed that the first device 100 is a personal mobile device and the second device 200 is a public device.

A public device 'A' 200-1 can play animation content (operation 1). At this point, a user of the first device 100 in a service area of the public device 'A' 200-1 can display the animation content played by the public device 'A' 200-1. When the user of the first device 100 remains in the service area of the public device 'A' 200-1 for a predetermined period of time and then leaves the service area, the user of the first device 100 may no longer display the content animation played by the public device 'A' 200-1.

Therefore, when the first device 100 detects the output of the first device 100 from the service area of the public device 'A' 200-1 (operation 2), the first device 100 may request a recommendation element from the management server 300 related to the animation content played by the public device 'A' 200 1 (operation 3). Operation 2, in which the first device 100 detects the exit of the service area of the public device 'A' 200-1, corresponds to operation S210 of the exemplary embodiment shown in Figure 2, and therefore, the Detailed descriptions of it are omitted at this point.

The management server 300 may have a database about service areas of the second device 200. Therefore, when the management server 300 receives a request for the recommendation element of the first device 100, the management server 300 may define the public device 'A' 200-1 as the second device 200, based on a position of the first device 100.

The management server 300 may request from the public device 'A' 200-1 information about the animation content played by the public device 'A' 200-1 at a time point when the first device 100 leaves the service area of the public device 'A' 200-1 (or when the management server 300 receives the request for the recommendation element of the first device 100). At this point, in response to the request of the management server 300, the public device 'A' 200-1 can transmit to the management server 300 at least one of an image of the animation content reproduced by the public device 'A' 200 -1 at the time point when the first device 100 leaves the service area of the public device 'A' 200-1 (or when the management server 300 receives the request for the recommendation element of the first device 100), information of playback position (for example, link information or index information) of the content played by the public device 'A' 200-1 in the time point when the first device 100 leaves the service area of the public device 'A' 200-1 (or when the management server 300 receives the request for the recommendation element of the first device 100), corresponding application information to the content played by the public device 'A' 200-1 at the time point when the first device 100 leaves the service area of the public device 'A' 200-1 (or when the management server 300 receives the request for the recommendation element of the first device 100), additional information, and announcement information related to content played by the public device 'A' 200-1 at the time point when the first device 100 leaves the service area of the public device 'A' 200-1 (or when the management server 300 receives the request for the recommendation element of the first device 100) (operation 4).

The public device 'A' 200-1 can transmit to the management server 300 a captured image (i.e., a last screen image) of a screen that reproduces the content at the time point when the first device 100 leaves the area of service of the public device 'A' 200-1 (or when the management server 300 receives the request for the recommendation element of the first device 100).

The management server 300 can generate the recommendation element using a plurality of pieces of information received from the public device 'A' 200-1 (operation 5). For example, the management server 300 may generate a resume element as the recommendation element using information received from the public device 'A' 200-1, that is, using the captured image (i.e. the last screen image) and the position information of the content being played at the time point when the first device 100 leaves the service area of the public device 'A' 200-1. Also, the management server 300 may generate an additional information element using the additional information received from the public device 'A' 200-1, or it may generate an application element using the application information received from the public device 'A' 200- one. At this point, the management server 300 may generate the recommendation element in the form of an object (for example, a gadget) to use a service, or in the form of a list.

The management server 300 may provide the recommendation element to the first device 100 (operation 6). The first device 100 can display the recommendation element received from the management server 300 on a screen (for example, a first screen) (operation 7).

Therefore, in accordance with the present exemplary embodiment, when the user of the first device 100 displays content reproduced by a public device and then leaves a service area of the public device, the first device 100 can provide the user with a recommendation element (for example, a resume element) related to the content played by the public device, so that, although the user leaves the service area of the public device, the user can continuously use a service provided by the public device .

Hereinafter, when the first device 100 performs a context analysis and recognizes that the user of the first device 100 has a high level of interest with respect to content reproduced by the second device 200, a display procedure of a device will be described below. recommendation element on a screen of the first device 100, the procedure performed by the first device 100.

Figure 4 is a flow chart of a display procedure of a recommendation element after the first device 100 performs a context analysis, the procedure performed by the first device 100, in accordance with an exemplary embodiment.

In operation S405, the second device 200 can play content. The content may include, but is not limited to, education content, movie content, broadcast content, game content, ad content, still image content, and news content.

In operation S410, the first device 100 may collect event information about an event that occurs in the first device 100. That is, the first device 100 can detect various types of events that occur in the first device 100 and can collect a plurality of pieces of event information about the various types of events detected.

For example, the first device 100 may collect position information, or network information (for example, GPS coordinate information, cell ID information, Wi-Fi access point information, or the like) that is from the first device 100.

Also, the first device 100 may collect status information about a state of a user from the first device 100. The status information of the user may indicate movement, a pattern of life, etc., of the user, and may include a plurality of pieces of information about a walking state, a exercising state, a driving state, a sleeping state, etc., of the user. For example, when the user connects the first device 100 to a support in a house, the first device 100 can determine that the user is in a sleeping state, taking into account position information, inclination information, movement information, information current time, alarm setting information, etc., of the first device 100. Also, when the user connects the first device 100 to a support in a car, the first device 100 can determine that the user is in the driving state, taking into account position information, tilt information, information on movement, etc., of the first device 100.

The first device 100 may collect content that is introduced by a user input device. For example, the first device 100 can collect a plurality of pieces of information about texts, drawings, symbols, etc., which are entered by a user via a touch screen, or can recognize a user's voice and can collect vocal contents introduced by the user

The first device 100 may collect exchanged message information, exchanged email information, call history information, social network service use information (SNS) and web page usage information. For example, the first device 100 may collect transmission and reception times of messages or emails, contents included in exchanged messages or emails, call contents, a call time, caller or receiver information, a server access time of SNS, a history of SNS use, information received from an SNS server, a web page access time, a web page usage history, or the like.

The first device 100 can collect a plurality of pieces of usage information with respect to applications in the first device 100. For example, when the user runs and uses a home economics book application, the first device 100 can collect a plurality of pieces of usage information about expenses, income, investments, etc., which are recorded in a home economics book, or when the user runs a planning management application and enters a schedule, the first device 100 may collect information from User planning Also, when the user runs a content capture and capture application, the first device 100 may collect content information about the captured content, or when the user runs a music playback application and plays music, the first device 100 may collect information of music about the music played by the user.

The first device 100 may collect ID information, type information, time use information, period of use information, etc., about applications that the user installed, used or searched. Also, when the user makes a transaction using a mobile card in the first device 100, the first device 100 may collect transaction information, purchase pattern information, etc., about the user.

That is, the first device 100 can collect by means of various sensors the plurality of pieces of event information about the events that take place in the first device 100, a plurality of pieces of information about the user of the first device 100, or the like. At this point, the first device 100 may periodically collect the plurality of pieces of event information or may collect event information in real time when a specific event occurs.

The first device 100 can collect the plurality of pieces of event information by means of an SSP, and therefore can significantly reduce the power consumption to collect the plurality of pieces of event information.

In operation S415, the first device 100 can detect an output of the first device 100 from a service area of the second device 200. The first device 100 can detect the output of the service area of the second device 200 using the plurality of parts of event information

For example, when the communication connection with the second device 200 is left, the first device 100 can detect the output of the first device from the service area of the second device 200.

Also, when the first device 100 recognizes an external device (for example, an NFC tag, a BLE tag, etc.) located outside the service area of the second device 200, or at a boundary of the service area of the Second device 200, the first device 100 can detect the output of the first device from the service area of the second device 200.

When the first device 100 previously stores information about the service area of the second device 200, the first device 100 can detect the output of the first device from the service area of the second device 200, using current position information. Operation S415 corresponds to operation S210, therefore, detailed descriptions thereof are omitted at this point.

In operation S420, the first device 100 may calculate a level of interest of the user of the first device 100 with respect to the content reproduced by the second device 200, based on the plurality of pieces of event information. The first device 100 can calculate the level of interest of the user of the first device 100 with respect to the content reproduced by the second device 200, based on user input information, user status information, current position information, history information of reservations, etc.

For example, when the user of the first device 100 performs a registration operation with respect to the second device 200 or the service area of the second device 200 using the first device 100, the first device 100 can calculate a high level of interest of the user of the first device 100 for the content reproduced by the second device 200.

The first device 100 can calculate a probability that the user of the first device 100 can display the content reproduced by the second device 200, and therefore can calculate the level of interest of the user of the first device 100.

At this point, the first device 100 can calculate the probability that the user of the first device 100 can display the content reproduced by the second device 200, based on the status information of the user, the current position information, application information about of an application executed on the first device 100, or the like.

For example, when the user of the first device 100 downloads to the first device 100 data that is provided by the second device 200, or input recommendation information to the first device 100 to recommend the content played by the second device 200 to another user by means of a SNS, the first device 100 can calculate a high probability (for example, approximately 95%) that the user of the first device 100 can display the content reproduced by the second device 200.

Also, when the user of the first device 100 remains in the service area of the second device 100 for a predetermined period of time and, while the user of the first device 100 remains in the service area, if the user of the first device 100 manipulates the first device 100 in a number of times or for a period of time that is less than a predetermined reference value, the probability that the user of the first device 100 can display the content reproduced by the second device 200 may be high.

That is, when a position of the first device 100 is not changed in the service area of the second device 100 during the predetermined period of time, and the first device 100 does not detect a user input for a predetermined period of time, the first device 100 may calculate a high probability (for example, approximately 90%) that the user of the first device 100 may wish to display the content reproduced by the second device 200.

Although the first device 100 is located in the service area of the second device 100 for the predetermined period of time, while the first device 100 is located in the service area of the second device 100, if the first device 100 receives from the user of the first device 100 an execution request with respect to an application that is irrelevant to the content reproduced by the second device 200, the first device 100 can calculate a low probability (for example, approximately 30%) that the user of the first device 100 may wish to display the content played by the second device 200. At this point, the second device 200 may disseminate information about the content played by the second device 200.

In the present exemplary embodiment, the first device 100 can detect the eyes of the user by means of a camera and therefore can calculate a probability that the user of the first device 100 can visualize the content reproduced by the second device 200.

For example, as a result of detecting the user's eyes, if the user continues to look at the screen of the first device 100, the first device 100 can calculate a low probability (for example, approximately 10%) that the user of the first device 100 can display the content reproduced by the second device 200. On the other hand, as the result of detecting the user's eyes, if the user does not share on the screen of the first device 100, the first device 100 can calculate a probability of at least 70% of the user of the first device 100 can view the content played by the second device 200.

In a case where the user of the first device 100 bought a movie ticket using the first device 100, and the first device 100 is located in a cinema at a time when a film corresponding to the movie ticket is shown, the first device 100 it can calculate a high probability (for example, approximately 98%) that the user of the first device 100 can view the movie played by the second device 200 (for example, a film projection apparatus).

For example, in a case where the user reserved a movie ticket for a particular movie to be viewed in a particular movie theater at 5 p.m. On March 1, 2013, using the first device 100, or the user downloaded the movie ticket compared from a server, the first device 100 can collect and analyze information regarding an event related to the purchase of the movie ticket. Then, when the first device leaves the private cinema at 6:30 p.m. On March 1, 2013, the first device 100 can calculate a high probability (for example, approximately 99.9%) of the user of the first device 100 viewing the particular movie. In accordance with the present exemplary embodiment, the first device 100 can analyze event information collected based on ontology, and therefore can obtain information about a level of interest of the user of the first device 100 with respect to the content reproduced by the second device 200.

Ontology means formal and explicit specification about shared conceptualization. Ontology can mean a type of dictionary consisting of words and relationships between them, in which words related to a specific domain are expressed hierarchically and there is a logical rule for further extension in them.

In the present exemplary embodiment, the first device 100 can analyze a text or voice that is entered from the user, based on ontology. That is, the first device 100 can obtain information about the correlation between the text / voice input of the user and the content played by the second device 200, based on ontology. At this point, the second device 200 may disseminate information about the content played by the second device 200. Based on the information about the correlation between the text / voice input of the user and the content played by the second device 200, the first Device 100 can calculate the level of interest of the user of the first device 100 with respect to the content reproduced by the second device 200.

For example, the second device 200 may display a particular animation and the first device 100 may receive information (for example, a content type, a content title, a content playback position, scene information, etc.) about the particular animation of the second device 200. At this point, the first device 100 can extract keywords after analyzing a user's voice obtained by means of a microphone, and can calculate a correlation between the extracted keywords and a plurality of pieces of information about the particular animation that is received from the second device 200, based on ontology.

If the user of the first device 100 frequently mentions words related to the particular animation while the user speaks with a friend directly or on a phone call, the first device 100 may determine that the user has a high level of interest in the particular animation played. for the second device 200.

In step S425, the first device 100 can determine whether the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value (for example, if a probability that the user of the first device 100 can display the content reproduced by the second device 200 is equal to or greater than 85%). The default value can be set on the first device 100, it can be set by the user, or it can be set by the management server 300.

In the present exemplary embodiment, the first device 100 in a predetermined context can estimate, without calculating the level of interest, that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than the default value.

For example, when the first device 100 has a purchase history of a viewing ticket with respect to the content reproduced by the second device 200, or has a registration history with respect to the service area of the second device 200, the first device 100 may determine that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than the predetermined value.

That is, when the user of the first device 100 intentionally purchased the ticket to display particular content, the first device 100 can analyze that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is high. Therefore, the first device 100 may not particularly calculate the probability that the user of the first device 100 can display the content reproduced by the second device 200.

In step S430, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than the predetermined value, the first device 100 may request from the management server 300 a related recommendation element with the content played by the second device 200. For example, when the level of interest of the user of the first device 100 in the content played by the second device 200 is equal to or greater than 85%, the first device 100 may request the server 300 management recommendation element.

The first device 100 may request the recommendation element while the first device 100 transmits to the management server 300 at least one of the position information of the first device 100, position information of the second device 200, ID information of the second device 200, content playback position information, and content link information.

When the level of interest of the user of the first device 100 in the content played by the second device 200 is lower than the predetermined value, the first device 100 may not request the recommendation element from the management server 300.

In operation S435, to generate the recommendation element, the management server 300 may request from the second device 200 information about the content played by the second device 200 at a time point when the first device 100 leaves the service area.

In operation S440, in response to the request of the management server 300, the second device 200 may transmit to the management server 300 the information about the content that is reproduced at the time point when the first device 100 leaves the zone of service.

For example, the second device 200 can capture a screen that reproduces the content at the time point when the first device 100 leaves the service area, and can transmit the captured image (i.e. last screen image) to the management server 300. Also, the second device 200 may transmit to the management server 300 at least one of the playback position information (eg, link information or index information) of the content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200, application information corresponding to the content reproduced by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200, additional information, and announcement information related to content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200.

In operation S445, the management server 300 can generate the recommendation element related to the content. For example, the management server 300 may generate a resume element as the recommendation element using the captured image (ie, the last screen image) and the playback position information (for example, the link information or the index information) that is received from the second device 200. Also, the management server 300 may generate an additional information element using the additional information received from the second device 200, or it may generate an application element using the application information received from the second device 200. At this point, the management server 300 may generate the recommendation element in the form of an object (for example, a gadget) to use a service, or in the form of a list.

In operation S450, the management server 300 may provide the recommendation element to the first device 100. In accordance with the present exemplary embodiment, the management server 300 may provide the recommendation element to the first device 100 via wired or wireless communication.

In step S455, the first device 100 can display the recommendation element on a screen. At this point, the first device 100 can display the recommendation element on the screen, taking into account user context information.

For example, when the first device 100 detects a gesture from the user of the first device 100 requesting the recommendation element, the first device 100 can display the recommendation element on the screen. The gesture of the user that is related to requesting the recommendation item may vary.

Also, the first device 100 can display the recommendation element on the screen, based on luminance information, tilt information, etc. For example, when a luminance of the first device 100 is less than a predetermined value, the first device 100 may not display the recommendation element on the screen, and when the luminance of the first device 100 is equal to or greater than the predetermined value, the First device 100 can display the recommendation item on the screen.

That is, in a case where the user of the first device 100 keeps the first device 100 in the user's pocket or does not carry the first device 100 in the user's hand, it may mean that the user may not have an intention to receive the item of recommendation. Therefore, the first device 100 may not display the recommendation element on the screen, based on the luminance information or the inclination information.

On the other hand, when the first device 100 leaves the service area of the second device 200, if the user of the first device 100 stares at the screen while the user holds the first device 100 in the user's hand, the first device 100 can display on the screen the recommendation element related to the content played by the second device 200.

Therefore, in accordance with the present exemplary embodiment, the first device 100 considers the context information of the user and therefore, when the user does not want the recommendation element or cannot display the recommendation element, the first device 100 You may not see the recommendation item on the screen.

The first device 100 can display the recommendation element according to a setting designated by the user. For example, the first device 100 may provide the recommendation element in the form of a pop-up window or may display the recommendation element on a specific page.

The first device 100 can scan the service area of the second device 200 that the first device 100 previously visited, and the scan can be performed within a predetermined range with respect to a current position. When the service area of the second device 200 that the first device 100 previously visited is scanned, the first device 100 can extract a recommendation element related to content that was previously reproduced by the second device 200 and can display the recommendation element in the screen.

For example, in a case where a gallery that the user of the first device 100 visited a month ago is located in a building near a department store where the first device 100 is currently positioned, the first device 100 can extract a recommendation element related to content that the user viewed in the gallery a month ago and can display the recommendation item on the screen.

That is, according to the present exemplary embodiment, in a case where a service area that the user visited previously located adjacent to the user, and the user viewed content in the service area, the first device 100 can provide a recommendation element related to the content that the user viewed.

Operation S455 corresponds to operation S240 shown in Figure 2 and therefore repeated detailed descriptions thereof are omitted at this point.

In accordance with the present exemplary embodiment, the first device 100 can perform the context analysis and therefore can provide the user with a recommendation element related to content that has a high probability that the user can visualize from among a plurality of pieces of content that are played by a public device. Therefore, it is possible to prevent many unnecessary recommendation elements from being provided to the user by the first device 100.

In another exemplary embodiment, an order of operations S405 may be changed to S455 or some operations may be omitted.

Figure 5 is a flow chart of a procedure for supplying a recommendation element, the procedure performed by the management server 300, in accordance with an exemplary embodiment.

In operation S505, the second device 200 can play content. At this point, the first device 100 may be located in a service area of the second device 200.

In step S510, the first device 100 may collect event information about an event that occurs in the first device 100. That is, the first device 100 can detect various types of events that occur in the first device 100 and can collect a plurality of pieces of event information about the various types of events detected. For example, the first device 100 may collect position information, network information, user status information, exchanged message information, exchanged email information, call history information, SNS usage information, usage information. application, and website usage information, transaction information, etc., of the first device 100.

In operation S515, the first device 100 can transmit the plurality of pieces of event information to the management server 300. The first device 100 can transmit all or some of the plurality of pieces of event information to the management server 300. For example, the first device 100 may not transmit to the management server 300 a plurality of pieces of personal financial information (for example, a bank account, a credit card number, etc.) that are entered by the user.

The first device 100 may periodically transmit the plurality of pieces of event information to the management server 300 or may transmit event information to the management server 300 when a specific event occurs. The first device 100 can encrypt the event information using a pre-agreed encryption code and then can transmit the encrypted event information to the management server 300.

In operation S520, the first device 100 can detect an output of the first device 100 from the service area of the second device 200. At this point, in operation S525, the first device 100 can request from the management server 300 an element of recommendation related to the content reproduced by the second device 200. That is, when the first device 100 leaves the service area of the second device 200 that reproduces the content, the management server 300 may receive a request for the recommendation element of the first device 100.

In operation S530, the management server 300 can calculate a level of interest of the user in the content reproduced by the second device 200. For example, when the user of the first device 100 performs a registration procedure with respect to the second device 200 or the service area of the second device 200 using the first device 100, the management server 300 can receive registration information from the first device 100. At this point, the management server 300 can calculate a high level of interest from the user of the first device 100 in the content played by the second device 200.

The management server 300 can calculate a probability that the user of the first device 100 can display the content reproduced by the second device 200, based on the plurality of pieces of event information collected by the first device 100, and therefore can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200.

At this point, the management server 300 can calculate the probability that the user of the first device 100 can display the content reproduced by the second device 200, based on user input information, user status information, position information current, reservation history information, etc., that are received from the first device 100.

For example, when the management server 300 receives a plurality of pieces of event information about events in which the user of the first device 100 downloads to the first device 100 data that is provided by the second device 200, or recommendation information of inputs to the first device 100 to recommend the content played by the second device 200 to another user, then the management server 300 can calculate a high probability (for example, approximately 95%) that the user of the first device 100 can display the content played by the second device 200.

Also, when a position of the first device 100 does not change in the service area of the second device 200 during the predetermined period of time, and a user input is not detected for a predetermined period of time, the management server 300 can calculate a high probability (for example, approximately 90%) that the user of the first device 100 can display the content reproduced by the second device 200.

Although the first device 100 is located in the service area of the second device 200 for the predetermined period of time, while the first device 100 is located in the service area of the second device 200, if the user of the first device 100 performs, using the first device 100, an operation that is irrelevant to the content reproduced by the second device 200, the management server 300 can calculate a low probability (for example, approximately 30%) that the user of the first device 100 can display the content played by the second device 200.

In a case where the user of the first device 100 bought a movie ticket using the first device 100, and the first device 100 is located in a movie theater at a time when a movie corresponding to the movie ticket compared is shown, the server 300 management can calculate a high probability (for example, approximately 98%) that the user of the first device 100 can see the movie played by the second device 200 (for example, a film projection apparatus).

In the present exemplary embodiment, the management server 300 can calculate a probability that the user of the first device 100 can view the content reproduced by the second device 200, based on information obtained by the first device 100 by detecting the user's eyes Through a camera.

In accordance with the present exemplary embodiment, the management server 300 can analyze event information collected by the first device 100 based on ontology, and therefore can obtain information about a level of interest of the user of the first device 100 in the content played by the second device 200.

For example, the management server 300 may obtain information about a correlation between text / voice inputs by the user and the content reproduced by the second device 200, based on ontology. Based on the information about the correlation between the text / voice inputs by the user and the content played by the second device 200, the management server 300 can calculate the level of interest of the user of the first device 100 in the content played by the second device 200.

In step S535, the management server 300 can determine whether the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value (for example, if a probability that the user of the first device 100 can display the content reproduced by the second device 200 is equal to or greater than 85%). The default value can be set by the user or by the management server 300.

In the present exemplary embodiment, the management server 300 in a predetermined context can estimate (or determine), without calculating the level of interest, that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 It is equal to or greater than the default value.

For example, when the user of the first device 100 has a purchase history of a ticket to display the content played by the second device 200, or has a registration history with respect to the service area of the second device 200, the server 300 management can determine that the level of interest of the user of the first device 100 in the content played by the second device 200 is equal to or greater than the predetermined value.

In step S540, when the level of interest of the user of the first device 100 in the content played by the second device 200 is equal to or greater than the predetermined value, the management server 300 may request information from the second device 200 about the content played. by the second device 200. At this point, the management server 300 can transmit to the second device 200 information about a time point when the first device 100 leaves the service area of the second device 200.

In operation S545, the management server 300 may receive information about the content of the second device 200. For example, the management server 300 may receive from the second device 200 at least one of captured image information obtained by capturing an image of the content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200, playback position information of the content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200, application information that corresponds to the content, additional information about the content, and announcement information that corresponds to the content.

In operation S550, the management server 300 may generate a recommendation element related to the content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200, based on the information about the content received from the second device 200.

For example, the management server 300 may generate a resume element using the captured image information obtained by capturing the image of the content reproduced by the second device 200 at the time point when the first device 100 leaves the service area of the second device, and playback position information (for example, an indication of time, index information, etc.) about the content played by the second device 200 at the time point when the first device 100 leaves the service area of the second device.

In operation S555, the management server 300 may transmit the generated recommendation element to the first device 100. At this point, in the present exemplary embodiment, the first device 100 may store the recommendation element in its memory.

In operation S560, the first device 100 can detect a gesture from the user of the first device 100 requesting the recommendation element. For example, the first device 100 can detect the gesture in which the user presses a specific button (for example, a start button), touches a specific area of a screen, unlocks a device lock, or the like.

In step S565, when the first device 100 detects the gesture of the user requesting the recommendation element, the first device 100 can display on the screen the recommendation element that is received from the management server 300. The screen can be a first screen.

In another exemplary embodiment, an order of operations S505 may be changed to S565 or some operations may be omitted. For example, in other exemplary embodiments, operations S530 and S535 may be performed after operation S545 or after operation S550.

Hereinafter, a procedure for receiving a recommendation element from the second device 200 without the use of the management server 300 and displaying the recommendation element on a predetermined screen, the procedure performed by the first device 100, will be described in detail with reference to Figures 6 to 8.

Figure 6 is a flow chart of a procedure for displaying a recommendation element, the procedure performed by the first device 100, in accordance with another exemplary embodiment.

In operation S610, the second device 200 can play content. At this point, the first device 100 may be located in a service area 600 of the second device 200. In the present exemplary embodiment, the service area 600 includes a communication area where the first device 100 can communicate with the second device 200 , or a display area where the user of the first device 100 can directly display the content reproduced by the second device 200.

In operation S620, the first device 100 may request a recommendation element from the second device 200 related to the content reproduced by the second device 200. At this point, the first device 100 may request the recommendation device from the second device 200, with the condition that the first device 100 is located in the service zone 600 of the second device 200 for a predetermined period of time (for example, 5 minutes).

For example, when the first device 100 receives a signal that diffuses from the second device 200 via a short distance communication over a predetermined period of time, the first device 100 may request the recommendation element related to the content from the second device 200 played by the second device 200. Additionally, when the first device 100 recognizes an NFC terminal that detects the first device, and allows a user of the first device to board a bus, and then a predetermined period of time elapses (for example , 3 minutes), the first device 100 may request from the second device 200 a recommendation element related to content reproduced by the second device 200, which may be a display device installed on the bus.

In operation S630, the second device 200 may generate the recommendation element related to the content reproduced by the second device 200. In the present exemplary embodiment, the second device 200 may generate the recommendation element in real time at a time point. when the second device 200 receives a request for the recommendation element of the first device. For example, the second device 200 may capture a screen that reproduces the content at the time point when the second device 200 receives the request. Next, the second device 200 can generate a resume element by linking the captured image to playback position information indicating a playback position of the content being played while it is being captured.

Before the second device 200 receives the request for the recommendation element of the first device 100, the second device 200 can previously generate the recommendation element related to the Played content In this case, when the second device 200 receives the request for the recommendation element of the first device 100, the second device 200 can extract the recommendation element related to the reproduced content of its memory.

In operation S640, the second device 200 may provide the first device 100 with the recommendation element related to the content reproduced. For example, the second device 200 may transmit at least one of the resume element, an application element, an additional information element, and an announcement element to the first device 100 via short distance communication.

After the second device 200 transmits the recommendation element, if the recommendation element is subsequently updated, the second device 200 can transmit the updated recommendation element to the first device 100. In a case of the resumption of the element, since the Content playback position changes according to a course of time, the second device 200 can update the resume item according to a changed content playback position and can transmit the updated resume item to the first device 100. When the second device 200 receives the request for the recommendation element of the first device 100, the second device 200 can periodically transmit the recommendation element.

The first device 100 may receive from the second device 200 the recommendation element related to the content reproduced by the second device 200.

In operation S650, the first device 100 may store in its memory the recommendation element received from the second device 200. At this point, since the first device 100 is located in the service zone 600 of the second device 200, the first device 100 may only store the recommendation element received from the second device 200 in memory, and may not display the recommendation element on a screen.

In operation S660, the first device 100 can detect an output of the first device 100 of the service zone 600 of the second device 200. In this case, in operation S670, the first device 100 can display the recommendation element on the screen. .

That is, while the first device 100 is located in the service zone 600 of the second device 200, the first device 100 may not display on the screen the recommendation element received from the second device 200, and then when the first device 100 leaves the service zone 600 of the second device 200, the first device 100 can display on the screen the recommendation element related to the content reproduced by the second device 200. In another exemplary embodiment, an order of operations S610 can be changed to S670 or some operations may be omitted. For example, in a case where the second device 200 periodically disseminates the recommendation element, a request operation by the first device 100 of the second device 200 may not be required for the recommendation element.

With reference to Figure 7, a procedure for supplying a recommendation element without using the management server 300, the procedure performed by the first device 100 and the second device 200 will be described below.

Figure 7 is a flow chart of a display method of a recommendation element, the procedure performed by the first device 100, in accordance with another exemplary embodiment.

In operation S710, the first device 100 and the second device 200 can communicate with each other. For example, the first device 100 and the second device 200 may be connected to each other via a short distance communication network such as Wi-Fi, Bluetooth, NFC, ZigBee, WFD, UWB, etc.

In operation S720, the second device 200 can play content. In the present exemplary embodiment, the content may include, but is not limited to, education content, movie content, broadcast content, game content, ad content, still image content, and news content.

In another exemplary embodiment, an order of operations S710 and S720 can be changed. That is, the second device 200 can play the content while the second device 200 is connected to the first device 100 through a communication network, or the second device 200 can be connected to the first device 100 via the communication network after that the second device 200 plays the content.

In operation S730, the first device 100 can calculate a level of interest of a user of the first device 100 in the content reproduced by the second device 200, based on a plurality of pieces of event information. For example, the first device 100 may calculate a probability that the user of the first device 100 can display the content played by the second device 200, based on user input information, user status information, current position information, reservation history information, etc., and therefore can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200. Since operation S730 corresponds to operation S420 shown in Figure 4 , detailed descriptions thereof are omitted at this point.

In step S740, the first device 100 can determine whether the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value (for example, if a probability that the user of the first device 100 can display the content reproduced by the second device 200 is equal to or greater than 85%). The default value can be set on the first device 100 or it can be set by the user.

Since operation S740 corresponds to operation S425 shown in Figure 4, detailed descriptions thereof are omitted at this point.

In step S750, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than the predetermined value, the first device 100 may request a recommendation element from the second device 200. For example, when the probability that the user of the first device 100 can display the content reproduced by the second device 200 is equal to or greater than 85%, the first device 100 may request the second device 200 for the recommendation element related to the Played content

On the other hand, when the probability that the user of the first device 100 can display the content reproduced by the second device 200 is less than the predetermined value, the first device 100 may not request the recommendation device from the second device 200.

In the present exemplary embodiment, the first device 100 in a predetermined context can estimate (or determine), without calculating the level of interest, that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than the default value. In this case, the first device 100 may request the recommendation element from the second device 200.

For example, when the first device 100 has a purchase purchase history of a ticket to display content reproduced by the second device 200, or has a registration history with respect to the registration to a service area of the second device 200, the first Device 100 may determine that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than the predetermined value, and may request the second device 200 for the recommendation element.

In step S760, the second device 200 may generate the recommendation element related to the content reproduced by the second device 200. For example, the second device 200 may generate a resume element using a captured image (i.e. a last image screen) obtained by capturing a screen and playback position information (for example, link information or index information) of the content. Also, the second device 200 can generate an additional information element using additional information of the reproduced content or can generate an application element using application information corresponding to the reproduced content. At this point, the second device 200 can generate the recommendation element in the form of an object to use a service or in the form of a list. However, the procedure for generating the recommendation element is not limited to the same.

In operation S770, the first device 100 may receive the recommendation element. In the present exemplary embodiment, the first device 100 may periodically receive the recommendation element of the second device 200.

In operation S780, the first device 100 can detect an output of the first device 100 from the service area of the second device 200. If the first device 100 does not leave the service area of the second device 200, the first device 100 may not display the recommendation element on a screen, and you can request again and receive a recommendation element from the second device 200 (repetition of operations S750 to S770).

In operation S790, when the first device 100 detects the output of the first device 100 from the service area of the second device 200, the first device 100 can display on the screen the recommendation element related to the content reproduced by the second device 200 In a case where the first device 100 periodically receives a recommendation element from the second device 200, the first device 100 may display on the screen a recommendation element that was last received by the first device before the first device 100 detects the output of the first device 100 from the service area of the second device 200. In the present exemplary embodiment, the screen may include a first screen.

In accordance with the present exemplary embodiment, the first device 100 can perform a context analysis and then only when there is a high probability that the user of the first device 100 visualizes the content reproduced by the second device 200, the first device 100 can request the second device 200 for the recommendation element related to the content reproduced by the second device 200.

The first device 100 can display the recommendation element on the screen, taking into account the context information.

For example, when the first device 100 detects a gesture from the user of the first device 100 requesting the recommendation element, the first device 100 can display the recommendation element on the screen. The gesture to request the recommendation item may vary. Additionally, the first device 100 can display the recommendation element on the screen, based on luminance information, inclination information, etc. For example, when a luminance of the first device 100 is less than a predetermined value, the first device 100 may not display the recommendation element on the screen, and when the luminance of the first device 100 is equal to or greater than the predetermined value, the First device 100 can display the recommendation item on the screen.

That is, in a case where the user of the first device 100 keeps the first device 100 in a user's pocket, or does not carry the first device 100 in the user's hand, it may mean that the user may not have an intention to receive the recommendation element. Therefore, the first device 100 may not display the recommendation element on the screen, based on the luminance information or the inclination information.

On the other hand, when the first device 100 leaves the service area of the second device 200, if the user of the first device 100 stares at the screen of the first device while the user holds the first device 100 in the user's hand, The first device 100 can display on the screen the recommendation element related to the content reproduced by the second device 200.

The first device 100 can display the recommendation element according to a setting designated by the user. For example, the first device 100 may provide the recommendation element in the form of a pop-up window or may display the recommendation element on a specific page.

The first device 100 can scan the service area of the second device 200 that the first device 100 previously visited, and the scan can be performed within a predetermined range with respect to a current position of the first device. When the service area of the second device 200 that the first device 100 previously visited is scanned, the first device 100 can extract a recommendation element related to content that was previously reproduced by the second device 200 and can display the recommendation element in the screen.

Figure 8 is a flow chart of a method of supplying a recommendation element, the procedure performed by the second device 200, in accordance with an exemplary embodiment. In this regard, repeated detailed descriptions of the same operations of the procedure of Figure 7 are omitted here.

In operation S810, the first device 100 and the second device 200 can communicate with each other. In operation S820, the second device 200 can play content. In operation S830, the second device 200 may receive from the first device 100 a request for a recommendation element related to the content reproduced by the second device 200.

In operation S840, the second device 200 can generate the recommendation element. For example, the second device 200 may generate an application element, a resume element, an additional information element, or an advertisement element as the recommendation element that corresponds to the content reproduced, but one or more exemplary embodiments are no more limited to the same.

In operation S850, the second device 200 can transmit the recommendation element to the first device 100.

In operation S860, the first device 100 can detect an output of the first device 100 from a service area of the second device 200. If the first device 100 does not leave the service area of the second device 200, the first device 100 may request and again receiving a recommendation element from the second device 200 (repetition of operations S830 to S850). For example, when the first device 100 does not leave the service area of the second device 200, the first device 100 may periodically receive a recommendation element that is updated in the second device 200.

In operation S870, when the first device 100 detects the output of the first device 100 from the service area of the second device 200, the first device 100 can calculate a level of interest of the user of the first device 100 in the content reproduced by the second device 200, based on a plurality of pieces of event information that are received by the first device 100.

In step S880, the first device 100 can determine whether the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value.

For example, the first device 100 can determine whether a probability that the user of the first device 100 can display the content played by the second device 200 is equal to or greater than 90%. When the probability that the user of the first device 100 can display the content played by the second device 200 is less than the predetermined value (for example, less than 90%), the first device 100 may not display the element on a screen of recommendation received from the second device 200.

In step S890, when the user's calculated interest level is equal to or greater than the default value (for example, 90%), the first device 100 can display on the screen the recommendation element received from the second device 200.

According to the present exemplary embodiment, in a case where a recommendation element is received periodically, the first device 100 may display on the screen a recommendation element that was last received by the first device before the first device 100 detects the output of the first device 100 from the service area of the second device 200.

The first device 100 can display the recommendation element on the screen, taking into account the context information. Operation S890 corresponds to operation S790 of the procedure of Figure 7, therefore, detailed descriptions thereof are omitted at this point.

In the following, a case will be described in detail in which, when the first device 100 leaves a service area of the second device 200, the first device 100 directly generates and displays a recommendation element related to the content reproduced by the second device 200 with reference to Figures 9 and 10.

Figure 9 illustrates a procedure for displaying a recommendation element, the procedure performed by the first device 100, in accordance with another exemplary embodiment.

In operation S910, the second device 200 can play content. Then, in operation S920, the second device 200 may disseminate information about the content reproduced by the second device 200. For example, the second device 200 may periodically broadcast at least one of a captured image obtained by capturing a screen that reproduces the content , playback position information (for example, a URI, URL, etc.) that indicates a playback location or location of the content that is reproduced when captured, application information corresponding to the content, additional information about the content, and Ad information that corresponds to the content.

In operation S930, the first device 100 located in a service area 900 of the second device 200 can obtain information about the content reproduced by the second device 200. That is, according to the present exemplary embodiment, the first device 100 can recording information about the content played by the second device 200 while the first device 100 is located in the service area 900 of the second device 200.

In operation S940, the first device 100 can detect an output of the first device 100 of the service zone 900 of the second device 200.

For example, when communication with the second device 200 is left, the first device 100 can detect the output of the first device from the service area 900 of the second device 200.

Additionally, when the first device 100 recognizes or detects an external device (for example, an NFC tag, a BLE tag, etc.) located outside the service zone 900 of the second device 200, or in a zone boundary of service 900 of the second device 200, the first device 100 may determine that the first device has left the service area 900 of the second device 200.

When the first device 100 previously stores information about the service area 900 of the second device 200, or receives information about the service area 900 of the second device 200 of the second device 200, the first device 100 can detect the output of the first service zone device 900 of the second device 200 using position information of the first device 100.

In step S950, the first device 100 may generate a recommendation element, based on information about the content received from the second device 200. For example, the first device 100 may generate a resume image related to the content played by the second device 200, using the captured image and the playback position information that was last received before the output of the first device is detected. Next, the first device 100 can generate an application element, an additional information element, and an advertisement element that are related to the content reproduced by the second device 200.

The first device 100 may display the recommendation element on a screen of the first device 100. In the present exemplary embodiment, the screen may include a first screen.

The first device 100 can generate the recommendation element and then can immediately display the recommendation element on the screen, or can display the recommendation element on the screen only when the first device 100 detects a gesture from the user requesting the recommendation element .

That is, according to the present exemplary embodiment, the first device 100 may record the information about the content reproduced by the second device 200 while the first device 100 is located in the service zone 900 of the second device 200, and when the first device 100 leaves the service area 900 of the second device 200, the first device 100 can display on the screen (for example, the first screen) the recommendation element related to the content reproduced by the second device 200. This procedure will be described in detail with reference to Figure 10.

Figure 10 is a flow chart of a display procedure of a recommendation element, the procedure performed by the first device 100, in accordance with another exemplary embodiment. In this regard, repeated detailed descriptions of the same operations of the procedure of Figure 9 are omitted here.

In operation S1010, the second device 200 can play content.

In operation S1020, the second device 200 may disseminate information (eg, an image, playback position information, additional information, announcement information, application information, etc.) about the content played.

In operation S1030, the first device 100 located in a service area of the second device 200 can obtain information about the content played by the second device 200. The first device 100 can manage the information received about the content.

In operation S1040, the first device 100 can detect an output of the first device 100 from the service area of the second device 200. The detection procedure performed by the first device 100 has already been described above and therefore detailed descriptions are omitted. of it at this point.

If the first device 100 does not leave the service area of the second device 200, the first device 100 may continue to collect a plurality of pieces of information about the content that is disseminated from the second device 200.

In operation S1050, when the first device 100 detects the output of the first device 100 from the service area of the second device 200, the first device 100 can calculate a level of interest of a user of the first device 100 in the content reproduced by the second device 200, based on a plurality of pieces of event information that are received by the first device 100.

In step S1060, the first device 100 can determine whether the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value (for example, 70%). As a result of the determination, when the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is less than the predetermined value (for example, 70%), the first device 100 may not generate the element of recommendation.

In step S1070, when the calculated interest level is equal to or greater than the predetermined value (for example, 70%), the first device 100 can generate the recommendation element, based on information about the content received from the second device 200.

In operation S1080, the first device 100 can display the recommendation element on a screen (for example, a first screen).

In the present exemplary embodiment, while the first device 100 is in the service area of the second device 200, the first device 100 may continue to receive information about the content reproduced by the second device 200, and when the first device 100 leaves the service area of the second device 200, the first device 100 can generate the recommendation element related to the content reproduced by the second device 200, and can display the recommendation element on the screen.

Also, in accordance with the present exemplary embodiment, the first device 100 can perform a context analysis and therefore, when there is a high probability that the user of the first device 100 can display the content reproduced by the second device 200, the First device 100 may generate the recommendation element related to the content reproduced by the second device 200 and may display the recommendation element on the screen to allow the user to continually use the content reproduced by the second device 200 even if the user exits the service area of the second device 200.

Figures 11A and 11B illustrate screens for displaying one or more recommendation elements, in accordance with an exemplary embodiment.

As illustrated in Figure 11A, the first device 100 may display on the screen recommendation elements in the form of a list, in which the recommendation elements are related to a plurality of pieces of content that are reproduced for a plurality of seconds. devices 200. That is, the recommendation elements may be related to the plurality of pieces of content reproduced by a plurality of second devices 200, each of which is different from each other. For example, in a case where a user goes to the cinema by bus, watches a movie, and then returns home by subway, the first device 100 can display a list of a first recommendation element related to animation content. played on the bus, a second recommendation item related to movie content shown in the cinema, and a third recommendation item related to ad content played at a train station or in an underground train.

The first device 100 can organize the list of recommendation elements in a sequential order of time according to the generation times of the recommendation elements, or it can organize a and the list of recommendation elements in an order according to time periods in which the first device 100 remained in the service areas.

The first device 100 can detect a user selection with respect to a recommendation item 1100 related to the content of the movie titled "Kung Fu Panda" from the list of recommendation items. The recommendation element 1100 related to the content of the movie entitled "Kung Fu Panda" may be a resume element in which the link information or index information is connected to a captured image that is obtained at a time point when the First device 100 leaves a service area of the second device 200.

For example, when the user of the first device 100 sees the content of the movie "Kung Fu Panda" on an airplane and then gets off the plane at the user's destination, the first device 100 can detect that the user has already left the plane You can then display a resume item on a screen to allow the user to resume playback of the "Kung Fu Panda" movie content that the user saw before getting off the plane. In one or more exemplary embodiments, the resume element may be generated by the management server 300, the second device 200, or the first device 100.

As illustrated in Figure 11B, when the user of the first device 100 selects the recommendation element 1100 related to the content of the movie titled "Kung Fu Panda", the first device 100 can check the link information or index information included in item 1100 of recommendation. Subsequently, based on the verified link information or the index information checked, the first device 100 may resume content playback after the time point when the first device 100 leaves the service area of the second device 200. For example, The first device 100 can resume playback of the content of the movie "Kung Fu Panda" that the user did not complete the viewing because he got off the plane.

Figures 12A, 12B and 12C illustrate a procedure for receiving a recommendation element from an external device and viewing the recommendation element, the procedure performed by the first device 100, in accordance with an exemplary embodiment.

As illustrated in Figure 12A, the first device 100 can detect a user gesture to request recommendation elements that are displayed on one or more external devices 400-1, 400-2 and 400-3. At this point, in response to the user's gesture, the first device 100 can transmit signals to one or more external devices 400-1,400 2 and 400-3 to request the recommendation elements.

As illustrated in Figure 12B, the first device 100 may receive from the one or more external devices 400-1, 400-2 and 400-3 the recommendation elements that are displayed on the one or more devices 400-1,400-2 and 400-3 external. Next, the first device 100 can add the recommendation items received from one or more external devices 400-1,400-2 and 400-3 to a predetermined screen (or a predetermined page) and can display the recommendation items.

The user can check the recommendation elements (for example, a recommendation element 1, a recommendation element 2, and a recommendation element 3) received from the one or more external 400-1, 400 2 and 400-3 devices, and you can delete some of the recommendation items (for example, recommendation item 2). That is, in a case where the first device 100 detects a deletion request gesture with respect to the recommendation element 2, the first device 100 can delete the recommendation element 2 from a list of the recommendation elements. The deletion request gesture may vary. For example, an example of the deletion request gesture may include, but is not limited to, a slip gesture, a turn gesture, a touch gesture, and a drag and drop gesture.

As illustrated in Figure 12C, the first device 100 can delete the recommendation element 2 from which the deletion request gesture is detected from the list of recommendation elements, and can reorganize the list of recommendation elements.

Figures 13A to 13C illustrate a method of sharing a recommendation element with an external device, the procedure performed by the first device 100, in accordance with an exemplary embodiment.

As illustrated in Figure 13A, the first device 100 may receive, from a user, a sharing request for a recommendation element shared with the external device.

As illustrated in Figure 13B, in response to the user's sharing request, the first device 100 can display a list of one or more external devices (for example, a living room TV, a TV 1300 of room, a screen of a refrigerator, a mobile phone of the brother, etc.) that can share the element of recommendation. The one or more external devices can be scanned around the first device 100 by short distance communication (for example, Bluetooth communication, Wi-Fi communication, etc.). Also, according to the present exemplary embodiment, the one or more external devices can be scanned based on universal plug and use (UP-nP).

The first device 100 can detect the user selection of the TV 1300 in the living room from the list of one or more external devices (for example, the TV 1300 in the living room, the TV in the room, the refrigerator screen, sister's mobile phone, etc.)

As illustrated in Figure 13C, the first device 100 can transmit to the TV 1300 of the living room the recommendation element that the user wishes to share. At this point, the first device 100 can perform an authentication procedure of the living room TV 1300. For example, the first device 100 can authenticate if the TV 1300 of the living room can display the recommendation element, based on authentication information, ID information of the TV 1300 of the living room, etc., which are received from the TV 1300 of the living room.

The TV 1300 in the living room that has received the recommendation item from the first device 100 can display the recommendation item received on its screen. The TV 1300 in the living room can then receive a user selection with respect to the recommendation item. If the recommendation item received from the first device 100 is a resume item, the TV 1300 in the living room can resume content playback.

If the recommendation element received from the first device 100 is an additional information element related to movie content, the TV 1300 in the living room can display a plurality of pieces of additional information on the screen such as a purchase of video on demand ( VOD), an original soundtrack purchase (OST), a production note display, etc., that are related to the movie content.

Figures 14A and 14B illustrate a method of supplying a recommendation element related to the content reproduced by public transport, the procedure performed by the first device 100, in accordance with an exemplary embodiment.

As illustrated in Figure 14A, in a case where a user views content using a display device 1400 available on an airplane and then gets off the plane at the destination, the user may no longer view the content.

At this point, as illustrated in Figure 14B, the first device 100 can detect that the first device 100 leaves a service area of the display device 1400 available on the aircraft, and can display a related recommendation element on a screen with the content reproduced by the display device 1400.

Figures 15A, 15B, and 15C illustrate a method of supplying a recommendation element related to film content shown in a cinema, the procedure performed by the first device 100, in accordance with an exemplary embodiment.

As illustrated in Figure 15A, a user can watch a movie using the second device 200 in the cinema, and then can leave the cinema before movie playback is completed. In this case, the first device 100 can recognize an external device (for example, an NFC tag, a BLE tag, etc.) located at a cinema entrance and therefore can determine that the first device 100 has left a service area of the second device 200.

As illustrated in Figure 15B, the first device 100 may provide a resume element to a screen of the first device 100 to allow the user of the first device 100 to resume content playback from a point of time when the user of the first device 100 exits the service area of the second device 200, in which the content is played by the second device 200. By doing so, the user can continue to see the rest of the content that the user could not see in the cinema.

As illustrated in Figure 15C, the first device 100 can transmit recommendation elements (for example, an additional information element and an announcement element) to an external device (for example, a domestic TV 1500). In this case, the user can check additional information related to the content shown in the cinema, using the domestic TV 1500.

Figures 16A, 16B, 16C, and 16D illustrate a method of supplying a recommendation element related to sports content reproduced in a sports complex, in accordance with an exemplary embodiment.

As illustrated in Figure 16A, a user can watch a baseball game in a baseball stadium. Next, the user can check details of the baseball game using a 1610 electric sign in the baseball stadium.

As illustrated in Figure 16B and 16C, when the user leaves the stands for a moment in the middle of the baseball game, the first device 100 can recognize an external device (for example, an NFC tag, a BLE tag, etc.) 1620 located outside the stands or at a limit of the stands, and therefore can detect that the user has left the stands. In this case, the first device 100 may display an additional information element related to the details of the baseball game that is displayed on the electrical sign 1610, an application element for retransmitting the baseball game, or the like as a recommendation element on a screen

As illustrated in Figure 16D, although the user leaves the stands, the user can continue checking the details of the baseball game using the first device 100.

Figures 17A and 17B are block diagrams illustrating a configuration of the first device 100, in accordance with an exemplary embodiment.

As illustrated in Figure 17A, the first device 100 may include a communication device 110, a sensor 130, and a controller 160 (also referred to as a processor 160). However, not all items shown are necessary items. That is, the first device 100 can be made with more or less elements than the elements shown.

For example, as illustrated in Figure 17B, the first device 100 may include the communication device 110, an output device 120, the sensor 130, a user input device 140, an audio / video input device 150 (A / V), controller 160, and a memory 170.

Hereinafter, the aforementioned elements are described.

The communication device 110 may include one or more elements to allow communication between the first device 100 and the second device 200 or communication between the first device 100 and the management server 300. For example, the communication device 110 may include a mobile communication device 111, a short distance communication device 112, a position information device 113, and a wireless communication device 114.

Also, the mobile communication device 111 exchanges a wireless signal with at least one of a base station, an external terminal, and a server through a mobile communication network. At this point, the wireless signal may include a voice call signal, a video call signal, or various types of data according to an exchange of text / multimedia messages.

The short distance communication device 112 is arranged for short distance communication. In the present exemplary embodiment, examples of short distance communication may include, but are not limited to, Wi-Fi, Bluetooth, ZigBee, WFD, UWB, Infrared Data Association (IrDA), and BLE.

The position information device 113 is arranged to check or obtain a position of the first device 100. An example of the position information device 113 may include a GPS module. The GPS module receives a plurality of pieces of position information from a plurality of satellites. At this point, each of the plurality of pieces of position information may include information about coordinates that consist of latitude and longitude. In particular, the GPS module can obtain from the position information not only a position of latitude, longitude and height but also can obtain three-dimensional speed (3D) information and the exact time.

The wireless communication device 114 is for accessing the Internet or other networks wirelessly, and may be embedded in the first device 100 or may be arranged outside the first device 100.

The output device 120 may function to emit an audio signal, a video signal, or a vibration signal, and may include a screen 121, a sound output device 122, a vibration motor 123, or the like.

The screen 121 displays and issues information that is processed in the first device 100. For example, the screen 121 can display on a screen (for example, a first screen) a recommendation element related to the content reproduced by the second device 200. Also, the screen 121 can display on the screen another recommendation element that is received from an external device.

When the screen 121 and a touch pad form a mutual layer structure and are then formed as a touch screen, the screen 121 can be used both as an output device and an input device. Display 121 may include at least one of a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode screen, a flexible display, a display in 3D, and an electrophoretic screen, although it is not limited to the same. Also, according to a type of the first device 100, the first device 100 can include at least two screens 121. At this point, the at least two screens 121 can face each other using a hinge.

In the present exemplary embodiment, the screen 121 may be arranged in an external device connected to the first device 100. The external device may include an input device, an output device, a control device, and the like.

Screen 121 may be included in user glasses. In this case, the first device 100 can display the recommendation element through the user's glasses.

The sound output device 122 may emit audio data that is received from the communication device 110 or stored in memory 170. The sound output device 122 may also emit a sound signal (eg, a reception sound of a call signal, a message reception sound, or the like) related to the capabilities made by the first device 100. The sound output device 122 may include a loudspeaker, a buzzer or the like.

The vibration motor 123 can emit a vibration signal. For example, the vibration motor 123 may emit the vibration signal that corresponds to an output of the audio data (for example, the call signal reception sound, the message reception sound, or the like) or data video. Also, when a touch is introduced on the touch screen, the vibration motor 123 can emit a vibration signal, and when the first device 100 leaves a service area of the second device 200, the vibration motor 123 can emit a signal of vibration

The sensor 130 may collect a plurality of pieces of event information about events taking place in the first device 100. For example, the sensor 130 can detect a position of the first device 100, user status information, application information about of at least one application used in the first device 100, exchanged message information, exchanged email information, call history information, SNS usage information, web page usage information, transaction information, a position of the User eyes, or the like.

The sensor 130 can also detect if the first device 100 leaves the service area of the second device 200. For example, the sensor 130 can detect that the communication with the second device 200 is disconnected. Also, the sensor 130 can recognize an external device located outside the service area, or within a limit of the service area of the second device 200.

The sensor 130 can detect how far away (for example, approximately N km) the first device 100 from the service area of the second device 200, using Wi-Fi, GPS information, a base station communication network, etc. Also, when a user performs a registration procedure in the service area of the second device 200 using the first device 100, the sensor 130 can estimate a movement distance at which the first device 100 moves from a registration position, using an acceleration sensor

Sensor 130 may include various sensors to collect the plurality of pieces of event information. For example, sensor 130 may include, but is not limited to, an acceleration sensor, a tilt sensor, a gyro sensor, a 3-axis magnetic sensor, a voice recognition sensor, a luminance sensor, a sensor temperature, an image sensor (for example, a camera), and a touch sensor.

The sensor 130 can interoperate with a non-interruption detection platform (SSP) 10. The SSP 10 may include a sensor hub and an SSP manager. At this point, the sensor 130 may be connected to the sensor hub, and the Sp manager can be included in a structure of an application processor (AP) 161.

Therefore, the sensor concentrator can collect a plurality of pieces of detection information (ie, the plurality of pieces of event information about the events taking place in the first device 100) by the sensor 130. In this point, in a case where the AP 161 in an idle mode has to be active (for example, in a case where the sensor 130 detects the output of the service area of the second device 200), the sensor concentrator can transmit a interrupt signal to the SSP manager to inform the SSP manager of data to be transmitted.

The SSP manager can transmit a signal that asks the sensor concentrator for a type and length of the data to be transmitted by the sensor concentrator. In this case, the sensor concentrator can transmit to the SSP manager a signal that includes the type and length of the data to be transmitted. The SSP manager can transmit a start message to read to the sensor hub, and when the sensor hub receives the start message to read, the sensor hub can process detection data to a predefined packet and then transmit the packet. to the SSP manager.

In the present exemplary embodiment, the sensor 130 may be arranged in an external device that is connected to the first device 100. The external device may be related to an application running in the first device 100. In another exemplary embodiment, they may be arranged one or more external devices. The first device 100 can control the external device using the application.

The first device 100 can receive from the external device data that is detected by the sensor 130 disposed in the external device. For example, in a case where the temperature sensor is embedded in a clock, and the sensor of acceleration is embedded in a belt, the first device 100 can receive temperature information from the watch and can receive acceleration information from the belt. At this point, the watch and the strap can be controlled by an application installed in the first device 100.

In accordance with the present exemplary embodiment, the various sensors can be embedded separately in peripheral devices so that the power consumption of the first device 100 can be reduced.

The user input device 140 may be a device by which the user enters data to control the first device 100. The user input device 140 may include a numeric keypad, a dome switch, a touch pad (a touch pad) capacitive touch type, a resistive pressure type touch pad, an infrared beam detection type touch pad, a surface acoustic wave type touch pad, an integral extensiometric gauge type touch pad, a touch pad piezo effect type, or the like), a scroll wheel, and a scroll switch, although one or more exemplary embodiments are no longer limited thereto.

The A / V input device 150 may be arranged to receive an input of an audio signal or a video signal and may include a camera 151, a microphone 152, or the like. The camera 151 can obtain an image frame such as a still image or a moving image by an image sensor in a video call mode or a photo mode. The image captured by the image sensor can be processed by controller 160 or a separate image processing device (not shown). The processed image frame can be displayed on the screen 121, it can be stored in the memory 170, or it can be transmitted to an external source by means of the communication device 110. According to a configuration of the first device 100, at least two cameras 151 may be arranged.

The microphone 152 can receive an input from an external voice signal in a call mode, a recording mode, or a voice recognition mode and can process the voice signal in electrical voice data. In the call mode, the processed voice data can be converted to be transmitted to a mobile communication base station via the mobile communication device 111 and then can be transmitted.

The controller 160 can generally control all the operations of the first device 100. That is, the controller 160 can execute programs stored in the memory 170 and therefore can control the communication device 110, the output device 120, the sensor 130 , user input device 140, A / V input device 150, memory 170, or the like.

Controller 160 may include AP 161 and a communication processor 162. The AP 161 can control the execution of various applications stored in the memory 170. The communication processor 162 can control various communication functions. In the present exemplary embodiment, the AP 161 and the communication processor 162 may be integrally realized as a hardware device or be performed separately as independent hardware devices.

Memory 170 may store a program to process and control controller 160, or it may store a plurality of pieces of data (for example, a recommendation element, information about content, detection information, etc.) that are input / output .

The memory 170 may include at least one storage medium between a storage medium of the flash memory type, a storage medium of the hard disk type, a storage medium of the micro-multimedia card type, memory cards (for example, an SD card, an XD memory, and the like), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read Only Memory (ROM), Erasable Electrically Programmable Read Only Memory (EEPROM), memory Magnetic Programmable Read-Only Memory (PROM), a magnetic disk, and an optical disk. Also, the first device 100 can control a web storage that performs a memory storage function 170 via the Internet.

Programs stored in memory 170 can be classified into a plurality of modules according to their functions, for example, in a UI module 171, a touch screen module 172, a context analysis module 173, a management module 174 of recommendation element, or similar.

The UI module 171 can provide a UI or graphical user interface (GUI) that are specialized according to the applications. The touch screen module 172 can detect a user's touch gesture on the touch screen and can transmit information related to the touch gesture to the controller 160. The touch screen module 172 can be configured as a separate controller (hardware)

Various sensors may be arranged at or near the touch screen to detect a touch or a close touch on the touch sensor. An example of the sensor to detect touch on the touch screen can be a touch sensor. The touch sensor detects a contact of a specific object at least by what a person can detect. The touch sensor can detect various types of information such as the roughness of a contact surface, the roughness of the contact object, the temperature of a contact point, or the like.

The user's touch gesture can include a touch gesture, a touch and maintenance gesture, a drag gesture, a panoramic gesture, a turning gesture, a drag and drop gesture, or the like.

"Touch" is a movement of the user's touch of a screen using a finger or a touch tool such as an electronic pen and then instantly lift the finger or touch screen tool without movement.

"Touch and hold" is a touch user movement of a screen using a finger or a touch tool such as an electronic pen and then maintain the previous touch movement for a critical time (for example, 2 seconds), after the touch from the screen. For example, a time difference between an input touch time and an output touch time is greater than or equal to the critical time, for example, 2 seconds. When a touch input lasts longer than the critical time, to inform the user if the touch input is touch or touch and maintenance, a feedback signal can be provided in a visual, acoustic or tactile manner. The critical time may vary according to exemplary embodiments.

"Double tap" is a user movement of tapping the screen twice using the finger or touch tool (such as a pen a stylus).

"Drag" is a movement of the user's touch of the screen using the finger or touch tool and move the finger or touch tool to another position on the screen while maintaining the touch movement. Dragging movement can enable the movement or panning of an object.

"Panoramic" is a movement of the user making a drag movement without selecting an object. Since no object is selected in the panning movement, the object is not moved on a page but the same page is moved on the screen or a group of objects can be moved within a page.

"Rotate" is a movement of the user making a drag movement during a critical speed, for example, 100 pixels / s, using the finger or touch tool. The dragging motion (panning) or the turning movement can be distinguished based on whether or not the movement speed of the finger or touch tool is above the critical speed, for example, 100 pixels / s.

"Drag and drop" is a movement of the user dragging an object to a predetermined position on the screen using the finger or touch tool and then dragging the object into that position.

"Pinch" is a movement of the two-finger movement that touches the screen in opposite directions. The pinch movement is a gesture to enlarge (open pinch) or contract (close pinch) an object or page. An enlargement value or a contraction value is determined according to the distance between the two fingers.

"Swipe" is a user's movement of touching an object on the screen using the finger or touch tool and simultaneously moving the object horizontally or vertically a predetermined distance. A sliding movement in a diagonal direction may not be recognized as a sliding event.

Memory 170 may include a voice recognition module (not shown) that recognizes a user's voice using a voice recognition engine and transmits the recognized voice to controller 160.

The context analysis module 173 can analyze a context, based on the plurality of pieces of event information collected by the sensor 130. For example, the context analysis module 173 can calculate a level of interest of the user of the first device 100 in the content reproduced by the second device 200. In the present exemplary embodiment, the context analysis module 173 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200, based on input information of the user, user status information, current position information, reservation history information, etc.

For example, when the user of the first device 100 performs a registration procedure with respect to the second device 200 or the service area of the second device 200 using the first device 100, the context analysis module 173 can calculate a high level of interest of the user of the first device 100 in the content reproduced by the second device 200.

The context analysis module 173 can calculate a probability that the user of the first device 100 can display the content reproduced by the second device 200, and therefore can calculate the level of interest of the user of the first device 100. At this point , the context analysis module 173 can calculate the probability that the user of the first device 100 can display the content reproduced by the second device 200, based on the user status information, the current position information, application information about of an application executed on the first device 100, or the like.

For example, when the user of the first device 100 downloads data provided by the second device 200 to the first device 100, or enters recommendation information to the first device 100 to recommend the content played by the second device 200 to another user via an SNS , the context analysis module 173 can calculate a high probability (for example, approximately 95%) that the user of the first device 100 can display the content reproduced by the second device 200.

Also, when a position of the first device 100 is not changed in the service area of the second device 200 for a predetermined period of time, and a user input is not detected for a predetermined period of time, the context analysis module 173 it can calculate a high probability (for example, approximately 90%) that the user of the first device 100 can display the content reproduced by the second device 200.

On the other hand, although the first device 100 is located in the service area of the second device 200 during the predetermined period of time, while the first device 100 is located in the service area of the second device 200, if the first device 100 receives from the user of the first device 100 an execution request with respect to an application that is irrelevant to the content reproduced by the second device 200, the context analysis module 173 can calculate a low probability (for example, approximately 30%) that the user of the first device 100 can display the content reproduced by the second device 200.

In the present exemplary embodiment, the context analysis module 173 can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200, based on information obtained by detecting the eyes of the user by the camera 151.

When the first device 100 has a purchase purchase history of a ticket with respect to the content reproduced by the second device 200, or has a record history with respect to the service area of the second device 200, the analysis module 173 context may determine that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value.

In the present exemplary embodiment, the context analysis module 173 can analyze event information collected based on ontology, and therefore can obtain information about the level of interest of the user of the first device 100 in the content reproduced by the second device 200 .

For example, the context analysis module 173 may obtain information about correlation between text / voice inputs by the user and the content reproduced by the second device 200, based on ontology. Based on the information about the correlation between the text / voice inputs by the user and the content reproduced by the second device 200, the context analysis module 173 can calculate the level of interest of the user of the first device 100 in the content played by the second device 200.

The recommendation element management module 174 can manage recommendation elements that are received from the management server 300, the second device 200, or the external device. Also, the recommendation element management module 174 can directly generate a recommendation element, based on information about the content received from the second device 200.

Figure 18 is a block diagram illustrating a configuration of the second device 200, in accordance with an exemplary embodiment.

As illustrated in Figure 18, the second device 200 may include a communication device 210, an output device 220, a user input device 230, a controller 240 (also referred to as a processor 240), and a memory 250 However, not all items shown are necessary items. That is, the second device 200 can be made with more or less elements than the elements shown.

Hereinafter, the aforementioned elements are described.

The communication device 210 may include one or more elements to allow communication between the second device 200 and the first device 100, or communication between the second device 200 and the management server 300. For example, the communication device 210 may include a mobile communication device 211, a short distance communication device 212, a position information device 213, and a wireless communication device 214.

In the present exemplary embodiment, examples of short distance communication may include, but are not limited to, Wi-Fi, Bluetooth, ZigBee, WFD, UWB, IrDA, BLE, and ANT +.

The communication device 210 may transmit information about content to the first device 100 or to the management server 300. Also, the communication device 210 may transmit a recommendation element related to the content to the first device 100 or the management server 300.

The communication device 210 may periodically disseminate, via short distance communication, information about the management server 300 corresponding to a recommendation element related to the content reproduced by the second device 200. The information about the management server 300 may include link information (for example, a URL) to access the management server 300.

The output device 220 may operate to emit an audio signal, a video signal, or a signal from vibration and may include a screen 221, a sound output device 222, a vibration motor 223, or the like.

The screen 221 displays and issues information that is processed in the second device 200. For example, the screen 221 can display on a screen the content played by the second device 200.

Also, the screen 221 can display the information about the management server 300 corresponding to the recommendation element related to the content reproduced by the second device 200, by means of a 2D barcode (for example, a QR barcode), a color code, a gray code, etc.

When the screen 221 and a touch pad form a mutual layer structure and are then formed as a touch screen, the screen 221 can be used both as an output device and an input device. Screen 221 may include at least one of an LCD, a TFT-LCD, an organic light emitting diode screen, a flexible screen, a 3D screen, and an electrophoretic screen. Also, according to a type of the second device 200, the second device 200 may include at least two screens 221.

The sound output device 222 emits audio data that is received from the communication device 210 or is stored in memory 250. The sound output device 222 emits a sound signal related to functions performed by the second device 200 The sound output device 222 may include a speaker, a buzzer or the like.

The vibration motor 223 can emit a vibration signal. For example, the vibration motor 223 can emit the vibration signal that corresponds to an output of the audio data or video data. Also, when a touch is introduced to the touch screen, the vibration motor 223 can emit a vibration signal.

The user input device 230 may be a device by which the user enters data to control the second device 200. The user input device 230 may include a numeric keypad, a dome switch, a touch pad (a touch pad) capacitive touch type, a resistive pressure type touch pad, an infrared beam detection type touch pad, a surface acoustic wave type touch pad, an integral extensiometric gauge type touch pad, a touch pad piezo effect type, or the like), a scroll wheel, and a scroll switch, although one or more exemplary embodiments are no longer limited thereto.

The controller 240 can in general control all the operations of the second device 200. That is, the controller 240 can execute programs stored in the memory 250 and therefore can control the communication device 210, the output device 220, the device 230 User input, memory 250, or the like.

The memory 250 may store a program to process and control the controller 240, or it may store a plurality of pieces of data (for example, a recommendation item, content information, detection information, etc.) that are input / output .

The memory 250 may include at least one storage medium between a flash memory type storage medium, a hard disk type storage medium, a multimedia microcard type storage medium, card type memories (for example, an SD card, an XD memory, and the like), RAM, SRAM, ROM, EEPROM, a magnetic PROM memory, a magnetic disk, and an optical disk. Also, the second device 200 can control a web storage that performs a memory storage function 250 via the Internet.

Programs stored in memory 250 can be classified into a plurality of modules according to their functions, for example, in a module 251 of UI, a module 252 for content reproduction, a module 253 for generating a recommendation element, a module 254 content management, or the like.

The UI module 251 can provide a UI, a GUI, or the like that are specialized according to a plurality of pieces of content or applications. The content playback module 252 can play content. The functions of the UI module 251 and the content reproduction module 252 can be intuitively deduced by a person skilled in the art by referring to sensor names, therefore, detailed descriptions thereof are omitted at this point.

The module 253 generating the recommendation element can generate a recommendation element related to the content reproduced. For example, the recommendation element generation module 253 can generate a resume element using an image captured from a screen that reproduces the content, and playback position information indicating a position of content playback at a time point when The image is captured. Also, the recommendation element generation module 253 can generate an application element, an advertisement element, an additional information element, or the like corresponding to the content reproduced.

The content management module 254 can manage the content played by the second device 200, information about the content, or the like.

Figure 19 is a block diagram illustrating a configuration of the management server 300 according to an exemplary embodiment.

As illustrated in Figure 19, the management server 300 may include a communication device 310, a controller 320, and a memory 330. However, not all of the elements shown are necessary elements. That is, the management server 300 can be performed with more or less elements than the elements shown.

Hereinafter, the aforementioned elements are described.

The communication device 310 may include one or more elements to allow communication between the management server 300 and the first device 100 or communication between the management server 300 and the second device 200.

The communication device 310 may receive from the first device 100 a request for a recommendation element related to content reproduced by the second device 200. The communication device 310 may request from the second device 200 information about the content reproduced by the second device 200 and You can receive the requested information. The communication device 310 may transmit to the first device 100 the recommendation element related to the content reproduced by the second device 200.

The communication device 310 may transmit the recommendation element related to the content to a cloud server that is connected to the first device 100.

Controller 320 can generally control all operations of management server 300. That is, the controller 320 can execute programs stored in memory 330 and therefore can provide the first device 100 with the recommendation element related to the content played by the second device 200.

Memory 330 can store a program to process and control controller 320, or it can store a plurality of pieces of data (for example, a recommendation item, content information, detection information, etc.) that are input / output. .

Programs stored in memory 330 can be classified into a plurality of modules according to their functions, for example, in a context analysis module 331, a recommendation element generation module 332, a zone management module 333 service, or similar.

The context analysis module 331 can analyze a context, based on a plurality of pieces of event information collected by the first device 100. For example, the context analysis module 331 can calculate a user interest level of the first device 100 in the content reproduced by the second device 200, a probability that the user of the first device 100 can display the content reproduced by the second device 200, or the like. The context analysis module 331 can calculate the probability that the user of the first device 100 can display the content reproduced by the second device 200, based on user input information, user status information, position information, position information reservation history, etc.

When the first device 100 has a purchase purchase history of a ticket to view the content reproduced by the second device 200, or has a record history with respect to a service area of the second device 200, the analysis module 331 context may determine that the level of interest of the user of the first device 100 in the content reproduced by the second device 200 is equal to or greater than a predetermined value.

In accordance with the present exemplary embodiment, the context analysis module 331 can analyze the plurality of pieces of event information collected by the first device 100 based on ontology, and therefore can analyze the level of interest of the user of the first device 100 in the content played by the second device 200.

For example, the context analysis module 331 can obtain correlation information about correlation between text / voice inputs by the user and the content reproduced by the second device 200, based on ontology, and then can calculate the level of interest of the user of the first device 100 in the content reproduced by the second device 200, using the correlation information.

The recommendation element generation module 332 may generate the recommendation element related to the content reproduced by the second device 200 at a time point when the first device 100 leaves the service area of the second device 200, based on the information about the content received from the second device 200.

The recommendation element generation module 332 can generate a resume element using captured image information obtained by capturing an image of the content reproduced by the second device 200 at the time point when the first device 100 leaves the service area of the second device 200, and playback position information about a playback position of the content played by the second device 200 at the time point when the First device 100 leaves the service area of the second device 200. Also, the recommendation element generation module 332 can generate an application element, an advertisement element, an additional information element, etc., such as the information element. recommendation, which corresponds to the content reproduced.

The service zone management module 333 can manage a plurality of pieces of information about the service area of the second device 200 that provides a content playback service. For example, the service zone management module 333 can manage a position of the second device 200, a location of the service area of the second device 200, ID information of the second device 200, information about the content played by the second device 200, or the like.

According to the one or more exemplary embodiments, the first device 100, which is a personal device of a user, allows the user of the first device 100 to experience again through the first device 100 a service that the user experienced before by another device of the first device 100.

One or more exemplary embodiments can also be performed as commands programmed to run on various computer media, and then can be recorded to a computer readable recording medium. The computer readable recording medium may include one or more of the programmed commands, data files, data structures, or the like. Programmed commands recorded on the computer readable recording medium may be designed or configured particularly for one or more exemplary embodiments or may be well known to a person skilled in the art. Examples of the computer-readable recording medium include magnetic media that include hard drives, magnetic tapes, and floppy disks, optical media that include CD-ROM and DVD, magneto-optical media that includes floppy disks, and a hardware device designed to store and execute the programmed commands in ROM, RAM, a flash memory, and the like. Examples of programmed commands include not only machine codes generated by a compiler but also include large codes to run on a computer using an interpreter. The hardware apparatus may be configured to function as one or more software modules to perform operations of one or more exemplary embodiments, or vice versa.

It should be understood that the exemplary embodiments described therein should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of the characteristics or aspects within each exemplary embodiment should typically be considered as available for other characteristics or similar aspects in other exemplary embodiments.

Although one or more exemplary embodiments have been described with reference to the figures, it will be understood by those skilled in the art that various changes in form and details can be made therein without departing from the scope of the inventive concept as defined by the following claims.

Claims (16)

1. A first device (100) configured to display an object related to content reproduced by a second device (200), the first device (100) comprising: a sensor (130) configured to detect an output of the first device (100) from a service area of the second device (200); a communicator (110) configured to communicate with a server (300); Y a controller (160) configured to control the communicator (110) to transmit a request to the server (300) for the object related to the content played by the second device (200) when the output of the first device (100) of the device is detected. service area of the second device (200) and to receive the requested object related to the content of the server (300), and control a screen of the first device (100) to display the object related to the content received from the server (300); in which the service area is an area where the second device (200) provides a service to the first device (100); wherein the request comprises at least one of the service area ID information, position information of the second device (200), and ID information of the second device (200); Y wherein the controller (160) is configured to obtain a level of interest of a user of the first device (100) in the content played by the second device (200), based on event information collected by the first device (100) , and control the communicator (110) to transmit the request to the server (300) for the object related to the content if the level of interest obtained is equal to or greater than a predetermined value. 2. The first device (100) of claim 1, wherein the sensor (130) is configured to detect a communication disconnect between the first device (100) and the second device (200). 3. The first device (100) of claim 1, wherein the sensor (130) is configured to detect the output of the first device (100) from the service area of the second device (200) based on recognition by a external device located outside the service area of the second device (200), or located in a boundary of the service area of the second device (200). 4. The first device (100) of claim 1, wherein the controller (160) is configured to calculate a probability that the user of the first device (100) will display the content played by the second device (200), based in the event information collected by the first device (100). 5. The first device (100) of claim 1, wherein the content-related object comprises an image of the content connected to at least one of link information and index information to access the image. 6. The first device (100) of claim 1, wherein the content-related object comprises at least one of an application element corresponding to the content, a resume element corresponding to the content, an additional information element that corresponds to the content, and an ad element that corresponds to the content. 7. The first device (100) of claim 1, wherein the controller (160) is configured to control the screen to display the object related to the content on a first screen that is displayed when an operating mode of the first device (100) is switched from a standby mode to an active mode. 8. The first device (100) of claim 1, wherein the service area of the second device (200) comprises a communication area where the first device (100) communicates with the second device (200). 9. A method of displaying an object related to content reproduced by a second device (200), the procedure performed by a first device (100) and comprising: detecting an output of the first device (100) from a service area of the second device (200); transmitting a request to a server (300) for the object related to the content reproduced by the second device (200) when the output of the first device (100) from the service area of the second device (200) is detected; receive the object related to the content of the server (300); Y display the object related to the content received from the server (300); in which the service area is an area where the second device (200) provides a service to the first device (100); wherein the request comprises at least one of the service area ID information, position information of the second device (200), and ID information of the second device (200); wherein the method further comprises obtaining a level of interest of a user of the first device (100) in the content reproduced by the second device (200), based on event information collected by the first device (100); Y in which transmitting the request comprises transmitting the request to the server (300) for the object related to the content if the level of interest obtained is equal to or greater than a predetermined value. 10. The method of claim 9, wherein the first device (100) comprises a personal mobile device, and wherein the second device (200) comprises a public device. 11. The method of claim 9, wherein the detection of the output of the first device (100) comprises detecting a communication disconnect between the first device (100) and the second device (200). 12. The method of claim 9, wherein the detection of the output of the first device (100) comprises recognizing the output of the first device (100) by an external device located outside the service area of the second device (200) or located in a limit of the service area of the second device (200). 13. The method of claim 9, wherein the display of the content-related object comprises displaying the information related to the content when an illuminance value outside the first device (100) is equal to or greater than a predetermined value. 14. A non-transient computer-readable recording medium that has a computer program recorded therein to execute a procedure performed by a first device (100) comprising: detecting an output of the first device (100) of a service area of a second device (200); transmitting a request to a server (300) for an object related to the content reproduced by the second device (200) when the output of the first device (100) from the service area of the second device (200) is detected; receive the object related to the content of the server (300); Y display the object related to the content received from the server (300); in which the service area is an area where the second device (200) provides a service to the first device (100); wherein the request comprises at least one of the service area ID information, position information of the second device (200), and ID information of the second device (200); wherein the method further comprises obtaining a level of interest of a user of the first device (100) in the content reproduced by the second device (200), based on event information collected by the first device (100); Y in which transmitting the request comprises transmitting the request to the server (300) for the object related to the content if the level of interest obtained is equal to or greater than a predetermined value. 15. The non-transient computer readable recording medium of claim 14, wherein the detection of the output of the first device (100) comprises detecting a communication disconnect between the first device (100) and the second device (200) . 16. The non-transient computer readable recording medium of claim 14, wherein the detection of the output of the first device (100) comprises recognizing the output of the first device (100) by an external device located outside the zone of service of the second device (200) or located in a limit of the service area of the second device (200).