WO2016076627A1

WO2016076627A1 - Method for sharing content and content sharing system

Info

Publication number: WO2016076627A1
Application number: PCT/KR2015/012116
Authority: WO
Inventors: 장바이후이; 리우쥔웨이
Original assignee: 삼성전자 주식회사
Priority date: 2014-11-12
Filing date: 2015-11-11
Publication date: 2016-05-19

Abstract

A method for sharing a content by a device comprises the steps of: receiving, from another device, a capture image obtained by capturing a screen of the another device and execution information for executing a content corresponding to an object displayed in the capture image; displaying the capture image; and executing the content corresponding to the object using the execution information in response to a user input to the area where the object is displayed in the capture image.

Description

How to share content and content sharing system

A method of sharing content and a content sharing system. Specifically, the present invention relates to a method for transmitting execution information for executing content to devices included in a content sharing system and a method for executing content using the execution information.

As technology associated with devices continues to evolve, the amount of information exchanged between devices is increasing. For example, various types of files are being transferred between devices.

Recently, when files are sent and received between devices, if the receiving device needs to know what files are being sent from the sending device, the sending device first sends a screenshot to show the list of files to send. do. Thereafter, the transmitting device transmits each of the files included in the list to the receiving device. This causes inefficient information transfer between devices.

Provides efficient information transfer between devices.

In order to solve the above-mentioned problems, receiving a capture image capturing a screen of another device and execution information for executing content corresponding to an object displayed on the captured image from another device, displaying a captured image, and a captured image In response to a user input for an area in which an object is displayed, the method provides a content sharing method comprising executing content corresponding to the object using execution information.

1 is a schematic diagram of a content sharing system.

2 is a flowchart illustrating a method of transmitting execution information for executing content by a first device to a second device in a content sharing system according to an embodiment.

3 illustrates an example of generating a transmission file including a capture image and execution information in a content sharing system.

4 illustrates an example of generating coordinate information of a predetermined area including at least one object in a captured image.

5 illustrates an example of generating a mapping table in a content sharing system.

6 is a flowchart illustrating another method of transmitting execution information for executing content by a first device to a second device in a content sharing system.

7 is another example in which the first device generates a transfer file including the captured image and the execution information in the content sharing system.

8 is a flowchart illustrating a method of receiving execution information from a first device for executing content by a second device in a content sharing system.

FIG. 9 illustrates an example of executing content using the mapping table of FIG. 5.

10 illustrates an example in which a second device stores content using execution information.

11 is an example of a captured image displayed by a second device.

12 is a flowchart illustrating another operation method of a content sharing system.

FIG. 13 illustrates an example in which a first device transmits a transmission file including a captured image and content identification information to a second device in a content sharing system.

14 is another example of generating a mapping table in a content sharing system.

15 is a flowchart illustrating a method of sharing content in a content sharing system according to another embodiment.

16 illustrates an example of sharing execution information of content using voice data.

17 is a flowchart illustrating a method of sharing content in a content sharing system according to another embodiment.

18 illustrates an example of sharing execution information of content using text data.

19 is a flowchart illustrating a method of sharing content in a content sharing system according to another embodiment.

20 illustrates an example of sharing execution information of content using video data.

FIG. 21 is a diagram illustrating a configuration of a first device and a second device in a content sharing system.

It is a figure explaining the detailed structure of a device.

A first aspect of the disclosed embodiment for solving the above problems is a step of receiving a capture image capturing a screen of another device and execution information for executing content corresponding to an object displayed on the captured image from another device, the captured image And displaying content, and executing content corresponding to the object by using the execution information, in response to a user input of an area in which the object is displayed in the captured image.

In addition, the other device may be transmitting or receiving a message with the device using the chat application, and the captured image may be displayed in the chat window of the chat application.

In addition, the executing of the content may include requesting the content corresponding to the object to another device using the execution information, and receiving the content from the other device.

The method may further include receiving a mapping table including coordinate information of the object in the captured image and execution information corresponding to the coordinate information.

The method may further include identifying execution information corresponding to the coordinate information of the region where the object is displayed, based on the received mapping table, and the executing may include executing content using the identified execution information. Can be.

In addition, the execution information may be at least one of a content file, identification information of the content file, and link information for downloading the content.

In addition, the step of executing may include displaying a graphical user interface (GUI) for storing content on the device.

Also, the object is an object selected by a user of another device among the plurality of objects in the captured image, and the object may be highlighted and displayed in the captured image.

In accordance with a second aspect of the disclosed embodiment, in response to a user input capturing a screen of the device, generating a capture image, and executing information for executing the content corresponding to the captured image and the object displayed in the captured image to another device It provides a content sharing method comprising the step of transmitting.

The method may further include transmitting a mapping table including coordinate information of the object in the captured image and execution information corresponding to the coordinate information to another device.

The method may further include receiving a user input for selecting an object from among the plurality of objects in the captured image, wherein the object may be highlighted in the captured image.

A third aspect of the disclosed embodiment includes a communication unit for receiving a capture image capturing a screen of another device and execution information for executing content corresponding to an object displayed on the captured image from another device; A display unit for displaying a captured image, and a control unit for executing the content corresponding to the object by using the execution information in response to a user input for the area in which the object is displayed in the captured image.

In addition, the other device may exchange messages with the device using a chat application, and the display unit may display the captured image in a chat window of the chat application.

In addition, the communication unit may request content corresponding to the object from another device using the execution information and receive the content from the other device in response to the user input.

In addition, the communication unit may receive a mapping table including coordinate information of the object in the captured image and execution information corresponding to the coordinate information.

In addition, the controller may identify execution information corresponding to the coordinate information of the region in which the object is displayed, based on the received mapping table, and execute content using the identified execution information.

In addition, the display unit may display a graphical user interface (GUI) for storing content in the device.

In accordance with a fourth aspect of the disclosed embodiment, in response to a user input of capturing a screen of a device, a controller for generating a captured image and execution information for executing content corresponding to the captured image and the object displayed on the captured image to another device It provides a device including a communication unit for transmitting.

A fifth aspect of the disclosed embodiment provides a computer readable recording medium having recorded thereon a program for implementing the method of the first and second aspects of the disclosed embodiment.

Terms used herein will be briefly described and the present invention will be described in detail.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are only used to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes any one of a plurality of related items or a combination of a plurality of related items.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless otherwise stated. In addition, the term "part" as used herein refers to a hardware component, such as software, FPGA or ASIC, and "part" plays certain roles. However, "part" is not meant to be limited to software or hardware. The “unit” may be configured to be in an addressable storage medium and may be configured to play one or more processors. Thus, as an example, a "part" refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. The functionality provided within the components and "parts" may be combined into a smaller number of components and "parts" or further separated into additional components and "parts".

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

1 is a schematic diagram of a content sharing system. Referring to FIG. 1, a content sharing system includes a first device 100 and a second device 200.

The first device 100 and the second device 200 may be computing devices that transmit and receive messages by executing a chat application. For example, the first device 100 and the second device 200 may be a smartphone, tablet PC, PC, smart TV, mobile phone, personal digital assistant (PDA), laptop, media player, micro server, global positioning system (GPS). system) devices, e-book terminals, digital broadcasting terminals, navigation, kiosks, MP3 players, digital cameras and other mobile or non-mobile computing devices, but is not limited thereto. In addition, the first device 100 and the second device 200 may include various devices such as an electronic blackboard, a touch table, and the like. In addition, the first device 100 and the second device 200 may be watches, glasses, hair bands and rings having a communication function and a data processing function. However, the present invention is not limited thereto, and the first device 100 and the second device 200 may include all kinds of devices capable of transmitting and receiving data through a network.

According to an embodiment, the first device 100 may transmit content to the second device 200 while transmitting and receiving a message with the second device 200. The first device 100 may capture a screen on which an object (eg, an icon, a name, etc. of a content file) indicating content to be transmitted is displayed. The first device 100 may transmit a content file corresponding to the objects displayed in the captured image to the second device 200 along with the captured image. For example, in order to simultaneously transmit a plurality of contents, the first device 100 may capture a screen displaying a file list in which content files to be transmitted are listed. Accordingly, a user of the first device 100 may easily transmit a plurality of content files to the second device 200.

Alternatively, the first device 100 may share a web page while transmitting and receiving a message with the second device 200. According to an embodiment, the first device 100 may capture a screen on which an object indicating a web page to be shared (for example, an execution window of the web page, a shortcut icon for accessing a specific web page, etc.) is displayed. The first device 100 may transmit the link information for downloading the web page corresponding to the objects displayed on the captured image to the second device 200 along with the captured image.

The captured image transmitted by the first device 100 may be displayed in a chat window of a chat application in which the first device 100 and the second device 200 transmit and receive a message. The second device 200 may receive a captured image through a chat window, and selectively receive and store a content file transmitted by the first device 100 in response to a user input of selecting an object displayed on the captured image. .

Meanwhile, the network illustrated in FIG. 1 includes a local area network (LAN), a wide area network (WAN), a value added network (VAN), a mobile radio communication network, and a satellite. It is a comprehensive data communication network that includes a communication network and a combination thereof, and enables each network constituent illustrated in FIG. 1 to communicate smoothly with each other, and may include a wired internet, a wireless internet, and a mobile wireless communication network. have.

2 to 14, a method in which the first device 100 transmits execution information for executing content together with the captured image to the second device 200 to the second device 200 will be described in detail. . 15 to 20, execution information for executing content is transmitted to the second device 200 by using the content information included in the audio, text, and video data received by the first device 100 from the user. The transmission method will be described in detail.

Also, for convenience of description, it is assumed that the first device 100 transmits execution information for executing the captured image and the content to the second device 200, but the second device 200 transmits the first device 100. It can be easily understood by those of ordinary skill in the art that the captured image and the like can be transmitted in the following embodiments.

Referring to FIG. 2, in operation S210, the first device 100 may generate a captured image in response to a user input of capturing a screen of the first device 100. In this case, the first device 100 may be executing a chat application, and may be transmitting and receiving a message with the second device 200 through the chat application.

In detail, the first device 100 may execute an execution screen, a home screen, or a menu screen of another application in the foreground while transmitting and receiving a message with the second device 200 through a chat application. In this case, the chat application may be executed in the background. In addition, the other application may be, for example, a searcher application, a photo album application, an address book application, a web server application, a browser application, or the like.

A user of the first device 100 may capture an execution screen of another application in which an object representing content that can be transmitted to the second device 200 is displayed through a chat application. For example, the first device 100 A user input for capturing an execution screen of a photo album application displaying an icon of a photo to be transmitted to the second device 200 may be received. Alternatively, the first device 100 may receive a user input for capturing an execution screen of an address book application displaying contact information to be transmitted to the second device 200. Alternatively, the first device 100 may receive a user input for capturing a menu screen on which an icon of an application to be transmitted to the second device 200 is displayed.

Alternatively, the first device 100 may copy an icon, an image, and / or text representing contents stored in different paths to a temporary storage space and then receive a user input of capturing the temporary storage space. In this case, the temporary storage space may be a clipboard provided by the chat application and may be displayed on the screen of the first device 100.

The user input for touching the screen may be a touch input using a user's hand, a stylus pen, or the like, or a button input using a button provided in the first device 100, or a combination thereof.

The first device 100 may generate a captured image in response to a user input of capturing a screen.

In operation S220, the first device 100 may transmit execution information for executing the content corresponding to the captured image and the object displayed on the captured image to the second device 200. Here, the execution information may be, for example, a content file of content corresponding to the object displayed in the captured image, identification information of the content file, or link information for downloading the content. In addition, the execution information may be, for example, identification information of the content, but is not limited thereto.

In detail, the first device 100 may identify the objects included in the captured image by analyzing the captured image. In addition, the first device 100 may determine whether the identified objects represent content. For example, when the object is text, the first device 100 may search for a content file having the same file name as the text. Alternatively, when the object is an image, the first device 100 may search for a content file having the same icon as the image. In this case, the first device 100 may search for a content file stored in the first device 100 or an external server. If the content file exists in the first device 100, the first device 100 may use the content file as execution information, and if the content file exists in an external server, the first device 100 may Link information in which a content file is stored in an external server may be used as execution information.

The first device 100 may generate a transmission file including the captured image and the execution information, and transmit the transmission file to the second device 200. For example, the first device 100 may generate a transmission file having a Multipurpose Internet Mail Extension HTML (MHTML) or Election Markup Language (EML) file format.

In addition, according to an embodiment, the first device 100 may generate coordinate information of a predetermined area including at least one object corresponding to the execution information in the captured image. For example, when one object corresponds to one execution information, the first device 100 may generate coordinate information about an area where one object is displayed in the captured image. Alternatively, when the plurality of objects correspond to the same execution information, the first device 100 may generate coordinate information about an area including the plurality of objects in the captured image. The first device 100 may transmit a mapping table including coordinate information corresponding to the object and execution information corresponding to the coordinate information to the second device 200. For example, the first device 100 may transmit a transmission file including the captured image, the execution information, and the mapping table to the second device 200.

If the execution information is identification information of the content file, the second device 200 may request content from the identification information of the content file to the first device 100. Here, the identification information of the content file may be a name of the content file, address information where the content file is stored, and the like. In this case, when the request is received from the second device 200, the first device 100 may transmit a content file.

Meanwhile, in the above description, the first device 100 generates a captured image while executing the chat application, but the present invention is not limited thereto. The first device 100 may generate a captured image regardless of whether the chat application is executed. In this case, the first device 100 may use a pre-stored captured image in the chat application. For example, when the first device 100 generates a captured image, a chat application may be executed.

Alternatively, in some embodiments, the chat application may provide a graphical user interface (GUI) capable of capturing execution screens of other applications. In this case, the first device 100 may generate a captured image by using a GUI provided by the chat application.

Referring to FIG. 3, the first device 100 may generate a captured image 320 according to a user input 310 for capturing all or part of a screen of the first device 100. In addition, the first device 100 may execute content corresponding to the

objects

321, 322, 323, 324, etc. displayed on the captured image 320 (that is, 'image 1' to 'image 5'). The execution information 330 may be obtained. For example, the execution information 330 may include content files (that is, image 1.jpg to image 5.jpg) stored in the first device 100.

In addition, the first device 100 may generate a transmission file 350 including the captured image 320 and the execution information 330. In addition, the transfer file 350 may further include a mapping table 340. The mapping table 340 may include coordinate information corresponding to the object 321 and the execution information 330 corresponding to the coordinate information in the captured image 320. A method of generating the mapping table 340 will be described in detail with reference to FIGS. 4 and 5.

Referring to FIG. 4, when the plurality of objects 321 correspond to the same execution information (ie, image 1), the first device 100 may include a predetermined area including the plurality of

objects

321 and 322. Coordinate information about 410 may be generated. For example, the first device 100 may generate coordinate information (that is, (x11, y11), (x12, y12)) at both ends of the diagonal direction of the predetermined region 410.

Alternatively, when one object 324 corresponds to one piece of execution information (that is, image 5), the first device 100 may refer to coordinate information of a predetermined area 420 including one object 324 ( That is, (x51, y51), (x52, y52)) can be generated.

Referring to FIG. 5, the first device 100 may generate a mapping table 340 including coordinate information of a predetermined area including at least one object and execution information corresponding to the coordinate information. In addition, the first device 100 may transmit the mapping table 340 to the second device 200. The second device 200 may execute content corresponding to the object displayed in the captured image 320 using the mapping table 340.

According to an embodiment, the mapping table 340 may be generated by the second device 200. In this case, the embodiment of FIGS. 4 and 5 may be performed by the second device 200.

Referring to FIG. 6, in operation S610, the first device 100 may generate a captured image in response to a user input of capturing a screen. For example, the first device 100 captures in response to a user input for capturing an execution screen of a photo album application, a explorer application, a photo album application, an address book application, a web server application, a browser application, or a home screen, a menu screen, or the like. You can create an image.

In operation S620, the first device 100 may receive a user input for selecting some of the objects displayed on the captured image. For example, the first device 100 may analyze the captured image to identify objects included in the captured image. In addition, the first device 100 may provide a GUI for selecting some of the identified objects. In addition, the first device 100 may highlight and display the selected object in the captured image. For example, the first device 100 may display the selected object in a thick line or in a specific color. Alternatively, when another object representing the same content as the selected object exists in the captured image, the first device 100 may highlight and display a predetermined area including different objects representing the same content.

In operation S630, the first device 100 may transmit execution information for executing the content corresponding to the captured image and the selected object, to the second device 200. For example, the first device 100 may retrieve content corresponding to the selected object from the first device 100 or an external server, and may obtain execution information for executing content corresponding to the selected object.

The first device 100 may generate a transmission file including the captured image and the execution information, and transmit the transmission file to the second device 200.

In addition, the first device 100 may generate coordinate information of a predetermined area including at least one object selected from the captured image. In this case, the first device 100 may generate a mapping table including coordinate information of a predetermined area including the selected object and execution information corresponding to the coordinate information.

As such, the first device 100 may selectively transmit execution information for executing content by using the captured image.

Referring to FIG. 7, the first device 100 captures an 'all' button image 701 and capture area 710 for obtaining execution information for executing content corresponding to all objects displayed in the capture area 710. The 'select' button image 703 may be provided to obtain execution information for executing content corresponding to some of the objects displayed on the screen. When the user of the first device 100 touches the 'all' button image 701, the first device 100 generates the transmission file 350 of FIG. 3, and then transfers the transmission file to the second device 200. 350 may be transmitted.

Alternatively, the first device 100 receives user inputs 717 and 719 for selecting some

objects

713 and 715 among the objects displayed in the capture area 710, and then displays the 'select' button image 703. It may also receive user input. In this case, the first device 100 executes the content corresponding to the selected

objects

713 and 715 according to the user inputs 717 and 719 (for example, 'image 1' and 'image 5'). Information 730 may be obtained. Here, the execution information 730 may include content files (eg, image 1.jpg and image 5.jpg) stored in the first device 100.

In addition, the first device 100 may highlight and display the first area 723 including the selected object 715 in the captured image 720. Alternatively, when another object 711 representing content (eg, 'image 1') corresponding to the selected object 713 exists in the captured image 720, the first device 100 may represent the same content. The second area 721 including the plurality of

objects

711 and 713 may be highlighted. Accordingly, the user of the second device 200 may easily recognize the

objects

711, 713, and 715 corresponding to the execution information 730 among the objects displayed on the received capture image 720.

In addition, the first device 100 may include a transmission file 750 including a captured image 720 and execution information 730, and generates a transmission file 750 further including a mapping table 740. You may. The mapping table 740 may include coordinate information of the first and

second regions

721 and 723 including the object selected in the captured image 720, and execution information corresponding to the coordinate information.

Referring to FIG. 8, in operation s810, the second device 200 may include a capture image capturing a screen of the first device 100 and execution information for executing content corresponding to an object displayed on the captured image. Can be received from 100. In this case, the second device 200 may be executing a chat application, and may be transmitting and receiving a message with the first device 100 through the chat application.

Here, the object displayed in the captured image may be an icon, text, and / or image representing content. In addition, the content may include text data, audio data, video data, and / or application execution data (eg, binary data) stored in the first device 100, and may include text data, audio data, stored in an external server, Video data and / or application execution data.

In addition, the execution information may be, for example, a content file of content corresponding to the object displayed in the captured image, identification information of the content file, or link information for downloading the content. For example, the second device 200 may receive a capture image and a content file for executing content corresponding to the object displayed on the capture image. Alternatively, the second device 200 may receive link information for downloading the content image for executing the content corresponding to the captured image and the object displayed on the captured image. However, the present invention is not limited thereto, and the second device 200 may be memory address information of the first device 100 in which a content image for executing content corresponding to the captured image and the object displayed on the captured image is stored. In this case, a method of executing content by the second device 200 will be described later in detail with reference to FIGS. 12 to 14.

Meanwhile, the captured image and the execution information may be transmitted in a Multipurpose Internet Mail Extension HTML (MHTML) or Election Markup Language (EML) file format.

In operation S820, the second device 200 may display the captured image. For example, the second device 200 may display the captured image in the chat window of the chat application.

In operation S830, the second device 200 may execute content corresponding to the object using execution information in response to a user input for a display area in which the object is displayed in the captured image.

For example, the second device 200 may analyze the captured image to identify an object displayed on the captured image. In addition, the second device 200 may receive a touch input using a user's hand, a stylus pen, or the like with respect to the display area where the identified object is displayed. The second device 200 may identify an object corresponding to the display area in which the touch input is received, and execute content using execution information corresponding to the object.

Alternatively, the second device 200 may receive a mapping table from the first device 100 including coordinate information of a predetermined area including an object and execution information corresponding to the coordinate information in the captured image. In this case, the second device 200 may execute the content by using coordinate information of the region where the user input is received, coordinate information of the mapping table, and real information. For example, the second device 200 may identify coordinate information of the mapping table that matches the coordinate information of the region where the object corresponding to the user input is displayed, and identify execution information corresponding to the coordinate information. Here, the matching may mean that the coordinate information of the region in which the object corresponding to the user input is displayed is included or coincident with the region according to the coordinate information of the mapping table. The second device 200 may execute the content by using the identified execution information.

Also, according to an embodiment, when the execution information is identification information of the content file, the second device 200 may request the content file from the first device 100 in response to a user input. When the content file is received from the first device 100, the second device 200 may execute the content using the content file.

According to an embodiment, the second device 200 may provide a graphical user interface (GUI) for storing the content in the second device 200 instead of immediately executing the content in response to a user input. When selecting a user input for storing content of the second device 200, the second device 200 may store the content in the second device 200 and then execute the content. In this case, the location where the content is stored may be preset in the second device 200, and may further provide a GUI for designating a storage location of the content.

Referring to FIG. 9, the second device 200 may display the captured image 920 received from the first device 100 in the chat window 910 of the chat application. When the captured image 920 is reduced in size, the second device 200 may receive a user input 923 that enlarges the captured image 920.

The second device 200 may receive a user input for one object 915 among the objects 911 to 919 displayed on the captured image 920. The second device 200 is coordinate information corresponding to coordinate information (x_in, y_in) of a region where an object corresponding to a user input is displayed among coordinate information of the mapping table 340 as {(x31, y31), (x32, y32). )} Can be identified. Also, the second device 200 may identify “image 3.jpg” corresponding to the identified coordinate information {(x31, y31), (x32, y32)} using the mapping table 340. The second device 200 may compensate the coordinate information of the mapping table 340 to match the coordinate system of the second device 200.

The second device 200 may display the image data 930 included in the 'image 3.jpg' file using the identified execution information.

As such, the first device 100 and the second device 200 may share content using the captured image 920 shared through the chat window 910. Meanwhile, although the first device 100 and the second device 200 have been described as sharing content, the disclosed embodiment may be applied to a plurality of devices that transmit and receive messages through the chat window 910. In this case, the first device 100 may transmit the captured image and the execution information to the plurality of devices.

Referring to FIG. 10, when the second device 200 receives a user input 1030 for an area in which the object 915 is displayed in the captured image 920, the second device 200 stores a GUI corresponding to the object 915. 1040 may be provided. For example, the GUI 1040 may include a "save" button image for storing content and a "execute" button image for directly executing the content. Therefore, in response to a user input to the GUI 1040, the second device 200 stores and executes the content obtained using the execution information received from the first device 100, or executes the execution information by using the execution information. You can run content right away.

11 is an example of a captured image displayed by a second device.

As illustrated in FIG. 11, the second device 200 may receive a captured image 1110 in which

predetermined areas

1101 and 1103 including some objects are highlighted. In this case, the second device 200 may execute content corresponding to the objects included in the highlighted

areas

1101 and 1103. If the user of the second device 200 selects an area 1120 including an object that is not highlighted in the captured image 1110, the second device 200 executes content corresponding to the selected object. Could not obtain execution information.

12 is a flowchart illustrating a method of operating a content sharing system.

Referring to FIG. 12, in operation S1210, the first device 100 may generate a captured image in response to a user input of capturing a screen of the first device 100.

In operation S1220, the first device 100 may obtain content identification information corresponding to the object displayed on the captured image. Here, the content identification information may include a name of the content, a unique number of the content, address information in which the content is stored, and the like.

For example, the first device 100 may analyze the captured image to identify objects displayed on the captured image. In addition, the first device 100 may obtain identification information of content corresponding to the identified object.

In operation S1230, the first device 100 may transmit identification information of the content corresponding to the captured image and the object displayed on the captured image, to the second device 200. In this case, the second device 200 may be an external device that transmits and receives a message through the chat window of the chat application with the first device 100.

In addition, the first device 100 may generate coordinate information of a predetermined area corresponding to the object in the captured image. The first device 100 may transmit a mapping table including coordinate information of a predetermined area corresponding to the object and content identification information corresponding to the coordinate information to the second device 200.

In operation S1240, the second device 200 may display a captured image received from the first device 100. For example, the second device 200 may display the captured image in the chat window of the chat application.

In operation S1250, the second device 200 may receive a user input for an area where an object is displayed in the captured image. For example, the second device 200 may receive a touch input using a user's hand, a stylus pen, or the like.

In operation S1260, the second device 200 may request the content device for executing the content or the link information for downloading the content to the first device 100 using the content identification information corresponding to the region. For example, the second device 200 may request the content file to the first device 100 by using the coordinate information of the region where the user input is received, the coordinate information of the mapping table, and the content identification information.

In operation S1270, the first device 100 may obtain a content file by using content identification information.

In operation S1280, the first device 100 may transmit the obtained content file to the second device 200.

In operation S1290, the second device 200 may execute content.

Referring to FIG. 13, the first device 100 may generate a captured image 1320 according to a user input 1310 that captures all or part of a screen of the first device 100. In addition, the first device 100 may include content identification information (ie, 'first memory address information' to 'fifth) of contents corresponding to the

objects

1321, 1322, 1323, 1324, and the like displayed on the captured image 1320. Memory address information ').

In addition, the first device 100 may generate a transmission file 1350 including the captured image 1320 and the content identification information 1330. In addition, the transmission file 1350 may further include a mapping table 1340. As illustrated in FIG. 14, the mapping table 1340 includes coordinate information 1410 and content identification information 1330 corresponding to the coordinate information 1410 and the coordinate information 1410 of a predetermined area including at least one object in the captured image 1320. ) May be included.

Referring to FIG. 15, in operation S1510, the first device 100 may receive voice data from a user. For example, the first device 100 may receive a voice command from the user for sharing specific content with the second device 200. For example, a chat application may provide a graphical user interface (GUI) that receives voice data from a user in a chat window. In response to a user input to the GUI, the first device 100 may activate a microphone unit (see 2270 of FIG. 22) included in the first device 100 and receive voice data through the microphone unit 2270. have.

In operation S1520, the first device 100 may obtain execution information of content to be shared with the second device 200 according to the received voice data. For example, the first device 100 may extract the identification value of the content from the voice data and obtain link information for downloading the content file or the content corresponding to the identification value of the content. In this case, the content may include, for example, text data, audio data, video data, and / or application execution data (eg, binary data) stored in the first device 100, and text data stored in an external server. , Audio data, video data and / or application execution data.

In addition, the first device 100 may display execution information of the content. For example, the first device 100 may display execution information of content in a chat window of a chat application. Accordingly, the user of the first device 100 may check whether the first device 100 properly acquires execution information of the content.

In operation S1530, the first device 100 may transmit execution information to the second device 200. For example, when the reception of voice data ends, the first device 100 may transmit execution information to the second device 200. Alternatively, when a user input for transmitting execution information to the second device 200 is received, the first device 100 may transmit the execution information to the second device 200.

In operation S1540, the second device 200 may display a GUI for executing content corresponding to the received execution information. For example, the second device 200 may display a GUI for executing content in a chat window of the chat application.

In operation S1550, when a user input for a GUI is received, the second device 200 may execute content using execution information. Meanwhile, the GUI may include a menu for storing or executing content in the second device 200 using execution information.

Referring to FIG. 16, when the first device 100 receives a user input 1620 for the GUI 1615 for receiving voice data for sharing content in the chat window 1610-1 of the chat application, the user Voice data may be received from 300. For example, the first device 100 may receive voice data “Share AAA file” from the user 300.

As the voice data is received, the first device 100 may obtain execution information of content (eg, 'AAA') included in the voice data. For example, the first device 100 may obtain a content file 1630 having 'AAA' as a file name.

The first device 100 may display the obtained content file 1630 in the chat window 1610-1 of the first device 100. In addition, the first device 100 may receive a user input 1640 for sharing the obtained execution information 1630 with the second device 200. Accordingly, the first device 100 may transmit a content file (ie, 'AAA.txt') 1630 to the second device 200.

The second device 200 displays a GUI 1650 in the chat window 1610-2 for storing or playing content using the content file 1630 received from the first device 100. Can provide.

Referring to FIG. 17, in operation S1710, the first device 100 may receive text data from a user. For example, the chat application may provide a GUI (eg, a keyboard GUI, etc.) that receives text data from the user in the chat window.

In operation S1720, the first device 100 may obtain execution information of content to be shared with the second device 200 according to the received text data. For example, the first device 100 may extract the content identification value included in the text data and obtain execution information for executing the content corresponding to the extracted content identification value. In this case, the text identification value may include a name of the content file, a content file storage location, a server name for downloading the content, a link address for downloading the content, and the like. In addition, the execution information may be, for example, a content file, identification information of the content file, link information for downloading the content, or the like.

In addition, the first device 100 may display the obtained execution information. For example, the first device 100 may display execution information obtained from the chat window of the chat application. Accordingly, the user of the first device 100 may check whether the first device 100 correctly obtains execution information.

In operation S1730, the first device 100 may transmit execution information to the second device 200. For example, the first device 100 may transmit execution information to the second device 200 when the reception of the text data is terminated (for example, an enter key or a transmission key input).

In operation S1740, the first device 100 may display a GUI for executing content corresponding to the received execution information. For example, the second device 200 may display a GUI for storing or executing content in a chat window of the chat application.

In operation S1750, when a user input for a GUI is received, the second device 200 may execute content using execution information.

Referring to FIG. 18, when text data is received through a user input to a keyboard GUI 1815 provided in a chat window 1810-1 of a chat application, the first device 100 identifies content included in the text data. Execution information for executing content corresponding to a value (ie, 'AAA') may be obtained. For example, the first device 100 may obtain a content file 1820 having 'AAA' as a file name.

The first device 100 may display the obtained content file 1820 in the chat window 1810-1 of the first device 100. In addition, the first device 100 may receive a user input 1830 for sharing the obtained content file 1820 with the second device 200. Accordingly, the first device 100 may transmit a content file (ie, 'AAA.txt') 1820 to the second device 200.

The second device 200 uses the content file 1820 received from the first device 100 to chat the GUI 1840 for storing or playing the content. Can be provided by

Referring to FIG. 19, in operation S1910, the first device 100 may receive video data from a user. For example, a chat application can provide a GUI to receive video data in a chat window. When the first device 100 receives a user input for the GUI, the first device 100 activates an image capturing unit (refer to 2275 of FIG. 22) provided on the front or rear surface of the first device 100, and receives a video through the image capturing unit 2275. Data can be obtained.

In operation S1920, the first device 100 may acquire execution information of content to be shared with the second device 200 according to the received video data. For example, the first device 100 may extract an identification value of the content included in the video data and obtain execution information for executing the content using the extracted content identification value. In this case, the content identification value may include an image, a gesture, an icon, a logo, a text image, and the like included in the video data. In addition, the execution information may be, for example, a content file for executing the content, identification information of the content file, link information for downloading the content, or the like.

In operation S1930, the first device 100 may transmit execution information of video data and content to the second device 200. In addition, the first device 100 may transmit to the second device 200 a mapping table including time information at which the identification value of the content is reproduced from the video data and coordinate information of the region at which the identification value of the content is displayed.

In operation S1940, the second device 200 may display a GUI for storing or executing content corresponding to the execution information of the received content. Referring to FIG. 20, while the second device 200 plays the video data 2010, the content included in the video data (ie, heart image data) using the execution information received from the first device 100. The GUI 2040 for executing 2030 may be displayed. In this case, the identification value of the content may be a heart hand gesture 2020.

In operation S1950, when a user input for a GUI is received, the second device 200 may execute content using execution information. Alternatively, the second device 200 may store content using execution information.

21 to 22 are diagrams for describing a device according to an embodiment. Hereinafter, a device according to the disclosed embodiments will be described with reference to FIGS. 21 through 22 along with FIGS. 21 through 22. Although not mentioned otherwise, the foregoing description and technical spirit are regarded to apply to the devices of FIGS. 21 to 22. Therefore, description overlapping with those in FIGS. 1 to 21 will be omitted.

Referring to FIG. 21, the first device 100 includes a first display unit 2110, a first control unit 2120, and a first communication unit 2130.

The first display unit 2110 may display information processed by the first device 100 on the screen. For example, the first device 100 may display an execution screen of an application executed in the foreground in the first device 100. The first device 100 may display a chat window of a chat application and display an execution screen of a photo album application.

The first controller 2120 may control the overall operation of the first device 100. For example, the first control unit 2120 may control the first display unit 2110 to display an execution screen of the application on the first display unit 2110.

In addition, the first controller 2120 may generate a captured image including the objects displayed on the first display unit 2110 in response to a user input of capturing the screen of the first device 100.

In addition, the first controller 2120 may obtain execution information for executing content corresponding to the objects displayed on the captured image. Here, the content may include text data, audio data, video data, and / or application execution data (eg, binary data) stored in the first device 100, and may include text data, audio data, stored in an external server, Video data and / or application execution data. In addition, the object representing the content may be an icon, text, and / or image representing the content. In addition, the execution information may be a content file of content corresponding to the object displayed in the captured image, identification information of the content file, or link information for downloading the content.

The first controller 2120 may analyze the captured image to identify objects included in the captured image. In addition, the first controller 2120 may determine whether the identified objects represent content. For example, when the object is text, the first controller 2120 may search for a content file having the same file name as the text. In this case, the first controller 2120 may search for a content file stored in the first device 100 or an external server. If the content file exists in the first device 100, the first controller 2120 may use the content file as execution information. When the content file exists in the external server, the first controller 2120 Link information in which a content file is stored in an external server may be used as execution information.

In addition, the first controller 2120 may generate coordinate information of an object or an image region corresponding to the execution information in the captured image. For example, when one object corresponds to one execution information, the first controller 2120 may generate coordinate information of an image region in which the object is displayed in the captured image. Alternatively, when the plurality of objects correspond to the same execution information, the first controller 2120 may generate coordinate information of an image area including the plurality of objects in the captured image.

In addition, in response to a user input for selecting some of the objects displayed on the captured image, the first controller 2120 may insert an indicator for highlighting and displaying the selected object in the captured image. For example, the first controller 2120 may display the selected object in a thick line or display the selected object in a specific color. In this case, the first controller 2120 may acquire only execution information for executing the selected object.

The first communication unit 2130 may include one or more components that allow the first device 100 to communicate with the second device 200 or other external devices. For example, the first communication unit 2130 may include at least one of a Wi-Fi chip (not shown), a Bluetooth chip (not shown), a wireless communication chip (not shown), and an NFC chip (not shown). The first control unit 2120 may transmit / receive data with the second device 200 or other external devices using the first communication unit 2130.

The first communication unit 2130 may transmit a transmission file including the captured image and the execution information to the second device 200 under the control of the first control unit 2120. For example, the first communication unit 2130 may transmit a transmission file having a multipurpose internet mail extension HTML (MHTML) or election markup language (EML) file format to the second device 200.

In addition, the first communication unit 2130 may, under the control of the first control unit 2120, generate a mapping table including coordinate information corresponding to the object displayed on the captured image and execution information corresponding to the coordinate information, from the second device 200. Can be sent to. For example, the first communication unit 2130 may transmit a transmission file including the captured image, execution information, and a mapping table to the second device 200 under the control of the first control unit 2120.

The second device 200 includes a second display unit 2140, a second control unit 2150, and a second communication unit 2160.

The second communication unit 2160 may include one or more components that allow the second device 200 to communicate with the first device 100 or other external devices. For example, the second communication unit 2160 may include at least one of a Wi-Fi chip (not shown), a Bluetooth chip (not shown), a wireless communication chip (not shown), and an NFC chip (not shown).

The second communication unit 2160 may receive a transmission file including information for executing a capture image transmitted by the first device 100 and content corresponding to objects displayed on the capture image. In addition, the second communication unit 2160 may receive a transmission file further including a mapping table in addition to the captured image and the executable file.

The second display unit 2140 may display information processed by the second device 200 on the screen. The second display unit 2140 may display the captured image received from the first device 100 through the second communication unit 2160. For example, the second display unit 2140 may display the captured image received in the chat window of the chat application. In this case, the captured image may be displayed by highlighting objects selected by the user of the first device 100.

The second controller 2150 may control the overall operation of the second device 200. The second controller 2150 may identify the object displayed on the captured image by analyzing the captured image. In addition, the second controller 2150 may identify an object corresponding to the area where the user input is received in response to the user input for the area where the identified object is displayed, and execute content using execution information corresponding to the object. have.

Alternatively, the second controller 2150 may execute content by using coordinate information of an area in which an object corresponding to a user input is displayed, coordinate information and execution information of a mapping table. For example, the second controller 2150 may identify coordinate information of the mapping table that matches the coordinate information of the region where the object corresponding to the user input is displayed, and identify execution information corresponding to the coordinate information. The second controller 2150 can execute the content by using the identified execution information. In addition, the second display unit 2140 may display an execution screen of the content.

Alternatively, the second controller 2150 may provide a GUI for storing content in the second device 200. When a user input for the GUI is received, the second controller 2150 may store content.

Meanwhile, in the above description, the operations of the first device 100 and the second device 200 of the content sharing system have been described, respectively, but the first device 100 and the second device 200 are the modules of the content sharing system described above. And the ability to perform the functions will be readily understood by those skilled in the art according to the disclosed embodiments. For example, the second controller 2150 of the second device 200 may generate a capture image and obtain execution information for executing content corresponding to the objects displayed on the captured image.

It is a figure explaining the detailed structure of a device.

Referring to FIG. 22, the device 2200 corresponding to the first device 100 or the second device 200 may include a memory 2230 and a sensor in addition to the control unit 2210, the display unit 2220, and the communication unit 2240. The unit 2235, an input unit 2250, a microphone unit 2270, an imaging unit 2275, and a speaker unit 2280 may be further included.

The controller 2210 may correspond to the first controller 2120 or the second controller 2150 of FIG. 21. In addition, the controller 2210 may include a display unit 2220, a communication unit 2240, a sensor unit 2235, an input unit 2250, a microphone unit 2270, an imaging unit 2275, and a speaker unit 2280 of the device 2200. ) Can be controlled overall.

The controller 2210 includes at least one of a random access memory (RAM) 2211, a read-only memory (ROM) 2212, a CPU 2213, a graphic processing unit (GPU) 2214, and a bus 2215. can do. The RAM 2211, the ROM 2212, the CPU 2213, the GPU 2214, and the like may be connected to each other through the bus 2215. However, the present invention is not limited thereto, and at least one of the RAM 2211, the ROM 2212, and the GPU 2214 may be located outside the controller 2210. In addition, the controller 2210 may be an Advanced RISC Machine (ARM) processor such as Qualcomm's Snapdragon (SNAPDRAMON ™).

The CPU 2213 accesses the memory 2230 and performs booting using an operating system stored in the memory 2230. In addition, various operations are performed using various programs, content, data, and the like stored in the memory 2230.

The ROM 2212 stores a command set for system booting. For example, when the turn-on command is input and the power is supplied, the device 2200 copies the operating system (OS) stored in the memory 2230 to the RAM 2211 according to a command stored in the ROM 2212. You can boot the system by running the OS. When the booting is completed, the CPU 2213 copies various programs stored in the memory 2230 to the RAM 2211 and executes the programs copied to the RAM 2211 to perform various operations. When booting of the device 2200 is completed, the GPU 2214 displays a UI screen on an area of the display unit 2220. In addition, the screen generated by the GPU 2214 may be provided to the display unit 2820 to be displayed on each area of the display unit 2820.

The display unit 2820 may correspond to the first display unit 2110 or the second display unit 2140 of FIG. 21. In addition, the display unit 2220 may include a display panel 2221 and a controller (not shown) for controlling the display panel 2221. The display panel 2221 is implemented with various types of displays such as a liquid crystal display (LCD), an organic light emitting diodes (OLED) display, an active-matrix organic light-emitting diode (AM-OLED), a plasma display panel (PDP), and the like. Can be. The display panel 2221 may be implemented to be flexible, transparent, or wearable. The display 1020 may be combined with the touch panel 2252 of the input unit 2250 and provided as a touch screen (not shown). For example, the touch screen (not shown) may include an integrated module in which the display panel 2221 and the touch panel 2252 are combined in a stacked structure. In addition, the touch screen may further include a pressure-sensitive sensor in a part of the integrated module in which the display panel 2221 and the touch panel 2252 are combined in a stacked structure.

The memory 2230 may include at least one of an internal memory (not shown) and an external memory (not shown).

The built-in memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), nonvolatile memory (for example, one time programmable ROM). ), PROM (Programmable ROM), EPROM (Erasable and Programmable ROM), EEPROM (Electrically Erasable and Programmable ROM), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD). It may include.

According to an embodiment, the controller 2210 may load a command or data received from at least one of the nonvolatile memory or another component into the volatile memory and process the same. In addition, the controller 2210 may store data received or generated from other components in the nonvolatile memory.

For example, the external memory may include at least one of Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), Mini Secure Digital (Mini-SD), Extreme Digital (xD), and a Memory Stick. It may include.

In addition, the memory 2230 may store a content file. For example, the memory 2230 may store various application execution data, audio data, video data, image data, and text data used for the operation of the device 2200.

The communication unit 2240 may correspond to the first communication unit 2130 or the second communication unit 2160 of FIG. 21. The communication unit 2240 may include at least one of a Wi-Fi chip 2241, a Bluetooth chip 2242, a wireless communication chip 2243, and an NFC chip 2244. The controller 2210 may exchange data with an external device using the communication unit 2240.

The Wi-Fi chip 2241 and the Bluetooth chip 2242 may perform communication using a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi chip 2241 or the Bluetooth chip 2242, various connection information such as SSID and session key may be transmitted and received first, and then various communication information may be transmitted and received using the same.

The wireless communication chip 2243 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evoloution (LTE), and the like. The NFC chip 2244 refers to a chip operating in a near field communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, 2.45 GHz, and the like.

The input unit 2250 may receive various commands from a user. The user input unit 2250 may include at least one of a key 2251, a touch panel 2252, and a pen recognition panel 2253.

The touch panel 2252 may detect a user's touch input and output a touch event value corresponding to the detected touch signal. According to an embodiment, the touch panel 2252 may receive a touch input including at least one of a user's tap, touch and hold, double tap, drag, pan, flick, and drag and drop. When the touch panel 2252 is combined with the display panel 2221 to form a touch screen (not shown), the touch screen may be implemented by various types of touch sensors such as capacitive, pressure sensitive, and piezoelectric.

The capacitive type is a method of calculating touch coordinates by detecting fine electricity generated by the human body of a user when a part of the user's body is touched by the touch screen surface by using a dielectric coated on the touch screen surface. The pressure-sensitive type includes two electrode plates embedded in the touch screen, and when the user touches the screen, the touch panel calculates touch coordinates by detecting that the upper and lower plates of the touched point are in contact with current. The touch event occurring in the touch screen may be mainly generated by a human finger, but may also be generated by an object of conductive material that can apply a change in capacitance.

The key 2251 may include various types of keys, such as mechanical buttons, wheels, and the like, formed in various areas such as a front portion, a side portion, and a rear portion of the main body exterior of the device 2200.

The pen recognition panel 2253 detects a proximity input or touch input of a pen according to the operation of a user's touch pen (eg, a stylus pen or a digitizer pen) and detects a detected pen proximity event or pen. A touch event can be output. The pen recognition panel 2253 may be implemented by, for example, an EMR method, and may detect a touch or a proximity input according to a change in the intensity of an electromagnetic field due to a proximity or a touch of a pen. In detail, the pen recognition panel 2253 includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processor (not shown) that sequentially provides an AC signal having a predetermined frequency to each loop coil of the electromagnetic induction coil sensor. It may be configured to include). If there is a pen incorporating a resonant circuit in the vicinity of the loop coil of the pen recognition panel 2253, the magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonant circuit in the pen. Based on this current, an induction magnetic field is generated from a coil constituting the resonant circuit in the pen, and the pen recognition panel 2253 detects the induction magnetic field in a loop coil in a signal receiving state so as to approach the pen's approach position or the like. The touch position can be detected. The pen recognition panel 2253 may be provided under the display panel 2221 to have a predetermined area, for example, an area that can cover the display area of the display panel 2221.

The microphone unit 2270 may receive a user voice or other sound and convert the audio into audio data. The controller 2210 may use a user's voice input through the microphone 2270 in a call operation or convert the user's voice into audio data and store it in the memory 2230.

The imaging unit 2275 may capture a still image or a moving image under the control of the user. The imaging unit 2275 may be implemented in plurality, such as a front camera and a rear camera.

When the imaging unit 2275 and the microphone unit 2270 are provided, the controller 2210 may perform a control operation according to a user voice input through the microphone unit 2270 or a user motion recognized by the imaging unit 2175. It may be. For example, the device 2200 may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the controller 2210 may activate the image capturing unit 2175 to capture a user, track a user's motion change, and perform a control operation corresponding thereto. When operating in the voice control mode, the controller 2210 may operate in a voice recognition mode that analyzes a user voice input through the microphone unit 2270 and performs a control operation according to the analyzed user voice.

The speaker unit 2280 may output audio data under the control of the controller 2210. According to some embodiments, when a user input for selecting an application in the application list is received through the input unit 2250, the speaker unit 2280 may output a notification sound distinguished by power consumption classes of the selected application.

In addition, although not shown in FIG. 22, the embodiment may include a USB port to which a USB connector may be connected in the device 2200, various external input ports for connecting to various external terminals such as a headset, a mouse, a LAN, and the like. A digital multimedia broadcasting (DMB) chip for receiving and processing signals and various sensors may be further included.

In addition, the device 2200 may further include a vibrator (not shown) for vibrating the device 2200. According to some embodiments, when a user input for selecting an application in the application list is received through the input unit 2250, the device 2200 may further include a vibration unit (not shown) that outputs vibrations distinguished by power consumption classes of the selected applications. It can be provided.

In addition, the names of the components of the device 2200 described above may vary according to embodiments.

Meanwhile, the above-described embodiments can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer which operates the program using a computer-readable recording medium.

In addition, when the processor of the computer needs to communicate with any other computer or server that is remote to perform the above-described functions, the processor of the computer may be configured to communicate with the computer's communication module (e.g. wired and / or wireless communication module). It may further include information about how it can communicate with any other computer or server in the remote, and what information or media should be transmitted and received during communication.

In addition, a functional program for implementing the disclosed embodiments, codes and code segments associated therewith, may be used in consideration of a system environment of a computer that executes a program by reading a recording medium. It may be easily inferred or changed by programmers.

Examples of recording media that can be read by a computer recording a program as described above include, for example, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical media storage device, and the like.

In addition, a computer-readable recording medium having recorded a program as described above may be distributed to computer systems connected through a network so that computer-readable codes may be stored and executed in a distributed manner. In this case, at least one of the plurality of distributed computers may execute some of the functions presented above, and transmit the result to at least one of the other distributed computers, and transmit the result. The receiving computer may also execute some of the functions presented above, and provide the results to other distributed computers as well.

In the above description, all elements constituting the disclosed embodiments are described as being combined or operating as one, but the scope of rights according to the present specification is not necessarily limited to these embodiments. That is, within the scope of the disclosed invention, all of the components may be selectively combined to operate at least one. In addition, although all of the components may be implemented in one independent hardware, each or some of the components of the program are selectively combined to perform some or all functions combined in one or a plurality of hardware. It may be implemented as a computer program having a. Codes and code segments constituting the computer program may be easily inferred by those skilled in the art to which the disclosed embodiments belong. Such a computer program may be stored in a computer readable storage medium and read and executed by a computer, thereby implementing embodiments of the present disclosure. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, and the like.

The above description is merely illustrative of the technical spirit of the present disclosure, and a person of ordinary skill in the art to which the disclosed embodiments belong may make various changes to the disclosed embodiments without departing from the essential characteristics of the invention. Modifications and variations will be possible. Therefore, the disclosed embodiments are not intended to limit the technical spirit described in the present specification but to describe the scope of the technical spirit of the invention by the disclosed embodiments. The protection scope of the invention according to the disclosed embodiments should be interpreted by the following claims, and all technical ideas within the equivalent scope should be construed as being included in the scope of the disclosed invention.

Claims

In the method of sharing content with a device,

Receiving a capture image capturing a screen of another device and execution information for executing content corresponding to the object displayed on the captured image from the other device;

Displaying the captured image; And

And executing the content corresponding to the object using the execution information in response to a user input of an area in which the object is displayed in the captured image.
The method of claim 1,

The other device is transmitting and receiving a message with the device using a chat application,

And the captured image is displayed in a chat window of the chat application.
The method of claim 1,

Executing the content,

Requesting content corresponding to the object from the other device using the execution information; And

Receiving the content from the other device.
The method of claim 1,

And receiving a mapping table including coordinate information of the object in the captured image and the execution information corresponding to the coordinate information.
The method of claim 4, wherein

Based on the received mapping table, identifying execution information corresponding to coordinate information of an area in which the object is displayed;

And the executing step is to execute the content using the identified execution information.
The method of claim 1,

And the execution information is at least one of a content file, identification information of the content file, and link information for downloading the content.
The method of claim 1,

The object is an object selected by a user of the other device, from among a plurality of objects in the captured image,

And the object is highlighted in the captured image.
In the method of sharing content with a device,

Generating a captured image in response to a user input of capturing a screen of the device; And

And transmitting execution information for executing the content corresponding to the captured image and the object displayed on the captured image to another device.
The method of claim 8,

Transmitting a mapping table including coordinate information of the object in the captured image and the execution information corresponding to the coordinate information to the other device.
The method of claim 8,

Receiving a user input for selecting the object among a plurality of objects in the captured image;

And the object is highlighted in the captured image.
A communication unit configured to receive a capture image capturing a screen of another device and execution information for executing content corresponding to an object displayed on the captured image from the other device;

A display unit which displays the captured image; And

And a controller configured to execute the content corresponding to the object using the execution information in response to a user input of an area in which the object is displayed in the captured image.
The method of claim 11,

The communication unit, in response to the user input, requests the content corresponding to the object to the other device using the execution information, and receives the content from the other device.
The method of claim 11,

The communication unit receives a mapping table including coordinate information of the object in the captured image and the execution information corresponding to the coordinate information.
The method of claim 11,

The object is an object selected by a user of the other device, from among a plurality of objects in the captured image,

Wherein the object is highlighted in the captured image.
A computer-readable recording medium having recorded thereon a program for implementing the method of claim 1.