WO2023085564A1

WO2023085564A1 - Electronic device and method for obtaining content of external electronic device by electronic device

Info

Publication number: WO2023085564A1
Application number: PCT/KR2022/012535
Authority: WO
Inventors: 문종채; 정경호; 이유미; 조형래; 한상진; 황상웅
Original assignee: 삼성전자 주식회사
Priority date: 2021-11-15
Filing date: 2022-08-22
Publication date: 2023-05-19

Abstract

An electronic device according to various embodiments comprises a communication module, a camera module, a display, and a processor. The processor may be configured to: detect an external electronic device while executing a camera application; capture a first image of the external electronic device received via the camera module, in response to the selection of an image capturing button; transmit a screenshot command, requesting to take a screenshot of content being output by the external electronic device, to the external electronic device via the communication module; and, if a second image corresponding to the screenshot of the content comprising first information relating to the content is received from the external electronic device via the communication module in response to the transmission of the screenshot command, link and store the first image corresponding to the external electronic device captured by the electronic device and the second image received from the external electronic device. Various other embodiments can be implemented.

Description

Electronic device and method for acquiring content of external electronic device in electronic device

Various embodiments relate to a method of acquiring content of an external electronic device in an electronic device.

In general, IP-TV (Internet Protocol-Television) service refers to a service that provides information service, video content, and broadcasting to a television set using high-speed Internet.

When a scene to be shared appears while watching the IP-TV or general TV, the portable terminal uses a camera module to capture an image corresponding to the scene being displayed on the TV, and transmits the captured image to the counterpart electronic device through a message. By transmitting to the device, the scene viewed on the TV can be shared with the other party.

When an image corresponding to a scene output from a TV is captured through a camera module of a portable terminal, the quality of the captured image may be lower than that of a screen provided by the TV.

In addition, since only the image taken by the portable terminal is transmitted to the other party's electronic device, the other party can view only the transmitted image and cannot additionally check the content related to the image.

According to various embodiments, an electronic device capable of obtaining a high-quality image of content being output from an external electronic device and providing various services related to the content based on content-related information included in the image provides an external A method of obtaining content of an electronic device may be provided.

The technical problem to be achieved in the present disclosure is not limited to the technical problem mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

An electronic device according to various embodiments includes a communication module, a camera module, a display, and a processor, wherein the processor detects an external electronic device while executing a camera application and, in response to selection of a photographing button, the Taking a first image corresponding to an external electronic device received through a camera module, and transmitting a screen capture command requesting a screen capture of content output from the external electronic device to the external electronic device through the communication module; , When a second image corresponding to the screen capture of the content including the first information related to the content is received from the external electronic device through the communication module in response to the transmission of the screen capture command, the electronic device The first image corresponding to the external electronic device captured by the user and the second image received from the external electronic device may be linked and stored.

According to various embodiments, a method of acquiring content of an external electronic device in an electronic device may include an operation of detecting the external electronic device while a camera application is being executed, and a camera module of the electronic device in response to selection of a photographing button. Taking a first image corresponding to an external electronic device received through a communication module of the electronic device, and transmitting a screen capture command requesting a screen capture of content output from the external electronic device to the external electronic device through a communication module of the electronic device. operation, and when a second image corresponding to the screen capture of the content including first information related to the content is received from the external electronic device through the communication module in response to the transmission of the screen capture command, the An operation of linking and storing a first image corresponding to the external electronic device captured by the electronic device and a second image received from the external electronic device may be included.

According to various embodiments, a high-quality image of content being output from an external electronic device may be acquired, and various services related to the content may be provided based on content-related information included in the image.

1 is a block diagram of an electronic device in a network environment according to various embodiments.

2 is a diagram for explaining an operation of acquiring content of an external electronic device in an electronic device according to various embodiments.

3 is a block diagram of an electronic device according to various embodiments.

4a, 4b, 4c, 4d, 4e, 4f, 4g, 4h, and 4i show content of an external electronic device obtained by an electronic device according to various embodiments, and providing related to the content. These are drawings for explaining possible service providing operations.

5a, 5b, 5c, 5d, 5e, and 5f illustrate an operation of acquiring content of an external electronic device and providing a service related to the content in an electronic device according to various embodiments of the present disclosure. drawings for

6A, 6B, 6C, and 6D are diagrams for explaining an operation of obtaining a content of an external electronic device in an electronic device and providing a service related to the content according to various embodiments of the present disclosure.

7a, 7b, 7c, 7d, 7e, and 7f illustrate an operation of obtaining a content of an external electronic device and providing a service related to the content in an electronic device according to various embodiments of the present disclosure. drawings for

8 is a diagram for explaining first information included in a second image corresponding to content of an external electronic device received by the electronic device according to various embodiments.

9 is a flowchart illustrating an operation of obtaining content of an external electronic device in an electronic device according to various embodiments of the present disclosure.

10 is a flowchart illustrating an operation of providing a service related to content of an external electronic device in an electronic device according to various embodiments of the present disclosure.

11 is a flowchart illustrating an operation of providing a service related to content of an external electronic device in an electronic device according to various embodiments of the present disclosure.

1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is a diagram 200 for explaining an operation of acquiring content of an external electronic device in an electronic device according to various embodiments.

Referring to FIG. 2 , when an electronic device 201 (eg, the electronic device 101 of FIG. 1 ) according to various embodiments detects an external electronic device 210 while executing a camera application, In response to the selection, the first image corresponding to the external electronic device 210 photographed by the electronic device 201 and the content being output from the external electronic device 210 received from the external electronic device 210 A second image obtained by capturing a screen may be linked and stored, and first information related to content output from the external electronic device 210 may be stored in the second image.

According to an embodiment, while the camera application is being executed, the electronic device 201 detects an external electronic device based on an image received through a camera module of the electronic device 201, or the electronic device 201 ), an external electronic device connected to the electronic device 201 among a plurality of external electronic devices registered in the premises may be detected, or an external electronic device may be detected through a UWB communication module.

According to an embodiment, the electronic device 201 may store a first image corresponding to the external electronic device 210 captured by the electronic device 201 in response to selection of the photographing button. .

According to an embodiment, the electronic device 201, in response to selection of the photographing button, displays a screen requesting a screen capture of content output from the external electronic device 201 to the external electronic device 210. A capture command may be transmitted (operation 251), and a second image may be received and stored from the external electronic device in response to the transmission of the screen capture command (operation 253).

According to an embodiment, the electronic device 201 includes a first image corresponding to the external electronic device 210 captured by the electronic device 201 and a second image received from the external electronic device 210. can link

According to an embodiment, the electronic device 201 checks at least one piece of service information based on the first information in response to selection of the second image while displaying the second image, and At least one service menu corresponding to the identified at least one service information may be provided based on the first information.

According to an embodiment, when the electronic device 201 identifies an image received through a transmission application as a second image including first information related to content, the electronic device 201 transmits information to the first information based on the first information. At least one included service information may be checked, and at least one service menu corresponding to the checked at least one service information may be provided based on the first information.

According to various embodiments, when the external electronic device 210 receives a screen capture command for requesting a screen capture of content output from the external electronic device 201 from the electronic device 201, the external electronic device 210 outputs a screen capture command. A second image obtained by capturing the screen of the content to be captured may be obtained, and first information related to the content may be included in the second image and transmitted to the electronic device 201 .

According to one embodiment, the external electronic device 210 executes an application for a screen capture function, and uses the application for the screen capture function to capture a screen corresponding to the screen of content output from the external electronic device 210. A second image may be captured.

According to an embodiment, the first information related to the content may be meta information including screen capture information about the content and at least one service information that may be provided related to the content.

According to an embodiment, the screen capture information for the content includes date and time information of the screen capture, channel information (eg, channel name, service provider, and/or channel number) through which the content is output, and information for displaying the content. Information on the type of external electronic device and/or application type, the type of content, the playback time and/or playback timing of the content, and the number of services that can be provided related to the content may be included. Various service information may be added to the screen capture information for the content according to the type of content output from the external electronic device 210 .

According to an embodiment, at least one piece of service information that can be provided related to content includes first service information for executing a transmission application to share content with an electronic device, and second information for outputting content to an external electronic device. It may include at least one of service information and third service information for executing a corresponding application to acquire additional information about content.

According to an embodiment, the external electronic device 210 determines at least one piece of service information that can be provided in relation to the content based on screen capture information for the content, and sets the first information to the first information. Screen capture information about the content and at least one service information that can be provided in relation to the content may be included and stored.

3 is a block diagram 300 of an electronic device according to various embodiments.

Referring to FIG. 3 , according to various embodiments, an electronic device 301 (eg, the electronic device 101 of FIG. 1 and/or the electronic device 201 of FIG. 2 ) may include a processor 320 (eg, the electronic device 101 of FIG. : processor 120 of FIG. 1), memory 330 (eg memory 130 of FIG. 1), display 360 (eg display module 160 of FIG. 1), camera module 380 and communication module 390 (eg, communication module 290 of FIG. 1).

According to various embodiments, when the processor 320 detects an external electronic device (eg, the external electronic device 210 of FIG. 2 ) while executing a camera application, the electronic device 201 A first image corresponding to the external electronic device captured in ) and a second image acquired by capturing the screen of the content being displayed on the external electronic device received from the external electronic device may be linked, received, and stored.

According to an embodiment, the processor 320, in a first shooting mode for executing a camera application and capturing an image received through the camera module 380, sends an image received through the camera module 380 to the processor 320. When an external electronic device is detected in the image through image processing for the external electronic device, the external electronic device enters the second shooting mode capable of receiving an image (eg, a second image) captured from the screen of the content being output by the external electronic device. can switch The processor 320, in the first photographing mode, detects an external electronic device based on an image received through the camera module 380 and registers it in the memory 330, at least one external electronic device (eg: TV, beam projector, or smart monitor), and when communication with the external electronic device is established, the second shooting mode may be switched. The processor 320 transmits a connection request signal requesting a connection to the external electronic device through the communication module 390 in the first shooting mode, and connects in response to the connection request signal from the external electronic device. When a response signal is received and communication with the external electronic device is established, the second photographing mode may be switched.

According to an embodiment, the processor 320 executes a camera application, and in a first shooting mode for capturing an image received through the camera module 380, at least one image of a home registered to the electronic device 301 is captured. When an external electronic device connected to the electronic device 301 is detected among one external electronic device (eg, a TV, a beam projector, or a smart monitor), an image capturing the screen of the content being output from the external electronic device It is possible to switch to the second photographing mode capable of receiving .

According to an embodiment, the processor 320 executes a camera application and in a first shooting mode for capturing an image received through the camera module 380, through a UWB communication module among the communication modules 390. A second shooting mode capable of receiving an image obtained by capturing a screen of content being output by the external electronic device from the external electronic device when an external electronic device performing ultra wide band (UWB) communication is detected based on the transmitted/received signal can be converted to The processor 320 selects at least one external electronic device (eg, TV, beam projector, or smart monitor) registered in the memory 330 among at least one external electronic device found through the UWB communication module in the first shooting mode. ) is detected, and when communication with the external electronic device is established, the second photographing mode may be switched.

According to an embodiment, the processor 320 captures images displayed on the display 360 in a second shooting mode capable of receiving an image obtained by capturing a screen of content being output by the external electronic device from an external electronic device. To display notification information notifying that an image (eg, a second image) obtained by capturing a screen of content output from an external electronic device can be received from an external electronic device through an input of the photographing button at a location close to the button. can

According to an embodiment, the processor 320, in response to selection of a shooting button in the second shooting mode capable of receiving an image obtained by capturing a screen of content being output by the external electronic device, from an external electronic device. , A screen for capturing a first image corresponding to the external electronic device received through the camera module 380 and requesting screen capture of content output from the external electronic device through the communication module 390 to the external electronic device. Capture commands can be sent.

According to an embodiment, the processor 330 captures the first image corresponding to the external electronic device received through the camera module 380 in response to selection of the photographing button in the second photographing mode, and stores the image in memory. It can be stored in the first storage unit 331 of (330).

According to an embodiment, the processor 330 transmits a screen capture command to an external electronic device in response to selection of the capture button in the second capture mode, and transmits the screen capture command to the external electronic device in response to transmission of the screen capture command. When a second image corresponding to a screen capture of the content including first information related to the content output from the external electronic device is received from the electronic device, the second image including the first information is stored in the memory 330 It can be stored in the second storage unit 331 of.

According to an embodiment, the processor 330 converts the first image stored in the first storage unit 331 of the memory 330 and the second image stored in the second storage unit 333 of the memory 330 to each other. In order to manage related image information, the first image and the second image may be linked.

According to various embodiments, the processor 320 may provide at least one service related to the second image in response to selection of the second image stored in the memory 330 .

According to an embodiment, the processor 330 captures a screen of content from an external electronic device while displaying the first image stored in the first storage unit 331 of the memory 330 on the display 360. When it is determined to display the second image on the display 360 in response to selection for viewing of the two images, the display 360 displays the second image stored in the second storage unit 333 of the memory 330. An image, screen capture information of content corresponding to the second image, and/or at least one service menu that may be provided in relation to the content may be displayed. The processor 320 checks screen capture information of the content based on the first information included in the image, and selects at least one service menu corresponding to at least one service information that can be provided in relation to the content. can be checked.

According to an embodiment, the processor 320 selects one second image while displaying at least one second image stored in the second storage unit 330 of the memory 330 on the display 360. In response to, if it is determined to display the second image on the display 360, the selected second image, screen capture information of the content corresponding to the selected second image, and/or the content and At least one service menu that can be related and provided may be displayed. According to an embodiment, when the display of the second image is determined on the display 360, the processor 320 parses the first information included in the second image to provide content and information corresponding to the second image. At least one piece of service information that can be provided in relation to the service information may be checked, and at least one service menu corresponding to the checked service information may be displayed on the display 360 together with the second image. The processor 320, in response to selection of one service menu from among the at least one service menu displayed on the display 360, transmits parameter information for executing a function corresponding to the selected service menu to the selected service. It can be transmitted to an executable application or a separate component to perform a function corresponding to the selected service menu.

According to an embodiment, at least one piece of service information that can be provided in relation to the content included in the first information includes first service information for executing a transmission application to share content with an external electronic device, to an external electronic device. It may include at least one of second service information for outputting content and third service information for executing a corresponding application to acquire additional information about the content. For example, when the processor 320 identifies at least one service information that may be provided related to the content included in the first information as first service information for sharing content with an external electronic device, the transmission application The first service menu through which the second image including the first information can be transmitted to the first electronic device can be displayed on the display 360 together with the second image.

For example, in the processor 320, the second image is an image obtained by capturing the screen of online class content output from a TV, and screen capture information for the content of the first information included in the second image, A first service that stores URLs of program information and lecture materials and executes a message application to share online class content with an external electronic device, with at least one service information that can be provided in relation to the content of the first information It can be confirmed that third service information for executing an Internet application is stored in order to download additional lecture materials related to information and online class content. The processor 320 displays a first service menu corresponding to the first service information for executing the message application together with the second image on the display 360, and the third service information for executing the Internet application. A third service menu corresponding to may be displayed. When the selection of the first service menu is confirmed, the processor 320 executes a message application and attaches a second image including the first information (eg, a second image capturing the screen of online class content). A message may be transmitted to the first electronic device selected by the user. When the selection of the third service menu is confirmed, the processor 320 may execute an Internet application to search for additional lecture materials for online class content corresponding to the second image and provide them to the user.

For example, in the processor 320, the second image is an image obtained by capturing a screen of travel program content output from a TV, and screen capture information for the content of the first information included in the second image, Program information, travel place name, travel date and related travel URL are stored, and at least one service information that can be provided in relation to the content of the first information is message application for sharing travel program content with an external electronic device. , third service information for executing a map application to display a travel destination in travel program contents, and third service information for executing an Internet application to visit a travel product sales site related to the travel program contents. You can check that the . The processor 320 displays a first service menu corresponding to the first service information for executing the message application together with the second image on the display 360, and a third service menu corresponding to the third service information for executing the map application. A 3-1 service menu and a 3-2 service menu corresponding to the third service information for executing the Internet application may be displayed. When the selection of the first service menu is confirmed, the processor 320 executes a message application and attaches a second image including the first information (eg, a second image obtained by capturing a screen of travel program content). A message may be transmitted to the first electronic device selected by the user. When the selection of the 3-1 service menu is confirmed, the processor 320 may execute a map application to display and provide the route to the travel destination of the travel program content corresponding to the second image to the user. When the selection of the 3-2 service menu is confirmed, the processor 320 may execute an Internet application and provide a travel product sales site related to the travel program content corresponding to the second image to the user.

For example, in the processor 320, the second image is an image obtained by capturing a screen of entertainment program content output from a TV, and screen capture information for the content of the first information included in the second image, First service information that stores program information and a related community URL, and executes a message application to share entertainment program content with an external electronic device as at least one service information that can be provided in relation to the content of the first information Third service information for running a calendar application to set information on the next episode of entertainment program content, related entertainment program information and notification information, and third service information for running an Internet application to visit community SNS and participate in events related to travel program content 3 You can confirm that the service information is being saved. The processor 320 displays a first service menu corresponding to the first service information for executing the message application together with the second image on the display 360, and a third service menu corresponding to the third service information for executing the calendar application. A 3-1 service menu and a 3-2 service menu corresponding to the third service information for executing the Internet application may be displayed. When the selection of the first service menu is confirmed, the processor 320 executes a message application and attaches a second image including the first information (eg, a second image obtained by capturing a screen of entertainment program content). A message may be transmitted to the first electronic device selected by the user. When the processor 320 confirms the selection of the 3-1 service menu, the user executes a calendar application to set next episode information of the entertainment program content corresponding to the second image, related entertainment program information, and notification. can be provided to When the selection of the 3-2 service menu is confirmed, the processor 320 executes an Internet application to provide the user with a site for visiting a community SNS and participating in an event related to entertainment program content corresponding to the second image. can do.

For example, the processor 320 is configured such that the second image is an image obtained by capturing a screen of game content output from a TV, and screen capture information for the content of the first information included in the second image is HDMI. To store connection information (eg, type of console) and game mode information set in the TV, and to share game content with an external electronic device as at least one service information that can be provided in relation to the content of the first information It can be confirmed that the first service information for executing a message application and the third service information for executing an Internet application for visiting a console community related to game contents and writing posts are stored. The processor 320 displays a first service menu corresponding to the first service information for executing the message application together with the second image on the display 360, and the third service information for executing the Internet application. A third service menu corresponding to may be displayed. When the selection of the first service menu is confirmed, the processor 320 executes a message application and attaches a second image including the first information (eg, a second image obtained by capturing a screen of game content). The message may be transmitted to the first electronic device selected by the user. When the selection of the third service menu is confirmed, the processor 320 executes an Internet application to provide the user with a site for visiting the console community and writing posts related to the game content corresponding to the second image. .

According to an embodiment, the processor 320, when the first information included in the second image includes at least one service information that can be provided related to the content, the content of the first information At least one piece of service information that can be provided in relation to the content may be generated and added to the first information based on the screen capture information for .

According to an embodiment, the processor 320, if the first information included in the second image does not include at least one piece of service information that can be provided related to the content, the content of the first information At least one piece of service information that can be provided in relation to content may be generated and stored in the first information based on the screen capture information for .

According to various embodiments, the processor 220 generates a second image based on first information included in the second image received through the transmission application from the first electronic device (eg, the electronic device 102 of FIG. 1 ). At least one service related to may be provided.

According to an embodiment, when the processor 220 confirms that the second image received through the transmission application (eg, message application) includes first information related to the content, based on the first information At least one service information included in the first information may be checked, and at least one service menu corresponding to the checked at least one service information may be displayed on the display 360 together with the second image. The processor 320, in response to selection of one service menu from among the at least one service menu displayed on the display 360, transmits parameter information for executing a function corresponding to the selected service menu to the selected service. It can be transmitted to an executable application or a separate component to perform a function corresponding to the selected service menu.

For example, when the processor 320 identifies at least one piece of service information that can be provided related to the content included in the first information as second service information that can output content to an external electronic device, A second service menu capable of outputting content corresponding to the second image may be displayed on an external electronic device. The processor 320, in response to selection of the second service menu, detects an external electronic device capable of outputting the content from among a plurality of external electronic devices registered to the electronic device, or performs short-range communication. Communication with the external electronic device may be established by detecting an external electronic device capable of outputting the content among at least one external electronic device detected based on the . The processor 320 controls the detected external electronic device (eg, TV) based on screen capture information (eg, channel information) for the content of the first information, so that the external electronic device controls the second electronic device. Content corresponding to the image (eg, TV program content) may be output.

According to various embodiments, the memory 330 may be implemented substantially the same as or similar to the display module 130 of FIG. 1 .

According to one embodiment, the memory 330 may include a first storage unit 331 and a second storage unit 333 . The first storage unit 331 may store the first image received through the camera module 280 of the electronic device 301, and the second storage unit 333 may store the first image received from the external electronic device. A second image including information may be stored.

According to various embodiments, the display 360 may be implemented substantially the same as or similar to the display module 160 of FIG. 1 .

According to an embodiment, the display 360 displays a second image received from an external electronic device (eg, the external electronic device 210 of FIG. 2 ), screen capture information about content corresponding to the second image, or And/or display at least one service menu corresponding to at least one service information that can be provided related to the content.

According to various embodiments, the camera module 380 may be implemented substantially the same as or similar to the camera module 180 of FIG. 1 .

According to an embodiment, the camera module 380 may receive an image corresponding to an external electronic device that outputs content based on the execution of a camera application.

According to various embodiments, the communication module 390 may be implemented substantially the same as or similar to the communication module 190 of FIG. 1, and may include a plurality of communication modules using different communication technologies. Communication circuitry may be included.

According to an embodiment, the communication module 390 may include a plurality of communication circuits, and may include at least one of a wireless LAN module (not shown) and a short-range communication module (not shown), and the short-range The communication module (not shown) may include a UWB communication module, a Wi-Fi communication module, a near field communication (NFC) communication module, a Bluetooth legacy communication module, and/or a bluetooth low energy (BLE) communication module.

4a, 4b, 4c, 4d, 4e, 4f, 4g, 4h, and 4i show content of an external electronic device obtained by an electronic device according to various embodiments, and providing related to the content. These are drawings 400a to 400i for explaining possible service operations.

Referring to FIG. 4A, the electronic device 401 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) is configured according to the user's selection. In a first shooting mode in which a camera application is executed according to the method and an image received through the camera module (eg, the camera module 380 of FIG. 3 ) of the electronic device 401 is captured, the image received through the camera module If the TV 410 is detected based on , a connection request signal for establishing short-range communication may be transmitted to the TV 410 through a communication module (eg, the communication module 390 of FIG. 3 ).

When the TV 410 (eg, the external electronic device 210 of FIG. 2 ) receives a connection request signal for establishing short-range communication from the electronic device 401, the information of the electronic device included in the connection request signal is sent to the TV 410. Based on this, the electronic device may be authenticated as a connectable device, and a connection response signal may be transmitted to the electronic device 401 .

The electronic device 401 may establish short-range communication with the TV 410 based on the connection response signal received from the TV 410 .

Referring to FIG. 4B, when short-range communication is established with the TV 401 in the first shooting mode, a second shooting capable of receiving an image obtained by capturing a screen of content output from an external electronic device from an external electronic device. mode can be switched. In the second shooting mode, the electronic device 401 takes the photo at a position close to the shooting button 411 displayed on the display 426 (eg, the display 360 of FIG. 3 ) of the electronic device 401. Notification information 413 (eg, screen capture of TV content) notifying that a second image obtained by capturing a screen of content output from the external electronic device can be received from the external electronic device through an input of a button can be displayed. there is.

Referring to FIG. 4C , when the electronic device 401 confirms the selection of the photographing button 411 in the second photographing mode, the electronic device 401 responds to the selection of the photographing button 411. The first image 451 corresponding to the TV 410 received through the camera module of the electronic device 401 and displayed on the display 426 of the electronic device 401 is captured and stored in the memory of the electronic device 401 (eg, diagram). It can be stored in the first storage unit (eg, the first storage unit 331 of FIG. 3) of the memory 330 of 3. The electronic device 401 may transmit a screen capture command requesting a screen capture of content output from the external electronic device to the TV 410 in response to selection of the capture button 411 .

When the TV 410 receives the screen capture command from the electronic device 401 while waiting for reception of a screen capture command after establishing communication with the electronic device 401, the TV 410 A second image 471 obtained by capturing the screen of the travel program content being output on the display 436 may be obtained. The TV 410 generates first information 473 related to the travel program content being output to the display 436 of the TV 410, and the second image including the first information 473. 471 may be transmitted to the electronic device 401 .

The electronic device 401 stores the second image 471 including the first information 473 received from the TV 410 in a memory of the electronic device 401 (eg, the memory of FIG. 3 ( 330) may be stored in the second storage unit (eg, the second storage unit 333 of FIG. 3). The electronic device 401 includes a first image 451 stored in the first storage unit of the memory of the electronic device 401 and a second image 451 stored in the second storage unit of the memory of the electronic device 401. Image 471 can be linked.

Referring to FIG. 4D , the electronic device 401 includes a plurality of first images 451 stored in the first storage unit of the memory of the electronic device 401 based on a user's selection. 1 images may be displayed on the display 426 of the electronic device 401 .

Referring to FIG. 4E , the electronic device 401 displays the second image 471 stored in the second storage unit of the memory of the electronic device 401 based on the user's selection. (426).

Referring to FIG. 4F , the electronic device 401 displays a plurality of first images stored in the first storage unit of the memory of the electronic device 401 on the display 426 of the electronic device 401. If selection of the first image 451 is confirmed during display, the first image 451 is displayed on the display 426, and the first image 451 is stored in the second storage unit of the memory. If it is confirmed that the image is linked, an option menu 453 capable of displaying a second image may be displayed in a certain area of the display 426 displaying the first image 451 . When the electronic device 401 confirms the selection 453a of the option menu 453 capable of displaying the second image, as shown in FIG. 4G, the second image linked to the first image 451 ( 471) may be displayed on the display 426.

Referring to FIG. 4G , the electronic device 401 displays a second image 471 on the display 426 of the electronic device 401 and screen capture information of content corresponding to the second image 471 ( 475), and as a service menu 477 that can be provided in relation to the content, a first service menu 477a for image transmission and a third service menu 477b for viewing image-related products can be displayed. . The electronic device 401 provides, based on the first information 473 included in the second image 471, screen capture information 475 of the content and a service menu 477 that may be provided in relation to the content. A first service menu 477a for image transmission and a third service menu 477b for viewing image-related products can be checked.

When the selection of the first service menu 477a is confirmed, the electronic device 401 executes a message application and displays a second image including the first information (eg, a second image captured from a screen of travel program content). ) may be transmitted to the first electronic device 409 selected by the user.

When the selection of the third service menu 477b is confirmed, the electronic device 401 executes an Internet application to provide a travel product sales site related to the travel program content corresponding to the second image 471 to the user. can

Referring to FIG. 4H , the first electronic device 409 that has received the message from the electronic device 401 converts the image included in the received message into a second image 471 including first information 473. ), it is possible to parse the first information 473 and check at least one service menu corresponding to at least one service information included in the first information 473 . The electronic device 401 may display the second image 471 included in the message and the second service menu 491 for direct TV viewing on the display 429 of the first electronic device 409. .

When the first electronic device 409 confirms the selection 491a of the second service menu 491, the screen capture information of the content included in the first information (eg, channel information on which the content is output (eg : channel name, service provider, and/or channel number), type of external electronic device capable of outputting content and/or type of application, type of content, playback time and/or playback time of the content), based on A TV 419 capable of outputting content corresponding to the second image may be searched for.

Referring to FIG. 4I, the first electronic device 409 performs short-distance communication with the TV 419 if there is a TV 419 among a plurality of external electronic devices registered to the first electronic device. is established, and the second information is sent to the TV 419 based on the screen capture information of the content included in the first information (eg, channel information (eg, channel name, service provider, and/or channel number) on which the content is output). A command for requesting a change of a channel number capable of outputting content corresponding to an image may be transmitted, and the TV 419 may be controlled to output content corresponding to the second image. 409), when the power of the TV 419 is turned off, together with a power-on command, a command requesting a change of a channel number capable of outputting content corresponding to the second image may be transmitted to the TV 419. The first electronic device 409 is a TV 419 capable of searching for nearby external electronic devices using short-range communication and outputting content corresponding to the second image from among the searched external electronic devices. can be searched for.

4H to 4I, the first electronic device 409 is an electronic device 401 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device of FIG. 3). 301)), the same operation can be performed. Also, the electronic device 401 may perform the same operation as the first electronic device 409 receiving the message in FIGS. 4H to 4I.

5a, 5b, 5c, 5d, 5e, and 5f illustrate an operation of acquiring content of an external electronic device and providing a service related to the content in an electronic device according to various embodiments of the present disclosure. These are drawings 500a to 500f for.

Referring to FIG. 5A, while the TV 510 (eg, the external electronic device 210 of FIG. 2) outputs the home shopping program content through the display 536, the external electronic device via the remote control 530 A screen capture command requesting a screen capture of output content may be received.

Referring to 5b above, when the TV 510 receives a screen capture command from the remote control 530, the second image 571 that captures the screen of the home shopping program content output through the display 536 is displayed. can be obtained The TV 510 generates first information 573 related to the home shopping program content being output to the display 536 of the TV 510, and the second information 573 including the first information 573. The image 571 may be transmitted to the server 580 and stored. The server 580 transmits the second image 571 including the received first information 573 to an electronic device 501 (eg, the electronic device 101 of FIG. 1 or the electronic device 201 of FIG. 2 ). ) and/or the electronic device 301 of FIG. 3), or the electronic device 501 accesses the server 580 and transmits the second image 571 including the first information 573. After downloading, the first storage unit (eg, the first storage unit 331 of FIG. 3 ) of the memory (eg, the memory 330 of FIG. 3 ) of the electronic device 501 or the second storage unit (eg, the memory 330 of FIG. 3 ) of the memory It can be stored in the second storage unit of FIG. 3).

Referring to FIG. 5C , the electronic device 501 stores a plurality of images including a second image 571 stored in the first storage unit of the memory of the electronic device 501 based on a user's selection. It can be displayed on the display 526 of the electronic device 501.

Referring to FIG. 5D , the electronic device 501 displays a plurality of images stored in the first storage unit of the memory of the electronic device 501 on the display 526 of the electronic device 451. If the selection of the second image 571 is confirmed during the operation, the second image 571 and the screen capture information 573 of the content corresponding to the second image 571 are displayed on the display 526 of the electronic device 501. , and as a service menu 577 that can be provided in relation to the content, a first service menu 577a for image transmission and a third service menu 577b for image-related product viewing can be displayed. The electronic device 501 checks the screen capture information 573 of the content based on the first information 573 included in the second image 571, and provides a service related to the content. As the menu 577, a first service menu 577a for image transmission and a third service menu 577b for viewing image-related products can be checked.

When the selection of the first service menu 577a is confirmed, the electronic device 501 executes a message application and displays a second image 571 including the first information 573 (eg, the content of the home shopping program). A message to which the second image of the screen is attached) may be transmitted to the first electronic device 509 selected by the user.

When the selection of the third service menu 577b is confirmed, the electronic device 501 executes an Internet application and provides detailed information related to a product introduced in the home program content corresponding to the second image 571 to the user. can provide

Referring to FIGS. 5E to 5F, the first electronic device 509 that has received a message from the electronic device 501 as shown in FIG. 5E converts an image included in the received message into first information 573 ), the first information 573 is parsed and at least one service menu corresponding to at least one service information included in the first information 573 is identified. can The electronic device 501 may display the second image 571 included in the message and the third service menu 591 for detailed viewing via the Internet on the display 529 of the first electronic device 509. .

As shown in FIG. 5F, when the first electronic device 409 confirms the selection 591a of the third service menu 591, the screen capture information of the content of the first information (eg, content is output Based on channel information (eg, channel name, service provider, and/or channel number), type of content, playback time and/or playback time of the content, an Internet application is executed to display a home corresponding to the second image 571. Detailed information 575 related to a product introduced in the program content may be provided to the user.

5E to 5F, the first electronic device 509 is an electronic device 501 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device of FIG. 3). 301)), the same operation can be performed. Also, the electronic device 501 may perform the same operation as the first electronic device 509 receiving the message in FIGS. 5E to 5F.

6A, 6B, 6C, and 6D are views (600a to 600a to 6d) for explaining an operation of obtaining a content of an external electronic device and providing a service that can be provided in relation to the content in an electronic device according to various embodiments; 600 d).

Referring to FIG. 6A, the electronic device 601 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) is configured according to the user's selection. In a first shooting mode in which a camera application is executed according to the method and an image received through the camera module (eg, the camera module 380 of FIG. 3 ) of the electronic device 601 is captured, the image received through the camera module Upon detecting the beam projector 610 and the beam projector screen 626 based on , a connection request signal for establishing short-range communication with the beam projector 610 through a communication module (eg, the communication module 390 of FIG. 3 ). can transmit.

When the beam projector 610 (eg, the external electronic device 210 of FIG. 2 ) receives a connection request signal for establishing short-range communication from the electronic device 601, the information of the electronic device included in the connection request signal Based on this, the electronic device may be authenticated as a connectable device, and a connection response signal may be transmitted to the electronic device 601 .

The electronic device 601 may establish short-range communication with the beam projector 610 based on the connection response signal received from the beam projector 610 .

Referring to FIG. 6B, when the beam projector 601 and the beam projector screen 626 are detected in the first shooting mode and short-range communication is established with the beam projector 601, external electrons from an external electronic device are detected. It is possible to switch to a second shooting mode capable of receiving an image obtained by capturing a screen of content output from the device. The electronic device 601, in the second shooting mode, takes the photo at a position close to the shooting button 611 displayed on the display 626 (eg, the display 360 of FIG. 3) of the electronic device 601. Notification information 613 (eg, screen capture of beam projector content) notifying that a second image obtained by capturing the screen of content output from the external electronic device can be received from the external electronic device through a button input is displayed. can

When the electronic device 601 confirms the selection of the photographing button 611 in the second photographing mode, reception is received through the camera module of the electronic device 601 as a response to the selection of the photographing button 611. The first image 651 corresponding to the beam projector 610 and the beam projector screen 626 displayed on the display 626 of the electronic device 601 is captured and stored in the memory of the electronic device 601 (eg: It may be stored in the first storage unit of the memory 330 of FIG. 3 (eg, the first storage unit of FIG. 3 (eg, the second storage unit 331 of FIG. 3). The electronic device 601 may In response to selection of the photographing button 611, a screen capture command requesting a screen capture of content output from an external electronic device may be transmitted to the beam projector 610.

When the beam projector 610 receives the screen capture command from the electronic device 601 while waiting for reception of the screen capture command after establishing communication with the electronic device 601, the beam projector screen ( In step 626, a second image 671 obtained by capturing a screen of movie content being output may be obtained. The beam projector 610 generates first information related to movie content being output to the beam projector screen 636, and converts the second image 671 including the first information to the electronic device 601. ) can be transmitted.

The electronic device 601 stores the second image 671 including the first information received from the beam projector 610 in a memory of the electronic device 601 (eg, the memory 330 of FIG. 3 ). ) may be stored in the second storage unit (eg, the second storage unit 333 of FIG. 3). The electronic device 601 includes the first image 651 stored in the first storage unit of the memory of the electronic device 601 and the second image 651 stored in the second storage unit of the memory of the electronic device 601 ( 671) can be linked.

Referring to FIG. 6C , the electronic device 601 stores the first image 651 stored in the first storage unit of the memory of the electronic device 601 and the memory of the electronic device 601. The second image 671 stored in the second storage unit may be compared.

Based on the comparison result between the first image 651 and the second image 671, the electronic device 601 transmits guide information capable of guiding the position of the beam projector 610 to the electronic device 601. It can be displayed on the display 626.

Referring to FIG. 6D , the electronic device 601 displays a “beam” on the display 626 of the electronic device 601 based on the comparison result between the first image 651 and the second image 671. Guide information 660 such as "Please raise the height of the projector" may be displayed. The electronic device 601 transmits horizontal correction or/and focus correction information to the beam projector 610 based on the comparison result between the first image 651 and the second image 671, and the beam The projector 610 may be controlled to automatically apply correction information.

7a, 7b, 7c, 7d, 7e, and 7f illustrate an operation of obtaining a content of an external electronic device and providing a service related to the content in an electronic device according to various embodiments of the present disclosure. These are drawings 700a to 700f for

Referring to FIG. 7A, the electronic device 701 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2, and/or the electronic device 301 of FIG. 3) is configured according to the user's selection. In a first shooting mode in which a camera application is executed according to the method and an image received through the camera module (eg, the camera module 380 of FIG. 3 ) of the electronic device 701 is captured, the image received through the camera module If the smart monitor 710 is detected based on , a connection request signal for establishing short-range communication may be transmitted to the smart monitor 710 through a communication module (eg, the communication module 390 of FIG. 3 ).

When the smart monitor 710 (eg, the external electronic device 210 of FIG. 2 ) receives a connection request signal for establishing short-range communication from the electronic device 701, the information of the electronic device included in the connection request signal Based on , the electronic device may be authenticated as a connectable device, and a connection response signal may be transmitted to the electronic device 701 .

The electronic device 701 may establish short-range communication with the smart monitor 710 based on the connection response signal received from the smart monitor 710 .

Referring to FIG. 7B, when short-range communication is established with the smart monitor 701 in the first shooting mode, a second electronic device capable of receiving an image obtained by capturing a screen of content output from the external electronic device is received from the external electronic device. You can switch to shooting mode. In the second shooting mode, the electronic device 701 inputs the shooting button at a position close to the shooting button 711 displayed on the display 726 (eg, the display 360 of FIG. 3 ) of the electronic device. It is possible to display notification information 713 (eg, screen capture of smart monitor content) notifying that a second image obtained by capturing a screen of content output from the external electronic device can be received from the external electronic device through .

Referring to FIG. 7C , when the electronic device 701 confirms the selection of the photographing button 711 in the second photographing mode, the electronic device 701 responds to the selection of the photographing button 711. A memory of the electronic device 401 (eg: It may be stored in the first storage unit (eg, the first storage unit 331 of FIG. 3 ) of the memory 330 of FIG. 3 . The electronic device 701 may transmit a screen capture command requesting a screen capture of content output from an external electronic device to the smart monitor 710 in response to selection of the capture button 711 .

When the smart monitor 710 receives the screen capture command from the electronic device 701 while waiting for reception of a screen capture command after establishing communication with the electronic device 701, the smart monitor 710 A second image 771 obtained by capturing the screen of the remote conference content being output to the display 736 of ) may be acquired. The smart monitor 710 generates first information 773 related to the remote conference content being output to the display 736 of the smart monitor 710, and the first information 773 includes the first information 773. 2 images 771 may be transmitted to the electronic device 701 .

The electronic device 701 stores the second image 771 including the first information 773 received from the smart monitor 710 in a memory of the electronic device 701 (eg, the memory of FIG. 3 ). 330) of the second storage unit (eg, the second storage unit 333 of FIG. 3). The electronic device 701 stores the first image 751 stored in the first storage unit of the memory of the electronic device 701 and the second storage unit 333 of the memory of the electronic device 401. The second image 471 stored in may be linked.

Referring to FIG. 7D , the electronic device 701 displays the second image 771 stored in the second storage unit of the memory of the electronic device based on the user's selection. (726).

Referring to FIG. 7E , when the selection of the second image 771 is confirmed in FIG. 7D , the electronic device 701 displays a second image 771 on the display 726 of the electronic device 701. , screen capture information 775 of the content corresponding to the second image 771, and a third service menu 777 for downloading data as a service menu 477 that can be provided in relation to the content can be displayed. The electronic device 701 checks the screen capture information 775 of the content based on the first information 773 included in the second image 771, and provides a service menu related to the content. As 477, a third service menu 777 for data download can be checked.

When the selection of the third service menu 777 is confirmed, the electronic device 701 can execute the Internet application and download data registered by the conference organizer of the remote conference content corresponding to the second image 471. there is.

Referring to FIG. 7F , as the electronic device 701 displays the downloaded data 771 on the display 726 of the electronic device 701, the user of the electronic device 701 While viewing the material data 771 displayed on the display 726 of the electronic device 701, a remote conference can be held through the smart monitor 701.

8 is a diagram 800 for explaining first information included in a second image corresponding to content of an external electronic device received by the electronic device according to various embodiments.

Referring to FIG. 8, the second image corresponding to the screen capture of the content output from the external electronic device (e.g., the external electronic device 210 of FIG. 2) received from the external electronic device includes first information related to the content. 830. The first information 830 may include screen capture information 831 for content and at least one service information 833 that may be provided related to the content.

The screen capture information 831 for the content includes date and time information of the screen capture, channel information (eg, channel name, service provider, and/or channel number) through which the content is output, and an external electronic device capable of outputting the content. and/or type of application, type of content, playback time and/or playback time of content, and information on the number of services that can be provided in relation to the content.

The at least one service information 833 includes a first service for transmitting a second image to a first electronic device through a transmission application for content sharing, a second service for outputting content to an external electronic device, or information about content. In order to obtain additional information, at least one of third services for executing a corresponding application may be included.

Each service information may include a target device, a service type, the total number of service parameters (n), and at least one parameter (1 싋n).

Also, the first information 830 including the aforementioned information may be included in the second image file in the form of metadata of the second image. For example, the first information may be recorded in at least one of the metadata fields according to the metadata format of the second image. In addition to metadata, the first information may be included in the second image file according to a preset format of the second image file.

Also, according to another embodiment, the first information 830 may be stored separately from the file of the second image. For example, the external electronic device may acquire files of the first information and the second image, respectively, and the external electronic device may transmit the files of the first information and the second image to the first electronic device. In this case, the first information and the second image file may be simultaneously included in the same message or signal and transmitted, or the first information and the second image file may be separated and included in different messages or signals and transmitted.

According to various embodiments, an electronic device (eg, the electronic device 301 of FIG. 3 ) includes a communication module (eg, the communication module 390 of FIG. 3 ) and a camera module (eg, the camera module 380 of FIG. 3 ). ), a display (eg, the display 3660 of FIG. 3 ), and a processor (eg, the processor 320 of FIG. 3 ), wherein the processor detects an external electronic device while executing a camera application and takes pictures. In response to the selection of the button, a first image corresponding to the external electronic device received through the camera module is captured, and a screen capture of the content output from the external electronic device is captured by the external electronic device through the communication module. transmits a screen capture command requesting a screen capture command, and in response to the transmission of the screen capture command, a first message corresponding to screen capture of the content including first information related to the content from the external electronic device through the communication module When two images are received, a first image corresponding to the external electronic device photographed by the electronic device and a second image received from the external electronic device may be linked and stored.

According to various embodiments, when the processor detects an external electronic device based on an image received through the camera module, the processor transmits a connection request signal requesting a connection to the external electronic device through the communication module; When a connection response signal is received from the external electronic device that has authenticated the electronic device as a connectable electronic device, communication with the external electronic device may be established through the communication module.

According to various embodiments of the present disclosure, when the external electronic device is detected, the processor captures the content output from the external electronic device through an input of the photographing button at a position close to the photographing button displayed on the display. It may be set to display notification information notifying that the second image obtained by capturing the screen can be received.

According to various embodiments, the first information related to the content may include screen capture information about the content and at least one service information that may be provided related to the content.

According to various embodiments, the at least one service information may include first service information for executing a transmission application to share content with an external electronic device, second service information for outputting content to an external electronic device, or content It may include at least one of third service information for executing a corresponding application in order to obtain additional information about the service.

According to various embodiments, a memory (eg, the memory 330 of FIG. 3 ) is further included, and the processor stores the first image in a first storage unit of the memory and stores the first image from the external electronic device. When two images are received, it is set to store the second image in the second storage unit of the memory, and to link the first image stored in the first storage unit and the second image stored in the second storage unit. can

According to various embodiments of the present disclosure, while displaying the first image stored in the first storage unit of the memory through the display, in response to a selection for viewing the second image, the processor displays the image of the memory through the display. It can be set to display the second image stored in the second storage unit, screen capture information for content corresponding to the second image, and at least one service menu that can be provided in relation to the content.

According to various embodiments, the processor checks at least one service information based on the first information included in the second image, and displays at least one service menu corresponding to the checked at least one service information. can be set to

According to various embodiments of the present disclosure, when the processor identifies the at least one service information as first service information for content sharing with an external electronic device, the processor displays the second image including the first information through a transmission application. may be set to display a first service menu capable of transmitting to the first electronic device.

According to various embodiments, when a second image including first information related to content is received through a transmission application, at least one service information included in the first information is checked, and the checked at least one service information When is confirmed as second service information capable of outputting content to an external electronic device, a second service menu capable of outputting content corresponding to the second image is displayed on the external electronic device, and In response to the selection, an external electronic device may be detected, and content corresponding to the second image may be output from the external electronic device by controlling the detected external electronic device.

9 is a flowchart 900 illustrating an operation of acquiring content of an external electronic device in an electronic device according to various embodiments. Operations for obtaining the content of the external electronic device may include operations 911 to 929. According to an embodiment, at least one of operations 911 to 929 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 911, the electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) executes a camera application and first Shooting mode can be executed.

According to an embodiment, when the camera application is executed based on a user's selection, the electronic device 901 is configured to capture an image received through a camera module (eg, the camera module 380 of FIG. 3 ). A first shooting mode may be executed.

In operation 913, the electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) sends the external electronic device 910 ( Example: When the external electronic device 210 of FIG. 2 is detected, the second shooting mode may be switched.

According to an embodiment, in the first shooting mode, the electronic device 901 detects an external electronic device from the image through image processing on the image received through the camera module 380, and When communication with the electronic device is established, the external electronic device may switch to a second shooting mode capable of receiving an image (eg, a second image) obtained by capturing a screen of content being output by the external electronic device. The electronic device 901 includes at least one external electronic device detected based on the image received through the camera module in the first shooting mode registered in a memory (eg, the memory 330 of FIG. 3 ). When included in an electronic device (eg, a TV, beam projector, or smart monitor), a connection request signal requesting a connection to the external electronic device 910 is transmitted through a communication module (eg, the communication module 390 of FIG. 3). can transmit When the electronic device 901 receives a connection response signal in response to the connection request signal from the external electronic device 910, communication is established with the external electronic device 910 and the electronic device 901 switches to the second shooting mode. can do.

According to an embodiment, the electronic device 901, in the first shooting mode, among at least one external electronic device (eg, TV, beam projector, or smart monitor) registered to the electronic device 901 in the premises When the external electronic device 910 connected to the electronic device 901 is detected, it is possible to switch to a second shooting mode capable of receiving an image obtained by capturing a screen of content being output on the external electronic device from the external electronic device.

According to an embodiment, the electronic device 901 performs ultra wide band (UWB) communication based on a signal transmitted and received through the UWB communication module of the communication module 390 in the first shooting mode. When the device is detected, communication is established with the external electronic device 910 and the external electronic device 910 enters the second shooting mode capable of receiving a screen capture image of the content being output by the external electronic device 910. can switch In the electronic device 901, at least the external electronic device 910 retrieved through the UWB communication module in the first shooting mode is registered in the memory of the electronic device 901 (eg, the memory 330 of FIG. 3). When included in one external electronic device (eg, a TV, beam projector, or smart monitor), the second shooting mode may be switched.

In operation 915, the electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) presses the shooting button in the second shooting mode. If the input of is confirmed, in operation 916, a first image corresponding to the external electronic device 910 received through the camera module (eg, the camera module 380 of FIG. 3) is captured, and in operation 919, the communication module A screen capture command requesting a screen capture of content output from the external electronic device may be transmitted to the external electronic device 910 through (eg, the communication module 390 of FIG. 3 ).

According to an embodiment, the electronic device 901 captures a first image in operation 916 and the external electronic device 910 in operation 919 in response to an input of a photographing button in the second photographing mode. ), an operation of transmitting a screen capture command may be performed, and operation 919 may be performed after operation 916 or operation 916 may be performed after operation 919 is performed.

In operation 917, the electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) stores the first image in the memory 330 ) can be stored in the first storage unit 331.

According to an embodiment, the electronic device 901 receives the external electronic device through a camera module (eg, the camera module 380 of FIG. 3 ) in response to selection of a photographing button in the second photographing mode. A first image corresponding to 910 may be captured and stored in a first storage unit (eg, first storage unit 331 of FIG. 3 ) of a memory (eg, memory 330 of FIG. 3 ).

In operation 921, the external electronic device 910 (eg, the external electronic device 210 of FIG. 2) may obtain a second image obtained by capturing the screen of content output from the external electronic device.

According to an embodiment, when the external electronic device 910 receives a screen capture command requesting a screen capture of the content output from the external electronic device 901, the external electronic device 910 ), a second image obtained by capturing the screen of the content output from the screen may be acquired.

According to one embodiment, the external electronic device 910 executes an application for a screen capture function, and uses the application for the screen capture function to capture a screen corresponding to a screen of content output from the external electronic device 910. A second image may be captured.

In operation 923, the external electronic device 910 (eg, the external electronic device 210 of FIG. 2) may include first information in the second image.

According to an embodiment, the external electronic device 910 may generate first information related to the content in the second image and insert the first information into the second image.

According to an embodiment, the screen capture information for the content includes date and time information of the screen capture, channel information (eg, channel name, service provider, and/or channel number) through which the content is output, and information for displaying the content. Information on the type of external electronic device and/or application type, the type of content, the playback time and/or playback timing of the content, and the number of services that can be provided related to the content may be included.

In operation 925, the external electronic device 910 (eg, the external electronic device 210 of FIG. 2) may transmit a second image including the first information to the electronic device 901.

In operation 927, the electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) stores the second image in the memory 330 ) may be stored in the second storage unit (eg, the second storage unit 333 of FIG. 3).

According to an embodiment, the electronic device 901, in response to the transmission of the screen capture command, displays the content including first information related to the content output from the external electronic device 901. When a second image corresponding to the screen capture of is received, the second image including the first information may be stored in the second storage unit of the memory.

In operation 929, the electronic device 901 (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) displays a first image and a second image. can link

According to an embodiment, the electronic device 901 includes a first image stored in a first storage unit (eg, the first storage unit 331) of a memory (eg, the memory 330 of FIG. 3) and a memory ( Example: To manage a second image stored in a second storage unit (eg, the second storage unit 333 of FIG. 3) of the memory 330 of FIG. 3 as image information associated with the first image and the second storage unit 333 of FIG. A second image can be linked.

10 is a flowchart 1000 for explaining a service providing operation related to content of an external electronic device in an electronic device according to various embodiments. Service providing operations related to the contents of the external electronic device may include operations 1001 to 1007. According to an embodiment, at least one of operations 1001 to 1007 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 1001, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) captures the screen of the content of the external electronic device. You can confirm the selection for display of the second image.

According to an embodiment, the electronic device may include a first storage unit (eg, the first storage unit of FIG. 3 ) of a memory (eg, the memory 330 of FIG. 3 ) on a display (eg, the display 360 of FIG. 3 ). While displaying the first image stored in the unit 331), if a selection for viewing a second image obtained by capturing a screen of content in an external electronic device is confirmed, selection for displaying the second image may be confirmed. .

According to an embodiment, the electronic device, at least one stored in the second storage unit (eg, the second storage unit 330 of FIG. 3) of the memory on the display (eg, the display 360 of FIG. 3). If selection of one second image is confirmed while displaying the second image, selection for display of the second image may be confirmed.

In operation 1003, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) displays a second image, content screen capture information, And/or at least one service menu that can be provided in relation to content may be displayed.

According to an embodiment, the electronic device provides the second image and screen capture information of the content corresponding to the second image and/or related to the content to a display (eg, the display 360 of FIG. 3). At least one possible service menu may be displayed. The electronic device may check screen capture information of content based on the second image and first information included in the second image, and check at least one service menu that may be provided in relation to the content. .

According to an embodiment, the electronic device parses the first information included in the second image to obtain at least one piece of service information that can be provided in relation to the content corresponding to the second image included in the first information. may be checked, and at least one service menu corresponding to the checked service information may be displayed on the display together with the second image.

In operation 1005, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) selects a first service menu from among at least one service menu. selection can be checked.

In operation 1007, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) executes the transmission application to include the first information. may transmit the second image to the first electronic device.

According to an embodiment, the electronic device sends a transmission application (eg, a message application) in response to selection of a first service menu from among at least one service menu displayed on a display (eg, the display 360 of FIG. 3 ). is executed, and a message to which a second message including the first information is attached may be transmitted to the first electronic device selected by the user (eg, 409 of FIG. 4H ).

11 is a flowchart 1100 for explaining a service providing operation related to content of an external electronic device in an electronic device according to various embodiments. Service providing operations related to the contents of the external electronic device may include operations 1101 to 1111. According to an embodiment, at least one of operations 1101 to 1111 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 1101, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) may receive an image through a transmission application. .

According to an embodiment, the electronic device may receive a message to which an image is attached through a message application.

In operation 1103, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) converts the image into a second image containing the first information. You can check it with images.

In operation 1105, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) sends second information included in the second image. can be parsed.

According to an embodiment, when the electronic device confirms that the second image received through a transmission application (eg, a message application) includes first information related to content, the electronic device sends the first information based on the first information. At least one service information included in information 1 may be checked, and at least one service menu corresponding to the checked at least one service information may be checked.

In operation 1107, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) displays the second image, content screen capture information, And/or at least one service menu that can be provided in relation to content may be displayed.

According to an embodiment, the electronic device provides the second image and screen capture information of the content corresponding to the second image and/or related to the content to a display (eg, the display 360 of FIG. 3). At least one possible service menu may be displayed. The electronic device may check screen capture information of the content based on the first information included in the second image, and check at least one service menu that may be provided in relation to the content.

In operation 1109, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) selects a second service menu among at least one service menu. selection can be checked.

In operation 1111, the electronic device (eg, the electronic device 101 of FIG. 1 , the electronic device 201 of FIG. 2 , and/or the electronic device 301 of FIG. 3 ) displays content corresponding to the second image in the external device. can be controlled to output.

According to an embodiment, the electronic device searches for a nearby external electronic device capable of outputting content corresponding to the second image, based on the selection of the second service menu, and sends the content to the searched external electronic device. The external electronic device may be controlled to output content corresponding to the second image.

According to various embodiments of the present disclosure, a method of obtaining content of an external electronic device of an electronic device may include an operation of detecting the external electronic device while a camera application is being executed, and a camera module of the electronic device in response to a selection of a photographing button. Taking a first image corresponding to an external electronic device received through a communication module of the electronic device, and transmitting a screen capture command requesting a screen capture of content output from the external electronic device to the external electronic device through a communication module of the electronic device. operation, and when a second image corresponding to the screen capture of the content including first information related to the content is received from the external electronic device through the communication module in response to the transmission of the screen capture command, the An operation of linking and storing a first image corresponding to the external electronic device captured by the electronic device and a second image received from the external electronic device may be included.

According to various embodiments, when an external electronic device is detected based on an image received through the camera module, transmitting a connection request signal requesting a connection to the external electronic device through the communication module, and the electronic device The method may further include an operation of establishing communication with the external electronic device through the communication module when a connection response signal is received from the external electronic device that has authenticated as a connectable electronic device.

According to various embodiments, when the external electronic device is detected, a screen of content output from the external electronic device is captured through an input of the photographing button at a position close to the photographing button displayed on the display. 2 may further include an operation of displaying notification information notifying that images can be received.

According to various embodiments of the present disclosure, storing the first image in a first storage unit of a memory of the electronic device, and receiving the second image from the external electronic device, storing the second image in a second storage unit of the memory. The method may further include an operation of storing an image and an operation of linking the first image stored in the first storage unit and the second image stored in the second storage unit.

According to various embodiments, while displaying the first image stored in the first storage unit of the memory of the electronic device through the display of the electronic device, in response to selection of the view of the second image through the display The operation of displaying the second image stored in the second storage unit of the memory, screen capture information for content corresponding to the second image, and at least one service menu that can be provided in relation to the content is further included. can do.

According to various embodiments, an operation of checking at least one service information based on the first information included in the second image, and an operation of displaying at least one service menu corresponding to the checked at least one service information may further include.

According to various embodiments, when the checked at least one service information is identified as first service information for content sharing with an external electronic device, the second image including the first information is transmitted through a transmission application to the first electronic device. An operation of displaying a first service menu that can be transmitted to the device may be further included.

According to various embodiments, upon receiving a second image including first information related to content through a transmission application, checking at least one service information included in the first information, and checking the at least one service If the information is confirmed as second service information capable of outputting content to an external electronic device, displaying a second service menu capable of outputting content corresponding to the second image to the external electronic device, and The method may further include detecting an external electronic device in response to selection of the service menu and outputting content corresponding to the second image from the external electronic device by controlling the detected external electronic device.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101 or electronic device 501). ) may be implemented as software (eg, program 140) including one or more instructions stored in . For example, a processor (eg, the processor 520) of a device (eg, the electronic device 501) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium readable by a device such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

Claims

In electronic devices,

Communication module:

camera module;

display; and

It includes a processor, the processor comprising:

Detect external electronic devices while running the camera application,

In response to selection of the photographing button, a first image corresponding to the external electronic device received through the camera module is captured, and a screen for content output from the external electronic device is transmitted to the external electronic device through the communication module. Send a screen capture command requesting capture,

In response to the transmission of the screen capture command, when a second image corresponding to the screen capture of the content including the first information related to the content is received from the external electronic device through the communication module, the electronic device An electronic device configured to link and store a first image corresponding to the captured external electronic device and a second image received from the external electronic device.
The method of claim 1, wherein the processor,

When an external electronic device is detected based on the image received through the camera module, a connection request signal requesting a connection is transmitted to the external electronic device through the communication module;

The electronic device configured to establish communication with the external electronic device through the communication module when receiving a connection response signal from the external electronic device that has authenticated the electronic device as a connectable electronic device.
The method of claim 1, wherein the processor,

When the external electronic device is detected, a second image obtained by capturing the screen of content output from the external electronic device is received from the external electronic device through an input of the photographing button at a position close to the photographing button displayed on the display. An electronic device set to display notification information indicating that it may be
According to claim 1,

The electronic device, wherein the first information related to the content includes screen capture information about the content and at least one service information that can be provided related to the content.
The method of claim 4, wherein the at least one service information,

First service information for executing a transmission application to share content with an external electronic device, second service information for outputting content to an external electronic device, or provision for executing a corresponding application to acquire additional information about content An electronic device including at least one of 3 service information.
According to claim 1,

contain more memory;

the processor,

storing the first image in a first storage unit of the memory;

When receiving the second image from the external electronic device, storing the second image in a second storage unit of the memory;

An electronic device set to link the first image stored in the first storage unit and the second image stored in the second storage unit.
The method of claim 1, wherein the processor,

In response to a selection for viewing of the second image while displaying the first image stored in the first storage unit of memory via the display, the second image stored in the second storage unit of memory via the display , Screen capture information on content corresponding to the second image, and at least one service menu that may be provided in relation to the content is set to be displayed on the electronic device.
The method of claim 7, wherein the processor,

Checking at least one piece of service information based on first information included in the second image;

An electronic device configured to display at least one service menu corresponding to the at least one checked service information.
The method of claim 7, wherein the processor,

If the at least one checked service information is identified as first service information for content sharing with an external electronic device, the second image including the first information can be transmitted to the first electronic device through a transmission application. 1 Electronic device set to display the service menu.
According to claim 1,

When receiving a second image including first information related to content through a transmission application, checking at least one service information included in the first information;

If the at least one checked service information is identified as second service information capable of outputting content to an external electronic device, a second service menu capable of outputting content corresponding to the second image is displayed on the external electronic device. do,

An electronic device configured to detect an external electronic device in response to selection of the second service menu, and output content corresponding to the second image from the external electronic device by controlling the detected external electronic device.
A method for acquiring content of an external electronic device in an electronic device,

detecting an external electronic device while running a camera application;

In response to selection of the photographing button, a first image corresponding to the external electronic device received through the camera module of the electronic device is captured, and the external electronic device is transferred to the external electronic device through the communication module of the electronic device. Transmitting a screen capture command requesting a screen capture of output content; and

In response to the transmission of the screen capture command, when a second image corresponding to the screen capture of the content including the first information related to the content is received from the external electronic device through the communication module, the electronic device and linking and storing a first image corresponding to the captured external electronic device and a second image received from the external electronic device.
According to claim 11,

transmitting a connection request signal requesting a connection to the external electronic device through the communication module when the external electronic device is detected based on the image received through the camera module; and

and establishing communication with the external electronic device through the communication module when receiving a connection response signal from the external electronic device that has authenticated the electronic device as a connectable electronic device.
According to claim 11,

When the external electronic device is detected, a second image obtained by capturing a screen of content output from the external electronic device may be received from the external electronic device through an input of the photographing button at a position close to the photographing button displayed on the display. A method further comprising an operation of displaying notification information notifying that there is presence.
According to claim 11,

The first information related to the content includes screen capture information about the content and at least one service information that can be provided related to the content.
The method of claim 14, wherein the at least one service information,

First service information for executing a transmission application to share content with an external electronic device, second service information for outputting content to an external electronic device, or provision for executing a corresponding application to acquire additional information about content 3 service information;