KR20230041935A - Electronic device for controlling displaying of screen to be shared based on user authentication and method thereof - Google Patents

Abstract

According to one embodiment, an electronic device comprises: a display; a communication circuitry; a memory configured to store a plurality of instructions; and a processor operably coupled with the display, the communication circuitry, and the memory, wherein the processor may access a first external electronic device distinct from the electronic device along a network connected by the communication circuit when executing the plurality of instructions, display a second screen distinct from a first screen on the display while providing the first screen related to an application running on the electronic device, receive a first input for switching from the second screen to the first screen while displaying the second screen, be provided by a second external electronic device distinct from the first external electronic device in the network in response to receiving the first input, identify whether the first external electronic device has been accessed using the location of the first external electronic device in the network, switch from the second screen to the first screen in response to receiving the first input in a first state accessing the first external electronic device using the location, distinguish the first screen from the second screen in response to receiving the first input in a second state distinct from the first state, and switch to a third screen requesting a second input distinct from the first input. According to one embodiment, the electronic device may control the display of content shared with another electronic device based on user authentication.

Description

Electronic device and method for controlling the display of a screen to be shared based on user authentication

The descriptions below relate to an electronic device and method for controlling display of a screen to be shared based on user authentication.

With the development of digital technology, communication while having mobility such as a mobile communication terminal, PDA (personal digital assistant), electronic notebook, smartphone, tablet PC (personal computer), or wearable device and/or electronic devices capable of performing information processing are becoming widespread. These electronic devices provide not only services such as voice calls and text messages, but also various services such as taking pictures, finding directions, and providing web interfaces.

Meanwhile, as the degree of access to content such as photos and videos increases due to the development of communication technology, various technologies for sharing such content are being developed.

As content shared between electronic devices is displayed on all of the electronic devices, a method for protecting the content from being leaked may be required.

The technical problem to be achieved in this document is not limited to the above-mentioned technical problem, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. .

An electronic device according to an embodiment includes a display, communication circuitry, a memory configured to store a plurality of instructions, and a processor operatively coupled with the display, communication circuitry, and memory. and the processor, when executing the plurality of instructions, accesses a first external electronic device that is distinguished from the electronic device along a network connected by the communication circuit to obtain a first external electronic device associated with an application executed in the electronic device. While providing a screen, displaying a second screen distinct from the first screen on the display, and receiving a first input for switching from the second screen to the first screen while displaying the second screen and, in response to receiving the first input, provided from a second external electronic device that is distinct from the first external electronic device within the network, and the position of the first external electronic device within the network In a first state in which the first external electronic device is accessed using the location, and in a first state in which the first external electronic device is accessed using the location, in response to receiving the first input, the second external electronic device is identified. In response to switching from a screen to the first screen, and receiving the first input in a second state distinct from the first state, from the second screen, distinct from the first screen, the first state It is possible to switch to a third screen requesting a second input distinct from the first input.

An electronic device according to one embodiment includes a display, communication circuitry, a memory configured to store a plurality of instructions, and a processor operatively coupled with the display, the communication circuitry, and the memory, the processor comprising: , When executing the plurality of instructions, while displaying a first screen based on one or more applications running in the electronic device to another electronic device through the communication circuit, the first screen on the display Displays a second screen distinct from the second screen, receives a first input for switching to the first screen in a state of displaying the second screen, and receives the other electronic device through a first network in the first part of the display. In response to receiving the first input while displaying a first visual object indicating communication with a device, switching from the second screen to the first screen, and in the first portion, the first network and the Distinguished from the first screen from the second screen in response to receiving the first input in a state of displaying a second visual object indicating communication with the other electronic device through a distinct second network; It is possible to switch to a third screen requesting a second input distinct from the first input.

A method of an electronic device according to an embodiment includes accessing a first external electronic device distinguished from the electronic device along a network connected by a communication circuit of the electronic device, and displaying a first screen related to an application executed in the electronic device. While providing, an operation of displaying a second screen distinct from the first screen on the display of the electronic device, a first step for switching from the second screen to the first screen while displaying the second screen. 1 operation of receiving an input, in response to receiving the first input, provided from a second external electronic device that is different from the first external electronic device within the network, and the first external electronic device and the network Identifying whether or not the first external electronic device is accessed using a location within the home, responding to receiving the first input in a first state in which the first external electronic device is accessed using the location and switching from the second screen to the first screen, and in response to receiving the first input in a second state distinct from the first state, from the second screen to the first screen and switching to a third screen requesting a second input distinct from the first input.

A method of an electronic device according to an embodiment includes, while displaying a first screen based on one or more applications running in the electronic device to another electronic device through a communication circuit of the electronic device, Displaying a second screen distinct from the first screen on the display of the electronic device, receiving a first input for switching to the first screen while the second screen is displayed, the display Switching from the second screen to the first screen in response to receiving the first input while displaying a first visual object indicating communication with the other electronic device through a first network on a first part of In response to receiving the first input in a state of displaying a second visual object indicating communication with the other electronic device through a second network distinct from the first network, An operation of switching from the second screen to a third screen that requests a second input that is distinct from the first screen and that is different from the first input.

An electronic device according to an embodiment may control display of content shared with other electronic devices based on user authentication.

Effects obtainable in the present disclosure are not limited to the above effects, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.
2A and 2B are exemplary diagrams for explaining different states of connection between electronic devices according to an embodiment.
3 is a block diagram of electronic devices according to an exemplary embodiment.
4 is a diagram for describing programs executed in each of electronic devices according to an exemplary embodiment.
5 is a state transition diagram related to states related to a mirroring function of electronic devices according to an embodiment.
6A to 6B are diagrams illustrating an example of a user interface (UI) displayed on each electronic device according to an embodiment.
7A to 7B are diagrams for explaining one or more other screens displayed in a state in which an electronic device transmits a screen to an external electronic device according to an exemplary embodiment.
8 is a flowchart illustrating an operation performed in a state in which an electronic device transmits a screen to an external electronic device according to an exemplary embodiment.
9 is a flowchart illustrating an operation performed based on a network type between the electronic device and the first external electronic device in a state in which the electronic device transmits a screen to the first external electronic device according to an embodiment.
10 is a flowchart illustrating an operation performed by an electronic device in a state of receiving a screen of an external electronic device according to an exemplary embodiment.

Hereinafter, various embodiments of this document will be described with reference to the accompanying drawings.

Various embodiments of this document and terms used therein are not intended to limit the technology described in this document to a specific embodiment, and should be understood to include various modifications, equivalents, and/or substitutes of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like elements. Singular expressions may include plural expressions unless the context clearly dictates otherwise. In this document, expressions such as "A or B", "at least one of A and/or B", "A, B or C" or "at least one of A, B and/or C" refer to all of the items listed together. Possible combinations may be included. Expressions such as "first", "second", "first" or "second" may modify the elements in any order or importance, and are used only to distinguish one element from another. The components are not limited. When a (e.g., first) element is referred to as being "(functionally or communicatively) coupled to" or "connected to" another (e.g., second) element, that element refers to the other (e.g., second) element. It may be directly connected to the component or connected through another component (eg, a third component).

The term "module" used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integral part or a minimum unit or part thereof that performs one or more functions. For example, the module may be composed of an application-specific integrated circuit (ASIC).

1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphics processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, a software structure in addition to a hardware structure.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more specified protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or movement) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : A local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), terminal power minimization and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeably interchangeable with terms such as, for example, logic, logical blocks, components, or circuits. can be used as A module may be an integral part or the smallest unit of a part or part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120) of a device (eg, the electronic device 101) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used when data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium readable by a device such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component among the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

2A to 2B are exemplary diagrams for explaining different states 200 and 205 of a connection 220 between electronic devices 101 and 210 according to an embodiment. Referring to FIGS. 2A and 2B , different states 200 and 205 in which electronic devices 101 and 210 are connected along a network 250 based on a wired network and/or a wireless network are shown. The electronic devices 101 and 210 according to an embodiment may perform a screen sharing operation while connected to each other through the network 250 . Hardware components included in each of the electronic devices 101 and 210 will be described with reference to FIG. 3 . The wired network may relate to the Internet, a local area network (LAN), a wide area network (WAN), Ethernet, or a combination thereof. The wireless network may be related to Long Term Evolution (LTE), 5g New Radio (NR), Wireless Fidelity (WiFi), Zigbee, Near Field Communication (NFC), Bluetooth, Bluetooth Low-Energy (BLE), or a combination thereof. can

The electronic devices 101 and 210 according to an embodiment may be terminals owned by users. The terminal is, for example, a personal computer (PC) such as a laptop and desktop, a smartphone, a smart pad, a tablet PC (Personal Computer), a smart watch, and an HMD (Head- Mounted Device) may include smart accessories. Referring to FIG. 2 , an example in which the electronic device 101 corresponds to a smart phone, a smart pad, and a tablet PC, and the electronic device 210 corresponds to a personal computer such as a desktop is shown. The embodiment is not limited to the example of FIGS. 2A to 2B .

The network 250 including the wired network and the wireless network may include a plurality of relay nodes for relaying one or more electrical signals (eg, packets). The relay node may include a router, a base station, an access point (AP), and a base station (eg, an eNode B (eNB) and/or a gNode B (gNB)). Referring to FIGS. 2A and 2B , an AP 260 and/or a base station 270 are illustrated as an example of a relay node disposed between the electronic devices 101 and 210 and the network 250 . The electronic devices 101 and 210 according to an embodiment may be connected to the network 250 through a relay node such as the AP 260 and the base station 270 . Each of the relay node and/or the electronic devices 101 and 210 included in the network 250 may be referred to as a node within the network 250 . Nodes included in network 250 may communicate with each other based on data indicating the location of the node within network 250 . The data, as a network address indicating the location, may include an Internet Protocol (IP) address and/or a Media Access Control (MAC) address. The IP address may be text assigned to each of the electronic devices 101 and 210 based on a designated format such as, for example, IP version 4 (IPv4) and/or IPv6.

Based on the plurality of relay nodes deployed in the network 250, a sub-network that is part of the network 250 may be formed. For example, a single sub-network may be formed within network 250 by means of relay nodes. A sub-network may refer to a part of the network 250 that is distinguished based on a translation of a network address by a relay node corresponding to the sub-network. For example, within a sub-network distinguished by a relay node, nodes may communicate directly based on network addresses (eg, IP addresses) uniquely assigned to nodes by the relay node. As nodes included in the sub-network communicate directly based on network addresses, connections between nodes can be established independently of translation of network addresses by relay nodes.

Nodes included in different sub-networks can communicate with each other based on translation of network addresses by relay nodes corresponding to each of the sub-networks. For example, a specific node included in a specific sub-network is distinguished from a network address given to other nodes included in other sub-networks, and a corresponding node among ports of relay nodes of other sub-networks is provided. By accessing the port, it is possible to access the other node. For example, converting a network address may include allocating at least one port among ports of a relay node to a node included in a sub-network distinguished by the relay node.

The electronic device 101 according to an embodiment is the electronic device 210, and video (eg, a screen obtained from the application) and/or audio (eg, obtained from one or more applications running on the electronic device 101) eg audio provided by the application). Hereinafter, as a function of the electronic device 101, the mirroring function is a function of transmitting the video and/or the audio to another electronic device (eg, the electronic device 210) that is distinguished from the electronic device 101. can mean The mirroring function may be referred to as a cast function and/or a mirrorlink function. The electronic device 210 receiving the video and/or the audio may output the video and/or the audio using a display and/or a speaker. In a state of performing the mirroring function, based on streaming, the electronic device 210 may substantially simultaneously transmit and output the video and/or the audio. One or more programs executed by the other electronic devices 101 and 210 to support the mirroring function according to an embodiment will be described later with reference to FIG. 4 .

In a state in which video and/or audio is received from the electronic device 101 according to an embodiment, the electronic device 210 receives input through an input means (eg, a keyboard and/or a mouse) of the electronic device 210. User input may be transmitted to the electronic device 101 . The user input may be related to the video and/or the audio output from the electronic device 210 and provided from the electronic device 101 . In response to the user input detected by the electronic device 210 , the electronic device 101 may change the video and/or the audio transmitted to the electronic device 210 . Referring to FIGS. 2A and 2B , based on a connection 220 established between electronic devices 101 and 210 according to an embodiment, signals representing the video, audio, and/or user input may be transmitted. can Hereinafter, the connection 220 may mean an end-to-end connection and/or a peer-to-peer connection established within a network, such as a session. Hereinafter, the connection 220 may be referred to as a mirroring session established between the electronic devices 101 and 210 .

The electronic devices 101 and 210 according to an embodiment may establish the connection 220 of FIGS. 2A to 2B based at least on the server 230 of the service provider related to the mirroring function. The electronic devices 101 and 210 according to an embodiment establish the connection 220 of FIGS. 2A and 2B using the server 240 for supporting establishment of a connection traversing different sub-networks. can be established For example, the server 240 may include a Session Traversal Utilities for NAT (STUN) server and/or a Traversal Using Relays around NAT (TURN) server. The STUN server stores information for P2P connection between the electronic devices 101 and 210 (eg, a public IP and/or port mapped to a node by network address translation in a relay node) and / or can be provided. The TURN server may be a server for relaying data between endpoints.

The electronic devices 101 and 210 according to an embodiment may control execution of a mirroring function based on the type of connection 220 . For example, the electronic devices 101 and 210 may control execution of the mirroring function according to which server among the servers 230 and 240 the connection 220 is established with. Controlling the execution of the mirroring function may, for example, switch the state of at least one of the electronic devices 101 and 210 and/or stream screen and/or audio between the electronic devices 101 and 210. It may include an operation of at least temporarily stopping. Hereinafter, a process for establishing a connection 220 between the electronic devices 101 and 210 will be described with reference to FIGS. 2A and 2B. The above process may be used, for example, to control execution of a mirroring function by the electronic devices 101 and 210 .

After accessing the network 250, the electronic devices 101 and 210 according to an embodiment may inform the server 230 of the network address assigned to each of the electronic devices 101 and 210. The network address may be determined by a relay node connected to each of the electronic devices 101 and 210 . The electronic device 210 according to an embodiment transmits the network address of the electronic device 101 to the server 230 in response to identifying a user input for executing a mirroring function related to the electronic device 101. you can ask for In response to the request, the server 230 may transmit, to the electronic device 210, a network address assigned to the electronic device 101 and determined by a relay node connected to the electronic device 101. Based on the network address, the electronic device 210 may attempt to establish a connection 220 within a single sub-network. Operations of the electronic devices 101 and 210 related to the user input will be described later with reference to FIGS. 6A and 6B.

Referring to FIG. 2A , a state 200 in which electronic devices 101 and 210 according to an embodiment are connected to a network 250 through a single sub-network by a single relay node (eg, AP 260). is shown In state 200, all of the electronic devices 101 and 210 may have network addresses generated by the AP 260 and different for each of the electronic devices 101 and 210. In state 200, when the electronic device 210 requests the server 230 to transmit the network address of the electronic device 101, the server 230 sends the electronic device 101 by the AP 260. The assigned network address may be transmitted to the electronic device 210 . In this case, the electronic device 210 may access the electronic device 101 according to the network address received from the server 230 within the sub-network of the electronic device 210 . In state 200, a connection 220 between the electronic devices 101 and 210 is established as the electronic device 210 accesses the electronic device 101 according to the network address received from the server 230. can

Referring to FIG. 2B , the electronic devices 101 and 210 according to an embodiment are connected to a network 250 through different sub-networks corresponding to different relay nodes (eg, a base station 270 and an AP 260), respectively. A state 205 connected to ) is shown. In state 205 , electronic device 101 may have a network address generated by base station 270 . The electronic device 210 may have a network address generated by the AP 260 that is distinct from that of the base station 270 . In state 205, when the electronic device 210 requests the server 230 to transmit the network address of the electronic device 101, the server 230 sends the electronic device 101 by the base station 270. The assigned network address may be transmitted to the electronic device 210 . In this case, as the network address is generated by the base station 270 that is distinct from the AP 260 of the sub-network including the electronic device 210, the electronic device 210 has the network address within the sub-network. The electronic device 101 having the may not be identified. If the electronic device 101 is not identified from the sub-network, the electronic device 210 uses a server 240 that is distinct from the server 230 to use another sub-network distinct from the sub-network of the electronic device 210. Electronic device 101 within a network (eg, a sub-network formed by base station 270 ) may be accessed. In state 205, the connection 220 between the electronic devices 101 and 210 is established by another server 240 (e.g., , STUN server and / or TURN server).

The electronic devices 101 and 210 according to an embodiment may control execution of a mirroring function based on proximity of the electronic devices 101 and 210 . The proximity can be distinguished according to whether the electronic devices 101 and 210 are included in the same sub-network within the network 250, as in states 200 and 205. When the electronic devices 101 and 210 are far apart, the electronic devices 101 and 210 may be included in different sub-networks, respectively. When the electronic devices 101 and 210 are included in each of the different sub-networks, the electronic devices 101 and 210 perform user authentication in order to prevent leakage of screen and/or audio shared based on the mirroring function. can be performed.

In one embodiment, the user authentication determines whether a user using at least one of the electronic devices 101 and 210 corresponds to a user pre-registered in at least one of the electronic devices 101 and 210. It may include actions to identify. For example, the electronic devices 101 and 210 may store authentication information including data such as a PIN and/or password, and/or fingerprint, iris and/or voice from the user. After storing the authentication information, the electronic devices 101 and 210 may perform user authentication based on whether information obtained from the user matches the authentication information. Hereinafter, an authorized user may mean a user determined to match a pre-registered user based on user authentication performed in at least one of the electronic devices 101 and 210 . Hereinafter, an unauthorized user is a user before performing the user authentication by at least one of the electronic devices 101 and 210, or a user determined to be different from a pre-registered user through the user authentication. can mean

Like the process described above with reference to FIGS. 2A and 2B , the electronic devices 101 and 210 may sequentially access the servers 230 and 240 to establish a connection 220 . Within the process of establishing the connection 220, based on whether the connection 220 is established based on the server 240 for supporting establishment of the connection across sub-networks, the electronic devices 101, 210 ) may control the execution of the mirroring function. For example, when a connection 220 between different sub-networks is established as in state 205, the electronic devices 101 and 210 may perform user authentication while executing a mirroring function. Meanwhile, as in state 200, when the connection 220 is established within a single sub-network, the electronic devices 101 and 210 may execute the mirroring function independently of the user authentication. States entered as the electronic devices 101 and 210 execute the mirroring function according to an embodiment will be described later with reference to FIG. 5 .

As described above, in a state in which one or more screens are displayed on all of the electronic devices 101 and 210 based on the mirroring function, an unauthorized user is displayed on one of the electronic devices 101 and 210. In order to prevent access to the one or more screens, the electronic devices 101 and 210 according to an embodiment may perform an operation related to user authentication. For example, if the electronic devices 101 and 210 are included in different sub-networks, as in state 205, the likelihood that an unauthorized user will access any one of the electronic devices 101 and 210 will increase. can In the above example, in response to identifying that the electronic devices 101 and 210 are included in different sub-networks, the electronic devices 101 and 210 access the respective screens of the electronic devices 101 and 210, respectively. User authentication can be performed for users who An operation of performing user authentication by the electronic devices 101 and 210 according to an embodiment will be described later with reference to FIGS. 7A to 7B .

Hereinafter, with reference to FIG. 3 , one or more hardware components included in each of the electronic devices 101 and 210 according to an embodiment and related to a mirroring function will be described.

3 is a block diagram of electronic devices 101 and 210 according to an exemplary embodiment. The electronic device 101 of FIG. 3 may correspond to an example of the electronic device 101 of FIGS. 1 and 2 . The electronic device 210 of FIG. 3 may correspond to an example of the electronic device 210 of FIG. 2 .

Referring to FIG. 3 , each of the electronic devices 101 and 210 according to an embodiment includes processors 312 and 314, memories 322 and 324, displays 342 and 344, and speakers 352. , 354) or at least one of the communication circuits 362 and 364. Hardware components included in each of the electronic device 101 and the electronic device 210 may be electrically and/or operatively connected to each other by an electronic component such as a communication bus. /or operably coupled with each other). The type and/or number of hardware components included in each of the electronic device 101 and the electronic device 210 are not limited to those shown in FIG. 3 . Processors 312 and 314, memories 322 and 324, displays 342 and 344, speakers 352 and 354, and communication circuits 362 and 364 are the processor 120 of FIG. 1, memory 130, the display module 160, and the audio module 170 may correspond to each. Each of the communication circuits 362 and 364 may correspond to the communication module 190 of FIG. 1 , the antenna module 197 , the subscriber identity module 196 , or a combination thereof.

Referring to FIG. 3 , the programs 372 and 374 stored in each of the memories 322 and 324 are a set of instructions representing one or more operations to be performed by each of the processors 312 and 314 to process data. can respond Programs 372 and 374 may include firmware, an operating system (eg, operating system 142 of FIG. 1 ), middleware (eg, middleware 144 of FIG. 1 ), processes, routines, sub-routines, and/or It may be referred to as an application (eg, application 146 of FIG. 1 ). Each of the electronic devices 101 and 210 according to an embodiment may execute the programs 372 and 374 to perform at least one of operations described below, for example, operations of FIGS. 8 to 10 . there is. One or more instances and/or one or more objects included in each of the programs 372 and 374 are described below with reference to FIG. 4 .

For example, each of the electronic devices 101 and 210 executes the programs 372 and 374 to control each of the communication circuits 362 and 364 to establish a connection between the electronic devices 101 and 210 ( 220) can be established. The connection 220 may include, for example, the connection 220 of FIGS. 2A to 2B. In one embodiment, through the connection 220 based on the mirroring session, the electronic device 101 transmits video representing a screen displayed on the display 342 and/or audio output from the speaker 352, It can be transmitted to the electronic device 210. The electronic device 210 may display the video received from the electronic device 101 on the display 344 . The electronic device 210 may output the audio received from the electronic device 101 through the speaker 354 . In response to the electronic device 210 detecting an event related to the mirroring function, the electronic device 210 may notify the electronic device 101 of the detected event through a connection 220 . The electronic device 101 may change the video and/or the audio transmitted to the electronic device 210 in response to the event.

The electronic device 101 according to an embodiment may create a mirroring session for transmitting the first screen displayed on the display 342 to the electronic device 210 . The mirroring session may be created based on the connection 220 between the electronic devices 101 and 210 . In a state of establishing a connection 220 to create a mirroring session, the electronic device 101 may identify proximity between the electronic device 210 and the electronic device 101 . When a connection 220 is established across different sub-networks, such as the connection 220 in state 205 of FIG. 2B, the electronic device 101 transmits the first screen to another electronic device 210. While maintaining this, a second screen distinct from the first screen may be displayed on the display 342 . For example, the second screen may have a size corresponding to the entire display area of the display 342 . For example, the second screen may be a screen different from the first screen that is changed in one or more applications running on the electronic device 101 in order to stop exposure of the first screen on the display 342. .

In response to identifying that the mirroring session included in the connection 220 is established across a plurality of sub-networks, the electronic device 101 according to an embodiment changes the state of the electronic device 101, at least temporarily. (at least temporarily) can be switched to a locked state. The locked state is determined by at least one designated function among all functions available in the electronic device 101 (e.g., an emergency call function, an alarm function, a photographing function, and/or a user authentication function). ) may include a state that restricts the execution of other functions. The locked state may include a state in which access to content obtained before the electronic device 101 switches to the locked state is restricted.

The electronic device 101 according to an embodiment may display a lock screen on the display 342 in a locked state. One or more screens provided in the locked state may be referred to as a lock screen. The locked state may include, for example, a state in which switching to other screens other than at least one designated screen such as the lock screen is restricted. The lock screen may include information guiding user authentication. The electronic device 101 according to an embodiment includes, within a locked state, first information provided from a user accessing the electronic device 101 and has been obtained in an unlocked state distinct from the locked state. Based on the operation of comparing the second information, it is possible to switch to another state distinct from the locked state, such as the unlocked state. The operation of comparing the first information and the second information may correspond to, for example, at least a part of an operation of authenticating a user accessing the electronic device 101 in a locked state. The second information may include, for example, personal identification number (PIN), password, one-time-password (OTP), biometric information such as iris and/or fingerprint.

In one embodiment, the lock release state is a state distinct from the lock state and may include a state allowing execution of all functions available in the electronic device 101 . The unlocked state may include a state in which the number of functions preceding user authentication is reduced compared to the number of functions preceding user authentication in the locked state. The unlocked state may include a state in which the range of accessible content within the electronic device 101 is increased than the range of accessible content within the electronic device 101 within the locked state.

When the end-to-end connection 220 between the electronic devices 101 and 210 is established by connecting a plurality of sub-networks, the electronic device 101 according to an embodiment, among the electronic devices 101 and 210 In response to identifying a user input accessing the electronic device 101 , the electronic device 210 may switch to a locked state independently of displaying a screen provided to the electronic device 210 . Meanwhile, when the end-to-end connection 220 between the electronic devices 101 and 210 is established within a single sub-network, the electronic device 101 maintains an unlocked state in response to identifying the user input. can For example, the electronic device 101 may display a screen provided to the electronic device 210 on the display 342 .

As the electronic device 101 is switched to the locked state, the electronic device 101 may at least temporarily stop executing a function corresponding to the identified user input. Before executing the function, the electronic device 101 may display a lock screen for user authentication on the display 342 . For example, the user of the electronic device 101 is a process of proving that the user corresponds to a pre-registered user of the electronic device 101 based on the lock screen displayed on the display 342, for example , credential and/or user authentication. The electronic device 101 according to an embodiment may switch from the locked state to the unlocked state in response to identifying that user authentication based on the lock screen succeeds. After switching to the unlock state, the electronic device 101 may resume displaying the screen provided to the electronic device 210 on the display 342 .

The electronic device 101 according to an embodiment similarly performs user authentication based on a user interface (UI) provided using the electronic device 101 among the electronic devices 101 and 210. , User authentication may be performed based on the UI provided using the electronic device 210 among the electronic devices 101 and 210 . For example, after the electronic device 101 is switched to the locked state, the electronic device 210 is displayed on the display 344, and related to the electronic device 101 as the electronic device 101 is switched to the locked state. A designated screen notifying that the mirroring function is paused may be displayed. The designated screen may further include a UI for performing user authentication related to the electronic device 101 using the electronic device 210 . In response to identifying that the user accessing the electronic device 210 corresponds to a pre-registered user in the electronic device 101 based on the designated screen, the electronic device 101 is displayed on the electronic device 210. Resume and/or initiate transmission of the screen based on 342 .

The electronic devices 101 and 210 according to an embodiment may identify an electronic device for which user authentication has been performed among the electronic devices 101 and 210 in a state of executing the mirroring function. Since the identified electronic device is used by an authenticated user among the electronic devices 101 and 210, the electronic device on which user authentication has been performed among the electronic devices 101 and 210 can maintain an unlocked state. Among the electronic devices 101 and 210, the electronic device on which user authentication has been performed is, for example, until user authentication is performed again on another electronic device that is distinct from the electronic device and/or for a specified time. The unlock state may be maintained until the display of the electronic device is deactivated as a user input is not received during the period.

As described above, the electronic devices 101 and 210 according to an embodiment, in a screen sharing state by executing a mirroring function, in order to prevent an unauthorized user from viewing the shared screen, the screen is displayed. In response to receiving user input to browse, it may switch to a locked state. Switching to the locked state is the sub-network related to the connection 220 between the electronic devices 101 and 210, the proximity between the electronic devices 101 and 210, or the electronic devices 101 and 210, respectively. User authentication may be performed based on at least one of successful histories.

Hereinafter, with reference to FIG. 4 , programs 372 and 374 executed by the electronic devices 101 and 210 to support the mirroring function according to an exemplary embodiment will be described in detail.

4 is a diagram for explaining programs 372 and 374 executed in each of electronic devices according to an exemplary embodiment. The electronic devices of FIG. 4 may include the electronic device 101 of FIGS. 1 to 3 and the electronic device 210 of FIGS. 2 to 3 . The programs 372 and 374 of FIG. 4 may correspond to the programs 372 and 374 of FIG. 3 , respectively. Referring to FIG. 4 , one or more objects and/or one or more instances included in each of the programs 372 and 374 are shown. An object and/or instance refers to a unit of one or more operations performed by an electronic device executed by the programs 372 and 374 .

Referring to FIG. 4 , a program 372 may correspond to an example of a program (eg, the program 372 of FIG. 3 ) executed by the electronic device 101 of FIGS. 1 to 3 . . For example, the program 372 may include instructions for an electronic device executing the program 372 to transmit a screen and/or audio generated by the electronic device based on a mirroring function to another electronic device. there is. The program 374 may correspond to an example of a program (eg, the program 374 of FIG. 3 ) executed by the electronic device 210 of FIGS. 2 to 3 . For example, the program 374 allows an electronic device executing the program 374 to transmit a screen and/or audio received from another electronic device executing the program 372 to a display and/or speaker of the electronic device. It may include instructions for outputting through. Hereinafter, an electronic device that executes the program 372 may be referred to as a source electronic device and/or a first electronic device as an electronic device that becomes a source of a screen and/or audio. Hereinafter, the electronic device executing the program 374 is an electronic device that is remotely connected to an electronic device that transmits a screen and/or audio, and is, for example, a remote electronic device and/or a second electronic device. can be referred to as

In one embodiment, the program 372 is at least a part of an operating system and/or middleware, and may be executed by the source electronic device as the source electronic device runs based on the operating system and/or the middleware. there is. Referring to FIG. 4 , as objects and/or instances activated as the source electronic device executes the program 372, a source connection manager 410, a source container manager 420, a mirroring guide screen manager 430, and content Protection manager 440 , input manager 450 and system services 460 are shown. In one embodiment, the source electronic device may create one or more source application containers by executing a mirroring function based on the source container manager 420 . Referring to FIG. 4 , N source application containers 422-1, 422-2, ..., 422-N generated by the source electronic device based on the source container manager 420 are shown. The N source application containers 422-1, 422-2, ..., 422-N are executed in the source electronic device and may correspond to N screens obtained from at least one application. The source electronic device according to an embodiment may acquire the N number of screens in response to receiving a screen sharing request from a remote electronic device. In one embodiment, program 372 includes source connection manager 410, source container manager 420, mirroring guide screen manager 430, content protection manager 440, input manager 450, and system services 460. ) may include instructions corresponding to each.

In one embodiment, the program 374, as at least a portion of an application related to the mirroring function, may be executed by the remote electronic device based on a user input for executing the application. Referring to FIG. 4 , a remote connection manager 415 and a remote container manager 425 are illustrated as objects and/or instances that are activated when a remote electronic device executes a program 374 . In one embodiment, the remote electronic device may create one or more remote application containers by executing a mirroring function based on the remote container manager 425 . Referring to FIG. 4 , N remote application containers 427-1, 427-2, ..., 427-N created by the remote electronic device based on the remote container manager 425 are shown. For example, the program 374 may include instructions corresponding to each of the remote connection manager 415 and the remote container manager 425 .

Instances activated by each of the programs 372 and 374 shown in FIG. 4 may correspond to each other according to the type of each instance. The source electronic device and the remote electronic device may transmit and/or receive data according to a correspondence relationship between instances within the connection 220 . For example, the source connection manager 410 activated in the source electronic device may correspond to the remote connection manager 415 activated in the remote electronic device. The source container manager 420 may correspond to the remote container manager 425 . N source application containers 422-1, 422-2, ..., 422-N correspond to N remote application containers 427-1, 427-2, ..., 427-N, respectively. can

Referring to FIG. 4 , the source electronic device may use the source connection manager 410 to communicate with a remote connection manager 415 that is an instance running on the remote electronic device. The source connection manager 410 and the remote connection manager 415 control communication between one or more instances executed according to the corresponding relationship in the source electronic device and the remote electronic device executing the programs 372 and 374. can be used The source electronic device according to an embodiment may establish and/or disconnect the connection 220 between the source electronic device and the remote electronic device using the source connection manager 410 . In order to control the execution of the mirroring function, the source electronic device uses the source connection manager 410 to establish the connection 220 (e.g., at least one of the servers 230 and 240 of FIGS. 2A and 2B). ) and/or identify one or more sub-networks associated with connection 220 . In response to identifying the server used to establish the connection 220 and/or one or more sub-networks associated with the connection 220, the source electronic device according to an embodiment may display the mirroring guide screen manager 430 and/or An event related to the content protection manager 440 may occur. The event is related to the proximity between the source electronic device and the remote electronic device, and may include, for example, an event notifying that the source electronic device and the remote electronic device are disposed on different sub-networks.

The source electronic device according to an embodiment may manage all of one or more applications executed based on the mirroring function based on the source container manager 420 . For example, by using the source container manager 420, the source electronic device may create and/or remove a source application container, which is an instance corresponding to each of the one or more applications. For example, the source electronic device may use the source container manager 420 to process a request received from a remote electronic device and related to execution and/or termination of an application stored in the source electronic device. In one embodiment, the source container manager 420 may be referred to as an application execution container manager. The event may include, for example, an event of receiving a request to execute an application stored in the source electronic device. Since the source container manager 420 corresponds to the remote container manager 425, the remote electronic device is the source container manager 420 executed in the source remote device based on the remote container manager 425, and the user of the remote electronic device A request to execute the application selected by may be transmitted. The source electronic device may obtain a source application container corresponding to the request using the source container manager 420 .

For example, when the source application container 422-1 is created in response to the request, the source electronic device uses the source container manager 420 to transfer the source application to the remote container manager 425 of the remote electronic device. Information related to the container 422-1 may be transmitted. The information is an identifier assigned to the source application container 422-1, for example, a package name of the application corresponding to the request, and a UID (user user) assigned to the application by the system service 460. ID) or a task ID.

In one embodiment, based on the source container manager 420, the source electronic device may process at least a portion of the user input detected by the remote electronic device as it performs a mirroring function. For example, when a user of the remote electronic device performs a user input for controlling an application provided through the remote electronic device and being executed in the source electronic device based on the source application container 422-1. , The remote electronic device may transmit a signal notifying the user input to the source electronic device using the remote application container 427-1 corresponding to the source application container 422-1.

In response to receiving the signal, the source electronic device may inform the source application container 422-1 of the occurrence of the user input according to the signal based on the source container manager 420. Similarly, when a user of the source electronic device performs a user input for controlling an application corresponding to the source application container 422-1, the source electronic device responds to the user input based on the source container manager 420. A source application container 422-1 for processing a corresponding event may be identified.

The source electronic device according to an embodiment may control one or more sessions formed based on the connection 220 between the source electronic device and the remote electronic device using one or more source application containers. In one embodiment, the source application container may be referred to as an application execution container. The one or more sessions are logical links established in correspondence with each of one or more applications of the source electronic device executed by the remote electronic device based on the mirroring function, and are, for example, mirroring sessions, screen mirroring sessions, and/or screen streaming. can be referred to as a session. Referring to FIG. 4 , N source application containers 422-1, 422-2, ..., 422-N created by the source electronic device in which the source container manager 420 is executed are N mirroring Sessions may correspond to N applications executed in the source electronic device and provided to the remote electronic device. Through each of the N mirroring sessions, a video signal generated when the source electronic device captures the screen of an application based on the source application container may be transmitted.

In an embodiment, the source electronic device may store information corresponding to each of one or more source application containers in a memory (eg, the memory 322 of the electronic device 101 of FIG. 3 ). The information may be stored in a portion of memory allocated to the corresponding source application container. For example, a source application container executed in a source electronic device is information uniquely assigned by the source electronic device using the source container manager 420, and includes an identifier (ID) and a package name of a corresponding application. , task ID or UID. Information allocated to the source application container may be used to indicate a source application container corresponding to a signal to be transmitted to the remote electronic device, for example. Information allocated to the source application container may be used to identify a remote application container corresponding to the source application container in the remote electronic device. For example, the information allocated to the source application container may indicate mapping between the source application container and the remote application container.

The source electronic device according to an embodiment uses the mirroring guide screen manager 430 to acquire a screen to be displayed on the display of the source electronic device (eg, the display 342 of FIG. 3 ) while executing the mirroring function. can The screen acquired by the source electronic device based on the mirroring guide screen manager 430 may include a message for notifying that the screen is transmitted to the remote electronic device. Hereinafter, a screen displayed on the display of the source electronic device based on the mirroring guide screen manager 430 may be referred to as a mirroring guide screen and/or a black screen. An example of a mirroring guide screen displayed by a source electronic device according to an embodiment will be described later with reference to FIGS. 6B and 7A to 7B.

The source electronic device according to an embodiment may process an event related to the mirroring guide screen using the mirroring guide screen manager 430 . For example, in response to identifying a user input for switching to another screen distinct from the mirroring guide screen, the source electronic device performs an operation corresponding to the identified user input using the mirroring guide screen manager 430. can do. For example, the operation performed by the source electronic device using the mirroring guide screen manager 430 may include an operation of stopping the display of the mirroring guide screen in the display. For example, the operation performed by the source electronic device using the mirroring guide screen manager 430 is another screen distinct from the mirroring guide screen, and the source application containers 422-1, 422-2, ... , 422-N) may include an operation of displaying a screen corresponding to any one of them. For example, the operation may include an operation of displaying a lock screen generated when the state of the source electronic device is switched to a locked state, as another screen different from the mirroring guide screen. For example, the operation may include notifying release of the mirroring guide screen to another instance (eg, the content protection manager 440) being executed by the source electronic device based on the program 372.

The source electronic device according to an embodiment uses the content protection manager 440 to view one or more screens (eg, the source application containers 422 -1, 422-2, ..., 422-N) and may perform an operation for limiting the display of N screens) transmitted to the remote electronic device. The operation performed by the source electronic device using the content protection manager 440 may include, for example, requesting the mirroring guide screen manager 430 to display the mirroring guide screen. The operation performed by the source electronic device using the content protection manager 440 may include, for example, switching the state of the source electronic device to a locked state.

The source electronic device according to an embodiment uses the content protection manager 440 in response to identifying that the source electronic device and the remote electronic device are located on different sub-networks using the source connection manager 410. Thus, the mirroring guide screen manager 430 can be controlled. For example, the source electronic device may add the mirroring guide screen obtained from the mirroring guide screen manager 430 to the display using the content protection manager 440 . The source electronic device may detect an event occurring on the mirroring guide screen using the content protection manager 440 .

The source electronic device according to an embodiment may use the content protection manager 440 to identify a history of switching from a locked state to an unlocked state in each of the source electronic device and the remote electronic device. For example, in a state in which user authentication has been completed based on the source electronic device is identified using the content protection manager 440, the source electronic device displays a lock screen in response to a user input for releasing the mirroring guide screen. can be bypassed. By bypassing the display of the lock screen, the source electronic device may display a screen transmitted to the remote electronic device. For example, in a state in which user authentication has been completed based on a remote electronic device among a source electronic device and a remote electronic device is identified using the content protection manager 440, the source electronic device receives a user input for releasing the mirroring guide screen. In response, the lock screen may be displayed.

The source electronic device according to an embodiment uses the surface plunger 480 included in the system service 460 to display the mirroring guide screen displayed by the mirroring guide screen manager 430 or the content protection manager 440. An object (eg, a surface corresponding to a presentation window area) to which at least one of the displayed lock screens is rendered may be created. The object is a part of memory identified by the source electronic device based on the system service 460, and may correspond to, for example, a frame buffer. The source electronic device may display at least one of the mirroring guide screen and the lock screen on the display using the surface plunger 480 and the mirroring guide screen manager 430 and the content protection manager 440 . Displaying at least one of the mirroring guide screen and the lock screen by the source electronic device is independent of the acquisition of corresponding screens by the source application containers 422-1, 422-2, ..., 422-N. can be performed with

The source electronic device according to an embodiment may process a user input detected by the source electronic device or the remote electronic device based on the mirroring function by using the input manager 450 . For example, the source electronic device may use the input manager 450 to identify which electronic device among the source electronic device and the remote electronic device detected the user input. The user input may include, for example, a user inputting information related to user authentication, such as a PIN input performed on a lock screen. The source electronic device according to an embodiment may use the input manager 450 to identify an identifier (eg, screen ID) of a screen related to the user input. An identifier of a screen, such as a screen ID, identified by the input manager 450 and associated with a user input, may be transmitted to the mirroring guide screen manager 430 and/or the content protection manager 440 by the source electronic device. . For example, the source electronic device may use the content protection manager 440 to identify the electronic device on which the user input was performed based on the screen ID.

The source electronic device according to an embodiment may switch the state of the source electronic device to a locked state by using the key input manager 470 included in the system service 460 . Switching the state of the source electronic device to the locked state may, for example, determine whether a connection 220 has been established by the source connection manager 410 to traverse multiple sub-networks and/or the mirroring guide screen manager 430 ), it may be performed based on specified conditions, such as whether or not a request to switch to a locked state is received.

Referring to FIG. 4 , a remote electronic device according to an embodiment may use a remote connection manager 415 to access a source connection manager 410 running in a source electronic device. For example, the remote electronic device may use the remote connection manager 415 to identify the network address assigned to the source electronic device. Based on the identified network address, the remote electronic device may access the source electronic device within a sub-network of the remote electronic device. If the source electronic device is not accessed within the sub-network of the remote electronic device, the remote electronic device may identify that the source electronic device and the remote electronic device are disposed in different sub-networks, respectively. In response to identifying that the source electronic device and the remote electronic device are located on different sub-networks, respectively, the remote electronic device, based on the STUN server and/or TURN server (e.g., server 240 of FIGS. 2A-2B) , may establish a connection 220 between the remote electronic device and the source electronic device. In response to establishing the STUN server and/or TURN server connection 220, the remote electronic device may determine that the remote electronic device and the source electronic device are separated by different sub-networks.

The remote electronic device according to an embodiment may manage one or more mirroring sessions corresponding to each of one or more applications executed in the source electronic device based on the mirroring function based on the remote container manager 425 . The remote container manager 425 executed in the remote electronic device may correspond to the source container manager 420 executed in the source electronic device. In one embodiment, remote container manager 425 may be referred to as a remote application container manager.

For example, by using the remote container manager 425, the remote electronic device can create and/or delete a remote application container, which is an instance corresponding to each of the one or more applications. For example, the remote electronic device may transmit a request to the source electronic device to execute an application, share a screen of the application, and/or stop the execution of the application by using the remote container manager 425. . For example, in response to receiving a request to execute an application, the source electronic device may transmit information related to a source application container acquired using the source container manager 420 corresponding to the remote container manager 425. can In response to receiving the information, the remote electronic device may create a remote application container corresponding to the source application container based on the information using the remote container manager 425 . The remote electronic device, based on the mapping between the remote application container and the source application container indicated by the remote container manager 425, corresponds to the data transmitted by the source electronic device based on the specific source application container to the specific source application container. can be sent to a remote application container that

The remote electronic device according to an embodiment may perform communication based on one or more mirroring sessions formed based on the connection 220 between the source electronic device and the remote electronic device using one or more remote application containers. there is. Referring to FIG. 4 , N remote application containers 427-N corresponding to each of the N source application containers 422-1, 422-2, ..., 422-N generated by the source electronic device. 1, 427-2, ..., 427-N) are shown. For example, the remote electronic device may acquire one or more remote application containers having a one-to-one correspondence with one or more source application containers being executed in the source electronic device based at least on the remote container manager 425 . The remote electronic device according to an embodiment assigns a unique identifier to each of the N remote application containers 427-1, 427-2, ..., 427-N based on the remote container manager 425. can do. Based on the identifier, N remote application containers 427-1, 427-2, ..., 427-N are N source application containers 422-1, 422-2, ..., 422 -N) can correspond to each.

According to an embodiment, the source electronic device and the remote electronic device use the source connection manager 410 and the remote connection manager 415 to connect one or more sub-networks associated with the connection 220 between the source electronic device and the remote electronic device. can identify them. In the state where the connection 220 is established based on the TCP/IP socket, the source electronic device and the remote electronic device assign to the TCP/IP socket using the source connection manager 410 and the remote connection manager 415. It is possible to identify whether the specified network address matches the network address of the source electronic device and/or the remote electronic device.

For example, if the network address assigned to the TCP/IP socket matches the network address of the source electronic device and/or remote electronic device, the source electronic device and remote electronic device establish a connection (220) within a single sub-network. ), it can be identified that they are connected to each other based on If the network address assigned to the TCP/IP socket does not match all of the network addresses of the source electronic device and the remote electronic device, then the source electronic device and the remote electronic device are connected to different sub-networks. included in can be identified. For example, the source electronic device and the remote electronic device may establish a connection 220 using a plurality of relay nodes within the network, by means of different sub-networks.

For example, the source electronic device and the remote electronic device compare identifiers (eg, Service Set Identifier (SSID)) of APs connected to the source electronic device and the remote electronic device, respectively, so that the source electronic device and the remote electronic device are configured as a single subsystem. -It can identify whether or not it is connected within the network. For example, when an identifier of a first AP connected to the source electronic device and an identifier of a second AP connected to the remote electronic device match (ie, the first AP and the second AP match), the source electronic device and the remote electronic device Devices may be determined to be located within the same sub-network. When the identifier of the first AP and the identifier of the second AP do not match, it may be determined that the source electronic device and the remote electronic device are disposed in separate sub-networks.

For example, the source electronic device uses the source connection manager 410 to establish a connection between the source electronic device and the remote electronic device using a short-range device-to-device (D2D) connection such as Bluetooth or BLE (Bluetooth LE). distance can be discerned. For example, the source electronic device may identify received signal strength (RSS) of an advertisement packet of BLE. Based on the identified RSS, the source electronic device can identify the distance between the source electronic device and the remote electronic device. The source electronic device according to an embodiment may notify the distance between the source electronic device and the remote electronic device to the mirroring guide screen manager 430 and/or the content protection manager 440 . The distance may be identified based on, for example, a short-range D2D connection. The distance may be related, for example, to the number of sub-networks used to establish connections 220 .

The source electronic device according to an embodiment may perform an operation based on a distance between the source electronic device and the remote electronic device in response to execution of the mirroring function. For example, in response to identifying that the distance exceeds a specified threshold, the source electronic device may display a mirroring guide screen by controlling the mirroring guide screen manager 430 using the content protection manager 440. there is. For example, the source electronic device uses the mirroring guide screen manager 430 to designate a region that is distinguished from screen capture based on a mirroring function among a plurality of regions (or a plurality of layers) related to a display. (eg, the presentation window area), a mirroring guide screen may be rendered. As the mirroring guide screen is rendered in the designated area, the source electronic device can display the mirroring guide screen on the display independently of screen capture based on the mirroring function. As the source electronic device displays the mirroring guide screen on the display, an unauthorized user may be prevented from observing the screen shared by the remote electronic device through the display of the source electronic device.

As described above, the source electronic device according to an embodiment may use the mirroring guide screen and/or the lock screen to authenticate a user who wants to access the screen shared by the remote electronic device using the display of the source electronic device. . For example, when the source electronic device and the remote electronic device are relatively far apart, a user using the mirroring function may select and access one of the source electronic device and the remote electronic device. In this case, in order to prevent leakage of content by other electronic devices that are distinguished from the electronic device selected by the user, the source electronic device according to an embodiment may conditionally switch to a locked state.

Hereinafter, with reference to FIG. 5 , operations of electronic devices according to an exemplary embodiment will be described based on finite states selected by electronic devices to control a mirroring function.

5 is a state transition diagram 500 related to states related to a mirroring function of electronic devices according to an embodiment. The electronic device of FIG. 5 may correspond to the electronic device 101 of FIGS. 1 to 3 and the source electronic device of FIG. 4 . The external electronic device of FIG. 5 is an electronic device that displays a screen provided from the electronic device, and may correspond to the electronic device 210 of FIGS. 1 to 3 and the remote electronic device of FIG. 4 .

Referring to the state transition diagram 500 of FIG. 5 , states 510, 520, 530, 540, and 550 are connected between an electronic device and an external electronic device (eg, FIGS. 2A to 2B and/or FIG. 3 ). After the connection 220) is established, it represents a state in which the electronic device and the external electronic device enter. Arrows between the states 510, 520, 530, 540, and 550 indicate states 510, 520, 530, 540, and 550 according to events generated after the electronic device and the external electronic device execute the mirroring function. represents the switching of

State 510 of FIG. 5 is a state in which the electronic device and the external electronic device initiate a mirroring function, and represents a state in which a connection between the electronic device and the external electronic device is established. As the connection is established, the electronic device and the external electronic device may switch from state 510 to state 520 . When an electronic device and an external electronic device according to an embodiment are connected to each other based on different sub-networks, and/or are spaced apart by a distance greater than or equal to a specified threshold, as in the exemplary connection 220 of FIG. 2B, the state It can switch from 510 to state 520.

Referring to FIG. 5 , in state 520, the electronic device according to an embodiment executes, for example, the mirroring guide screen manager 430 of FIG. 4 to display the electronic device (eg, the display of FIG. 3). (344)), the mirroring guide screen can be displayed. The mirroring guide screen may be distinguished from a screen transmitted by an electronic device to an external electronic device. For example, in state 520, the external electronic device may display one or more screens that are distinguished from the mirroring guide screen and provided from the electronic device based on one or more applications running on the electronic device. In state 520, the electronic device may prevent the screen being provided to the external electronic device from being exposed on the display of the electronic device by using the mirroring guide screen. In state 520, a screen displayed on the display by each of the electronic device and the external electronic device will be described later with reference to FIG. 6A.

Referring to FIG. 5 , an electronic device and an external electronic device that operate based on state 520, state 530, at least based on the occurrence of an event corresponding to a user input for switching from a mirroring guide screen to another screen. can be switched to The user input may include, for example, a gesture indicated by a mirroring guide screen being displayed on the electronic device. In state 530, the electronic device according to an embodiment may switch to a locked state. As the electronic device switches to the locked state, the electronic device may display a lock screen requesting information for switching to the unlocked state to the user. For example, state 530 may correspond to a state for receiving the information in an electronic device generating one or more screens. In state 530, the external electronic device according to an embodiment may stop displaying a screen provided from the electronic device. In state 530, the external electronic device according to an embodiment may display a message indicating that the electronic device operates based on the locked state and/or a screen including the message. For example, in state 530, the mirroring function being performed in the electronic device and the external electronic device may be stopped at least temporarily.

Referring to FIG. 5 , in state 530, when user authentication for a user using the electronic device succeeds, the electronic device according to an embodiment may switch from state 530 to state 550. State 530 may correspond to a state in which all electronic devices and external electronic devices are controlled by an authorized user. In state 530, based on the mirroring function between the electronic device and the external electronic device, sharing of one or more screens temporarily suspended by state 530 may be resumed. In state 530, as sharing of one or more screens resumes, the external electronic device may display one or more screens provided from the electronic device. Since state 530 is a state in which user authentication for a user using the electronic device has been completed, the electronic device switched to state 530 may stop displaying the mirroring guide screen. For example, the electronic device may display one or more screens to be transmitted to an external electronic device on a display of the electronic device. For example, as the state 550 is switched, the electronic device may switch from a locked state to an unlocked state.

Referring to FIG. 5 , in state 550, when reception of a user input is stopped for a specified time, the electronic device according to an embodiment may switch from state 550 to state 520. As switching from state 550 to state 520, the electronic device may resume displaying the mirroring guide screen while maintaining the unlocked state. Independently of displaying the mirroring guide screen, the electronic device may keep streaming one or more screens acquired from one or more applications running on the electronic device to an external electronic device, which are distinguished from the mirroring guide screen.

For example, in state 520 after being switched from state 530 to state 550 by user authentication performed by the electronic device, the electronic device receives a user input for switching from a mirroring guide screen to another screen. In response to identifying, it may switch to state 550 among states 530 and 550 . For example, in response to identifying that a difference between a first time point of switching from state 530 to state 550 due to user authentication and a second time point of identifying the user input is less than a specified threshold, the electronic device Among states 530 and 550, state 550 may be switched. For example, user authentication that was successful at the first time point may be used to authenticate a user who performed a user input at a second time point for unlocking the mirroring guide screen. In this case, the user can simultaneously control both the electronic device and the external electronic device by releasing the mirroring guide screen displayed on the electronic device without repeatedly performing user authentication.

In state 530, if the user of the electronic device does not complete user authentication, the electronic device may continue to operate within state 530. As the electronic device operates within state 530, the electronic device may block the user's access to content stored on the electronic device. In state 530, the user of the external electronic device may identify a message indicating that the electronic device is switched to a locked state through a screen displayed on at least a portion of the display of the external electronic device. For example, a user of an external electronic device may perform a user input requesting transmission of a lock screen displayed on the electronic device through the screen.

In response to identifying the user input, the electronic device and the external electronic device according to an embodiment may switch from state 530 to state 540 . State 540 may correspond to a state in which user authentication is performed by a user of the external electronic device. For example, state 540 may correspond to a state in which a lock screen of the electronic device is transmitted to an external electronic device based on a mirroring function. As the lock screen of the electronic device is transmitted to the external electronic device, in state 540, the external electronic device may display the lock screen of the electronic device on the display of the external electronic device. In this case, the user of the external electronic device may proceed with user authentication by controlling the lock screen. In this case, the electronic device may display another screen overlapping at least a portion of the lock screen so that the lock screen controlled by the user of the external electronic device is not exposed to other users of the electronic device. For example, in state 540, the electronic device may display another screen (eg, a mirroring guide screen) distinct from a lock screen corresponding to the locked state within the locked state.

In state 540, when the user of the electronic device performs a user input for switching from the mirroring guide screen to another screen, the electronic device and the external electronic device may switch from state 540 to state 530. As the electronic device and the external electronic device switch from state 540 to state 530, sharing of the lock screen by state 540 may be stopped. According to an embodiment, the electronic device performs user authentication whenever user authentication by the lock screen fails in order to prevent repeated interruption and resumption of sharing of the lock screen due to repetitive execution of the user input. can be suspended for a specified period of time. The specified time may increase (eg, increase exponentially) according to the number of user authentication failures.

In state 540, when the user of the external electronic device succeeds in user authentication based on the lock screen of the electronic device displayed through the display of the external electronic device, the electronic device and the external electronic device according to an embodiment state ( From 540 to state 520 may be switched. As switching from state 540 to state 520, the electronic device may keep displaying the mirroring guide screen.

For example, in a state after being switched from state 540 to state 520 by user authentication performed by an external electronic device, the electronic device is responsible for identifying a user input for switching from a mirroring guide screen to another screen. In response, it may switch to state 530. For example, if user authentication is successful based on the electronic device at a first time point, the electronic device and the external electronic device at a second time point included in a designated time interval after the first time point and corresponding to state 520. may switch from state 520 to state 550 in response to identifying the user input. For example, if user authentication is successful based on the external electronic device at a first time point, the electronic device and the external electronic device at a second time point included in a designated time interval after the first time point and corresponding to state 520. The device may switch from state 520 to state 530 in response to identifying the user input.

In state 520, the electronic device may receive a user input for switching to a locked state. The user input may include, for example, a gesture of pressing a button included in the electronic device and related to the locked state. In response to receiving the user input, the electronic device according to an embodiment may switch from state 520 to state 540 .

As described above, as the electronic device and the external electronic device according to an embodiment operate based on the state transition diagram 500, user authentication for the electronic device may be selectively performed in the electronic device and/or the external electronic device. can The user authentication is performed by an authorized user using one electronic device among the electronic device and/or the external electronic device through the display of the other electronic device in a state where the electronic device and/or the external electronic device are deployed in different sub-networks. It can be performed to block leakage of content.

Hereinafter, a UI displayed by an electronic device operating based on the state transition diagram 500 of FIG. 5 and an external electronic device will be described with reference to FIGS. 6A to 6B and 7A to 7B.

6A to 6B are diagrams illustrating an example of a user interface (UI) displayed on each electronic device according to an embodiment. The electronic devices of FIGS. 6A to 6B may include the electronic device 101 of FIGS. 1 to 3 and the electronic device 210 of FIGS. 2 to 3 , and/or the source electronic device and remote electronic device of FIG. 4 . there is.

Referring to FIG. 6A , an external electronic device connected to the electronic device 101 (eg, the remote electronic device of FIG. 4 and/or the electronic device 210 of FIGS. 2 and 3 ) is connected to the electronic device 101 based on a mirroring function. ) A screen 610 displayed to control is shown. Within the screen 610, the external electronic device includes information for representing the electronic device 101 (eg, an identifier assigned to a user of the electronic device 101 and/or a type of the electronic device 101), an electronic device ( 101) may display at least a portion of the stored information. For example, in response to receiving a user input of touching and/or clicking the visual object 620 , the external electronic device is stored in the electronic device 101 within the screen 610 and is stored in the electronic device 101 . A list 640 of one or more applications that can be executed by In the example of FIG. 6A , the external electronic device may display identifiers such as icons and names of each of a plurality of applications stored in the electronic device 101 in the list 640 .

Referring to FIG. 6A , within a screen 610, an external electronic device obtains a user input for searching for at least one application among a plurality of applications stored in the electronic device 101 together with a list 640, and obtains a visual input. The object 650 may be displayed. Based on the keyword input in the visual object 650 , the external electronic device may temporarily stop displaying at least one of the plurality of applications in the list 640 . The external electronic device, in response to receiving a user input for selecting an application in the list 640 (eg, a user input for touching and/or clicking an icon included in the list 640), the electronic device 101 ), it is possible to request transmission of screen and audio based on the application selected by the user input. In response to receiving the user input, the external electronic device may obtain a remote application container corresponding to the application. Upon receiving the request, the electronic device 101 may obtain a source application container related to the application while executing the application. Based on the source application container and the remote application container, a mirroring session connecting the electronic device 101 and an external electronic device (eg, connection 220 of FIGS. 2 to 4 ) may be established.

In response to receiving the video signal and the audio signal corresponding to the request, the external electronic device appears by the video signal on at least a portion of the display distinct from the screen 610, provided from the electronic device 101, The screen of the application may be displayed. In response to receiving the audio signal corresponding to the request, the external electronic device may output audio, indicated by the audio signal through a speaker and generated by the application running on the electronic device 101. .

Referring to FIG. 6B , after receiving a user input related to the visual object 630 for requesting the screen of the electronic device 101 within the screen 610, the external electronic device and the screen displayed on the electronic device 101 Fields 660, 670 and 680 are shown. The screens 660, 670, and 680 of FIG. 6B may be displayed, for example, based on any one of the states 520 and 550 of FIG. 5 by the electronic device 101 and the external electronic device, respectively. there is. The electronic device 101 according to an embodiment, in response to receiving a signal notifying the detection of the user input from the external electronic device, transmits a video signal representing a screen 660 being displayed on the display to the external electronic device. can be sent to Referring to FIG. 6B , a screen 670 displayed on at least a portion of the display in response to the external electronic device receiving the video signal is shown. The screen 670 may include the screen 660 being displayed on the display of the electronic device 101 . Within the screen 670, the external electronic device may further display one or more visual objects for controlling the location of the screen 670 within the display.

For example, as in state 520 of FIG. 5 , the electronic device 101 according to an embodiment displays a screen 680 corresponding to a mirroring guide screen in a state of providing the screen 660 to an external electronic device. can be displayed In the screen 680, in order to reduce burn-in caused by deterioration of the display of the electronic device 101, an area having a designated color such as black may be larger than other areas having other colors. . Referring to FIG. 6B , the electronic device 101 is displayed on a designated part of screens 660 and 680, such as a notification bar 682 (or a status bar), of the electronic device 101. One or more visual objects corresponding to each of the one or more parameters may be displayed. For example, the electronic device 101 is a visual object notifying the type of network to which the electronic device 101 is connected (eg, a wireless network based on a communication protocol such as LTE, NR, and/or WiFi), such as an icon 690 can be displayed.

The electronic device 101 according to an embodiment may be configured according to the type of network connected to the electronic device 101 and/or the number of sub-networks related to the connection between the electronic device 101 and an external electronic device, as indicated by an icon 690. Based on this, a screen to be displayed may be changed in response to a user input performed to stop displaying the screen 680 . The user input may include, for example, a swipe gesture performed within the screen 680 and/or a gesture of pressing a designated button (eg, a power button) of the electronic device 101 . For example, the electronic device 101 and the external electronic device are included in the same sub-network (eg, a state in which an icon 690 and another icon representing WiFi are displayed in the notification bar 682), or , and/or if user authentication based on the electronic device 101 succeeds prior to receiving the user input, in response to receiving the user input, the electronic device 101 displays a screen 680 displayed on the display. ) may be stopped, and the screen 660 may be displayed.

7A to 7B are diagrams for describing one or more other screens displayed in a state in which the electronic device 101 transmits screens to an external electronic device according to an exemplary embodiment. The electronic device 101 of FIGS. 7A to 7B may include the electronic device 101 of FIGS. 1 to 3 and/or the source electronic device of FIG. 4 . The external electronic device of FIGS. 7A to 7B may include the electronic device 210 of FIGS. 2 to 3 and/or the remote electronic device of FIG. 4 .

Referring to FIG. 7A , while an external electronic device displays a screen 670 based on a video signal received from the electronic device 101 according to an embodiment, a screen displayed on the display by the electronic device 101 Fields 660, 680, 710, and 720 are shown. For example, in state 520 of FIG. 5 , the electronic device 101 displays the screen 680 while maintaining the display of the screen 670 on the external electronic device as a video signal is transmitted to the external electronic device. can be displayed In a state where the screen 680 is displayed in the display of the electronic device 101, when the user of the electronic device 101 performs a user input to stop displaying the screen 680, the electronic device 101 displays the screens One screen among (710, 720, 660) can be displayed.

For example, when the state of the electronic device 101 is switched from state 520 in FIG. 5 to state 530 in response to receiving the user input, the electronic device 101 displays screens 710, 720), one screen may be displayed. For example, the screen 710 displayed by the electronic device 101 may include a message for guiding user authentication based on the lock screen as the electronic device 101 is switched to a locked state. The electronic device 101 may display a visual object (eg, a button 715) for switching to the screen 720 corresponding to the lock screen within the screen 710.

Referring to FIG. 7A , in response to identifying a user input of clicking and/or touching a button 715 within a screen 710, the electronic device 101 may display a screen 720. The screen 720 is a lock screen displayed in a locked state, and includes one or more visual objects requesting input of information matching pre-registered information by the user, such as a PIN and/or password, for example. can do. The embodiment is not limited thereto, and for example, the screen 720 may include a message requesting input of biometric information such as a fingerprint and/or an iris using a sensor distinct from a display.

The electronic device 101 according to an embodiment, in response to identifying that user authentication based on the screen 720 is completed, for example, in state 530 of FIG. 5 , is a screen transmitted to an external electronic device. (660) can be displayed. The screen 660 may be displayed on the display of the electronic device 101, for example, as the electronic device 101 is switched from the state 530 of FIG. 5 to the state 550. The screen 660 may be displayed on the display of the electronic device 101, for example, as the electronic device 101 is switched to an unlocked state. The screen 660 displayed by the electronic device 101 and the screen 670 displayed by the external electronic device may include matched content as the electronic device 101 and the external electronic device execute a mirroring function.

In a state in which the screen 660 is displayed, when a user input is not received for a specified time, the electronic device 101 may switch from the state 550 of FIG. 5 to the state 520, for example. As the state 550 of FIG. 5 is switched to the state 520, the electronic device 101 may display the screen 680. While the electronic device 101 switches the screen being displayed on the display from the screen 660 to the screen 680, based on the video signal transmitted by the electronic device 101 to the external electronic device, the external electronic device Displaying the screen 670 may be maintained. In one embodiment, after displaying the screen 660 as the user authentication based on the screen 720 is completed, and then as the user input is not performed for a specified time, after the screen 680 is displayed, the electronic device ( In step 101 , the screen 660 may be displayed by bypassing user authentication based on the screens 710 and 720 in response to a user input performed on the screen 680 . The electronic device 101 bypasses user authentication based on the screens 710 and 720 and displays the screen 660, for example, for a specified time after user authentication based on the screen 720 is completed. It can be done within intervals. Within the specified time interval, the electronic device 101 may block switching to the locked state and/or maintain the unlocked state.

For example, if user authentication based on the screen 720 fails, the electronic device 101 according to an embodiment may switch the screen displayed on the display from the screen 720 to the screen 710. there is. While switching from the screen 720 to the screen 710, the electronic device 101 may stop displaying a visual object that causes the display of the screen 720, such as a button 715, for a specified time. The designated time may increase in proportion to a time for switching from the screen 720 to the screen 710 while the electronic device 101 maintains a locked state.

The electronic device 101 according to an embodiment may display the screen 710 again when user authentication is not completed for a specified time after displaying the screen 720 . While displaying the screen 710 again, the electronic device 101 may stop displaying the button 715 for switching to the screen 720. The designated time may be related to a time during which the electronic device 101 maintains activation of the display after the user input is stopped. For example, the designated time may be a time obtained by applying a designated ratio (eg, 2/3) to the time during which the electronic device 101 maintains display activation.

As described above, in order to display the screen 660 based on whether a user accessing the electronic device 101 is an authorized user, the electronic device 101 according to an embodiment switches to a locked state to allow the user to access the electronic device 101. A screen 720 for authentication may be displayed. After user authentication based on the screen 720 succeeds, the electronic device 101 can display the screen 660 provided to the external electronic device based on the mirroring function on the display of the electronic device 101 . Before user authentication succeeds, the electronic device 101 may prevent leakage of the screen 660 by an unauthorized user accessing the electronic device 101 using the screens 680 , 710 , and 720 .

Referring to FIG. 7A , screens 660 , 680 , and 710 may correspond to screens displayed by the electronic device 101 in an unlocked state. The screen 720 may correspond to a screen displayed by the electronic device 101 in a locked state. For example, the electronic device 101 displays the screens 680 and 710, among a plurality of areas (or layers) related to the display area of the display, one or more areas for capturing a screen to be streamed to an external electronic device. It can be rendered in a designated area (eg, presentation window area) distinct from As the screens 680 and 710 are rendered in the designated area, the screens 680 and 710 may be displayed on the display of the electronic device 101 independently of the screen 660 to be transmitted to the external electronic device. there is. As the screens 680 and 710 are displayed on the display of the electronic device 101 independently of the screen 660 to be transmitted to the external electronic device, an unauthorized user may view the screen 660 through the display of the electronic device 101. reading can be prevented.

Referring to FIG. 7B , while the electronic device 101 displays any one of the screens 660, 680, 710, and 720 of FIG. 7A, a screen displayed on the display by an external electronic device according to an embodiment. Fields 670, 730 and 740 are shown. For example, the screen 670 may correspond to a screen streamed from the electronic device 101 and may be displayed by the external electronic device in one of the states 520 and 550 of FIG. 5 .

In a state of displaying the screen 720 as the electronic device 101 switches to the locked state (eg, state 530 of FIG. 5), as the screen 720 is streamed to the external electronic device, the screen 720 In order to prevent leakage of the based user input, the electronic device 101 may at least temporarily suspend the execution of the mirroring function related to the external electronic device. The external electronic device according to an embodiment may display the screen 730 on at least a portion of the display in response to identifying that execution of the mirroring function is stopped as the electronic device 101 switches to a locked state. The screen 730 may be displayed, for example, by an external electronic device in state 530 of FIG. 5 . The external electronic device may display a visual object (eg, a button 735) for requesting a screen (eg, the screen 720) displayed by the electronic device 101 in a locked state within the screen 730. there is.

Referring to FIG. 7B , in response to identifying a user input of clicking and/or touching a button 735 within a screen 730 , the external electronic device may display a screen 740 . For example, the external electronic device may acquire a lock screen displayed on the electronic device 101 based on the mirroring function and display a screen 740 corresponding to the acquired lock screen. Displaying the screen 740 by the external electronic device may cause, for example, a transition from state 530 to state 540 in FIG. 5 . In this case, while the electronic device 101 initiates streaming of a lock screen such as the screen 720, another screen (eg, screen 710 and/or Alternatively, the screen 680) may be displayed. For example, in each of states 530 and 540 of FIG. 5 , a lock screen related to the electronic device 101 may be selectively displayed on one of the electronic device 101 and the external electronic device. As the lock screen is selectively displayed on one of the electronic device 101 and the external electronic device, leakage of information input by the user can be minimized during user authentication based on the lock screen.

Referring to FIG. 7B , as the user of the external electronic device completes user authentication based on a screen 740, the external electronic device displays a screen 670 based on an application running on the electronic device 101. can resume For example, as the user of the external electronic device completes user authentication based on the screen 740, the electronic device 101 and the external electronic device may switch from the state 540 of FIG. 5 to the state 520. there is. If the user of the external electronic device fails user authentication based on the screen 740, the external electronic device may stop displaying the screen 740 and display the screen 730. After stopping the display of the screen 740 and displaying the screen 730, the external electronic device may stop displaying the button 735 causing switching to the screen 740 for a specified period of time. The designated time may increase in proportion to the number of times that user authentication based on the screen 740 fails while the electronic device 101 maintains a locked state.

As described above, the lock screen (eg, the screens 720 and 740) for user authentication responds to a user input for selecting one of the buttons 715 and 735, and the electronic device 101 and the external It can be selectively displayed among electronic devices. As the lock screen is exclusively displayed through one of the electronic device 101 and the external electronic device, the lock screen may be prevented from being displayed on both the electronic device 101 and the external electronic device based on the mirroring function.

8 is a flowchart illustrating an operation performed in a state in which an electronic device transmits a screen to an external electronic device according to an exemplary embodiment. The electronic device of FIG. 8 may include the electronic device 101 of FIGS. 1 to 3 and/or the source electronic device of FIG. 4 . The external electronic device of FIG. 8 may include the electronic device 210 of FIGS. 2 to 3 and/or the remote electronic device of FIG. 4 . The operation of FIG. 8 may be performed by, for example, the electronic device 101 of FIG. 3 and/or the processor 312 of FIG. 3 .

Referring to FIG. 8 , in operation 805, the electronic device according to an embodiment may start providing a first screen of the electronic device to an external electronic device. The first screen may include, for example, the screen 660 of FIGS. 6B and/or 7A to 7B. The first screen may be streamed from the electronic device to the external electronic device based on a mirroring session established between the electronic device and the external electronic device.

Referring to FIG. 8 , in operation 810, the electronic device according to an embodiment displays a second screen distinct from the first screen on the display of the electronic device while providing the first screen to the external electronic device. can do. The second screen is a mirroring guide screen, and may include, for example, the screen 680 of FIGS. 6B and/or 7A to 7B. While displaying the second screen, the electronic device may determine whether a first input for switching from the second screen to the first screen is received based on operation 815 . If the first input is not received (815-No), the electronic device may maintain displaying the second screen based on operation 810.

In response to receiving the first input (815-yes), in operation 820, the electronic device according to an embodiment determines whether or not the external electronic device is accessible based on the network address assigned to the external electronic device. can judge The network address is a network address allocated from a relay node (eg, the AP 260 of FIGS. 2A and 2B ) of the external electronic device and may correspond to a network address of an external electronic device based on a sub-network. Operation 820 may be performed as the electronic device and the external electronic device execute each of the source connection manager 410 and the remote connection manager 415 of FIG. 4 .

If the electronic device fails to access the external electronic device based on the network address assigned to the external electronic device (820-No), in operation 825, the electronic device according to an embodiment independently of the external electronic device Based on the second input provided to , it may be determined whether there is a history of switching the electronic device from the lock state. For example, before receiving the first input, the electronic device may determine whether user authentication has succeeded in the electronic device. The history of switching from the locked state may indicate a history of switching the electronic device from the locked state to the unlocked state when user authentication is successful in the electronic device.

Referring to FIG. 8 , when an external electronic device is accessed based on a network address assigned to the external electronic device (820-yes), or when a history of switching the electronic device from a locked state exists (825-yes), In operation 830, the electronic device according to an embodiment may switch from the second screen to the first screen. For example, if user authentication is successful in the electronic device before receiving the first input, the electronic device may switch from the second screen to the first screen based on operation 830 .

When the history of switching the electronic device from the locked state does not exist (825-No), in operation 835, the electronic device according to an embodiment may switch to the locked state. Upon switching to the locked state, in operation 840, the electronic device according to an embodiment may stop providing the first screen of operation 805 to the external electronic device. Stopping the provision of the first screen may include an operation of at least temporarily stopping streaming of the screen between the electronic device and the external electronic device. As the provision of the first screen is stopped, the external electronic device may display a screen (eg, the screen 730 of FIG. 7B ) that is distinguished from the first screen and indicates that the provision of the first screen is stopped. Stopping the provision of the first screen of operation 840 may be performed based on communication between the source container manager 410 and the remote container manager 415 of FIG. 4 , for example.

Referring to FIG. 8 , in operation 845, the electronic device according to an embodiment may display a third screen corresponding to a locked state on the display of the electronic device. The third screen is a lock screen requiring user authentication, and may include, for example, the screen 720 of FIG. 7A. The display of the third screen may be performed, for example, based on the content protection manager 440 executed in the electronic device. As the operation of displaying the third screen of operation 845 is performed after the provision of the first screen of operation 840 is stopped, the third screen of operation 845 is an electronic device among external electronic devices and electronic devices. can be displayed in

Referring to FIG. 8 , in operation 850, the electronic device according to an embodiment may determine whether the external electronic device has requested mirroring and/or transmission of a third screen corresponding to a locked state. For example, an external electronic device receiving a user input related to the button 735 of FIG. 7B may request transmission of the third screen to the electronic device. Before the external electronic device requests transmission of the third screen (850 - No), the electronic device may display the third screen on the electronic device among the external electronic device and the electronic device.

When the external electronic device requests transmission of the third screen (850-Yes), in operation 855, the electronic device according to an embodiment may transmit the third screen to the external electronic device. In a state of transmitting the third screen to the external electronic device based on operation 855, the electronic device may stop displaying the third screen on the display of the electronic device based on operation 845. For example, operation 845 may correspond to a state in which a third screen corresponding to a locked state is displayed on an electronic device among electronic devices and external electronic devices. For example, operation 855 may correspond to a state in which an external electronic device among electronic devices and external electronic devices displays a third screen corresponding to a locked state.

While a third screen corresponding to the locked state is displayed on one of the electronic device and the external electronic device by one of operations 845 and 855, in operation 860, the electronic device performs user authentication based on the third screen. You can judge whether this was successful or not. For example, the electronic device may use the content protection manager 440 of FIG. 4 to identify whether user authentication by the third screen is completed. If user authentication fails (860 - No), the electronic device may keep displaying the third screen on the electronic device or an external electronic device.

If user authentication based on the third screen is successful (860-Yes), in operation 865, the electronic device according to an embodiment may switch to another state different from the locked state (eg, unlocked state). Upon switching to another state different from the lock state, in operation 870, the electronic device according to an embodiment may resume providing the first screen to the external electronic device. Based on operation 845, if user authentication is successful while the third screen is displayed on the electronic device, the electronic device provides the first screen to the external electronic device and simultaneously displays the first screen on the display of the electronic device. can be displayed. In this case, the first screen may be displayed on both the electronic device and the external electronic device. Based on operation 855, if user authentication is successful while the third screen is displayed on the external electronic device, the electronic device provides the first screen to the external electronic device and simultaneously displays the first screen on the display of the electronic device. Another screen distinguished from the screen (eg, the second screen of operation 810) may be displayed.

9 is a flowchart illustrating an operation performed based on a network type between an electronic device and another electronic device in a state in which an electronic device transmits a screen to a first external electronic device according to an embodiment. The electronic device of FIG. 9 may include the electronic device 101 of FIGS. 1 to 3 and/or the source electronic device of FIG. 4 . The first external electronic device of FIG. 9 may include the electronic device 210 of FIGS. 2 to 3 and/or the remote electronic device of FIG. 4 . The operation of FIG. 9 may be performed by, for example, the electronic device 101 of FIG. 3 and/or the processor 312 of FIG. 3 .

Referring to FIG. 9 , in operation 910, the electronic device according to an embodiment may display a second screen distinct from the first screen in a state in which the first screen is provided to the first external electronic device. . For example, as the electronic device and the first external electronic device execute a mirroring function, a first screen generated by the electronic device may be transmitted to the first external electronic device. The second screen may include, for example, a mirroring guide screen provided based on the mirroring guide screen manager 430 of FIG. 4 . The electronic device may provide the first screen to the first external electronic device by transmitting a video signal corresponding to the first screen through a mirroring session between the electronic device and the first external electronic device.

Referring to FIG. 9 , in operation 920, the electronic device according to an embodiment uses a second external electronic device to provide a first screen of the electronic device to the first external electronic device. You can identify the network address assigned to the device. The network address may be obtained from, for example, the server 230 of FIGS. 2A to 2B. The network address may indicate a location of the first external electronic device within a sub-network distinguished by a relay node connected to the first external electronic device.

Referring to FIG. 9 , in operation 930, the electronic device according to an embodiment may determine whether the first external electronic device is accessible based on the network address identified in operation 920. For example, the electronic device may access the first external electronic device by creating a TCP/IP socket based on the network address. For example, the electronic device may search for one or more nodes included in a sub-network of the electronic device based on the network address and identify a first external electronic device among the nodes. Accessing the first external electronic device based on the network address identified in operation 920 may mean that the electronic device and the first external electronic device exist in the same sub-network within the network. Failing to access the first external electronic device based on the network address identified in operation 920 may mean that the electronic device and the first external electronic device exist in different sub-networks within the network.

In a state in which the first external electronic device is accessed based on the network address identified in operation 920 (930-Yes), in operation 940, the electronic device according to an embodiment displays the first screen in the second screen. In response to receiving the first input for switching to , it is possible to switch from the second screen to the first screen. For example, accessing the first external electronic device based on the network address identified in operation 920 means that the electronic device and the first external electronic device exist within the same sub-network within the network, so that the electronic device It may mean that the device and the first external electronic device are relatively close. In this case, the electronic device may bypass user authentication and switch from the second screen to the first screen.

In a state in which the first external electronic device is not accessed based on the network address identified in operation 920 (930-No), in operation 950, the electronic device according to an embodiment performs a STUN server and/or TURN The first external electronic device may be accessed using a third external electronic device corresponding to the server (eg, the server 240 of FIGS. 2A and 2B ). Failure to access the first external electronic device based on the network address identified in operation 920 means that the electronic device and the first external electronic device exist in different sub-networks within the network, and thus the electronic device and the first external electronic device exist in different sub-networks. This may mean that the first external electronic device is relatively far away. In this case, in order to access the first external electronic device, the electronic device is a third external electronic device that is distinct from the second external electronic device, and signals to the first external electronic device (eg, a video displaying the first screen). signal) may be requested to be transmitted.

In a state in which the first external electronic device is accessed using the third external electronic device in operation 950, in operation 960, the electronic device according to an embodiment performs a method for switching from a second screen to a first screen. In response to receiving the first input, a third screen corresponding to the locked state may be displayed. The third screen, as a lock screen, may include the screen 720 of FIG. 7A. As the third screen is displayed, the electronic device may display the first screen on condition that user authentication is successful.

As described above, the electronic device according to an embodiment may access the first external electronic device as the mirroring function is executed. The electronic device may establish a connection traversing one or more sub-networks with the first external electronic device by using the second external electronic device and/or the third external electronic device. In a state in which a connection traversing one or more sub-networks is established, the electronic device views a shared screen based on a mirroring function based on the proximity between the electronic device and the first external electronic device detected by the connection. It is possible to determine whether or not to bypass user authentication for a user to do so.

10 is a flowchart illustrating an operation performed by an electronic device in a state of receiving a screen of an external electronic device according to an exemplary embodiment. The electronic device of FIG. 10 may include the electronic device 210 of FIGS. 2 to 3 and/or the remote electronic device of FIG. 4 . The external electronic device of FIG. 10 may include the electronic device 101 of FIGS. 1 to 3 and/or the source electronic device of FIG. 4 . The operation of FIG. 10 may be performed by, for example, the electronic device 210 of FIG. 3 and/or the processor 314 of FIG. 3 .

Referring to FIG. 10 , in operation 1010, the electronic device according to an embodiment may display a first screen provided from an external electronic device on the display. For example, the external electronic device may transmit a signal indicating a screen of an application being executed on the external electronic device to the electronic device by performing operation 910 of FIG. 9 . In response to receiving the signal, the electronic device may display a screen based on the received signal on the display. The first screen of operation 1010 may include a screen displayed by the signal.

Referring to FIG. 10 , in operation 1015, the electronic device according to an embodiment may determine whether a first input designated for switching the state of the external electronic device to the locked state is received. The first input may include a designated input provided by a user of the electronic device. For example, the user of the electronic device may perform a first input for switching the state of the external electronic device to a locked state.

In response to receiving a designated first input for switching the state of the external electronic device to the locked state (1015-yes), in operation 1020, the electronic device according to an embodiment places the external electronic device in the locked state. You can request a conversion. After requesting the external electronic device to switch to the locked state, in operation 1025, the electronic device according to an embodiment may display a third screen provided from the external electronic device and based on the locked state. The third screen may correspond to a lock screen for performing user authentication by an external electronic device. The third screen may include, for example, the screen 740 of FIG. 7B.

Prior to receiving a designated first input for switching the state of the external electronic device to the locked state (1015-No), in operation 1030, the electronic device according to an embodiment switches the external electronic device to the locked state. It is possible to determine whether or not a notification indicating that it has been received is received. For example, the external electronic device is in a locked state based on an operation of switching from state 520 to state 530 in FIG. 5 , operation 835 in FIG. 8 and/or operation 960 in FIG. 9 . can switch The external electronic device may notify the electronic device that it is switched to the locked state.

Before receiving the first input (1015-No) and before receiving a notification indicating that the external electronic device is switched to a locked state (1030-No), the electronic device, based on operation 1010, 1 It is possible to keep displaying the screen in the display. In response to receiving a notification indicating that the external electronic device has switched to a locked state (1030-yes), in operation 1035, the electronic device according to an embodiment displays the first screen of operation 1010. can be stopped For example, as the external electronic device switches to a locked state, providing the first screen of operation 1010 to the electronic device may be stopped. As the provision of the first screen from the external electronic device is stopped, the electronic device may stop displaying the first screen.

In a state in which the display of the first screen is stopped, in operation 1040, the electronic device according to an embodiment may display a second screen indicating that the external electronic device is in a locked state. The second screen may include, for example, the screen 730 of FIG. 7B. Referring to FIG. 10 , in operation 1045, the electronic device according to an embodiment may determine whether a designated second input for releasing the locked state is received within the second screen. The second input may include, for example, an operation of selecting a button 735 included in the screen 730 of FIG. 7B.

Before receiving the designated second input (1045 - No), in operation 1050, the electronic device according to an embodiment may determine whether the lock state of the external electronic device is released. Before receiving the designated second input (1045-No) and before the lock state of the external electronic device is released (1050-No), the electronic device stops displaying the second screen based on operation 1040. can keep

In a state in which it is identified that the lock state of the external electronic device is released (1050 - Yes), the electronic device according to an embodiment may resume displaying the first screen on the display based on operation 1010. For example, in a state in which the second screen is displayed, as user authentication is completed in the external electronic device, the locked state of the external electronic device may be released. As the external electronic device is switched from the locked state to the unlocked state, the external electronic device may resume providing the first screen to the electronic device.

In a state in which the designated second input is received (1045-yes), in operation 1055, the electronic device according to an embodiment records a history of switching the state of the external electronic device from the locked state to another state by the electronic device. You can determine whether it exists or not. For example, the electronic device may identify a history of switching the state of the external electronic device to the unlocked state based on information input through the screen 740 of FIG. 7B .

When the electronic device does not have a history of switching the state of the external electronic device from the lock state to another state (1055-No), the electronic device according to an embodiment displays a third screen based on operation 1025. can do. For example, the third screen may include the screen 740 of FIG. 7B. After displaying the third screen, sharing of the first screen between the electronic device and the external electronic device may be resumed based on a result of user authentication based on the third screen. If there is a history of switching the state of the external electronic device from the locked state to another state by the electronic device (1055-Yes), in operation 1060, the electronic device according to an embodiment locks the external electronic device to the external electronic device. Resumption of provision of the first screen may be requested based on another state distinguished from the state. For example, the electronic device may perform operation 1060 similar to operation 1010 .

As described above, an electronic device according to an embodiment may establish a connection for transmitting a screen based on one or more applications running on the electronic device to another electronic device. The connection may be established across one or more sub-networks as an end-to-end connection between an electronic device and another electronic device. As the connection is established across a plurality of sub-networks, in a state where the electronic device and other electronic devices are relatively far apart, the electronic device according to an embodiment covers a screen shared by other electronic devices. A different screen may be displayed and/or a screen shared with other electronic devices may be displayed on condition of user authentication.

As described above, an electronic device according to an embodiment includes a display, communication circuitry, a memory configured to store a plurality of instructions, and a processor operatively coupled with the display, the communication circuitry, and the memory. and, when executing the plurality of instructions, the processor accesses a first external electronic device distinct from the electronic device along a network connected by the communication circuit to obtain a first external electronic device related to an application executed in the electronic device. A first input for displaying a second screen distinct from the first screen on the display while providing the first screen, and switching from the second screen to the first screen while displaying the second screen. and, in response to receiving the first input, provided from a second external electronic device that is different from the first external electronic device within the network, the first external electronic device within the network It is identified whether the first external electronic device is accessed using the location, and in response to receiving the first input in a first state in which the first external electronic device is accessed using the location, the first external electronic device is accessed. Switching from the second screen to the first screen, and in a second state distinct from the first state, in response to receiving the first input, from the second screen, distinguished from the first screen, the It is possible to switch to a third screen requesting a second input distinct from the first input.

For example, when executing the plurality of instructions, the processor, in response to switching to the third screen, changes the state of the electronic device to at least one of a plurality of functions available in the electronic device. It can switch to a locked state that restricts the execution of other functions except for the designated functions.

For example, the processor, when executing the plurality of instructions, obtains the second input for identifying whether a user who provided the first input corresponds to a specified user, based on the third screen. and, based on the second input, in response to identifying that the user corresponds to the designated user, switching to another state distinct from the locked state.

For example, when executing the plurality of instructions, the processor at least temporarily suspends providing the first screen to the first external electronic device in response to switching to the third screen. at least temporarily).

For example, when executing the plurality of instructions, the processor may request the first external electronic device to display a fourth screen indicating that the third screen is displayed on the electronic device.

For example, the processor, when executing the plurality of instructions, in response to identifying the first external electronic device through another network distinct from the network, in the second state, the third screen and It is possible to switch to the first screen among the first screens.

For example, the processor, when executing the plurality of instructions, in response to receiving the first input in the second state, prior to receiving the first input, the state of the electronic device is: Identifying a time point at which a transition is made from a locked state in which execution of other functions other than one or more designated functions among all of the plurality of functions available in the electronic device is restricted to another state distinct from the locked state, and the identified time point and in response to identifying that the difference between the time points at which the first input is received is less than a specified threshold, stopping switching to the third screen and switching from the second screen to the first screen.

For example, when executing the plurality of instructions, the processor may, in response to receiving the first input in the second state, perform authentication related to a designated user in the electronic device at a first time point and the A first external electronic device identifies a second time point in which authentication related to the designated user has been performed, and stops switching to the third screen in response to identifying that the first time point is after the second time point, It is possible to switch from the second screen to the first screen.

For example, the first state is a state of directly accessing the first external electronic device based on an IP address provided from the second external electronic device and allocated to the first external electronic device. can respond to

For example, the second state is based on an address different from an IP address assigned to the first external electronic device by using a third external electronic device distinct from the second external electronic device. 1 may correspond to a state of accessing an external electronic device.

As described above, an electronic device according to an embodiment includes a display, communication circuitry, a memory configured to store a plurality of instructions, and a processor operatively coupled with the display, the communication circuitry, and the memory. and, when executing the plurality of instructions, the processor, while displaying a first screen based on one or more applications being executed in the electronic device, to another electronic device through the communication circuit, on the display. displaying a second screen distinct from the first screen, receiving a first input for switching to the first screen in a state in which the second screen is displayed, and displaying a first network in the first part of the display. In response to receiving the first input in a state of displaying a first visual object indicating communication with the other electronic device through, switching from the second screen to the first screen, and in the first part In response to receiving the first input in a state of displaying a second visual object indicating communication with the other electronic device through a second network distinct from the first network, from the second screen, the first It is possible to switch to a third screen that is distinct from the screen and requests a second input that is distinct from the first input.

For example, the processor, when executing the plurality of instructions, after switching to the third screen, displays another screen distinct from the third screen, at least based on a result of authenticating the user of the electronic device. can switch

For example, when executing the plurality of instructions, the processor, in response to switching to the third screen, changes the state of the electronic device to at least one of a plurality of functions available in the electronic device. It can switch to a locked state that restricts the execution of other functions except for the designated functions.

For example, the state of communicating with the other electronic device through the first network may include a state of being connected to an access point to which the other electronic device is connected.

For example, in response to receiving the first input while displaying the second visual object, a first time point in which authentication related to a designated user is performed in the electronic device and the designated user in the other electronic device. identifying a second time point at which relevant authentication was performed, and in response to identifying that the first time point is later than the second time point, stopping switching to the third screen from the second screen to the first screen can be switched to

As described above, the method of an electronic device according to an embodiment includes accessing a first external electronic device distinct from the electronic device along a network connected by a communication circuit of the electronic device, and an application running in the electronic device. An operation of displaying a second screen distinct from the first screen on the display of the electronic device while providing a first screen related to, while displaying the second screen, from the second screen to the first screen An operation of receiving a first input for switching to , in response to receiving the first input, provided from a second external electronic device distinct from the first external electronic device within the network, the first external electronic device Identifying whether or not the first external electronic device is accessed using the location of the electronic device and the network, and in a first state in which the first external electronic device is accessed using the location, the first input In response to receiving the operation of switching from the second screen to the first screen, and in response to receiving the first input in a second state distinct from the first state, from the second screen , Switching to a third screen that is distinct from the first screen and requests a second input that is distinct from the first input.

For example, the operation of switching to the third screen changes the state of the electronic device to a locked state in which execution of other functions except for one or more designated functions among all of a plurality of functions available in the electronic device is restricted. A switching operation may be further included.

For example, the operation of switching to the third screen may include, based on the third screen, obtaining the second input for identifying whether a user who provided the first input corresponds to a designated user; and switching to another state distinct from the locked state in response to identifying that the user corresponds to the designated user based on the second input.

For example, the operation of switching to the third screen may further include an operation of at least temporarily stopping providing the first screen to the first external electronic device in response to switching to the third screen. can

For example, the method of the electronic device may include, in response to receiving the first input in the second state, prior to receiving the first input, the state of the electronic device is used in the electronic device. An operation of identifying a time point of transition from a locked state in which execution of other functions other than one or more designated functions among all of a plurality of possible functions is restricted to another state distinct from the locked state, and the identified time point and the second function The method may further include stopping switching to the third screen and switching from the second screen to the first screen in response to identifying that the difference between the times at which input 1 is received is less than a specified threshold.

As described above, in the method of an electronic device according to an embodiment, a first screen based on one or more applications being executed in the electronic device is transferred to another electronic device through a communication circuit of the electronic device. While displaying, displaying a second screen distinct from the first screen on the display of the electronic device, receiving a first input for switching to the first screen while displaying the second screen. In response to receiving the first input while displaying a first visual object representing communication with the other electronic device through a first network on the first part of the display, The operation of switching to a first screen and receiving the first input in a state in which a second visual object representing communication with the other electronic device is displayed on the first part through a second network distinct from the first network In response to doing so, it may include an operation of switching from the second screen to a third screen that is distinct from the first screen and requests a second input that is distinct from the first input.

The devices described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in the embodiments include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable PLU (programmable logic unit). logic unit), microprocessor, or any other device capable of executing and responding to instructions. The processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. You can command the device. The software and/or data may be embodied in any tangible machine, component, physical device, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. there is. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. In this case, the medium may continuously store a program executable by a computer or temporarily store the program for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or combined hardware, but is not limited to a medium directly connected to a certain computer system, and may be distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROM and DVD, magneto-optical media such as floptical disks, and ROM, RAM, flash memory, etc. configured to store program instructions. In addition, examples of other media include recording media or storage media managed by an app store that distributes applications, a site that supplies or distributes various other software, and a server.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (20)

In an electronic device,
display;
communication circuit;
a memory configured to store a plurality of instructions; and
a processor operatively coupled with the display, the communication circuitry, and the memory, wherein the processor, when executing the plurality of instructions:
While accessing a first external electronic device distinct from the electronic device along a network connected by the communication circuit and providing a first screen related to an application running on the electronic device, the first screen and the first screen are displayed on the display. display a distinct second screen;
receiving a first input for switching from the second screen to the first screen while displaying the second screen;
In response to receiving the first input, provided from a second external electronic device different from the first external electronic device within the network, using a location of the first external electronic device within the network identify whether the first external electronic device is accessed;
In a first state in which the first external electronic device is accessed using the location, switching from the second screen to the first screen in response to receiving the first input; and
In a second state distinct from the first state, requesting a second input distinct from the first screen and distinct from the first input from the second screen in response to receiving the first input. An electronic device that switches to a third screen. According to claim 1,
The processor, when executing the plurality of instructions,
In response to switching to the third screen, the electronic device switches a state of the electronic device to a locked state in which execution of other functions except for one or more designated functions among all of a plurality of functions available in the electronic device is restricted. Device. According to claim 2,
The processor, when executing the plurality of instructions,
based on the third screen, obtain the second input for identifying whether a user who provided the first input corresponds to a designated user; and
An electronic device that switches to another state distinct from the locked state in response to identifying that the user corresponds to the designated user based on the second input. According to claim 1,
The processor, when executing the plurality of instructions,
In response to switching to the third screen, the electronic device at least temporarily suspends providing the first screen to the first external electronic device. According to claim 4,
The processor, when executing the plurality of instructions,
An electronic device requesting display of a fourth screen indicating that the third screen is displayed on the electronic device, by the first external electronic device. According to claim 1,
The processor, when executing the plurality of instructions,
An electronic device that switches to the first screen among the third screen and the first screen in the second state in response to identifying the first external electronic device through another network distinct from the network. According to claim 1,
The processor, when executing the plurality of instructions,
In response to receiving the first input in the second state, prior to receiving the first input, a state of the electronic device determines one or more designated functions among all of a plurality of functions available in the electronic device. Identifying a time point of transition from a locked state that restricts the execution of other functions except for the locked state to another state distinct from the locked state;
In response to identifying that the difference between the identified time point and the time point at which the first input is received is less than a specified threshold, stopping switching to the third screen and switching from the second screen to the first screen Device. According to claim 1,
The processor, when executing the plurality of instructions,
In response to receiving the first input in the second state, a first point in time when authentication related to the specified user is performed in the electronic device and a second point in time when authentication related to the specified user is performed in the first external electronic device. identify a point in time; and
In response to identifying that the first time point is after the second time point, the electronic device stops switching to the third screen and switches from the second screen to the first screen. According to claim 1,
The first state,
Corresponding to a state of directly accessing the first external electronic device based on an IP address provided from the second external electronic device and allocated to the first external electronic device. According to claim 9,
The second state,
Corresponds to a state of accessing the first external electronic device by using a third external electronic device distinct from the second external electronic device, based on an address different from the IP address assigned to the first external electronic device to do, electronic devices. In an electronic device,
display;
communication circuit;
a memory configured to store a plurality of instructions;
a processor operatively coupled with the display, the communication circuitry, and the memory, wherein the processor, when executing the plurality of instructions:
displaying a second screen distinct from the first screen on the display to another electronic device through the communication circuit while displaying a first screen based on one or more applications running on the electronic device;
receiving a first input for switching to the first screen while the second screen is displayed;
In response to receiving the first input while displaying a first visual object representing communication with the other electronic device through a first network on the first portion of the display, the first screen from the second screen switch to; and
In response to receiving the first input in a state in which a second visual object representing communication with the other electronic device is displayed on the first portion through a second network distinct from the first network, the second screen , switching to a third screen that is distinct from the first screen and requests a second input that is distinct from the first input. According to claim 11,
The processor, when executing the plurality of instructions,
After switching to the third screen, the electronic device switches to another screen distinct from the third screen, based at least on a result of authenticating the user of the electronic device. According to claim 11,
The processor, when executing the plurality of instructions,
In response to switching to the third screen, the electronic device switches a state of the electronic device to a locked state in which execution of other functions except for one or more designated functions among all of a plurality of functions available in the electronic device is restricted. Device. According to claim 11,
The state of communicating with the other electronic device through the first network includes a state of being connected to an access point to which the other electronic device is connected. According to claim 11,
In response to receiving the first input while displaying the second visual object, a first point in time when authentication related to the specified user is performed in the electronic device and authentication related to the specified user is performed in the other electronic device identify a second time point; and
In response to identifying that the first time point is after the second time point, the electronic device stops switching to the third screen and switches from the second screen to the first screen. In the method of electronic device,
While accessing a first external electronic device distinct from the electronic device along a network connected by a communication circuit of the electronic device and providing a first screen related to an application running on the electronic device, on the display of the electronic device displaying a second screen distinct from the first screen on the screen;
receiving a first input for switching from the second screen to the first screen while displaying the second screen;
In response to receiving the first input, it is provided from a second external electronic device that is different from the first external electronic device within the network, and uses the location of the first external electronic device and the network identifying whether or not the first external electronic device has been accessed;
switching from the second screen to the first screen in response to receiving the first input in a first state in which the first external electronic device is accessed using the location; and
In a second state distinct from the first state, requesting a second input distinct from the first screen and distinct from the first input from the second screen in response to receiving the first input. A method comprising switching to a third screen. According to claim 16,
The operation of switching to the third screen,
and switching the state of the electronic device to a locked state that restricts execution of other functions except for one or more designated functions among all of a plurality of functions available in the electronic device. According to claim 17,
The operation of switching to the third screen,
obtaining the second input for identifying whether the user who provided the first input corresponds to a designated user, based on the third screen; and
and switching to another state distinct from the locked state in response to identifying that the user corresponds to the designated user based on the second input. According to claim 17,
The operation of switching to the third screen,
In response to switching to the third screen, at least temporarily stopping providing the first screen to the first external electronic device. According to claim 16,
In response to receiving the first input in the second state, prior to receiving the first input, a state of the electronic device is determined by one or more of all of a plurality of functions available in the electronic device. identifying a time point at which a transition is made from a locked state in which execution of functions other than the functions are restricted to another state distinct from the locked state; and
Stopping switching to the third screen and switching from the second screen to the first screen in response to identifying that the difference between the identified time point and the time point at which the first input is received is less than a specified threshold How to include more.

Images