KR20230049932A - Method for providing continuous user interface between electronic devices in multi-device usage environment and electronic device therefor - Google Patents

Abstract

According to various embodiments, disclosed are a method and device for providing a continuous user interface between a plurality of electronic devices in a multi-device usage environment. An electronic device according to various embodiments includes a communication module, a display, and a processor. The processor may detect the proximity of an external electronic device through the communication module; connect to the external electronic device through designated communication based on detecting the proximity to the external electronic device; share operation information with the external electronic device based on the connection with the external electronic device; distribute tasks for the electronic device and the external electronic device based on the operation information; and control the electronic device and the external electronic device to change and execute a corresponding function based on task distribution and to provide a user interface corresponding to the function change. Various embodiments are possible. Accordingly, the efficiency and convenience of the work of a user can be improved.

Description

A method for providing a continuous user interface between electronic devices in a multi-device use environment and an electronic device therefor

Embodiments of the present disclosure disclose a method for providing a continuous user interface between a plurality of electronic devices in a multi-device use environment and an electronic device therefor.

With the development of digital technology, mobile communication terminals, PDAs (personal digital assistants), electronic notebooks, smart phones, tablet PCs (personal computers), wearable devices and / or laptops Various types of electronic devices such as personal computers are widely used. In order to support and increase functions of these electronic devices, hardware parts and/or software parts of electronic devices are continuously being developed.

Meanwhile, a user may consume various media and perform productivity tasks by utilizing one or more electronic devices. For example, a user may use a dual screen by connecting two electronic devices wired or wirelessly, or perform multitasking by performing different tasks using different electronic devices.

For example, in utilizing a plurality of electronic devices, a second electronic device may be utilized as a second display for expanding information displayed through a first display in a first electronic device. For example, while using a smart phone, a user uses a desktop computer, a laptop computer, and/or a tablet PC as a second display for display expansion. Alternatively, an input method not supported by the first electronic device (eg, a digitizer, a pen, or a touch interface) may be utilized through the second electronic device. For example, while using a desktop computer or laptop that does not support touch or digitizer, a tablet PC can be used as a touch or digitizer input method.

In various embodiments, a method and apparatus for intuitively identifying a plurality of electronic devices connected to each other in a multi-device use environment and providing a user interface having continuity between the plurality of electronic devices connected to each other are disclosed.

In various embodiments, when a plurality of electronic devices are connected in close proximity to each other, a function operating method for continuously using a user interface between connected electronic devices while providing a visual effect that wireless communication is being performed between the connected electronic devices, and Indicate about the device.

In various embodiments, in a state in which a first electronic device executes a first function and a second electronic device executes a second function, when the first electronic device and the second electronic device are closely connected, the first electronic device Disclosed is a method and apparatus for visually providing a state of wireless communication between an electronic device and a second electronic device, changing a first function and a second function into a third function and a fourth function, respectively.

An electronic device according to an embodiment of the present disclosure includes a communication module, a display, and a processor operatively connected to the communication module and the display, wherein the processor detects proximity of an external electronic device through the communication module. and based on detecting proximity with the external electronic device, connect with the external electronic device through designated communication, share operation information with the external electronic device based on the connection with the external electronic device, and share the operation information Based on the task distribution for the electronic device and the external electronic device, and based on the task distribution, the electronic device and the external electronic device change to a corresponding function and execute it, and create a user interface corresponding to the function change. can be controlled to provide.

An operation method of an electronic device according to an embodiment of the present disclosure includes an operation of detecting proximity of an external electronic device through a communication module of the electronic device, and based on sensing proximity of the external electronic device, the external electronic device. Connecting with the external electronic device through designated communication, sharing operation information with the external electronic device based on the connection with the external electronic device, and distributing tasks for the electronic device and the external electronic device based on the operation information The electronic device and the external electronic device may change and execute a function corresponding to the function based on the operation and task distribution, and control the function to provide a user interface corresponding to the function change.

In various embodiments of the present disclosure to solve the above problems, a computer-readable recording medium in which a program for executing the method in a processor may be included.

Additional scope of applicability of the present disclosure will become apparent from the detailed description that follows. However, since various changes and modifications within the spirit and scope of the present disclosure may be clearly understood by those skilled in the art, it should be understood that the detailed description and specific embodiments such as the preferred embodiments of the present disclosure are given by way of example only.

According to the electronic device and its operating method according to the present disclosure, in a multi-device use environment, a plurality of electronic devices connected to each other can be intuitively identified and a user interface having continuity between the plurality of electronic devices connected to each other can be provided. According to various embodiments, in a multi-device use environment using a plurality of personalized electronic devices, it is possible to improve efficiency and convenience of using multiple devices by providing a continuous user interface between electronic devices. For example, in a user's multi-device use environment, the user's work efficiency and convenience may be improved.

According to various embodiments, a connection state and/or a synchronization state between electronic devices is visually provided so that a user can intuitively identify the connection state of electronic devices and electronic devices connected to each other in a multi-device environment. .

According to various embodiments, an effect of manipulating the electronic devices connected to each other together (or approximately simultaneously) is provided by manipulating any one of the electronic devices connected to each other, and additional additional electronic devices by connection between the electronic devices are provided. By providing convenience in using functions, it is possible to improve the efficiency and convenience of a user's work.

In addition to this, various effects identified directly or indirectly through this document may be provided.

In the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.
1 is a block diagram of an electronic device in a network environment according to various embodiments.
2, 3, and 4 are diagrams illustrating examples of utilization between a plurality of electronic devices according to various embodiments.
5 is a diagram illustrating an operating method between a plurality of electronic devices according to various embodiments.
6 is a detailed diagram illustrating an operating method between a plurality of electronic devices according to various embodiments.
7 is a flowchart illustrating a method of operating an electronic device according to various embodiments.
8 is a flowchart illustrating in detail an operating method of an electronic device according to various embodiments.
9 and 10 are diagrams illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.
11 is a diagram illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.
12 and 13 are diagrams illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.
14 and 15 are diagrams illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.
16 is a diagram illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.
17, 18, and 19 are diagrams illustrating examples of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.
20, 21, and 22 are diagrams illustrating examples of providing an interface based on interactions between a plurality of electronic devices according to various embodiments.
23, 24, and 25 are diagrams illustrating examples of providing an interface based on an interaction between a plurality of electronic devices according to various embodiments.
26, 27, and 28 are diagrams illustrating examples of providing an interface based on interactions between a plurality of electronic devices according to various embodiments.

1 is a block diagram of an electronic device 101 within a network environment 100 according to various embodiments.

Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to an embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit (CPU) or an application processor (AP)) or a secondary processor (which may be operated independently of or together with the main processor 121). 123) (e.g., graphic processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor hub processor, or communication processor (CP, communication processor)). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 may At least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or At least some of the functions or states related to the communication module 190) may be controlled. According to one embodiment, the auxiliary processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of other functionally related components (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130, and may include, for example, an operating system (OS) 142, middleware 144, or an application 146. there is.

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, a : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunications network such as a LAN or wide area network (WAN)). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (eMBB, mobile broadband), minimization of terminal power and access of multiple terminals (mMTC, massive machine type communications), or high-reliability and low-latency (URLLC, ultra-reliable and low-latency communications) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO, full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 may be used to realize peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency (for realizing URLLC). Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a bottom surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish that component from other corresponding components, and may refer to that component in other respects (eg, importance or order) is not limited. A (eg, first) component is said to be "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the operations performed by a module, program or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order. may be added, omitted, or one or more other actions may be added.

2, 3, and 4 are diagrams illustrating examples of utilization between a plurality of electronic devices according to various embodiments.

Referring to FIG. 2 , FIG. 2 shows an electronic device 101 (eg, the electronic device 101 of FIG. 1 ) and an external electronic device 201 (eg, the electronic device 102 of FIG. 1 ) through designated communication. As a state prior to connection, for example, an example of a state in which the electronic device 101 and the external electronic device 201 are separated by a specified distance threshold value may be indicated. As illustrated in FIG. 2 , the electronic device 101 and the external electronic device 201 may individually operate, and may be in a state of displaying a corresponding interface based on a user's use state. In the example of FIG. 2 , the electronic device 101 may display the first user interface 210 and the external electronic device 201 may display the second user interface 220 .

In the above state, the electronic device 101 and the external electronic device 201 may come close to each other. For example, the electronic device 101 may detect whether or not it is close to the external electronic device 201 using a communication module (eg, the communication module 190 of FIG. 1 ). According to an embodiment, when the electronic device 101 and the external electronic device 201 are within a specified distance threshold (eg, about 5 cm, about 10 cm, or about 30 cm), the electronic device 101 and the external electronic device 201 ) can be judged to be close. For example, the electronic device 101 may detect proximity using short-range wireless communication such as ultra wide band (UWB), Bluetooth, and low energy Bluetooth. According to an embodiment, when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they can connect to each other through specified communication (eg, short-range wireless communication).

Referring to FIG. 3 , when the electronic device 101 and the external electronic device 201 are connected, a connection between the electronic device 101 and the external electronic device 201 may be visually displayed and provided to the user. According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, through the display of the electronic device 101 and the external electronic device 201, a designated guide interface indicating a connection state is displayed approximately simultaneously. can operate to provide For example, the electronic device 101 includes a first theme (eg, color theme, interface color, or background color) corresponding to the first user interface 210 of the electronic device 101 and the external electronic device 201. It may operate to provide a second theme corresponding to the second user interface 220 as the same or similar theme.

For example, the electronic device 101 extracts a representative color from an execution screen (eg, an application execution screen or a home screen) (eg, the first user interface 210) currently being executed on the electronic device 101, and extracts the representative color. Information (eg, color information) related to the selected representative color may be transmitted to the connected external electronic device 201 . In one embodiment, an operation of extracting a representative color may correspond to a known technology, and detailed description may be omitted. According to an embodiment, the electronic device 101 instructs to change the second theme for the second user interface 220 of the external electronic device 201 based on color information related to the representative color and the corresponding color information. Commands can be sent. The external electronic device 201 may receive color information from the connected electronic device 101 and change the second theme of the second user interface 220 of the external electronic device 201 based on the received color information. .

For example, in the example of FIG. 2 , the electronic device 101 is in a state of displaying the first user interface 210 (eg, a yellow interface) with a first color (eg, yellow) as a representative color, and the external The electronic device 201 may be in a state of displaying the second user interface 220 (eg, a gray interface) with a second color (eg, gray) as a representative color. When connected to the external electronic device 201, the electronic device 101 may extract a representative color (eg, a first color) and provide related color information to the external electronic device 201. In the example of FIG. 3 , when the electronic device 101 and the external electronic device 201 are closely connected to each other, the electronic device 101 maintains the display of the yellow first user interface 210 and the external electronic device 201 may change the second user interface 220 of gray color to the second user interface 320 of yellow color (eg, change the interface color) according to the received color information and provide it.

For example, the external electronic device 201 applies a representative color related to the electronic device 101 to at least some elements being displayed through the display of the external electronic device 201, so that the external electronic device 201 is the electronic device (101) can be provided in real time. In this way, when the electronic device 101 and the external electronic device 201 are connected to each other, through the user interfaces 210 and 320 of the same or similar color, the user between the electronic device 101 and the external electronic device 201 By providing uniformity to the interface, the user can visually and intuitively recognize a state in which the electronic device 101 and the external electronic device 201 are connected.

Referring to FIG. 4 , in a state in which the electronic device 101 and the external electronic device 201 are connected, another external electronic device 301 is close to the electronic device 101 and is different from the electronic device 101. An example of a state in which external electronic devices 301 are connected to each other may be shown. As illustrated in FIG. 4 , in a state in which the electronic device 101 and the external electronic device 201 are connected, the electronic device 101 is different from the electronic device 101 when another external electronic device 301 is additionally connected. Through the external electronic device 301, a designated guide interface indicating a connection state may be provided at approximately the same time. For example, while the other external electronic device 301 displays the third user interface 230 (eg, a pink interface) with a third color (eg, pink) as a representative color, the electronic device 101 can be connected in close proximity to

When connected to another external electronic device 301, the electronic device 101 may extract a representative color (eg, a first color) and provide related color information to the other external electronic device 301. In the example of FIG. 4 , when the electronic device 101 and another external electronic device 301 are closely connected to each other, the electronic device 101 maintains the display of the yellow first user interface 210 and the other external electronic device 301 maintains the display. The electronic device 301 may change the pink third user interface 230 to the yellow third user interface 430 according to the received color information (eg, interface color change) and provide the same. For example, the other external electronic device 301 applies a representative color related to the electronic device 101 to at least some elements being displayed through the display of the other external electronic device 301 to display the other external electronic device 301. is connected to the electronic device 101 may be provided in real time.

Therefore, the electronic device 101, the external electronic device 201 connected to the electronic device 101, and the other external electronic device 301 connected to the electronic device 101 display user interfaces 210, 320, 430), uniformity is provided for the user interfaces 210, 320, and 420 between the electronic device 101, the external electronic device 201, and other external electronic devices 301, so that the user can use the electronic device 101, It is possible to visually and intuitively recognize that the external electronic device 201 and the other external electronic device 301 are both connected to the electronic device 101 and are operating.

Referring to the example of FIG. 4 and looking at another example, the electronic device 101 and the external electronic device 201 are disconnected, another external electronic device 301 is close to the external electronic device 201, and the other The external electronic device 301 and the external electronic device 201 may be connected to each other. When the connection between the electronic device 101 and the external electronic device 301 is disconnected, the electronic device 101 maintains the display of the first user interface 210 in yellow color, and the external electronic device 201 displays a previously set second user interface. It can be changed to the second user interface 220 of 2 themes (eg, a gray interface). In addition, when another external electronic device 301 and the external electronic device 201 are closely connected to each other while the electronic device 101 and the external electronic device 201 are disconnected, the other external electronic device 301 maintains the display of the pink third user interface 230, and the external electronic device 201 displays the gray second user interface 220 according to the color information received from the other external electronic device 301. , It may be provided by changing to a pink second user interface (not shown) (eg, changing interface color).

According to various embodiments, a designated guide interface for indicating a communication connection state between the electronic device 101 and the external electronic device 201 may be provided based on color, as illustrated in FIGS. 3 and 4 . In an embodiment of the present disclosure, an example of a color-based designated guide interface is only for helping understanding of the invention, and does not limit the embodiment of the present disclosure. For example, the designated guide interface sends a designated indicator object (eg, an icon and/or text) to a designated area (eg, a status bar area of the electronic device 101 and/or a status bar area of the external electronic device 201). can be provided through For another example, the designated guide interface may be provided through floating on the displays of the electronic device 101 and the external electronic device 201 . For example, a designated guide interface can be implemented using various graphical affordances.

According to various embodiments, as in the example of FIG. 3 or 4 , when a plurality of electronic devices are connected to each other, the plurality of electronic devices provide different functions and different interfaces based on task distribution (or collaboration). can operate to provide For example, when the electronic device 101 connects to the external electronic device 201 while executing a first function, the electronic device 101 determines that the external electronic device 201 performs a second function related to (or identical to) the first function. Whether or not the function is being executed can be determined through mutual communication. The first function of the electronic device 101 and the second function of the external electronic device 201 are based on the fact that the electronic device 101 simultaneously executes functions related to the electronic device 101 and the external electronic device 201. It can be changed in association with each other and operate to provide a related interface.

According to an embodiment, a user uses a first function (eg, calendar application execution) using the electronic device 101 and simultaneously uses a second function (eg, calendar application) using the external electronic device 201 . While being used (or in parallel), the electronic device 101 and the external electronic device 201 may be located within a certain distance and connected to each other. When the electronic device 101 and the external electronic device 201 are connected to each other, as in the above example, it is visually displayed that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating (e.g., a theme). or change the background screen, provide a floating icon).

According to an embodiment, a simultaneous mode execution for simultaneous use of the electronic device 101 and the external electronic device 201 may be determined based on a connection between the electronic device 101 and the external electronic device 201. . The electronic device 101 and the external electronic device 201 change the first function of the electronic device 101 to the third function and the second function of the external electronic device 201 based on the decision to execute the concurrent mode. It may operate to change the function into a fourth function and provide it.

The electronic device 101 and the external electronic device 201 may change and provide a user interface related to the changed function in response to a function change. For example, when changing the first function to the third function, the electronic device 101 may change the first user interface of the first function to a third user interface of the third function. For example, when changing the second function to the fourth function, the external electronic device 201 may change the second user interface of the second function to the fourth user interface of the fourth function. In one embodiment, the first function, the second function, the third function, and the fourth function may be mutually related functions provided by the same or similar applications.

In one embodiment, the user interface may mean a screen displayed on the display of the electronic device 101 and the external electronic device 201 (eg, the display module 160 of FIG. 1 ) or an execution screen of an application. For example, when an application is executed on the electronic device 101, an execution screen of the application may be provided as a user interface. For another example, when the first function is executed through an application in the electronic device 101, an execution screen of the first function may be provided as a user interface. For another example, when the electronic device 101 executes a second function different from the first function through an application, an execution screen of the second function may be provided as a user interface.

According to an embodiment, when the electronic device 101 and the external electronic device 201 do not have the same application, they may operate to execute the simultaneous mode by another application that can be replaced. For example, when the electronic device 101 executes the first application but the external electronic device 201 does not have the first application, the external electronic device 201 may search whether there is an application that can replace the first application. there is. The external electronic device 201 may search for a second application corresponding to the first application and execute the searched second application. For example, the second application is another application of the same or similar type as the first application, and may refer to an application capable of interworking with the first application.

The electronic device 101 according to an embodiment of the present disclosure includes a communication module (eg, the communication module 190 of FIG. 1 ), a display (eg, the display module 160 of FIG. 1 ), and the communication module and the and a processor operatively connected to the display (eg, the processor 120 of FIG. 1 ), wherein the processor detects the proximity of the external electronic device 201 through the communication module and determines the proximity of the external electronic device 201 . Based on the detection, a connection is established with the external electronic device through designated communication, based on the connection with the external electronic device, operation information is shared with the external electronic device, and based on the operation information, the electronic device and the external electronic device are connected. It is possible to distribute jobs for electronic devices, and based on the job distribution, change and execute corresponding functions between the electronic device and the external electronic device, and provide a user interface corresponding to the function change.

According to an embodiment, the processor may operate to provide a designated guide interface for guiding proximity to the external electronic device based on sensing proximity to the external electronic device.

According to an embodiment, the operation information indicates information for determining whether to execute a concurrent mode based on mutual availability between the electronic device and the external electronic device, and the electronic device and the external electronic device simultaneously run an application at the same time. Application information, application use information, network information, and/or display information for identifying whether the electronic device and the external electronic device are connected to the same network and/or used, and/or the currently displayed screen state. can include

According to an embodiment, the processor may control the electronic device and the external electronic device to provide different functions and different interfaces related to the designated application by a designated application.

According to an embodiment, the processor generates control information for function and/or user interface control based on the operation information, and provides a function execution and user interface for the electronic device based on the control information. and transmits the control information to the external electronic device through the communication module, and controls the external electronic device to execute a corresponding function and provide a user interface based on the control information.

According to an embodiment, when the electronic device and the external electronic device are connected, the processor determines that the electronic device and the external electronic device are connected to each other through a display of the electronic device and the external electronic device. It is configured to provide a visual guide interface for guiding, and the visual guide interface may be provided based on a designated graphical affordance.

According to an embodiment, the processor applies a representative color related to the electronic device to at least some elements being displayed on the display of the external electronic device, so that the user interface between the electronic device and the external electronic device is unified. can operate to provide

According to an embodiment, when the electronic device and the external electronic device are connected, the processor determines whether to execute a simultaneous mode for simultaneous use of the electronic device and the external electronic device based on the operation information; Based on determining the concurrent mode of execution, it may act to perform task distribution.

According to an embodiment, the processor changes a first function to a third function in the electronic device based on the determination of the simultaneous mode execution, and in response to the function change, the first function of the first function Operate to change the user interface to a third user interface of the third function, and based on determining the concurrent mode execution, the external electronic device changes the second function to a fourth function and responds to the function change Accordingly, the external electronic device may be controlled to change the second user interface of the second function to a fourth user interface of the fourth function and provide the fourth user interface.

According to an embodiment, the processor obtains first operation information of the electronic device and second operation information of the external electronic device based on a connection between the electronic device and the external electronic device, and the first operation information and the second operation information, based on a result of comparing the operation information, determining whether a specified condition for concurrent mode execution is satisfied, and based on determining that the specified condition is satisfied, and to determine the concurrent mode of execution.

According to an embodiment, the processor triggers a concurrent mode based on a user input input to execute a concurrent mode for simultaneous use of the electronic device and the external electronic device while performing a specified operation, , based on the simultaneous mode trigger, through a designated communication, to search for an external electronic device that is closer to the electronic device by a specified distance threshold or less, wherein the electronic device and the external electronic device are grouped into a user account. They may be account-based devices.

Hereinafter, an operating method of the electronic device 101 according to various embodiments will be described in detail. According to an embodiment, operations performed by the electronic device 101 described below include various processing circuitry and/or executable program elements of the electronic device 101. may be executed by the processor 120 . According to an embodiment, operations performed by the electronic device 101 may be executed by instructions stored in the memory 130 and causing the processor 120 to operate when executed.

5 is a diagram illustrating an operating method between a plurality of electronic devices according to various embodiments.

According to one embodiment, in the example of FIG. 5 , it is shown that the external electronic device 201 that is close to the electronic device 101 is one, but this is only to help understanding of the present invention and limits the embodiment of the present disclosure. It is not. For example, in FIG. 5 , an external electronic device 201 proximate to the electronic device 101 may include a plurality of external electronic devices, and the electronic device 101 may include each of the plurality of external electronic devices, FIG. The operations disclosed in can be performed.

Referring to FIG. 5 , in operation 501, the electronic device 101 may detect proximity to the external electronic device 201. For example, the electronic device 101 may detect proximity to the external electronic device 201 using designated communication (eg, short-range wireless communication such as UWB, Bluetooth, and/or Bluetooth Low Energy).

In operation 503, the external electronic device 201 may detect the proximity of the electronic device 101. For example, the external electronic device 201 may detect proximity of the electronic device 101 using designated communication (eg, short-range wireless communication such as UWB, Bluetooth, and/or Bluetooth Low Energy).

In one embodiment, operation 501 or operation 503 may be performed concurrently, operation 501 may be performed first and operation 503 may be performed later, or operation 503 may be performed first and operation 501 may be performed later. The above description is only for helping understanding of the invention, and the embodiments of the present disclosure are not limited by the description.

In operation 505, when the distance between the electronic device 101 and the external electronic device 201 is equal to or less than a specified distance threshold, they may be connected using specified communication. In one embodiment, the distance threshold may mean a distance close enough to connect and use the electronic device 101 and the external electronic device 201 . The distance threshold may be set by the user or the electronic device 101 .

According to various embodiments, when the electronic device 101 and the external electronic device 201 are connected to each other, the connection between the electronic device 101 and the external electronic device 201 is displayed as a visual guide interface to inform the user. can provide According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, the electronic device 101 operates to provide a designated guide interface indicating a connection state through a display of the electronic device 101 and the external electronic device 201. can do. For example, the electronic device 101 includes a first theme (eg, color theme, interface color, or background color) corresponding to the user interface of the electronic device 101 and a user interface corresponding to the external electronic device 201. It may operate to provide the second theme as the same or similar theme.

According to an embodiment, the electronic device 101 includes color information related to the first theme and a command for instructing to change the second theme for the user interface of the external electronic device 201 based on the corresponding color information. can transmit. The external electronic device 201 may receive color information from the connected electronic device 101 and change the theme (eg, color) of the user interface of the external electronic device 201 based on the received color information. According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected, the designated guide interface is temporarily or continuously for a designated time (eg, about 5 seconds, about 10 seconds, or always). can be provided as

In operation 507, the electronic device 101 may share operation information with the external electronic device 201. For example, the electronic device 101 may transmit operation information of the electronic device 101 to the external electronic device 201 . According to an embodiment, the electronic device 101 may receive operation information of the external electronic device 201 from the external electronic device 201 . In one embodiment, operation information may include application information, application usage information, network information, and/or display information. For example, the operation information may include whether the electronic device 101 and the external electronic device 201 are simultaneously using the same/similar application at the same time (eg, the current time), the electronic device 101 and the external electronic device 201 ) may include information for identifying whether the same network (eg, a Wi-Fi access point (AP)) is connected to and being used, and/or a currently displayed screen state.

In one embodiment, the application information may include an identifier, name, or property for identifying the application (eg, type of application such as media playback, image editing, document editing, gallery, calendar, or game). In one embodiment, the display information may include a function provided (or executed) by an application and/or processing information related to a screen currently being displayed according to a function (eg, screen data processed according to function execution). there is.

In operation 509, the electronic device 101 may control the user interface based on the operation information. The user interface may indicate an interface related to displaying a function execution screen or an application execution screen displayed on the display of the electronic device 101 and the external electronic device 201 (eg, the display module 160 of FIG. 1 ).

According to an embodiment, the electronic device 101 may operate to provide different interfaces for the electronic device 101 and the external electronic device 201 based on operation information. According to an embodiment, the electronic device 101 may generate control information for user interface control based on motion information. In one embodiment, the control information may include screen information (eg, display data) related to a provided interface and/or execution control information (eg, information for controlling execution of an application or function).

For example, taking a case where an application executed on the electronic device 101 is a note application, the electronic device 101 interfaces a writing field or palette for writing notes to the external electronic device 201. It is possible to provide related control information to provide as. For another example, the electronic device 101 may provide related control information so that the external electronic device 201 provides a note list as an interface. For another example, the electronic device 101 may provide related control information so that the external electronic device 201 provides a display field for displaying a note written in the electronic device 101 as an interface.

In operation 509, the electronic device 101 may transmit control information to the external electronic device 201. According to an embodiment, the electronic device 101 transmits control information for interface control of the external electronic device 201 using a designated communication module (eg, the communication module 190 of FIG. 1 ) to the external electronic device ( 201), the external electronic device 201 can be controlled to provide an interface based on the control information.

In operation 513, the electronic device 101 may provide a user interface for the electronic device 101 based on the control information. For example, the electronic device 101 may provide a related user interface through a display (eg, the display module 160 of FIG. 1 ) of the electronic device 101 based on the control information. For example, the electronic device 101 may change the first user interface to a third user interface related to the application based on the control information in a state in which the first user interface related to the application is displayed, and provide the same.

In operation 515, the external electronic device 201 may provide a user interface for the external electronic device 201 based on the control information. According to an embodiment, the external electronic device 201 may receive control information from the electronic device 101 and provide a related user interface based on the control information. For example, the external electronic device 201 provides a related user interface through a display (eg, the display module 160 of FIG. 1 ) of the external electronic device 201 based on control information of the electronic device 101 . can do. For example, the external electronic device 201 may change the second user interface to a fourth user interface related to the application based on control information in a state in which the second user interface related to the application is displayed, and provide the second user interface.

According to an embodiment, the first interface, the second interface, the third interface, and the fourth interface may be different from each other.

According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, based on operation information, whether to execute a simultaneous mode for simultaneous use of the electronic device 101 and the external electronic device 201 is executed. can decide The electronic device 101 changes the first function of the electronic device 101 to the third function based on determining the simultaneous mode execution with the external electronic device 201, and the second function of the external electronic device 201 It is possible to change the function to the fourth function and, in response to the function change, change and provide a related user interface.

For example, the electronic device 101 may change a first function to a third function and change a first user interface of the first function to a third user interface of the third function based on the control information. For example, the external electronic device 201 may change the second function to the fourth function based on the control information, and change the second user interface of the second function to the fourth user interface of the fourth function. In one embodiment, the first function, the second function, the third function, and the fourth function may be mutually related functions provided by the same or similar applications.

According to an embodiment, although the drawing shows that the electronic device 101 controls the interface, according to another embodiment of the present disclosure, the external electronic device 201 operates based on operation information with the electronic device 101. You can also control the interface. The above description is only for helping understanding of the invention, and does not limit the embodiments of the present disclosure.

6 is a detailed diagram illustrating an operating method between a plurality of electronic devices according to various embodiments.

According to one embodiment, in the example of FIG. 6 , it is shown that the external electronic device 201 proximate to the electronic device 101 is one, but this is only to help understanding of the present invention and limits the embodiment of the present disclosure. It is not. For example, in FIG. 6 , the external electronic device 201 proximate to the electronic device 101 may include a plurality of external electronic devices, and the electronic device 101 may include each of the plurality of external electronic devices in FIG. 6 . The operations disclosed in can be performed. In one embodiment, FIG. 6 may show a detailed operation for simultaneous mode execution between the electronic device 101 and the external electronic device 201 as illustrated in FIG. 5 .

Referring to FIG. 6 , in operation 601, the electronic device 101 may provide a first function and a first user interface. For example, the electronic device 101 may be in a state of executing a first function in a first application running on the electronic device 101 and displaying a first user interface related to the first function.

In operation 603, the external electronic device 201 may provide a second function and a second user interface. For example, the external electronic device 201 may be in a state of executing a second function in a second application running in the external electronic device 201 and displaying a second user interface related to the second function. According to an embodiment, the second application may be the same as the first application or another application capable of providing the same or similar functions as the first application.

In operation 605, the electronic device 101 may detect proximity to the external electronic device 201. For example, the electronic device 101 may be in a state of performing a designated operation (eg, operation 601) according to interaction with the user, and during the operation, the electronic device 101 interacts with one or more external electronic devices 201. proximity can be sensed. According to an embodiment, the electronic device 101 may detect proximity to the external electronic device 201 using designated communication (eg, short-range wireless communication such as UWB, Bluetooth, and/or Bluetooth Low Energy). According to an embodiment, proximity detection between the electronic device 101 and the external electronic device 201 may be performed by the external electronic device 201 .

In operation 607, the electronic device 101 may connect with the external electronic device 201. For example, when the distance between the electronic device 101 and the external electronic device 201 is less than or equal to a specified distance threshold, the electronic device 101 and the external electronic device 201 may connect to each other through designated communication. In one embodiment, the distance threshold may mean a distance close enough to connect and use the electronic device 101 and the external electronic device 201 . The distance threshold may be set by the user or the electronic device 101 .

In operation 609, the electronic device 101 may provide a guide interface. For example, when the electronic device 101 is connected to the external electronic device 201, the connection between the electronic device 101 and the external electronic device 201 may be displayed as a visual guide interface and provided to the user. . According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, the electronic device 101 operates to provide a designated guide interface indicating a connection state through a display of the electronic device 101 and the external electronic device 201. can do. For example, the electronic device 101 includes a first theme (eg, color theme, interface color, or background color) corresponding to the user interface of the electronic device 101 and a user interface corresponding to the external electronic device 201. It may operate to provide the second theme as the same or similar theme.

In operation 611, the electronic device 101 may transmit guide information on the guide interface to the external electronic device 201. The guide information may include color information related to the theme of the electronic device 101 and a command for controlling theme change. For example, the electronic device 101 transmits color information related to a first theme and a command instructing to change a second theme for a user interface of the external electronic device 201 based on the corresponding color information to the external electronic device ( 201) can be sent.

According to an embodiment, the electronic device 101 may request operation information related to the external electronic device 201 from the external electronic device 201 based on a connection with the external electronic device 201 . For example, the electronic device 101 may request operation information necessary to determine whether to execute a simultaneous mode with the external electronic device 201 from the external electronic device 201 . According to an embodiment, the request for operation information may be performed as a previously agreed operation between the electronic device 101 and the external electronic device 201 . For example, when connected to the electronic device 101, the external electronic device 201 may use it as a trigger for obtaining and transmitting operation information based on receiving guide information from the electronic device 101. For another example, when the electronic device 101 is connected to the external electronic device 201, guide information and operation information of the electronic device 101 may be provided together, and the external electronic device 201 may provide the electronic device ( Based on receiving motion information from 101), it can be used as a trigger for obtaining and transmitting motion information.

In operation 613, the external electronic device 201 may provide a guide interface. For example, the external electronic device 201 receives guide information from the connected electronic device 101, and based on color information and commands according to the received guide information, the theme of the user interface of the external electronic device 201 (eg, : color) can be changed and provided to the user. For example, the external electronic device 201 may provide a visual guide interface indicating that the external electronic device 201 is connected to the electronic device 101 based on a theme change of the user interface.

In one embodiment, operations 609 and 611 may be performed approximately simultaneously in the electronic device 101 and the external electronic device 201 . According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected, the designated guide interface is temporarily or continuously for a designated time (eg, about 5 seconds, about 10 seconds, or always). can be provided as

In operation 615, the external electronic device 201 may acquire operation information. For example, the external electronic device 201 may perform an operation for obtaining operation information of the external electronic device 201 . For example, the external electronic device 201 may activate a function (or application) and/or hardware component (or module) (eg, camera, sensor module) related to motion information acquisition, and may activate the function and/or hardware Operation information may be obtained through the component. In one embodiment, operation information may include application information, application usage information, network information, and/or display information. For example, the operation information may include whether the electronic device 101 and the external electronic device 201 are simultaneously using the same/similar application at the same time (eg, the current time), the electronic device 101 and the external electronic device 201 ) may indicate information for identifying whether the same network (eg, a Wi-Fi access point (AP)) is connected to and being used, and/or a currently displayed screen state.

In operation 617, the external electronic device 201 may transmit operation information of the external electronic device 201 to the electronic device 101 through designated communication.

In operation 619, the electronic device 101 may analyze the operation information. For example, the electronic device 101 receives operation information from the external electronic device 201 and determines application information, application use information, network information, and/or display information of the external electronic device 201 from the operation information. can do.

In operation 621, the electronic device 101 may determine a specified condition for concurrent mode execution based on a result of analyzing the operation information. In one embodiment, the specified condition is, for example, whether the electronic device 101 and the external electronic device 201 are simultaneously using the same/similar application at the same time (eg, the current time), the electronic device 101 and the external electronic device 201 Conditions such as whether the external electronic device 201 is connected to and using the same network (eg, a Wi-Fi access point (AP)) and/or whether the currently displayed screen state is a synchronized screen state may be included. . According to an embodiment, the electronic device 101 may determine to execute an operation mode with the external electronic device 201 when at least one of specified conditions is satisfied. According to another embodiment, the electronic device 101 may determine to execute an operation mode with the external electronic device 201 when all specified conditions are satisfied.

In operation 623, the electronic device 101 may determine functions for the electronic device 101 and the external electronic device 201. For example, the electronic device 101 determines functions that can be executed in an application of the electronic device 101 when a specified condition is satisfied and the simultaneous mode execution is determined, and the electronic device 101 and the electronic device 101 are connected according to the executable functions. Functions according to task distribution (or cooperation) between the external electronic devices 201 may be determined.

For example, taking a case where an application executed on the electronic device 101 is a note application, the electronic device 101 provides two functions (eg, the electronic device 101) for the note application of the electronic device 101. A third function for the external electronic device 201 and a fourth function for the external electronic device 201) may be distinguished. According to an embodiment, the electronic device 101 may distribute a function of displaying a main screen for a note application on the electronic device 101 as a third function of the electronic device 101 . According to an embodiment, the electronic device 101 provides a writing function (or palette function) for supporting notes provided by the electronic device 101 to be written on the external electronic device 201 for the external electronic device 201. It can be distributed as a fourth function.

In operation 625, the electronic device 101 may generate control information corresponding to the function. According to an embodiment, the electronic device 101 may generate control information for executing functions respectively distributed in the electronic device 101 and the external electronic device 201 and providing a corresponding user interface. there is. For example, the electronic device 101 may generate first control information for a third function related to the electronic device 101 and second control information for a fourth function related to the external electronic device 201. . According to an embodiment, the electronic device 101 generates control information for controlling to provide different functions and different interfaces by the same/similar application between the electronic device 101 and the external electronic device 201, respectively. can According to an embodiment, the electronic device 101 generates respective control information for controlling the respective device to execute the corresponding function in relation to the third function and the fourth function classified for each device 101 or 201. can do.

In operation 627, the electronic device 101 may execute a third function and provide a third user interface corresponding to the execution of the third function. For example, the electronic device 101 executes a third function allocated (or distributed) to the electronic device 101 based on control information related to the electronic device 101, and a third function corresponding to the third function. 3 can provide a user interface. According to an embodiment, the electronic device 101 changes the first function to the third function in a state of providing the first function and the first user interface as in operation 601 prior to execution of the concurrent mode, and responds to the function change. It may operate to display a corresponding third user interface. According to an embodiment, the third function may be the same as or different from the function currently being executed (eg, the first function) of the electronic device 101 .

In operation 629, the electronic device 101 may transmit control information to the external electronic device 201. For example, the electronic device 101 may share control information for controlling the external electronic device 201 to execute a fourth function and provide a fourth user interface with the external electronic device 201 . According to an embodiment, the electronic device 101 controls a function and/or user interface of the external electronic device 201 using a designated communication module (eg, the communication module 190 of FIG. 1 ). Information may be transmitted to the external electronic device 201, and the external electronic device 201 may be controlled to execute a function and provide a user interface based on the control information.

In operation 631, the external electronic device 201 executes a related function (eg, a fourth function) based on the control information and provides a related user interface (eg, a fourth user interface) corresponding to the execution of the related function. can According to an embodiment, the external electronic device 201 executes a fourth function assigned (or distributed) to the external electronic device 201 based on control information received from the electronic device 101, and A fourth user interface corresponding to the function may be provided. According to an embodiment, in operation 603, the external electronic device 201 changes the second function to a fourth function in a state of providing the second function and the second user interface, and provides a second function corresponding to the function change. 4 Can be operated to display a user interface. According to an embodiment, the fourth function may be the same as or different from the function currently being executed (eg, the second function) of the external electronic device 201 .

According to an embodiment, the first interface, the second interface, the third interface, and the fourth interface may be different from each other.

7 is a flowchart illustrating a method of operating an electronic device according to various embodiments.

Referring to FIG. 7 , in operation 701, the processor 120 of the electronic device 101 may detect proximity to the external electronic device 201. The processor 120 may detect proximity to the external electronic device 201 using a communication module (eg, the communication module 190 of FIG. 1 ). For example, the processor 120 may detect proximity to the external electronic device 201 using designated communication (eg, short-range wireless communication such as UWB, Bluetooth, and low energy Bluetooth).

In operation 703, the processor 120 may provide a user interface for guiding proximity to the external electronic device 201. For example, the processor 120 may guide the user by displaying a designated guide interface for guiding that the external electronic device 201 is in proximity through a display (eg, the display module 160 of FIG. 1 ). According to some embodiments, the processor 120 may guide proximity to the external electronic device 201 through vibration or voice. Depending on implementation, operation 703 may be omitted.

In operation 705, the processor 120 may connect with the external electronic device 203. For example, when the distance between the electronic device 101 and the external electronic device 201 is less than or equal to a specified distance threshold, the processor 120 may connect them using specified communication. In one embodiment, the distance threshold may mean a distance close enough to connect and use the electronic device 101 and the external electronic device 201 .

In operation 707, the processor 120 may share operation information with the external electronic device 203. For example, the processor 120 may transmit operation information of the electronic device 101 to the external electronic device 201 . According to an embodiment, the electronic device 101 may receive operation information of the external electronic device 201 from the external electronic device 201 . In one embodiment, operation information may include application information, application usage information, network information, and/or display information. For example, the operation information may include whether the electronic device 101 and the external electronic device 201 are simultaneously using the same/similar application at the same time (eg, the current time), the electronic device 101 and the external electronic device 201 ) may include information for identifying whether the same network (eg, Wi-Fi AP) is connected to and being used, and/or a currently displayed screen state.

In one embodiment, the application information may include an identifier, name, or property for identifying the application (eg, type of application such as media playback, image editing, document editing, gallery, calendar, or game). In one embodiment, the display information may include a function provided (or executed) by an application and/or processing information related to a screen currently being displayed according to a function (eg, screen data processed according to function execution). there is.

In operation 709, the processor 120 may operate to provide a user interface for the electronic device 101 and the external electronic device 201 based on the operation information. In one embodiment, the user interface is an interface related to displaying a function execution screen or an application execution screen displayed on the display of the electronic device 101 and the external electronic device 201 (eg, the display module 160 of FIG. 1 ). can represent

According to an embodiment, the processor 120 may operate to provide different interfaces for the electronic device 101 and the external electronic device 201 based on operation information. According to an embodiment, the processor 120 may generate control information for user interface control based on motion information. In one embodiment, the control information may include screen information (eg, display data) related to a provided interface and/or execution control information (eg, information for controlling execution of an application or function).

According to an embodiment, the processor 120 may provide a user interface for the electronic device 101 based on control information. For example, the processor 120 may provide a related user interface through a display (eg, the display module 160 of FIG. 1 ) of the electronic device 101 based on the control information. For example, the processor 120 may change the first user interface to a third user interface related to the application based on the control information in a state in which the first user interface related to the application is displayed, and provide the changed user interface.

According to an embodiment, the processor 120 may transmit control information to the external electronic device 201 . According to an embodiment, the processor 120 transmits control information for controlling a function and/or a user interface of the external electronic device 201 using a designated communication module (eg, the communication module 190 of FIG. 1 ). By transmitting to the external electronic device 201, the external electronic device 201 can be controlled to provide a related function and/or user interface based on the control information.

According to an embodiment, the external electronic device 201 may provide a user interface for the external electronic device 201 based on control information. According to an embodiment, the external electronic device 201 may receive control information from the electronic device 101 and provide a related user interface based on the control information. For example, the external electronic device 201 provides a related user interface through a display (eg, the display module 160 of FIG. 1 ) of the external electronic device 201 based on control information of the electronic device 101 . can do. For example, the external electronic device 201 may change the second user interface to a fourth user interface related to the application based on control information in a state in which the second user interface related to the application is displayed, and provide the second user interface.

According to an embodiment, the first interface, the second interface, the third interface, and the fourth interface may be different from each other.

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected, the processor 120 performs simultaneous use of the electronic device 101 and the external electronic device 201 based on operation information. You can decide whether to run concurrent mode or not. The processor 120 changes the first function of the electronic device 101 to the third function and the second function of the external electronic device 201 based on the determination of execution mode concurrently with the external electronic device 201. may be changed to a fourth function, and in response to the function change, a related user interface may be changed and provided. For example, the processor 120 may change a first function to a third function based on the control information, and change a first user interface of the first function to a third user interface of the third function. For example, the processor 120 allows the external electronic device 201 to change the second function to a fourth function based on the control information, and convert the second user interface of the second function into a fourth user interface of the fourth function. It can be controlled and provided. In one embodiment, the first function, the second function, the third function, and the fourth function may be mutually related functions provided by the same or similar applications.

According to an embodiment, although the electronic device 101 is shown as controlling a user interface for the electronic device 101 and the external electronic device 201 in the drawing, according to another embodiment of the present disclosure, the external electronic device 201 may control the user interface for the electronic device 101 and the external electronic device 201 as an operation corresponding to the operation of the illustrated electronic device 101 . The above description is only for helping understanding of the invention, and does not limit the embodiments of the present disclosure.

8 is a flowchart illustrating in detail an operating method of an electronic device according to various embodiments.

In one embodiment, FIG. 8 may show a detailed operation for simultaneous mode execution between the electronic device 101 and the external electronic device 201 as illustrated in FIG. 7 .

Referring to FIG. 8 , in operation 801, the processor 120 of the electronic device 101 may provide a first function and a first user interface. For example, the processor 120 may be in a state of executing a first function in a first application running in the electronic device 101 and displaying a first user interface related to the first function.

At operation 803, processor 120 may detect concurrent mode execution. According to an embodiment, the processor 120 may be in a state of performing an operation specified by a user, and input to execute a simultaneous mode for simultaneous use of the electronic device 101 and the external electronic device 201 during the operation. Based on user input, execution of concurrent mode may be triggered. According to some embodiments, operation 803 may be omitted depending on the implementation. For example, the simultaneous mode may be automatically executed according to settings of the electronic device. For example, the electronic device 101 may perform the simultaneous mode automatically or in response to a request from a user or another device. For example, the electronic device 101 may execute the simultaneous mode by itself, or may alternatively or additionally execute the operation mode based on an execution command from a user or another external electronic device. It can work.

In operation 805, the processor 120 may detect proximity to the external electronic device 201. For example, the processor 120 may search for nearby external electronic devices based on the concurrent mode execution. For example, the processor 120 may search for one or more external electronic devices 201 approaching the electronic device 101 through designated communication. According to an embodiment, the processor 120 searches for the external electronic device 201 (or searches for the external electronic device 201) using designated communication (eg, short-range wireless communication such as UWB, Bluetooth, and/or Bluetooth Low Energy). ) can be detected.

According to an embodiment, the processor 120 searches whether a user account-based external electronic device 201 grouped (or logged in) with a user account among various external electronic devices is in close range. can For example, the electronic device 101 and the external electronic device 201 may represent devices based on user accounts grouped by user accounts.

In operation 807, the processor 120 may provide a first guide interface for guiding proximity to the external electronic device 201. For example, the processor 120 may guide the user by displaying a designated guide interface for guiding that the external electronic device 201 is in proximity through a display (eg, the display module 160 of FIG. 1 ). According to some embodiments, the processor 120 may guide proximity to the external electronic device 201 through vibration or voice. Depending on the implementation, operation 807 may be omitted.

In operation 809, the processor 120 may connect with the external electronic device 201. For example, when the distance between the electronic device 101 and the external electronic device 201 approaches a specified distance threshold or less, the processor 120 may connect the external electronic device 201 through designated communication.

In operation 811, the processor 120 may provide a second guide interface for guiding a connection between the electronic device 101 and the external electronic device 201. For example, when the electronic device 101 is connected to the external electronic device 201, the processor 120 displays that the electronic device 101 and the external electronic device 201 are connected to each other through a visual guide interface so that the user can be provided to According to an embodiment, when the processor 120 is connected to the external electronic device 201, the processor 120 provides a designated guide interface indicating a connection state at approximately the same time through the display of the electronic device 101 and the external electronic device 201. can act to do so. For example, the processor 120 may include a first theme (eg, color theme, interface color, or background color) corresponding to the user interface of the electronic device 101 and a second theme corresponding to the user interface of the external electronic device 201 . It can operate to provide 2 themes as the same or similar themes.

In operation 813, the processor 120 may transmit control information (eg, guide information) related to the second guide interface to the external electronic device 201. The control information may include color information related to the theme of the electronic device 101 and a command for controlling theme change. For example, the processor 120 may transmit a command instructing the external electronic device 201 to change a second theme for a user interface of the external electronic device 201 based on color information related to a first theme and the corresponding color information. ) can be transmitted.

According to an embodiment, the processor 120 extracts a representative color from an execution screen (eg, an application execution screen or a home screen) (eg, a first user interface) currently being executed in the electronic device 101, and the extracted representative color. Color-related information (eg, color information) may be transmitted to the connected external electronic device 201 . In one embodiment, an operation of extracting a representative color may correspond to a known technology, and detailed description may be omitted. According to an embodiment, the electronic device 101 transmits color information related to the representative color and a command instructing to change the second theme for the second user interface of the external electronic device 201 based on the corresponding color information. can

The external electronic device 201 receives control information (eg, color information and commands) from the connected electronic device 101, and based on the color information and commands according to the control information, the second user interface of the external electronic device 201 A second theme (eg, interface color) for may be changed and provided to the user.

For example, when the electronic device 101 and the external electronic device 201 are connected to each other, the processor 102 communicates between the electronic device 101 and the external electronic device 201 through a user interface of the same or similar color. By controlling to provide uniformity to the user interface, the user can visually and intuitively recognize a state in which the electronic device 101 and the external electronic device 201 are connected.

According to various embodiments, the second guide interface for indicating a communication connection state between the electronic device 101 and the external electronic device 201 may be provided based on color. In an embodiment of the present disclosure, the example of the color-based second guide interface is only for helping understanding of the invention, and does not limit the embodiment of the present disclosure. For example, the second guide interface may provide a designated indicator object (eg, an icon and/or text) through a designated area (eg, a status bar area and/or a status bar area) or through a floating area. there is. For example, the second guide interface may be implemented using various graphic affordances.

In operation 815, the processor 120 may obtain operation information based on the connection with the external electronic device 203. For example, the processor 120 may collect operation information of the electronic device 101 and operation information of the external electronic device 201 respectively.

According to an embodiment, the processor 120 may perform an operation for obtaining operation information of the electronic device 101 . For example, the processor 120 may activate a function (or application) and/or a hardware component (or module) (eg, a camera, a sensor module) related to motion information acquisition, and the function and/or hardware component Through, it is possible to obtain operation information. According to an embodiment, the processor 120 may request operation information related to the external electronic device 201 from the external electronic device 201 and obtain operation information from the external electronic device 201 .

In one embodiment, operation information may include application information, application usage information, network information, and/or display information. For example, the operation information may include whether the electronic device 101 and the external electronic device 201 are simultaneously using the same/similar application at the same time (eg, the current time), the electronic device 101 and the external electronic device 201 ) may indicate information for identifying whether the same network (eg, a Wi-Fi access point (AP)) is connected to and being used, and/or a currently displayed screen state. For example, the operation information may indicate information necessary to determine whether to execute the concurrent mode based on the interaction between the electronic device 101 and the external electronic device 201 .

At operation 817, the processor 120 may analyze the operation information. For example, the processor 120 uses application information, application use information, and network information of the electronic device 101 and the external electronic device 201 from operation information of the electronic device 101 and operation information of the external electronic device 201 . , and/or display information.

At operation 819, processor 120 may compare operation information. For example, the processor 120 may compare application information, application use information, network information, and/or display information of the electronic device 101 and the external electronic device 201 based on a result of analyzing the operation information. there is.

In operation 821, the processor 120 may determine whether a specified condition for concurrent mode execution is satisfied based on a result of comparing the operation information. In one embodiment, the specified condition is, for example, whether the electronic device 101 and the external electronic device 201 are simultaneously using the same/similar application at the same time (eg, the current time), the electronic device 101 and the external electronic device 201 Conditions such as whether the external electronic device 201 is connected to and using the same network (eg, a Wi-Fi AP) and/or whether the currently displayed screen state is a synchronized screen state may be included. According to an embodiment, the processor 120 may determine to execute an operation mode with the external electronic device 201 when at least one of specified conditions is satisfied. According to another embodiment, the processor 120 may determine to execute an operation mode with the external electronic device 201 when all specified conditions are satisfied.

In operation 821, when it is determined that the specified condition is not satisfied, the processor 120 proceeds to operation 803 to re-perform an operation related to concurrent mode execution. According to some embodiments, the processor 120 provides a user with an interface informing that the simultaneous mode cannot be executed with the external electronic device 201, and performs a corresponding operation based on the user's control command (or user input). can make it do.

In operation 821, when it is determined that the specified condition is satisfied, in operation 823, the processor 120 may determine execution in a concurrent mode.

In operation 825, the processor 120 may distribute functions between the electronic device 101 and the external electronic device 201 based on the determination of concurrent mode execution. For example, the processor 120 may determine functions respectively corresponding to the electronic device 101 and the external electronic device 201 . For example, the processor 120 determines functions that can be executed in an application of the electronic device 101 when a specified condition is satisfied and execution of the concurrent mode is determined, and the electronic device 101 and the external Functions according to task distribution (or collaboration) between the electronic devices 201 may be determined. For example, the processor 120 may include a third function associated with an application running on the electronic device 101 (eg, a function for (or allocated to) the electronic device 101) and a fourth function associated with the running application. Example: functions for the external electronic device 201).

According to an embodiment, taking a case where an application executed on the electronic device 101 is a note application as an example, the processor 120 has two functions (eg, the electronic device 101) for the note application of the electronic device 101. A third function for and a fourth function for the external electronic device 201) may be distinguished. According to an embodiment, the processor 120 may distribute a function of displaying a main screen for a note application on the electronic device 101 as a third function of the electronic device 101 . According to an exemplary embodiment, the processor 120 provides a writing function (or palette function) for the external electronic device 201 to support notes provided from the electronic device 101 to be written in the external electronic device 201 . It can be divided into 4 functions.

In operation 827, the processor 120 may transmit control information for the external electronic device 201 to the external electronic device 201 based on the distributed function. For example, the processor 120 may generate control information corresponding to the distributed function. According to an embodiment, the processor 120 may generate control information for executing functions respectively distributed in the electronic device 101 and the external electronic device 201 and providing a corresponding user interface.

For example, the processor 120 may generate first control information for a third function related to the electronic device 101 and second control information for a fourth function related to the external electronic device 201 . According to an embodiment, the processor 120 may generate control information for controlling to provide different functions and different interfaces between the electronic device 101 and the external electronic device 201 by the same/similar application. there is. According to an embodiment, the processor 120 may generate control information for controlling the respective device to execute the corresponding function in relation to the third function and the fourth function classified for each device 101 or 201. can

In operation 829, the processor 120 may operate to execute a function by interacting with the external electronic device 201 and provide a user interface. According to an embodiment, the processor 120 may execute a third function and provide a third user interface corresponding to the execution of the third function. For example, the processor 120 executes a third function allocated (or distributed) to the electronic device 101 based on control information (eg, first control information) related to the electronic device 101, A third user interface corresponding to the third function may be provided.

According to an embodiment, the electronic device 101 changes the first function to a third function in a state of providing the first function and the first user interface, as in operation 801 prior to execution of the concurrent mode, and responds to the function change. It may operate to display a corresponding third user interface. According to an embodiment, the third function may be the same as or different from the function currently being executed (eg, the first function) of the electronic device 101 .

According to an embodiment, the processor 120 may transmit control information (eg, second control information) to the external electronic device 201 . For example, the processor 120 may share control information (eg, second control information) for controlling the external electronic device 201 to execute a fourth function and provide a fourth user interface with the external electronic device 201 . can According to an embodiment, the processor 120 uses a designated communication module (eg, the communication module 190 of FIG. 1 ) to control the function and/or user interface of the external electronic device 201 and control information. may be transmitted to the external electronic device 201 to control the external electronic device 201 to execute a function and provide a user interface based on control information.

According to an embodiment, the external electronic device 201 receiving control information (eg, second control information) from the electronic device 101 executes a related function (eg, fourth function) based on the control information, and , a related user interface (eg, a fourth user interface) corresponding to the execution of a related function may be provided. According to an embodiment, the external electronic device 201 executes a fourth function assigned (or distributed) to the external electronic device 201 based on control information received from the electronic device 101, and A fourth user interface corresponding to the function may be provided. According to an embodiment, the external electronic device 201 is configured to change the second function to a fourth function and display a fourth user interface corresponding to the function change in a state of providing the second function and the second user interface. It can work. According to an embodiment, the fourth function may be the same as or different from the function currently being executed (eg, the second function) of the external electronic device 201 .

9 and 10 are diagrams illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.

Referring to FIG. 9 , FIG. 9 shows an electronic device 101 (eg, the electronic device 101 of FIG. 1 ) and an external electronic device 201 (eg, the electronic device 102 of FIG. 1 ) through specified communication. As a state prior to connection, for example, an example of a state in which the electronic device 101 and the external electronic device 201 are separated by a specified distance threshold value may be indicated. As illustrated in FIG. 9 , the electronic device 101 and the external electronic device 201 may individually operate, and may be in a state of displaying a corresponding interface based on a user's use state. In the example of FIG. 9 , the electronic device 101 may display the first user interface 910 and the external electronic device 201 may display the second user interface 920 .

In the above state, the electronic device 101 and the external electronic device 201 may come close to each other. For example, the electronic device 101 may detect whether or not it is close to the external electronic device 201 using a communication module (eg, the communication module 190 of FIG. 1 ). According to an embodiment, when the electronic device 101 and the external electronic device 201 are within a specified distance threshold (eg, about 5 cm, about 10 cm, or about 30 cm), the electronic device 101 and the external electronic device 201 ) can be judged to be close. For example, the electronic device 101 may detect proximity using short-range wireless communication such as UWB, Bluetooth, and low energy Bluetooth. According to an embodiment, when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they can connect to each other through specified communication (eg, short-range wireless communication).

Referring to FIG. 10 , when the electronic device 101 and the external electronic device 201 are connected, a connection between the electronic device 101 and the external electronic device 201 may be visually displayed and provided to the user. According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, through the display of the electronic device 101 and the external electronic device 201, a designated guide interface indicating a connection state is displayed approximately simultaneously. can operate to provide For example, the electronic device 101 includes a first theme (eg, color theme, interface color, or background color) corresponding to the first user interface 910 of the electronic device 101 and the external electronic device 201. It may operate to provide a second theme corresponding to the second user interface 920 as the same or similar theme.

For example, the electronic device 101 extracts a representative color from an execution screen (eg, an application execution screen or a home screen) (eg, the first user interface 910) currently being executed on the electronic device 101, and extracts the representative color. Information (eg, color information) related to the selected representative color may be transmitted to the connected external electronic device 201 . In one embodiment, an operation of extracting a representative color may correspond to a known technology, and detailed description may be omitted. According to an embodiment, the electronic device 101 instructs to change the second theme for the second user interface 920 of the external electronic device 201 based on color information related to the representative color and the corresponding color information. command can be sent. The external electronic device 201 may receive color information from the connected electronic device 101 and change the second theme of the second user interface 920 of the external electronic device 201 based on the received color information. .

For example, in the example of FIG. 9 , the electronic device 101 is in a state of displaying the first user interface 910 (eg, a yellow interface) with a first color (eg, yellow) as a representative color, and the external The electronic device 201 may be in a state of displaying the second user interface 920 (eg, a gray interface) with a second color (eg, gray) as a representative color. When connected to the external electronic device 201, the electronic device 101 may extract a representative color (eg, a first color) and provide related color information to the external electronic device 201. In the example of FIG. 10 , when the electronic device 101 and the external electronic device 201 are closely connected to each other, the electronic device 101 maintains the display of the yellow first user interface 910 and the external electronic device In step 201 , the second user interface 920 of gray color may be changed to the second user interface 1020 of yellow color (eg, interface color change) according to the received color information and provided.

For example, the external electronic device 201 applies a representative color related to the electronic device 101 to at least some elements being displayed through the display of the external electronic device 201, so that the external electronic device 201 is the electronic device (101) can be provided in real time. In this way, when the electronic device 101 and the external electronic device 201 are connected to each other, the user interface between the electronic device 101 and the external electronic device 201 is displayed through the user interfaces 910 and 1020 having the same or similar color. By providing uniformity to the interface, the user can visually and intuitively recognize a state in which the electronic device 101 and the external electronic device 201 are connected.

According to various embodiments, a designated guide interface for indicating a communication connection state between the electronic device 101 and the external electronic device 201 may be provided based on color, as illustrated in FIG. 10 . In an embodiment of the present disclosure, an example of a color-based designated guide interface is only for helping understanding of the invention, and does not limit the embodiment of the present disclosure. For example, as illustrated in FIG. 10 , the designated guide interface includes designated indicator objects 1040 and 1050 (eg, icons and/or text) in designated areas (eg, the status bar area of the electronic device 101 and/or Alternatively, it may be provided through the status bar area of the external electronic device 201). For another example, the designated guide interface may be provided through floating on the displays of the electronic device 101 and the external electronic device 201 . For example, a designated guide interface can be implemented using various graphic affordances.

For example, when the electronic device 101 and the external electronic device 201 are connected, the electronic device 101 and the external electronic device 201 display designated indicator objects 1040 and 1050 in a designated area (eg, a status bar). area and status bar area), respectively, it is possible to visually provide that they are connected to each other. According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, a designated indicator object representing a connection state through a designated area on a display of the electronic device 101 and the external electronic device 201 ( 1040 and 1050) at approximately the same time. For example, the electronic device 101 displays the first indicator object 1040 in the status bar area of the electronic device 101, and the external electronic device 201 displays the first indicator object 1040 in the status bar area of the external electronic device 201. A second indicator object 1050 may be displayed. In one embodiment, the first indicator object 1040 and the second indicator object 1050 may be provided by the same or similar object (eg, the same icon). For example, the first indicator object 1040 and the second indicator object 1050 may be provided as designated icons to indicate a connection state between the electronic device 101 and the external electronic device 201 .

According to an embodiment, the specified guide interface for indicating the connection state between the electronic device 101 and the external electronic device 201 includes application of the same theme between user interfaces and an indicator through a specified area (and/or floating). It may be provided using either or both of the object representations.

11 is a diagram illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.

Referring to FIG. 11 , when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they may connect to each other through specified communication (eg, short-range wireless communication).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are configured to work with other corresponding devices based on task distribution (or collaboration). It can act to provide functionality and other interfaces. For example, when the electronic device 101 connects to the external electronic device 201 while executing a first function, the electronic device 101 determines that the external electronic device 201 performs a second function related to (or identical to) the first function. Whether or not the function is being executed can be determined through mutual communication. The first function of the electronic device 101 and the second function of the external electronic device 201 are based on the fact that the electronic device 101 simultaneously executes functions related to the electronic device 101 and the external electronic device 201. It can be changed in association with each other and operate to provide a related interface.

According to an embodiment, the user uses the electronic device 101 to use the first function (eg, calendar application execution) and uses the external electronic device 201 to perform the second function (eg, calendar application execution). While being used simultaneously (or in parallel), the electronic device 101 and the external electronic device 201 may be located within a certain distance and connected to each other. When the electronic device 101 and the external electronic device 201 are connected to each other, it is visually indicated that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating (eg, theme or wallpaper change, floating icon).

According to an embodiment, a simultaneous mode execution for simultaneous use of the electronic device 101 and the external electronic device 201 may be determined based on a connection between the electronic device 101 and the external electronic device 201. . For example, the electronic device 101 may determine simultaneous mode execution based on the fact that the electronic device 101 and the external electronic device 201 simultaneously execute functions related to each other. According to an embodiment, the electronic device 101 and the external electronic device 201 are connected to each other to distribute tasks (or collaborate) based on the determination of simultaneous mode execution. ), it is possible to provide a designated visual cue (or designated guide interface) indicating that they can operate (or use) together. According to one embodiment, the designated visual cue may be provided in association with a function (or menu) that can be used together through task distribution (or collaboration), for example.

For example, as illustrated in FIG. 11 , the electronic device 101 and the external electronic device 201 control an application (eg, a calendar application) of the electronic device 101 based on determining the simultaneous mode execution. 1 function (eg, calendar screen display) is changed to a third function (eg, function list screen related to a calendar application), and the second function (eg, calendar screen) of the external electronic device 201 is changed to a fourth function (eg, calendar screen). Example: a function list screen related to a calendar application and a calendar screen) may be changed and provided. The electronic device 101 and the external electronic device 201 may change and provide a user interface related to the changed function in response to a function change.

According to an embodiment, when changing the first function to the third function, the electronic device 101 may change the first user interface of the first function to a third user interface of the third function. For example, when changing the second function to the fourth function, the external electronic device 201 may change the second user interface of the second function to the fourth user interface of the fourth function. In one embodiment, the first function, the second function, the third function, and the fourth function may be mutually related functions provided by the same or similar application (eg, a calendar application).

According to an embodiment, a visual cue indicating that the electronic device 101 and the external electronic device 201 can use the changed functions (eg, the third function and the fourth function) in conjunction with each other in response to a function change ( 1110, 1120) may be provided. For example, when the electronic device 101 and the external electronic device 201 simultaneously use the sync now function, the visual cues 1110 and 1120 may be provided through corresponding function items in a given interface. For example, the electronic device 101 displays a first visual cue 1110 on a given interface of the electronic device 101, and the external electronic device 201 displays a second visual cue 1110 on a given interface of the external electronic device 201. A cue 1120 may be displayed. In one embodiment, the first visual cue 1110 and the second visual cue 1120 may be provided by the same or similar object (eg, the same icon). For example, the first visual cue 1110 and the second visual cue 1120 are used to indicate that corresponding functions can be simultaneously used based on a connection between the electronic device 101 and the external electronic device 201. It can be provided as a designated icon. For example, when the electronic device 101 and the external electronic device 201 simultaneously execute a function related to a calendar application, the electronic device 101 may use a visual cue indicating that a corresponding function may be used together through the calendar application ( 1110, 1120) may be provided.

12 and 13 are diagrams illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.

Referring to FIG. 12 , when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they can connect to each other through specified communication (eg, short-range wireless communication).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are configured to work with other corresponding devices based on task distribution (or collaboration). It can act to provide functionality and other interfaces. For example, when the electronic device 101 connects to the external electronic device 201 while executing a first function, the electronic device 101 determines that the external electronic device 201 performs a second function related to (or identical to) the first function. Whether or not the function is being executed can be determined through mutual communication. The first function of the electronic device 101 and the second function of the external electronic device 201 are based on the fact that the electronic device 101 simultaneously executes functions related to the electronic device 101 and the external electronic device 201. It can be changed in association with each other and operate to provide a related interface.

According to an embodiment, a user uses a first function (eg, media playback) by using an application (eg, a media playback application) on the electronic device 101, and uses an application (eg, media playback application) on the external electronic device 201. While the second function (eg, media play list display) is being used simultaneously (or in parallel) using a playback application), the electronic device 101 and the external electronic device 201 are located within a certain distance can be connected to each other. When the electronic device 101 and the external electronic device 201 are connected to each other, it is visually indicated that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating (eg, theme or wallpaper change, floating icon).

According to an embodiment, a simultaneous mode execution for simultaneous use of the electronic device 101 and the external electronic device 201 may be determined based on a connection between the electronic device 101 and the external electronic device 201. . For example, the electronic device 101 may determine simultaneous mode execution based on the fact that the electronic device 101 and the external electronic device 201 simultaneously execute functions (eg, a media playback application) related to each other. According to an embodiment, the electronic device 101 and the external electronic device 201 are connected to each other to distribute tasks (or collaborate) based on the determination of simultaneous mode execution. ), it is possible to provide designated objects (eg, floating icons 1210 and 1220) (or designated guide interfaces) indicating that they can be operated (or used) together.

For example, as illustrated in FIG. 12 , the electronic device 101 is performing a first function (eg, media playback) through a media playback application, and the external electronic device 201 performs a second function (eg, media playback) through a media playback application. It may be performing a function (eg, displaying a media playlist). According to an embodiment, the electronic device 101 and the external electronic device 201 interwork with each other based on the decision to execute the simultaneous mode, and the electronic device 101 and the external electronic device 201 relate to a media playback application. Floating icons 1210 and 1220 indicating that the functions can be used together may be provided. For example, when the electronic device 101 and the external electronic device 201 simultaneously use a media playback application, screen-linked floating icons 1210 and 1220 may be provided through given interfaces 1230 and 1240, respectively. .

For example, the electronic device 101 displays a first floating icon 1210 on the first user interface 1230 of the electronic device 101, and the external electronic device 201 displays the first floating icon 1210 of the external electronic device 201. 2 The second floating icons 1220 and 1120 may be displayed on the user interface 1240 . In one embodiment, the first floating icon 1210 and the second floating icon 1220 may be provided by the same or similar object (eg, the same icon). For example, the first floating icon 1210 and the second floating icon 1220 are used to indicate that corresponding functions can be simultaneously used based on a connection between the electronic device 101 and the external electronic device 201. It can be provided as a designated icon. For example, when the electronic device 101 and the external electronic device 201 simultaneously execute a function related to a media playback application, the electronic device 101 displays a floating function indicating that the corresponding function can be used together through the media playback application. Icons 1210 and 1220 may be provided.

Referring to FIG. 13 , the electronic device 101 and the external electronic device 201 provide a first function (eg, media playback) of a media playback application of the electronic device 101 based on the decision to execute the simultaneous mode. 3 function (eg, media play pause), and the second function (eg, media play list display) of the external electronic device 201 is changed to a fourth function (eg, media play) and provided. can The electronic device 101 and the external electronic device 201 may change and provide user interfaces 1330 and 1340 related to the changed function, respectively, in response to a function change.

According to an embodiment, when the electronic device 101 changes a first function (eg, media playback) to a third function (eg, media playback pause), the first user interface 1230 of the first function ( Example: a media playback screen) may be changed to a third user interface 1330 (eg, a media playback pause screen) of a third function. For example, when the external electronic device 201 changes the second function (eg, media play list display) to the fourth function (eg, media play), the second user interface 1240 (eg, media play) of the second function : The media play list screen) can be changed to the fourth user interface 1340 (eg, media play screen) of the fourth function. For example, the electronic device 101 may pause media playback and provide a corresponding user interface, and the external electronic device 201 may continue to play the media being played on the electronic device 101 and display a corresponding user interface. can provide. For example, the external electronic device 201 may provide a media play screen in which the media is played continuously from the part where the media is stopped in the electronic device 101 .

14 and 15 are diagrams illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.

Referring to FIG. 14 , FIG. 14 shows a state before the electronic device 101 and the external electronic device 201 are connected by specified communication, for example, the electronic device 101 and the external electronic device 201 are specified. An example of a state farther than the distance threshold may be shown. As illustrated in FIG. 14 , the electronic device 101 and the external electronic device 201 may individually operate, and may be in a state of displaying a corresponding interface based on a user's use state. In the example of FIG. 14 , the electronic device 101 displays a first user interface 1410 (eg, a screen for displaying months of a calendar), and the external electronic device 201 displays a second user interface 1420 (eg, a draw screen). (drawer) menu and month display screen of calendar) may be displayed.

In the above state, when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they may be connected to each other through specified communication (eg, short-range wireless communication).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are configured to work with other corresponding devices based on task distribution (or collaboration). It can act to provide functionality and other interfaces. For example, when the electronic device 101 connects to the external electronic device 201 while executing a first function, the electronic device 101 determines that the external electronic device 201 performs a second function related to (or identical to) the first function. Whether or not the function is being executed can be determined through mutual communication. The first function of the electronic device 101 and the second function of the external electronic device 201 are based on the fact that the electronic device 101 simultaneously executes functions related to the electronic device 101 and the external electronic device 201. It can be changed in association with each other and operate to provide a related interface.

According to an embodiment, a user uses a first function (eg, displaying months in a calendar) by using a calendar application on the electronic device 101, and uses a second function (eg, displaying minutes in a calendar) by using the calendar application on the external electronic device 201. Example: The electronic device 101 and the external electronic device 201 may be located within a certain distance and connected to each other while simultaneously (or in parallel) using a drawer menu and month display of a calendar). . When the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating using a designated graphic affordance (eg, 1530 theme applied) can be presented visually.

According to an embodiment, a simultaneous mode execution for simultaneous use of the electronic device 101 and the external electronic device 201 may be determined based on a connection between the electronic device 101 and the external electronic device 201. . For example, the electronic device 101 may determine execution of the simultaneous mode based on the fact that the electronic device 101 and the external electronic device 201 simultaneously execute functions (eg, a calendar application) related to each other.

Referring to FIG. 15 , the electronic device 101 and the external electronic device 201 perform a first function of a calendar application of the electronic device 101 (eg, displaying months in a calendar) based on the decision to execute the simultaneous mode. Change to the third function (eg, drawer menu display), and change the second function (eg, drawer menu and month display of calendar) of the external electronic device 201 to the fourth function (eg, calendar month display) and can operate to provide. The electronic device 101 and the external electronic device 201 may change and provide user interfaces 1510 and 1520 related to the changed function in response to a change in function.

According to an embodiment, when the electronic device 101 changes a first function (eg, displaying the minutes of a calendar) to a third function (eg, displaying a drawer menu), the first user interface 1410 of the first function (eg, month display screen) may be changed to the third user interface 1510 (eg, drawer menu screen) having a third function. For example, when the external electronic device 201 changes the second function (eg, displaying the drawer menu and the month minutes of the calendar) to the fourth function (eg, displaying the minutes of the month of the calendar), the second user interface of the second function 1420 (eg, drawer menu and month display screen) may be changed to a fourth user interface 1520 (eg, month display screen) having a fourth function. For example, the electronic device 101 may provide a drawer menu related to setting of a calendar through the third user interface 1510, and the external electronic device 201 may display an expanded month view of the calendar in the electronic device 101. may be provided as the fourth user interface 1520 .

For example, the external electronic device 201 may expand a calendar screen to provide a large screen, and the electronic device 101 may display a drawer menu related to setting (or manipulating) a calendar displayed on the external electronic device 201. can be provided in full screen. According to an embodiment, when there is a user input based on the drawer menu in the electronic device 101, a processing result of the user input may be reflected and provided through a calendar screen of the external electronic device 201.

16 is a diagram illustrating an example of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.

Referring to FIG. 16 , when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they may connect to each other through specified communication (eg, short-range wireless communication).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected, a connection between the electronic device 101 and the external electronic device 201 may be visually displayed and provided to the user. According to an embodiment, when the electronic device 101 is connected to the external electronic device 201, a specified guide interface (eg, graphic affordance) can operate to provide approximately the same time. For example, the electronic device 101 includes a first theme (eg, color theme, interface color, or background color) corresponding to the first user interface 1610 of the electronic device 101 and the external electronic device 201. It may operate to provide a second theme corresponding to the second user interface 1620 as the same or similar theme.

For example, in the example of FIG. 16 , the electronic device 101 is in a state of displaying the first user interface 1610 (eg, a yellow theme color interface) with a first color (eg, yellow) as a representative color, The external electronic device 201 may be in a state of displaying the second user interface 1620 (eg, a gray-themed interface) with a second color (eg, gray) as a representative color. When connected to the external electronic device 201, the electronic device 101 may extract a representative color (eg, a first color) and provide related color information to the external electronic device 201.

When the electronic device 101 and the external electronic device 201 are closely connected to each other, the electronic device 101 maintains the display of the yellow theme color first user interface 1610, and the external electronic device 201 maintains the display of the gray theme color. The second user interface 1620 of the theme color may be changed to the second user interface 1620 of the yellow theme color (eg, interface theme color is changed) according to the received color information and provided. For example, the external electronic device 201 applies a representative color related to the electronic device 101 to at least some elements being displayed through the display of the external electronic device 201, so that the external electronic device 201 is the electronic device (101) can be provided in real time.

As illustrated in FIG. 16 , in a state in which the electronic device 101 and the external electronic device 201 (hereinafter, referred to as a 'first external electronic device 201') are connected, another external electronic device 301 (hereinafter, referred to as 'first external electronic device 201') , referred to as 'the second external electronic device 301') is close to the electronic device 101, and the electronic device 101 and the second external electronic device 301 may be additionally connected. In a state in which the electronic device 101 and the first external electronic device 201 are connected, when the second external electronic device 301 is additionally connected to the electronic device 101, the electronic device 101 and the second external electronic device ( 301), it is possible to operate to approximately simultaneously provide a designated guide interface (eg, graphic affordance) indicating a connection state. For example, while the second external electronic device 301 displays the third user interface 1630 (eg, a pink interface) with a third color (eg, pink) as a representative color, the electronic device 101 ) and can be closely connected.

When connected to the second external electronic device 301, the electronic device 101 may extract a representative color (eg, first color) and provide related color information to the second external electronic device 301. When the electronic device 101 and the other external electronic device 301 are closely connected to each other, the electronic device 101 maintains the display of the yellow first user interface 1610 and displays the second external electronic device 301. may change the pink third user interface 1630 to a yellow third user interface 1630 according to the received color information (eg, interface color change) and provide it. For example, the second external electronic device 301 applies a representative color related to the electronic device 101 to at least some elements being displayed through the display of the second external electronic device 301, so that the second external electronic device 301 is displayed. It may provide in real time that 301 is connected to the electronic device 101 .

Therefore, the electronic device 101, the first external electronic device 201 connected to the electronic device 101, and the second external electronic device 301 connected to the electronic device 101 are user interfaces 1610 having the same or similar colors. , 1620, 1630), uniformity is provided for the user interfaces 1610, 1620, and 1630 between the electronic device 101, the first external electronic device 201, and the second external electronic device 301, so that the user can It is possible to visually and intuitively recognize that the electronic device 101 , the first external electronic device 201 , and the second external electronic device 301 are all connected to the electronic device 101 and are operating.

According to various embodiments, a designated guide interface for indicating a communication connection state between the electronic device 101, the first external electronic device 201, and the second external electronic device 301 may be provided based on color. In an embodiment of the present disclosure, an example of a color-based designated guide interface is only for helping understanding of the invention, and does not limit the embodiment of the present disclosure. For example, the designated guide interface displays designated indicator objects (eg, icons and/or text) in designated areas (eg, the status bar area of the electronic device 101, the status bar area of the first external electronic device 201, and It can be provided through the status bar area of the second external electronic device 301). For another example, the designated guide interface may be provided through floating on the displays of the electronic device 101 , the first external electronic device 201 , and the second external electronic device 301 . For example, a designated guide interface can be implemented using various graphic affordances.

17, 18, and 19 are diagrams illustrating examples of providing an interface based on a connection between a plurality of electronic devices according to various embodiments.

Referring to FIG. 17 , FIG. 17 shows a state before the electronic device 101 and the external electronic device 201 are connected by specified communication, for example, the electronic device 101 and the external electronic device 201 are specified. An example of a state farther than the distance threshold may be shown. As illustrated in FIG. 17 , the electronic device 101 and the external electronic device 201 may individually operate, and may be in a state of displaying a corresponding interface based on a user's use state. In the example of FIG. 17 , the electronic device 101 displays a first user interface 1710 (eg, a home screen), and the external electronic device 201 displays a second user interface 1730 (eg, a video call or video call). conference screen) may be displayed.

In one embodiment, the external electronic device 201 displays at least one execution object 1740 or 1750 related to a function currently being performed (eg, video call or video conference) on the second user interface 1730 to the second user interface. It can be provided through the designated area of (1730). For example, when the external electronic device 201 provides a second user interface 1730 associated with a video call (or video conference) application, a first execution object 1740 associated with a function executed in the video call application and A second execution object 1750 may be included.

For example, the first execution object 1740 is used to identify (or display) a first image (eg, a first user image) obtained by interworking with the external electronic device 201 or the electronic device 101. It may be a first image icon, and the second execution object 1750 is a second image obtained and transmitted through a camera of another external electronic device (not shown) that is wirelessly connected to the external electronic device 201 and performs a video call. (eg, a second image icon for identifying (or displaying) a second user's (or counterpart's) image). In an embodiment, the external electronic device 201 transmits image information (eg, an image acquired from a camera) on a first user and a second user through a first execution object 1740 and a second execution object 1750. can provide

According to an embodiment, in the examples of FIGS. 16, 17, and 18 , the external electronic device 201 does not include a camera, the camera of the external electronic device 201 does not operate, or the external electronic device 201 ) may indicate a case in which the use of the camera is blocked. For example, in the examples of FIGS. 16, 17, and 18 , image information for the first user is not displayed on the first execution object 1740 for the first user of the external electronic device 201 and is in an inactive state. Examples may be provided.

In one embodiment, the external electronic device 201 displays a control panel 1700 (or pop-up window) related to a function (eg, video call or video conference) currently being performed by the external electronic device 201 in the second user interface 1730. A pop-up box (or pop-up window) may be provided through a designated area of the second user interface 1730 . For example, when the external electronic device 201 executes an application such as a video call or a video conference, the control panel 1700 displays a menu for controlling functions (or settings) that can be provided (or executed) in the corresponding application. can

For example, the control panel 1700 may include various objects 1701 , 1703 , 1705 , and 1707 (or icon objects and/or button objects) related to functions provided by a corresponding application. For example, in the example of FIG. 17 , the control panel 1700 includes a first object 1701 (eg, a phone object for a phone function) and a second object 1703 (eg, a camera object for a camera function). , a third object 1705 (eg, a microphone object for a microphone function), and/or a fourth object 1707 (eg, a menu object for calling additional other functions).

Various objects 1701 , 1703 , 1705 , and 1707 of the control panel 1700 may be composed of combinations of various objects, and objects in the control panel 1700 may be changed (eg, removed, replaced, and/or added). . The various objects 1701, 1703, 1705, and 1707 of the control panel 1700 are components (eg, hardware modules) for executing functions respectively corresponding to the objects 1701, 1703, and 1705 to which the external electronic device 201 is designated. ), display states of the designated objects 1701, 1703, and 1705 may be provided differently (eg, state classification by activation/deactivation). For example, in the example of FIG. 17 , when the external electronic device 201 is in a state in which use of a camera is blocked, the second object 1703 may be provided in an inactive state (eg, dimmed). there is.

The above description is only for helping understanding of the invention, and the embodiments of the present disclosure are not limited by the description. For example, when a video call or video conference application is executed on the electronic device 101, a user interface corresponding to the second user interface 1730 may be implemented by the electronic device 101.

In the above state, when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they may be connected to each other through specified communication (eg, short-range wireless communication).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 work simultaneously based on task distribution (or collaboration). It may act to provide other available functions and other interfaces. For example, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 provides the first function of the electronic device 101 and the second function of the external electronic device 201 to each other. It can be operated to make association changes and provide relevant interfaces.

According to an embodiment, a user uses a first function (eg, displaying a home screen) on the electronic device 101 and uses a video call (or video conference) application on the external electronic device 201 to perform a second function ( Example: While a video call or video conference is being used simultaneously (or in parallel), the electronic device 101 and the external electronic device 201 may be located within a certain distance and connected to each other. When the electronic device 101 and the external electronic device 201 are connected to each other, it is possible to visually provide that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating using a designated graphic affordance.

For example, in the example of FIG. 17 , the electronic device 101 is in a state of displaying the first user interface 1710 (eg, a yellow theme color interface) with a first color (eg, yellow) as a representative color, The external electronic device 201 may be in a state of displaying the second user interface 1730 (eg, a gray theme color interface) with the second color 1720 (eg, gray) as a representative color. For example, in the examples of FIGS. 18 and 19 , when the electronic device 101 and the external electronic device 201 are closely connected to each other, the electronic device 101 displays a first user interface 1710 of a yellow theme color. While maintaining the display, the external electronic device 201 converts the second user interface 1730 of the gray theme color 1720 to the second user interface 1730 of the yellow theme color 1820 according to the received color information. It can be provided by changing it (e.g. changing the interface theme color).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are configured to work with other corresponding devices based on task distribution (or collaboration). It can act to provide functionality and other interfaces. For example, when the electronic device 101 is connected to the external electronic device 201, it can determine a function being executed in the external electronic device 201 through communication with the external electronic device 201, and the external electronic device 201 In 201 , a function (eg, a function required by the external electronic device 201 ) (or a designated function request) associated with the function being executed may be identified. For example, when the external electronic device 201 is connected to the electronic device 101, information about functions being executed in the external electronic device 201 and/or functions related to functions being executed in the external electronic device 201 An execution request for may be provided to the electronic device 101 .

Referring to FIG. 18 , based on the fact that the electronic device 101 and the external electronic device 201 are connected to each other, simultaneous mode execution for simultaneous use of the electronic device 101 and the external electronic device 201 may be determined. . The electronic device 101 and the external electronic device 201 convert the first function (eg, home screen display) of the electronic device 101 to the third function (eg, the external electronic device (eg, the external electronic device) based on the simultaneous mode execution determination. 201), and change the second function (eg, video call or video conference) of the external electronic device 201 to a fourth function (eg, interacting with the electronic device 101) Interworking (interworking) function) can be changed and operated to provide. The electronic device 101 and the external electronic device 201 may change and provide a user interface related to the changed function in response to a function change.

According to an embodiment, the electronic device 101 may change to a third function (eg, an assist function) and wait for a function execution request from the connected external electronic device 201 . According to an embodiment, when the electronic device 101 changes to a third function (eg, an assist function), a designated function (eg, a camera function) for assisting the external electronic device 201 is automatically executed, A corresponding user interface (eg, preview screen) may be provided.

According to an embodiment, the external electronic device 201 may change to a fourth function (eg, interworking function) and provide a user interface related to interworking with the electronic device 101 . For example, as illustrated in FIG. 18 , the external electronic device 201 functions as a camera (eg, the camera module 180 of FIG. 1 ) of the electronic device 101 based on interworking with the electronic device 101 . can be used, and a guide interface for this can be provided. For example, the external electronic device 201 may additionally provide a designated object 1803 related to interworking through the control panel 1700 of the second user interface 1730 . For example, the control panel 1700 may include a fifth object 1803 (eg, an object for interworking with the electronic device 101) in addition to various existing objects 1701, 1703, 1705, and 1707. there is. In an embodiment, the fifth object 1803 may be an object that requests and receives a camera image of the electronic device 101 from the electronic device 101 through interworking with the electronic device 101 .

As illustrated in FIG. 18 , the user interacts with the electronic device 101 and the outside through a user input (eg, touching the fifth object 1803 ) based on the fifth object 1803 added on the control panel 1700 . Interworking of the electronic device 201 may be commanded. The external electronic device 201 may operate to request and receive a camera image of the electronic device 101 (eg, a function execution request) to the electronic device 101 in response to a user input based on the fifth object 1803. there is. The electronic device 101 may activate (or execute) a camera (eg, the camera module 180 of FIG. 1 ) of the electronic device 101 based on receiving a function execution request from the external electronic device 201 . there is.

Referring to FIG. 19 , the electronic device 101 acquires (eg, captures) an external image through the camera based on activation of a camera (eg, the camera module 180 of FIG. 1 ), and a corresponding third user interface. 1910 (eg, a preview screen) may be displayed. For example, the electronic device 101 may change the first user interface 1710 to a third user interface 1910 and provide the same. According to an embodiment, the electronic device 101 may provide (eg, transmit) the acquired external image to the external electronic device 201 through designated communication.

The external electronic device 201 may receive an image acquired (eg, photographed) by the electronic device 101 from the electronic device 101 and provide the received image through the second user interface 1730. . For example, the external electronic device 201 may replace the first execution object 1740 of the third user interface 1730 with the third execution object 1940 and provide it. For example, the external electronic device 201 replaces a blank space of the first execution object 1740 for identifying (or displaying) the first user of the external electronic device 201 with a camera image of the electronic device 101 It may be provided as the third execution object 1940 . For example, the image of the third running object 1940 may include at least a part of the third interface 1910 (eg, a preview screen) of the electronic device 101 . In this way, the external electronic device 201 does not include a camera, the camera does not operate, and/or the camera is not available, such as when the use of the camera is blocked, and the electronic device 101 and An external camera of the electronic device 101 may be used based on interworking.

According to an embodiment, the external electronic device 201 controls the control panel 1700 of the second user interface 1730 while using the camera function of the electronic device 101 based on interworking with the electronic device 101 . Through this, a designated object 1903 related to interworking may be added or replaced and provided. For example, as illustrated in FIG. 19 , the control panel 1700 interfaces with a fifth object 1803 (eg, the electronic device 101) among various existing objects 1701 , 1703 , 1803 , 1705 , and 1707 . A sixth object 1903 capable of controlling off of the camera function of the electronic device 101 may be provided instead of the object for walking).

In one embodiment, the sixth object 1903 is an object for requesting to stop (or cancel) providing a camera image of the electronic device 101 from the electronic device 101 through interworking with the electronic device 101 can be For example, the user inputs the electronic device 101 and the external electronic device 201 through a user input based on the sixth object 1903 added on the control panel 1700 (eg, touching the sixth object 1903). ) to stop interworking. In response to a user input based on the sixth object 1903, the external electronic device 201 may request the electronic device 101 to stop transmitting the camera image of the electronic device 101 (eg, a function execution stop request). there is. The electronic device 101 may deactivate (or turn off) the camera of the electronic device 101 based on receiving a function execution stop request from the external electronic device 201 .

20, 21, and 22 are diagrams illustrating examples of providing an interface based on interactions between a plurality of electronic devices according to various embodiments.

Referring to FIG. 20 , FIG. 20 shows a state before the electronic device 101 and the external electronic device 201 are connected by specified communication, for example, the electronic device 101 and the external electronic device 201 are specified. An example of a state farther than the distance threshold may be shown. As illustrated in FIG. 20 , the electronic device 101 and the external electronic device 201 may individually operate, and may be in a state of displaying a corresponding interface based on a user's use state. In the example of FIG. 20 , the electronic device 101 displays a first user interface 2010 (eg, a home screen), and the external electronic device 201 displays a second user interface 2030 (eg, a video call screen). may be in a state of displaying

In an embodiment, the external electronic device 201 displays at least one execution object 2040 or 2050 associated with a function currently being performed (eg, video call) in the second user interface 2030 through the second user interface 2030. It can be provided through a designated area of For example, when the external electronic device 201 provides a second user interface 2030 related to a video call application, a first execution object 2040 and a second execution object associated with a function executed in the video call application ( 2050) may be included.

For example, the first execution object 2040 may be a first image icon for identifying (or displaying) a first image (eg, a first user image) acquired through a camera of the external electronic device 201 and , The second execution object 2050 is a second image acquired and transmitted through a camera of another external electronic device (not shown) that is wirelessly connected to the external electronic device 201 and performs a video call (eg, a second user ( Alternatively, it may be a second image icon for identifying (or displaying) the other party's image). In an embodiment, the external electronic device 201 transmits image information (eg, an image obtained from a camera) on a first user and a second user through a first execution object 2040 and a second execution object 2050. can provide

According to an embodiment, in the examples of FIGS. 20 , 21 and 22 , a case in which the camera of the external electronic device 201 operates may be indicated. For example, in the examples of FIGS. 20, 21, and 22 , an example in which image information for the first user is displayed on the first execution object 2040 for the first user of the external electronic device 201 may be shown. .

In one embodiment, the external electronic device 201 displays a control panel 2000 (or a pop-up box (or A pop-up window)) may be provided through a designated area of the second user interface 2030 . The control panel 2000 may correspond to the control panel 1700 as described in the description with reference to FIG. 17 . For example, when the external electronic device 201 executes a video call application, the control panel 2000 may display a menu for controlling functions (or settings) that can be provided (or executed) in the corresponding application. The control panel 2000 may include various objects 2001, 2003, 2005, and 2007 (or icon objects and/or button objects) related to functions provided by a corresponding application. For example, in the example of FIG. 20 , the control panel 2000 includes a first object 2001 (eg, a phone object for a phone function) and a second object 2003 (eg, a camera object for a camera function). , a third object 2005 (eg, a microphone object for a microphone function), and/or a fourth object 2007 (eg, a menu object for calling additional other functions).

In the above state, when the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they may be connected to each other through specified communication (eg, short-range wireless communication).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 work simultaneously based on task distribution (or collaboration). It may act to provide other available functions and other interfaces. For example, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 provides the first function of the electronic device 101 and the second function of the external electronic device 201 to each other. It can be operated to make association changes and provide relevant interfaces.

According to an embodiment, a user uses a first function (eg, displaying a home screen) on the electronic device 101 and uses a video call application on the external electronic device 201 to perform a second function (eg, video call). While using simultaneously (or in parallel), the electronic device 101 and the external electronic device 201 may be located within a certain distance and connected to each other. When the electronic device 101 and the external electronic device 201 are connected to each other, it is possible to visually provide that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating using a designated graphic affordance.

For example, in the example of FIG. 20 , the electronic device 101 is in a state of displaying the first user interface 2010 (eg, a yellow theme color interface) with a first color (eg, yellow) as a representative color, The external electronic device 201 may be in a state of displaying the second user interface 2030 (eg, a gray theme color interface) with the second color 2020 (eg, gray) as a representative color. For example, in the examples of FIGS. 21 and 22 , when the electronic device 101 and the external electronic device 201 are closely connected to each other, the electronic device 101 displays a first user interface 2010 of a yellow theme color. While maintaining the display, the external electronic device 201 converts the second user interface 2030 of the gray theme color 2020 to the second user interface 2030 of the yellow theme color 2120 according to the received color information. It can be provided by changing it (e.g. changing the interface theme color).

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are configured to work with other corresponding devices based on task distribution (or collaboration). It can act to provide functionality and other interfaces. For example, when the electronic device 101 is connected to the external electronic device 201, it can determine a function being executed in the external electronic device 201 through communication with the external electronic device 201, and the external electronic device 201 In 201 , a function (eg, a function required by the external electronic device 201 ) (or a designated function request) associated with the function being executed may be identified. For example, when the external electronic device 201 is connected to the electronic device 101, information about functions being executed in the external electronic device 201 and/or functions related to functions being executed in the external electronic device 201 An execution request for may be provided to the electronic device 101 .

Referring to FIG. 21 , based on the connection between the electronic device 101 and the external electronic device 201, simultaneous mode execution for simultaneous use of the electronic device 101 and the external electronic device 201 may be determined. . The electronic device 101 and the external electronic device 201 convert the first function (eg, home screen display) of the electronic device 101 to the third function (eg, the external electronic device (eg, the external electronic device) based on the simultaneous mode execution determination. 201), and the second function (eg, video call) of the external electronic device 201 is changed to a fourth function (eg, an interworking function that interacts with the electronic device 101) ) and can be operated to provide. The electronic device 101 and the external electronic device 201 may change and provide a user interface related to the changed function in response to a function change.

According to an embodiment, the electronic device 101 may change to a third function (eg, an assist function) and wait for a function execution request from the connected external electronic device 201 . According to an embodiment, when the electronic device 101 changes to a third function (eg, an assist function), a designated function (eg, a camera function) for assisting the external electronic device 201 is automatically executed, A corresponding user interface (eg, preview screen) may be provided.

According to an embodiment, the external electronic device 201 may change to a fourth function (eg, interworking function) and provide a user interface related to interworking with the electronic device 101 . For example, as illustrated in FIG. 21 , the external electronic device 201 functions as a camera (eg, the camera module 180 of FIG. 1 ) of the electronic device 101 based on interworking with the electronic device 101 . can be used, and a guide interface for this can be provided. For example, the external electronic device 201 may additionally provide a designated object 2103 related to interworking through the control panel 2000 of the second user interface 2030 . For example, the control panel 2000 may include a fifth object 2003 (eg, an object for interworking with the electronic device 101) in addition to various existing objects 2001, 2003, 2005, and 2007. there is. In an embodiment, the fifth object 2003 may be an object that requests and receives a camera image of the electronic device 101 from the electronic device 101 through interworking with the electronic device 101 .

As illustrated in FIG. 21 , the user interacts with the electronic device 101 and the outside through a user input (eg, touching the fifth object 2003) based on the fifth object 2003 added on the control panel 2000. Interworking of the electronic device 201 may be commanded. The external electronic device 201 may operate to request and receive a camera image of the electronic device 101 (eg, a function execution request) to the electronic device 101 in response to a user input based on the fifth object 2003. there is. The electronic device 101 may activate (or execute) a camera (eg, the camera module 180 of FIG. 1 ) of the electronic device 101 based on receiving a function execution request from the external electronic device 201 . there is.

Referring to FIG. 22 , the electronic device 101 acquires (eg, captures) an external image through the camera based on activation of a camera (eg, the camera module 180 of FIG. 1 ), and a corresponding third user interface. 2210 (eg, a preview screen) may be displayed. For example, the electronic device 101 may change the first user interface 2010 to a third user interface 2210 and provide the same. According to an embodiment, the electronic device 101 may provide (eg, transmit) the acquired external image to the external electronic device 201 through designated communication.

The external electronic device 201 may receive an image acquired (eg, photographed) by the electronic device 101 from the electronic device 101 and provide the received image through the second user interface 2030. . For example, the external electronic device 201 may add and provide a third execution object 2260 on the second user interface 2030 . For example, the external electronic device 201 includes a first execution object 2040 for a first image obtained through a camera of the external electronic device 201 and a second image obtained through a camera of another external electronic device and transmitted. A second execution object 2050 for an image and a third execution object 2260 for a third image acquired and transmitted through the camera of the electronic device 101 may be provided. For example, the image of the third running object 2260 may include at least a part of the third interface 2210 (eg, a preview screen) of the electronic device 101 . In this way, even when the external electronic device 201 uses a camera, it may use an external camera by the electronic device 101 based on interworking with the electronic device 101 .

According to an embodiment, the external electronic device 201 controls the control panel 2000 of the second user interface 2030 while using the camera function of the electronic device 101 based on interworking with the electronic device 101. Through this, a designated object 2203 related to interworking may be added or replaced and provided. For example, as exemplified in FIG. 22 , the control panel 2000 interfaces with a fifth object 2103 (eg, the electronic device 101) among various existing objects 2001, 2003, 2103, 2005, 2007. A sixth object 2203 capable of controlling off of the camera function of the electronic device 101 may be provided instead of the object for walking). In one embodiment, the sixth object 2203 is an object for requesting to stop (or cancel) providing a camera image of the electronic device 101 from the electronic device 101 through interworking with the electronic device 101. can be

For example, through a user input based on the sixth object 2203 added on the control panel 2000 (eg, touching the sixth object 2203), the electronic device 101 and the external electronic device 201 ) to stop interworking. In response to a user input based on the sixth object 2203, the external electronic device 201 may request the electronic device 101 to stop transmitting the camera image of the electronic device 101 (eg, a function execution stop request). there is. The electronic device 101 may deactivate (or turn off) the camera of the electronic device 101 based on receiving a function execution stop request from the external electronic device 201 .

23, 24, and 25 are diagrams illustrating examples of providing an interface based on an interaction between a plurality of electronic devices according to various embodiments.

Referring to FIG. 23, as illustrated in FIG. 22, for example, FIG. 23 may represent an example of a state in which the electronic device 101 and the external electronic device 201 are connected by designated communication and operate. . According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected, a connection between the electronic device 101 and the external electronic device 201 may be visually displayed and provided to the user. For example, the electronic device 101 may include a first theme (eg, color theme, interface color, or background color) corresponding to the first user interface 2310 of the electronic device 101 and the external electronic device 201 . It may operate to provide a second theme corresponding to the second user interface 2340 as the same or similar theme 2320 . For example, the electronic device 101 provides the first user interface 2310 of yellow theme color, and the external electronic device 201 changes to the second user interface 2340 of yellow theme color (eg, interface theme color change) may be provided.

As illustrated in FIG. 22 described above, the external electronic device 201 executes execution objects 2350, 2360, and 2370 associated with a function currently being performed (eg, a video call and interworking function) in the second user interface 2340. may be provided through a designated area of the second user interface 2340. For example, when the external electronic device 201 provides a second user interface 2340 related to a video call application, a first execution object 2350 and a second execution object associated with a function executed in the video call application ( 23600) and a third execution object 2370. In one embodiment, the first running object 2350, the second running object 2360, and the third running object 2370 are the first running object 2040 and the second running object 2050 with reference to FIG. 22 described above. and the third execution object 2260, respectively.

As illustrated in FIG. 22 described above, the external electronic device 201 displays a control panel 2300 related to a function currently being performed (eg, video call) by the external electronic device 201 in the second user interface 2340 ( Alternatively, a pop-up box (or pop-up window) may be provided through a designated area of the second user interface 2340 . The control panel 2300 may correspond to the control panel 2000 as described in the description with reference to FIG. 22 . For example, the control panel 2300 includes a first object 2301 (eg, a phone object for a phone function), a second object 2303 (eg, a camera object for a camera function), and a sixth object 2305 ) (eg, an object for stopping interworking with the electronic device 101), a third object 2307 (eg, a microphone object for a microphone function), and/or a fourth object 2309 (eg, additional other menu object for function call). In one embodiment, the first object 2301 , the second object 2303 , the sixth object 2305 , the third object 2307 , and/or the fourth object 2309 may be referred to as FIG. 22 described above. Each may correspond to the first object 2001, the second object 2003, the sixth object 2103, the third object 2005, and/or the fourth object 2007.

Referring to FIG. 24 , while an electronic device 101 (hereinafter, referred to as a 'first electronic device 201') and an external electronic device 201 are connected, another external electronic device 301 (hereinafter, referred to as a 'first electronic device 201') The second electronic device 301') may be close to the external electronic device 201, and the external electronic device 201 and the second electronic device 301 may be connected. For example, in the example of FIG. 24 , the first electronic device 101 and the external electronic device 201 may be disconnected, and the external electronic device 201 may be connected to the second electronic device 301 .

In one embodiment, when the connection between the first electronic device 101 and the external electronic device 201 is disconnected, the first electronic device 101 maintains display of the first user interface 2310 of a yellow theme color, The external electronic device 201 may change to the second user interface 2340 (eg, a gray theme color interface) of a previously set second theme (eg, gray color). According to an embodiment, when the connection with the external electronic device 201 is disconnected, the first electronic device 101 may automatically deactivate (or turn off) the camera. For example, in response to a user input, the external electronic device 201 may request the first electronic device 101 to stop transmitting the camera image of the second electronic device 101 (eg, a function execution stop request). there is. The first electronic device 101 may deactivate (or turn off) the camera of the first electronic device 101 based on receiving a function execution stop request from the external electronic device 201 .

According to an embodiment, when the connection with the first electronic device 101 is released, the external electronic device 201 may stop (or end) an interworking function with the first electronic device 101 . According to an embodiment, the external electronic device 201 is an execution object 2350 associated with a function currently being performed (eg, a video call and an interworking function) in the second user interface 2340 based on the interruption of the interworking function. Among operations 2360 and 2370 , the third execution object 2370 related to interworking with the first electronic device 101 may be removed from the second user interface 2340 . For example, the external electronic device 201 may display the first execution object 2350 and the second execution object 23600 on the second user interface 2340, but may not display the third execution object 2370. there is. In one embodiment, the first running object 2350, the second running object 2360, and the third running object 2370 are the first running object 2040 and the second running object 2050 with reference to FIG. 22 described above. and the third execution object 2260 respectively.

In addition, when the external electronic device 201 and the second electronic device 201 are closely connected to each other while the external electronic device 201 is disconnected from the first electronic device 101, the second electronic device ( 301) maintains the display of the third user interface 2330 of the third color (eg, the blue theme color interface), and the external electronic device 201 displays the second user interface 2340 of the gray theme color, 2 According to the color information received from the electronic device 301, the second user interface 2340 of the blue theme color 2420 may be changed (eg, the interface color is changed) and provided.

For example, when the second electronic device 301 and the external electronic device 201 are connected, the second electronic device 301 and the external electronic device 201 display a designated guide interface (eg, graphic affordance) indicating a connection state. It can operate to provide approximately simultaneously. For example, while the second electronic device 301 displays the third user interface 2330 (eg, a blue theme color interface) with a third color (eg, blue) as a representative color, the external electronic device ( 201) and can be connected in close proximity.

When connected to the external electronic device 201, the second electronic device 301 may extract a representative color (eg, a third color) and provide related color information to the external electronic device 201. When the second electronic device 301 and the external electronic device 201 are closely connected to each other, the second electronic device 301 maintains the display of the third user interface 2330 in blue color, and the external electronic device 201 ) may change the second user interface 2340 of gray color to the second user interface 2340 of blue color 2420 according to the received color information (eg, interface color change) and provide it. For example, the external electronic device 201 applies a representative color related to the second electronic device 301 to at least some elements being displayed through the display of the external electronic device 201 so that the external electronic device 201 can Connection with the second electronic device 301 may be provided in real time.

According to an embodiment, when the second electronic device 301 and the external electronic device 201 are connected to each other, the second electronic device 301 and the external electronic device 201 work based on task distribution (or collaboration). , can operate to provide corresponding other functions and other interfaces. For example, when the second electronic device 301 is connected to the external electronic device 201, it can determine a function being executed in the external electronic device 201 through communication with the external electronic device 201, and A function (eg, a function required by the external electronic device 201 ) (or a designated function request) associated with a function being executed in the electronic device 201 may be identified. For example, when the external electronic device 201 is connected to the second electronic device 301, information about functions being executed in the external electronic device 201 and/or functions being executed in the external electronic device 201 are provided. An execution request for a related function may be provided to the second electronic device 301 .

Referring to FIG. 24 , based on the connection between the second electronic device 301 and the external electronic device 201, a concurrent mode for simultaneous use of the second electronic device 301 and the external electronic device 201 is executed. can determine The second electronic device 301 and the external electronic device 201 convert the fifth function (eg, displaying the home screen) of the second electronic device 301 to the sixth function (eg, displaying the home screen) based on the simultaneous mode execution determination. assist function for supporting the function of the external electronic device 201), and the second function (eg, video call) of the external electronic device 201 is changed to a fourth function (eg, the second electronic device 301). Interworking function that interacts) can be changed and operated to provide. The second electronic device 301 and the external electronic device 201 may change and provide a user interface related to the changed function in response to a function change.

According to an embodiment, the second electronic device 301 may change to a fifth function (eg, an assist function) and wait for a function execution request from the connected external electronic device 201 . According to an embodiment, when the second electronic device 301 changes to a fifth function (eg, an assist function), a designated function (eg, a camera function) to assist the external electronic device 201 is automatically executed. and a corresponding user interface (eg, a preview screen) may be provided.

According to an embodiment, the external electronic device 201 may change to a fourth function (eg, interworking function) and provide a user interface related to interworking with the second electronic device 301 . For example, as illustrated in FIG. 24 , the external electronic device 201 is based on interworking with the second electronic device 301 and the camera of the second electronic device 301 (eg, the camera module of FIG. 1 ( 180)) function can be used, and a guide interface for this function can be provided. For example, the external electronic device 201 may additionally provide a specified object 2405 related to interworking through the control panel 2300 of the second user interface 2340 . For example, the control panel 2300 includes a fifth object 2405 (eg, an object for interworking with the second electronic device 301) in addition to various existing objects 2301, 2303, 2307, and 2309. can do. In one embodiment, the fifth object 2405 requests and receives a camera image of the second electronic device 301 from the second electronic device 301 through interworking with the second electronic device 301 . can be an object.

As illustrated in FIG. 24 , the user receives the second electronic device 301 through a user input (eg, touching the fifth object 2405) based on the fifth object 2405 added on the control panel 2300. and the external electronic device 201 may be commanded to perform interworking. In response to a user input based on the fifth object 1405, the external electronic device 201 requests and receives a camera image of the second electronic device 301 from the second electronic device 301 (eg, a function execution request). can act to do so. Based on receiving a function execution request from the external electronic device 201, the second electronic device 301 activates (or can run).

Referring to FIG. 25 , the second electronic device 301 acquires (eg, captures) an external image through the camera (eg, camera module 180 of FIG. 1 ) based on activation of the camera, and a corresponding fourth electronic device 301 A user interface 2530 (eg, a preview screen) may be displayed. For example, the second electronic device 301 may change the third user interface 2330 to a fourth user interface 2530 and provide the same. According to an embodiment, the second electronic device 301 may provide (eg, transmit) the acquired external image to the external electronic device 201 through designated communication.

The external electronic device 201 receives an image obtained (eg, photographed) by the second electronic device 301 from the second electronic device 301, and transmits the received image through the second user interface 2340. can provide For example, the external electronic device 201 may add and provide a fourth execution object 2570 on the second user interface 2340 . For example, the external electronic device 201 includes a first execution object 2350 for a first image obtained through a camera of the external electronic device 201 and a second image acquired through a camera of another external electronic device and transmitted. A second running object 2360 for an image and a fourth running object 2570 for a fourth image acquired and transmitted through the camera of the second electronic device 301 may be provided. For example, the image of the fourth running object 2570 may include at least a part of the fourth interface 2530 (eg, a preview screen) of the second electronic device 301 .

According to an embodiment, the control panel of the second user interface 2340 is used while the external electronic device 201 uses the camera function of the second electronic device 301 based on interworking with the second electronic device 301 . Through 2300, a designated object 2305 related to interworking may be added or replaced and provided. For example, as illustrated in FIG. 25 , the control panel 2300 includes a fifth object 2405 (eg, the second electronic device 301) among various existing objects 2301 , 2303 , 2405 , 2307 , and 2309 . A sixth object 2305 capable of controlling off of the camera function of the second electronic device 301 may be provided by replacing the object for interworking with the second electronic device 301 . In an embodiment, the sixth object 2305 stops (or cancels) providing a camera image of the second electronic device 301 from the second electronic device 301 through interworking with the second electronic device 301 . ) may be an object for requesting.

For example, through a user input based on the sixth object 2305 added on the control panel 2300 (eg, touching the sixth object 2305), the second electronic device 301 and the external electronic device Interworking of 201 may be commanded to stop. In response to a user input based on the sixth object 2305, the external electronic device 201 requests the second electronic device 301 to stop transmitting the camera image of the second electronic device 301 (eg, stop function execution). request) can be made. The second electronic device 301 may deactivate (or turn off) the camera of the second electronic device 301 based on receiving a function execution stop request from the external electronic device 201 .

26, 27, and 28 are diagrams illustrating examples of providing an interface based on interactions between a plurality of electronic devices according to various embodiments.

Referring to FIG. 26 , FIG. 26 may show an example of a state before the electronic device 101 and the external electronic device 201 are connected through designated communication. As illustrated in FIG. 26 , the electronic device 101 and the external electronic device 201 may individually operate and may be in a state of displaying a corresponding interface based on a user's use state. In the example of FIG. 26 , the electronic device 101 displays the first user interface 2610 (eg, a picture (or note) writing screen), and the external electronic device 201 displays the second user interface 2630 (eg, a picture (or note) writing screen). : It may be a state of displaying a picture (or note) list screen).

According to an embodiment, the user may be in the process of writing (eg, drawing) a picture on the electronic device 101 using the digital pen 2601, and the external electronic device 201 through the external electronic device 201. It may be in a state of checking the picture list screen stored in the memory. In this state, the user may bring the electronic device 101 and the external electronic device 201 close to each other. When the electronic device 101 and the external electronic device 201 come close to each other within a specified distance threshold, they may be connected to each other through specified communication (eg, short-range wireless communication).

When the electronic device 101 and the external electronic device 201 are connected to each other, it is possible to visually provide that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating using a designated graphic affordance. For example, in the example of FIG. 26 , the electronic device 101 is in a state of displaying the first user interface 2610 (eg, a yellow theme color interface) with a first color (eg, yellow) as a representative color, The external electronic device 201 may be in a state of displaying the second user interface 2630 (eg, a gray-themed interface) with the second color 2620 (eg, gray) as a representative color. In the example of FIG. 27 , when the electronic device 101 and the external electronic device 201 are closely connected to each other, the electronic device 101 maintains the display of the yellow theme color first user interface 2610 and The device 201 changes the second user interface 2630 of the gray theme color 2620 to the second user interface 2630 of the yellow theme color 2640 according to the received color information (eg, interface theme color). change) can be provided.

According to an embodiment, when the electronic device 101 and the external electronic device 201 are connected to each other, the electronic device 101 and the external electronic device 201 are configured to work with other corresponding devices based on task distribution (or collaboration). It can act to provide functionality and other interfaces. For example, when the electronic device 101 connects to the external electronic device 201 while executing a first function, the electronic device 101 determines that the external electronic device 201 performs a second function related to (or identical to) the first function. Whether or not the function is being executed can be determined through mutual communication. The first function of the electronic device 101 and the second function of the external electronic device 201 are based on the fact that the electronic device 101 simultaneously executes functions related to the electronic device 101 and the external electronic device 201. It can be changed in relation to each other and operate to provide a related interface.

According to an embodiment, a user uses an application (eg, a note application) on the electronic device 101 to use a first function (eg, a drawing function), and an application (eg, a note application) on the external electronic device 201. While the second function (eg, a picture list display function) is being used simultaneously (or in parallel) by using the application), the electronic device 101 and the external electronic device 201 are located within a certain distance and are close to each other. can be connected When the electronic device 101 and the external electronic device 201 are connected to each other, it is visually indicated that the electronic device 101 and the external electronic device 201 are wirelessly connected and communicating (eg, theme or wallpaper change, floating icon).

Based on the connection between the electronic device 101 and the external electronic device 201, it is possible to determine execution of a concurrent mode for simultaneous use of the electronic device 101 and the external electronic device 201. For example, the electronic device 101 may determine simultaneous mode execution based on the fact that the electronic device 101 and the external electronic device 201 simultaneously execute functions related to each other (eg, a note application). According to an embodiment, the electronic device 101 and the external electronic device 201 are connected to each other to distribute tasks (or collaborate) based on the determination of simultaneous mode execution. ), it is possible to provide designated objects (eg, floating icons 1210 and 1220) (or designated guide interfaces) indicating that they can be operated (or used) together.

For example, as illustrated in FIG. 27 , the electronic device 101 is performing a first function (eg, drawing a picture) through a note application, and the external electronic device 201 performs a second function (eg, drawing) through a note application. eg displaying a list of pictures). According to an embodiment, the electronic device 101 and the external electronic device 201 interwork with each other based on the determination of simultaneous mode execution, and the function related to the note application. You can provide a relevant guide interface indicating that can be used together. For example, when the electronic device 101 and the external electronic device 201 simultaneously use a note application, the screen linkage guide object 2700 may be provided through at least one of given interfaces 2610 and 2640.

For example, the electronic device 101 and the external electronic device 201 provide (eg, display) the screen linkage guide object 2700 as a pop-up box in the second user interface 2630 of the external electronic device 201. can For example, the screen linkage guide object 2700 is provided as a designated icon and/or text indicating that a function corresponding to the connection between the electronic device 101 and the external electronic device 201 can be simultaneously used. It can be. For example, when the electronic device 101 and the external electronic device 201 simultaneously execute a function related to a note application, the electronic device 101 provides a guide indicating that the corresponding function can be used together through the note application. can do.

According to an embodiment, when the external electronic device 201 detects a user input for executing a linkage function based on the screen linkage guide object 2700, the external electronic device 201 operates to execute a concurrent mode by interlocking with the electronic device 101. can do.

Referring to FIG. 28 , the electronic device 101 and the external electronic device 201 determine the simultaneous mode execution, and the electronic device 101 converts a first function (eg, drawing) into a third function (eg, drawing). : assist function), and the external electronic device 201 may change the second function (eg, picture list) into a fourth function (eg, drawing a picture) and provide the same. The electronic device 101 and the external electronic device 201 may change and provide user interfaces 2810 and 2830 related to the changed function, respectively, in response to a function change.

According to an embodiment, when the electronic device 101 changes a first function (eg, drawing) to a third function (eg, an assist function), the first user interface 2610 (eg, an assist function) of the first function The picture creation screen) may be changed to the third user interface 2810 (eg, an auxiliary input device (eg, graphic tablet) screen) having a third function. When the external electronic device 201 changes the second function (eg, picture list) to the fourth function (eg, drawing a picture), the second user interface 2630 (eg, picture list screen) of the second function is displayed. It can be changed to the fourth user interface 2830 (eg, picture creation screen) of the fourth function. For example, the electronic device 101 may stop drawing and switch to the auxiliary input device of the external electronic device 201 to provide a corresponding third user interface 2810, and the external electronic device 201 may The electronic device 101 may continuously display the picture being created and provide a corresponding fourth user interface 2830 . For example, the external electronic device 201 may provide a picture creation screen so that picture creation (eg, drawing) can be continued from the part where picture creation is stopped in the electronic device 101 .

An operation method performed by an electronic device 101 according to an embodiment of the present disclosure includes an operation of detecting proximity of an external electronic device through a communication module of the electronic device, based on detecting proximity to the external electronic device. , Connecting with the external electronic device through designated communication, sharing operation information with the external electronic device based on the connection with the external electronic device, and connecting the electronic device and the external electronic device based on the operation information. It may include an operation of distributing a task for the task, and an operation of controlling the electronic device and the external electronic device to change and execute a corresponding function based on the task distribution, and to provide a user interface corresponding to the function change.

According to an embodiment, the operation information indicates information for determining whether to execute a simultaneous mode based on mutual availability between the electronic device and the external electronic device, and the electronic device and the external electronic device run an application at the same time. Application information, application use information, network information, and/or display information for identifying whether the electronic device and the external electronic device are being used simultaneously, whether the electronic device and the external electronic device are connected to the same network, and/or the currently displayed screen state. can include

According to an embodiment, the operation of providing the user interface may include controlling the electronic device and the external electronic device to provide different functions and different interfaces associated with the designated application by a designated application. can

According to an embodiment, the operation of providing the user interface may include an operation of generating control information for controlling a function and/or a user interface based on the operation information, and a function for the electronic device based on the control information. Execution and operation of providing a user interface, transmitting the control information to the external electronic device through the communication module, and controlling the external electronic device to provide a corresponding function execution and user interface based on the control information Actions may be included.

According to an embodiment, the connecting operation may include, when connecting the electronic device and the external electronic device, the electronic device and the external electronic device are connected to each other through a display of the electronic device and the external electronic device. An operation of providing a visual guide interface for guiding that the user is present, and the visual guide interface may be provided based on a designated graphic affordance.

According to an embodiment, the operation of providing the visual guide interface may include applying a representative color related to the electronic device to at least some elements being displayed through a display of the external electronic device, so that the electronic device and the external electronic device It may include an operation of providing uniformity for user interfaces between devices.

According to an embodiment, the operation of providing the user interface, when the electronic device and the external electronic device are connected, executes a simultaneous mode for simultaneous use of the electronic device and the external electronic device based on the operation information. Based on the operation of determining whether or not to execute the concurrent mode, the electronic device changes the first function to a third function, and in response to the function change, the first user interface of the first function is displayed as the The external electronic device changes the second function to a fourth function based on the operation of changing to a third user interface of a third function and the decision to execute the concurrent mode, and in response to the function change, the second function An operation of controlling the external electronic device to change the second user interface of the function to the fourth user interface of the fourth function and provide the fourth user interface.

According to an embodiment, the operation of determining whether to execute the simultaneous mode may include first operation information of the electronic device and second operation information of the external electronic device based on a connection between the electronic device and the external electronic device. Obtaining operation, comparing the first operation information with the second operation information, determining whether or not a specified condition for concurrent mode execution is satisfied based on a result of comparing the operation information, and the specified condition Based on determining that satisfies , an operation of determining the simultaneous mode execution may be included.

According to an embodiment, the electronic device triggers a concurrent mode based on a user input input to execute a concurrent mode for simultaneous use of the electronic device and the external electronic device while performing a specified operation. and searching for an external electronic device that is closer to the electronic device by a specified distance or less through specified communication based on a concurrent mode trigger, wherein the electronic device and the external electronic device are grouped into a user account. may be built-in, user-account-based devices.

Various embodiments of the present disclosure disclosed in the present specification and drawings are only presented as specific examples to easily explain the technical content of the present disclosure and help understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed as including all changes or modified forms derived based on the technical spirit of the present disclosure in addition to the embodiments disclosed herein.

101: electronic device
120: processor
130: memory
160: display module
190: communication module
201 External electronic device

Claims (20)

In electronic devices,
communication module;
display; and
a processor operatively coupled with the communication module and the display, the processor comprising:
Detect proximity of an external electronic device through the communication module;
Based on detecting proximity with the external electronic device, connecting with the external electronic device through designated communication;
Based on the connection with the external electronic device, operation information is shared with the external electronic device;
Distributing tasks for the electronic device and the external electronic device based on the operation information; and
An electronic device configured to change and execute a function corresponding to the electronic device and the external electronic device based on job distribution and provide a user interface corresponding to the function change.
The method of claim 1, wherein the processor,
An electronic device configured to provide a designated guide interface for guiding proximity to the external electronic device based on detecting proximity to the external electronic device.
The method of claim 1, wherein the operation information,
Indicates information for determining whether to execute a simultaneous mode based on mutual availability of the electronic device and the external electronic device;
Application for identifying whether the electronic device and the external electronic device are using the application at the same time, whether the electronic device and the external electronic device are connected to the same network and are using the application, and/or a currently displayed screen state. An electronic device configured to include information, application usage information, network information, and/or display information.
The method of claim 1, wherein the processor,
An electronic device that controls the electronic device and the external electronic device to provide different functions and different interfaces related to the designated application by a designated application.
The method of claim 1, wherein the processor,
Based on the operation information, control information for function and/or user interface control is generated;
Providing a function execution and user interface for the electronic device based on the control information;
The electronic device transmitting the control information to the external electronic device through the communication module, and controlling the external electronic device to execute a corresponding function and provide a user interface based on the control information.
The method of claim 1, wherein the processor,
When the electronic device and the external electronic device are connected, a visual guide interface for guiding that the electronic device and the external electronic device are connected to each other is provided through a display of the electronic device and the external electronic device. become,
The electronic device, characterized in that provided based on the visual guide interface, a designated graphic affordance (graphical affordance).
The method of claim 6, wherein the processor,
The electronic device configured to provide unification of a user interface between the electronic device and the external electronic device by applying a representative color related to the electronic device to at least some elements being displayed through a display of the external electronic device.
The method of claim 1, wherein the processor,
When the electronic device and the external electronic device are connected, determine whether to execute a simultaneous mode for simultaneous use of the electronic device and the external electronic device based on the operation information;
An electronic device configured to perform task distribution based on determining the simultaneous mode execution.
The method of claim 8, wherein the processor,
Based on the decision to execute the simultaneous mode, the electronic device changes the first function to a third function, and in response to the function change, the first user interface of the first function is changed to the third function of the third function. Operate to change to a user interface;
Based on the decision to execute the concurrent mode, the external electronic device changes the second function to a fourth function, and in response to the function change, a second user interface of the second function is set to a fourth function of the fourth function. 4 An electronic device that operates to control the external electronic device to change and provide a user interface.
The method of claim 8, wherein the processor,
Obtain first operation information of the electronic device and second operation information of the external electronic device based on a connection between the electronic device and the external electronic device;
Compare the first operation information and the second operation information;
Based on a result of comparing the operation information, it is determined whether a specified condition for concurrent mode execution is satisfied;
An electronic device configured to determine execution of the concurrent mode based on determining that the specified condition is satisfied.
The method of claim 1, wherein the processor,
Triggering a simultaneous mode based on a user input to execute a simultaneous mode for simultaneous use of the electronic device and the external electronic device while performing a specified operation;
Based on the simultaneous mode trigger, it is set to search for an external electronic device that is close to the electronic device by a specified distance or less through specified communication;
The electronic device according to claim 1 , wherein the electronic device and the external electronic device are grouped into user accounts and are based on user accounts.
In the operating method of the electronic device,
detecting proximity of an external electronic device through a communication module of the electronic device;
connecting to the external electronic device through designated communication based on sensing proximity with the external electronic device;
sharing operation information with the external electronic device based on the connection with the external electronic device;
distributing tasks for the electronic device and the external electronic device based on the operation information; and
and controlling the electronic device and the external electronic device to change and execute a corresponding function based on job distribution, and to provide a user interface corresponding to the function change.
The method of claim 12, wherein the operation information,
Indicates information for determining whether to execute a simultaneous mode based on mutual availability of the electronic device and the external electronic device;
Application for identifying whether the electronic device and the external electronic device are using the application at the same time, whether the electronic device and the external electronic device are connected to the same network and are using the application, and/or a currently displayed screen state. A method for including information, application usage information, network information, and/or display information.
The method of claim 12, wherein providing the user interface comprises:
and controlling the electronic device and the external electronic device to provide different functions and different interfaces associated with the designated application by a designated application.
The method of claim 14, wherein providing the user interface comprises:
An operation of generating control information for controlling a function and/or a user interface based on the operation information;
Executing a function for the electronic device and providing a user interface based on the control information;
and transmitting the control information to the external electronic device through the communication module to control the external electronic device to execute a corresponding function and provide a user interface based on the control information.
The method of claim 12, wherein the connecting operation,
When the electronic device and the external electronic device are connected, providing a visual guide interface for guiding that the electronic device and the external electronic device are connected to each other through displays of the electronic device and the external electronic device. including,
Wherein the visual guide interface is provided based on a designated graphical affordance.
The method of claim 16, wherein the operation of providing the visual guide interface,
and applying a representative color related to the electronic device to at least some elements displayed on a display of the external electronic device to provide unification of a user interface between the electronic device and the external electronic device.
The method of claim 12, wherein providing the user interface comprises:
When the electronic device and the external electronic device are connected, determining whether to execute a simultaneous mode for simultaneous use of the electronic device and the external electronic device based on the operation information;
Based on the decision to execute the simultaneous mode, the electronic device changes the first function to a third function, and in response to the function change, the first user interface of the first function is changed to the third function of the third function. the act of making changes to the user interface;
Based on the decision to execute the concurrent mode, the external electronic device changes the second function to a fourth function, and in response to the function change, a second user interface of the second function is set to a fourth function of the fourth function. 4. A method comprising controlling the external electronic device to change and provide a user interface.
19. The method of claim 18, wherein determining whether to execute the concurrent mode comprises:
Obtaining first operation information of the electronic device and second operation information of the external electronic device based on a connection between the electronic device and the external electronic device;
Comparing the first operation information and the second operation information;
Based on a result of comparing the operation information, determining whether a specified condition for concurrent mode execution is satisfied;
and determining execution of the concurrent mode based on determining that the specified condition is satisfied.
According to claim 12,
Triggering a simultaneous mode based on a user input to execute a concurrent mode for simultaneous use of the electronic device and the external electronic device while performing a specified operation;
Searching for an external electronic device that is close to the electronic device by a specified distance or less through specified communication based on a concurrent mode trigger;
The method of claim 1 , wherein the electronic device and the external electronic device are devices based on user accounts grouped into user accounts.

Images