KR20240039553A - Foldable electronic device and method for providing application scrren on external diplay device thereof - Google Patents

Abstract

An electronic device according to an embodiment includes a first housing and a second housing disposed on both sides of a folding axis and formed to be folded relative to each other, and the first housing and the second housing being arranged to face a first direction. It may include a first display, a communication interface, a memory, and a processor operatively connected to the first display, the communication interface, and the memory. The processor according to one embodiment displays a content display unit on a first display area of the first display corresponding to the first housing while the first housing and the second housing are folded at a predetermined angle, and the second housing is folded at a certain angle. The second display area of the first display corresponding to the housing can be controlled to display an application execution screen in a split screen UI mode that displays a content control unit. When a screen sharing service is executed while an application execution screen is displayed in the split screen UI mode, the processor according to one embodiment may recognize an external electronic device connected to the electronic device through the communication interface. According to one embodiment, when there is no input device connected to the recognized external electronic device, the processor excludes the content manipulation unit of the second display area and screen information of the content display unit being displayed in the first display area. can be controlled to transmit to the external electronic device. According to one embodiment, when there is an input device connected to the external electronic device, the processor excludes the content manipulation unit of the second display area and displays the screen information of the content display unit displayed in the first display area and the external electronic device. It is possible to control transmission of an external manipulation UI, including shortcut keys mapped to application manipulation of the electronic device, to the external electronic device through the input device of the electronic device.

Description

FOLDABLE ELECTRONIC DEVICE AND METHOD FOR PROVIDING APPLICATION SCRREN ON EXTERNAL DIPLAY DEVICE THEREOF}

Various embodiments relate to a foldable electronic device and a method of the foldable electronic device providing an application screen to an external display device.

The electronic device supports a screen sharing service (mirroring) function that transmits the application screen executed on the electronic device to an external electronic device with a larger display and provides the application screen to the display of the external device. .

Screen sharing services can display the screen being displayed on the electronic device on the display of the external electronic device, or provide the application screen of the electronic device on a single window provided by the external electronic device.

In addition to simply transmitting the application screen to the display of an external device, the electronic device provides a user interface for the application of the electronic device in a PC (personal computer) environment and controls the application operation of the electronic device with user input in the PC environment. There is a need to develop services that

The technical problem to be achieved in the present disclosure is not limited to the technical problem mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

An electronic device according to an embodiment includes a first housing and a second housing disposed on both sides of a folding axis and formed to be folded relative to each other, and the first housing and the second housing being arranged to face a first direction. It may include a first display, a communication interface, a memory, and a processor operatively connected to the first display, the communication interface, and the memory. The processor according to one embodiment displays a content display unit on a first display area of the first display corresponding to the first housing while the first housing and the second housing are folded at a predetermined angle, and the second housing is folded at a certain angle. The second display area of the first display corresponding to the housing can be controlled to display an application execution screen in a split screen UI mode that displays a content control unit. When a screen sharing service is executed while an application execution screen is displayed in the split screen UI mode, the processor according to one embodiment may recognize an external electronic device connected to the electronic device through the communication interface. According to one embodiment, when there is no input device connected to the recognized external electronic device, the processor excludes the content manipulation unit of the second display area and screen information of the content display unit being displayed in the first display area. can be controlled to transmit to the external electronic device. According to one embodiment, when there is an input device connected to the external electronic device, the processor excludes the content manipulation unit of the second display area and displays the screen information of the content display unit displayed in the first display area and the external electronic device. It is possible to control transmission of an external manipulation UI, including shortcut keys mapped to application manipulation of the electronic device, to the external electronic device through the input device of the electronic device.

The memory according to one embodiment displays a content display unit on a first display area of the first display corresponding to the first housing in a state in which the first housing and the second housing are folded at a predetermined angle, and the second housing is folded at a certain angle. The second display area of the first display corresponding to the housing may include instructions for controlling the display of an application execution screen in a split-screen UI mode that displays a content control unit. The memory according to one embodiment includes instructions for recognizing an external electronic device connected to the electronic device through the communication interface when a screen sharing service is executed while the application execution screen is displayed in the split screen UI mode. can do. According to one embodiment, the memory may include screen information of the content display unit being displayed on the first display area, excluding the content manipulation unit of the second display area, when there is no input device connected to the recognized external electronic device. It may include instructions that control transmission to the external electronic device. According to one embodiment, when an input device connected to the external electronic device exists, the memory excludes the content manipulation unit of the second display area and displays screen information of the content display unit displayed in the first display area and the external electronic device. It may include instructions for controlling transmission of an external manipulation UI including shortcut keys mapped to application manipulation of the electronic device to the external electronic device through the input device of the electronic device.

According to one embodiment, an electronic device (e.g., a foldable electronic device) operates in a split screen UI mode (e.g., an application screen) in a state in which the first housing and the second housing are folded at a certain angle (e.g., the display is folded). If the screen sharing service is running while displaying the application execution screen in a mode in which the content display unit and the content control unit are displayed separately, only the screen information for the content display unit is provided to the external electronic device depending on whether the input device is connected to the external electronic device. Alternatively, in addition to screen information, an external manipulation UI including shortcut keys mapped to application manipulation of the electronic device may be provided to the external electronic device through an input device of the external electronic device.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes a first housing and a second housing disposed on both sides of the folding axis and folded relative to each other and displayed at a predetermined angle. In this state, the method may include displaying an application execution screen in a split screen UI mode on a display disposed to face a first direction of the first housing and the second housing.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when a screen sharing service is executed while the application execution screen is displayed in the split screen UI mode, through the communication interface. It may include recognizing an external electronic device connected to the electronic device.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when there is no input device connected to the recognized external electronic device, excluding the content control unit of the second display area, The method may include transmitting screen information of the content display unit being displayed in the first display area to the external electronic device.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when an input device connected to the external electronic device exists, excluding the content control unit of the second display area, The method may further include transmitting screen information of the content display unit being displayed in the display area and an external manipulation UI including shortcut keys mapped to application manipulation of the electronic device through an input device of the external electronic device. there is.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when there is no input device connected to the recognized external electronic device, excluding the content control unit of the second display area, The method may include transmitting screen information of the content display unit being displayed in the first display area to the external electronic device.

Accordingly, the electronic device can share an application screen optimized for the situation of the connected external electronic device, and additionally provides the external electronic device with an interface that can utilize the input device of the connected external electronic device, thereby enabling electronic devices to be used in the external electronic device environment. A service that controls the application operation of a device can be provided. The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

FIG. 1 is a block diagram of an electronic device 101 in a network environment according to various embodiments.
FIG. 2A illustrates the front and rear sides of a foldable electronic device in an unfolded state, according to various embodiments.
FIG. 2B is a diagram illustrating a folded state of the foldable electronic device 101 according to various embodiments.
FIG. 2C illustrates an intermediate state or unfolded state of the foldable electronic device 101 according to embodiments.
Figure 3 shows an example of an electronic device and an external electronic device according to an embodiment.
4 is a simplified block diagram of an electronic device according to various embodiments.
Figure 5 illustrates a method of providing an application screen to an external display device in a foldable electronic device according to an embodiment.
Figure 6 illustrates a method of providing an application screen to an external display device in a foldable electronic device, according to an embodiment.
Figures 7 to 9 illustrate examples in which an electronic device provides different application screens depending on the type of external electronic device, according to an embodiment.
10 to 15 illustrate screens in which an external display device provides application execution screens for each application in an electronic device, according to one embodiment.
FIG. 16 illustrates an example of a change in a screen provided by an external display device to an application execution screen in an electronic device, according to embodiments of the present invention.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores instructions or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, coprocessor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself, where artificial intelligence is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, connected to the plurality of antennas by the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

FIG. 2A is a diagram illustrating the front and rear sides of a foldable electronic device in an unfolded state according to various embodiments, and FIG. 2B illustrates a folded state of a foldable electronic device according to various embodiments. It is a drawing. FIG. 2C is a diagram illustrating an intermediate state or unfolded state of a foldable electronic device according to one embodiment.

2A to 2C, a foldable electronic device (e.g., electronic device 101 of FIG. 1) according to various embodiments includes a first surface 211 and a third surface 213. It may include a housing 210 and a second housing 220 including a second side 221 and a fourth side 223. The first side 211 of the first housing 210 and the second side 221 of the second housing 220 represent the front of the electronic device 101, as shown in <2001>, and the first housing 210 The third side 213 of 210 and the fourth side 223 of the second housing 220 may represent the rear side of the electronic device 101, as shown in <2002>.

The first housing 210 and the second housing 220 are disposed on both sides about a folding axis (eg, A-axis), and may have an overall symmetrical shape with respect to the folding axis. The first housing 210 and the second housing 220 may be designed to be folded relative to each other. Between the first housing 210 and the second housing 220, there is at least one hinge device (e.g., a hinge module or a hinge structure) 260 so that the housing 210 and the second housing 220 can be folded with respect to each other. is formed, so that the front of the electronic device 101 can be folded.

The angle or distance between the first housing 210 and the second housing 220 varies depending on whether the electronic device 101 is in an unfolded (or open) state, a folded (or closed) state, or an intermediate state. You can. For example, the unfolding state may mean an open state, an open state, or a flat (or flat) state. The unfolded state is a state in which the first housing 210 and the second housing 220 are arranged side by side, and may mean a state in which the electronic device 101 is fully unfolded. In the unfolded state, the angle between the first housing 210 and the second housing 220 is 180 degrees, and the first side 211 of the first housing 210 and the second side of the second housing 220 The surfaces 221 may be arranged to face the same direction (eg, the first direction).

The folded state (folding state) may mean a folded state, a closed state, or a closed state (e.g., Figure 2b). The folded state is a state in which the first housing 210 and the second housing 220 are disposed to face each other, and may mean a state in which the electronic device 101 is completely folded. In the folded state, the angle between the first housing 210 and the second housing 220 forms a narrow angle (e.g., 0 degrees to 5 degrees), and the first surface 211 of the first housing 210 and the second housing 210 form a narrow angle (e.g., 0 degrees to 5 degrees). 2 The second sides 221 of the housing 220 may face each other. Below, the electronic device 101 implemented in an in-folding method is described, but the same or similar method is applied to the electronic device 101 implemented in an out-folding method. It can be implemented.

The intermediate state is a state in which the first housing 210 and the second housing 220 are arranged at a certain angle, and the electronic device 101 may not be in the unfolded state or the folded state (e.g. :Figure 2c). The intermediate state may mean a state in which the first surface 211 of the first housing 210 and the second surface 221 of the second housing 220 form a certain angle (e.g., 6 degrees to 179 degrees). there is.

The electronic device 101 has a first display 230 (e.g., main display) (e.g., the display module 160 of FIG. 1) on the first side 211 and the second side 221, which are the front of the electronic device 101. )) can be formed. The first display 230 may be formed entirely on the front surface (eg, in the first direction of the electronic device 101). The first display 230 may refer to a flexible display in which at least some areas can be transformed into a flat or curved surface. The first display 230 may include a first display area corresponding to the first side 211 or a second display area corresponding to the second side 221 . Additionally, the electronic device 101 may place the first camera 214 on the second side 221. Although the drawing shows one first camera 214, there may be a plurality of first cameras 214. Although the drawing shows that the first camera 214 is disposed on the second surface 221, the first camera 214 may also be formed on the first surface 211.

Additionally, the electronic device 101 may form a second display 240 (e.g., sub-display, cover display) (e.g., display module 160 of FIG. 1) on a portion of the rear surface of the electronic device 101. . The second display 240 may be formed on at least a portion of the third surface 213 of the electronic device 101. The electronic device 101 may include a plurality of cameras (eg, 215, 217, 219, and 225) on the rear 250 of the electronic device 101. For example, the electronic device 101 arranges the second camera 215, the third camera 217, and the fourth camera 219 on the fourth side 223, and the fifth camera 219 on the third side 213. A camera 225 can be placed. According to various embodiments, the second camera 215, the third camera 217, the fourth camera 219, and the fifth camera 225 may have the same or different performance (e.g., angle of view, resolution). You can. For example, the second camera 215 has a field of view greater than 125 degrees (e.g., ultra wide), the third camera 217 has a view angle of 90 to 125 degrees (e.g., wide), and the fourth The camera 219 may have a 90-degree field of view and a 2x zoom (e.g., tele), and the fifth camera 225 may have a 90-degree field of view and a normal magnification. The electronic device 101 may further include a sensor area 241 on the fourth side 223. Similar to the sensor module 176 of FIG. 1, an infrared sensor, a fingerprint sensor, or an illumination sensor may be placed in the sensor area 241.

According to one embodiment, when the electronic device 101 is in an unfolded state (e.g., FIG. 2A), the first display 230 is on (or activated), and the second display 240 is off. ) (or deactivated). If a user input (e.g., touch, button selection) is not detected for a certain period of time (e.g., 5 seconds, 10 seconds, or 1 minute) while the first display 230 is turned on, the electronic device 101 turns on the first display 230. (230) can be turned off. Alternatively, when a user input (e.g., touch, button selection) is detected on the second display 240 while the second display 240 is turned off, the electronic device 101 turns on the second display 240. You can. According to various embodiments, when the second display 240 is turned on, the first display 230 may be turned off. Alternatively, even if the second display 240 is turned on, the electronic device 101 maintains the first display 230 in the on state for a certain time and then displays the user on the first display 230 even after a certain time has elapsed. When no input is detected, the first display 230 can be turned off.

The electronic device 101 may further include a sensor module (eg, sensor module 176 in FIG. 1). For example, the electronic device 101 may include a sensor module 176 in at least one of the first housing 210 or the second housing 220. The sensor module 176 may include at least one of an acceleration sensor, a gyroscope sensor, a geomagnetic sensor, a proximity sensor, an illumination sensor, a gesture sensor, or a hall sensor. An acceleration sensor is a sensor that detects speed, and a gyroscope sensor can detect the angular velocity, which is the rotation speed of an object. A geomagnetic sensor is a sensor that detects geomagnetism, and like a compass, it can detect geomagnetic directions (e.g., azimuth) such as east, west, south, and north. A proximity sensor detects whether an object is close, and an illuminance sensor can measure the amount of surrounding light (e.g., illuminance) in real time or periodically. Gesture sensors can detect infrared rays. Hall sensors can detect changes in electrical signals based on the proximity or distance of an object with magnetic force (or magnetic force). When a Hall sensor is used to detect the folding state of the electronic device 101, the electronic device 101 may further include a magnet corresponding to the Hall sensor.

As shown in <2003> and <2004>, the electronic device 101 has a hinge device 260 formed around a folding axis (e.g., A axis), so that the front of the electronic device 101 is in a folded state ( For example, it may be in a closed state). FIG. 2B is a diagram showing the third side 213 of the first housing 210 and the fourth side 223 of the second housing 220 when the electronic device 101 is in a folded state.

According to one embodiment, when the electronic device 101 is in a folded state, the first display 230 may be turned off and the second display 240 may be turned on. If a user input is not detected for a certain period of time while the second display 240 is turned on, the electronic device 101 may turn off the second display 240. When the electronic device 101 is in a folded state and the second display 240 is turned off, and a button formed on (or mounted on) the electronic device 101 is selected, the electronic device 101 displays the second display 240. ) can be turned on. Alternatively, when the electronic device 101 is in a folded state, the second display 240 is turned off, and a user input is detected on the second display 240, the electronic device 101 displays the second display 240. can be turned on.

The foldable electronic device of FIGS. 2A and 2B is an example of an electronic device 101 with two parallel sides (e.g., top and bottom sides or left and right sides) having similar lengths, and the foldable electronic device of FIG. 2C is an example of the electronic device 101 having two sides parallel to each other (e.g., top and bottom sides or left and right sides). This shows an example of the electronic device 101 where the first length of the side (eg, top and bottom sides) is longer or shorter than the second length of the other two sides (eg, left and right sides). The foldable electronic device of FIGS. 2A and 2B and the foldable electronic device of FIG. 2C may have the same or similar structure or operation except that the external appearance of the electronic device 101 is different.

As shown in <2005>, the electronic device 101 has a hinge device 260 formed around a folding axis (e.g., A axis), so that the first housing 210 and the second housing 220 are kept at a constant position. It may be an intermediate state forming an angle. For example, in the intermediate state, one side of the first housing 210 or the second housing 220 is placed on the floor, and the second housing 220 placed on the floor and the first housing 210 not placed on the floor are kept constant. An angle can be formed. In the drawing, the fourth side 223 of the second housing 220 is placed on the floor, and the first side 211 of the first housing 210 and the second side 221 of the second housing 220 are constant. It shows the state of forming an angle.

According to one embodiment, in the intermediate state 201, the first display 230 may be activated and a user interface may be displayed through the first display 230. The user interface may be displayed on the entire screen of the first display 230, or may be divided into two parts (or areas), such as a split screen. Alternatively, in the intermediate state, an output unit (e.g., an application execution screen) is displayed through the first surface 211 of the first housing 210, and an input unit is displayed through the second surface 221 of the second housing 220. (e.g. keypad) may be displayed. As shown in <2005>, the electronic device 101 has a cover display (e.g., the display module of FIG. 1 ( 160) and the second display 240 of FIGS. 2A to 2C. A plurality of cameras 215-217 and a sensor area 241 may be further included next to the second display 240.

The following embodiments will be described assuming that the electronic device 101 is a foldable electronic device, but it is not limited thereto. In addition, in addition to the foldable electronic device, various electronic devices that provide an application screen that changes to a standard UI mode and a split screen UI mode according to a change in the state of the electronic device 101 or a change in the display structure include various examples described in this disclosure. It can be applied.

Standard UI mode displays the application screen in a single layout without dividing it into a content display unit (or viewing area) that displays content and a content control unit (or interaction area) that receives application manipulation input. It can mean a mode that does. Screen split UI mode refers to a mode in which the layout is divided and displayed into two parts, such as a content display unit and a content control unit, and may be referred to as flex mode.

Figure 3 shows an example of an electronic device and an external electronic device according to an embodiment.

Referring to FIG. 3, in one embodiment, the electronic device 101 (e.g., the electronic device 101 of FIG. 1 and the electronic device 101 of FIGS. 2A to 2C) may be implemented as a foldable electronic device, The external electronic device 301 may be implemented as a computing device such as a desktop PC, laptop PC, or notebook computer, or a display device such as a tablet PC, monitor, or TV.

According to one embodiment, the electronic device 101 may execute an application. For example, the electronic device 101 may provide an application execution screen on the display 310 of the electronic device 101 in a standard UI mode based on application execution.

According to one embodiment, the electronic device 101 displays an application execution screen when an application is executed according to application settings, or according to a state change (or display state change) of the electronic device 101 (e.g., closed state → open state). can be provided to the display 310 in a split screen UI mode.

For example, the first housing of the electronic device 101 shown in FIGS. 2A to 2C (e.g., the first housing 210 in FIGS. 2A to 2C) and the second housing (e.g., the first housing 210 in FIGS. 2A to 2C) When the second housing 220 maintains a folded state at a certain angle (e.g., the display 310 is folded), the electronic device 101 executes an application based on a change in the display area of the display displaying information. The screen layout can be changed from the standard UI mode to the split screen UI mode and provided to the display 310. For example, in the posture of the electronic device 101 shown in FIG. 3, the screen split UI mode is a content display unit (or A viewing area) is provided, and the second display area 315 may display a content manipulation unit (or interaction area) that receives application manipulation input.

In the split screen UI mode, the layout shape may be dynamically changed depending on the posture of the electronic device 101 (e.g., landscape or portrait mode), the positions of the housings (or folding angles), and the display active area.

According to one embodiment, the electronic device 101 and the external electronic device 301 may be connected to each other through wired or wireless communication. For example, the electronic device 101 and the external electronic device 301 may include high definition multimedia interface (HDMI), universal serial bus (USB), recommended standard 232 (RS-232), power line communication, or plain old telephone service (POTS). ) can be connected to each other through a wired interface, such as Wi-Fi direct, or a short-range wireless communication network such as Bluetooth.

According to one embodiment, when the electronic device 101 and the external electronic device 301 are connected through wired or wireless communication, the electronic device 101 may provide a screen sharing service to the external electronic device 301. The screen sharing service is a service that allows the execution screen of an application running on the electronic device 101 to be used on an external electronic device 301 (or an external display device) using virtualization technology, such as mirroring or Link to Windows. Or it could be a function.

According to one embodiment, when the electronic device 101 and the external electronic device 301 are connected through a wired or wireless interface, the electronic device 101 displays an application execution screen in response to execution of the screen sharing service to the external electronic device ( 301). The external electronic device 301 may display the application execution screen received from the electronic device 101 on the display 350 of the external electronic device 301.

According to one embodiment, the electronic device 101 displays a split screen UI in a state in which the first housing 2100 and the second housing 220 are folded at a certain angle (e.g., the display 310 is folded or bent). When an application is running in mode and connected to an external electronic device for a screen sharing service, environmental conditions of the connected external electronic device 301 (e.g., whether an input device connected to the external electronic device 301 exists, input device type) ), screen sharing data (or mirroring data) can be configured differently.

For example, when there is no input device connected to the external electronic device 301, the electronic device 101 displays the screen information being output on the content display portion that displays the content, excluding the content control portion during the split screen UI mode. The included first screen sharing data can be transmitted to the external electronic device 301.

For another example, when there is an input device connected to the external electronic device 301, the electronic device 101 excludes the content control panel during the split screen UI mode and displays the screen information being displayed on the content display unit that displays the content and the external electronic device 301. Second screen sharing data including an external manipulation UI including shortcut keys mapped to application manipulation of the electronic device 101 may be transmitted to the external electronic device 301 through the input device of the electronic device 301.

Optionally, the electronic device 101 may provide an external manipulation UI to at least a portion of the content manipulation unit displayed on the second display area 315 depending on the situation (eg, whether or not the content manipulation unit is activated). The user may check manipulation information using the input device of the external electronic device 301 through the electronic device 101 while the application screen of the electronic device 101 is displayed on the external electronic device 301 .

While the application screen running in the electronic device 101 is displayed on the display 350 of the external electronic device 301, the electronic device 101 detects it through the content control panel during the screen split UI mode of the electronic device 101. The application running on the electronic device 101 can be controlled based on user input or user input through an input device of the external electronic device 301.

4 is a simplified block diagram of an electronic device according to various embodiments.

Referring to FIG. 4, the electronic device 101 (e.g., the electronic device 101 in FIGS. 2A to 2C) includes a display 410, a processor 420, a memory 430, a communication interface 440, and a sensor ( 450) and may further include at least some of the configuration and/or functions of the electronic device 101 of FIG. 1.

According to one embodiment, the display 410 is a foldable display (e.g., an in-foldable display, an out-foldable display) that can be folded at least in part. It may be a rollable display that can be rolled at least in part. For example, display 410 may be a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, or a micro It may be implemented as either a micro electro mechanical systems (MEMS) display or an electronic paper display, but is not limited thereto.

According to one embodiment, the electronic device 101 may include two or more displays that are independent from each other. For example, the display 410 may include a first display 411 and a second display 413. The display 410 may include at least some of the configuration and/or functions of the display module 160 of FIG. 1 .

According to one embodiment, the communication interface 440 may support a wired or wireless communication connection with an external battery device (eg, the external electronic device 301 of FIG. 3). For example, the communication interface 440 is an example of a wired communication interface (e.g., interface 177 in FIG. 1) and may include a high definition multimedia interface (HDMI) and a universal serial bus (USB) interface. The communication interface 440 may include a wireless communication module (eg, the wireless communication module 192 of FIG. 1) that supports an external device and a short-range communication module. The wireless communication module can support a variety of short-range wireless communication methods (e.g. Wi-Fi, Bluetooth, BLE (bluetooth low energy)), and has independent hardware and/or software configuration to support each wireless communication method. may include.

According to one embodiment, the communication interface 440 operates on an execution screen (e.g., an application execution screen) of the electronic device 101 based on execution of a screen sharing service with the external electronic device 270 under the control of the processor 420. Screen sharing data (e.g., first screen sharing data or second screen sharing data) related to may be transmitted to the external electronic device 301.

According to one embodiment, the sensor 450 is configured to detect various states related to the operation of the electronic device 101 (e.g., the posture of the electronic device 101, the combined state of the housings, or the variable state of the display 410, etc.) or the environmental state ( For example, position, speed, temperature, etc.), generate an electrical signal or measurement value corresponding to the detected state, and transmit the measurement value to the processor 120. For example, the sensor 450 may include, but is not limited to, an angle sensor, a gyro sensor, a magnetic sensor, an acceleration sensor, a proximity sensor, or an illumination sensor.

According to one embodiment, the sensor 450 detects the folding angle (θ) of the electronic device 101 or the folded state of the display 101 based on the measured value, and sends the folding angle information or display state to the processor 420. Information can be conveyed. The processor 420 may change the layout of the application display mode being displayed on the display 410 (e.g., standard UI mode ↔ split screen UI mode) based on the folding angle information or display state information transmitted from the sensor.

The memory 430 can store various instructions that can be executed by the processor 420. These instructions may include various control instructions including arithmetic and logical operations, data movement, and/or input/output that can be recognized by processor 420.

According to one embodiment, the memory 430 may store layout information of standard UI mode and split screen UI mode for each application. For example, the split screen UI mode may be preset for each supportable application, and depending on the setting, only one area of the content display area and the content control area (e.g., the content control area may be excluded) may be activated.

According to one embodiment, the memory 430 has pre-mapped shortcut keys using the input device of the external electronic device 301 in response to control commands for application manipulation for each application in relation to the screen sharing service in the split screen UI mode. The configuration information of the external operation UI can be saved.

For example, when the application is a media playback application, the electronic device 101 may map shortcut key information of the external manipulation UI using a keyboard device as shown in [Table 1] in response to the media playback application.

application Shortcut keys (=operation keys) Video task Photo task media Shift + Enter (or space) Start or pause the video being played - Shift + < (or P ) Select previous video Select previous photo Shift + > (or N) Select next video Select next photo Shift + < + < (or B ) Move forward 10 seconds in the playing video - Shift + > + > (or F) Go back 10 seconds to the playing video - Shift + M Sound mute setting - Shift + S Share the playing video share photos

The above-described [Table 1] is only an example for convenience of explanation, and the electronic device 101 can set or store in advance the configuration information of the external operation UI for each application, and may be configured for each type of input device. . For example, in the case of a media playback application, [Table 1] shows the configuration information of the manipulation UI using a keyboard device, but the configuration information of the external manipulation UI using a remote control device may be set separately or stored in advance.

According to one embodiment, the processor 420 is a component (e.g., an application processor) capable of performing operations or data processing related to control and/or communication of each component of the electronic device 101, and is the processor of FIG. 1. It may include at least some of the configurations and/or functions of 120. The processor 420 operates operatively and functionally with each component of the electronic device 101, including the display 410, the communication interface 440, the memory 430, and the sensor 450. and/or may be electrically connected.

An electronic device (e.g., the electronic device 101 in FIGS. 1, 2A to 2C, 3, and 4) according to an embodiment includes first housings disposed on both sides of a folding axis and folded relative to each other. It may include a second housing (e.g., the first housing 210 in FIGS. 2A to 2C) and a second housing (e.g., the second housing 220 in FIGS. 2A to 2C). The electronic device 101 includes a first display (e.g., the display module 160 in FIG. 1, the display 310 in FIG. 3, and the display 310 in FIG. 4) arranged to face a first direction of the first housing and the second housing. Display 410) may be included. The electronic device 101 may include a communication interface (communication interface 440 in FIG. 4). The electronic device 101 may include memory (eg, memory 130 in FIG. 1 and memory 430 in FIG. 4). The electronic device 101 may include a processor (eg, the processor 120 of FIG. 1 and the processor of FIG. 4) operatively connected to the first display, the communication interface, and the memory.

According to one embodiment, the processors 120 and 420 display a content display unit in the first display area of the first display corresponding to the first housing while the first housing and the second housing are folded at a certain angle. The application execution screen may be set to be displayed in a split screen UI mode displaying a content control unit in the second display area of the first display corresponding to the second housing.

According to one embodiment, when the processor 120 or 420 displays an application execution screen in the split screen UI mode and a screen sharing service is executed, an external electronic device (e.g., : Can be set to recognize the external electronic device 301 in FIG. 3).

According to one embodiment, when there is no input device connected to the recognized external electronic device, the processors 120 and 420, excluding the content manipulation unit of the second display area, display the information being displayed in the first display area. It may be set to transmit screen information of the content display unit to the external electronic device.

According to one embodiment, when an input device connected to the external electronic device exists, the processors 120 and 420 control the content display unit being displayed on the first display area, excluding the content manipulation unit of the second display area. It can be set to transmit an external manipulation UI including screen information and shortcut keys mapped to application manipulation of the electronic device to the external electronic device through the input device of the external electronic device.

According to one embodiment, when an input device is present in the external electronic device, the processors 120 and 420 check whether the content manipulation unit displayed on the second display area during the split screen UI mode is activated, and , when the content manipulation unit is not activated, the external manipulation UI may be set to be transmitted to the external electronic device.

According to one embodiment, when the content manipulation unit is activated, the processors 120 and 420 transmit the external manipulation UI to the external electronic device and display the external manipulation UI in at least a portion of the second display area. It can be set to provide additional information.

According to one embodiment, the electronic device 101 may further include a second display disposed to face a second direction opposite to the first direction of either the first housing or the second housing.

According to one embodiment, the electronic device 101 and the external electronic device 301 may be connected through wireless or wired communication through the communication interface.

According to one embodiment, the processors 120 and 420 determine whether the external electronic device exists and input device based on device information obtained from the external electronic device in the process of connecting with the external electronic device based on the screen sharing service. It can be set to check the type of.

According to one embodiment, the device information includes at least one of device recognition information that identifies the device, device function information that represents function information that can be performed within the device, or device command information that represents command information for device control. It can be included.

According to one embodiment, when the processors 120 and 420 cannot identify an input device connected to the external electronic device in the process of connecting with an external electronic device based on the screen sharing service, the processor 120, 420 connects the external electronic device through the communication interface. The device may be further configured to request information about the type of an input device connected to the device to an external electronic device and to receive input device information connected to the external electronic device from the external electronic device.

According to one embodiment, the screen split UI mode may be set to automatically enter when the application is executed according to application settings.

According to one embodiment, the application execution screen may support a standard UI mode in which the application execution screen is displayed in a single layout without being divided into a content display unit that displays content and a content control unit that receives application manipulation input.

According to one embodiment, the processors 120 and 420 execute the application based on the fact that the first housing and the second housing are folded at a certain angle while displaying the application execution screen in the standard UI mode. The execution screen may be further configured to be displayed by changing it to the split screen UI mode.

According to one embodiment, the external manipulation UI is configured to correspond to the input device type of the external electronic device for each application, and configuration information of the external manipulation UI may be stored in the memory.

According to one embodiment, the external manipulation UI may be configured to include a removal item for removing the external manipulation UI.

According to one embodiment, when displaying the application execution screen in the split screen UI mode, the processors 120 and 420 display a sub-image in the second display area that is linked to the screen being displayed in the first display area. If provided, it may be set to additionally transmit screen information about the sub-image to the external electronic device when executing the screen sharing service.

Hereinafter, there will be no limitation to the calculation and data processing functions that the processor 420 can implement on the electronic device 101, but various embodiments related to the screen sharing service will be described. The operations of the processor 420 in FIGS. 5 and 6, which will be described later, can be performed by executing instructions stored in the memory 430.

Figure 5 illustrates a method of providing an application screen to an external display device in a foldable electronic device according to an embodiment.

In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

Referring to FIG. 5, a processor (e.g., the processor 120 of FIG. 1, the processor of FIG. 4) of an electronic device (e.g., the electronic device 101 of FIGS. 1, 2A to 2C, and FIG. 3) according to an embodiment. 420 indicates that in operation 510, the first housing (e.g., the first housing 210 in FIGS. 2A to 2C) and the second housing (e.g., the second housing 220 in FIGS. 2A to 2C) are folded to a certain degree. While maintaining the folded state at an angle (e.g., the display 310 is folded), the display (e.g., the first display (e.g., the display module 160 of FIG. 1, the display 310 of FIG. 3), FIG. The content display unit is displayed in the first display area (e.g., the first display area 311 of FIG. 3) of the display 410 of FIG. 4, and the content is displayed in the second display area (e.g., the second display area 315 of FIG. 3). You can run the application in split-screen UI mode that displays the control panel.

According to one embodiment, the processors 120 and 420 are based on folding angle (θ) information or display state information transmitted from a sensor (e.g., sensor module 176 in FIG. 1 and sensor 450 in FIG. 4). , the unfolded or folded state of the housings 210 and 220 can be confirmed. The folding angle θ may be understood as the angle formed between the first housing 210 and the second housing 220. The processors 120 and 420 may change the layout of the application display mode being displayed on the display 410 (e.g., standard UI mode ↔ split screen UI mode) based on the unfolded or folded state of the housings 210 and 220.

For example, the processors 120 and 420 are configured to fold the currently activated display 410 at a certain folding angle based on the folding angle θ of the first housing 210 and the second housing 220 (e.g. : Based on the display 310 being changed to a folded state), the layout of the running application execution screen can be displayed by changing from the standard UI mode to the split screen UI mode.

In operation 520, the processors 120 and 420 may execute a screen sharing service function with an external electronic device (e.g., the external electronic device 301 in FIG. 3) while the application is running in the split screen UI mode. For example, while executing an application in split screen UI mode, the processors 120 and 420 establish a communication interface with the external electronic device 301 (e.g., the communication module 190 of FIG. 1) based on a screen sharing service execution request being received. ), can be connected through the communication interface 440 of FIG. 4).

In operation 530, the processors 120 and 420 may recognize the connected external electronic device 301 based on execution of the screen sharing service. According to one embodiment, operation 530 may be performed during the connection process with the external electronic device 301, and may be performed before operation 520.

For example, the processors 120 and 420 may form a mirroring session by connecting to the external electronic device 301 through wired or wireless communication. In the process of forming a mirroring session, the processors 120 and 420 may obtain device information from the external electronic device 301. Device information includes device recognition information that identifies the device (e.g. device ID, manufacturer, serial number, etc.), device capacity information that indicates function information that can be performed within the device, or command information for device control. It may include at least one of device instruction information representing.

In operation 540, the processors 120 and 420 may check whether an input device exists in the external electronic device 301 connected to the electronic device 101 for the screen sharing service.

For example, the processors 120 and 420 determine whether an input device connected to the external electronic device 101 exists based on device information obtained from the external electronic device 301 and provide type information of the input device (e.g. keyboard, remote control, etc.). For example, an electronic device determines the device type (e.g., a TV device that can be controlled by a remote control, a desktop PC that can be controlled by a keyboard, or a notebook) based on device information (e.g., device ID, device instruction information) delivered by a communication protocol protocol. You can check or identify the device (a monitor, a tablet PC, or a display device without an input device).

According to one embodiment, when the processors 120 and 420 cannot confirm or identify the device type, the processors 120 and 420 send type information of the input device connected to the external electronic device 301 through the communication interface 440 to the external electronic device 301. ), and input device information connected to the external electronic device 301 can also be received from the external electronic device 301.

In operation 560, when an input device connected to the external electronic device 301 exists, the processors 120 and 420 display screen information being output on the content display unit of the first display area 311 in the split screen UI mode and the external electronic device. Second screen sharing data including an external manipulation UI composed of shortcut keys capable of manipulating the application of the electronic device 101 can be transmitted to the external electronic device 301 through the input device 301 .

For example, the processors 120 and 420 maintain the first housing 210 and the second housing 220 in a folded state at a certain folding angle (e.g., the display 310 in a folded state) while maintaining the split screen UI. The application running in the mode can be confirmed, and second screen sharing data can be generated based on the configuration information of the external operation UI stored in the memory 430 in response to the confirmed application. The configuration information of the external manipulation UI may be configuration information of the external manipulation UI to which shortcut keys used to manipulate the application are mapped through the input device of the external electronic device 301 in response to the application control command.

For example, if the input device connected to the external electronic device 301 is a remote control device, the electronic device 101 may display an external manipulation UI consisting of an application control command mapped to the remote control's volume key or channel change key and a screen split UI. Excluding the content control unit during the mode, the screen information being displayed on the content display unit can be transmitted to the external electronic device 301 along with the screen information. The external electronic device 301 provides an external manipulation UI to the display of the external electronic device 301 (e.g., the external electronic device display 350 in FIG. 3) along with the screen being displayed on the content display unit of the electronic device 101. can do.

According to one embodiment, when displaying an application execution screen in the split screen UI mode, the electronic device 101 displays a sub-image linked to the content display unit displayed in the first display area on the content manipulation unit of the second display area. When provided, screen information about the sub-image may be additionally transmitted to an external electronic device when executing the screen sharing service.

According to one embodiment, when a user input signal is detected through an input device of the external electronic device 301, the electronic device 101 may transmit an input signal based on the input device to the electronic device 101. The electronic device 101 can control the running application based on the user input signal from the external electronic device 101 as well as the user input detected by the electronic device 101, and display the controlled application execution screen on the external electronic device 101. You can share it with (301).

In operation 560, when there is no input device connected to the external electronic device 301, the processors 120 and 420, excluding the content control unit being output to the second display area 315 in the split screen UI mode, display the first First screen sharing data including screen information being displayed on the content display unit of the display area 311 may be transmitted to the external electronic device 301.

Figure 6 illustrates a method of providing an application screen to an external display device in a foldable electronic device, according to an embodiment.

In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. Additionally, some of the operations in FIG. 6 are the same as those in FIG. 5, and examples described in FIG. 5 can be equally applied.

Referring to FIG. 6, a processor (e.g., the processor 120 of FIG. 1, the processor of FIG. 4) of an electronic device (e.g., the electronic device 101 of FIGS. 1, 2A to 2C, and FIG. 3) according to an embodiment. 420 indicates that in operation 610, the first housing (e.g., the first housing 210 in FIGS. 2A to 2C) and the second housing (e.g., the second housing 220 in FIGS. 2A to 2C) are folded to a certain degree. While maintaining the folded state at an angle (e.g., the display 310 is folded), the display (e.g., the first display (e.g., the display module 160 of FIG. 1, the display 310 of FIG. 3), FIG. The content display unit is displayed in the first display area (e.g., the first display area 311 of FIG. 3) of the display 410 of FIG. 4, and the content is displayed in the second display area (e.g., the second display area 315 of FIG. 3). You can check whether the application is running in split-screen UI mode that displays the control panel.

For example, the processors 120 and 420 are configured to fold the currently activated display 410 at a certain folding angle based on the folding angle θ of the first housing 210 and the second housing 220 (e.g. : Based on the display 310 being changed to a folded state), the layout of the running application execution screen can be displayed by changing from the standard UI mode to the split screen UI mode.

If the processor 120 or 420 is not executing the application in the split screen UI mode, the process of FIG. 6 may be terminated.

In operation 620, the processors 120 and 420 may check whether the screen sharing service function with an external electronic device (e.g., the external electronic device 301 of FIG. 3) is being executed while the application is running in the split screen UI mode. .

For example, while executing an application in split screen UI mode, the processors 120 and 420 establish a communication interface with the external electronic device 301 (e.g., the communication module 190 of FIG. 1) based on a screen sharing service execution request being received. ), can be connected through the communication interface 440 of FIG. 4). The processors 120 and 420 may recognize the connected external electronic device 301 based on execution of the screen sharing service. For example, the processors 120 and 420 may form a mirroring session by connecting to the external electronic device 301 through wired or wireless communication. In the process of forming a mirroring session, the processors 120 and 420 may obtain device information from the external electronic device 301. Device information includes device recognition information (e.g. device ID, manufacturer, serial number, MAC, etc.), device capacity information indicating function information that can be performed within the device, or command information for device control. It may include at least one of device instruction information.

If the processor 120 or 420 does not execute the screen sharing service function while the application is running in the split screen UI mode, the process of FIG. 6 may be terminated.

In operation 630, the processors 120 and 420 may check whether an input device exists in the external electronic device 301 connected to the electronic device 101 for the screen sharing service.

For example, the processors 120 and 420 determine whether an input device connected to the external electronic device 101 exists based on device information obtained from the external electronic device 301 and provide type information of the input device (e.g. keyboard, remote control, etc.). For example, an electronic device determines the device type (e.g., a TV device that can be controlled by a remote control, a desktop PC that can be controlled by a keyboard, or a notebook) based on device information (e.g., device ID, device instruction information) delivered by a communication protocol protocol. You can check or identify the device (a monitor, a tablet PC, or a display device without an input device).

According to one embodiment, when the processors 120 and 420 cannot confirm or identify the device type, the processors 120 and 420 send type information of the input device connected to the external electronic device 301 through the communication interface 440 to the external electronic device 301. ), and input device information connected to the external electronic device 301 can also be received from the external electronic device 301.

In operation 640, when there is no input device connected to the external electronic device 301, the processors 120 and 420, excluding the content control unit being output to the second display area 315 in the split screen UI mode, display the first First screen sharing data including screen information being displayed on the content display unit of the display area 311 may be transmitted to the external electronic device 301.

In operation 650, if an input device connected to the external electronic device 301 exists, the processors 120 and 420 may check whether the content manipulation unit is activated during the split screen UI mode.

For example, when an application is running in split screen UI mode, the user removes the display of the content control panel, does not display the content control panel according to the application settings (e.g. YouTube app), or shares the screen according to the application settings. If the service provides only the area (e.g., viewing area) where content is displayed on the app execution screen to the external electronic device, the electronic device 101 may recognize that the content control unit is not activated.

In operation 660, when the processors 120 and 420 recognize that the content manipulation unit is not activated, the screen information being output on the content display unit of the first display area 311 in the split screen UI mode and the external electronic device 301 are displayed. Second screen sharing data including an external manipulation UI composed of shortcut keys capable of manipulating the application of the electronic device 101 can be transmitted to the external electronic device 301 through the input device.

In operation 670, when the processors 120 and 420 recognize that the content manipulation unit is activated, they may add and provide an external manipulation UI to at least a portion of the content manipulation unit being output to the second display area. Optionally or additionally, in operation 670, the processors 120 and 420 may transmit an external manipulation UI to the external electronic device 301 along with screen information being displayed on the content display unit of the first display area 311.

According to one embodiment, when displaying an application execution screen in the split screen UI mode, the electronic device 101 displays a sub-image linked to the content display unit displayed in the first display area on the content manipulation unit of the second display area. When provided, screen information about the sub-image may be additionally transmitted to an external electronic device when executing the screen sharing service.

According to one embodiment, when a user input signal is detected through an input device of the external electronic device 301, the electronic device 101 may transmit an input signal based on the input device to the electronic device 101. The electronic device 101 can control the running application based on the user input signal from the external electronic device 101 as well as the user input detected by the electronic device 101, and display the controlled application execution screen on the external electronic device 101. You can share it with (301).

Figures 7 to 9 illustrate examples in which an electronic device provides different application screens depending on the type of external electronic device, according to an embodiment.

Referring to FIGS. 7 to 9 , an electronic device (e.g., the electronic device 101 of FIGS. 1, 2a to 2c, and FIG. 3) according to an embodiment includes a display (e.g., the display module 160 of FIG. 1). , the content display unit is displayed in the first display area (e.g., the first display area 311 in FIG. 3) of the display 310 in FIG. 3) and the display 410 in FIG. 4, and the second display area (e.g. : In the second display area 315 of FIG. 3, a screen sharing service with an external electronic device (e.g., the external electronic device 101 of FIG. 3) is provided while the application is running in a split screen UI mode in which the content control panel is displayed. When executed, different shared screen data may be provided to the external electronic device 301 depending on the situation conditions of the external electronic device 301. Because of this, users can experience various screen sharing environments depending on the external electronic device environment.

As shown in FIG. 7, according to one embodiment, the electronic device 101 displays a screen that displays a content display unit 710 in the first display area 311 and a content manipulation unit 715 in the second display area 315. In a situation where an application is running in split UI mode, it can be connected to an external electronic device 301, which is a tablet PC without an input device, for a screen sharing service.

The electronic device 101 can identify that the connected external electronic device 301 is a tablet PC device without an input device. Based on the fact that the external electronic device 301 is identified as a tablet PC device without an input device, the electronic device 101 excludes the content manipulation unit 715 and displays the first screen information including screen information being output on the content display unit 710. Screen sharing data can be transmitted to the external electronic device 301. The external electronic device 301 may display the application screen 730 of the electronic device 101 on the display 350 based on the first screen sharing data transmitted from the electronic device 301.

As shown in FIG. 8, according to one embodiment, the electronic device 101 displays a content display unit 810 in the first display area 311 and a content manipulation unit 815 in the second display area 315. When an application is running in split screen UI mode, it may be connected to an external electronic device 301, which is a TV device, for screen sharing service. The TV device can be connected to an input device, which is a remote control device 301-1.

The electronic device 101 can identify that the connected external electronic device 301 is a TV device connected to the remote control device 301-1. Based on being connected to the TV device, the electronic device 101 provides configuration information of the external operation UI set or stored in the currently running application (e.g., media playback app) (e.g., external operation UI using the shortcut keys of the remote control device). You can check. The electronic device 101, excluding the content manipulation unit 815, sends the second screen sharing data, including screen information being output to the content display unit 810 and an external manipulation UI using shortcut keys of the remote control device, to the external electronic device 301. It can be passed on.

The external electronic device 301 displays an external manipulation UI 845 using the shortcut keys of the remote control device along with the application screen 830 of the electronic device 101 based on the second screen sharing data transmitted from the electronic device 301. It can be displayed on the display 350.

For example, the external operation UI 845 using the shortcut keys of the remote control device includes shortcut key information using the volume keys (+, -) and channel change keys (,) of the remote control device, and the external operation UI 845 A removal item 840 for removal may be included, but this is only an example.

The user can control the operation of the application running on the electronic device 101 by operating the remote control device 301-1 through the external operation UI 845. Additionally, the user can control the operation of the application through the content manipulation unit 815 displayed on the electronic device 101.

As shown in FIG. 9, according to one embodiment, the electronic device 101 displays a screen that displays a content display unit 910 in the first display area 311 and a content manipulation unit 915 in the second display area 315. In a situation where an application is running in split UI mode, it may be connected to an external electronic device 301, which is a laptop device connected to a keyboard device, for a screen sharing service.

The electronic device 101 can identify that the connected external electronic device 301 is a laptop device. Based on the connection with the laptop device, the electronic device 101 provides configuration information of the external operation UI (e.g., external operation UI using shortcut keys of the keyboard device) set or stored in the currently running application (e.g., media playback app). You can check. The electronic device 101, excluding the content manipulation unit 915, sends the second screen sharing data, including screen information being output to the content display unit 910 and an external manipulation UI using shortcut keys of the keyboard device, to the external electronic device 301. It can be passed on.

The external electronic device 301 displays an external manipulation UI 945 using the shortcut keys of the keyboard device together with the application screen 930 of the electronic device 101 based on the second screen sharing data transmitted from the electronic device 301. It can be displayed on the display 350.

For example, the external operation UI 945 using the shortcut keys of the keyboard device includes shortcut key information using the enter key, shift key, and movement keys (↑, ↓) of the keyboard device, and the external operation UI 945 is removed. A removal item 940 may be included, but this is only an example.

The user can control the operation of the application running on the electronic device by operating the keyboard through the external operation UI 945. Additionally, the user can control the operation of the application through the content manipulation unit 915 displayed on the electronic device.

10 to 15 illustrate screens in which an external display device provides application execution screens for each application in an electronic device, according to one embodiment. The application execution screen and external operation UI shown in Figures 10 to 15 are only examples, and are not limited thereto, and may be replaced with an external UI using a remote control device, and the contents of the shortcut keys may be changed according to settings. there is.

Referring to FIG. 10, an electronic device (e.g., the electronic device 101 of FIGS. 1, 2A to 2C, and FIG. 3) includes a display (e.g., the display module 160 of FIG. 1, the display 310 of FIG. 3). ), the content display unit 1010 is displayed in the first display area (e.g., the first display area 311 in FIG. 3) of the display 410 in FIG. 4, and the content display unit 1010 is displayed in the second display area (e.g., the first display area 311 in FIG. 3). 2 In the display area 315), a screen sharing service with an external electronic device (e.g., the external electronic device 301 in FIG. 3) can be executed while the camera application is running in the split screen UI mode in which the content control unit 1015 is displayed. You can.

Here, the external electronic device 301 may be a monitor device connected to a keyboard (eg, Bluetooth keyboard or wired keyboard) device.

The electronic device 101 identifies that a monitor device connected to a keyboard (e.g., Bluetooth keyboard or wired keyboard) device is connected, and displays screen information and camera applications corresponding to the content display unit 1010, excluding the content manipulation unit 1015. An external manipulation UI using shortcut keys of a correspondingly set keyboard device can be provided to the external electronic device 301.

The external electronic device 301 displays an external manipulation UI 1035 using shortcut keys of a keyboard device along with a content display screen 1030 (e.g., camera preview area) of the camera application of the electronic device 101. ) can be displayed on the display 350.

According to one embodiment, when there is a preview image 1020 stored in the content manipulation unit 1015 in the camera application, the electronic device 101 sends the stored preview image 1020 to the external electronic device 301 according to the settings. You can send it. The external electronic device may display a preview image screen 1040 stored separately from the content display screen on the display 350.

Referring to FIG. 11, the electronic device 101 displays a content display unit 1110 on the first display area 311 of the display 310 and a content manipulation unit 1115 on the second display area 315. While the gallery application is running in split screen UI mode, a screen sharing service with the external electronic device 301 may be executed. Here, the external electronic device 301 may be a monitor device connected to a keyboard (eg, Bluetooth keyboard or wired keyboard) device.

The electronic device 101 identifies that a monitor device connected to a keyboard (e.g., Bluetooth keyboard or wired keyboard) device is connected, and displays screen information and gallery applications corresponding to the content display unit 1110, excluding the content manipulation unit 1115. An external manipulation UI using shortcut keys of a correspondingly set keyboard device can be provided to the external electronic device 301.

The external electronic device 301 displays an external manipulation UI 1135 using a shortcut key of the keyboard device together with the content display screen 1130 (e.g., gallery image area) of the gallery application of the electronic device 101. ) can be displayed on the display 350.

Referring to FIG. 12, the electronic device 101 displays a content display unit 1210 on the first display area 311 of the display 310 and a content manipulation unit 1215 on the second display area 315. While a video editor application is running in split screen UI mode, a screen sharing service with the external electronic device 301 may be executed. Here, the external electronic device 301 may be a monitor device connected to a keyboard (eg, Bluetooth keyboard or wired keyboard) device.

The electronic device 101 identifies that a monitor device connected to a keyboard (e.g., Bluetooth keyboard or wired keyboard) device is connected, and displays screen information and a video editor application corresponding to the content display unit 1210, excluding the content manipulation unit 1215. An external manipulation UI using shortcut keys of a keyboard device set in response can be provided to the external electronic device 301.

The external electronic device 301 displays an external operation UI 1235 using a shortcut key of the keyboard device along with the content display screen 1230 (e.g., video display area) of the video editor application of the electronic device 101 ( It can be displayed on the display 350 of 301).

Referring to FIG. 13, the electronic device 101 displays a content display unit 1310 on the first display area 311 of the display 310 and a content manipulation unit 1315 on the second display area 315. While a video call application is running in split screen UI mode, a screen sharing service with the external electronic device 301 may be executed. Here, the external electronic device 301 may be a monitor device connected to a keyboard (eg, Bluetooth keyboard or wired keyboard) device.

The electronic device 101 identifies that a monitor device connected to a keyboard (e.g., Bluetooth keyboard or wired keyboard) device is connected, and screen information and video calls ( An external manipulation UI using shortcut keys of a keyboard device set in response to a video call) application can be provided to the external electronic device 301.

The external electronic device 301 includes a content display screen 1330 (e.g., recipient image and sender image area) of the video call application of the electronic device 101, as well as an external operation UI (UI) using shortcut keys of the keyboard device. 1335 may be displayed on the display 350 of the external electronic device 301.

Referring to FIG. 14, the electronic device 101 displays a content display unit 1410 on the first display area 311 of the display 310 and a content manipulation unit 1415 on the second display area 315. While the avatar editing application is running in split screen UI mode, a screen sharing service with the external electronic device 301 may be executed. Here, the external electronic device 301 may be a monitor device connected to a keyboard (eg, Bluetooth keyboard or wired keyboard) device.

The electronic device 101 identifies that a monitor device connected to a keyboard (e.g., Bluetooth keyboard or wired keyboard) device is connected, and displays screen information and an avatar editing application corresponding to the content display unit 1410, excluding the content manipulation unit 1415. An external manipulation UI using shortcut keys of a keyboard device set in response can be provided to the external electronic device 301.

The external electronic device 301 displays an external manipulation UI 1435 using the shortcut keys of the keyboard device together with the content display screen 1430 (e.g., avatar image area) of the avatar editing application of the electronic device 101 ( It can be displayed on the display 350 of 301).

According to one embodiment, when an avatar image 1420 stored in the content manipulation unit 1415 exists in an avatar editing application, the electronic device 101 sends the stored avatar image 1420 to the external electronic device 301 according to settings. Can be sent together. The external electronic device 301 may display an avatar image screen 1440 stored separately from the content display screen 1430 on the display 350.

Referring to FIG. 15, the electronic device 101 displays a content display unit 1510 on the first display area 311 of the display 310 and a content manipulation unit 1515 on the second display area 315. While the calendar application is running in split screen UI mode, a screen sharing service with the external electronic device 301 may be executed. Here, the external electronic device 301 may be a monitor device connected to a keyboard (eg, Bluetooth keyboard or wired keyboard) device.

The electronic device 101 identifies that a monitor device connected to a keyboard (e.g., Bluetooth keyboard or wired keyboard) device is connected, and displays screen information and calendar applications corresponding to the content display unit 1510, excluding the content manipulation unit 1515. An external manipulation UI using shortcut keys of a correspondingly set keyboard device can be provided to the external electronic device 301.

The external electronic device 301 displays the content display screen 1530 (e.g., calendar image area) of the calendar application of the electronic device 101 and an external operation UI 1535 using shortcut keys of the keyboard device. ) can be displayed on the display 350.

FIG. 16 illustrates an example of a change in a screen provided by an external display device to an application execution screen in an electronic device, according to embodiments of the present invention.

Referring to FIG. 16, the electronic device (e.g., the electronic device 101 in FIGS. 1, 2a to 2c, and 3) changes the folding state of the electronic device 101 (e.g., in-folded state ↔ out-folded state). Depending on the ratio, the content display screen 1530 being displayed on the external electronic device (e.g., the external electronic device 301 in FIG. 3) may be provided differently.

For example, when the screen sharing service with the external electronic device 301 is executed while the electronic device 101 is in an in-folded state, as shown in <16001>, the external electronic device 301 displays an external operation UI ( 1635), a content display screen 1630 of an application running on the electronic device 101 may be provided on the display 350 of the external electronic device 301 at a first screen ratio (e.g., 4:3).

When the electronic device 101 changes to the out-folding state, as shown in <16002>, the electronic device 101 changes the screen ratio of the running application and displays the changed screen ratio information of the electronic device 101. It can be transmitted to an external electronic device 301.

The external electronic device 301 may change the content display screen 1630 to a second screen ratio (e.g., 16:9) according to the changed screen ratio information of the electronic device 301 and provide the content display screen 1630 to the display 350.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes a first housing and a second housing disposed on both sides of the folding axis and folded relative to each other and displayed at a predetermined angle. In this state, the method may include displaying an application execution screen in a split screen UI mode on a display disposed to face a first direction of the first housing and the second housing.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when a screen sharing service is executed while the application execution screen is displayed in the split screen UI mode, through the communication interface. It may include recognizing an external electronic device connected to the electronic device.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when there is no input device connected to the recognized external electronic device, excluding the content control unit of the second display area, The method may include transmitting screen information of the content display unit being displayed in the first display area to the external electronic device.

A method of providing an application screen from a foldable electronic device to an external display device according to an embodiment includes, when an input device connected to the external electronic device exists, excluding the content control unit of the second display area, The method may further include transmitting screen information of the content display unit being displayed in the display area and an external manipulation UI including shortcut keys mapped to application manipulation of the electronic device through an input device of the external electronic device. there is.

In the method of providing an application screen from a foldable electronic device to an external display device according to an embodiment, the screen split UI mode displays a content display unit in a first display area of the display corresponding to the first housing, and 2 The second display area of the display corresponding to the housing may be in a mode in which a content manipulation unit is displayed.

In the method of providing an application screen from a foldable electronic device to an external display device according to an embodiment, the operation of displaying the application execution screen includes executing the screen sharing service when the content control unit is activated in the split screen UI mode. When transmitting the external manipulation UI to the external electronic device, the external manipulation UI may be additionally provided to at least a portion of the second display area.

In a method of providing an application screen from a foldable electronic device to an external display device according to an embodiment, the operation of recognizing an external electronic device connected to the electronic device includes the operation of recognizing the external electronic device connected to the screen sharing service. The method may further include checking whether the external electronic device exists and the type of the input device based on device information obtained from the electronic device.

In a method of providing an application screen from a foldable electronic device to an external display device according to an embodiment, the device information includes device recognition information identifying the device, device function information indicating function information that can be performed within the device, or It may include at least one of device command information representing command information for device control.

In the method of providing an application screen from a foldable electronic device to an external display device according to an embodiment, the operation of recognizing an external electronic device connected to the electronic device includes: If the input device connected to the external electronic device cannot be identified, requesting the type information of the input device connected to the external electronic device to the external electronic device through the communication interface and the input device connected to the external electronic device from the external electronic device. The operation of receiving information may further be included.

In the method of providing an application screen from a foldable electronic device to an external display device according to an embodiment, the operation of transmitting the external manipulation UI to the external electronic device includes displaying the application execution screen in the split screen UI mode. When providing a sub-image linked to a screen being displayed in the first display area in the second display area, the method may further include transmitting screen information about the sub-image to the external electronic device. there is.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or via an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims (16)

In electronic devices,
A first housing and a second housing disposed on both sides with respect to the folding axis and formed to be folded with respect to each other,
a first display disposed to face a first direction of the first housing and the second housing;
communication interface;
Memory; and
a processor operatively coupled to the first display, the communication interface, and the memory;
The processor,
In a state in which the first housing and the second housing are folded at a predetermined angle, a content display unit is displayed on the first display area of the first display corresponding to the first housing, and a content display unit is displayed on the first display area corresponding to the second housing. In the second display area, an application execution screen is displayed in a split screen UI mode that displays a content control panel,
When the screen sharing service is executed while the application execution screen is displayed in the split screen UI mode, recognize an external electronic device connected to the electronic device through the communication interface,
If there is no input device connected to the recognized external electronic device, the screen information of the content display unit being displayed in the first display area is transmitted to the external electronic device, excluding the content manipulation unit of the second display area. ,
When there is an input device connected to the external electronic device, excluding the content manipulation unit of the second display area, the screen information of the content display unit displayed in the first display area and the input device of the external electronic device are used to transmit electronic information. An electronic device configured to transmit an external manipulation UI including shortcut keys mapped to application manipulation of the device to the external electronic device. According to paragraph 1,
The processor,
If an input device is present in the external electronic device, it is checked whether the content manipulation unit displayed in the second display area during the split screen UI mode is activated, and if the content manipulation unit is not activated, the external manipulation is performed. Transmitting UI to the external electronic device,
When the content manipulation unit is activated, the electronic device is configured to transmit the external manipulation UI to the external electronic device and additionally provide the external manipulation UI to at least a portion of the second display area. According to claim 1 or 2,
The electronic device further includes a second display disposed to face a second direction opposite to the first direction of either the first housing or the second housing. According to claim 1 or 2,
An electronic device, characterized in that the electronic device and an external electronic device are connected through wireless or wired communication through the communication interface. According to claim 1 or 2,
The processor,
It is set to check whether the external electronic device exists and the type of the input device based on device information obtained from the external electronic device in the process of connecting with the external electronic device based on the screen sharing service,
The device information includes at least one of device recognition information identifying the device, device function information indicating function information that can be performed within the device, or device command information indicating command information for controlling the device. According to clause 5,
The processor,
In the process of connecting with an external electronic device based on the screen sharing service, if the input device connected to the external electronic device cannot be identified, information on the type of the input device connected to the external electronic device is requested from the external electronic device through the communication interface. and an electronic device further configured to receive input device information connected to an external electronic device from the external electronic device. According to claim 1 or 2,
The electronic device is set to automatically enter the split screen UI mode when the application is executed according to application settings. According to claim 1 or 2,
The application execution screen supports a standard UI mode that is displayed in a single layout without being divided into a content display unit that displays content and a content control unit that receives application manipulation input,
The processor,
While displaying the application execution screen in the standard UI mode, the application execution screen is changed to the split screen UI mode based on the first housing and the second housing being changed to a folded state at a certain angle. Set electronic device. According to clause 5,
The external manipulation UI is configured to correspond to the input device type of the external electronic device for each application, and the configuration information of the external manipulation UI is stored in the memory. According to claim 1 or 2,
The external operation UI is an electronic device configured to include a removal item for removing the external operation UI. According to claim 1 or 2,
The processor,
When displaying the application execution screen in the split screen UI mode, providing a sub-image in the second display area that is linked to the screen being displayed in the first display area, when executing the screen sharing service, the sub-image is provided in the second display area. An electronic device configured to additionally transmit screen information about an image to the external electronic device. In a method of providing an application screen from a foldable electronic device to an external display device,
A display arranged to face a first direction of the first and second housings, with the first and second housings disposed on both sides of the folding axis and folded relative to each other displayed at a certain angle. The operation of displaying an application execution screen in split-screen UI mode;
Recognizing an external electronic device connected to the electronic device through a communication interface when a screen sharing service is executed while the application execution screen is displayed in the split screen UI mode;
When there is no input device connected to the recognized external electronic device, the screen information of the content display unit being displayed in the first display area is transmitted to the external electronic device, excluding the content manipulation unit of the second display area. motion, and
When there is an input device connected to the external electronic device, excluding the content manipulation unit of the second display area, the screen information of the content display unit displayed in the first display area and the input device of the external electronic device are used to transmit electronic information. Further comprising transmitting an external manipulation UI including shortcut keys mapped to application manipulation of the device to the external electronic device,
The screen split UI mode is a method of displaying a content display unit in a first display area of the display corresponding to the first housing, and displaying a content manipulation unit in a second display area of the display corresponding to the second housing. According to clause 12,
The operation of displaying the application execution screen is,
When the content manipulation unit is activated in the screen split UI mode, when executing the screen sharing service, the external manipulation UI is transmitted to the external electronic device and the external manipulation UI is displayed in at least a portion of the second display area. A method characterized by providing additional. According to clause 12,
The operation of recognizing an external electronic device connected to the electronic device includes:
Further comprising the operation of checking whether the external electronic device exists and the type of the input device based on device information obtained from the external electronic device in the process of connecting with the external electronic device based on the screen sharing service,
The device information includes at least one of device recognition information that identifies the device, device function information that represents function information that can be performed within the device, or device command information that represents command information for controlling the device. According to clause 12,
The operation of recognizing an external electronic device connected to the electronic device includes:
In the process of connecting with an external electronic device based on the screen sharing service, if the input device connected to the external electronic device cannot be identified, information on the type of the input device connected to the external electronic device is requested from the external electronic device through the communication interface. action; and receiving input device information connected to the external electronic device from the external electronic device. According to clause 12,
The operation of transmitting the external manipulation UI to the external electronic device includes:
When displaying the application execution screen in the split screen UI mode, if a sub-image linked to the screen being displayed in the first display area is provided in the second display area, screen information about the sub-image is additionally provided. The method further includes transmitting to the external electronic device.

Images