WO2022025400A1

WO2022025400A1 - Screen division provision method linked with electronic pen, and foldable electronic device using same

Info

Publication number: WO2022025400A1
Application number: PCT/KR2021/006101
Authority: WO
Inventors: 장원경; 지윤정; 한훈
Original assignee: 삼성전자 주식회사
Priority date: 2020-07-30
Filing date: 2021-05-14
Publication date: 2022-02-03
Also published as: KR20220014968A

Abstract

According to various embodiments, an electronic device comprises a foldable display, a folding detection sensor, an electronic pen, and a processor. The processor can detect a folding state of the foldable display by using the folding detection sensor, divide and display an execution screen of a first application, which is being executed, in the first and second areas of the foldable display in response to the folding state, detect an event related to the electronic pen, and provide a third area to at least a portion of the second area on the basis of the detected event related to the electronic pen. Other various embodiments can be possible.

Description

Method for providing split screen interlocked with electronic pen and foldable electronic device using same

Various embodiments of the present disclosure relate to a method of providing a screen division interworking with an electronic pen and a foldable electronic device using the same.

Portable electronic devices (hereinafter, 'electronic devices') typified by smartphones can be equipped with various functions. The electronic device may include a touch screen-based display so that a user can easily access various functions, and may provide screens of various applications through the display.

Electronic devices are being transformed into various shapes beyond the bar shape. In recent years, a display that can be folded from a bendable form or a display that can be expanded in a slide form or a rolling form is being developed. An electronic device including such a display may be provided with ease of use according to the state of the display and the posture of the electronic device.

The conventional electronic device may provide a continuous feeling of use to the user when the use area is changed due to the change of the state of the display. In the case of an electronic pen interworking with an electronic device, a predetermined action (eg, pressing a button, etc.) must be taken in order to utilize the function of the electronic pen.

When the display state of the electronic device having the foldable display is changed, the execution screen of the currently running application may be changed and provided to suit the user's convenience. When the user uses the electronic pen together with the foldable electronic device, an additional operation for inputting the electronic pen must be performed in a state where the display is changed to perform a task separate from the running application.

According to various embodiments, the electronic device includes a foldable display, a folding detection sensor, an electronic pen, and a processor, wherein the processor detects a folding state of the foldable display using the folding detection sensor, and detects the folding state. Correspondingly, an execution screen of a running first application is displayed separately in a first area and a second area of the foldable display, an event related to the electronic pen is detected, and based on the detected event related to the electronic pen Thus, the third region may be provided in at least a portion of the second region.

According to various embodiments of the present disclosure, the method for providing split screen interlocked with an electronic pen includes detecting a folding state of a foldable display using a folding detection sensor, and displaying an execution screen of a running first application in response to the folding state. Based on the operation of separately displaying the first area and the second area of the foldable display, the operation of detecting an event related to the electronic pen, and the detected event related to the electronic pen, a third area is displayed on at least a part of the second area area can be provided.

When the display of the electronic device is a foldable display or an expandable display, the user may use the display for various purposes according to a change in the state of the display. The user may execute another application related to the currently running application according to the state of the display and the posture of the electronic device.

The electronic device has a foldable display or an expandable display to increase utilization according to the state of the display, so that the user can use it together with the electronic pen. The electronic device may provide convenience to the user by dividing the execution screen of the application according to the state of the display and the posture of the electronic device and displaying other related applications even if there is no additional operation through the electronic device.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;

2 is a block diagram of components of an electronic device according to various embodiments of the present disclosure;

3 is a flowchart illustrating an operation corresponding to a change in a state of a display and use of an electronic pen, according to various embodiments of the present disclosure;

4A to 4D are exemplary views of a structure and a folding state of a foldable electronic device according to various embodiments of the present disclosure;

5A to 5D are exemplary views of a structure and a folding state of a foldable electronic device according to various embodiments of the present disclosure;

6A to 6G are exemplary views of a structure and a folding state of a foldable electronic device according to various embodiments of the present disclosure;

7A to 7C are diagrams illustrating a structure of a rollable electronic device and a closed/unfolded state of a rollable display according to various embodiments of the present disclosure;

8A to 8C are diagrams illustrating a structure and a folding state of a foldable electronic device according to various embodiments of the present disclosure;

9A to 9C are diagrams illustrating a structure of a rollable electronic device and a closed/unfolded state of a rollable display according to various embodiments of the present disclosure;

10 is a flowchart illustrating a divided display on a display screen of an electronic device according to various embodiments of the present disclosure;

11A to 11D are exemplary diagrams of a split screen display of a foldable electronic device according to various embodiments of the present disclosure;

12A to 12D are exemplary views of a split screen display of a foldable electronic device according to various embodiments of the present disclosure;

13A and 13B are diagrams illustrating split screen display of a rollable electronic device according to various embodiments of the present disclosure;

14A and 14B are diagrams illustrating a split screen display of a foldable electronic device according to various embodiments of the present disclosure;

15A and 15B are diagrams illustrating split screen display of a rollable electronic device according to various embodiments of the present disclosure;

16A to 17B are exemplary diagrams of a screen change corresponding to a display arrangement of a foldable electronic device, according to various embodiments of the present disclosure;

18A and 18B are flowcharts of an operation of moving content in a split screen display according to various embodiments of the present disclosure;

19A and 19B are exemplary diagrams of content movement related to split screen display according to various embodiments of the present disclosure;

20A to 20C are exemplary diagrams corresponding to a state change of a display and use of an electronic pen, according to various embodiments of the present disclosure;

21A to 23B are diagrams illustrating use of split screen display according to various embodiments.

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

Referring to FIG. 2 , the electronic device 200 (eg, the electronic device 101 of FIG. 1 ) includes a processor 210 (eg, the processor 120 of FIG. 1 ) and a folding detection sensor (eg, the sensor of FIG. 1 ). module 176 ), magnetic sensor 230 (eg, sensor module 176 of FIG. 1 ), foldable display 240 (eg, display module 160 of FIG. 1 ), and electronic pen 250 (eg, display module 160 of FIG. 1 ). Example: input module 150 of FIG. 1) may be included, and some of the illustrated components may be omitted or substituted. The electronic device may include at least some of the configuration and/or functions of the electronic device 101 of FIG. 1 .

According to an embodiment, the electronic device may include a structure in which the provided display can be folded, and is not limited in any way. For example, in the folding method, the electronic device may be in-folding or out-folding, and may be folded vertically or horizontally about a folding axis. According to another embodiment, the electronic device may include a structure in which a provided display can be rolled (eg, slid), and is not limited in any way. For example, a portion of the display of the electronic device may be rolled or folded inside the housing, and may be spread horizontally or vertically through at least one roller structure or the like.

According to various embodiments, the processor 210 is a configuration capable of performing an operation or data processing related to control and/or communication of temporary components of the electronic device 200, and includes the configuration and / or may include at least some of the functions. The processor may be functionally, operatively, and/or electrically coupled to internal components of an electronic device, including a folding detection sensor, a magnetic sensor, a foldable display, and an electronic pen.

Referring to FIG. 2 , the folding detection sensor 220 may detect a folding state of the electronic device. The folded state of the electronic device may be, for example, a state formed by the display of the electronic device. The folding detection sensor may perform a function of detecting the folding state of the electronic device, for example, the folding state of the display, and may include a gyro sensor, a magnetic sensor, and an acceleration sensor. In addition, the folding detection sensor may be located on one surface of the housing of the electronic device or located within a hinge. The folding detection sensor according to various embodiments of the present disclosure may include at least some of the configuration and/or functions of the sensor module 176 of FIG. 1 .

Referring to FIG. 2 , the magnetic sensor 230 may detect whether an electronic pen that can be mounted on an electronic device is detached or detached. As for the posture of the electronic device, the magnetic sensor 230 according to various embodiments of the present disclosure may include at least some of the configuration and/or functions of the sensor module 176 of FIG. 1 .

Referring to FIG. 2 , a foldable display 240 may refer to a flexible display of an electronic device. According to an embodiment, the foldable display may be the main display of the electronic device, and may be located on the front or rear side. According to another embodiment, the foldable display may be a secondary display of the electronic device, and may be located on the front or rear side. The foldable display according to various embodiments of the present disclosure may include at least a portion of the structure and/or function of the display module 160 of FIG. 1 .

Referring to FIG. 2 , an electronic pen 250 may refer to a stylus pen that may be provided in an electronic device. According to an embodiment, the electronic pen may be mounted and provided together when the electronic device is provided. According to another embodiment, the electronic pen may not be provided in the mounting space as an external device to the electronic device. The electronic pen 250 according to various embodiments of the present disclosure may include at least some of the configuration and/or functions of the input module 150 of FIG. 1 .

Referring to FIG. 3 , in operation 310, the processor of the electronic device (eg, the processor 120 of FIG. 1 and the processor 210 of FIG. 2 ) displays (eg, the display module 160 of FIG. 1 , the folder of FIG. 2 ) It may be to detect a folded state of the display 240 , a posture of the electronic device, or a closed/unfolded state (eg, a roll-in, roll-out, slide-in, or slide-out state). In operation 310, the processor may check a result detected by the folding detection sensor and the gravity sensor.

Referring to FIG. 3 , in operation 320, the processor of the electronic device divides the display area to display the execution screen of the application in response to the folded state of the display and the posture of the electronic device. For example, the processor displays the execution screen regarding the content input result of the application in the area of the display in the front direction of the user's gaze, and displays the execution screen regarding the content input of the application toward the ceiling (eg, the sky) of the display. area can be displayed.

Referring to FIG. 3 , in operation 330 , the processor of the electronic device may determine an operation of an electronic pen mounted on the electronic device or an electronic pen that is a separate external device. For example, it may mean determining an operation in which the electronic pen mounted on the electronic device is detached from the electronic device or an operation in which the electronic pen as an external device is communicatively connected to the electronic device.

Referring to FIG. 3 , in operation 340 , the processor of the electronic device determines the detected folding state of the display, the posture of the electronic device, or a closed/unfolded state (eg, roll-in, roll-out, slide-in, or slide-out state) and the electronic pen. An execution screen of another application may be displayed on at least a part of the divided display partial area based on an operation such as, for example. For example, the execution screen of another application may be displayed on at least a portion of the display area of the execution screen related to the content input of the application displayed in operation 320 . The execution screen of another application may be an execution screen of an application selected by an air command or an execution screen of an application (eg, a memo application, etc.) capable of extending the range of application that is being executed.

Referring to FIG. 4A , the foldable electronic device 400 (eg, the electronic device 101 of FIG. 1 and the electronic device 200 of FIG. 2 ) according to various embodiments has a folding axis (eg, the A-axis). Two housings as a reference, a foldable display 410 (eg, the display module 160 of FIG. 1 , the foldable display 240 of FIG. 2 , the first display), and a front camera 420 (eg, the display module of FIG. 1 ) camera module 180), secondary display 430 (eg, display module 160, second display of FIG. 1), and rear camera 440 (eg, camera module 180 of FIG. 1). and may include at least some of the structures and/or functions of the electronic device 101 of FIG. 1 and/or the electronic device 200 of FIG. 2 . The two housings may be overlapped by a hinge structure, and may be overlapped by folding about at least one axis.

According to various embodiments, of the two housings, a first housing may include a first surface and a second surface, and the second housing may include a third surface and a fourth surface. For example, when the first display 410 of the electronic device 400 is folded based on the A-axis, the first surface of the first housing may face the third surface of the second housing and overlap each other. . Here, when the folding state of the first display is folded, for example, the angle between the first surface of the first housing and the third surface of the second housing may form a narrow angle (eg, 0 to 5 degrees). have. The folded state may mean a closed state (closed state), and may mean a state in which the electronic device 400 is completely folded. The first display 410 may be divided into a first area 411 and a second area 412 as an area in which content is displayed, and the first area may be located on the first surface of the first housing, The second region may be located on the third surface of the second housing.

The first housing and the second housing may be disposed at upper and lower sides about a folding axis (eg, A axis), and may have an overall symmetrical shape with respect to the folding axis. Referring to FIG. 4A , the first housing may be located above the folding axis and the second housing may be located below the folding axis. The first housing and the second housing may be designed to be folded with respect to each other, and in a folded state or a folded state, the first surface of the first housing and the third surface of the second housing may be overlapped to face each other. .

According to various embodiments, a hinge may be formed between the first housing and the second housing, so that the first housing and the second housing of the electronic device 400 may be overlapped and folded. However, the housing structure in which the electronic device is vertically disposed with respect to the folding axis is only an example, and the housing may be disposed left and right with respect to the folding axis of the electronic device.

The first housing and the second housing are each other depending on whether the folded state of the first display 410 of the electronic device 400 is an unfolded state (or an open state), a folded state (or a closed state), or an intermediate state. The angle or distance formed may be different. For example, the unfolded state may mean an open state, an opened state, a flat (or flat) state, or an open state. The state in which the first display 410 of the electronic device 400 is unfolded is a state in which the first housing and the second housing are vertically arranged, and may refer to a state in which the electronic device 400 is fully unfolded. When the folded state of the first display 410 is unfolded, the angle between the first housing and the second housing is 180 degrees, and the first surface of the first housing and the third surface of the second housing are in the same direction. It can be arranged to face.

An intermediate state among the folding states of the first display of the electronic device 400 is a state in which the first housing and the second housing are arranged at a predetermined angle, and may not be a folded state or an unfolded state. The intermediate state may mean a state in which the first surface of the first housing and the third surface of the second housing form a constant angle (eg, 6 to 179 degrees).

The electronic device may include the second display 430 in the first housing or at least a part of the second housing. Referring to FIG. 4A , the second display 430 may be formed on at least a portion of the second surface of the first housing of the electronic device 400 . The second display 430 may be disposed on the fourth surface of the second housing, or may be formed through some or all of the second surface of the first housing and the fourth surface of the second housing. The second display may include at least a part of the structure and/or function of the display module 160 of FIG. 1 .

4B to 4D are exemplary views illustrating postures of a foldable electronic device according to various embodiments of the present disclosure;

4B and 4D , the folding angle of the foldable electronic device may be greater than or equal to 90 degrees and less than or equal to 135 degrees. The processor of the foldable electronic device may check a result of sensing the folding angle of the electronic device (eg, the folding angle of the foldable display) through the folding angle sensor. Referring to FIG. 4C , the folding angle of the foldable electronic device may be greater than or equal to 160 degrees and less than or equal to 180 degrees.

Referring to FIG. 4B , the processor of the foldable electronic device may check whether the second area of the first display faces upward (eg, whether the fourth side faces downward) while the folding angle is greater than or equal to 90 degrees and less than or equal to 135 degrees. have. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 4D , the processor of the foldable electronic device may check whether the first area of the first display faces upward (eg, whether the third side faces downward) while the folding angle is greater than or equal to 90 degrees and less than or equal to 135 degrees. have. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 4C , the processor of the foldable electronic device determines whether the folding angle is greater than or equal to 160 degrees and less than or equal to 180 degrees and the first area and the second area of the first display face upward (eg, the second surface and the fourth surface). You can check whether it is facing downwards). For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

According to various embodiments of the present disclosure, the processor may divide and display the display screen of the display in response to a pre-stored state that matches the change of the state of the display of the electronic device and the result of checking the posture of the electronic device. For example, the processor may divide and display the execution screen (eg, UI) of the application being executed based on the folding axis or the rolling/sliding boundary axis. According to an embodiment, the processor displays an execution screen (eg, a dialog screen of a message application) related to the content input result of the application on the display area in the front direction of the user's gaze, and the execution screen (eg, a dialog screen of the message application) related to the content input of the application. Example: An input screen such as a keyboard for inputting message content) can be displayed in an area of the display facing upward (eg, ceiling, sky).

According to various embodiments, of the two housings, a first housing may include a first surface and a second surface, and the second housing may include a third surface and a fourth surface. For example, when the first display 510 of the electronic device 500 is folded based on the A-axis, the first surface of the first housing may face the third surface of the second housing and overlap each other. . Here, when the folding state of the first display 510 is folded, for example, the angle between the first surface of the first housing and the third surface of the second housing is a narrow angle (eg, 0 to 5 degrees). it may be achieved The folded state may mean a closed state (closed state), and may mean a state in which the electronic device 500 is fully folded. The first display 510 may be divided into a first area 511 and a second area 512 as an area in which content is displayed, and the first area may be located on the first surface of the first housing, The second region may be located on the third surface of the second housing.

The first housing and the second housing may be disposed on both sides of the folding axis (eg, the A axis), and may have an overall symmetrical shape with respect to the folding axis. Referring to FIG. 5A , the first housing may be located on the left side with respect to the folding axis, and the second housing may be located on the right side with respect to the folding axis. The first housing and the second housing may be designed to be folded with respect to each other, and in a folded state or a folded state, the first surface of the first housing and the third surface of the second housing may be overlapped to face each other. .

According to various embodiments, a hinge may be formed between the first housing and the second housing, so that the first housing and the second housing of the electronic device 500 may be overlapped and folded. However, the housing structure in which the electronic device is disposed on the left and right with respect to the folding axis is only an example, and the housing may be disposed vertically with respect to the folding axis of the electronic device.

The first housing and the second housing are each other depending on whether the folded state of the first display 510 of the electronic device 500 is an unfolded state (or an open state), a folded state (or a closed state), or an intermediate state. The angle or distance formed may be different. For example, the unfolded state may mean an open state, an opened state, a flat (or flat) state, or an open state. The state in which the first display 510 of the electronic device 500 is unfolded is a state in which the first housing and the second housing are arranged side by side, and may mean a state in which the electronic device 500 is fully unfolded. When the folded state of the first display 510 is unfolded, the angle between the first housing and the second housing is 180 degrees, and the first surface of the first housing and the third surface of the second housing are in the same direction. It can be arranged to face.

An intermediate state among the folding states of the first display of the electronic device 500 is a state in which the first housing and the second housing are arranged at a predetermined angle, and may not be a folded state or an unfolded state. The intermediate state may mean a state in which the first surface of the first housing and the third surface of the second housing form a constant angle (eg, 6 to 179 degrees).

The electronic device may include the second display 550 (eg, the display module 160 of FIG. 1 ) in the first housing or at least a part of the second housing. Referring to FIG. 5A , the second display may be formed on at least a portion of the second surface of the first housing of the electronic device 500 . The second display 550 may be disposed on the fourth surface of the second housing, or may be formed through some or all of the second surface of the first housing and the fourth surface of the second housing. The second display may include at least a part of the structure and/or function of the display module 160 of FIG. 1 .

5B to 5D are exemplary views illustrating postures of a foldable electronic device according to various embodiments of the present disclosure;

5B and 5D , the folding angle of the foldable electronic device may be 90 degrees or more and 135 degrees or less. The processor of the foldable electronic device may check a result of sensing the folding angle of the electronic device (eg, the folding angle of the foldable display) through the folding angle sensor. Referring to FIG. 5C , the folding angle of the foldable electronic device may be 160 degrees or more and 180 degrees or less.

Referring to FIG. 5B , the processor of the foldable electronic device may check whether the second area of the first display faces upward (eg, whether the fourth side faces downward) while the folding angle is greater than or equal to 90 degrees and less than or equal to 135 degrees. have. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 5D , the processor of the foldable electronic device may check whether the first area of the first display faces upward (eg, whether the third side faces downward) while the folding angle is greater than or equal to 90 degrees and less than or equal to 135 degrees. have. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 5C , the processor of the foldable electronic device determines whether the folding angle is greater than or equal to 160 degrees and less than or equal to 180 degrees and whether the first area and the second area of the first display face upward (eg, the second surface and the fourth surface). You can check whether it is facing downwards). For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 6A , an electronic device 600 (eg, the electronic device 101 of FIG. 1 and the electronic device 200 of FIG. 2 ) according to various embodiments has a first housing, a second housing, and a third housing. and the first display 610 , and may include at least some of the structures and/or functions of the electronic device 101 of FIG. 1 and/or the electronic device 200 of FIG. 2 . The first housing, the second housing, and the third housing may correspond to individual housings of the housing structure, and may overlap by folding about at least one axis (eg, axis A and axis B in FIG. 6A ).

The first housing may include first and second surfaces, the second housing may include third and fourth surfaces, and the third housing may include fifth and sixth surfaces. For example, when the first display 610 of the electronic device 600 is folded based on the A-axis, the first surface of the first housing faces the third surface of the second housing, and the third surface of the first housing The second surface and the fourth surface of the second housing may face each other and overlap each other. In addition, when the first display 610 is folded along the B axis, the third surface of the second housing and the fifth surface of the third housing face each other, and the fourth surface of the second housing and the sixth surface of the third housing The faces may be overlapped to face each other. According to an embodiment, when the folded state of the first display 610 is folded, the angle between the second surface of the first housing and the fourth surface of the second housing is a narrow angle (eg, 0 to 5 degrees). it may be achieved According to another embodiment, when the folded state of the first display is folded, the angle between the third surface of the second housing and the fifth surface of the third housing may form a narrow angle (eg, 0 to 5 degrees). have. The folded state may mean a closed state (closed state), and may mean a state in which the electronic device 600 is completely folded. For example, in the folded state, the electronic device is fully folded based on the A-axis and B-axis, is folded based on only the A-axis and is not folded based on the B-axis, or is not folded based on the A-axis and is not folded based on the B-axis. It can mean only folded. The first display 610 may be divided into a first area 611 , a second area 612 , and a third area 613 as an area in which content is displayed. The first area may be located on the first surface of the first housing, the second area may be located on the third surface of the second housing, and the third area may be located on the fifth surface of the third housing.

The first housing and the second housing may be disposed on both sides about the folding axis (eg, A-axis), and the second housing and the third housing may be disposed on both sides about the folding axis (eg, B-axis). and may have a symmetrical shape with respect to the folding axis. Referring to FIG. 6A , the first housing may be located on the left side with respect to the A axis, and the second housing may be located on the right side with respect to the A axis. The second housing may be located on the left side with respect to the B axis, and the third housing may be located on the right side with respect to the B axis. The first housing and the second housing, and the second housing and the third housing may be designed to be folded with respect to each other.

According to various embodiments, a hinge may be formed between the first housing and the second housing and between the second housing and the third housing. The first housing, the second housing, and the third housing of the electronic device 600 may be overlapped and folded by a hinge formed between the individual housings (eg, the first housing, the second housing, and the third housing) of the housing structure. However, the housing structure in which the electronic device is disposed on the left and right with respect to the folding axis is only an example, and the housing may be disposed vertically with respect to the folding axis of the electronic device.

The first and second housings, the second housing and the third housing are the folded state of the first display 610 of the electronic device 600 in an unfolded state (or an open state), a folded state (or a closed state) Alternatively, angles or distances formed with each other may be different depending on whether they are in an intermediate state. For example, the unfolded state may mean an open state, an opened state, a flat (or flat) state, or an open state.

According to an embodiment, the unfolded state of the first display 610 is a state in which the first housing, the second housing, and the third housing are arranged side by side, which means a state in which the electronic device 600 is fully unfolded. can According to another embodiment, the unfolded state may include a partially unfolded state of the first display 610 . A state in which the first display 610 is partially unfolded may mean a state in which the second housing and the third housing are arranged side by side and the first housing and the second housing are folded. The folded state of the first display 610 may be an unfolded state in which an angle between the first housing and the second housing forms 180 degrees and an angle between the second housing and the third housing forms 180 degrees. The unfolded state may include disposing the first surface of the first housing, the third surface of the second housing, and the fifth surface of the third housing to face the same direction. According to another exemplary embodiment, in the partially unfolded state of the first display 610 , the second surface of the first housing, the third surface of the second housing, and the fifth surface of the third housing are the same. It may mean that it is arranged to face the direction.

An intermediate state among the folding states of the first display 610 is a state in which the first housing and the second housing are arranged at a predetermined angle, and may not be a folded state or an unfolded state. The intermediate state may mean a state in which the second surface of the first housing and the fourth surface of the second housing form a constant angle (eg, 6 to 179 degrees). Also, it may refer to a state in which the third surface of the second housing and the fifth surface of the third housing form a constant angle (eg, 6 to 179 degrees).

Referring to FIG. 6A , A-axis and B-axis folding axes may exist between individual housings (eg, a first housing, a second housing, and a third housing) of the electronic device 600 . The at least one folding shaft may be formed by a hinge that may be provided between the individual housings (eg, the first housing, the second housing, and the third housing). The number of hinges provided for folding of the individual housings (eg, the first housing, the second housing, and the third housing) may be the same as the number of folding shafts. The hinge structure may include a first hinge and a second hinge. The first hinge may be provided between the first housing and the second housing, and the second hinge may be provided between the second housing and the third housing.

6B to 6G are exemplary views illustrating a posture of a foldable electronic device according to various embodiments of the present disclosure;

Referring to FIG. 6B , the foldable electronic device may have an in-folding angle of 90 degrees or more and 135 degrees or less and an out-folding angle of 10 degrees or more and 90 degrees or less. The processor of the foldable electronic device may check a result of sensing the folding angle of the electronic device (eg, the folding angle of the foldable display) through the folding angle sensor. Referring to FIG. 6C , the foldable electronic device may have an in-folding angle of 90 degrees or more and an out-folding angle of 0 degrees or more and 180 degrees or less.

Referring to FIG. 6D , the foldable electronic device may have an infolding angle of 0 degrees and an outfolding angle of 60 degrees or more and 95 degrees or less. Referring to FIG. 6E , an infolding angle of the foldable electronic device may be 90 degrees or more and 135 degrees or less. Referring to FIG. 6F , the in-folding angle may be 180 degrees and the out-folding angle may be 0 degrees. Referring to FIG. 6G , the in-folding and out-folding angles may be 180 degrees or 0 degrees.

Referring to FIG. 6B , the processor of the foldable electronic device determines whether the third area of the first display faces upward when the infolding angle is 90 degrees or more and 135 degrees or less and the outfolding angle is 10 degrees or more and 90 degrees or less. : Check whether the 6th side is facing downward). For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 6C , the processor of the foldable electronic device determines whether the third area of the first display faces upward (eg, the sixth area when the infolding angle is 90 degrees or more and the outfolding angle is 0 degrees or more and 180 degrees or less) face down) can be checked. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 6D , the processor of the foldable electronic device determines whether the first area of the first display faces downward (for example, the second side is facing upwards) can be checked. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 6E , the processor of the foldable electronic device determines whether the first area and the second area of the first display face upward (eg, the first surface and the second area) when the infolding angle is greater than or equal to 90 degrees and less than or equal to 135 degrees. face down) can be checked. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 6F , the processor of the foldable electronic device determines whether the first area of the first display faces downward (eg, whether the second side faces upward) when the infolding angle is 180 degrees and the outfolding angle is 0 degrees. ) can be checked. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 6G , the processor of the foldable electronic device determines whether the entire area of the first display faces upward (eg, the second surface, the fourth surface, and Check whether the 6th side is all facing downward). For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 7A , an electronic device 700 (eg, the electronic device 101 of FIG. 1 and the electronic device 200 of FIG. 2 ) according to various embodiments may include a housing and a first display 710 . and may include at least some of the configuration and/or functions of the electronic device 101 of FIG. 1 and/or the electronic device 200 of FIG. 2 . A portion of the first display 710 may be rolled or folded inside the housing, and may be spread left and right through at least one or more roller structures.

The first display 710 may be divided into a first area 711 and a second area 712 as an area in which content is displayed. The first area 711 may correspond to an area in which the contents of the electronic device 700 are displayed when the first display 710 is in a roll-in or slide-in state. The second area 712 may correspond to an additional area in which the content of the electronic device 700 is displayed in a roll-out or slide-out state of the first display 710 . Here, the additional area may mean a display area of the extended first display other than the first area 711 of the first display 710 in which content was displayed in a roll-in or slide-in state. have.

Referring to FIG. 7A , a roll-in state or a slide-in state of the electronic device 700 may correspond to a folded state. For example, a roll-in state or a slide-in state may correspond to a closed state. A roll-out or slide-out state of the electronic device 700 may correspond to an unfolded state. For example, a roll-out or slide-out state may correspond to an open state, and may correspond to an unfolded state.

In addition to the form shown in FIG. 7A , the electronic device 700 may increase the display utilization area of the roll-in or slide-in state by three times when the roll-out or slide-out state is used. In this case, the rolled-in or rolled-in hidden display may be more than twice the display area of the rolled-in state.

7B and 7C are exemplary views illustrating a posture of a rollable electronic device according to various embodiments of the present disclosure;

Referring to FIG. 7B , the first display of the rollable electronic device may be unfolded to an area twice as large as the first area. According to another embodiment, the unfolded state of FIG. 7B may be an unfolded state corresponding to n times the area corresponding to the first area in the roll-in state. The processor of the rollable electronic device may check a result of sensing the closed/unfolded state of the electronic device through the sensor.

Referring to FIG. 7C , the first display of the rollable electronic device may be unfolded to an area equal to one time the first area. For example, the rolled-in state of FIG. 7C may be a rolled-in state corresponding to the area corresponding to the first region. The processor of the rollable electronic device may check a result of sensing the closed/unfolded state of the electronic device through the sensor.

According to various embodiments of the present disclosure, the processor may divide and display the display screen of the display in response to a pre-stored state that matches the change of the state of the display of the electronic device and the result of checking the posture of the electronic device. For example, the processor may divide and display the execution screen (eg, UI) of the application being executed based on the folding axis or the rolling/sliding boundary axis. According to an embodiment, the processor displays an execution screen (eg, a dialog screen of a message application) related to the content input result of the application in the area (eg, the first area) of the display in the roll-in state, and responds to the content input of the application. A related execution screen (eg, an input screen such as a keyboard for inputting message content) may be displayed in an area of the display facing the area of the display (eg, at least a part of the second area) that is expanded.

Referring to FIG. 8A , an electronic device 800 (eg, the electronic device 101 of FIG. 1 and the electronic device 200 of FIG. 2 ) according to various embodiments of the present disclosure includes a first housing, a second housing, and a first The display 810 may be included, and may include at least some of the configuration and/or functions of the electronic device 101 of FIG. 1 and/or the electronic device 200 of FIG. 2 . The first housing and the second housing may correspond to individual housings of the housing structure, and may overlap by folding about at least one axis (eg, axis A of FIG. 8A ).

The first housing may include a first surface and a second surface, and the second housing may include a third surface and a fourth surface. For example, when the first display 810 of the electronic device 800 is folded based on the A-axis, the first surface of the first housing faces the third surface of the second housing, and the third surface of the first housing The second surface and the fourth surface of the second housing may face each other and overlap each other. Here, when the folding state of the first display 810 is folded, for example, the angle between the second surface of the first housing and the fourth surface of the second housing is a narrow angle (eg, 0 to 5 degrees). it may be achieved The folded state may mean a closed state (closed state), and may mean a state in which the electronic device 800 is completely folded. The first display 810 may be divided into a first area 811 and a second area 812 as an area in which content is displayed, and the first area may be located on the first surface of the first housing, The second region may be located on the third surface of the second housing.

The first housing and the second housing may be disposed on both sides of the folding axis (eg, the A axis), and may have an overall symmetrical shape with respect to the folding axis. Referring to FIG. 8A , the first housing may be located on the left side with respect to the folding axis, and the second housing may be located on the right side with respect to the folding axis. The first housing and the second housing may be designed to be folded with respect to each other, and the second surface of the first housing and the fourth surface of the second housing may be overlapped to face each other in a folded state or a folded state. .

According to various embodiments, a hinge is formed between the first housing and the second housing, so that the first housing and the second housing of the electronic device 800 are overlapped and folded. However, the housing structure in which the electronic device is disposed on the left and right with respect to the folding axis is only an example, and the housing may be disposed vertically with respect to the folding axis of the electronic device.

The first housing and the second housing are each other depending on whether the folded state of the first display 810 of the electronic device 800 is an unfolded state (or an open state), a folded state (or a closed state), or an intermediate state. The angle or distance formed may be different. For example, the unfolded state may mean an open state, an opened state, a flat (or flat) state, or an open state. A state in which the first display 810 of the electronic device 800 is unfolded is a state in which the first housing and the second housing are arranged side by side, and may mean a state in which the electronic device 800 is fully unfolded. When the folded state of the first display 810 is unfolded, the angle between the first housing and the second housing is 180 degrees, and the first surface of the first housing and the third surface of the second housing are in the same direction. It can be arranged to face.

An intermediate state among the folding states of the first display of the electronic device 800 is a state in which the first housing and the second housing are arranged at a predetermined angle, and may not be a folded state or an unfolded state. The intermediate state may mean a state in which the second surface of the first housing and the fourth surface of the second housing form a constant angle (eg, 6 to 179 degrees).

8B and 8C are exemplary views illustrating a posture of a foldable electronic device according to various embodiments of the present disclosure;

Referring to FIG. 8B , an outfolding angle of the foldable electronic device may be greater than or equal to 0 degrees and less than or equal to 25 degrees. The processor of the foldable electronic device may check a result of sensing the folding angle of the electronic device (eg, the folding angle of the foldable display) through the folding angle sensor. Referring to FIG. 8C , an outfolding angle of the foldable electronic device may be greater than or equal to 160 degrees and less than or equal to 180 degrees.

Referring to FIG. 8B , the processor of the foldable electronic device determines whether the first area of the first display faces upward (eg, whether the second side faces downward) while the outfolding angle is greater than or equal to 0 degrees and less than or equal to 25 degrees. can For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

Referring to FIG. 8C , the processor of the foldable electronic device checks whether the outfolding angle is greater than or equal to 160 degrees and less than or equal to 180 degrees and the entire area of the first display faces upward (eg, the second and fourth surfaces are downwards). towards the ) can be checked. For example, the processor may check a result of sensing the posture of the electronic device through a gravity sensor (eg, the sensor module 176 of FIG. 1 ). The processor may be set to determine whether the result of checking the folding angle and the posture of the electronic device matches the pre-stored state.

According to various embodiments of the present disclosure, the processor may divide and display the display screen of the display in response to a pre-stored state that matches the change of the state of the display of the electronic device and the result of checking the posture of the electronic device. For example, the processor may divide and display the execution screen (eg, UI) of the application being executed based on the folding axis or the rolling/sliding boundary axis. According to an embodiment, the processor displays an execution screen (eg, a dialog screen of a message application) related to the content input result of the application on the display area in the front direction of the user's gaze, and the execution screen (eg, a dialog screen of the message application) related to the content input of the application Example: An input screen such as a keyboard for inputting message content) can be displayed in an area of the display facing upward (eg, ceiling, sky).

Referring to FIG. 9A , an electronic device 900 (eg, the electronic device 101 of FIG. 1 and the electronic device 200 of FIG. 2 ) according to various embodiments may include a housing and a first display 910 . and may include at least some of the configuration and/or functions of the electronic device 101 of FIG. 1 and/or the electronic device 200 of FIG. 2 . A portion of the first display 910 may be rolled in or folded inside the housing, and may be spread vertically through at least one or more roller structures.

The first display 910 may be divided into a first area 911 and a second area 912 as an area in which content is displayed. The first area 911 may correspond to an area in which the content of the electronic device 900 is displayed in a roll-in or slide-in state of the first display 910 . The second area 912 may correspond to an additional area in which the content of the electronic device 900 is displayed in a state of roll out or slide out of the first display 910 . Here, the additional area may mean a display area of the expanded first display other than the first area 911 of the first display 910 in which content was displayed in the roll-in state or the slide-in state.

Referring to FIG. 9A , a roll-in state or a slide-in state of the electronic device 900 may correspond to a folded state. For example, a roll-in or slide-in state may correspond to a closed state. A roll-out or slide-out state of the electronic device 900 may correspond to an unfolded state. For example, a roll-out or slide-out state may correspond to an open state, and may correspond to an unfolded state.

In addition to the form shown in FIG. 9A , the electronic device 900 may increase the display utilization area in the closed state up to three times when unfolded. In this case, the rolled-in or rolled-in hidden display may be twice the display area of the unfolded state.

9B and 9C are exemplary views illustrating a posture of a rollable electronic device according to various embodiments of the present disclosure;

Referring to FIG. 9B , the first display of the rollable electronic device may be unfolded to an area twice as large as the first area. According to another embodiment, the unfolded state of FIG. 7B may be an unfolded state corresponding to n times the area corresponding to the first area in the roll-in state. The processor of the rollable electronic device may check a result of sensing the roll-in state of the electronic device through the sensor.

Referring to FIG. 9C , the first display of the rollable electronic device may be unfolded to an area equal to one time the first area. For example, the rolled-in state of FIG. 9C may be a rolled-in state corresponding to the area corresponding to the first region. The processor of the rollable electronic device may check a result of sensing the roll-in state of the electronic device through the sensor.

Referring to FIG. 10 , operation 1001 may correspond to executing a first application. For example, the first application may include at least one of a video call application, a photographing application, a messenger application, a document writing application, and a video playback application.

Referring to FIG. 10 , in operation 1002 , the processor of the electronic device may detect a folded state of the electronic device. For example, the folding state of the electronic device may be checking the result of detecting the folding state of the display through the folding detection sensor.

Referring to FIG. 10 , in operation 1003 , the processor may sense the posture of the electronic device. For example, the posture of the electronic device may be to confirm a result of detecting a direction in which the display is directed through a gravity sensor in a state in which a part of the electronic device is folded.

Referring to FIG. 10 , operation 1004 may be to compare a state in which the processor is preset with the folded state and posture of the electronic device. For example, it may correspond to checking whether the range of the folding angle of the electronic device matches a predetermined state corresponding to the posture of the electronic device.

Referring to FIG. 10 , operation 1005 may be to divide the display of the electronic device into a first area and a second area based on a folding axis. According to an embodiment, the upper or lower, left or right regions may be divided based on the folding axis of the display of the foldable electronic device. According to another embodiment, the area may be divided based on the closed/unfolded state of the display of the rollable electronic device.

Referring to FIG. 10 , operation 1006 may be to display a part of the execution screen of the first application being executed in the first area. For example, what is displayed in the first area may be a UI corresponding to an execution screen related to a content input result. The first area may refer to an area of the display in the front direction of the user's gaze for the convenience of the user.

Referring to FIG. 10 , operation 1007 may be to display the remainder of the execution screen of the first application in the second area. For example, a UI for receiving an input related to the execution of the first application may be displayed in the second area. For example, a UI corresponding to an execution screen related to content input may be displayed in the second area.

Referring to FIG. 10 , in operation 1008 , it may be determined whether a communication connection of the electronic pen is detected as an event related to the built-in electronic pen or an external device. According to an embodiment, the event related to the embedded electronic pen may include at least one of an input of clicking a button of the electronic pen, proximity of the electronic pen to the electronic device, or removal of the electronic pen from the electronic device. According to another embodiment, the communication connection of the electronic pen as an external device may include at least one of an input of clicking a button of the external device, proximity of the external device to the electronic device, or communication connection of the external device with the electronic device. have.

Referring to FIG. 10 , operation 1009 may be to provide a third area to at least a part of the second area when an event related to the electronic pen or a communication connection is detected.

Referring to FIG. 10 , in operation 1010, an air command may be displayed on at least a portion of the third area. For example, the air command may mean display of a control UI for executing the second application. According to various embodiments, the second application may include at least one of a memo application and an editing application.

Referring to FIG. 10 , operation 1011 may determine whether the user selects an air command.

Referring to FIG. 10 , operation 1012 may be to display the execution screen of the second application on at least a portion of the third area when the user's selection of the air command is detected. Operation 1013 may be to display the execution screen of the third application on at least a part of the third area when the user's selection of the air command is not detected.

According to various embodiments, the first area may include any one of two areas divided based on a folding axis of the foldable display. The second area may include at least a portion of the other one of the two areas divided based on the folding axis of the foldable display. The third region may include at least a portion of the second region. The representation of the first region, the second region, and the third region described in this document may be divided into a physical region based on a folding axis. According to another embodiment, the n-th region may correspond to the first region, the second region, and/or the third region in which the input interface is located, the execution screen that can enter the field of view in consideration of the user's convenience.

11A to 11D , an application (eg, a first application) being executed in the foldable electronic device may be a video call application. For example, the user may change the display state of the foldable electronic device to match the pre-stored posture of the electronic device. The processor may determine the folding angle and posture of the electronic device, and display the execution screen of the first application divided based on the folding axis. According to an embodiment, the execution screen displayed on the first area 411 of the first display 410 may relate to images of users making a video call. According to another embodiment, a UI for receiving an input related to the execution of the first application may be displayed in the second area. For example, the execution screen displayed on the second area 412 of the first display 410 may relate to a UI for controlling a video call. An event related to 250 may be executed or an electronic pen, which is an external device, may be communicatively connected with the electronic device. The processor may detect an event related to the electronic pen or sense a communication connection through the communication module, and may provide the third area to at least a portion of the second area. For example, the second area may mean physically the first display area of the second housing, but it will be understood by referring to the area of the second application or the third application displayed on the second area as the third area. can According to an embodiment, the processor sets the control UI 1110 (eg, air command) to be displayed on the third area for a preset time (eg, 2-3 seconds) in response to removal of the electronic pen or communication connection can be

Referring to FIG. 11C , after the third area is displayed, the air command button 1110 is displayed together and when selection (eg, input) of at least a part of the air command is sensed, the air command menu screen is a screen for executing the second application. (1120).

Referring to FIG. 11D , when the selection of at least a part of the air command is not detected after the third area is displayed, the execution screen of the third application (eg, paint application for video call editing, sketch mode, etc.) is displayed in the third area can be displayed.

According to various embodiments, when a preset event is detected, the processor may be set to display the control UI 1110 in the third area to detect whether a corresponding UI is selected. For example, as shown in FIG. 11D , there may be a case where the air command is not used in the third area and then the air command is used again. The user may perform a preset event to use the second application instead of the third application. The preset event may include at least one of a gesture control using an electronic pen and/or a touch, a voice control, a long press, and a button input.

11B to 11D , when the third region is activated, the video call screen of the first region may be mirrored in the third region. The user may input an AR doodle sketch, a pen sketch, and the like on the screen of the first area. The input on the third region may be displayed in the same manner as the input in the first region in real time.

12A to 12D , an application (eg, a first application) being executed in the foldable electronic device may be a messenger application (eg, an interactive application). For example, the user may change the display state of the foldable electronic device to match the pre-stored posture of the electronic device. The processor may determine the folding angle and posture of the electronic device, and display the execution screen of the first application divided based on the folding axis. According to an exemplary embodiment, the execution screen displayed on the second area 612 of the first display 610 may relate to user conversations. According to another embodiment, the execution screen displayed on the third area 613 of the first display 610 may be related to a UI for controlling a messenger.

Referring to FIG. 12B , the user executes an event related to the electronic pen 250 while executing the messenger, or the electronic pen, which is an external device, may be communicated with the electronic device. The processor may detect an event related to the electronic pen or detect a communication connection through the communication module, and may provide an execution screen of the second application or the third application on at least a portion of the display. For example, the third area may mean physically the first display area of the third housing, but the area of the second application or the third application displayed on the third area (or the area where the control UI is displayed) may be understood by referring to the fourth region. According to an embodiment, the processor may be set to display a control UI (eg, an air command) on the fourth area for a preset time (eg, 2-3 seconds) in response to an event or communication connection related to the electronic pen. have.

According to various embodiments, after the fourth area is displayed, the air command button is displayed together and when a selection (eg, input) of at least a part of the air command is detected, the screen for executing the second application is converted to the air command menu screen. can

According to an embodiment, when the selection of at least a part of the air command is not detected after the fourth area is displayed, a third application (eg, a handwriting application for editing a conversation in a messenger, a memo pad application, a paint application, etc.) is executed The screen may be displayed in the fourth area.

According to another embodiment, when a preset event is detected, the processor may be set to display a control UI in the fourth area to detect whether a corresponding UI is selected. For example, there may be a case where the air command is not used in the fourth area and then the air command is used again. The user may perform a preset event to use the second application instead of the third application. The preset event may include at least one of a gesture control using an electronic pen and/or a touch, a voice control, a long press, and a button input.

12B to 12D , when the fourth area is activated, the execution screen of the third application may be provided to the fourth area. According to an embodiment, the user may input content into the fourth area using an electronic pen and a touch input. According to another embodiment, when the user inputs content to the fourth area, only input using a pen may be possible. According to an embodiment, the processor may store the type of pen that the user has recently used, and may also store the style of the pen that has been used. For example, if the user makes a fountain pen-style input using the No. 1 electronic pen (eg, the electronic pen 250 that may be mounted in the electronic device), if the same connection is made, the memory for the most recent use is saved. It can provide continuity of read and use.

13A and 13B , an application (eg, a first application) being executed in the rollable electronic device may be a messenger application (eg, an interactive application). For example, the user may change the display state of the rollable electronic device to match the previously stored state of the electronic device. The processor may determine the change state of the display, and divide and display the execution screen of the first application based on the rolling/sliding boundary axis. According to an exemplary embodiment, the execution screen displayed on the first area 711 of the first display 710 may relate to user conversations. According to another embodiment, the execution screen displayed on the second area 712 of the first display 710 may be related to a UI for controlling a messenger.

Referring to FIG. 13B , the user executes an event related to the electronic pen 250 while executing the messenger, or the electronic pen, which is an external device, may be communicated with the electronic device. The processor may detect an event related to the electronic pen or detect a communication connection through the communication module, and may provide an execution screen of the second application or the third application on at least a portion of the display. For example, the second area 712 may physically mean the first display area of the second housing, but the second application or third area displayed on the second area (or the area where the control UI is displayed). It may be understood that the application area is referred to as a third area 713 . According to an embodiment, the processor may be set to display a control UI (eg, an air command) in the third area for a preset time (eg, 2-3 seconds) in response to an event or communication connection related to the electronic pen. have.

According to various embodiments, when the air command button is displayed together after the third area 713 is displayed and a selection (eg, input) of at least a part of the air command is detected, the air command menu screen as a screen for executing the second application. can be converted to

According to an embodiment, when the selection of at least a part of the air command is not detected after the third area 713 is displayed, a third application (eg, a handwriting application for editing a messenger conversation, a memo pad application, a paint application, etc.) ) may be displayed in the third area 713 .

According to another embodiment, when a preset event is detected, the processor may be set to display a control UI in the third area to detect whether a corresponding UI is selected. For example, there may be a case in which the air command is not used in the third area 713 and then the air command is intended to be used again. The user may perform a preset event to use the second application instead of the third application. The preset event may include at least one of a gesture control using an electronic pen and/or a touch, a voice control, a long press, and a button input.

13A and 13B , when the third area 713 is activated, an execution screen of a third application may be provided in the third area. According to an embodiment, the user may input content into the third area 713 using an electronic pen and a touch input. According to another embodiment, when the user inputs content to the third area, only input using a pen may be possible. According to an embodiment, the processor may store the type of pen that the user has recently used, and may also store the style of the pen that has been used. For example, if the user makes a fountain pen-style input using the No. 1 electronic pen (eg, the electronic pen 250 that may be mounted in the electronic device), if the same connection is made, the memory for the most recent use is saved. It can provide continuity of read and use.

14A and 14B , an application (eg, a first application) being executed in the foldable electronic device may be a messenger application (eg, an interactive application). For example, the user may change the display state of the foldable electronic device to match the pre-stored posture of the electronic device. The processor may determine the folding angle and posture of the electronic device, and display the execution screen of the first application divided based on the folding axis. According to an exemplary embodiment, the execution screen displayed on the second area 812 of the first display 810 may be related to user conversations. According to another embodiment, the execution screen displayed on the third area 813 of the first display 810 may be related to a UI for controlling a messenger.

Referring to FIG. 14B , the user may execute an event related to the electronic pen 250 while executing the messenger, or the electronic pen, which is an external device, may be communicated with the electronic device. The processor may detect an event related to the electronic pen or detect a communication connection through the communication module, and may provide an execution screen of the second application or the third application on at least a portion of the display. For example, the third area may physically mean the first display area of the third housing, but the area of the second application or the third application displayed on the second area (or the area where the control UI is displayed) may be understood as a third region 813 . According to an embodiment, the processor may be set to display a control UI (eg, an air command) in the third area for a preset time (eg, 2-3 seconds) in response to an event or communication connection related to the electronic pen. have.

According to various embodiments, when the air command button is displayed together after the third area 813 is displayed and a selection (eg, input) of at least a part of the air command is detected, the air command menu screen as a screen for executing the second application. can be converted to

According to an embodiment, when the selection of at least a part of the air command is not detected after the third area 813 is displayed, a third application (eg, a handwriting application for editing a conversation of a messenger, a memo pad application, a paint application, etc.) ) may be displayed in the third area 813 .

According to another embodiment, when a preset event is detected, the processor may be set to display a control UI in the third area to detect whether a corresponding UI is selected. For example, there may be a case where the air command is not used in the third area and then the air command is used again. The user may perform a preset event to use the second application instead of the third application. The preset event may include at least one of a gesture control using an electronic pen and/or a touch, a voice control, a long press, and a button input.

14A and 14B , when the third area 813 is activated, an execution screen of a third application may be provided in the third area. According to an embodiment, the user may input content into the third area using an electronic pen and a touch input. According to another embodiment, when the user inputs content to the third area, only input using a pen may be possible. According to an embodiment, the processor may store the type of pen that the user has recently used, and may also store the style of the pen that has been used. For example, if the user makes a fountain pen-style input using the No. 1 electronic pen (eg, the electronic pen 250 that may be mounted in the electronic device), if the same connection is made, the memory for the most recent use is saved. It can provide continuity of read and use.

15A and 15B , an application (eg, a first application) running in a rollable electronic device (eg, a type of out-rollable electronic device) may be a messenger application (eg, an interactive application). For example, the user may change the display state of the rollable electronic device to match the previously stored state of the electronic device. The processor may determine the change state of the display and divide and display the execution screen of the first application based on half of the first area 911 of the first display 910 . According to an embodiment, the execution screen displayed on the upper half of the first area 911 of the first display 910 may relate to user conversations. According to another embodiment, the execution screen displayed in the lower half of the first area 911 of the first display 910 may relate to a UI for controlling a messenger.

Referring to FIG. 15B , the user executes an event related to the electronic pen 250 while executing the messenger, or the electronic pen, which is an external device, may be communicated with the electronic device. The processor may detect a communication connection through an event related to the electronic pen or a communication module, and may provide an execution screen of the second application or the third application on at least a portion of the display. For example, the second area 912 may physically mean the area of the display that is slid and expanded, but the second application displayed on the first area or the second area (or the area where the control UI is displayed). Alternatively, the area of the third application may be understood as a third area 913 . According to an embodiment, the processor may be set to display a control UI (eg, an air command) in the third area for a preset time (eg, 2-3 seconds) in response to an event or communication connection related to the electronic pen. have.

According to various embodiments, after the third area 913 is displayed, the air command button is displayed together and when a selection (eg, input) of at least a part of the air command is detected, the air command menu screen as a screen for executing the second application. can be converted to

According to an embodiment, when the selection of at least a part of the air command is not detected after the third area 913 is displayed, a third application (eg, a handwriting application for editing a messenger conversation, a memo pad application, a paint application, etc.) ) may be displayed in the third area 913 . According to various embodiments of the present disclosure, in the rollable electronic device, the third area 913 may be activated in the direction of the second area 912 . For example, if the display is expanded by sliding out the rollable electronic device, the third area 913 may be displayed while being expanded in the direction of the second area 912 . The third area 913 does not increase by the expanded size (eg, not limited to the slide-out area of the display), but is divided within the display area including the extended area and displayed on the screen (eg, the physical size of the first display). may be displayed over the first area 911 and the second area 912).

According to another embodiment, when a preset event is detected, the processor may be set to display a control UI in the third area to detect whether a corresponding UI is selected. For example, there may be a case in which the air command is not used in the third area 913 and then the air command is intended to be used again. The user may perform a preset event to use the second application instead of the third application. The preset event may include at least one of a gesture control using an electronic pen and/or a touch, a voice control, a long press, and a button input.

13A and 13B , when the third area 913 is activated, an execution screen of a third application may be provided in the third area. According to an embodiment, the user may input content into the third area 913 using an electronic pen and a touch input. According to another embodiment, when the user inputs content to the third area, only input using a pen may be possible. According to an embodiment, the processor may store the type of pen that the user has recently used, and may also store the style of the pen that has been used. For example, if the user makes a fountain pen-style input using the No. 1 electronic pen (eg, the electronic pen 250 that may be mounted in the electronic device), if the same connection is made, the memory for the most recent use is saved. It can provide continuity of read and use.

In a foldable electronic device according to various embodiments of the present disclosure, a portion of an execution screen of a first application displayed on the

first regions

411 and 511 of the

first displays

410 and 510 and displayed on the

second regions

412 and 512 are displayed. It may be possible to switch the execution screen.

According to an embodiment, the processor may determine the posture of the electronic device. The processor can compare the results detected by the gravity sensor to determine whether it matches the pre-stored state. In the foldable electronic device, the display viewed by the user may be changed as shown in FIGS. 16A to 17B . The processor may detect the posture of the electronic device and switch the divided and displayed execution screen corresponding to the posture of the electronic device.

Referring to FIG. 18A , in operation 1811, input contents such as an electronic pen may be displayed on the third area. For example, input contents such as an electronic pen may be input to the execution screen of the third application displayed in the third area.

Referring to FIG. 18A , operation 1812 may be to determine whether a command for moving input content from the third area to the first area is detected. For example, it may be detected that the content input by the user in the third area is moved to the first area by hovering, selection, and drag and drop. In this case, selected contents among contents input to the third area may be copied and pasted into the first area.

Referring to FIG. 18A , operation 1813 may be to provide content generated in the third area to the first area. For example, when a hovering input or a drag-and-drop input is sensed from the third region to the first region, the content of a selected portion of the content input to the third region may be provided to the first region.

Referring to FIG. 18B , operation 1821 may be to display the contents of an input using an electronic pen or the like in the first area or the third area.

Operation 1822 may be to copy content input to the first area or the third area in a clipboard. Copying and/or pasting content input using the clipboard may enable sharing between the first area and/or the third area. Operation 1823 may be to provide the content generated in the first area or the third area to the first area or the third area. For example, content of content input from the first area and/or the third area may be copied and/or pasted to each other by sharing a clipboard.

According to an exemplary embodiment, content input to the third areas 413 and 513 (eg, content generated by a user) may be moved to the first area 411 or the second area 512 . For example, if the content created in a third application (eg, a paint application, a notepad application, etc.) is moved toward the first area 411 or the second area 512 as an input for hovering by a user selecting a certain area, You can copy and/or paste sketch images or handwritten images, memo text, etc.

According to another exemplary embodiment, content input to the

third areas

413 and 513 may be shared with the first area 411 or the second area 512 . For example, content generated in a first application (eg, a messenger application, a document application, etc.) may be copied and/or pasted by a user using a clipboard to be utilized in the third area. The clipboard may be controlled to share generated content between the first area and the third area (eg, between divided areas of the display).

FIG. 20A may indicate that a screen is displayed after being divided based on the folding axis according to the state of the electronic device detected by the change of the folding state of the foldable electronic device 500 .

20B is an example illustrating activation of the third region 513 due to the use of the electronic pen 250 . According to an embodiment, the third area may be displayed while the display screen of the first area 511 is reduced. According to another embodiment, when it is determined that the posture is different from the posture of the electronic device of FIG. 20B , the third area may be displayed while the display screen of the second area 512 is reduced.

20C is an example illustrating that the third region 513 is deactivated when the use of the electronic pen 250 is terminated. Ending the use of the electronic pen may refer to the end of an event related to the electronic pen. For example, the end of the event related to the electronic pen may include at least one of stopping the use of the electronic pen, moving the electronic pen away from the electronic device by a certain distance or more, or inserting the electronic pen. When an event related to the electronic pen is terminated or a communication connection is disconnected, the activated and displayed third area may be deactivated and disappear. The execution screen of the third area displayed in the first area or the second area may be inactivated, and only the control UI portion of the first application displayed in the first area or the second area may be displayed.

21A to 21C may correspond to a folded state and posture of the foldable electronic device of FIG. 6C . Referring to FIG. 21A , a messenger application may be running as a first application. The first area 611 and the second area 612 of the first display 610 of the electronic device 600 may be displayed as one execution screen. The execution screen of the first application displayed over the first area 611 and the second area 612 may relate to the contents of the messenger conversation. In the third area 613, information related to the control UI of the first application may be displayed.

Referring to FIG. 21B , the user of the electronic device 600 may execute an event related to the electronic pen mounted in the electronic device to use the electronic pen 250 or may communicate and connect the electronic pen, which is an external device, with the electronic device. . The processor of the electronic device 600 may detect an event related to the electronic pen 250 or detect a communication connection with the electronic pen through a communication module. According to an embodiment, when the processor detects an event related to the electronic pen or a communication connection of an external device (eg, an electronic pen that is not mounted), the processor displays the fourth area 614 on at least a part of the third area 613 . can be set. For example, the control UI related to the use of the electronic pen may be displayed in the fourth area 614 for a preset period of time, and may be deactivated when there is no detection of selection regarding the control UI. In this case, the fourth region 614 is not deactivated. According to another embodiment, when a selection regarding the control UI is detected, the second application is displayed on the fourth area 614 , and when the selection is not detected, the execution screen of the third application can be displayed on the fourth area 614 . have.

Referring to FIG. 21C , the content generated in the fourth area 614 may be moved to the first area 611 and the second area 612 in a format acceptable to the electronic device, such as images and text. According to another embodiment, it may be set to share the clipboard so that copying and/or pasting is mutually possible.

22A and 22B may correspond to a folded state and posture of the foldable electronic device of FIG. 6E . Referring to FIG. 22A , an image playback application may be running as a first application. The execution screen of the first application displayed on the third area 613 of the first display 610 of the electronic device 600 may relate to image reproduction. In the first area 611 and the second area 612 , an application different from the first application (eg, a document editing application, a memo pad application, etc.) may be displayed separately.

Referring to FIG. 22B , the user of the electronic device 600 may execute an event related to the electronic pen mounted in the electronic device to use the electronic pen 250 or may communicate and connect the electronic pen as an external device with the electronic device. . The processor of the electronic device 600 may detect an event related to the electronic pen 250 or detect a communication connection with the electronic pen through a communication module. According to an embodiment, when the processor detects an event related to the electronic pen or a communication connection of an external device (eg, an unmounted electronic pen), the application displayed in the first area 611 and the second area 612 is executed The screen may disappear and the sketch application may be set to run. In this case, the sketch application may be input through a touch input and/or an electronic pen. According to another embodiment, the sketch application may be set so that only input through the electronic pen is possible.

According to various embodiments, the control UI related to the use of the electronic pen may be displayed for a preset period of time in the first area 611 and the second area 612 , and may be deactivated when there is no detection of selection regarding the control UI. In this case, the first region 611 and the second region 612 are not deactivated. According to another embodiment, when a selection regarding the control UI is detected, the second application is displayed in the first area 611 and the second area 612 , and when the selection is not detected, the execution screen of the sketch application is displayed in the first area ( 611) and the second area 612 may be displayed.

23A and 23B may correspond to the folded state and posture of the foldable electronic device of FIG. 6E . Referring to FIG. 23A , a messenger application may be running as a first application. The first area 611 and the second area 612 of the first display 610 of the electronic device 600 may be displayed as one execution screen. The execution screen of the first application displayed in the third area 613 may be related to the contents of the messenger conversation. The first area 611 and the second area 612 may display information related to the control UI of the first application.

Referring to FIG. 23B , the user of the electronic device 600 may execute an event related to the electronic pen mounted in the electronic device to use the electronic pen 250 or may communicate and connect the electronic pen, which is an external device, with the electronic device. . The processor of the electronic device 600 may detect an event related to the electronic pen 250 or detect a communication connection with the electronic pen through a communication module. According to an embodiment, when the processor detects an event related to the electronic pen or a communication connection of an external device (eg, an unmounted electronic pen), the processor places a fourth in at least a portion of the first area 611 and the second area 612 . It may be set to display the area 611 (eg, a fourth area as an expression indicating newly displayed content). For example, in the fourth area 611 on the first area, the control UI related to the use of the electronic pen may be displayed for a preset period of time and may be deactivated when there is no detection of selection regarding the control UI. In this case, the fourth region 614 is not deactivated. According to another embodiment, when a selection regarding the control UI is detected, the second application is displayed on the fourth area 611 , and when the selection is not detected, the execution screen of the third application can be displayed on the fourth area 611 . have.

According to various embodiments, the third application that may be displayed in the fourth area may be set in various ways, such as a paint application, a note application, a memo pad application, and the like.

The electronic device according to various embodiments disclosed herein may include a foldable display, a folding detection sensor, an electronic pen, and a processor, and the processor is configured to detect a folding state of the foldable display using the folding detection sensor. The execution screen of the first application being executed in response to the folding state may be displayed separately in the first area and the second area of the foldable display, and an event related to the electronic pen may be detected, and the detection may be performed. A third area may be provided in at least a portion of the second area based on an event related to the electronic pen.

In addition, the processor may display a UI for receiving an input related to the execution of the first application in the second area, and display an execution screen of a second application for receiving the input of the electronic pen in the third area have.

Also, the first region may include any one of two regions divided based on a folding axis, and the second region may include at least a portion of the other one of the two regions divided based on the folding axis. may include, wherein the first application may include at least one of a video call application, a photographing application, a messenger application, a document writing application, and a video playback application, and the second application may include at least one of a memo application and an editing application. may include one, and the event related to the electronic pen may include at least one of a button input of the electronic pen, proximity of the electronic pen to the electronic device, or removal of the electronic pen from the electronic device. have.

In addition, the electronic device according to various embodiments disclosed in this document may further include a communication module, the processor may check a communication connection with an external device through the communication module, and The third region may be provided in at least a part of the second region based on the second region.

In addition, the processor may display a control UI using the electronic pen or the external device on at least a part of the third area for a preset time based on the detected event related to the electronic pen or confirmation of communication connection with the external device. can be displayed

In addition, the processor may display an execution screen of a second application in the third area when selection of at least a part of the displayed control UI is detected, and the selection of at least a part of the displayed control UI is not detected. If not, the execution screen of the third application may be displayed in the third area.

In addition, the processor may display the control UI on at least a part of the third area when a preset event is detected during execution of the third application, and detect selection of at least a part of the displayed control UI. can

Also, the preset event may include at least one of a gesture control, a voice control, a long press, and a button input.

In addition, the electronic device according to various embodiments disclosed herein may further include a gravity sensor, and the processor detects the first area and the second area through the gravity sensor in response to the sensed folding state. and display the execution screen of the first application in the first and second areas divided based on the folding axis.

In addition, the processor stores the content generated in the third area in a clipboard and provides them to each other to share with the first area, or by hovering at least a part of the content generated in the third area. It can be provided as the first area.

In addition, the processor may detect the end of the event related to the electronic pen or confirm the end of the communication connection with the external device, and may be configured to detect the end of the detected event related to the electronic pen or to communicate with the confirmed external device. Based on termination of the connection, the provided third area may be restored to the second area.

A method of providing a screen division interlocked with an electronic pen according to various embodiments disclosed herein includes an operation of detecting a folding state of a foldable display using a folding sensor, and executing a first application being executed in response to the folding state At least a portion of the second area based on an operation of separately displaying a screen in a first area and a second area of the foldable display, an operation of detecting an event related to the electronic pen, and an operation of detecting an event related to the electronic pen It may include an operation of providing the third region to the .

The displaying may include displaying a UI for receiving an input related to execution of the first application in the second area, and the providing may include input of the electronic pen in the third area. It may include an operation of displaying the execution screen of the second application that receives the.

Also, the detecting of the event related to the electronic pen may include at least one of a button input of the electronic pen, proximity of the electronic pen to the electronic device, or removal of the electronic pen from the electronic device, The first area may include any one of the two areas divided based on the folding axis, and the second area may include at least a portion of the other one of the two areas divided based on the folding axis. and the first application may include at least one of a video call application, a photographing application, a messenger application, a document writing application, and a video playback application, and the second application may include at least one of a memo application or an editing application. may include

In addition, the providing operation includes an operation of confirming a communication connection with an external device through a communication module and an operation of providing the third region to at least a portion of the second region based on the communication connection confirmation with the external device may include

Also, based on the detected event related to the electronic pen or confirmation of communication connection with the external device, displaying a control UI using the electronic pen or the external device on at least a part of the third area for a preset time period may further include.

In addition, the displaying operation may include an operation of displaying an execution screen of a second application in the third area when selection of at least a part of the displayed control UI is detected and a selection of at least a part of the displayed control UI is not detected. In this case, an operation of displaying an execution screen of a third application in the third area may be included.

In addition, when a preset event is detected during execution of the third application, the method may further include displaying the control UI on at least a part of the third area and detecting selection of at least a part of the displayed control UI. can

In addition, in response to the detected folding state, the operation of dividing the first region and the second region through the gravity sensor and the execution screen of the first application in the divided first region and the second region based on the folding axis may further include an operation of displaying

In addition, the contents generated in the third area are stored in a clipboard and provided to each other to be shared with the first area, or some of the contents generated in the third area are provided to the first area by hovering It may further include an operation to

In addition, based on an operation of detecting the end of the event related to the electronic pen or confirming the end of the communication connection with the external device, and the end of the detected event related to the electronic pen or the confirmed termination of the connection with the external device The method may further include restoring the provided third area to the second area.

An electronic device according to various embodiments disclosed herein may include a rollable display, a detection sensor for detecting a state of the display, an electronic pen, and a processor, wherein the processor uses the detection sensor to expand the rollable display state can be detected, and in response to the sensed unfolding state, an execution screen of a running first application can be displayed separately in the first region and the second region of the rollable display, and the electronic pen-related An event may be detected, and a third area may be provided in at least a portion of the second area based on an event related to the electronic pen.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of, or all possible combinations of, items listed together in the corresponding one of the phrases. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims

In an electronic device,

foldable display;

folding sensor;

electronic pen; and

including a processor;

the processor is

detecting the folding state of the foldable display using the folding detection sensor;

In response to the folding state, the execution screen of the first application being executed is displayed separately in the first area and the second area of the foldable display,

detecting an event related to the electronic pen;

An electronic device providing a third area to at least a part of the second area based on the detected event related to the electronic pen.
According to claim 1,

The processor is

displaying a UI for receiving an input related to the execution of the first application in the second area;

An electronic device that displays an execution screen of a second application that receives an input of the electronic pen in the third area.
3. The method of claim 2,

The first area includes any one of two areas divided based on the folding axis,

The second area includes at least a partial area of the other one of the two areas divided based on the folding axis,

The first application includes at least one of a video call application, a photographing application, a messenger application, a document writing application, and a video playback application,

The second application includes at least one of a memo application and an editing application,

The event related to the electronic pen includes at least one of a button input of the electronic pen, proximity of the electronic pen to the electronic device, or removal of the electronic pen from the electronic device.
According to claim 1,

Further comprising a communication module,

the processor is

Check the communication connection with the external device through the communication module,

The electronic device provides the third region in at least a part of the second region based on confirmation of communication connection with the external device.
5. The method of claim 4,

the processor is

An electronic device that displays a control UI using the electronic pen or the external device for a preset time on at least a part of the third area based on the detected event related to the electronic pen or confirmation of communication connection with the external device.
6. The method of claim 5,

the processor is

When a selection of at least a part of the displayed control UI is detected, an execution screen of a second application is displayed in the third area,

When a selection of at least a part of the displayed control UI is not detected, the electronic device displays an execution screen of a third application in the third area.
7. The method of claim 6,

the processor is

When a preset event is detected during execution of the third application, the control UI is displayed on at least a part of the third area,

An electronic device that detects selection of at least a part of the displayed control UI.
8. The method of claim 7,

The preset event is

An electronic device comprising at least one of gesture control, voice control, long press, or button input.
According to claim 1,

further comprising a gravity sensor,

the processor is

distinguishing the first region and the second region through the gravity sensor in response to the sensed folding state,

An electronic device that displays an execution screen of the first application in the first and second areas divided based on a folding axis.
According to claim 1,

the processor is

The content generated in the third area is stored in a clipboard and provided to each other to be shared with the first area, or provided to the first area by hovering at least a portion of the content generated in the third area. electronic device.
5. The method of claim 4,

the processor is

detecting termination of an event related to the electronic pen or confirming termination of a communication connection with the external device;

The electronic device restores the provided third area to the second area based on the end of the detected event related to the electronic pen or the confirmed end of the connection with the external device.
A method of providing a screen division interlocked with an electronic pen, the method comprising:

detecting a folding state of the foldable display using a folding detection sensor;

displaying an execution screen of a running first application in a first area and a second area of the foldable display in response to the folding state;

detecting an event related to the electronic pen; and

and providing a third area to at least a part of the second area based on the detected event related to the electronic pen.
13. The method of claim 12,

The displayed operation is

and displaying a UI for receiving an input related to the execution of the first application in the second area,

The operation provided above is,

and displaying an execution screen of a second application for receiving the input of the electronic pen in the third area.
14. The method of claim 13,

The first area includes any one of two areas divided based on the folding axis,

The second area includes at least a partial area of the other one of the two areas divided based on the folding axis,

The first application includes at least one of a video call application, a photographing application, a messenger application, a document writing application, and a video playback application,

The second application includes at least one of a memo application and an editing application,

The operation of detecting an event related to the electronic pen is

and at least one of a button input of the electronic pen, proximity of the electronic pen to the electronic device, and detachment of the electronic pen from the electronic device.
13. The method of claim 12,

The operation provided above is

checking a communication connection with an external device through the communication module; and

and providing the third area to at least a part of the second area based on confirmation of communication connection with the external device.