KR20230052184A - Electronic device including flexible display and method for operating thereof - Google Patents

Abstract

The present document relates to an electronic device including a flexible display and an operating method of the electronic device, and according to an embodiment, the electronic device may perform: in an unfolded state, an operation of displaying, in a first region of a flexible type display, a first execution screen in a first screen ratio of a first application; on the basis of the electronic device being changed to a folded state, an operation of changing the first screen ratio of the first execution screen to a second screen ratio corresponding to a third region of the display, and obtaining a first image corresponding to the first execution screen changed to the second screen ratio; an operation of moving and displaying the first image in the third region by applying a visual effect of moving from the first region to the third region of the display through the second region of the display; and an operation of displaying the first execution screen changed to the second screen ratio in the third region, instead of the first image, on the basis of the moving of the first image being completed. Other embodiments are also possible. It is possible to provide visual effects.

Description

Electronic device including a flexible display and operation method in the electronic device

Various embodiments of this document relate to an electronic device including a flexible display and a method of operating the electronic device.

BACKGROUND Electronic devices are evolving into various forms for user convenience and providing various services, applications, or functions. As the variety of services, applications, or functions provided in electronic devices gradually increase, a larger display for providing more screens is required.

Recently, various types of electronic devices (eg, foldable, slideable, or flexible electronic devices) capable of changing the shape of a housing to have a larger display have been developed. Such an electronic device may secure portability while providing a larger display. An electronic device may provide a flexible display in a foldable or bendable form, a slideable form, or a rollable form according to a change in the shape of a housing.

An electronic device may include housings rotatably connected to each other and a flexible display disposed on the housings. An electronic device may display content (eg, video, image) on a flexible display based on data obtained by executing and driving an application. The electronic device may provide a service of displaying different execution screens (or contents) for each area of the flexible display corresponding to each of the housings.

However, in recent electronic devices, each area of the flexible display is visually disconnected, and as the shape of the electronic device is deformed, the execution screen displayed in one hidden area is stopped, providing a continuous and natural experience to the user. It is difficult to display an execution screen displayed in one area in another exposed area.

In this document, according to various embodiments, an electronic device including a flexible display for providing a screen for an application or function and an operating method of the device may be provided.

According to one embodiment of the present document, an electronic device includes a housing including a first housing structure and a second housing structure, a memory, a display module including a flexible display, and electrically connected to the memory and the display module. and at least one processor, wherein the at least one processor controls the display module to display a first execution screen of a first application at a first aspect ratio in a first area of the display in an unfolded state of the electronic device. and change the first aspect ratio of the first execution screen to a second aspect ratio corresponding to the third area of the display based on the transition to the folded state of the electronic device, and change the second aspect ratio to the second aspect ratio. A first image corresponding to the changed first execution screen is obtained, and a visual effect moving from the first area through the second area of the display to the third area is applied to transfer the first image to the third area. Control the display module to move and display, and display the first execution screen changed to the second aspect ratio in the third area by replacing the first image based on the completion of the movement of the first image. It may be set to control the display module.

According to an embodiment, an operation method in an electronic device includes displaying a first execution screen at a first aspect ratio of a first application on a first area of a flexible display of the electronic device in an unfolded state of the electronic device. , Based on the transition to the folded state of the electronic device, the first aspect ratio of the first execution screen is changed to a second aspect ratio corresponding to the third area of the display, and the changed to the second aspect ratio Obtaining a first image corresponding to a first execution screen, applying a visual effect moving from the first area through the second area of the display to the third area of the display to convert the first image to the third area. and displaying the first execution screen changed to the second aspect ratio in the third area by replacing the first image based on the completion of the movement of the first image. can do.

According to an embodiment of the present document, an electronic device including a flexible display obtains an image corresponding to an execution screen displayed in one area among areas of a display that is deformed according to a folded state or an unfolded state, and converts the image to another area. It is possible to provide a visual effect by moving to and displaying it, and by moving to another area and displaying an execution screen corresponding to the displayed image by replacing it, it is possible to provide a continuous and natural experience to the user.

1 is a block diagram of an electronic device in a network environment according to various embodiments.
2 is a diagram illustrating a structure of an electronic device according to an exemplary embodiment.
3A and 3B are views illustrating an unfolded state of an electronic device according to an exemplary embodiment.
3C is a diagram illustrating a closed state of an electronic device according to an exemplary embodiment.
4A and 4B are diagrams illustrating examples for displaying an execution screen according to a state of an electronic device according to an embodiment.
5 is a diagram illustrating an example of an operating method in an electronic device according to an embodiment.
6 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an embodiment.
7 is a diagram illustrating an example of an operating method in an electronic device according to an embodiment.
8 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an embodiment.
9 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an embodiment.
10 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an exemplary embodiment.
11 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an exemplary embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

Hereinafter, electronic devices according to various embodiments will be described with reference to the accompanying drawings. The term user used in various embodiments may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, a software structure in addition to a hardware structure.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used for a component (eg, the processor 120) of the electronic device 101 from an outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : A local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 may be used to realize Peak data rate (eg, 20 Gbps or more) for realizing 1eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency (for realizing URLLC). Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

FIG. 2 is a diagram showing the structure of an electronic device according to an embodiment, FIGS. 3A and 3B are views showing an unfolded state of the electronic device according to an embodiment, and FIG. 3C is an electronic device according to an embodiment. It is a drawing showing the closed state of

Referring to FIGS. 2, 3A, 3B, and 3C , an electronic device 101 (eg, the electronic device 101 of FIG. 1 ) according to an embodiment includes a first housing structure 210 and a second housing structure ( 220, at least one processor 120, a memory 130, and a display module 160. In addition to this, the electronic device may further include other components. The electronic device 101 may be configured in a form in which the shape of the housing is deformable (eg, a foldable, slidable, or flexible form).

According to one embodiment, the first housing structure 210 and the second housing structure 220 may be disposed on both sides of a folding axis B (eg, a horizontal folding axis), and the hinge structure 260 ) It may be rotatably coupled with respect to the folding axis (B) so as to face each other and be folded through. It is not limited thereto, and according to another embodiment, the housing of the electronic device 101 may further include a housing structure other than the first housing structure 210 and the second housing structure 220, and a plurality of folding It can be composed of a structure that can be folded into various shapes through an axis. According to another embodiment, the electronic device 101 may be configured in a form in which a portion of the housing may be folded in a direction different from the folding axis B of FIG. 2 (eg, a y-axis perpendicular to B or a vertical direction). can

According to an embodiment, the first housing structure 210 includes a camera module (eg, a camera 214 included in the camera module 180 of FIG. 1 , various sensors 215 , and a speaker (eg, a receiver) 216 In another embodiment, the camera 214, various sensors 215, and the speaker 216 may be additionally disposed or replaced in at least a portion of the second housing structure 220. According to another embodiment, at least a portion of the camera 214, various sensors 215, and the speaker 216 are disposed in at least a partial area of the first housing 210, and the remaining portion is disposed in the second housing structure 220. The camera 214 may be exposed through an opening provided at one corner of the front surface (eg, the first surface 211) of the first housing structure 210. The sensors 215 may include at least one of a proximity sensor, an illuminance sensor, an iris recognition sensor, an ultrasonic sensor, or an indicator For example, the sensors 215 may be positioned at one corner of the first housing structure 210. It may be exposed on the front surface of the electronic device 101 through the provided opening, or may be disposed on the bottom of at least a portion of the display 161. For example, the electronic device 101 may be disposed in the first housing structure 210 A camera (eg, a rear camera) exposed through an opening provided at one corner of the second surface 212 of ) may be further included.

According to an embodiment, the electronic device 101, although not shown, includes an ear jack hole disposed through the first housing structure 210 and/or the second housing structure 220, an external speaker module, a SIM card tray, and an interface. It may also include a connector port or at least one key button.

According to an exemplary embodiment, the first housing structure 210 and the second housing structure 220 are configured such that the electronic device 101 is in an unfolded state (eg, an unfolded state in FIGS. 3A and 3B), Depending on a folded state (folded state or closed state) (eg, the folded state of FIG. 3C ) or an intermediate state (intermediate state or half folded state), the angle or distance between them may vary. The description of the state may be replaced with a description of the mode. In the intermediate state, the angle between the first surface 211 of the first housing structure 210 and the first surface 221 of the second housing structure 220 is a specified reference angle (eg, 90 degrees or 80 degrees to 100 degrees). range), which may mean a half-folded state. In the unfolded state, the angle between the first surface 211 of the first housing structure 210 and the first surface 221 of the second housing structure 220 exceeds a specified reference angle (eg, exceeds 90 degrees). ~ 180 degrees or more than 101 degrees ~ 180 degrees) or fully open and unfolded (eg, 180 degree angle). In the folded state, the angle range between the first surface 211 of the first housing structure 210 and the first surface 221 of the second housing structure 220 is less than a specified reference angle (eg, less than 90 degrees to It may mean a state that is closed to 0 degrees or less than 80 degrees to 0 degrees) or a state that is completely closed and folded (eg, 0 degrees).

According to one embodiment, the first housing structure 210 and the second housing structure 220 have displays on the first side (eg, front) 211 and 221 of the housing, as shown in FIGS. 3A to 3C . A portion of the flexible display 161 included in the module 160 (hereinafter referred to as a first area y2 - y3 161 - 1 ) may be configured to be disposed. As shown in FIGS. 3A and 3B , the first housing structure 210 has a second side 212 (eg, rear) and a first side 211 of the housing facing in the opposite direction to the first side 211 . and other areas of the display 161 in a form surrounding the third surface 213 (eg, side) of the housing in the space between the second surface 212 (hereinafter, the second area (y1-y2) 161 -2) and a third region (0-y1) (referred to as 161-3) may be configured to be disposed. According to another embodiment, the second region 161 - 1 and the third region 161 - 3 of the display 161 are the second face 221 and the third face 223 of the second housing structure 220 . It can be arranged in the form of enclosing. According to another embodiment, the electronic device 101 surrounds the second region 161 - 3 and a region corresponding to or similar to the third surface 223 of the second housing structure 220 and surrounding the display 161 . Another area (hereinafter referred to as a fourth area) may be configured to extend and be disposed in the first area 161-1.

According to an embodiment, the processor 120 determines the state of the electronic device 101 set according to the angle between the first housing structure 210 and the second housing structure 220 (eg, an unfolded state, a folded state, an intermediate state) ), an operation of displaying an execution screen of an application may be performed. An operation of displaying an application execution screen according to the state of the electronic device 101 will be described later.

According to an embodiment, the processor 120 is a hardware module or a software module (eg, an application program), and is a hardware component (function) including at least one of various components included in the electronic device 101. ) or a software element (program).

According to one embodiment, the processor 210 may include, for example, one or a combination of two or more of hardware, software, or firmware. The processor 210 may omit at least some of the above components or may further include other components for performing image processing operations in addition to the above components.

According to an embodiment, the memory 130 includes various data used by at least one component (eg, the processor 210) of the electronic device 101 and instructions for performing operations executed by the processor 210. can save them. For example, the memory 130 may store an application (function or program) for which an execution screen is displayed in a corresponding area of the display 161 according to an open state or a closed state of the electronic device 101 . The memory 130 may store various data generated during execution of the program 140 as well as programs used for functional operations (eg, the program 140 of FIG. 1 ). The memory 130 may largely include a program area and a data area (not shown). The program area 140 may store program information related to driving the electronic device 201, such as an operating system (OS) for booting the electronic device 201 (eg, the operating system 142 of FIG. 1). The data area (not shown) may store transmitted and/or received data and generated data according to various embodiments. In addition, the memory 130 may be a flash memory, a hard disk, or a multimedia card micro type memory (eg, secure digital (SD) or extreme digital (XD) memory). , RAM (RAM), may be configured to include at least one storage medium of ROM (ROM). According to an embodiment, the memory 130 may store an image corresponding to an execution screen of at least one application displayed on a corresponding area of the display 161 according to an open state or a closed state.

According to one embodiment, the display module 160 may include a flexible display 161 . When the display module 160 displays the execution screen of the application on the set areas of the display 161, the screen of the execution screen of the application to be displayed according to the size, resolution, and ratio of the horizontal length to the vertical length of each set area. ratio can be determined. Here, the aspect ratio of the execution screen of the application is set by the display module 160 under the control of at least one processor 120 or based on aspect ratio information set by at least one processor 120 to be displayed in the corresponding area. You can set the aspect ratio of the screen.

According to an embodiment, as shown in FIGS. 3A and 3B , the display 161 may have a first shape in an unfolded state of the electronic device 101 . As shown in FIG. 3C , the display 161 may have a second shape in a folded state of the electronic device 101 . For example, the first shape may include a first aspect ratio (eg, 16:9), and the second shape may include a second aspect ratio (eg, 4:3). The display 161 may include a first area 161-1 as a main area, a second area 161-2 as a sub area, and a third area 161-3. The first region 161-1 of the display 161 is formed on the first surface 211 of the first housing 210 and the first surface 221 of the second housing structure 220 in a first aspect ratio of the first area 161-1. can be arranged in shape. For example, as shown in FIG. 3B , the second area 161-2 of the display 161 extends to the point y2 and is arranged to surround the third surface 213 of the first housing structure 210. , the third area 161 - 3 of the display 161 may extend to the point y1 and be disposed to surround the second surface 212 of the first housing structure 210 . For another example, the second area 161-2 of the display 161 extends from the point y3 of the first area 161-2 and is disposed on the third surface 223 of the second housing structure 220. , the third region 161 - 3 may extend to the second region 161 - 2 and be disposed on the second surface 222 of the second housing structure 220 . For another example, the display 161 is combined with the second region 161-2 in a folded state of the electronic device 101 to display an execution screen of an application on the second surface 213 of the first housing structure 210. ) and a fourth region (not shown) disposed on the third surface 223 of the second housing structure 220 .

According to another embodiment, parts of the display 161 (eg, the second area 161-2 and the third area 161-3 of the display 161) are rollable that can be rolled into the electronic device. It can be configured as a sliding shape that can be pushed into the shape or inside. For example, parts of the display 161 (eg, the second area 161-2 and the third area 161-3 of the display 161) may be part of the first housing structure 210 or the second housing structure ( 210) is inserted by rolling or pushing into the electronic device 101 through an opening formed on one side of the third surface 213 or 223, and the area inserted into the inside is expanded to extend to the first area 161-1. and can be configured to expand. When in use, the electronic device 101 expands the area inserted into the first housing structure 210 or the second housing structure 220 to the second surface 212 or 222 and the first housing structure 210 or the second housing structure 210. It may be arranged to surround the third surface 213 or 223 of the housing structure 220 .

According to an embodiment, the electronic device 101 may include a motion sensor included in a sensor module (eg, the sensor module 176 of FIG. 1 ) and a magnetic material (eg, a magnet). A motion sensor and a magnetic material (eg, a magnet) may be disposed on at least a portion of the first housing structure 210 . The motion sensor may include a combination of at least two of an acceleration sensor, an angular velocity sensor (eg, a gyro sensor), or a geomagnetic sensor. For example, the electronic device 101 may detect the pose and gesture of the first housing structure 210 through a motion sensor. For example, the posture of the first housing structure 210 may be detected based on an acceleration sensor of the motion sensor, and the movement of the first housing structure 210 may be detected based on an angular velocity sensor of the motion sensor. According to one embodiment, the magnetic material may be disposed on at least a portion of the first housing structure 210 adjacent to the hinge structure 260 .

According to an embodiment, the electronic device 101 includes a motion sensor module and a magnetic force sensor module disposed in at least a portion of the second housing structure 220 and included in a sensor module (eg, the sensor module 176 of FIG. 1 ). can do. According to an embodiment, the motion sensor disposed on at least a portion of the second housing structure 220 may include a combination of at least two of an acceleration sensor, an angular velocity sensor (eg, a gyro sensor), or a geomagnetic sensor. For example, the electronic device 101 may detect the posture of the second housing structure 220 through an acceleration sensor of the motion sensor and detect the movement of the second housing structure 220 through an angular velocity sensor. The magnetic force sensor module may be disposed on at least a portion of the second housing structure 220 adjacent to the hinge structure 260 . For example, the magnetic body of the first housing structure 210 and the magnetic force sensor module of the second housing structure 220 may be arranged so that at least a part faces each other when the electronic device 101 is folded, as shown in FIG. 3C. can

4A is a diagram illustrating an example for displaying an execution screen according to a state of a foldable electronic device according to an exemplary embodiment.

Referring to FIGS. 2 and 4A , the processor 120 of the electronic device 101 according to an embodiment, as shown in (a) of FIG. 4A , displays 161 in an unfolded state of the electronic device 101. Displays an execution screen (hereinafter, referred to as a first execution screen) 410 of an application (hereinafter, referred to as a first application) having a first aspect ratio arranged in a first area (y2-y3) 161-1 of The display module 160 may be controlled to do so. The first aspect ratio may be set to a size (or area) corresponding to or similar to that of the first area (y2-y3) 161-1 of the display 161.

According to one embodiment, as shown in (b) of FIG. 4A , based on the transition to the folded state, the processor 120 displays the first execution screen 410 displayed on the first area 161-1 ( Example: The first screen ratio of the APP) may be changed to the second aspect ratio, and the first execution screen 420 (eg, APP') of the second aspect ratio may be changed. For example, when the processor 120 detects that the first housing structure 210 and the second housing structure 220 face each other and are completely folded using at least one sensor (eg, a proximity sensor), the first housing structure 210 and the second housing structure 220 face each other. The first execution screen 410 of the first aspect ratio may be changed to the first execution screen 420 of the second aspect ratio. For another example, the processor 120 may determine an angle between the first housing structure 210 and the second housing structure 220 based on the folding axis B using at least one sensor (eg, a proximity sensor). When it is detected as less than the designated reference angle, the first execution screen 410 of the first aspect ratio may be changed to the first execution screen 420 of the second aspect ratio.

According to one embodiment, as shown in (c) of FIG. 4A, the processor 120 uses at least one sensor to detect the first housing structure 210 and the second housing structure 220. When the angle between them is detected as less than the specified reference angle, it is identified that the display 161 is switched to the folded state, and the changed first execution screen 420 is captured to capture a first image having a size corresponding to the second aspect ratio ( 430) (e.g. image of App'). The second aspect ratio may be set to a size (or area) corresponding to or similar to that of the third area (0-y1) 161-3 of the display 161. For example, the second aspect ratio may be smaller than the first aspect ratio.

According to an embodiment, as shown in (c) of FIG. 4A, the processor 120 transmits the first image 430 acquired in the folded state to a portion of the first region 161-1 of the display 161. It is possible to control the display module 160 to display on. In the first region 161-1 of the display 161, the electronic device is not exposed in a folded state, and in an activated state, a first image 430 may be displayed on a portion of the first area 161-1, and the first image 430 may be moved. When the movement of the first image 430 is completed while displaying a visual effect, it may be switched to an inactive state. For example, as shown in (c) of FIG. 4A, the second area 161-2 and the third area 161-3 of the display 161 may be in an inactive state. For another example, in the second area 161-2 and the third area 161-3 of the display 161, when the first image 430 is displayed on a portion of the first area 161-1, can be activated.

According to an embodiment, the processor 120 displays the first image 430 in the first area 161-1 of the display 161 in a folded state, as shown in (d) and (e) of FIG. 4A. The display module 160 is configured to display a visual effect moving from a portion of the display 161 through the second area 161-2 (y2-y1) to the third area 161-3 (y1-0). You can control it. For example, as shown in (d) of FIG. 4A, the second area 161-2 and the third area 161-3 of the display 161 are displayed when the first image 430 starts to move. , can be switched to an active state. The processor 120 converts the first image 430 by applying a visual effect that moves the generated first image 430, not at least one content of the application displayed on the first execution screen 420 of the second aspect ratio. can be displayed Here, if at least one content of the application is moved and displayed, the display of the screen may be loaded because the screen of the displayed application must be refreshed every frame while moving in units of pixels. Accordingly, when the processor 120 switches from the expanded state to the collapsed state, the first image 430 obtained by screen-capturing the first execution screen 420 instead of at least one content of the application displayed on the first execution screen 420 can be displayed by applying a visual effect (e.g., animation effect) that moves the For example, the processor 120 transfers the first image 430 from a portion of the first area 161-1 to the second area 161-2 (y2-y1) at a specified speed (eg, constant velocity or acceleration). ) to the third region 161-3 (y1-0) may be displayed by applying a visual effect. For example, the processor 120 may display the first image 430 by applying a gradually enlarged visual effect while moving to the third area 161-3 (y1-0). For another example, the processor 120 displays the first image 430 by applying a gradually reduced visual effect while moving to the third area 161-3 (y1-0), and responds to the reduced effect. Thus, the first execution screen 420 may be displayed while being gradually enlarged. Without being limited thereto, the processor 120 may display the first image 430 by applying various visual effects.

According to one embodiment, as shown in (e) of FIG. 4a, when the movement of the first image 430 to point 0 is completed, the processor 120, as shown in (f) of FIG. 4a, The first image 430 to which the visual effect is applied is removed, and the display module 160 is configured to display the first execution screen 420 (eg, App') of the second aspect ratio on the third area 161-3. You can control it. Here, the first execution screen 420 of the second aspect ratio is the screen of the refreshed application and is displayed in the second aspect ratio corresponding to the size of the third area 161-3 (eg, the size of 0 to y1). It can be.

According to an embodiment, as shown in (f) of FIGS. 3C and 4A, the processor 120 displays the first execution screen 420 on the third area 161-3 in a folded state, In the second area 161-2, another execution screen related to the first application, a second execution screen of the second application, or an object related to at least one application (eg, an execution icon, or content including images, text, or symbols) is displayed. ) may be controlled to display the display module 160 .

According to an embodiment, the processor 120 displays a first execution screen of a first application on a portion of the first area 161-1 in an expanded state, as shown in (a) of FIGS. 3B and 4A. and control the display module 160 to display the second execution screen of the second application on another part of the first region 161-1. As shown in (b) to (d) of FIGS. 3C and 4A , the processor 120 displays the first image corresponding to the first execution screen of the first application to the second area 161 as it is converted to the folded state. -2) to move to the third area 161-3 and display the second image corresponding to the second execution screen of the second application to the second area 161-2 to display the display module ( 160) can be controlled. As shown in (e) of FIG. 4A, when the movement of the first image and the second image is completed, the processor 120 displays the first execution screen corresponding to the first image in the third area 161-3. and a second execution screen corresponding to the second image may be displayed on the second area 161-2. The first image may be an image that changes the first execution screen to the second aspect ratio and corresponds to the first execution screen changed to the second aspect ratio. The second image may be an image that changes the second execution screen to a third aspect ratio and corresponds to the second execution screen changed to the third aspect ratio. For example, the third aspect ratio may be smaller than the second aspect ratio.

According to an embodiment, the processor 120 displays the first execution screen on the third area 161-3 and displays the second execution screen on the second area 161-2, and performs user interaction (e.g. : When a designated gesture, touch, or voice) is input, the display module 160 displays the second execution screen on the third area 161-3 and displays the first execution screen on the second area 161-2. can control.

4B is a diagram illustrating an example for displaying an execution screen according to a state of a foldable electronic device according to an exemplary embodiment.

Referring to FIGS. 2 and 4B , the processor 120 of the electronic device 101 according to an embodiment displays a display 161 in a folded state of the electronic device 101, as shown in (a) of FIG. 4B. The display module 160 may be controlled to display the first execution screen 420 of the second aspect ratio disposed in the third region (0-y1) 161-3 of the screen. As shown in (a) of FIG. 4B, when the electronic device 101 is in a folded state, the first region 161-1 may be in an inactive state. Here, the first execution screen 420 may include the same or different contents (or objects) as the first execution screen 420 described with reference to FIG. 4A . For example, the processor 120 may display another execution screen related to the first application or an execution screen of another application on the second area 161-2.

According to one embodiment, the processor 120 acquires the first image 430 corresponding to the first execution screen 420 based on the transition to the expanded state, as shown in (b) of FIG. 4B can do. The first image 430 may be an image having a second aspect ratio obtained by capturing the first execution screen 410 (eg, screen capture). For example, when the angle between the first housing structure 210 and the second housing structure 220 is detected using at least one sensor (eg, a proximity sensor) as greater than or equal to a specified reference angle, the processor 120 displays the display. (161) to identify the expanded state, and obtain a first image 430 (eg, image of App') corresponding to the first execution screen 420 (eg, App') of the currently displayed second aspect ratio. can Here, the first image 430 may include the same or different content (or object) as the first image 430 described with reference to FIG. 4A. The processor 120 may control the display module 160 to display the first image 430 obtained in the unfolded state on the third area 161 - 3 of the display 161 . For example, when another execution screen related to the first application or an execution screen of another application is displayed on the second area 161-2, the processor 120 executes another execution screen related to the first application or another application. Another image corresponding to the screen may be acquired.

According to an embodiment, the processor 120, as shown in (c) and (d) of FIG. 4B, displays a third area (0-y1) 161-3 of the display 161 in an unfolded state. Controls the display module 160 to display the first image 430 to which the visual effect of moving to the first area 161-1 (y2-y3) via the second area (y1-y2) 161-2 is applied. can do. The processor 120 may switch the first area 161-1 to an active state when the electronic device 101 detects an unfolded state or identifies movement of the first image 430. For example, when another execution screen related to the first application or an execution screen of another application is displayed on the second area 161-2, the processor 120 executes another execution screen related to the first application or another application. A visual effect of moving another image corresponding to the screen simultaneously with the first image, sequentially, or individually may be displayed. The processor 120 converts the first image 430 by applying a visual effect that moves the generated first image 430, not at least one content of the application displayed on the first execution screen 420 of the second aspect ratio. can be displayed When the processor 120 is converted from the expanded state to the collapsed state, the first image 430 screen-captured of the first execution screen 420 is moved instead of at least one content of the application displayed on the first execution screen 420. It can be displayed by applying a visual effect (eg, animation effect) that is desired. For example, the processor 120 transfers the first image 430 from a portion of the first area 161-1 to the second area 161-2 (y2-y1) at a specified speed (eg, constant velocity or acceleration). ) to the third region 161-3 (y1-0) may be displayed by applying a visual effect. For example, the processor 120 may display the first image 430 by applying a gradually enlarged visual effect while moving to the third area 161-3 (y1-0). For another example, the processor 120 displays the first image 430 by applying a gradually reduced visual effect while moving to the third area 161-3 (y1-0), and responds to the reduced effect. Accordingly, the first execution screen 420 of the second aspect ratio may be displayed while gradually enlarging. Without being limited thereto, the processor 120 may display the first image 430 by applying various visual effects.

According to an embodiment, as shown in (e) of FIG. 4B, when the movement of the first image 430 is completed, the processor 120 removes the first image 430 to which the visual effect is applied, and The display module 160 may be controlled to display the first execution screen 420 (eg, App') of the 2 aspect ratio on a portion of the first area 161 - 1 of the display 161 . As shown in (f) of FIG. 4B, the processor 120 changes the size of the first execution screen 420 to a first aspect ratio, and displays the first execution screen 410 of the changed first aspect ratio to the first screen of the display. The display module 160 may be controlled to display on the area 161-1. For example, when another execution screen related to the first application or an execution screen of another application is displayed on the second area 161-2, the processor 120 may display another image related to the first application corresponding to the moved image. The display module 160 may be controlled to display an execution screen or an execution screen of another application together with the first execution screen 410 on the first region 161-1. For example, when the movement of the first image 430 is completed, the processor 120 may switch the second area 161-2 and/or the third area 161-3 to an inactive state. For another example, the processor 120 maintains an active state and displays another execution screen related to the first application or an execution screen of another application to the second area 161-2 and/or the third area 161-3. The display module 160 may be controlled to display.

Referring to FIGS. 2, 4A, and 4B, the processor 120 according to an exemplary embodiment displays an always on display (AOD) on a third area 161-3 of the display 161 in a folded state. When the screen is displayed, the display module 160 may be controlled so that the first execution screen 410 of the first application is changed to a third screen ratio and displayed on the second area 161-2.

Referring to FIGS. 2 , 4A and 4B , the processor 120 according to an embodiment includes a third surface 213 of the first housing structure 210 and a third surface 223 of the second housing structure 220 . When the fourth area of the display 161 is disposed on ) and an always on display (AOD) is displayed on the third area 161-3 of the display 161, the first application is first executed. The screen 410 may be changed to the fourth aspect ratio and displayed in the fourth area of the display 161 . For example, the fourth aspect ratio may be smaller than the second aspect ratio and larger than the third aspect ratio. According to an embodiment, in the processor 120, the fourth area of the display 161 is disposed on the third surface 223 of the second housing structure 220, and the third area 161-3 of the display 161 When an always on display (AOD) is displayed on ), the first execution screen 410 of the first application is changed to the third aspect ratio and displayed on the first part of the fourth area of the display 161. And, the display module 160 may be controlled to change the second execution screen of the second application to the third aspect ratio and display the second part of the fourth area. Here, the fourth area of the display 161 includes the second area 161-2, and a portion corresponding to the second area 161-2 is the third surface 213 of the first housing structure 210. , and the other part may be disposed on the third surface 223 of the second housing structure 220 .

As such, in one embodiment, the main components of the electronic device have been described through the electronic device 101 of FIGS. 1 and 2 . However, in various embodiments, not all of the components shown in FIGS. 1 and 2 are essential components, and the electronic device 101 may be implemented with more components than the illustrated components, or fewer components. The electronic device 101 may be implemented by In addition, the location of the main components of the electronic device 101 described above with reference to FIGS. 1 and 2 may be changeable according to various embodiments.

According to an embodiment, an electronic device (eg, electronic device 101 of FIGS. 1 and 2 ) includes a first housing structure (eg, first housing structure 210 of FIG. 2 ) and a second housing structure (eg, FIG. 2 ). A display module including a housing including the second housing structure 220 of 2, a memory (eg, the memory 130 of FIG. 1), and a flexible display (eg, the display 161 of FIG. 2) (eg, It includes the display module 160 of FIG. 1 and at least one processor electrically connected to the memory and the display module (for example, the processor 120 of FIG. 1 ), wherein the at least one processor of the electronic device Controlling the display module to display a first execution screen at a first aspect ratio of a first application on a first area of the display in an unfolded state;

Based on the transition to the folded state of the electronic device, the first aspect ratio of the first execution screen is changed to a second aspect ratio corresponding to the third area of the display, and the second aspect ratio is changed to the second aspect ratio. A first image corresponding to 1 execution screen is obtained, and a visual effect moving from the first area through the second area of the display to the third area of the display is applied to transfer the first image to the third area. Control the display module to move and display, and display the first execution screen changed to the second aspect ratio in the third area by replacing the first image based on the completion of the movement of the first image. It may be set to control the display module.

According to one embodiment, the first area of the display is disposed on a first surface of the first housing structure and a first surface of the second housing structure, and the second area of the display is disposed on the first housing structure. The third area of the display is disposed on the second surface of the first housing structure, and the folded state is the first surface of the first housing structure and the second surface of the second housing structure. The first surfaces may be folded to face each other.

According to an embodiment, the at least one processor may, in the folded state, display another execution screen related to the first application, a second execution screen of a second application, or an object related to at least one application (eg : It can be set to display a screen including an execution icon or content including an image, text, or symbol.

According to an embodiment, the at least one processor controls the display module to display the first execution screen of the first application in the first area at the first aspect ratio in the unfolded state, and the folded Based on the transition to the state, the display module is controlled to display the first execution screen changed to the second aspect ratio in a part of the first area, and the changed first execution screen is screen-captured to display the first execution screen. It can be set to acquire an image.

According to an embodiment, the at least one processor controls the display module to display a second execution screen of a second application on a part of the first region in the expanded state, and is converted to the folded state. Visual effect of changing the second execution screen to a third aspect ratio and moving a second image corresponding to the second execution screen changed to the third aspect ratio from a part of the first area to the second area Controls the display module to display the second image in the second area by applying , and based on the completion of the movement of the second image to the second area, the third image is replaced with the second image. It may be set to control the display module to display the second execution screen changed to the aspect ratio in the second area.

According to an embodiment, the at least one processor displays the first execution screen displayed on the third area on the second area, in response to receiving a user input, and displays the second execution screen displayed on the second area. It is set to control the display module to display an execution screen in the third area, the first execution screen displayed in the second area is changed to a third aspect ratio, and the second execution screen displayed in the third area is changed. The execution screen may be changed to the second aspect ratio.

According to an embodiment, when an always-on display screen is displayed on the third area, the at least one processor changes the first execution screen of the first application to a third aspect ratio so that the second area It can be set to control the display module to display on.

According to an exemplary embodiment, the at least one processor changes the first execution screen of the first application to a fourth aspect ratio when an always-on display screen is displayed in the third area, so that the first screen of the display is displayed. set to control the display module to display in four regions, wherein the fourth region of the display includes the second region, and a portion corresponding to the second region is disposed on a third surface of the first housing structure. and the other part may be disposed on the third surface of the second housing structure. For example, the fourth aspect ratio may be smaller than the second aspect ratio and larger than the third aspect ratio.

According to an exemplary embodiment, the at least one processor changes the first execution screen of the first application to a third aspect ratio when an always-on display screen is displayed in the third area, so that the first screen of the display is displayed. It is described to control the display module to display on the first part of the fourth area, change the second execution screen of the second application to a third aspect ratio, and display the second execution screen on the second part of the fourth area. The fourth area includes the second area, a part corresponding to the second area is disposed on the third surface of the first housing structure, and the other part is disposed on the third surface of the second housing structure. can

According to an embodiment, when the at least one processor is converted from the folded state to the expanded state, the first image corresponding to the first execution screen displayed in the third region is transmitted through the second region. The display module controls the display module to move to the first area and display the first execution screen in the first area by replacing the first image when the movement of the first image is completed. , the first execution screen displayed in the third area may be displayed in a second aspect ratio, and the first execution screen displayed in the first area may be displayed in a first aspect ratio.

Hereinafter, an operating method in an electronic device will be described with reference to the above-described drawings (eg, FIGS. 1, 2, 3A to 3C, 4A, and 4B).

5 is a diagram illustrating an example of an operating method in an electronic device according to an embodiment, and FIG. 6 is a diagram illustrating an example of displaying an execution screen according to a state of an electronic device according to an embodiment.

Referring to FIGS. 5 and 6 , in operation 501, the electronic device 101 (eg, the electronic device 101 of FIGS. 1 and 2 ) according to an embodiment, as shown in FIG. , In the unfolded state, the first application is displayed on the first area 161-1 of the display 161 (eg, the display 161 of FIG. 2 ) of the display module (eg, the display module 160 of FIGS. 1 and 2 ). 1 execution screen 610 may be displayed. The electronic device 101 displays the size of the first execution screen 610 of the first application in the first area 161-1 (eg, areas y2 to y3 of FIG. 3B) at the first aspect ratio in the unfolded state. can For example, the first execution screen 610 may be displayed in a size corresponding to or similar to the size of the first region 161-1 in a first aspect ratio.

In operation 503, the electronic device 101 may check whether the electronic device 101 is converted to a folded state. As shown in (b) of FIG. 6 , the electronic device 101 determines the angle between the first housing structure 210 and the second housing structure 220 using at least one sensor (eg, a proximity sensor). If it is detected as less than a designated reference angle, it can be identified as being converted to a folded state. As a result of the check, when converted to a folded state, the electronic device may perform operation 505. On the other hand, if it is not converted to the folded state, the electronic device 101 may perform operation 501.

In operation 505, the electronic device 101 may obtain a first image corresponding to the first execution screen 610 in a folded state. When the electronic device obtains the first image 620, the first execution screen 610 of the first application is changed to the second aspect ratio so that a part of the first area 161-1 has the second aspect ratio. 1 execution screen 620 may be displayed. For example, the second aspect ratio may be smaller than the first aspect ratio, and have a size corresponding to or similar to the third area 161-3 (eg, areas 0 to y1 of FIG. 3B) of the display 161 ( or area). For example, a portion of the first area 161 - 1 of the display 161 may have a size corresponding to or similar to that of the first surface of the first housing structure 210 . The electronic device 101 may acquire the first image 620 of the second aspect ratio by capturing (eg, screen capture) the first execution screen 620 of the second aspect ratio.

In operation 507, as shown in FIG. The first image 620 may be displayed so that a visual effect of moving to the third area 161 - 3 of the display 161 via the area 161 - 2 appears. The electronic device 101 applies a visual effect of moving the generated first image 620 instead of at least one content of the application displayed on the first execution screen 610 of the second aspect ratio to display the first image 620. can be displayed. Here, if at least one content of the application is moved and displayed, the screen display may be loaded because the screen of the application displayed in each frame must be refreshed while moving in units of pixels. Accordingly, when the electronic device 101 is converted from an expanded state to a folded state, a first image 620 obtained by screen-capturing the first execution screen 610 instead of at least one content of the application displayed on the first execution screen 610 ) can be displayed by applying a visual effect (e.g., animation effect) to move it. For example, the electronic device 101 transfers the first image 620 from a portion of the first area 161-1 of the display 161 to the second area 161-1 at a specified speed (eg, constant velocity or acceleration). 2) A visual effect of moving through (y2-y1) to the third area 161-3 (y1-0) may be applied and displayed. For example, the electronic device 101 may display the first image 430 by applying a gradually enlarged visual effect while moving to the third area 161-3 (y1-0) of the display 161. there is. For another example, the electronic device 101 displays the first image 430 by applying a gradually reduced visual effect while moving to the third area 161-3 (y1-0) of the display 161, , the first execution screen 620 may be displayed while being gradually enlarged in response to the effect of being reduced. Without being limited thereto, the processor 120 may display the first image 620 by applying various visual effects.

In operation 509, the electronic device 101 moves to the third area 161-3 of the display 161 by applying a visual effect moving at a specified speed and displays it, and then the display of the first image 620 is completed. you can check the For example, the electronic device 101 may determine that the display of the first image 620 is completed when the first image 620 is completely moved to the third area 161-3 and displayed. For another example, the electronic device 101 determines that the display of the first image 620 is completed after a specified time elapses after the first image 620 is completely moved to the third area 161-3 and displayed. can As a result of checking, when the display of the first image 620 is completed, the electronic device 101 may perform operation 511 . On the other hand, if the display of the first image 620 is not completed, operation 507 may be continuously performed.

In operation 511, the electronic device 101, as shown in (c) of FIG. 6 , based on the completion of the movement of the first image 620 to the third area 161-3, the first image 620) may be displayed on the third area 161-3. The electronic device 101 may remove the first image 620 to which the visual effect is applied, and the first execution screen 630 may be displayed on the third area 161-3. Here, the first execution screen 420 of the second aspect ratio is the screen of the refreshed application and is displayed in the second aspect ratio corresponding to the size of the third area 161-3 (eg, the size of 0 to y1). It can be.

According to an embodiment, when the electronic device 101 is converted from a folded state to an unfolded state, contrary to the operations of FIGS. 5 and 6 , the first aspect ratio of the second aspect ratio displayed in the third region 161-3 is displayed. By applying a visual effect of moving to the first area 161-1 via the second area 161-2 corresponding to the execution screen 630, the first image 620 is moved to the first area 161-1. ), and when the movement of the first image is completed, the first execution screen 610 of the first aspect ratio may be displayed on the first area 161-1 by replacing the first image 620. .

7 is a diagram illustrating an example of an operating method in an electronic device according to an embodiment.

The electronic device 101 of an electronic device (eg, FIGS. 1 2, 3A to 3C, 4A, and 4B) according to an exemplary embodiment may include a display (eg, FIGS. 2, 3A to 3C, and 4A). and different applications in the first area (eg, the first area (y2-y3) 161-1 of FIG. 4a), such as multitasking (split view) in the unfolded state of the display 161 of FIG. 4b. Each execution screen may be displayed.

Referring to FIG. 7 , in operation 701, the electronic device according to an embodiment displays a first application in a first portion of a first area of a display of a display module (eg, the display module 160 of FIGS. 1 and 2 ). A first execution screen may be displayed, and a second execution screen of a second application may be displayed in a second portion of the first region.

In operation 703, the electronic device may check whether the electronic device is converted into a folded state. The electronic device uses at least one sensor (eg, proximity sensor) to provide a first housing structure (eg, the first housing structure 210 of FIG. 2 ) and a second housing structure (eg, the second housing structure of FIG. 2 ( 220)), it can be identified as being switched to a folded state when the angle between them is detected to be less than a specified reference angle. As a result of the check, if it is identified that the electronic device is converted to a folded state, the electronic device may perform operation 705. On the other hand, if it is not converted to the folded state, the electronic device may perform operation 701.

In operation 705, when the electronic device is converted to a folded state, a first execution screen of a first application is captured (eg, screen capture) to acquire a first image, and a second execution screen of a second application is captured (eg, screen capture). : screen capture) to acquire the second image. For example, the electronic device may select a main screen to be displayed in the third area and a sub screen to be displayed in the second area from among the first execution screen and the second execution screen displayed in the unfolded state. The execution screen selected as the main screen may be changed to the second aspect ratio, and the execution screen selected as the sub screen may be changed to the third aspect ratio. For example, the electronic device may select, as the main screen, an execution screen selected by a user from among a first execution screen and a second execution screen, an execution screen with a last user input before being converted to a folded state, or a focused execution screen. can The second aspect ratio may be a ratio smaller than the first aspect ratio, and the third aspect ratio may be a ratio smaller than the second aspect ratio. For example, when the first execution screen of the first application is focused, the electronic device captures the focused first execution screen and has a second aspect ratio (e.g., the third area (0 to y1) 161- of FIG. 3A). 3), capture a second execution screen that is not focused, and capture a third aspect ratio (e.g., the size of the second area (y1 to y2) 161-2 of FIG. 3A). A second image may be obtained.

In operation 707, the electronic device applies a visual effect in which the first image and the second image move from a part of the first area to the second area and the third area of the display based on the designated speed in the folded state, and thereby displays the first image. and the second image may be displayed, respectively. For example, a visual effect of moving the electronic device to a third area (eg, third area y1 to 0 in FIG. 3A) via the second area (eg, the second area y2 to y1 in FIG. 3A). (eg, an animation effect) may be applied to display the first image. The electronic device may display the second image by applying a moving visual effect (eg, an animation effect) to the second area (eg, the second areas y2 to y1 of FIG. 3A ). The electronic device disposes a first image capturing a focused first execution screen on an upper portion, and disposing a second image capturing a non-focused second execution screen on a lower portion following the first image to move and display the captured image. You can sort the order.

In operation 709, the electronic device performs a refreshed first execution screen replacing the first image and a refreshed second image, based on the completion of moving the first image and the second image, respectively. ) The second execution screen can be moved and displayed. For example, when the first execution screen is selected as the main screen and focused, the electronic device moves and displays a first image captured on the first execution screen to a third region, and displays a second image that is aligned following the first image. The image may be moved to the second area and displayed. For another example, when the second execution screen is selected as the main screen and focused, the electronic device aligns the second image captured with the second execution screen to the upper part, moves the second image to the third area, and displays the second image, , the aligned first image following the second image may be moved to the second area and displayed.

In operation 711, the electronic device may check whether a user input (eg, a user input such as a designated gesture, touch, or voice) is received in the folded state. As a result of checking, if a user input is received, operation 713 may be performed. On the other hand, if a user input is not received, operation 711 may be continuously performed. For example, the electronic device may confirm that a user input such as a touch or a swipe is received in the unfocused second area.

In operation 713, the electronic device may switch and display the first execution screen and the second execution screen in the folded state. For example, when the first execution screen is the main screen and is focused, the electronic device may release the focus of the first execution screen displayed in the third area and switch from the third area to the second area and display the second area. The first execution screen may be reduced to correspond to the aspect ratio of the second area. The electronic device may set the focus while moving and displaying the second execution screen of the sub-screen displayed in the second area to the third area. The first execution screen may be enlarged corresponding to the aspect ratio of the second area. For another example, when the second execution screen is the main screen and is focused, the electronic device displays the second execution screen on the third area and displays the first execution screen on the second area, thereby displaying the second execution screen displayed on the third area. The focus can be set while the second execution screen of the main screen is released, the third area is switched to the second area and displayed, and the first execution screen of the sub screen displayed in the second area is moved to the third area and displayed. there is.

8 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an exemplary embodiment.

Referring to FIGS. 7 and 8 , an electronic device 101 (eg, the electronic device 101 of FIGS. 1 and 2 ) according to an embodiment shows operation 701 of FIG. 7 and operation 701 of FIG. 8 (a). As shown, the first execution screen 810 of the first application is displayed on the first part of the first area 161-1 of the display 161 included in the display module 160 in the unfolded state, and the first area The second execution screen 820 of the second application may be displayed on the second part of 161-2. For example, the first portion of the first region 161-1 may have a size corresponding to or similar to that of the first housing structure 210, and the second portion of the first region 161-1 may have a size similar to that of the first housing structure 210. It may be a region having a size corresponding to or similar to that of the second housing structure 220 .

According to an embodiment, among the first execution screen 810 and the second execution screen 820, the main screen to be displayed on the third area 161-3 of the display 161 is selected as the second execution screen 820. In this case, a visual effect indicating that the selected second execution screen 820 is focused (eg, displaying a thick line, displaying a highlight, or displaying a specific mark) may be displayed.

According to an embodiment, when the electronic device 101 detects that the display 161 is folded using at least one sensor, as shown in operation 705 of FIG. 7 and FIG. 8 (b), The first image 811 may be obtained by capturing the first execution screen 810 and the second image 821 may be obtained by capturing the second execution screen 820 . Here, the first image 811 is a sub-screen, and may be generated by reducing the size of the third aspect ratio so that it is moved to and displayed in the second area 161-2, and the second image 821 is generated in the third area 161-2. (161-3) may be created with the size of the second aspect ratio to be displayed.

According to an embodiment, as shown in operation 707 of FIG. 7 and FIG. 8(b), when detecting that the display 161 is being folded using at least one sensor, the electronic device 101 A visual effect of moving the second image 821 acquired by screen capture of the second execution screen 820, which is the main screen, to the third area 161-3 is applied to the third area 161-3 at the second aspect ratio. 3) can be displayed. Here, the second aspect ratio may correspond to or have a similar size to the third area 161-3. The electronic device 101 applies a visual effect of moving the first image 811 acquired by capturing the screen of the first execution screen 810, which is a sub screen, to the second area 161-2 and converts it to a third aspect ratio. It can be displayed on the second area 161-2. Here, the third aspect ratio may correspond to or have a similar size to the second area 161-2.

According to an embodiment, when the electronic device 101 detects a completely folded state of the display 161 using at least one sensor, as shown in operation 709 of FIG. 7 and FIG. The first execution screen 813 is displayed in the third aspect ratio by replacing the first image 811 displayed in the area 161-2, and the second image 821 displayed in the third area 161-3 The second execution screen 823 can be displayed in the second aspect ratio by replacing .

According to an embodiment, as shown in operation 713 of FIG. 7 and (d) of FIG. 8 , the electronic device 101 confirms that a user input such as a touch or a swipe is received in the unfocused second area. If so, the first execution screen 813 and the second execution screen 823 may be switched and displayed. The electronic device 101 changes the first execution screen 813 to the second aspect ratio, displays the changed first execution screen 815 as a main screen on the third area 161-3, and displays the second execution screen ( 823) to the third aspect ratio, and the changed second execution screen 825 can be displayed on the second area 161-2 as a sub screen. For example, the electronic device 101 moves from the third area 162-3 to the second area 162-2 by releasing the focus of the second execution screen 823 displayed on the third area 163-3. The second execution screen 825 moved and reduced to the third aspect ratio may be displayed on the second area 162-2. The electronic device 101 moves the first execution screen 813 of the sub-screen displayed on the second area 161-2 to the third area 161-3 and enlarges the first execution screen at the second aspect ratio ( 815) may be displayed on the third area 162-3.

9 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an embodiment.

Referring to FIG. 9 , an electronic device 101 (eg, the electronic device 101 of FIGS. 1 and 2 ) according to an embodiment is, as shown in (a) of FIG. 9 , a display module ( The first execution screen 910 of the first application may be displayed on the first area 161 - 1 of the display 161 included in 160 . When the electronic device 101 detects that the display 161 is switched from an unfolded state to a folded state using at least one sensor, the electronic device 101 displays the first execution screen 910 as shown in (b) of FIG. The first image 911 may be acquired by changing the aspect ratio to the second aspect ratio and capturing the screen of the changed first execution screen. The electronic device 101 sets the first execution screen 910 as the main screen and displays the first image 911 from the first area 161-1 to the second area 161-2 of the display 161. It can be displayed by moving to the third area 161-3. The electronic device 101 displays content to be displayed in the second area 161-2 (eg, a recently executed application, an application frequently executed by a user, an execution icon representing content, weather, a clock or a notification display, or a system interface). A sub-screen 920 including data) may be acquired and displayed on the second area 161-2. For example, the sub screen 920 is displayed on the second area 161-2 so as to gradually appear in response to the movement of the first image 911, or the first image 911 is displayed on the second area 161-2. 2) can be indicated when out of range. For another example, when the first execution screen 910 is changed to the second aspect ratio, the electronic device displays the sub screen 920 in a lower area of the first area 161-1 where the changed first execution screen is displayed. screen capture image of the sub screen 920 is acquired, and as the first image 911 moves, the screen capture image of the sub screen 920 is moved and displayed on the second area 161-2. can do.

According to an embodiment, when the electronic device 101 identifies that the display 161 is in a completely folded state using at least one sensor, as shown in (c) of FIG. 9 , the first image 911 ), the first execution screen 913 is displayed on the third area 161-3 at the second aspect ratio, and the sub screen 920 is displayed on the second area 161-2 of the display 161. can do. For example, when a screen-captured image of the sub-screen 920 is displayed on the second area 161-2, the sub-screen 920 may be displayed.

10 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an exemplary embodiment.

Referring to FIG. 10 , an electronic device 101 (eg, the electronic device 101 of FIGS. 1 and 2 ) according to an embodiment is, as shown in FIG. 10 (a) , a display module ( The first execution screen 1010 of the first application may be displayed on the first area 161 - 1 of the display 161 included in 160 . As shown in (b) of FIG. 10 , at least one sensor detects that the display 161 is folded in an unfolded state, and the user displays an always-on display (AOD) execution screen in the third area 161-3. If it is selected to be displayed, the electronic device 101 generates a first image 1011 obtained by screen-capturing the first execution screen 1010 displayed in the first area 161-1 at the third aspect ratio, and always The execution screen to be displayed on the on-display (AOD) is converted into an AOD image 1020, and a visual effect (eg, animation effect) is applied to the first image 1011 and the AOD image 1020 so that the second area 161- 2) and can be displayed by moving to the third area 161-3. Here, the third aspect ratio may have a size corresponding to or similar to that of the second area 161-2 (eg, area y1-y2 in FIG. 3B). The electronic device 101 may display the first image 1011 on the second area 161-2 of the display 161 at the third aspect ratio and display the AOD image on the third area 161-3. there is. When the electronic device 101 detects that the display 161 is in a fully folded state using at least one sensor, the first image 1011 is converted into a first execution screen having a third aspect ratio and displayed in a second area 161-2. ) can be displayed. In the electronic device 101, after the display 161 is completely converted into a folded state using at least one sensor, the main screen is turned off, and the execution screens of the second area 161-2 and the third area 161-3 are displayed. When is turned off, AOD can be displayed in the third area 161-3.

According to an embodiment, as shown in (c) of FIG. 10 , when a user input (eg, touch or drag) 1001 is received in the second area 161-2, the electronic device 101 The first execution screen of the third aspect ratio displayed in the second area 161-2 is changed to the first image 1013 of the second aspect ratio, and the second area 161-2 is changed to the third area 161-3. ), the first image 1013 may be displayed on the third area 161-3. When the first image 1013 completely moves to the third area 161-3, the electronic device 101 substitutes the first image 1013 to display a first execution screen of the second aspect ratio in the third area 161. -3) can be displayed. For example, when the electronic device 101 displays the first execution screen of the second aspect ratio on the third area 161-3, the second area 161-2 always displays the screen that is changed to the third aspect ratio. The screen of the on-display (AOD) may be displayed.

11 is a diagram illustrating an example for displaying an execution screen according to a state of an electronic device according to an embodiment.

Referring to FIG. 11 , an electronic device 101 (eg, the electronic device 101 of FIGS. 1 and 2 ) according to an embodiment is, as shown in (a) of FIG. 11 , a display module ( The first execution screen 1110 of the first application may be displayed on the first area 161-1 of the display 161 included in the display 160, and the second execution screen 1120 of the second application may be displayed. . When the electronic device 101 detects that the first execution screen 1110 is focused as the main screen and is converted from an expanded state to a collapsed state using at least one sensor, the electronic device 101 screen captures the first execution screen 1110. The first image 1111 may be obtained, and the second image 1121 obtained by capturing the second execution screen 1120 may be acquired.

According to an embodiment, as shown in (b) of FIG. 11 , when the electronic device 101 detects a transition from an unfolded state to a folded state using at least one sensor, a first image 1111 is displayed. A visual effect moving from the second area 161-2 to the third area 161-3 is applied and displayed in the third area 161-3 at the second aspect ratio, and the first image 111 As it is moved and displayed, the second image 1121 may be displayed in the fourth area 161-4 at the fourth aspect ratio by applying visual effects. Here, the fourth aspect ratio may correspond to or have a similar size to the fourth area 161 - 4 of the display 161 . The fourth area of the display 161 includes the second area 161-2 of the display 161, and a portion corresponding to the second area 161-2 is the third surface of the first housing structure 210. 213 (eg, the second face 212 in FIGS. 2, 3A, 3B, and 3C), and the other part is disposed on the third face 223 (eg, the second face 223 of the second housing structure 220). It may be disposed on the third surface 213 of FIGS. 2, 3a, 3b, and 3c.

According to an embodiment, as shown in (c) of FIG. 11, the electronic device 101 is converted from an unfolded state to a folded state using at least one sensor, and in the folded state When the always-on display (AOD) screen is set to be displayed on the third area 161-3, the first surface 213 of the first housing 210 (eg, FIGS. 2, 3A, 3B, and 3C) The first image 1113 of the third aspect ratio is displayed by applying a visual effect of moving to the first part of the fourth area 161-4 disposed on the second surface 212 of the second housing structure. moving to the second part of the fourth area 161-4 disposed on the third side 223 of 220 (eg, the third side 213 in FIGS. 2, 3A, 3B and 3C). The second image 1123 of the third aspect ratio is displayed on the second part of the fourth area 161-4 by applying visual effects, and the image 1130 to be displayed on the AOD screen is displayed in the third aspect ratio of the third aspect ratio. It can be displayed in area 161-3.

According to an embodiment, when the electronic device 101 detects that the display 161 is completely folded using at least one sensor, the first image 1113 is replaced with a first execution screen having a third aspect ratio. and display it in the first part of the fourth area 161-4, and replace the second image 1123 with the second execution screen of the third aspect ratio and display it in the second part of the fourth area 161-4 can do.

According to an embodiment, when a user input (eg, touch or drag) 1001 is received in the first part of the fourth area 161-4, the electronic device 101 operates on the fourth area 161-4. A visual effect of moving the screen-captured image of the first execution screen of the third aspect ratio displayed in the first part may be applied to move and enlarge the display to the third area 161-3. Image 1130 to be displayed as an AOD screen by enlarging and displaying the second execution screen of the third aspect ratio displayed in the second part of the fourth area 161-4 to the entire area of the fourth area 161-4 can be removed. For example, the electronic device 101 applies a visual effect of moving a screen-captured image of the first execution screen of the third aspect ratio displayed in the first part of the fourth region 161-4 to the third region ( 161-3), and by applying a visual effect of moving to the first part of the fourth area 161-4, the image 1130 to be displayed on the AOD screen is reduced and displayed in the fourth area 161-4. It can be indicated in the first part of 4).

According to an embodiment, when a user input (eg, touch or drag) 1001 is received in the second part of the fourth area 161-4, the electronic device 101 operates on the fourth area 161-4. The second execution screen of the third aspect ratio displayed in the second part may be moved and enlarged to the third area 161-3 by applying a visual effect of moving the screen-captured image. The first execution screen of the third aspect ratio displayed in the first part of the fourth area 161-4 is enlarged and displayed to the entire area of the fourth area 161-4, and an image to be displayed as an AOD screen 1130 can be removed. For example, the electronic device 101 applies a visual effect of moving a screen-captured image of a second execution screen of a third aspect ratio displayed in the second part of the fourth region 161-4 to the third region ( 161-3), and by applying a visual effect of moving to the second part of the fourth area 161-4, the image 1130 to be displayed on the AOD screen is reduced and displayed in the fourth area 161-4. It can be indicated in the second part of 4).

According to an embodiment, the electronic device 101 uses at least one sensor to turn the display 161 into a completely folded state, turn off the main screen, and turn off the running screens of the fourth area 161-4. AOD may be displayed in the third area 161-3.

According to an embodiment, an operating method in an electronic device (eg, the electronic device 101 of FIGS. 1 and 2 ) includes a flexible display (eg, the electronic device 101 of FIG. 2 ) of the electronic device in an unfolded state. An operation of displaying a first execution screen in a first aspect ratio of a first application on the first area of the display 161), based on the transition to the folded state of the electronic device, the first screen of the first execution screen An operation of changing the aspect ratio to a second aspect ratio and acquiring a first image corresponding to a first execution screen changed to the second aspect ratio; a third aspect of the display from the first area through the second area of the display; Based on the operation of moving and displaying the first image to the third area by applying a visual effect of moving to the area and the movement of the first image being completed, the first image is replaced in the second aspect ratio. An operation of displaying the changed first execution screen on the third area may be included.

According to an embodiment, the first area of the display may include a first surface of the first housing structure (eg, the first housing structure 210 of FIG. 2 ) of the electronic device and a second housing structure ( Example: disposed on the first side of the second housing structure 220 in FIG. 1), the second area of the display is disposed on the third side of the first housing structure, the third area of the display is It is disposed on the second surface of the first housing structure, and the folded state may be a folded state such that the first surface of the first housing structure and the first surface of the second housing structure face each other.

According to an embodiment, the method may include another execution screen related to the first application, a second execution screen of a second application, or an object (eg, an execution icon) related to at least one application in the second region in the folded state. , or content including images, text, or symbols) may further include an operation of displaying a screen.

According to an embodiment, the obtaining of the first image may include displaying the first execution screen of the first application in the first area at the first aspect ratio in the unfolded state, and in the folded state. Based on the conversion, an operation of displaying the first execution screen changed to the second aspect ratio on a part of the first area, by a camera module (eg, the camera module 180 of FIG. 1) of the electronic device and acquiring the first image by screen-capturing the first execution screen changed to the second aspect ratio.

According to an embodiment, the method may include an operation of displaying a second execution screen of a second application on a part of the first area in the expanded state, and displaying the second execution screen based on the transition to the collapsed state. The second image is changed to a third aspect ratio, and a visual effect effect of moving the second image corresponding to the second execution screen changed to the third aspect ratio from a part of the first area to the second area is applied. Based on the operation of displaying a in the second area and the completion of the movement of the second image to the second area, the second execution screen changed to the third aspect ratio by replacing the second image is displayed in the first area. An operation of displaying in area 2 may be further included.

According to an embodiment, the method may include changing the first execution screen of the first application to a third aspect ratio and displaying the screen in the second region when an always-on display screen is displayed in the third region. More actions may be included.

According to an embodiment, the method may include changing the first execution screen of the first application to a fourth aspect ratio when the screen of the always-on display is displayed on the third area so as to display the screen in the fourth area of the display. and displaying, wherein the fourth area of the display includes the second area, a portion corresponding to the second area is disposed on a third surface of the first housing structure of the electronic device, and the remaining area is disposed on a third surface of the first housing structure of the electronic device. Another part may be disposed on the third side of the second housing structure of the electronic device.

According to an embodiment, the method may change the first execution screen of the first application to a third aspect ratio when the screen of the always-on display is displayed on the third area so as to display the fourth area of the display. and displaying a second execution screen of a second application in a third aspect ratio and displaying the second execution screen of a second application in a second portion of the fourth area, wherein the fourth area of the display displays the second screen in the third aspect ratio. 2 regions, a part corresponding to the second region is disposed on the third surface of the first housing structure of the electronic device, and the other part is disposed on the third surface of the second housing structure of the electronic device. can

According to an embodiment, the method may include, when switching from the folded state to the expanded state, the first image corresponding to the first execution screen displayed on the third region through the second region. and displaying the first execution screen in the first area by replacing the first image when the movement of the first image is completed. The displayed first execution screen may be displayed in a second aspect ratio. The first execution screen displayed in the first area may be displayed in a first aspect ratio.

According to an embodiment, in a non-transitory storage medium storing a program, the program, when executed by a processor of an electronic device, causes the processor to display a flexible display of the electronic device in an unfolded state of the electronic device. displaying a first execution screen of a first application on a first area; acquiring a first image corresponding to the first execution screen based on the transition to a folded state of the electronic device; Based on the operation of displaying the first image so that a visual effect of moving from the second area of the display to the third area of the display appears and the movement of the first image is completed, the first image is replaced. and an executable command to execute an operation of displaying the first execution screen on the third region.

In addition, the embodiments disclosed in this document are presented for explanation and understanding of the disclosed technical content, and do not limit the scope of the technology described in this document. Therefore, the scope of this document should be construed as including all changes or various other embodiments based on the technical idea of this document.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

100: network environment 101: electronic device
120: processor 130: memory
160: display module 176: sensor module
180: camera module 161: display
210: first housing structure 220: second housing structure

Claims (20)

In electronic devices,
a housing comprising a first housing structure and a second housing structure;
Memory;
A display module including a flexible display; and
It includes at least one processor electrically connected to the memory and the display module,
The at least one processor,
Controlling the display module to display a first execution screen of a first application at a first aspect ratio in a first area of the display in an unfolded state of the electronic device;
Based on the transition to the folded state of the electronic device, the first aspect ratio of the first execution screen is changed to a second aspect ratio corresponding to the third area of the display, and the second aspect ratio is changed to the second aspect ratio. 1 Acquire a first image corresponding to an execution screen,
Controlling the display module to move the first image to the third area and display the first image by applying a visual effect moving from the first area to the third area through the second area of the display;
An electronic device configured to control the display module to display the first execution screen changed to the second aspect ratio in the third area by replacing the first image, based on completion of the movement of the first image. .
According to claim 1,
the first area of the display is disposed on a first surface of the first housing structure and a first surface of the second housing structure;
the second area of the display is disposed on a third side of the first housing structure;
the third area of the display is disposed on the second side of the first housing structure;
The folded state is a state in which the first surface of the first housing structure and the first surface of the second housing structure are folded so that they face each other.
The method of claim 1, wherein the at least one processor,
The electronic device is set to display another execution screen related to the first application, a second execution screen of a second application, or a screen including an object related to at least one application on the second area in the folded state.
The method of claim 1, wherein the at least one processor,
Controlling the display module to display the first execution screen of the first application in the first area at the first aspect ratio in the expanded state;
Based on the transition to the folded state, controlling the display module to display the first execution screen changed to the second aspect ratio on a portion of the first area;
The electronic device is set to acquire the first image by screen-capturing the changed first execution screen.
The method of claim 1, wherein the at least one processor,
Controlling the display module to display a second execution screen of a second application on a part of the first region in the expanded state;
Based on the transition to the folded state, the second execution screen is changed to a third aspect ratio;
To display the second image in the second area by applying a visual effect of moving the second image corresponding to the second execution screen changed to the third aspect ratio from a part of the first area to the second area. control the display module;
Based on the completion of the movement of the second image to the second area, the display module is controlled to display the second execution screen changed to the third aspect ratio in the second area by replacing the second image. An electronic device configured to do so.
The method of claim 5, wherein the at least one processor,
In response to receiving a user input, the display module displays the first execution screen displayed on the third area on the second area and displays the second execution screen displayed on the second area on the third area. is set to control
The first execution screen displayed in the second area is changed to a third aspect ratio;
The second execution screen displayed in the third area is changed to a second aspect ratio.
The method of claim 1, wherein the at least one processor,
When an always-on display screen is displayed in the third area, the display module is configured to control the display module to change the first execution screen of the first application to a third aspect ratio and display the screen in the second area. Device.
The method of claim 1, wherein the at least one processor,
When an always-on display screen is displayed on the third area, the display module is configured to control the display module so that the first execution screen of the first application is changed to a fourth screen ratio and displayed on the fourth area of the display. ,
The fourth area of the display includes the second area, a part corresponding to the second area is disposed on the third surface of the first housing structure, and the other part is disposed on the third surface of the second housing structure. An electronic device, disposed on the surface.
The method of claim 1, wherein the at least one processor,
When the screen of the always-on display is displayed on the third area, the first execution screen of the first application is changed to a third aspect ratio and displayed on the first part of the fourth area of the display, and the second application It is described to control the display module to change the second execution screen of to a third aspect ratio and display it in the second part of the fourth area,
The fourth area of the display includes the second area, a part corresponding to the second area is disposed on the third surface of the first housing structure, and the other part is disposed on the third surface of the second housing structure. An electronic device, disposed on the surface.
The method of claim 1, wherein the at least one processor,
When switching from the folded state to the expanded state, the display module to move and display the first image corresponding to the first execution screen displayed in the third region to the first region through the second region control,
When the movement of the first image is completed, it is set to control the display module to display the first execution screen in the first area by replacing the first image;
The first execution screen displayed in the third area is displayed in a second aspect ratio;
The first execution screen displayed in the first area is displayed in a first aspect ratio.
In the operating method in an electronic device,
displaying a first execution screen at a first aspect ratio of a first application on a first area of a flexible display of the electronic device in an unfolded state of the electronic device;
Based on the transition to the folded state of the electronic device, the first aspect ratio of the first execution screen is changed to a second aspect ratio, and the first image corresponding to the first execution screen changed to the second aspect ratio is displayed. operation to acquire;
moving the first image to the third area and displaying the first image by applying a visual effect moving from the first area to the third area of the display via the second area of the display; and
and displaying the first execution screen changed to the second aspect ratio in the third area by replacing the first image, based on completion of the movement of the first image.
According to claim 11,
the first region of the display is disposed on a first surface of a first housing structure of the electronic device and a first surface of a second housing structure of the electronic device;
the second area of the display is disposed on a third side of the first housing structure;
the third area of the display is disposed on the second side of the first housing structure;
The folded state is a state in which the first surface of the first housing structure and the first surface of the second housing structure are folded to face each other.
The method of claim 11, wherein the method,
In the folded state, another execution screen related to the first application, a second execution screen of the second application, or an object related to at least one application (eg, an execution icon, or an image, text, or symbol including The method further includes an operation of displaying a screen including content).
The method of claim 11, wherein the obtaining of the first image comprises:
displaying the first execution screen of the first application in the first area at the first aspect ratio in the expanded state;
displaying the first execution screen changed to the second aspect ratio on a portion of the first area based on the transition to the folded state; and
and acquiring the first image by screen-capturing the first execution screen changed to the second aspect ratio by a camera module of the electronic device.
The method of claim 11, wherein the method,
displaying a second execution screen of a second application on a portion of the first area in the expanded state;
Based on the transition to the folded state, the second execution screen is changed to a third aspect ratio, and a second image corresponding to the second execution screen changed to the third aspect ratio is displayed in a part of the first area. displaying the second image on the second area by applying a visual effect moving to the second area; and
Based on the completion of the movement of the second image to the second area, displaying the second execution screen changed to the third aspect ratio in the second area by replacing the second image , method.
The method of claim 11, wherein the method,
and changing the first execution screen of the first application to a third aspect ratio and displaying the first execution screen of the first application on the second area when an always-on display screen is displayed on the third area.
The method of claim 11, wherein the method,
When an always-on display screen is displayed on the third area, changing the first execution screen of the first application to a fourth aspect ratio and displaying the first execution screen on the fourth area of the display;
The fourth area of the display includes the second area, a portion corresponding to the second area is disposed on the third surface of the first housing structure of the electronic device, and the other portion is disposed on the third surface of the electronic device. 2 disposed on the third side of the housing structure.
The method of claim 11, wherein the method,
When the screen of the always-on display is displayed on the third area, the first execution screen of the first application is changed to a third aspect ratio and displayed on the first part of the fourth area of the display, and the second application Further comprising an operation of changing a second execution screen of to a third aspect ratio and displaying it in a second part of the fourth area,
The fourth area of the display includes the second area, a portion corresponding to the second area is disposed on the third surface of the first housing structure of the electronic device, and the other portion is disposed on the third surface of the electronic device. 2 disposed on the third side of the housing structure.
The method of claim 11, wherein the method,
moving and displaying the first image corresponding to the first execution screen displayed on the third area to the first area via the second area when the state is converted from the folded state to the expanded state; and
When the movement of the first image is completed, displaying the first execution screen in the first area by replacing the first image;
The first execution screen displayed in the third area is displayed in a second aspect ratio;
The first execution screen displayed in the first area is displayed in a first aspect ratio.
A non-transitory storage medium storing a program, wherein the program, when executed by a processor of an electronic device, causes the processor to:
displaying a first execution screen at a first aspect ratio of a first application on a first area of a flexible display of the electronic device in an unfolded state of the electronic device;
Based on the transition to the folded state of the electronic device, the first aspect ratio of the first execution screen is changed to a second aspect ratio corresponding to the third area of the display, and the second aspect ratio is changed to the second aspect ratio. obtaining a first image corresponding to one execution screen;
moving the first image to the third area and displaying the first image by applying a visual effect moving from the first area to the third area of the display via the second area of the display; and
Based on the completion of the movement of the first image, an executable command to execute an operation of displaying the first execution screen changed to the second aspect ratio in the third area by replacing the first image, Non-transitory storage media.

Images