KR20220043600A - The method for displaying user interface and the electronic device supporting the same - Google Patents

Abstract

Disclosed is an electronic device including a flexible display, a wireless communication circuit, a processor, and a memory operatively connected with the processor. The memory can store at least one instruction which, when executed, causes the processor to: receive a first signal including movement information of a stylus pen from the stylus pen; display a first user interface including a plurality of icons on a flexible display of the electronic device operated in a first form, based on the movement information; when sensing touch input to at least one of the plurality of icons, identify at least one application corresponding to the at least one icon to which the touch input is sensed; execute the at least one identified application in response to a second signal transmitted from the stylus pen; and display an execution screen of the at least one executed application on the flexible display. Besides, various embodiments identified through the present specification can be possible. Therefore, the present invention is capable of providing user convenience by aligning a user interface.

Description

A method for displaying a user interface and an electronic device supporting the same

Various embodiments disclosed in this document relate to a method of displaying a user interface and an electronic device supporting the same.

The electronic device may display various types of user interfaces (UIs) using the display. For example, in order to provide various functions, the electronic device may display at least one icon for executing the functions in various forms on the display. As an example, the user may cause the electronic device to display a user interface having a specified structure and shape on the display by performing a shaking gesture of the electronic device while holding the electronic device.

As the shape of the electronic device is diversified, the structure of a screen displayed using a display may be diversified. For example, a foldable electronic device including a flexible display and in which at least a portion of the flexible display is foldable may display a user interface having various structures and shapes based on the folding angle.

The electronic device may include an input device (eg, a stylus pen, a digital pen, or a digitizer pen) that allows a user to perform a more delicate touch input. For example, the electronic device may include a housing and provide a detachable stylus pen inside the housing. A user may be provided with an intuitive user experience through a touch input using a stylus pen.

The electronic device may detect a gesture designated by the user (eg, a shaking gesture) and provide a user interface of various structures and forms on the display. However, there is a problem in that the user cannot check the display of the electronic device while performing the specified gesture.

The electronic device according to the related art has limited functions that can be provided based on a gesture operation using an external input device. For example, a conventional electronic device provides a function of changing information related to sound output (eg, adjusting a volume and/or starting and stopping sound output) in response to a gesture designated by a user, or changing a camera angle of view Could. However, it is difficult for the electronic device to provide a user experience for intuitively and immediately displaying different functions (eg, a function of displaying various user interfaces changed based on the motion type) based on the change of the motion shape.

An electronic device according to an embodiment disclosed in this document includes a flexible display, a wireless communication circuit, a processor, a stylus pen that is detachably inserted into at least one area inside the housing and communicates with the wireless communication circuit, and the processor It may include a memory operatively coupled to. When the memory is executed, the processor receives a first signal including motion information of the stylus pen from the stylus pen, and based on the motion information, the flexible of the electronic device operates in a first form A first user interface including a plurality of icons is displayed on a display, and when a touch input to at least one of the plurality of icons is sensed, at least one application corresponding to the at least one icon in which the touch input is sensed is displayed. One or more instructions ( instructions) can be stored.

A method of displaying a user interface by an electronic device according to an exemplary embodiment disclosed in this document includes an operation of receiving a first signal including motion information of the stylus pen from a stylus pen, based on the motion information to display a first user interface including a plurality of icons on the flexible display of the electronic device operating in a first form, and when a touch input to at least one of the plurality of icons is detected, the touch input is In response to an operation of identifying at least one application corresponding to the detected at least one icon, and a second signal transmitted from the stylus pen, the identified at least one application is executed, and the executed at least one application is executed. and displaying an execution screen of the on the flexible display.

According to various embodiments disclosed herein, the electronic device operates based on motion information of an input device (eg, a stylus pen, a digital pen, or a digitizer pen), thereby providing a user interface displayed immediately in a fixed state can do. For example, the input device may be detachable from at least a portion of a housing included in the electronic device.

According to various embodiments disclosed in this document, the electronic device aligns the user interface based on a specified weight (eg, the number of times of use, recent execution information, association with a running application, and/or association with an input device). By displaying it, it is possible to provide convenience to the user.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram of a display module according to various embodiments of the present disclosure;
3 is a block diagram illustrating components of an electronic device according to various embodiments of the present disclosure;
4 illustrates an electronic device that provides a user interface in various forms, according to various embodiments of the present disclosure.
5 illustrates an electronic device that provides various user interfaces in a folding form, according to various embodiments of the present disclosure.
6 illustrates an electronic device that provides various user interfaces in an unfolded form, according to various embodiments of the present disclosure.
7 illustrates an electronic device that provides various user interfaces in an unfolded form according to various embodiments of the present disclosure;
8 illustrates an electronic device that provides various user interfaces in an unfolded form according to various embodiments of the present disclosure;
9 illustrates an electronic device terminating providing a user interface, according to various embodiments of the present disclosure.
10 illustrates an electronic device that provides various user interfaces in a half-folding form according to various embodiments of the present disclosure.
11 illustrates an electronic device that provides various user interfaces in a half-folding form, according to various embodiments of the present disclosure.
12 illustrates an electronic device that provides various user interfaces in a half-folding form, according to various embodiments of the present disclosure.
13 illustrates an electronic device that provides various user interfaces in a half-folding form, according to various embodiments of the present disclosure;
14 illustrates an electronic device that provides various user interfaces, according to various embodiments of the present disclosure.
15 illustrates an electronic device that provides various user interfaces, according to various embodiments of the present disclosure.
16 illustrates an electronic device that provides various user interfaces, according to various embodiments of the present disclosure.
17 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure;
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present document will be described with reference to the accompanying drawings. However, this is not intended to limit the technology described in this document to specific embodiments, and it should be understood as including various modifications, equivalents, and/or alternatives of the embodiments of this document. .

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , the electronic device 101 communicates with the electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, the program 140) to execute at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 uses less power than the main processor 121 or is set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The secondary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . Sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. Technologies such as full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be chosen. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of, or all possible combinations of, items listed together in the corresponding one of the phrases. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish an element from other elements in question, and may refer elements to other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store™) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram 200 of a display module 160, according to various embodiments. Referring to FIG. 2 , the display module 160 may include a display 210 and a display driver IC (DDI) 230 for controlling the display 210 . The DDI 230 may include an interface module 231 , a memory 233 (eg, a buffer memory), an image processing module 235 , or a mapping module 237 . The DDI 230 receives, for example, image data or image information including an image control signal corresponding to a command for controlling the image data from other components of the electronic device 101 through the interface module 231 . can do. For example, according to one embodiment, the image information is the processor 120 (eg, the main processor 121 (eg, an application processor) or the auxiliary processor 123 (eg, an application processor) operated independently of the function of the main processor 121 For example: graphic processing device) The DDI 230 may communicate with the touch circuit 250 or the sensor module 176 through the interface module 231. In addition, the DDI 230 may be At least a portion of the received image information may be stored in the memory 233, for example, in units of frames. Pre-processing or post-processing (eg, adjustment of resolution, brightness, or size) may be performed based on at least the characteristics of the display 210. The mapping module 237 may perform pre-processing or post-processing through the image processing module 135. A voltage value or a current value corresponding to the image data may be generated. According to an embodiment, the generation of the voltage value or the current value may include, for example, a property of pixels of the display 210 (eg, an arrangement of pixels ( RGB stripe or pentile structure), or the size of each sub-pixel) At least some pixels of the display 210 may be at least partially based on, for example, the voltage value or the current value. By being driven, visual information (eg, text, image, or icon) corresponding to the image data may be displayed through the display 210 .

According to an embodiment, the display module 160 may further include a touch circuit 250 . The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251 . The touch sensor IC 253 may control the touch sensor 251 to detect a touch input or a hovering input for a specific position of the display 210 , for example. For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or electric charge amount) for a specific position of the display 210 . The touch sensor IC 253 may provide information (eg, location, area, pressure, or time) regarding the sensed touch input or hovering input to the processor 120 . According to an embodiment, at least a part of the touch circuit 250 (eg, the touch sensor IC 253 ) is disposed as a part of the display driver IC 230 , the display 210 , or outside the display module 160 . It may be included as a part of another component (eg, the coprocessor 123).

According to an embodiment, the display module 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 176 , or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display module 160 (eg, the display 210 or the DDI 230 ) or a part of the touch circuit 250 . For example, when the sensor module 176 embedded in the display module 160 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor provides biometric information related to a touch input through a partial area of the display 210 . (eg, fingerprint image) can be acquired. For another example, when the sensor module 176 embedded in the display module 160 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or the entire area of the display 210 . can According to an embodiment, the touch sensor 251 or the sensor module 176 may be disposed between pixels of the pixel layer of the display 210 , or above or below the pixel layer.

3 is a block diagram 300 illustrating components of an electronic device 301 according to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, the electronic device 301 disclosed in this document may include at least some of the components of the electronic device described above with reference to FIG. 1 (eg, the electronic device 101 of FIG. 1 ). can For example, the electronic device 301 includes a processor 320 (eg, processor 120 of FIG. 1 ), a memory 330 (eg, memory 130 of FIG. 1 ), and a pen input interface 350 (eg, a pen input interface 350 ). to include: input module 150 of FIG. 1 ), display 360 (eg, display 160 of FIG. 1 ), and/or communication circuitry 390 (eg, communication module 190 of FIG. 1 ). can The components illustrated in FIG. 4 are exemplary, and the electronic device 301 may further include components not illustrated in FIG. 4 or may not include some of the illustrated components.

The processor 320 may be operatively coupled to the memory 330 , the pen input interface 350 , the display 360 , and/or the communication circuitry 390 , according to one embodiment. The memory 330 may store one or more instructions that, when executed, cause the processor 320 to perform various operations of the electronic device 301 .

The pen input interface 350 may be configured to receive an input by the input device 302 (eg, a stylus pen, a digital pen, or a digitizer pen), according to an embodiment. For example, the pen input interface 350 may include a grid-shaped circuit pattern, and may be set to detect an input position of the input device 302 using the circuit pattern. For example, the pen input interface 350 may be embedded in the display 360 or located below the display 360 .

The display 360, according to an embodiment, may include a plurality of pixels. The display 360 may further include a touch input detection circuit and/or a pen input detection circuit (eg, the pen input interface 350 ) for detecting a touch input (eg, a touch input by a user). The processor 320 may distinguish and detect a touch input by an external object (eg, a user's hand) and an input by the input device 302 . The processor 320 may detect a touch input using a touch input detection circuit, and may detect an input of the input device 302 using a pen input detection circuit. For example, the processor 320 may detect a hovering input from the input device 302 when the input device 302 is spaced apart within a specified distance from the display 360 . For example, the processor 320 may detect a pen input (eg, pen touch input or pen contact input) from the input device 302 when one end of the input device 302 is in contact with the display 360 . can For example, when a button of the input device 302 is triggered, the processor 320 may detect a button input from the input device 302 .

The display 360, according to an embodiment, may include various types of displays. For example, the display may include a flexible display. The flexible display may refer to a display in which at least part of it is flexible. The flexible display may be folded or unfolded based on a hinge structure included in the electronic device 301 . For example, the display 360 may display different screens in each area of the display that is physically and/or logically separated under the control of the processor 320 . Depending on the folding angle of the display 360 , the electronic device 301 may be used in various forms. The form of use of the electronic device 301 according to the folding angle of the display 360 may be referred to in more detail in the description of FIG. 4 to be described later.

According to an embodiment, the communication circuit 390 may be configured to support short-range wireless communication based on a Bluetooth protocol (eg, legacy Bluetooth and/or BLE) and/or a wireless LAN. For example, communication circuitry 390 may provide communication with input device 302 .

The electronic device 301 may further include components not shown in FIG. 3 . For example, the electronic device 301 may further include a housing. The housing may include a magnetic pad for attachment of the input device 302 and/or a slot for insertion of the input device 302 .

The input device 302 may be referred to as a stylus pen, a digital pen, or a digitizer pen. For example, the input device 02 may receive an electromagnetic field signal (eg, a proximity signal) generated from a digitizer (eg, a pen input interface) of the electronic device 301 . For example, the input device 302 may receive an electromagnetic field signal using a resonant circuit. The input device 302 may transmit an electromagnetic resonance (EMR) input signal to the electronic device 301 . As another example, the input device 302 may use at least one of an active electrostatic (AES) method and an electrically coupled resonance (ECR) method. When the input device 302 transmits a signal using the AES method, the input device 302 may generate a signal using the electronic device 301 and capacitive coupling. When the input device 302 transmits a signal by the ECR method, the input device 302 includes a resonance frequency based on an electric field generated from a capacitive device of the electronic device 301 . signal can be generated.

According to an embodiment, the input device 302 may include a communication circuit for communication with the electronic device 301 . For example, the input device 302 may communicate with the electronic device 301 using short-range wireless communication (eg, at least one of Bluetooth, Bluetooth low energy (BLE), or wireless LAN). In one example, the input device 302 may include at least one button. When an input for at least one button is received, the input device 302 may transmit a signal corresponding to the button input to the electronic device 301 using a resonance circuit and/or a communication circuit.

According to an embodiment, the input device 302 may include at least one sensor (eg, an accelerator sensor, a piezo sensor, and/or a gyro sensor). For example, the input device 302 may obtain motion information related to the motion of the input device 302 using at least one sensor. For example, the input device 302 obtains motion information related to a movement (eg, shaking) of the input device 302 by an external (eg, a user), and transmits a control signal including the motion information electronically. may be transmitted to the device 301 .

4 illustrates an electronic device 401 that provides a user interface in various forms, according to various embodiments of the present disclosure.

Referring to reference numeral 400 , according to various embodiments of the present disclosure, the electronic device 401 (eg, the electronic device 101 of FIG. 1 ) includes at least a part of the flexible display 460 (eg, FIG. 1 ) having flexibility. 1 display module 160). The electronic device 401 may be used in various forms according to the folding angle of the flexible display 460 . The electronic device 401 may receive a control signal from the input device 402 and provide various functions based on the control signal. For example, when an external input to the button 410 (eg, a pressure input by a user) is received, the input device 402 transmits a first signal corresponding to the external input to the button 410 to the electronic device ( 401) can be sent. As an example, the first signal may include motion information of the input device 402 . The input device 402 may detect a shaking of the input device 402 by the user using at least one sensor, and may acquire motion information based on the sensed information. The input device 402 may transmit a first signal including motion information to the electronic device 401 .

Referring to reference numeral 400a, according to an embodiment, the electronic device 401 may operate in a folding form. The electronic device 401 may display various user interfaces on one area of the flexible display 460 . As shown by reference numeral 400a, the shape of the electronic device 401 operating in a folding shape may be defined as a first shape. For example, the electronic device 401 may receive a specified signal (eg, a first signal) from the input device 402 and display various user interfaces based on the specified signal. For example, when an external input to the button 410 included in the input device 402 is continuously detected, the electronic device 401 generates and transmits the first input device 402 in response to the external input. signal can be received. The motion information included in the first signal may include information about the number of times of shaking of the input device 402 , a shaking speed, and/or a shaking direction. The electronic device 401 may display various user interfaces on one area of the flexible display 460 based on the motion information. For example, the electronic device 401 operating in the first form may display a plurality of icons (a first icon 451 , a second icon 452 , and a third icon ( 453)) may be displayed. Each of the plurality of icons may be referred to as a graphic user interface (GUI) for executing a designated application based on a touch input (eg, a touch input by the input device 402 ).

Referring to reference numeral 400b , according to an embodiment, the electronic device 401 may operate in an unfolded form. The electronic device 401 may display various user interfaces on one area of the flexible display 460 . As illustrated by reference numeral 400b, the shape of the electronic device 401 operating in an unfolded shape may be defined as a second shape. The electronic device 401 may display various user interfaces on one area of the flexible display 460 based on motion information of the input device 402 included in the first signal received from the input device 402 . For example, the electronic device 401 operating in the second form may display a plurality of images (a first image 461 , a second image 462 , and a third image 463 on at least one area of the flexible display 460 ). ), and a fourth image 464) may be displayed. Each of the plurality of images may be referred to as a GUI for executing a designated application based on a touch input. For example, the plurality of images may be referred to as thumbnail images displaying virtual execution screens of the specified applications.

In FIG. 4 , the operation form of the electronic device 401 is divided into a first form and a second form, but this is exemplary and is not limited thereto. For example, the electronic device 401 may provide various user interfaces in the form of half-folding. A shape of the electronic device 401 operating in a half-folding shape may be defined as a third shape. The description of the electronic device 401 operating in the half-folding configuration may be referred to in more detail with reference to FIGS. 10 to 14 to be described later.

5 illustrates an electronic device 501 that provides various user interfaces in a folding form according to various embodiments of the present disclosure.

According to an embodiment, the operation form of the electronic device 501 (eg, the electronic device 101 of FIG. 1 ) illustrated by reference numeral 500 is a first shape (eg, a first shape according to reference numeral 400a of FIG. 4 ). ) can be defined as The electronic device 501 may provide various user interfaces based on communication with the input device 502 (eg, the input device 402 of FIG. 4 ). For example, the electronic device 501 may receive a control signal (eg, a first signal) transmitted from the input device 502 and obtain motion information included in the first signal. When it is determined that the motion information of the input device 502 satisfies the specified condition, the electronic device 501 may provide various user interfaces to the flexible display 560 (eg, the display module 160 of FIG. 1 ). there is. The specified condition may include a number of shaking (shaking), a shaking speed, and/or a shaking direction of the input device 502 . For example, the number of times of shaking may be defined as the number of times the user shakes the input device 502 for a specified time. As another example, the shaking speed may be defined as a speed or intensity at which the electronic device shakes the input device 502 based on a specified period. As another example, the shaking direction may be defined as a direction in which the user shakes the input device 502 . As an example, the control signal transmitted from the input device 502 is the input device 502 when an external input is sensed to a button 510 included in the input device 502 (eg, the button 410 in FIG. 4 ). may be referred to as a first signal that is generated and transmitted to the electronic device 501 . In other words, when an external input to the button 510 is continuously detected, the input device 502 continuously transmits the first signal including the motion information of the input device 502 acquired using at least one sensor to electronic may be transmitted to the device 501 . The electronic device 501 may receive the first signal from the input device 502 using a communication circuit (eg, the communication circuit 390 of FIG. 3 ).

According to an embodiment, the electronic device 501 receives the first signal, obtains motion information included in the first signal, and displays various user interfaces on one area of the flexible display 560 based on the motion information. can be displayed For example, the user interface may include a plurality of icons (eg, a first icon 551 , a second icon 552 , a third icon 553 , a fourth icon 554 , a fifth icon 555 , and a sixth icon 556). For example, the plurality of icons may be referred to as a graphic user interface (GUI) for executing a specified application based on a touch input (eg, a touch input by a user or a touch input by the input device 502 ).

According to an embodiment, the electronic device 501 may obtain a first signal including information related to the movement 505 of the input device 502 from the input device 502 . For example, the information about the movement 505 of the input device 502 may include information about the number of times of shaking, the shaking speed, and/or the shaking direction of the input device 502 . When information related to the movement 505 of the input device 502 is changed, the electronic device 501 may change and display the user interface on the flexible display 560 . For example, when the shaking speed of the input device 502 increases (eg, when a user performs a shaking gesture operation using the input device 502 at a faster cycle), the input device 502 may use at least one It is possible to identify that the shaking speed has been increased using the sensor, and transmit a first signal including the changed motion information to the electronic device 501 . The electronic device 501 may receive the first signal and display additional icons (eg, not shown) on the flexible display 560 . In other words, when the shaking speed of the input device 502 increases, the electronic device 501 may additionally display new icons in addition to the plurality of icons 551 to 556 that are previously displayed on the flexible display 560 . can As another example, when the shaking speed of the input device 502 decreases (eg, when a user performs a shaking gesture operation using the input device 502 at a slower cycle), the electronic device 501 previously At least one of the plurality of icons 551 to 556 being displayed may not be displayed any more.

According to an embodiment, the electronic device 501 may display a plurality of icons included in the user interface differently based on weights stored in a memory (eg, the memory 330 of FIG. 3 ). For example, the weight may include the number of times and/or usage history of each of the applications provided by the electronic device 501 . For example, in the electronic device 501 , an icon (eg, a first icon 551 ) corresponding to an application with a high usage count is an icon (eg, a second icon 552 to a second icon 552 ) corresponding to an application with a low usage count. A user interface having a relatively wider area than the 6 icon 556) may be displayed on the flexible display 560 . As another example, the electronic device 501 may display a user interface on the flexible display 560 in which an icon corresponding to the most recently used application has a relatively wider area than other icons.

According to an embodiment, the electronic device 501 may execute a specified function based on a touch input to at least one area of the user interface. For example, the electronic device 501 detects a touch input (eg, a touch input by a user and/or a pen touch input by the input device 502 ) for the first icon 551 included in the user interface. In this case, an application corresponding to the first icon 551 may be executed and displayed on the flexible display 560 . As another example, when a pen touch input by the input device 502 is sensed in at least one of a plurality of icons while an external input is detected on the button 510 of the input device 502 , the electronic device 501 . ) may be displayed on the flexible display 560 by executing applications corresponding to at least one of the plurality of icons. For example, when the electronic device 501 detects a pen touch input to at least one of the plurality of icons while receiving the first signal from the input device 502 , the plurality of icons in which the touch input is sensed Applications corresponding to at least one of them may be executed and displayed on the flexible display 560 . In other words, the electronic device 501 may display a user interface in which a plurality of icons have different regions based on a specified weight.

In FIG. 5 , the user interface displayed by the electronic device 501 is illustrated as including six icons 551 to 556 , but is not limited thereto. Meanwhile, a description of an execution screen in which the electronic device 601 executes at least one application based on a touch input to at least one of the plurality of icons may be described with reference to FIG. 7 to be described later.

6 illustrates an electronic device 601 that provides various user interfaces in an unfolded form, according to various embodiments of the present disclosure.

According to an embodiment, the operation form of the electronic device 601 (eg, the electronic device 101 of FIG. 1 ) shown by reference numeral 600 is a second shape (eg, the second shape according to reference numeral 400b of FIG. 4 ). ) can be defined as The electronic device 601 may provide various user interfaces based on communication with the input device 602 (eg, the input device 402 of FIG. 4 ).

According to an embodiment, the electronic device 601 receives a first signal including motion information related to a motion 605 of the input device 602 , and based on the motion information, an area of the flexible display 660 . can display various user interfaces. For example, the user interface may include a plurality of images (eg, a first image 661 , a second image 662 , a fourth image 664 , a fifth image 665 , a sixth image 666 , a sixth image 666 and a seventh image 667). For example, the plurality of images may be referred to as a graphical user interface (GUI) for executing a specified application based on a touch input (eg, a touch input by a user or a touch input by the input device 602 ).

According to an embodiment, the electronic device 601 may receive a first signal including information related to the movement 605 of the input device 602 . For example, the information about the movement 605 of the input device 602 may include information about the number of shaking (shaking), shaking speed, and/or shaking direction of the input device 602 . When information related to the movement 605 of the input device 602 is changed, the electronic device 601 may change and display the user interface on the flexible display 660 . For example, when the shaking speed of the input device 602 increases (eg, when a user performs a shaking gesture operation by using the input device 602 at a faster cycle), the input device 602 performs at least one An increase in the shaking gesture speed may be identified using the sensor, and a first signal including the changed motion information may be transmitted to the electronic device 601 . The electronic device 601 may display additional thumbnails (eg, not shown) on the flexible display 660 based on the changed motion information. In other words, when the shaking speed of the input device 602 increases, the electronic device 601 may additionally display new images in addition to the plurality of images 661 to 667 that are previously displayed on the flexible display 660 . can As another example, when the shaking speed of the input device 602 decreases (eg, when the user performs a shaking gesture operation using the input device 602 at a slower cycle), the electronic device 601 ) may no longer display at least one of a plurality of images (reference numerals 661 to 667) that are being displayed.

According to an embodiment, the electronic device 601 may display a plurality of images included in the user interface differently based on weights stored in a memory (eg, the memory 330 of FIG. 3 ). For example, the weight may include the number of times and/or usage history of each of the applications provided by the electronic device 601 . For example, in the electronic device 601 , an image (eg, the first image 661 ) corresponding to an application with a high frequency of use is an image (eg, the second image 662 to the second image 662 ) corresponding to an application with a low frequency of use. A user interface having a relatively wider area than the 7 image 667) may be displayed on the flexible display 660 . As another example, the electronic device 601 may display a user interface on the flexible display 660 in which an image corresponding to the most recently used application has a relatively wider area than other images.

According to an embodiment, the electronic device 601 may execute a specified function based on a touch input to at least one area of the user interface. For example, the electronic device 601 detects a touch input (eg, a touch input by a user and/or a pen touch input by the input device 602 ) with respect to the first image 661 included in the user interface. In this case, an application corresponding to the first image 661 may be executed and displayed on the flexible display 660 . As another example, when a pen touch input by the input device 602 is sensed in at least one of a plurality of images while an external input is sensed to the button 610 of the input device 602 , the electronic device 601 ) may be displayed on the flexible display 660 by executing applications corresponding to at least one of the plurality of images. For example, when the electronic device 601 detects a pen touch input for at least one of a plurality of images while receiving the first signal from the input device 602 , the plurality of images in which the touch input is sensed Applications corresponding to at least one of them may be executed and displayed on the flexible display 660 . In other words, the electronic device 601 may display a user interface in which a plurality of images have different regions based on a specified weight.

In FIG. 6 , the user interface displayed by the electronic device 601 is illustrated as including seven images 661 to 667 , but is not limited thereto. Meanwhile, a description of an execution screen in which the electronic device 601 executes at least one application based on a touch input for at least one of a plurality of images may be described with reference to FIG. 7 to be described later.

7 illustrates an electronic device 701 that provides various user interfaces in an unfolded form according to various embodiments of the present disclosure.

Referring to reference numeral 700 , according to various embodiments, the electronic device 701 (eg, the electronic device 101 of FIG. 1 ) applies applications to different areas of the flexible display (eg, the display 460 of FIG. 4 ). The execution screen can be displayed. For example, the electronic device 701 may display an application execution screen having different regions on the flexible display based on a weight stored in a memory (eg, the memory 330 of FIG. 3 ). The division of the area of the flexible display described in FIG. 7 may be a division of a physical area based on a folding structure (eg, a hinge structure) of the flexible display, or a division of a logical area based on an execution screen. .

According to an embodiment, FIG. 7 shows an electronic device displaying a user interface in a first form (eg, a first form according to reference numeral 400a of FIG. 4 , a folding form) using a plurality of icons in the user interface. Receive a touch input (eg, a touch input by a user or an input device (eg, a pen touch input by the input device 402 of FIG. 4 ) for at least one of (eg, reference numerals 551 to 556 of FIG. 5 ); , may be referred to as a diagram illustrating an electronic device 701 executing at least one application determined based on the touch input. A touch input (for example, reference numerals 661 to 667 in FIG. 6 ) of at least one of a plurality of icons in the user interface (eg, reference numerals 661 to 667 in FIG. For example, reference may be made to a diagram illustrating an electronic device 701 that receives a touch input by a user or a pen touch input by an input device and executes at least one application determined based on the touch input. The device 701 may display an execution screen on the flexible display by executing at least one application determined based on the touch input in response to the second signal transmitted from the input device.

Referring to reference numeral 700a, according to an embodiment, the electronic device 701 may execute two applications determined based on a touch input. For example, the electronic device 701 may display execution screens of the first application and the second application in the first area 761 and the second area 762 of the flexible display, respectively. As an example, the electronic device 701 receives a first signal while displaying a plurality of icons in a first form, and includes a first icon (eg, a first icon 551 in FIG. 5 ) and a second icon ( Example: A touch input to the second icon 552 of FIG. 5 ) may be detected. After determining an application to be executed based on the touch input, the electronic device 701 may receive a second signal from the input device. When the operation form is changed from the first form to the second form, the electronic device 701 may execute the applications in different areas 761 and 762 in response to the received second signal. As another example, the electronic device 701 receives a first signal while displaying a plurality of images in a second form, and includes a first image (eg, the first image 661 of FIG. 6 ) and a second image ( For example, a touch input to the second image 662 of FIG. 6 ) may be detected. After determining an application to be executed based on the touch input, the electronic device 701 may receive a second signal from the input device. The electronic device 701 may execute the applications in different areas 761 and 762 in response to the received second signal.

Referring to reference numeral 700b, according to an embodiment, the electronic device 701 may execute three applications determined based on a touch input. For example, the electronic device 701 executes the first application, the second application, and the third application in the first area 761 , the second area 762 , and the third area 763 of the flexible display, respectively. screen can be displayed.

Referring to reference numeral 700c, according to an embodiment, the electronic device 701 may execute four applications determined based on a touch input. For example, the electronic device 701 provides a first application and a second application in the first area 761 , the second area 762 , the third area 763 , and the fourth area 764 of the flexible display, respectively. , the third application, and the execution screen of the fourth application may be displayed.

In FIG. 7 , the division of the area of the flexible display is exemplary, and various embodiments of the present document are not limited thereto. For example, first region 761 and second region 762 of reference number 700a, second region 762 and third region 763 of reference number 700b, and all regions of reference number 700c are identical to each other. Although illustrated as an area of a size, the electronic device 701 may display an application execution screen in areas having different sizes. In addition, although each area is illustrated as having a rectangular shape, this is also exemplary, and the electronic device 701 may display an application execution screen in a changed shape area based on a user's setting or a specified input.

8 illustrates an electronic device 801 that provides various user interfaces in an unfolded form according to various embodiments of the present disclosure.

Referring to reference numeral 800 , according to various embodiments, the electronic device 801 (eg, the electronic device 101 of FIG. 1 ) moves the input device 802 (eg, the input device 302 of FIG. 3 ). A user interface having various structures may be displayed based on the information. For example, the electronic device 801 may receive a first signal including motion information of the input device 802 from the input device 802, change the structure of the user interface based on the motion information, and display it. there is. For example, the electronic device 801 may change and display the structure of the user interface based on shaking direction information included in the motion information of the input device 802 .

Referring to reference numeral 800a, the electronic device 801 is configured to include motion information of the input device 802 that is repeatedly shaken in the first direction 811 and the second direction 812 using at least one sensor. 1 signal can be received. For example, the user may repeatedly perform a shaking gesture in the first direction 811 and the second direction 812 while holding the input device 802 . The input device 802 obtains first motion information of the input device 802 that is repeatedly shaken in the first direction 811 and the second direction 812 using at least one sensor, and the first motion information A first signal including , may be transmitted to the electronic device 801 . For example, the electronic device 801 may display a user interface based on first motion information including the first direction 811 and the second direction 812 . For example, the electronic device 801 arranges the first area 861 on the right side of the flexible display (eg, the display 460 of FIG. 4 ) based on the first motion information, and the second area 862 and An application execution screen may be displayed by arranging the third area 863 on the left side.

Referring to reference numeral 800b , the electronic device 801 may receive a first signal including motion information of the input device 802 that is repeatedly shaken in the third direction 813 and the fourth direction 814 . . For example, the user may repeatedly shake the input device 802 in the third direction 813 and the fourth direction 814 while gripping the input device 802 . The input device 802 transmits a first signal including second motion information of the input device 802 that is repeatedly shaken in the third direction 813 and the fourth direction 814 using at least one sensor to the electronic device. It can be sent to (801). For example, the electronic device 801 may display the user interface based on the second motion information including the third direction 813 and the fourth direction 814 . For example, the electronic device 801 arranges the first area 861 on the left side of the flexible display and the second area 862 and the third area 863 on the right side of the flexible display based on the second motion information. The application execution screen can be displayed.

The division of the area of the application execution screen shown in FIG. 8 is exemplary, and various embodiments of the present document are not limited thereto. For example, the electronic device 801 may display the application execution screen by dividing the second area 862 and the third area 863 to have different sizes.

9 illustrates an electronic device 901 terminating providing a user interface, according to various embodiments of the present disclosure.

Referring to reference numeral 900 , according to various embodiments, the electronic device 901 (eg, the electronic device 101 of FIG. 1 ) terminates the provision of the user interface based on the change of the operation form according to the change of the folding angle. can do.

Referring to reference numeral 900a, according to an embodiment, the electronic device 901 may operate in a second shape (eg, a second shape according to reference numeral 400b of FIG. 4 , an unfolding shape). The electronic device 901 receives a first signal transmitted from the input device 902 (eg, the input device 302 of FIG. 3 ), and obtains motion information of the input device 902 included in the first signal can do. For example, when it is determined that the motion information satisfies a specified condition, the electronic device 901 displays a plurality of images (eg, FIG. 3 ) on the flexible display 960 (eg, the flexible display 360 of FIG. 3 ). 6, reference numerals 661 to 667).

Referring to reference numeral 900b, according to an embodiment, the electronic device 901 may operate in a third mode. For example, the third form may be referred to as a half-folding form in which the flexible display is folded at a specified angle. When the operation form of the electronic device 901 is changed to the third form, the electronic device 901 changes and displays the plurality of images displayed on the flexible display 960 into icons (eg, a water droplet icon) of a different form. can do.

Referring to reference numeral 900c, according to an embodiment, the electronic device 901 may remove the icons displayed on the flexible display 960 . For example, the electronic device 901 may remove the icon in which the designated input is sensed based on a designated input for the icons (eg, a drag input by a user or a pen drag input). As another example, in the third form, when the display time of the icons exceeds a specified time, the electronic device 901 may sequentially remove the icons according to a specified weight. For example, when it is determined that the display time of the icons exceeds a specified time, the electronic device 901 may sequentially remove at least one icon from an icon corresponding to an application having the lowest number of uses.

10 illustrates an electronic device 1001 that provides various user interfaces in a half-folding form according to various embodiments of the present disclosure.

According to an embodiment, an operation form of the electronic device 1001 (eg, the electronic device 101 of FIG. 1 ) illustrated by reference numeral 1000 may be defined as a third form. For example, the third form refers to a form in which at least a portion of the flexible display (eg, the display 360 of FIG. 3 ) included in the electronic device 1001 is folded at a specified angle (eg, 90 degrees to 150 degrees). can be The electronic device 1001 may provide various user interfaces based on communication with the input device 1002 (eg, the input device 402 of FIG. 4 ). For example, the electronic device 1001 may receive a control signal transmitted from the input device 1002 . The input device 1002 obtains motion information related to the motion 1005 of the input device 1002 using at least one sensor (eg, an acceleration sensor, a piezo sensor, and/or a gyro sensor), and collects the motion information. The included control signal may be transmitted to the electronic device 1001 . When it is determined that the motion information of the input device 1002 satisfies the specified condition, the electronic device 1001 displays at least a portion of the flexible display (eg, the first display area 1060a and/or the second display area 1060b). ) can provide various user interfaces. The specified condition may include a number of shaking of the input device 1002 by the user, a shaking speed, and/or a shaking direction. As an example, the control signal transmitted from the input device 1002 is input device 1002 when an external input is sensed to a button 1010 included in the input device 1002 (eg, button 410 in FIG. 4 ). may be referred to as a first signal that is generated and transmitted to the electronic device 1001 . In other words, when an external input to the button 1010 is continuously detected, the input device 1002 may continuously transmit the first signal to the electronic device 1001 . The electronic device 1001 may receive the first signal from the input device 1002 using a communication circuit (eg, the communication circuit 390 of FIG. 3 ).

According to an embodiment, the electronic device 1001 receives a first signal including motion information related to a motion 1005 of the input device 1002 , and based on the motion information, one area of the flexible display 1060 . Various user interfaces may be displayed on (eg, the first display area 1060a and/or the second display area 1060b). For example, the user interface may include a plurality of icons (eg, a first icon 1081 , a second icon 1082 , a third icon 1083 , a fourth icon 1084 , a fifth icon 1085 , and a sixth icon 1086). As another example, the user interface may include a plurality of images (eg, a first image 1071 , a second image 1072 , and a third image 1073 ). For example, the plurality of icons and the plurality of images are displayed as a graphical user interface (GUI) for executing a designated application based on a touch input (eg, a touch input by a user or a touch input by the input device 1002 ). can be referenced.

According to an embodiment, the electronic device 1001 may divide regions of the flexible display and include different user interfaces in the divided regions. For example, the electronic device 1001 may divide the flexible display into a first display area 1060a and a second display area 1060b based on a folding part of the flexible display. For example, the electronic device 1001 displays a plurality of images 1071 to 1073 on the first display area 1060a, and displays a plurality of icons 1081 to 1086 on the second display area 1060b. can do.

According to an embodiment, the electronic device 1001 may display various user interfaces based on motion information of the input device 1002 and/or weights stored in a memory (eg, the memory 330 of FIG. 3 ). The description of the electronic device 1001 that displays various user interfaces based on the motion information and/or weights may be replaced with the description disclosed in FIGS. 4 and 5 .

According to an embodiment, the electronic device 1001 may execute a specified function based on a touch input to at least one area of the user interface. For example, the electronic device 1001 performs a touch input (eg, a touch input by a user and/or a pen touch by the input device 1002 ) for the first thumbnail 1071 displayed on the first display area 1060a. input) is detected, an application corresponding to the first image 1071 may be executed and displayed on the first display area 1060a. As another example, when a pen touch input by the input device 1002 is sensed in at least one of a plurality of images and/or icons while an external input is sensed to the button 1010 of the input device 1002 , the electronic device 1001 may execute applications corresponding to at least one of the plurality of images and/or icons and display them on the first display area 1060a and/or the second display area 1060b. For example, when the electronic device 1001 detects a pen touch input for at least one of a plurality of images and/or icons while receiving the first signal from the input device 1002 , the touch input is Applications corresponding to at least one of the detected plurality of images and/or icons may be executed and displayed on the first display area 1060a and/or the second display area 1060b.

11 illustrates an electronic device 1101 that provides various user interfaces in a half-folding form according to various embodiments of the present disclosure.

According to an embodiment, an operation form of the electronic device 1101 (eg, the electronic device 101 of FIG. 1 ) illustrated by reference numeral 1100 may be defined as a third form (eg, the third form of FIG. 10 ). there is. For example, the flexible display of the electronic device 1101 operating in the third shape may be divided into a first area 1160a and a second area 1160b. The above division of the flexible display may be a division of a physical area based on a folding structure (eg, a hinge structure) or a division of a logical area based on an execution screen. The electronic device 1101 may sequentially perform the operations illustrated by reference numerals 1100a, 1100b, and 1100c based on a designated input.

Referring to reference numeral 1100a, according to an embodiment, the electronic device 1101 may display various user interfaces on the flexible display. For example, the electronic device 1101 obtains motion information of the input device 1102 based on a first signal transmitted from the input device 1102 (eg, the input device 402 of FIG. 4 ), and the movement When it is determined that the information satisfies the specified condition, various user interfaces may be displayed on the flexible display. As an example, the electronic device 1101 displays a plurality of images (eg, a first thumbnail 1171 , a second thumbnail 1172 , and a third image 1173 ) on the first display area 1160a, A plurality of icons (eg, the first icon 1181) may be displayed on the second display area 1160b. The electronic device 1101 may store information about a plurality of applications (eg, the number of times of use, a history of use, and/or a correlation with the input device 1102 ) in a memory. The electronic device 1101 may determine images and/or icons displayed on the first display area 1160a and the second display area 1160b based on the information on the plurality of applications. For example, the electronic device 1101 may display a plurality of images corresponding to applications with a high frequency of use on the first display area 1160a.

Referring to reference numeral 1100b, according to an embodiment, the electronic device 1101 may receive an input for the flexible display and determine an application corresponding to the input. For example, the electronic device 1101 receives a first signal from the input device 1102 , and displays a first image 1111 and a second image 1112 and a second display displayed on the first display area 1160a. Pen touch inputs 1111 , 1112 , and 1113 for the first icon 1181 displayed in the area 1160b may be detected. For example, the electronic device 1101 may detect the pen touch inputs 1111 , 1112 , and 1113 and receive a second signal. In response to the reception of the second signal, the electronic device 1101 may determine an application corresponding to the image and icon detected by the pen touch inputs 1111 , 1112 , and 1113 as an application to be executed. For example, the first signal is transmitted to the electronic device 1101 by the input device 1102 on the basis of receiving an external input (eg, a pressure input by a user) for a button (eg, the button 410 in FIG. 4 ). It can be referred to as a transmitted control signal. As another example, the second signal may be referred to as a control signal transmitted by the input device 1102 to the electronic device 1101 in response to termination of an external input for a button. In other words, when the user performs an operation of pressing a button of the input device 1102 , the input device 1102 may generate a first signal and transmit it to the electronic device 1101 . Thereafter, when the user no longer presses the button of the input device 1102 , the input device 1102 may generate a second signal and transmit it to the electronic device 1101 .

Referring to reference number 1100c, according to an embodiment, the electronic device 1101 may display execution screens of applications determined by reference number 1100b in the first display area 1160a and the second display area 1160b. The electronic device 1101 displays execution screens in various arrangements based on information about a plurality of applications stored in the memory (eg, the number of times of use, use history, identification information, and/or correlation with the input device 1102 ). can do. For example, the electronic device 1101 may display an image and/or an execution screen of an application that displays an image (eg, a drawing application) on the first display area 1160a. As another example, the electronic device 1101 may display an execution screen of an application having a high correlation with the input device 1102 among the determined applications on the second display area 1160b. As another example, the electronic device 1101 may display, on the second display area 1160b, an execution screen of an application (eg, an Internet application) in which a touch operation is frequently used, based on identification information of the application.

12 illustrates an electronic device 1201 that provides various user interfaces in a half-folding form according to various embodiments of the present disclosure.

Referring to reference numeral 1200 , according to various embodiments, the electronic device 1201 (eg, the electronic device 101 of FIG. 1 ) arranges thumbnails and/or icons included in a user interface based on a designated touch input. can be changed According to an embodiment, the electronic device 1201 displays the first image 1271 , the second image 1272 , and the third image 1273 on the first display area 1260a, and the second display area ( A plurality of icons including the first icon 1281 and the second icon 1282 may be displayed in 1260b). For example, the first image 1271 , the second image 1272 , and the third image 1273 may be GUIs corresponding to the first application, the second application, and the third application, respectively. As another example, the first icon 1281 and the second icon 1282 may be GUIs corresponding to the fourth application and the fifth application, respectively.

Referring to reference numeral 1200a , according to an embodiment, the electronic device 1201 arranges the user interface in response to a drag input by the input device 1202 (eg, the input device 402 of FIG. 4 ). structure can be changed. For example, when a drag input to at least a part of the first display area 1260a is sensed from the area corresponding to the first icon 1281 , the electronic device 1201 displays the first display area 1260b in the second display area 1260b. The icon 1281 may be deleted and a new icon may be displayed. For example, in response to a drag input directed from the first icon 1281 to at least a portion of the first display area 1260a, the electronic device 1201 displays the first icon 1281 and the third image 1273 . The display area can be changed. The electronic device 1201 may determine an image whose display area is to be changed in the first display area 1260a based on a specified weight. The electronic device 1201 changes and displays the first icon 1281 with the display area changed to the first display area 1260a into an image, and the third image 1273 with the display area changed to the second display area 1260b. can be displayed by changing to an icon. Also, the electronic device 1202 may delete one of the plurality of images displayed on the first display area 1260a (eg, the third image 1273 ) and display a new image. For example, the electronic device 1202 may display the first display area 1260a based on a weight stored in the memory (eg, the number of times of use, recent execution information, association with a running application, and/or association with an input device) stored in the memory. ) may determine at least one image to be deleted. For example, the new icon may be referred to as an icon corresponding to the third application. As another example, the new image may be an image corresponding to the fourth application.

Referring to reference numeral 1200b, according to an embodiment, the electronic device 1201 arranges the user interface in response to a drag input by the input device 1202 (eg, the input device 402 of FIG. 4 ). structure can be changed. For example, a pen touch input is sensed in areas corresponding to the second image 1272 , the third image 1273 , the first icon 1281 , and the second icon 1282 , and the second display area 1260b ), when a drag input to at least a portion of the first display area 1260a is sensed from at least a portion of the first display area 1260a, the electronic device 1201 may delete the selected images and icons from each display area. Thereafter, the electronic device 1202 may display icons corresponding to the second application and the third application on the second display area 1260b. Also, the electronic device 1202 may display images corresponding to the fourth application and the fifth application on the first display area 1260a. In other words, in response to a drag input to at least a portion of the first display area 1260a and the second display area 1260b, the electronic device 1202 displays at least a portion of at least one image or icons that are being displayed in advance. can be displayed by changing (eg, switching) the display area of .

13 illustrates an electronic device 1301 that provides various user interfaces in a half-folding form according to various embodiments of the present disclosure.

Referring to reference numeral 1300 , according to various embodiments, the electronic device 1301 receives a specified input, executes an application determined based on the specified input, and displays an execution screen of the application on a flexible display (eg, in FIG. 4 ). It may be displayed on one area of the display 460). For example, the electronic device 1301 may display a plurality of images 1371 , 1372 , and 1373 on the first display area 1360a , and display a plurality of icons on the second display area 1360b . .

Referring to reference numeral 1300a, according to an embodiment, the electronic device 1301 may receive a touch input 1311 by the input device 1302 in one area of the flexible display. The touch input 1311 may be at least one of a single tap, a double tap, and a long press input. For example, the electronic device 1301 may receive a touch input 1311 for one area of the first thumbnail 1371 displayed on the first display area 1360a. For example, the electronic device 1301 may execute an application determined based on the touch input 1311 and display an execution screen on the first area 1321 in the first display area 1360a. The application may be referred to as a first application corresponding to the first image 1371 in which the touch input 1311 is sensed.

Referring to reference numeral 1300b, according to an embodiment, the electronic device 1301 provides a first signal transmitted from the input device 1302 and/or a touch input 1311 by the input device 1302 on one region of the flexible display. and 1313). The first signal is generated by the input device 1302 and transmitted to the electronic device 1301 when an external input is detected on the button 1310 (eg, the button 410 in FIG. 4 ) included in the input device 1302 . It can be referred to as a control signal to The touch input may be at least one of a single tap, a double tap, or a long press input. For example, the electronic device 1301 receives a first signal transmitted from the input device 1302 , and includes one of the first image 1371 and the third image 1373 displayed on the first display area 1360a. Touch inputs 1311 and 1313 for the region may be received. For example, the electronic device 1301 executes applications determined based on the touch inputs 1311 and 1313 , and displays the first and second areas 1321 and 1323 in the first display area 1360a. Each execution screen can be displayed. The applications may be referred to as a first application and a third application corresponding to the first image 1371 and the third thumbnail 1373 in which the touch input is sensed. For example, the electronic device may display an execution screen of a first application in the first area 1321 and may display an execution screen of a second application in the second area 1323 . The electronic device 1301 may delete the second image 1372 in which the touch inputs 1311 and 1313 are not sensed from the first display area 1360a among the plurality of images. For example, the second image 1372 may be referred to as a GUI corresponding to the second application. The electronic device 1301 may display the second icon 1382 on the second display area 1360b. For example, the second icon 1382 may be referred to as a GUI corresponding to the second application.

14 illustrates an electronic device 1401 that provides various user interfaces according to various embodiments of the present disclosure.

Referring to reference numeral 1400 , according to various embodiments, the electronic device 1401 (eg, the electronic device 101 of FIG. 1 ) communicates with the input device 1402 (eg, the input device 302 of FIG. 3 ). Based on this, a user interface that provides various functions may be displayed. For example, the electronic device 1401 may provide a drawing function that generates a drawing image based on a touch input by the input device 1402 . The electronic device 1401 receives a touch input from the input device 1402 and displays various types of drawing images generated based on the touch input on the flexible display 1460 (eg, the display 360 of FIG. 3 ). can be displayed

According to an embodiment, the electronic device 1401 may display a drawing image based on a property set for the touch input based on communication with the input device 1402 . For example, the electronic device may receive a first signal transmitted from the input device 1402 and obtain motion information of the input device 1402 included in the first signal. The first signal is input by the input device 1402 using at least one sensor when an external input is sensed to the button 1410 (eg, the button 410 in FIG. 4 ) included in the input device 1402 . It may be referred to as a control signal that obtains motion information related to the motion of the device 1402 , generates to include the motion information, and transmits the motion information to the electronic device 1401 . For example, when it is determined that the motion information satisfies a specified condition, the electronic device 1401 may change a property set for the touch input. The attribute may include, for example, color, thickness, pattern, size, and/or shape. For example, the electronic device 1401 receives a first signal from the input device, obtains motion information of the input device 1402 , and determines that the shaking speed of the input device 1402 included in the motion information is When it is determined that there is an increase, a drawing image generated based on the touch input may be displayed after setting the property for the touch input as the first property. For example, the first property may be referred to as a property for displaying the drawing image with a relatively larger thickness compared to a preset property.

15 illustrates an electronic device 1501 that provides various user interfaces according to various embodiments of the present disclosure.

Referring to reference numeral 1500 , according to various embodiments, the electronic device 1501 (eg, the electronic device 1501 of FIG. 1 ) may provide location information (eg, GPS information) or communication information (eg, Bluetooth) communication. information), a user interface that provides various functions may be displayed.

According to an embodiment, the electronic device 1501 may perform Bluetooth communication with an external device (eg, a car). The electronic device 1501 may receive a first signal from the input device 1502 (eg, the input device 302 of FIG. 3 ) while performing Bluetooth communication with the external device. For example, the electronic device 1501 may receive a first signal including motion information of the input device 1502 . When it is determined that the motion information satisfies the specified condition, the electronic device 1501 displays at least one application (eg, a navigation application 1561) on the flexible display 1560 (eg, the display 360 of FIG. 3 ); A music application 1562 and/or an SNS application 1563) may be displayed. For example, the at least one application may be referred to as an application determined by the electronic device 1501 based on location information and/or communication information of the electronic device 1501 .

16 illustrates an electronic device 1601 that provides various user interfaces according to various embodiments of the present disclosure.

Referring to reference numeral 1600 , according to various embodiments, the electronic device 1601 (eg, the electronic device 101 of FIG. 1 ) executes various applications while the input device 1602 (eg, the electronic device 101 of FIG. 3 ) is running. Various functions may be provided based on communication with the input device 302). For example, the electronic device 1601 may display a map application execution screen on a flexible display (eg, the display 360 of FIG. 3 ). Hereinafter, an operation in which the electronic device 1601 provides various functions based on communication with the input device 1602 may be sequentially described.

Referring to reference numeral 1600a, according to an embodiment, the electronic device 1601 receives the first signal transmitted from the input device 1602, and is displayed on one area of the first user interface 1621 displayed on the flexible display. A touch input of the input device 1602 may be received. For example, the first user interface 1621 may include a plurality of GUIs corresponding to a search function and/or a theme selection function. The electronic device 1601 may receive a touch input from the input device 1602 for at least one theme among the theme selection functions included in the first user interface 1621 . The electronic device 1601 may identify one theme among a plurality of themes based on the touch input.

Referring to reference numeral 1600b, according to an embodiment, the electronic device 1601 may obtain motion information related to the motion 1605 of the input device 1602 based on a first signal transmitted from the input device 1602. can For example, when it is determined that the shaking speed of the input device 1602 included in the motion information satisfies a specified condition, the electronic device 1601 may display the second user interface 1622 . . As an example, the second user interface 1622 may include place information corresponding to the identified theme.

Referring to reference numeral 1600c, according to an embodiment, the electronic device 1601 may display a place corresponding to the place information included in the second user interface 1622 on the map screen. For example, the electronic device 1601 may display a place corresponding to the place information on a map screen displayed on the flexible display 1660 as a plurality of GUIs 1623 (eg, icons). For example, when it is determined that the shaking speed of the input device 1602 increases, the electronic device 1601 sets the plurality of GUIs 1623 based on a specified weight (eg, the number of searches and/or visits). At least some of the GUI can be displayed by changing the size.

17 illustrates an operation flowchart 1700 of an electronic device according to various embodiments of the present disclosure.

According to an embodiment, the electronic device (eg, the electronic device 101 of FIG. 1 ) may perform the operations of FIG. 17 . For example, the processor of the electronic device (eg, the processor 120 of FIG. 1 ) may be set to perform the operations of FIG. 17 when instructions stored in the memory (eg, the memory 130 of FIG. 1 ) are executed. .

In operation 1705, the electronic device may acquire motion information of the stylus pen in response to a first signal transmitted from the stylus pen (eg, the input device 302 of FIG. 3 ). For example, the first signal is when an external input is detected on a button (eg, button 410 of FIG. 4 ) included in the stylus pen, the stylus pen acquires movement information of the stylus pen using at least one sensor and may be referred to as a control signal generated to include the motion information. For example, the motion information of the stylus pen may include information related to the number of times of shaking of the stylus pen, a shaking speed, and/or a shaking direction of the stylus pen. For example, the at least one sensor may include an acceleration sensor, a piezo sensor, and/or a gyro sensor.

In operation 1710, the electronic device may display a user interface on the flexible display based on the motion information. For example, when the electronic device operates in the first form, the electronic device may display a first user interface including a plurality of icons (eg, reference numerals 551 to 556 of FIG. 5 ) on one area of the flexible display. can As another example, when the electronic device operates in the second form, the electronic device displays a second user interface including a plurality of thumbnails (eg, reference numerals 661 to 667 of FIG. 6 ) on one area of the flexible display. can do. As another example, when the electronic device operates in the third form, the electronic device displays a first user interface including a plurality of icons on a first display area of the flexible display and a plurality of thumbnails on a second display area It is possible to display a second user interface including For example, the electronic device may store data related to execution information of a plurality of applications in a memory (eg, the memory 130 of FIG. 1 ). The electronic device may generate a weight for each application based on the data, and display a user interface determined based on the weight.

In operation 1715, the electronic device may receive a touch input for an area of the user interface, and identify at least one application based on the touch input. For example, when a touch input for at least one of a plurality of icons and/or a plurality of thumbnails is detected, the electronic device may detect at least one icon and/or at least one thumbnail corresponding to the detected touch input. One application can be identified.

In operation 1720, the electronic device may receive a second signal from the stylus pen. For example, the second signal may be referred to as a control signal transmitted from the stylus pen when an external input to a button included in the stylus pen is no longer detected.

According to an embodiment, when the electronic device receives the second signal from the stylus pen (eg, operation 1720 - Yes), the electronic device may perform operation 1725 .

According to an embodiment, when the electronic device does not receive the second signal from the stylus pen (eg, operation 1720 - No), the electronic device may continue to perform operation 1710 .

In operation 1725, the electronic device may display an execution screen of at least one identified application on the flexible display. The electronic device may display execution screens having various structures on the flexible display. For example, the electronic device may store a correlation between a plurality of applications and the stylus pen in the memory. The electronic device may determine an area in which to display an execution screen of at least one application based on the correlation. For example, the electronic device may display an application having a relatively high correlation with the stylus pen on the first display area, and display an application having a relatively low correlation with the stylus pen on the second display area.

According to various embodiments of the present disclosure, an electronic device includes a flexible display, a wireless communication circuit, a processor, a stylus pen that is detachably inserted into at least one region inside the housing and communicates with the wireless communication circuit, and the processor operates It may include a memory that is operatively connected.

According to an embodiment, when the memory is executed, the processor receives a first signal including motion information of the stylus pen from the stylus pen, and operates in a first form based on the motion information A first user interface including a plurality of icons is displayed on the flexible display of the electronic device, and when a touch input to at least one of the plurality of icons is detected, the first user interface corresponds to the at least one icon in which the touch input is sensed identify at least one application to be executed, execute the identified at least one application in response to a second signal transmitted from the stylus pen, and display an execution screen of the executed at least one application on the flexible display may store one or more instructions.

According to an embodiment, when the one or more instructions are executed, the processor includes a plurality of thumbnails on the flexible display of the electronic device operating in a second form based on the motion information. a user interface is displayed, and when a touch input for at least one of the plurality of thumbnails is detected, at least one application corresponding to the at least one thumbnail for which the touch input is sensed is identified, and the stylus pen transmits the In response to the second signal, the identified at least one application may be executed, and an execution screen of the executed at least one application may be configured to be displayed on the flexible display.

According to an embodiment, when the one or more instructions are executed, the processor, based on the motion information, displays the plurality of displaying the first user interface including icons of , displaying a second user interface including a plurality of thumbnails in a second display area, and touching at least one of the plurality of icons or the plurality of thumbnails Identifies at least one application based on an input, executes the identified at least one application in response to the second signal transmitted from the stylus pen, and displays an execution screen of the at least one executed application in the flexible It can be set to be displayed on the display.

According to an embodiment, the memory further stores correlations of the plurality of applications with the stylus pen, and wherein the one or more instructions, when executed, cause the processor to: An area in which the execution screen of the at least one application is to be displayed may be determined and displayed as at least one of the first display area and the second display area based on the correlation.

According to an embodiment, when the processor detects a drag input to the execution screen of the one or more applications displayed on the first display area when the one or more instructions are executed, It may be set to display the execution screen by moving it to at least a part of the second display area.

According to an embodiment, the memory further stores data related to execution information of a plurality of applications, the plurality of icons include a first icon and a second icon, and the one or more instructions are the processor generates a weight based on the data associated with execution information of a first application corresponding to the first icon and a second application corresponding to the second icon, and the first determined based on the weight A user interface may be set to be displayed on the flexible display.

According to an embodiment, the processor executes the first application and the second application when a touch input for the first icon and the second icon is sensed when the one or more instructions are executed and display the first application execution screen and the second application execution screen determined based on the weight on the flexible display.

According to an embodiment, the motion information may include at least one of information related to a number of shaking of the stylus pen, a shaking speed, and a shaking direction.

According to an embodiment, when the one or more instructions are executed, the processor performs at least one of an area size, area arrangement, or display of the plurality of icons and the execution screen based on the motion information. may be set to be determined and displayed on the flexible display.

According to an embodiment, the first signal corresponds to a control signal transmitted from the stylus pen when an external input is sensed to a button included in the stylus pen, and the second signal is included in the stylus pen. When the external input to the button is no longer sensed, it may correspond to a control signal transmitted from the stylus pen.

According to various embodiments of the present disclosure, a method for an electronic device to display a user interface includes receiving a first signal including motion information of the stylus pen from a stylus pen, and based on the motion information, a first form displaying a first user interface including a plurality of icons on a flexible display of the electronic device operating as In response to an operation of identifying at least one application corresponding to the icon, and a second signal transmitted from the stylus pen, the identified at least one application is executed, and an execution screen of the executed at least one application is displayed. It may include an operation of displaying on the flexible display.

According to an embodiment, an operation of displaying a second user interface including a plurality of thumbnails on the flexible display of the electronic device operating in a second form based on the motion information, at least one of the plurality of thumbnails When a touch input to is detected, an operation of identifying at least one application corresponding to the at least one thumbnail in which the touch input is detected, and in response to the second signal transmitted from the stylus pen, the identified at least The method may further include executing one application and displaying an execution screen of the at least one executed application on the flexible display.

According to an embodiment, based on the motion information, the first user interface including the plurality of icons is displayed on a first display area of the flexible displays of the electronic device operating in a third form, and a second Displaying a second user interface including a plurality of thumbnails on a display area, identifying at least one application based on a touch input for at least one of the plurality of icons or the plurality of thumbnails, and the The method may further include executing the identified at least one application in response to the second signal transmitted from the stylus pen, and displaying an execution screen of the at least one executed application on the flexible display.

According to an embodiment, the operation of displaying the execution screen of the at least one executed application on the flexible display may include storing an area to display the execution screen of the at least one application identified based on the touch input in the memory. The method may further include determining and displaying at least one of the first display area and the second display area based on the correlation.

According to an embodiment, in the method for displaying a user interface by an electronic device, when a drag input to an execution screen of the at least one application displayed on the first display area is detected, the execution screen is displayed as the The method further includes moving and displaying at least a part of the second display area.

According to an embodiment, the plurality of icons include a first icon and a second icon, and the operation of displaying a first user interface including the plurality of icons on the flexible display may include: generating a weight based on the data associated with the execution information of a first application and a second application corresponding to the second icon, and displaying the first user interface determined based on the weight on the flexible display may further include.

According to an embodiment, in the method of displaying a user interface by an electronic device, when a touch input to the first icon and the second icon is sensed, the operation of executing the first application and the second application and the weight The method may further include displaying, on the flexible display, the first application execution screen and the second application execution screen determined based on .

According to an embodiment, in the method of displaying a user interface by the electronic device, the flexible by determining at least one of a size, an area arrangement, or whether to display the plurality of icons and the execution screen based on the motion information. An operation of displaying on a display may be further included.

Claims (20)

In an electronic device,
flexible display;
wireless communication circuitry;
processor;
a stylus pen detachably inserted into at least one area inside the housing and communicating with the wireless communication circuit; and
a memory operatively coupled to the processor; including,
The memory, when executed, the processor
Receiving a first signal including movement information of the stylus pen from the stylus pen,
displaying a first user interface including a plurality of icons on the flexible display of the electronic device operating in a first form based on the motion information;
When a touch input to at least one of the plurality of icons is detected, at least one application corresponding to the at least one icon in which the touch input is sensed is identified;
In response to the second signal transmitted from the stylus pen, one or more instructions to execute the identified at least one application and display an execution screen of the executed at least one application on the flexible display to store, electronic devices.
The method according to claim 1,
The one or more instructions, when executed, cause the processor to:
displaying a second user interface including a plurality of thumbnails on the flexible display of the electronic device operating in a second form based on the motion information;
When a touch input to at least one of the plurality of thumbnails is detected, at least one application corresponding to the at least one thumbnail in which the touch input is sensed is identified;
The electronic device is configured to execute the identified at least one application in response to the second signal transmitted from the stylus pen, and display an execution screen of the executed at least one application on the flexible display.
The method according to claim 1,
The one or more instructions, when executed, cause the processor to:
Based on the motion information, the first user interface including the plurality of icons is displayed on a first display area among the flexible displays of the electronic device operating in a third form, and a plurality of thumbnails are displayed on a second display area. Display a second user interface comprising
identify at least one application based on a touch input for at least one of the plurality of icons or the plurality of thumbnails;
The electronic device is configured to execute the identified at least one application in response to the second signal transmitted from the stylus pen, and display an execution screen of the executed at least one application on the flexible display.
4. The method according to claim 3,
The memory further stores the correlation with the stylus pen of the plurality of applications,
The one or more instructions, when executed, cause the processor to:
The electronic device is configured to determine and display an area in which the execution screen of the at least one application identified based on the touch input is displayed as at least one of the first display area and the second display area based on the correlation.
4. The method according to claim 3,
The one or more instructions, when executed, cause the processor to:
The electronic device is configured to move and display the execution screen to at least a part of the second display area when a drag input is detected on the execution screen of the at least one application being displayed on the first display area.
The method according to claim 1,
The memory further stores data related to execution information of a plurality of applications,
The plurality of icons includes a first icon and a second icon,
The one or more instructions, when executed, cause the processor to:
generating a weight based on the data associated with execution information of a first application corresponding to the first icon and a second application corresponding to the second icon;
The electronic device is configured to display the first user interface determined based on the weight on the flexible display.
7. The method of claim 6,
The one or more instructions, when executed, cause the processor to:
When a touch input to the first icon and the second icon is detected, the first application and the second application are executed;
The electronic device is configured to display the first application execution screen and the second application execution screen determined based on the weight on the flexible display.
The method according to claim 1,
The motion information includes at least one of information related to a number of shaking of the stylus pen, a shaking speed, and a shaking direction.
9. The method of claim 8,
The one or more instructions, when executed, cause the processor to:
The electronic device is configured to determine at least one of a size, a region arrangement, or whether to display the plurality of icons and the execution screen on the basis of the motion information and display the determined on the flexible display.
The method according to claim 1,
The first signal corresponds to a control signal transmitted from the stylus pen when an external input is sensed to a button included in the stylus pen,
The second signal corresponds to a control signal transmitted from the stylus pen when the external input to the button included in the stylus pen is no longer sensed.
A method for an electronic device to display a user interface, comprising:
receiving a first signal including motion information of the stylus pen from the stylus pen;
displaying a first user interface including a plurality of icons on a flexible display of the electronic device operating in a first form based on the motion information;
identifying at least one application corresponding to the at least one icon in which the touch input is sensed when a touch input to at least one of the plurality of icons is detected; and
executing the identified at least one application in response to a second signal transmitted from the stylus pen, and displaying an execution screen of the executed at least one application on the flexible display; A method comprising
12. The method of claim 11,
displaying a second user interface including a plurality of thumbnails on the flexible display of the electronic device operating in a second form based on the motion information;
identifying at least one application corresponding to the at least one thumbnail in which the touch input is sensed when a touch input to at least one of the plurality of thumbnails is detected; and
executing the identified at least one application in response to the second signal transmitted from the stylus pen, and displaying an execution screen of the executed at least one application on the flexible display; A method further comprising:
12. The method of claim 11,
Based on the motion information, the first user interface including the plurality of icons is displayed on a first display area among the flexible displays of the electronic device operating in a third form, and a plurality of thumbnails are displayed on a second display area. displaying a second user interface including
identifying at least one application based on a touch input to at least one of the plurality of icons or the plurality of thumbnails; and
executing the identified at least one application in response to the second signal transmitted from the stylus pen, and displaying an execution screen of the executed at least one application on the flexible display; A method further comprising:
14. The method of claim 13,
The operation of displaying the execution screen of the at least one executed application on the flexible display includes:
determining and displaying an area to display the execution screen of the at least one application identified based on the touch input as at least one of the first display area and the second display area based on a correlation stored in a memory; A method further comprising:
14. The method of claim 13,
A method for the electronic device to display a user interface,
when a drag input to the execution screen of the at least one application displayed on the first display area is sensed, moving the execution screen to at least a part of the second display area to display; A method further comprising:
12. The method of claim 11,
The plurality of icons includes a first icon and a second icon,
The operation of displaying the first user interface including the plurality of icons on the flexible display may include:
generating a weight based on the data associated with execution information of a first application corresponding to the first icon and a second application corresponding to the second icon; and
displaying the first user interface determined based on the weight on the flexible display; A method further comprising:
17. The method of claim 16,
A method for the electronic device to display a user interface,
executing the first application and the second application when a touch input to the first icon and the second icon is sensed; and
displaying the first application execution screen and the second application execution screen determined based on the weight on the flexible display; A method further comprising:
12. The method of claim 11,
The motion information includes at least one of information related to a number of shaking (shaking) of the stylus pen, a shaking speed, and a shaking direction.
19. The method of claim 18,
A method for the electronic device to display a user interface,
determining at least one of an area size, area arrangement, and display status of the plurality of icons and the execution screen based on the motion information and displaying the determined on the flexible display; A method further comprising:
12. The method of claim 11,
The first signal corresponds to a control signal transmitted from the stylus pen when an external input is sensed to a button included in the stylus pen,
The second signal corresponds to a control signal transmitted from the stylus pen when the external input to the button included in the stylus pen is no longer sensed.

Images