WO2023008703A1

WO2023008703A1 - Electronic device, and method for providing panel for controlling application in electronic device

Info

Publication number: WO2023008703A1
Application number: PCT/KR2022/006705
Authority: WO
Inventors: 정진교; 장은아; 나민욱
Original assignee: 삼성전자 주식회사
Priority date: 2021-07-30
Filing date: 2022-05-11
Publication date: 2023-02-02
Also published as: KR20230018684A

Abstract

An electronic device may comprise: a hinge for foldably connecting one side of a first housing to one side of a second housing; a display comprising a first display area, which is disposed on the first housing, and a second display area and a third display area which are disposed on the second housing; and at least one processor. The at least one processor is formed to: in a first state in which the hinge is unfolded, display a first application in the first display area and the second display area and display at least one default button in the third display area; and, in a second state in which the hinge is folded, display panel buttons in the third display area by controlling the display, and, on the basis of which a panel button is selected in the second state, display the first application in the first display area by controlling the display and display, in the second display area, a first panel comprising at least one control button and at least one system button.

Description

An electronic device and a method for providing a panel for controlling an application in the electronic device

The present disclosure relates to an electronic device and a method of providing a panel for controlling an application in the electronic device.

Various services and additional functions provided through electronic devices, for example, portable electronic devices such as smart phones, are gradually increasing. In order to increase the utility value of these electronic devices and satisfy the needs of various users, communication service providers or electronic device manufacturers are competitively developing electronic devices to provide various functions and to differentiate themselves from other companies. Accordingly, various functions provided through electronic devices are becoming increasingly sophisticated.

In addition, considering the portability of the electronic device, the display (or the electronic device equipped with the display) may be mounted on the electronic device in a foldable or bendable or rollable form.

In an electronic device including a foldable or bendable display, when the electronic device is changed to a folded state while displaying an application execution in an unfolded state, the execution screen of the application is displayed distorted. Otherwise, an optimal control button for controlling the application may not be properly provided according to the type of the application being executed.

According to various embodiments, an electronic device and a method of providing a panel for controlling an application in the electronic device are provided.

An electronic device according to an aspect of the present disclosure includes a first housing, a second housing, a hinge that foldably connects one side of the first housing to one side of the second housing, a first display area provided in the first housing, and a display including a second display area and a third display area provided on the second housing, and at least one processor, wherein the processor is in a first state in which the hinge is unfolded. Based on the above, the display is controlled to display the execution screen of the first application on the first display area and the second display area, and at least one default button for controlling the electronic device is provided on the third display area. a panel button for displaying a panel in the third display area by controlling the display in the second state based on a state of the electronic device that is changed from the first state to a second state in which the hinge is folded; is added and displayed, based on the selection of the panel button in the second state, the display is controlled to display the execution screen of the first application in the first display area, and the execution screen of the first application is displayed in the second display area. A first panel including at least one control button for controlling one application and at least one system button for controlling a system of the electronic device may be set to be displayed.

According to an aspect of the present disclosure, a method for providing a panel for controlling an application in an electronic device includes, based on a state of the electronic device in a first state in which a hinge is unfolded, the hinge is provided with a first display area. One side of one housing is configured to be foldably connected to one side of a second housing provided with a second display area and a third display area, and an execution screen of a first application is displayed on the first display area and the second display area. and displaying at least one default button for controlling the electronic device on the third display area, based on the state of the electronic device changed from the first state to a second state in which the hinge is folded, the An operation of displaying a panel button for displaying a panel on the third display area in the second state, and displaying an execution screen of the first application on the first display area based on selection of the panel button in the second state. and displaying a first panel including at least one control button for controlling the first application and at least one system button for controlling a system of the electronic device on the second display area. can

An electronic device according to an aspect of the present disclosure includes a first housing, a second housing, a hinge that foldably connects one side of the first housing to one side of the second housing, a folded state of the electronic device, and the electronic device a display including at least one sensor for detecting a posture, a first display area provided on the first housing, and a second display area provided on the second housing, and a processor, the processor configured to: An execution screen of an application is displayed on the first display area and the second display area based on the detection that the hinge is in an unfolded state, and based on sensor information received from the at least one sensor, the Based on the fact that the hinge is changed from an unfolded state to a folded state, and the attitude of the electronic device detects that the first display area is provided above the second display area, the display is controlled to control the first display area. An execution screen of the application is displayed on the display area, and a panel including at least one control button for controlling the application and at least one system button for controlling the system of the electronic device is displayed on the second display area. can be set to

According to various embodiments, an optimal control button capable of controlling an application running in a folded state of an electronic device and a system button capable of controlling a system of the electronic device are provided, thereby providing an optimal user experience. It works.

The foregoing and other aspects, features, and advantages of specific embodiments of the present disclosure may become more apparent in the following detailed description taken in conjunction with the accompanying drawings.

1 is a block diagram of an electronic device in a network environment according to various embodiments;

2a, 2b, and 2c are diagrams for describing a display of an electronic device according to various embodiments;

3 is a block diagram of an electronic device according to various embodiments;

4 is a diagram for explaining an operation of displaying a panel button in a third display area in an electronic device according to various embodiments;

5A, 5B, and 5C are diagrams for explaining a configuration of a panel displayed on a second display area in an electronic device according to various embodiments;

6A and 6B are diagrams for explaining types of panels displayed on a second display area in an electronic device according to various embodiments;

7A, 7B, 7C, 7D, 7E, and 7F are diagrams for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

8A, 8B, 8C, and 8D are diagrams for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

9A, 9B, 9C, and 9D are diagrams for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

10A, 10B, 10C, and 10D are diagrams for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

11A, 11B, 11C, 11D, 11E, 11F, and 11G are views for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure; are;

12a, 12b, 12c, and 12d are diagrams for explaining an operation of adding an operation button to a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

13A, 13B, and 13C are diagrams for explaining an operation of adding an operation button to a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

14A and 14B are diagrams for explaining an operation of providing a panel according to rotation of an electronic device according to various embodiments of the present disclosure;

15A and 15B are views for explaining an operation of providing a panel according to rotation of the electronic device in an electronic device according to various embodiments of the present disclosure;

16A, 16B, and 16C are diagrams for explaining an operation of providing a panel according to a mounting state of an electronic device according to various embodiments;

17a, 17b, 17c, 17d, 17e, and 17f are diagrams for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments;

18a, 18b, 18c, 18d, 18e, 18f, 18g, and 18h describe an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments. are drawings for;

19a, 19b, 19c, 19d, 19e, 19f, 19g, 19h, 19i, and 19j illustrate selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure. These are drawings for explaining the operation of providing a panel based on;

20a, 20b, 20c, 20d, 20e, and 20f are diagrams for describing an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure; are drawings;

21a, 21b, 21c, 21d, 21e, 21f, 21g, 21h, and 21i show a panel based on selection of a panel button in a second state of the electronic device according to various embodiments. These are drawings for explaining the operation of providing;

22a, 22b, 22c, and 22d are diagrams for explaining an operation of providing a panel based on selection of a panel button in a second state of the electronic device according to various embodiments;

23 is a flowchart illustrating an operation of providing a panel displayed on a second display area in an electronic device according to various embodiments of the present disclosure; and

24 is a flowchart illustrating an operation of providing a panel displayed on a second display area in an electronic device according to various embodiments.

1 is a block diagram 100 of an electronic device 101 within a network environment 100, in accordance with various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external

electronic devices

102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2A, 2B, and 2C are diagrams 200a to 200c for describing a display of an electronic device according to various embodiments.

The display 260 of the electronic device 201 shown in FIGS. 2A to 2C is a flexible display in which an area of the display is divided according to folding of a hinge capable of connecting two housings on which the display is placed. ) may be included. In the flexible display, when an electronic device includes an in-foldable hinge capable of connecting two housings, the display in an unfolded state is folded inward according to the folding of the in-foldable hinge, thereby extending the area of the display. this can be distinguished. In the case of the flexible display, when an electronic device includes an out-foldable hinge capable of connecting two housings, the display in an unfolded state is folded outward according to the folding of the out-foldable hinge, thereby forming the display area can be distinguished. The electronic device may include one hinge (eg, a hinge capable of in-folding or a hinge capable of out-folding) or a plurality of hinges (eg, a hinge capable of in-folding and a hinge capable of out-folding).

2A to 2C describe the operation of the electronic device 201 including a hinge capable of in-folding as an example, but the same can be applied to an electronic device including a hinge capable of out-folding. 2a is a diagram illustrating a first state in which the electronic device 201 is unfolded according to various embodiments. The electronic device 201 includes a first display area 261 disposed in a first housing 271, and a display 260 including a second display area 263 and a third display area 265 disposed on the second housing 273 . Also, according to an embodiment, the second display area 263 corresponds to a display area corresponding to the second housing 273, and the third display area 265 is an area included in the second display area 263. can be For example, a panel including at least one control button and at least one system button capable of controlling a system of the electronic device may be displayed on the second display area 263, and at least a portion of the panel may be displayed on the third display area 263. It may also be displayed on the display area 265 . Also, according to an embodiment, the third display area 265 is not displayed when there is no user input for a certain period of time, and the display area corresponding to the second housing 273 is entirely displayed as the second display area 263. It may be displayed in the second display area 263 according to the user's input or the state of the electronic device. The electronic device 201 may include a hinge 281 capable of connecting one side of the first housing 271 to one side of the second housing 273 in a foldable manner. The electronic device 201 may change the position of the first display area 261 at a predetermined angle according to the folding of the hinge 281 .

As shown in FIG. 2A , for example, the electronic device 201 uses the first display area 261 and the second display area 263 as one screen in the unfolded first state and displays the first display area 261 and the second display area 263 as one screen. An execution screen of an application may be displayed, and at least one default button for controlling the electronic device may be displayed on the third display area 265. For example, a recent app may be displayed on the third display area 265. A navigation bar including a button, a home button, and a previous button may be displayed. In an embodiment, the previous button may be, for example, a previous button.

2B is a diagram illustrating a second state in which the electronic device 201 is folded according to various embodiments, and the electronic device 201 has a first display area 261 and a second display area 263 An execution screen of a first application is displayed while being used as one screen, and a panel button for panel display along with at least one default button for controlling the electronic device is additionally displayed on the third display area 265. can In embodiments, the at least one default button may be at least one default button that may include, for example, a recent app button, a home button, and a previous and/or cancel button. The electronic device 201 is a sensor module of the electronic device 201, for example, a sensor received from at least one of an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, or a motion sensor. When the unfolding of the electronic device 201 is detected in the second state as shown in FIG. 2B using the information, the electronic device 201 may be changed to the first state as shown in FIG. 2A.

2C is a diagram showing a panel after the electronic device 201 is folded according to various embodiments, and the electronic device 201 displays a panel button 265b displayed on the third display area 265 in the second state. ) is confirmed, the first display area 261 and the second display area 263 are divided into separate screens, and the execution screen of the first application is displayed on the first display area 261. and a first panel 270 including at least one control button capable of controlling the first application and at least one system button capable of controlling a system of the electronic device on the second display area 263 may be displayed, or a second panel including at least one common button commonly used for all applications and at least one system button capable of controlling the system of the electronic device may be displayed. In embodiments, all applications may mean a plurality of applications installed in the electronic device. In embodiments, detecting the selection may include, for example, confirming or determining the selection by confirming that a selection has occurred or determining that a user input for a selection has been made or received. While the electronic device 201 displays a panel (eg, the first panel 270) on the second display area 263 as shown in FIG. 2C, the panel button displayed on the third display area 265 When the selection of 265b is confirmed, the state may be changed to the second state as shown in FIG. 2B. When the electronic device 201 detects unfolding of the electronic device 201 while displaying a panel on the second display area 263 as shown in FIG. 2C, the electronic device 201 returns to the first state as shown in FIG. 2A. can be changed.

According to various embodiments, the electronic device 201 does not go through the second state as shown in FIG. 2b according to the folding or mounting of the electronic device 201 or the posture of the electronic device 201 in the first state as shown in FIG. 2A. As shown in 2c, the electronic device 201 may be folded and display the panel on the second display area 263. In some examples, the posture may be related to, for example, a position or manner in which the electronic device is mounted. For example, the electronic device 201 uses at least one sensor included in a sensor module of the electronic device, for example, at least one of an angle sensor, a tilt sensor, an acceleration sensor, etc. The folded state of can be detected. For example, the electronic device 201 uses at least one sensor included in a sensor module of the electronic device, for example, at least one of an angle sensor, a tilt sensor, an acceleration sensor, etc. position can be detected.

According to an embodiment, when the electronic device 201 detects a change from an unfolded state to a folded state and a posture of the electronic device, the first display area 261 as shown in FIG. 2C It can be determined that the second display area 263 is located above the second display area 263 and the second display area 263 is located below the first display area 261 . At this time, when the electronic device 201 confirms the selection of the panel button in the second state as shown in FIG. 2B, the screens corresponding to the selection of the panel button are displayed in the first display area 261 and It can be controlled to be displayed on the second display area 263 . For example, the electronic device 201 displays the first application on the first display area 261 located on the top of the second display 263, which is a position that is easy for the user to view, and allows the user to easily manipulate it. A panel (eg, at least one control button capable of controlling the first application and a control button capable of controlling the system of the electronic device) is provided on the second display area 263 located at the lower end of the first display 261, which is the location. A panel including at least one system button) may be displayed.

3 is a block diagram 300 of an electronic device according to various embodiments.

Referring to FIG. 3, the electronic device 301 corresponding to the electronic device 101 of FIG. 1 and/or the electronic device 201 of FIGS. 2A to 2C includes a processor 320, a memory 330, It may include a display 360 , a sensor module 376 , and a communication module 390 .

According to various embodiments, the processor 320 may display the first display area 361 and the first display area 361 in a first state in which the electronic device 301 is unfolded (eg, the first state of the electronic device 201 of FIG. 2A ). 2 A second state in which the electronic device 301 is folded while the first application displays an execution screen using the display area 363 as one screen (eg, the second state of the electronic device 201 of FIG. 2B ) ), a panel button for displaying a panel is additionally displayed on the third display area 365, and when selection of the panel button is confirmed in the second state, the first display area 361 displays the first panel button. An execution screen of an application may be displayed, and a panel including a plurality of buttons for controlling the first application and the electronic device may be displayed on the second display area 363 .

According to an embodiment, the processor 320 controls the display 360 in a first state in which the electronic device 301 is unfolded (eg, the first state of the electronic device 201 of FIG. 2A ). The first application displays an execution screen by using the first display area 361 and the second display area 363 as one screen, and at least one screen for controlling the electronic device is displayed on the third display area 365. A default button may be displayed, and for example, a navigation bar including a recent app button, a home button, and a previous (cancel) button may be displayed on the third display area 365 .

According to an embodiment, the processor 320 receives sensor information from the sensor module 376 (eg, at least one of an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, and a motion sensor). When the electronic device 301 detects a change from the first state to the second folded state (eg, the second state of the electronic device 201 of FIG. 2B), the display 360 is controlled by using A first application displays an execution screen by using the first display area 361 and the second display area 363 as one screen, and a panel button for displaying a panel on the third display area 365 ( Example: The panel button 265b of FIG. 2B) may be additionally displayed.

According to one embodiment, when the processor 320 creates the panel button as a floating button and displays it on the third display area 365, the processor 320 displays the floating button on the third display area 365. At least one default button for controlling the electronic device (eg, at least one default button 265a in FIG. 2B) is moved to the left side, and the panel button is created and displayed on the right side. At this time, the at least one default button ( Example: recent apps button, home button, and previous button) and the panel buttons may be evenly spaced.

According to one embodiment, when the processor 320 confirms selection of the panel button in the third display area 365 in the second state (eg, the second state of FIG. 2B ) of the electronic device, At least one control capable of displaying an execution screen of the first application on the first display area 361 by controlling the display 360 and controlling the first application on the second display area 363 A first panel including buttons and at least one system button capable of controlling a system of the electronic device may be displayed.

According to one embodiment, when displaying a floating first panel on the second display area 363, the processor 320 divides the first panel into a first area and a second area, and the display Control 360 to display at least one control button capable of controlling the first application in the first area, and control the display 360 to control the system of the electronic device in the second area. At least one system button that can be displayed.

According to one embodiment, the processor 320 controls the display 360 to dispose a first area displaying at least one control button capable of controlling the first application on an upper side of the first panel, , A second area displaying at least one system button capable of controlling the system of the electronic device may be disposed and displayed below the first panel.

According to one embodiment, the processor 320 controls the display 360 to dispose a second region above the first panel to display at least one system button capable of controlling the system of the electronic device. And, a first area displaying at least one control button capable of controlling the first application may be disposed and displayed below the first panel.

According to one embodiment, the processor 320 divides a second display area displaying at least one system button capable of controlling the system of the electronic device into a first sub area and a second sub area, and the display 360 to dispose a first sub-region displaying at least one system button capable of controlling the system of the electronic device on the upper side of the first panel, and disposing the first sub-region on the lower side of the first sub-region. A first area displaying at least one control button capable of controlling an application is disposed, and a second sub area displaying at least one system button capable of controlling the system of the electronic device below the first area. can be displayed by placing

According to one embodiment, when the electronic device 301 confirms selection of the panel button in the second state (eg, the second state of the electronic device 201 of FIG. 2B), the processor 320 executes If the type of the running first application is identified and the first application is identified as the type of application for displaying the first panel, at least one control button capable of controlling the first application is determined, and the display ( 360) to display the determined at least one control button on the first area of the first panel. Based on the type of the application, the processor 320 determines whether the application is an application for displaying a first panel including at least one control button capable of controlling the application, or is commonly used for all or a plurality of applications. It can be checked whether the application is for displaying the second panel including at least one common button that can be used. The type of application for displaying the first panel and the type of application for displaying the second panel may be stored in the memory 330 .

For example, if the processor 320 determines that the type of the first application is a video application and the video application is a type of application for displaying the first panel, the processor 320 controls the display 360 to A first panel (eg, a video panel) including a previous video play button, a play/pause button, and a next video play button capable of controlling the video application may be displayed in the first area.

According to one embodiment, when the processor 320 detects selection of a button for displaying a next panel included in the first panel while displaying the first panel, the processor 320 controls the display 360 to display the first panel. 2 A second panel including at least one common button that can be commonly used in all applications without displaying the first panel on the display area 363 and at least one system button that can control the system of the electronic device. can be displayed. For example, at least one common button that can be used in common for all or a plurality of applications includes an application list view button, a screen up button, a notification button, a screen shot button, and Can contain cursor buttons.

According to one embodiment, the processor 320, when the electronic device confirms selection of the panel button in the second state (eg, the second state of the electronic device 201 of FIG. 2B), the first If the type of application is identified and the first application is identified as the type of application for displaying the second panel, the display 360 is controlled to be commonly used by all or a plurality of applications in the second display area. A second panel including at least one common button capable of controlling a system of the electronic device and at least one system button capable of controlling a system of the electronic device may be displayed.

According to an embodiment, the processor 320 divides the second panel into a first area and a second area in the same way as the first panel, and controls the display 360 to display all areas in the first area. Alternatively, at least one common button commonly used in a plurality of applications may be displayed, and at least one system button capable of controlling a system of the electronic device may be displayed in the second area.

According to an embodiment, the processor 320 divides the first panel into a first area, a second area, and a third area according to the display setting of the first panel, and controls the display 360 to display the At least one control button capable of controlling the first application is displayed on a first area, at least one common button commonly used for all or a plurality of applications is displayed on the second area, and the second area is displayed. At least one system button capable of controlling the system of the electronic device may be displayed in area 3.

According to one embodiment, when displaying the first panel on the second display area 363, the processor 320 controls the display 360 to set or select the second area of the first panel. At least one system button capable of controlling the system of the electronic device (eg, a brightness control button and a volume control button of a display) may be displayed.

According to one embodiment, the processor 320, based on the state information of the first application or the type of an external electronic device connected to the electronic device, at least one capable of controlling an operation related to the first application. An operation button may be determined, and the at least one operation button may be displayed along with the at least one system button in a second area of the first panel by controlling the display 360 . For example, when the first application displayed on the first display area is a video application and currently playing a video, the processor 320 controls the display 360 to display the second area of the first panel. Along with the at least one system button, an eye comfort button may be additionally displayed as at least one operation button. For example, while the processor 320 controls the display 360 to display the execution screen of the first application displayed on the first display area, the earbuds of the electronic device 301 are connected via Bluetooth communication. When connected, the display 360 is controlled to additionally display a Bluetooth function button capable of controlling Bluetooth communication with at least one operation button along with the at least one system button in the second region of the first panel. can

According to various embodiments, the processor 320 controls the display 360 to display the first application on the first display area 361 based on selection of a panel button in the second state of the electronic device 301 . While the execution screen is displayed and the first or second panel is displayed on the second display area 363, the display 360 is controlled according to the rotation of the electronic device to display the display position and size of the first panel. can be displayed by adjusting

According to an embodiment, while the processor 320 controls the display 360 to display a first panel or a second panel on the second display area 363, the sensor module 376 (eg : When rotation of the electronic device is detected using sensor information received from an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, or a motion sensor, rotation information (eg, rotation value) , The display position and size of the first panel or the second panel may be adjusted and displayed based on the position of the third display area and size information of the second display area that changes according to the rotation of the electronic device.

For example, in a second state in which the electronic device 301 is folded in a portrait mode, the processor 320 controls the display 360 based on selection of the panel button to display the second state. If -90 degree rotation of the electronic device is detected while the first panel is displayed on the display area 363, rotation information (eg -90 degree rotation), position of the third display area (eg right end area) The display position and size of the first panel may be adjusted and displayed based on size information of the second display area that changes according to rotation of the electronic device. In embodiments, -90 degree rotation may correspond to rotation from a vertical direction to a horizontal direction, for example.

According to an embodiment, when the processor 320 detects rotation of the electronic device while controlling the display 360 to display a first panel or a second panel on the second display area 363, Display of the first panel or the second panel based on at least one of rotation information of the electronic device, a mounting state of the electronic device according to a rotation result of the electronic device, or panel display setting information for a right-handed or left-handed user It can be displayed by adjusting the position and size.

According to various embodiments, the processor 320 controls the display 360 based on selection of a panel button in the second state (eg, the second state of the electronic device 201 of FIG. 2B ) to display the first display area While displaying the execution screen of the first application in 361 and displaying the first panel or the second panel in the second display area 363, based on the type of gesture detected in the second display area, the first A function of moving the first panel or the second panel or hiding the first panel or the second panel may be performed.

According to an embodiment, the processor 320 performs a first gesture operation on the first panel or the second panel displayed in a floating form on the second display area 363, for example, the first panel Alternatively, when a drag operation is detected after a long touch on the second panel, the display 360 may be controlled to move the first panel or the second panel in a direction corresponding to the drag operation and display the display. When the processor 320 moves the first panel or the second panel in the direction corresponding to the drag operation according to the first gesture operation and the processor 320 moves out of the critical area (eg, the second display area), the display 360 can be controlled to display a visual warning.

According to an embodiment, the processor 320 performs a second gesture operation on the first panel or the second panel displayed in a floating form on the second display area 363, for example, the first panel Alternatively, if a flick operation is detected in the left bezel direction or the right bezel direction of the second display area 363 after touching the second panel, a function of hiding the first panel or the second panel is performed. can be performed The processor 320 may perform the third gesture operation, for example, after touching the left bezel or the right bezel of the second display area 363 while hiding the first panel or the second panel. When a flick operation toward the center of the second display area 363 is detected, the display 360 is controlled to display the hidden first panel or the second panel on the second display area 363 again. can

According to an embodiment, the processor 320 may display the first panel or the second panel on the second display area 363 while the electronic device 301 displays the third display area 365. When the second state (eg, the second state of the electronic device 201 of FIG. 2B ) is changed by selection of the displayed panel button, the first panel or the second panel displayed on the second display area 363 is displayed. Last location information can be saved. The processor 320, when the electronic device 301 confirms the selection of the panel button displayed on the third display area 365 in the second state, the previously stored first panel or the second Based on the last location information of the panel, the display 360 may be controlled to display the first panel or the second panel in the second display area 363 .

According to various embodiments, the processor 320 controls the display 360 to display an execution screen of the first application on the first display area 361 based on selection of a panel button in the second state of the electronic device. and while displaying the execution screen of the second application on the second display area 363, if the selection of the second application is confirmed, the display 360 is controlled to display the second application on the first display area 361. 2 Displays an execution screen of an application, and displays a panel (eg, a first panel or a second panel) including a plurality of buttons for controlling the second application and the electronic device on the second display area 363 can do.

According to an embodiment, the processor 320 controls the display 360 to display the execution screen of the first application on the first display area 361 and displays the second panel on the second display area 363. While displaying, the display 360 is controlled based on detection of selection of an application list providing button among at least one common button commonly used for all or a plurality of applications included in the second panel. Accordingly, types of a plurality of applications may be displayed on the second display area 363 . While the processor 320 controls the display 360 to display the execution screen of the first application on the first display area 361, the processor 320 displays one of the plurality of applications on the second display area 363. The selected second application may be displayed. The processor 320 controls the display 360 to display an execution screen of a first application on the first display area 361 and an execution screen of a second application on the second display area 363. While running, the display 360 is controlled to execute the second application on the first display area 361 based on detection of selection of the second application being displayed on the second display area 363. A screen may be displayed, and a panel (eg, a first panel or a second panel) including a plurality of buttons for controlling the second application and the electronic device may be displayed on the second display area 363 .

According to various embodiments, the processor 320 controls the display 360 to display an execution screen of the first application on the first display area 361 based on selection of a panel button in the second state of the electronic device. may be displayed, and a touch pad panel or cursor function panel capable of controlling the first application may be provided on the second display area 363 .

According to an embodiment, the processor 320 controls the display 360 to display an execution screen of a first application on the first display area 361, and the second While displaying the second panel on the display area 363, selecting a touch pad button for providing a touch pad among at least one common button commonly used for all or a plurality of applications included in the second panel. Based on the detection of the first application, a touch pad panel capable of controlling the first application may be provided in the second display area. The processor 320 determines the types of various gestures (eg, short touch, long touch, double touch, multi-touch, pinch zoom in/out, multi-touch) detected by the touch pad panel provided on the second display area 363. various functions for controlling the screen of the first application may be performed using a control icon displayed on the first display area 361 based on a touch and then a drag). A function of enlarging/reducing the screen of the application and a function of moving the screen of the first application may be performed.

According to an embodiment, the processor 320 controls the display 360 to display an execution screen of a first application on the first display area 361, and the second While displaying the second panel on the display area 363, information regarding selection of a cursor button for providing a cursor function among at least one common button commonly used for all or a plurality of applications included in the second panel If detection is confirmed, the display 360 is controlled to display a cursor icon on the first display area 361, and a cursor function panel capable of controlling the first application is displayed on the second display area 363. can provide The processor 320, based on the types of various gestures (eg, short touch, long touch, and double touch) detected by the cursor function panel provided on the second display area 363, the first display area Various functions for controlling the first application displayed on the first display area 361 may be performed while moving and controlling the cursor icon displayed in 361 . The processor 320 may move the screen of the first application displayed on the first display area 361 using page up/down buttons provided on the cursor function panel.

According to various embodiments, the memory 330 may be implemented substantially the same as or similar to the memory 130 of FIG. 1 .

According to various embodiments, the display 360, which may correspond to the display 260 of FIGS. 2A to 2C, may correspond to the first display area 261 of FIGS. 2A to 2C. 361, the second display area 363 that may correspond to the second display area 263 of FIGS. 2A to 2C and the third display area 265 of FIGS. 2A to 2C A display area 365 may be included. The position of the first display area 361 may be changed at a predetermined angle according to folding of a hinge (eg, the hinge 281 of FIG. 2A ).

According to an embodiment, the display 360 may be the same as the display module 160 of FIG. 1 , or may perform at least one function or operation performed by the display module 160 .

According to various embodiments, the sensor module 376 may be implemented substantially the same as or similar to the sensor module 176 of FIG. 1 .

According to an embodiment, the sensor module 376 may be configured to perform an unfolding state of the electronic device (eg, a first state), a folding state of the electronic device (eg, a second state), a posture state (or a standing state) of the electronic device. ), and various sensors capable of detecting the rotation state of the electronic device.

According to an embodiment, the sensor module 376 may include an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, a motion sensor, a gravity sensor, and a proximity sensor. For example, the sensor module 376 uses sensor information received from at least one of an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, and a motion sensor to determine an unfolded state of the electronic device ( Example: a first state), a folding state (eg, a second state) of the electronic device, a posture state (or mounting state) of the electronic device, and a rotation state of the electronic device may be detected.

According to various embodiments, the communication module 390 may be implemented substantially the same as or similar to the communication module 190 of FIG. 1 and may include a plurality of communication circuits using different communication technologies.

According to an embodiment, the communication module 390 may include at least one of a wireless LAN module and a short-range communication module, and the short-range communication module includes an ultra wide band (UWB) communication module, a Wi-Fi communication module, and NFC. A communication module, a Bluetooth legacy communication module, and/or a BLE communication module may be included.

4 is a diagram 400 for explaining an operation of displaying a panel button in a third display area in an electronic device according to various embodiments.

Referring to FIG. 4, the electronic device (eg, the electronic device of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 310 of FIG. 3) is in an unfolded first state. (Example: In the first state of the electronic device 201 of FIG. 2A), the third display area 465 as shown in FIG. 4(a) (Example: the third display area 265 of FIGS. 2A to 2C) At least one default button 465a for controlling the electronic device (eg, at least one default button 265a of FIG. 2A ) may be displayed.

The electronic device uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3 ) of the electronic device to enter a second state (eg, the electronic device is folded) from the first state of the electronic device. When a change to the second state of the electronic device of FIG. 2B) is detected, the panel button is created as a floating button, and as shown in FIG. At least one default button 465a for controlling the electronic device (eg, at least one default button 265a of FIG. 2B) is moved to the right, and the panel button 465b (eg, the panel of FIG. 2B) is moved to the left. A button 265b is displayed, and at this time, a distance between the panel button 465b and the at least one default button 465a may be equally adjusted.

According to an embodiment, the position or display method of the panel button and at least one default button in the third display area 465 may be variously modified, and may be designated as a preset position or display method as an initial setting of the electronic device. can In addition, the position or display method of the panel button and at least one default button in the third display area 465 may be changed and set by the user of the electronic device.

The electronic device may use sensor information received from a sensor module of the electronic device (eg, the sensor module 376 of FIG. When a change to the second state of the electronic device 201 in 2b) is detected, the panel button is generated as a floating button, and as shown in FIG. At least one default button 465a for controlling the electronic device (eg, at least one default button 265a of FIG. 2B) is not interfered with, for example, the panel button is located at a predetermined position in the second display area. (465b) can be displayed.

According to an embodiment, in consideration of an area that is easy for a user to manipulate, the panel buttons are configured in a third display area 465 and a second display area (eg, the second display area 465 in FIG. 3 ) based on the folding state and posture of the electronic device. It can be displayed on one display area of the display area 363) or the first display area (eg, the first display area 361 of FIG. 3).

According to an embodiment, the electronic device omits a panel button for displaying a panel, and the second display area (eg, the second display area 363 in FIG. 3 ) or the second display area 363 in FIG. A panel may be automatically displayed on one display of one display area (eg, the first display area 361 of FIG. 3 ) without a user's input to display the panel.

According to an embodiment, the electronic device may provide a setting option through which a user may select a mode in which a user input is received to display a panel through a panel button and a mode in which a panel is automatically displayed.

5A, 5B, and 5C are diagrams 500a to 500c for explaining a configuration of a panel displayed on a second display area in an electronic device according to various embodiments.

Referring to FIG. 5A, the electronic device (eg, the electronic device of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 310 of FIG. 3) is in a second state in which the electronic device is folded. Based on the selection of the panel button displayed on the third display area (eg, the second state of the electronic device in FIG. 2B), the first panel or the second display area (eg, the second display area 263 in FIG. 2C) A second panel may be displayed.

5A, when displaying the first panel 570 on the second display area, the electronic device divides the first panel 570 into a first area 571 and a second area 573. and at least one control button (eg, previous video play button, play/stop) capable of controlling the first application (eg, video application) displayed on the first display area on the upper side of the first panel 570. button and play the next video), and at least one system button (eg, display) for controlling the system of the electronic device is disposed below the first panel 570. The second area 573 including the brightness control button (a1) and the volume control button (a2) may be disposed and displayed.

5B, when displaying the first panel 570 on the second display area, the electronic device divides the first panel 570 into a first area 571 and a second area, and The second area may be divided into a first sub area 573a and a second sub area 573b. The electronic device includes at least one operation button (eg, a mirroring function) capable of controlling an operation related to a first application (eg, a video application) displayed on the first display area on the upper side of the first panel 570. A first sub area 573a including a button a3 and a Bluetooth function button a4 may be disposed. The electronic device may include at least one control button (eg, a previous video play button, a play/pause button, and a next video application) capable of controlling the first application (eg, a video application) on the lower side of the first sub-area 573a. A first area 571 including video playback) may be disposed. The electronic device includes at least one system button (eg, a brightness control button a1 and a volume control button a2) capable of controlling a system of the electronic device below the first area 571. The second sub area 573b may be disposed and displayed.

5C, when displaying the first panel 570 on the second display area, the electronic device divides the first panel into a first area 571 and a second area 573, and At least one system button (eg, a brightness control button (a1) and a volume control button (a2)) capable of controlling the system of the electronic device is provided on the upper side of the first panel 570 and the first application (eg, video The second area 573 including at least one operation button (eg, a mirroring function button a3 and a Bluetooth function button a4) capable of controlling an operation related to an application) is disposed, and the first panel At least one control button (eg, a previous video play button, a play/pause button, and a next video play) capable of controlling a first application (eg, a video application) displayed on the first display area at the lower side of 570. The first area 571 including a may be arranged and displayed.

6A and 6B are diagrams 600a to 600b for explaining types of panels displayed on a second display area in an electronic device according to various embodiments.

Referring to FIG. 6A, an electronic device 601 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is Based on the selection of the panel button in the second state (eg, the second state of the electronic device 201 of FIG. 2B) in which the first display area 661 and the second display area 663 are folded and the second display area 663 is divided, An execution screen of the first application may be displayed on the first display area 661 . The electronic device 601 identifies the type (eg, video application) of the first application being executed on the first display area 661, and converts the first application to the type of application for display on the first panel. If confirmed, at least one control button capable of controlling the first application (eg, a previous video play button, a play/pause button, and a next video play button) is determined, and the determined at least one control button is set to the first application. It can be displayed on the first area 671 of the panel 670 . The electronic device 601 includes, in the second area 673 of the first panel 670, at least one system button (eg, a brightness control button of a display) capable of controlling a system of the electronic device set or selected. and volume control buttons) may be displayed. Also, according to an embodiment, at least one system button may be configured as a function button related to a first application type (or first application) among function buttons capable of controlling a system of the electronic device. For example, the electronic device may check the type of application being executed, and control to display at least one system button corresponding to the type of the identified application on the first panel 670 . In addition, at least one system button included in the first panel 670 may be automatically configured and displayed as a function button related to the type of the first application, or may be displayed as a function button checked/selected by the user. . The electronic device 601 may display at least one default button 665a and a panel button 665b for controlling the electronic device on the third display area 665 .

Referring to FIG. 6B, an electronic device 601 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is Based on the selection of the panel button in the second state (eg, the second state of the electronic device 201 of FIG. 2B) in which the first display area 661 and the second display area 663 are folded and the second display area 663 is divided, An execution screen of the first application may be displayed on the first display area 661 . When the electronic device 601 identifies the type of the first application being executed on the first display area 661 and identifies the first application as the type of application for display on the second panel, the second At least one common button (eg, a screen up button, a notification button, a screen shot) that can be commonly used in all or a plurality of applications is provided in the first area 681 of the panel 680. ) button and cursor button), and at least one system button (eg, display brightness) capable of controlling the system of the electronic device set or selected in the second area 683 of the second panel 680. control button and volume control button) can be displayed. The electronic device 601 may display at least one default button 665a and a panel button 665b for controlling the electronic device on the third display area 665 .

7A, 7B, 7C, 7D, 7E, and 7F are diagrams 700a for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure; to 700e).

Referring to FIG. 7A, an electronic device 701 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is folded and the first display area 761 and the second display area 763 are divided (eg, the second state of the electronic device 201 of FIG. 2B), based on selection of the panel button, The first video is reproduced and displayed according to the execution of the video application on the first display area 761, and at least one control button capable of controlling the video application and the system of the electronic device are provided on the second display area 763. A first panel 770 (eg, a video panel) including at least one controllable system button may be displayed.

The electronic device 701 includes at least one control button capable of controlling a video application in the first region 771 of the first panel 770, a previous video play button (b1), a play/stop button ( b2), a next video play button b3, a search bar b4, and a next panel display button b5 may be displayed. The electronic device 701 includes a brightness control button (b6) and a volume control button (b6) as at least one system button capable of controlling the system of the electronic device in the second area 773 of the first panel 770. b7) can be displayed. The electronic device 701 may display at least one default button 765a and a panel button 765b for controlling the electronic device on the third display area 765 .

In FIG. 7A , the electronic device 701 detects the selection of the search bar b4 displayed on the first area 771 of the first panel 770 displayed on the second display area 763. 7B, the frame of the first video corresponding to the moving position of the selected search bar b4 can be reproduced on the first display area 761.

7A, the electronic device 701 detects selection of the volume control button b7 displayed on the second area 773 of the first panel 770 displayed on the second display area 763. Based on this, as shown in FIG. 7C, a volume control bar 791 can be displayed as a volume control button b7 and a detailed control button for volume control in the second region 773 of the first panel 770. there is. While the electronic device 701 displays the volume control bar 791, an area other than the volume control bar 791 is touched or an area other than the second area 773 of the first panel 770 is touched. is touched or when a predetermined time elapses without detection of a touch operation on the volume control bar 791, as shown in FIG. 7A, a brightness control button (b6) and a volume control button b7 can be displayed. The electronic device 701, when a detailed control button is required among a plurality of buttons provided on the first panel or the second panel, detects selection of a button such as the volume control button b7, indicating that the button is being displayed. Detailed control buttons can be displayed together with the buttons in the area.

In FIG. 7A, the electronic device 701 detects selection of the next video play button b3 displayed on the second area 773 of the first panel 770 displayed on the second display area 763. Based on , as shown in FIG. 7D , playback of the second video may be displayed on the first display area 761 . In FIG. 7D, the electronic device 701, while displaying the playback of the second video on the first display area 761, if a certain amount of time elapses without detecting any action or event on the electronic device 701, FIG. As shown in 7e, the brightness of the first panel displayed on the second display area 763 may be adjusted so that the buttons included in the first panel 770 are not displayed. As shown in FIG. 7E , the electronic device 701 displays a second button on the first display area 761 in a state in which buttons included in the first panel 770 displayed on the second display area 763 are not displayed. If an action or event is detected on the electronic device 701 while a video is displayed, the brightness of the first panel displayed on the second display area 763 is adjusted as shown in FIG. 7D so that the first panel ( 770) may be displayed.

7A, the electronic device 701 detects selection of the next panel display button b5 displayed on the first area 771 of the first panel 770 displayed on the second display area 763. Based on, as shown in FIG. 7F, at least one common button (eg, a screen up button, a notification button) that can be commonly used in all or a plurality of applications is displayed on the second display area 763. , a screen shot button and a cursor button) and at least one system button (eg, a brightness control button and a volume control button) capable of controlling the system of the electronic device are displayed. A second panel 780 including a second area 783 to be displayed may be displayed.

8A, 8B, 8C, and 8D are diagrams 800a to 800d for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments.

Referring to FIG. 8A, an electronic device 801 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is folded and the first display area 861 and the second display area 863 are divided (eg, the second state of the electronic device 201 of FIG. 2B), based on selection of the panel button, An execution screen of a video call application is displayed on the first display area 861, and at least one control button capable of controlling the video call application and a system of the electronic device are displayed on the second display area 863. A first panel 870 (eg, a video call panel) including at least one system button may be displayed.

The electronic device 801 includes at least one control button capable of controlling a video call application in the first area 871 of the first panel 870, a microphone mute button c1, and a microphone volume control button ( c2) and the next panel display button c3 can be displayed. The electronic device 801 includes, as at least one control button capable of controlling a video call application, a camera on/off button, a background blur button capable of blurring a background, and a call end button as the first control button. The first area 871 of the panel 870 may be provided.

The electronic device 801 includes at least one system button for controlling the system of the electronic device in the second area 873 of the first panel 870, a brightness control button c4 and a volume control button ( c5) can be displayed. The electronic device 801 may display at least one default button 885a and a panel button 885b for controlling the electronic device on the third display area 885 .

8A, the electronic device 801 detects selection of the microphone volume control button c2 displayed on the first area 871 of the first panel 870 displayed on the second display area 863. Based on, as shown in FIG. 8B, a microphone volume control button (c2) and a detailed control button for adjusting the volume of the microphone are located in the first area 871 of the first panel 870, and the microphone volume control bar 891 can be displayed. While the electronic device 801 displays the microphone volume control bar 891, an area other than the microphone volume control bar 891 is touched, or the first area 871 of the first panel 870 When an area other than the area is touched, or when a predetermined time elapses without detection of a touch operation on the microphone volume control bar 891, the microphone is muted in the first area 871 of the first panel 870 as shown in FIG. 8A. A button c1, a microphone volume control button c2, and a next panel display button c3 can be displayed.

8A, the electronic device 801 detects selection of the volume control button c5 displayed on the second area 873 of the first panel 870 displayed on the second display area 863. Based on this, as shown in FIG. 8C, a volume control bar 891 can be displayed as a volume control button c5 and a detailed control button for volume control in the second region 873 of the first panel 870. . While the electronic device 801 displays the volume control bar 891, an area other than the volume control bar 891 is touched or an area other than the second area 873 of the first panel 870 is touched. is touched or when a predetermined time elapses without detection of a touch operation on the volume control bar 891, the brightness control button c4 is displayed on the second area 873 of the first panel 870 as shown in FIG. 8A. and a volume control button c5 may be displayed.

8A, the electronic device 801 detects selection of the next panel display button c3 displayed on the first area 871 of the first panel 870 displayed on the second display area 863. Based on, as shown in FIG. 8D, at least one common button (eg, a screen up button, a notification button) that can be commonly used in all or a plurality of applications is displayed on the second display area 863. , a screen shot button and a cursor button) and at least one system button (eg, a brightness control button and a volume control button) capable of controlling the system of the electronic device are displayed. A second panel 880 including a second area 883 to be displayed may be displayed.

9A, 9B, 9C, and 9D are diagrams 900a to 900d for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments.

Referring to FIG. 9A, an electronic device 901 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is folded and the first display area 961 and the second display area 963 are divided (eg, the second state of the electronic device 201 of FIG. 2B), based on selection of the panel button, An execution screen of a video call application is displayed on the first display area 961, and at least one control button capable of controlling the video call application and a system of the electronic device are displayed on the second display area 963. A first panel 970 (eg, a video call panel) including at least one system button may be displayed.

The electronic device 901 includes at least one control button for controlling a video call application in the first area 971 of the first panel 970, a background blur button d1 and a background color button d2. ), a background image button d3 and a next panel display button d4 can be displayed.

The electronic device 901 includes a brightness control button d5 and a volume control button (d5) as at least one system button capable of controlling the system of the electronic device in the second area 973 of the first panel 970. d6) can be displayed. The electronic device 901 may display at least one default button 965a and a panel button 965b for controlling the electronic device on the third display area 965 .

9A, the electronic device 901 detects selection of the background blur button d1 displayed on the first area 971 of the first panel 970 displayed on the second display area 963. Based on this, as shown in FIG. 9B , the background screen of the image displayed on the first display area 961 may be displayed after being blurred.

9A, the electronic device 901 detects selection of the background color button d2 displayed in the first area 971 of the first panel 970 displayed in the second display area 963. Based on this, as shown in FIG. 9C , the background screen of the image displayed on the first display area 961 may be changed to a color selected by the user and displayed.

9A, the electronic device 901 detects selection of the background image button d3 displayed on the first area 971 of the first panel 970 displayed on the second display area 963. Based on this, as shown in FIG. 9D , the background screen of the image displayed on the first display area 961 may be changed to an image selected by the user among images stored in the electronic device 901 and displayed.

10A, 10B, 10C, and 10D are diagrams 1000a to 1000d for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments.

Referring to FIG. 10A, an electronic device 1001 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is folded and the second state in which the first display area 1061 and the second display area 1063 are divided (eg, the second state of the electronic device 201 of FIG. 2B), based on selection of the panel button, An execution screen of the camera application is displayed on the first display area 1061, and at least one control button capable of controlling the camera application and at least one control button controlling the system of the electronic device are displayed on the second display area 1063. A first panel 1070 (eg, a camera panel) including a system button of , may be displayed.

The electronic device 1001 includes at least one control button capable of controlling a camera application in the first area 1071 of the first panel 1070, including a timer button e1, a photographing button e2, and a camera. A switch button (e3) and a next panel display button (e4) can be displayed.

The electronic device 001 includes a brightness control button (e5) and a volume control button ( e6) can be displayed. The electronic device 1001 may display at least one default button 1065a and a panel button 1065b for controlling the electronic device on the third display area 1065 .

In FIG. 10A , the electronic device 1001 detects selection of the camera change button e3 displayed on the first area 1071 of the first panel 1070 displayed on the second display area 1063. Based on this, as shown in FIG. 10B , an image taken by the front camera may be displayed on the first display area 961 .

In FIG. 10A, the electronic device 1001 detects selection of the timer button e3 displayed on the first area 1071 of the first panel 1070 displayed on the second display area 1063. As shown in FIG. 10C , a plurality of buttons 1091 indicating types of timers may be displayed at predetermined positions in the first area 1071 of the first panel 1070 displayed on the second display area 1063. there is. In FIG. 10C , the electronic device 1001 may operate a timer for photographing as shown in FIG. 10D when any one of the plurality of buttons 1091 indicating the type of timer is selected.

11A, 11B, 11C, 11D, 11E, 11F, and 11G are views for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure; are (1100a to 1100g).

Referring to FIG. 11A, an electronic device 1101 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is the electronic device is folded and the second state in which the first display area 1161 and the second display area 1163 are divided (e.g., the first state of the electronic device 201 of FIG. 2B), based on selection of the panel button, The execution screen of the first application is displayed on the first display area 1161 and is common to all or a plurality of applications on the first area 1181 of the second panel 1180 displayed on the second display area 1163. At least one common button that can be used as can be displayed. The electronic device 1101 includes at least one common button in the first area 1181 of the second panel 1180, a screen up button (f1), a notification button (f2), A screen shot button f3 and a cursor button f4 may be displayed. The electronic device 1101 includes a brightness control button f5 and a volume control button (f5) as at least one system button capable of controlling the system of the electronic device in the second region 1183 of the second panel 1180. f6) can be displayed. The electronic device 1101 may display at least one default button 1165a and a panel button 1165b for controlling the electronic device on the third display area 1165.

11A, the electronic device 1101 selects a screen up button f1 displayed on the first area 1181 of the second panel 1180 displayed on the second display area 1163. Based on the detection of , as shown in FIG. 11B , the brightness of the second panel displayed on the second display area 363 may be adjusted, and the second panel may be processed and displayed in gray. The screen up function is a function that raises the screen to the top. When it is impossible to raise the screen, the brightness of the buttons included in the second panel is adjusted so that the second panel is displayed in gray. or can be adjusted to be grayed out.

In FIG. 11A, the electronic device 1101 detects selection of the cursor button f4 displayed on the first area 1181 of the second panel 1180 displayed on the second display area 1163. 11C, a cursor is displayed on the first display area 1161 displaying the execution screen of the first application, and instead of the second panel 1180 on the second display area 1163, the first display area A cursor function pad 1191 capable of controlling a cursor displayed on 1161 may be provided. The electronic device 1101 may control the first application displayed on the first display area 1161 by using the cursor based on various gesture types detected by the cursor function pad 1191 . The electronic device 1101 may provide up and down scroll buttons 1192 to the cursor function pad 1191 .

11A, the electronic device 1101 detects selection of the brightness control button f5 displayed on the second area 1183 of the second panel 1180 displayed on the second display area 1163. Based on this, as shown in FIG. 11D, a brightness adjustment bar 1193 is displayed as a brightness control button f5 and a detailed control button for adjusting the brightness of the display in the second area 1183 of the second panel 1180. can While the electronic device 1101 displays the brightness control bar 1193, an area other than the brightness control bar 1193 is touched or an area other than the second area 1183 of the second panel 1180 is touched. is touched or when a predetermined time elapses without detection of a touch operation on the brightness control bar 1193, the brightness control button f5 is displayed in the second region 1183 of the second panel 1180 as shown in FIG. 11A. and a volume control button f6 can be displayed.

In FIG. 11A, the electronic device 1101 responds to selection of a notification button f2 displayed on the first area 1181 of the second panel 1180 displayed on the second display area 1163. Based on the detection, as shown in FIG. 11E , a notification panel 1144 may be displayed on the first display area 1161 and the second display area 1163 and notification contents may be displayed.

11A, the electronic device 1101 selects a screen shot button f3 displayed on the first area 1181 of the second panel 1180 displayed on the second display area 1163. Based on the detection of the second panel 1180 displayed on the second display 1163, as shown in FIG. can be captured and displayed. When the execution screen of the currently running first application is captured as shown in FIG. 11F, the electronic device 1101 provides various buttons 1195 for editing and sharing the captured screen as shown in FIG. 11G. It can be displayed on the display area 1163.

12A, 12B, 12C, and 12D are diagrams for explaining an operation of adding an operation button to a panel based on selection of a panel button in a second state of an electronic device according to various embodiments (1200a to 1200d). )am.

Referring to FIG. 12A, an electronic device 1201 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is After being folded, the first display area 1261 and the second display area 1263 are used as one screen to display playback of the first video selected by the execution of the video application, and the panel button ( When selection of the panel button 1265b is confirmed in the second state (eg, the second state of the electronic device 201 of FIG. 2B) displaying 1265b), the first display area 1261 as shown in FIG. 12B At least one control button capable of displaying playback of the first video on ) and controlling the video application on the first area 1271 of the first panel 1270 displayed on the second display area 1263 ( Example: previous video play button, play/stop button, next video play button, and next panel display button) can be displayed. The electronic device 1201 uses at least one system button capable of controlling the system of the electronic device on the second area 1273 of the first panel 1270 displayed on the second display area 1263 to provide brightness. Along with the control button g1 and the volume control button g2, at least one operation button g3 and g4 capable of controlling an operation related to the video application may be displayed. Here, at least one system button included in the first panel 1270 may be preset to correspond to a function related to a video application among system functions of the electronic device. When the electronic device 1201 confirms that the first video is being played on the first display area 1261 based on the state information of the video application, the electronic device 1201 provides an eye comfort function with the at least one operation button. An eye comfort button g3 that can be used may be additionally displayed on the second region 1273 of the first panel 1270 . The electronic device 1201 has a Bluetooth function capable of controlling the Bluetooth speaker with the at least one operation button when an external electronic device is connected to the electronic device 1201 and the connected external electronic device is a Bluetooth speaker. A button g4 may be additionally displayed on the second area 1273 of the first panel 1270 .

12B, when the electronic device 1201 confirms the connection between the external electronic device and the mirroring function, as shown in FIG. 12C, the first panel 1270 displayed on the second display area 1263 A mirroring function button g4 for controlling the mirroring function with the at least one operation button may be additionally displayed in the second area 1273 of the first panel 1270 in the second area 1273 .

12C, the electronic device 1201 displays an eye comfort button g3 displayed on the second area 1273 of the first panel 1270 displayed on the second display area 1263. ), reproduction of the first video to which the eye comfort function is applied may be displayed on the first display area 1261, as shown in FIG. 12D.

13A, 13B, and 13C are diagrams 1300a to 1300c for explaining an operation of adding an operation button to a panel based on selection of a panel button in a second state of an electronic device according to various embodiments.

Referring to FIG. 13A, an electronic device 1301 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is the electronic device ( 1301) is folded, and the first display area 1361 and the second display area 1363 are used as one screen to display the execution screen of the video call application, and the panel button 1365b is displayed on the third display area 1365. In the second state (eg, the second state of the electronic device 201 of FIG. 2B ) displaying , when selection of the panel button 1365b is confirmed, the first display area 1361 appears as shown in FIG. 13B. At least one control button capable of displaying an execution screen of a video call application and controlling the video call application on the first area 1371 of the first panel 1370 displayed on the second display 1363 : Microphone mute button, microphone volume control button, and next panel display button) can be displayed. The electronic device 1301 controls the brightness of the second area 1373 of the first panel 1370 displayed on the second display 1363 using at least one system button capable of controlling the system of the electronic device. At least one operation button (h3, h4, h5) capable of controlling an operation related to the video call application may be displayed together with the button (h1) and the volume control button (h2). Here, at least one system button included in the first panel 1370 may be preset to correspond to a function related to a video call application among system functions of the electronic device. When the electronic device 1301 confirms that a video call is being performed on the first display area 1361 based on the state information of the video call application, the electronic device 1301 can share data with the other party during the video call by using the at least one action button. A share button (h3), a do not disturb button (h4), and a record button (h5) capable of performing screen recording may be additionally displayed in the second region 1373 of the first panel 1370. .

Referring to FIG. 13C , when the electronic device 1301 has an external electronic device connected to the electronic device 1301 and the connected external electronic device is a Bluetooth speaker, the at least one operation button controls the Bluetooth speaker. A controllable Bluetooth function button h6 may be additionally displayed on the second area 1373 of the first panel 1370.

14A and 14B are diagrams 1400a to 1400b for explaining a panel providing operation according to rotation of the electronic device in an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 14A, the electronic device 1401 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is in portrait mode ( In a second state in which the first display area 1461 and the second display area 1463 are divided by folding up and down in the portrait mode (eg, the second state of the electronic device 201 of FIG. 2B ), the panel buttons Based on the selection, an execution screen of the first application is displayed on the first display area 1461, and at least one common button commonly used for all or a plurality of applications is displayed on the second display area 1463 and the A second panel 1480 including at least one system button capable of controlling the system of the electronic device may be displayed.

14A, the electronic device 1401 includes a sensor module (eg, the sensor module 376 of FIG. 3) (eg, an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, or a motion sensor) of the electronic device. When -90 degree rotation of the electronic device 1401 is detected using sensor information received from at least one of the sensors, rotation information (eg, -90 degrees) of the electronic device 1401 is detected as shown in FIG. 14B. degree rotation), the location of the third display area 1465 (eg, the last area on the right), and the size information of the second display area 1463 that changes according to the rotation of the electronic device, the second panel 1480 ) can be displayed at the bottom of the second display area 1463 by adjusting the display position and size.

15A and 15B are diagrams 1500a to 1500b for explaining a panel providing operation according to rotation of the electronic device in an electronic device according to various embodiments.

Referring to FIG. 15A, the electronic device 1501 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is in a landscape mode ( In the second state in which the first display area 1561 and the second display area 1563 are divided by folding up and down in the landscape mode, the first application is displayed on the first display area 1561 based on the selection of the panel button. Displays an execution screen and includes at least one common button commonly used for all or a plurality of applications on the second display area 1563 and at least one system button capable of controlling the system of the electronic device A second panel 1580 may be displayed.

In FIG. 15A, when the electronic device 1501 detects a 90 degree rotation of the electronic device 1501, as shown in FIG. 15B, the electronic device 1501 rotation information (eg, 90 degree rotation), a third display The display position and size of the second panel 1580 are determined based on information about the location of the area 1565 (eg, the last area on the left) and the size information of the second display area 1563 that changes according to the rotation of the electronic device. It can be adjusted and displayed at the bottom of the second display area 1563. In embodiments, a 90 degree rotation may correspond to a rotation from a horizontal direction to a vertical direction, for example.

16A, 16B, and 16C are diagrams 1600a to 1600c for explaining a panel providing operation according to a mounting state of an electronic device in an electronic device according to various embodiments.

Referring to (a) of FIG. 16A, the electronic device 1601 uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3) of the electronic device 1601. ) is out-folded up and down in landscape mode, and when it is confirmed that the mounting state (or posture state) of the electronic device 1601 is the first mounting state, selection of the panel button displayed on the third display area A panel that displays the execution screen of the first application on the first display area 1661 and includes a plurality of buttons on the right side of the second display area 1663 for controlling the system of the first application and the electronic device. (1670) can be displayed.

Referring to (b) of FIG. 16A, the electronic device 1601 uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3) of the electronic device ( When it is confirmed that the electronic device 1601 is out-folded vertically in landscape mode and the mounting state (or posture state) of the electronic device 1601 is the second mounting state, the display of the panel buttons displayed on the third display area Depending on selection, a panel 1670 including a plurality of buttons for system control of the first application displayed on the first display area 1661 and the electronic device may be displayed on the right side of the second display area 1663. .

Referring to (a) of FIG. 16B, the electronic device 1601 uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3) of the electronic device 1601. It can be confirmed that is in a vertically folded state in a landscape mode, and the mounting state (or posture state) of the electronic device 1601 is the third mounting state. When the electronic device 1601 checks the panel display setting information for the right-handed user and confirms the selection of the panel button displayed on the third display area, the electronic device 1601 displays the execution screen of the first application on the first display area 1661. and a panel 1670 including a plurality of buttons for controlling the system of the first application and the electronic device may be displayed on the lower side of the second display area 1663 .

Referring to (b) of FIG. 16B, the electronic device 1601 uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3) of the electronic device 1601. ) is a state in which the electronic device 1601 is folded upwards and downwards in a landscape mode, and the electronic device 1601 is in a third mounting state. The electronic device 1601 displays the execution screen of the first application on the second display area 1663 when the panel display setting information for the left-handed user is checked and selection of the panel button displayed on the third display area is confirmed. and a panel 1670 including a plurality of buttons for controlling the system of the first application and the electronic device may be displayed on the lower side of the first display area 1661 .

Referring to (a) of FIG. 16C, the electronic device 1601a uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3) of the electronic device 1601a. When it is confirmed that is folded up and down in portrait mode and the mounting state (or posture state) of the electronic device 1601a is the fourth mounting state, according to the selection of the panel button displayed on the third display area. An execution screen of the first application is displayed on the first display area 1661a, and a panel 1670a including a plurality of buttons for system control of the first application and the electronic device is provided below the second display area 1663a. can be displayed

Referring to (b) of FIG. 16C, the electronic device 1601 uses sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3) of the electronic device 1601. ) is a state in which the electronic device 1601 is folded up and down in landscape mode, and it can be confirmed that the mounting state (or posture state) of the electronic device 1601 is the fourth mounting state. The electronic device 1601 checks panel display setting information for a right-handed user and executes a first application on the first display area 1661 based on detection of selection of a panel button displayed on the third display area. A screen may be displayed, and a panel 1670 including a plurality of buttons for controlling the system of the first application and the electronic device may be displayed on the left side of the second display area 1663 .

17A, 17B, 17C, 17D, 17E, and 17F are diagrams 1700a for explaining an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure; to 1700 f).

Referring to FIG. 17A, an electronic device 1701 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) is the electronic device A second state in which the 1701 is folded up and down in portrait mode and the first display area 1761 and the second display area 1763 are divided (eg, the second state of the electronic device 201 of FIG. 2B). state)), an execution screen of the first application is displayed on the first display area 1761 and can be commonly used for all or a plurality of applications on the second display area 1763. At least one common button (eg, a screen up button, a notification button, a screen shot button, and a cursor button), and at least one system button capable of controlling a system of the electronic device. A second panel 1780 including (brightness control button and volume control button) may be displayed. After detecting a long touch T1 on the second panel 1780 displayed in a floating form on the second display area 1763, the electronic device 1701 performs an upward drag operation T2 as shown in FIG. 17B. If detected, the second panel 1780 can be displayed by moving it in an upward direction corresponding to the upward drag operation, as shown in FIG. 17C. As shown in FIG. 17C, the electronic device 1701 notifies that the upper drag motion detected after the long touch does not deviate from the second display area 1763. A visual warning 1791 may be displayed.

17C, when the electronic device 1701 detects a flick operation in the left bezel direction of the second display area 1763 after detecting the touch T3 on the second panel 1780, As shown in FIG. 17D, a function of hiding the second panel 1780 may be performed. 17D, the electronic device 1701 touches (T4) the left bezel of the second display area 1763 while hiding the second panel, and then touches the center of the second display area 1763. When a flick operation is detected in the direction, the hidden second panel can be displayed on the second display area 1763 again, as shown in FIG. 17E.

17E, the electronic device 1701 displays on the second display area 1763 as shown in FIG. 17E based on detection of selection of the panel button 1765b displayed on the third display area 1765. The second state of not displaying the second panel 1780 in the second display area 1763 as shown in FIG. 17F (eg, the electronic device 201 of FIG. 2B). ) to the second state). When the electronic device 1701 confirms the selection of the panel button 1765b displayed on the third display area 1765 in the second state as shown in FIG. 17F, the last position information of the second panel as shown in FIG. 17E Based on , the second panel 1780 can be displayed in the second display area 1763 .

18a, 18b, 18c, 18d, 18e, 18f, 18g, and 18h describe an operation of providing a panel based on selection of a panel button in a second state of an electronic device according to various embodiments. These are drawings (1800a to 1800h) for doing.

Referring to FIG. 18A, an electronic device 1801 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) A second state in which the 1801 is folded vertically in landscape mode and the first display area 1861 and the second display area 1863 are divided (eg, the second state of the electronic device 201 of FIG. 2B). state), an execution screen of the first application is displayed on the first display area 1861 based on the selection of the panel button, and on the second display area 1863, a screen that can be commonly used for all or a plurality of applications is displayed. At least one common button (eg, a screen up button, a notification button, a screen shot button, and a cursor button), and at least one system button capable of controlling a system of the electronic device. A second panel 1880 including (brightness control button and volume control button) may be displayed. After detecting a long touch S1 on the second panel 1880 displayed in a floating form on the second display area 1863, the electronic device 1801 performs a right drag operation S2 as shown in FIG. 18B. If detected, the second panel 1880 can be displayed by moving in the right direction corresponding to the right drag operation, as shown in FIG. 18C. In FIG. 18C, when the electronic device 1801 detects an upward drag operation (S3) following a right drag operation on the second panel 1880, the second panel 1880 is moved upward as shown in FIG. 18D. It can be displayed by moving in an upward direction corresponding to the drag operation. As shown in FIG. 18D, the electronic device 1801, when the upward drag operation (S3) leaves the second display area 1863, displays a visual message notifying that the second display area 1863 cannot be left. A warning (1891) can be displayed.

18D, after detecting the touch S4 on the second panel 1880, the electronic device 1801 performs a flick operation in the right bezel direction of the second display area 1863 as shown in FIG. 18E. When (S5) is detected, a function of hiding the second panel 1880 can be performed, as shown in FIG. 18F. 18F, the electronic device 1801, while hiding the second panel, touches the right bezel of the second display area 1863 and then flicks toward the center of the second display area 1863. When the (flick) operation S6 is detected, the hidden second panel 1880 can be displayed on the second display area 1863 again, as shown in FIG. 18G.

In FIG. 18G, the electronic device 1801 displays on the second display area 1863 as shown in FIG. 18G based on detection of selection of the panel button 1865b displayed on the third display area 1865. The second state of not displaying the second panel 1880 in the second display area 1863 as shown in FIG. 18H (eg, the electronic device 201 of FIG. 2B). ) to the second state). When the electronic device 1801 confirms the selection of the panel button 1865b displayed on the third display area 1865 in the second state as shown in FIG. 18H, the last position information of the second panel as shown in FIG. 18G Based on , the second panel 1880 can be displayed in the second display area 1863 .

19a, 19b, 19c, 19d, 19e, 19f, 19g, 19h, 19i, and 19j illustrate selection of a panel button in a second state of an electronic device according to various embodiments of the present disclosure. These are drawings 1900a to 1900j for explaining an operation of providing a panel based on the drawing.

Referring to FIG. 19A, an electronic device 1901 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) A second state in which the first display area 1961 and the second display area 1963 are divided by folding the 1901 up and down in portrait mode (eg, the second state of the electronic device 201 of FIG. 2B ) state), an execution screen of the first application is displayed on the first display area 1961, and at least one application that can be commonly used for all or a plurality of applications is displayed on the second display area 1963. A first area 1981 displaying one common button and a second area 1983 displaying at least one system button (eg, a brightness control button and a volume control button) capable of controlling the system of the electronic device. A second panel 1980 including the second panel 1980 may be displayed. The electronic device 1901 includes, as the at least one common button in the first area 1981 of the second panel 1980, an application list view button i1, a screen up button i2, A notification button i3 and a screen shot button i4 may be included.

In FIG. 19A, the electronic device 1901, based on detection of selection of the screen up button i2 displayed in the first area 1981 of the second panel 1980, FIG. 19B As such, brightness of a plurality of buttons included in the second panel may be adjusted and displayed in gray. 19B, the electronic device 1901 includes a second panel (including a plurality of buttons), as shown in FIG. 1980) can be indicated. In FIG. 19C, the electronic device 1901 based on detection of selection of the application list view button i1 displayed in the first area 1981 of the second panel 1980, as shown in FIG. 19D, An application list including types of applications stored in the electronic device 1901 may be displayed on the second display area 1963 . Based on the detection of selection of the second application R1 from the application list, while displaying the execution screen of the first application on the first display area 1961 as shown in FIG. 19E, the second display area ( 1963), an execution screen of the second application may be displayed. In FIG. 19E, the electronic device 1901, based on detection of selection of the panel button 1965b displayed on the third display area 1965, as shown in FIG. 19F, the second display area 1963 ), the second panel 1980 may be displayed. In FIG. 19F, the electronic device 1901 based on detection of selection of the application list view button i1 displayed in the first area 1981 of the second panel 1980, as shown in FIG. 19G, An application list including types of applications stored in the electronic device 1901 may be displayed on the second display area 1963. The electronic device 1901 selects a third application from the application list (R2). Based on the detection of , while the execution screen of the first application is displayed on the first display area 1961, as shown in FIG. 19H, the execution screen of the third application is displayed on the second display area 1963. can do. 19H, while displaying the execution screen of the first application on the first display area 1961 and displaying the execution screen of the third application on the second display area 1963, the second display area In step 1963, selection (focus) of the displayed third application may be confirmed, and based on the type of the third application, whether to display the first panel or the second panel may be determined. When the electronic device 1901 confirms that the third application is an application for displaying the first panel, as shown in FIG. 19i, the electronic device 1901 displays an execution screen of the selected third application on the first display area 1901 and , At least one control button (eg, previous video play button, play/pause button, next video play button, and next panel view) for controlling the third application (eg, video application) on the second display area 1963 button) and a second area 1973 displaying at least one system button (eg, a brightness control button and a volume control button) for controlling the system of the electronic device. 1 panel 1970 (e.g. video panel) can be displayed

When the electronic device 1901 confirms that the third application is an application for displaying the second panel, as shown in FIG. 19J, the electronic device 1901 displays an execution screen of the selected third application on the first display area 1901 and , a first area 1981 displaying at least one common button commonly used for all applications on the second display area 1963 and at least one system button capable of controlling the system of the electronic device (eg : A second panel 1980 including a second area 1983 displaying brightness control buttons and volume control buttons) may be displayed.

20a, 20b, 20c, 20d, 20e, 20f, 20g, and 20f provide a panel based on selection of a panel button in a second state of the electronic device according to various embodiments. These are drawings 2000a to 2000f for explaining the operation.

Referring to FIG. 20A, an electronic device 2001 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) 1901 is folded up and down in landscape mode to divide the first display area 2061 and the second display area 2063 into a second state, based on selection of a panel button, the first display area ( 2061) and while displaying the execution screen of the second application on the second display area 2063, selection of the panel button 2065b displayed on the third display area 2065 is checked. , at least one common button (eg, application list view button j1), screen up ( A first area 2081 displaying a screen up button (j2), a notification button (j3), and a screen shot button (j4) and at least one capable of controlling the system of the electronic device. A second panel 2080 including a second area 2083 displaying system buttons (eg, a brightness control button and a volume control button) may be displayed.

In FIG. 20A, the electronic device 2001 based on detection of selection of the application list view button j1 displayed on the first area 2081 of the second panel 2080, as shown in FIG. 20B, The second display area 2063 is divided into a first area 2063a and a second area 2063b, and the execution screen of the second application is displayed in the first area 2063a of the second display area 2063. and an application list including types of applications stored in the electronic device 2001 may be displayed on the second area 2063b of the second display area 2063. The electronic device 2001 may display the application list. Based on the detection of the selection (Q1) of the third application from the list, as shown in FIG. 20C, while displaying the execution screen of the first application on the first display area 2061, the second display area 2063 An execution screen of the second application may be displayed on the first area 2063a of the screen, and an execution screen of the selected third application may be displayed on the second area 2063b of the second display area 2063 .

Based on the detection of the selection of the panel button 2065b displayed on the third display area 2065 in FIG. 20C, as shown in FIG. 20D, the electronic device 2001, the second display area 2063 ), at least one common button that can be commonly used in all or a plurality of applications (eg, application list view button (j1), screen A first area 2081 displaying a screen up button (j2), a notification button (j3) and a screen shot button (j4) and a system capable of controlling the electronic device A second panel 2080 including a second area 2083 displaying at least one system button (eg, a brightness control button and a volume control button) may be displayed.

In FIG. 20D, the electronic device 2001 based on detection of selection of the application list view button j1 displayed in the first area 2081 of the second panel 2080, as shown in FIG. 20E, The second display area 2063 is divided into a first area 2063a and a second area 2063b, and the execution screen of the second application is displayed in the first area 2063a of the second display area 2063. and an application list including types of applications stored in the electronic device 2001 may be displayed on the second area 2063b of the second display area 2063. The electronic device 2001 may display the application list. Based on the detection of the selection (Q2) of the fourth application from the list, as shown in FIG. 20F, while displaying the execution screen of the first application on the first display area 2061, the second display area 2063 An execution screen of the second application may be displayed on the first area 2063a of the screen, and an execution screen of the selected fourth application may be displayed on the second area 2063b of the second display area 2063 .

21a, 21b, 21c, 21d, 21e, 21f, 21g, 21h, and 21i show a panel based on selection of a panel button in a second state of the electronic device according to various embodiments. These are drawings 2100a to 2100i for explaining the operation of providing.

Referring to FIG. 21A, an electronic device 2101 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) When the screen 2101 is folded and selection of the panel button is confirmed, the execution screen of the first application is displayed on the first display area 2161 and common to all or a plurality of applications on the second display area 2163. A control panel displaying at least one common button that can be used (eg, application list view button (k1), touch pad button (k2), notification button (k3), and screen shot button (k4)) A second panel 2180 including a first area 2181 and a second area 2183 displaying at least one system button (eg, a brightness control button and a volume control button) capable of controlling the system of the electronic device. can be displayed.

21A, the electronic device 2101, based on detection of selection of the touch pad button k2 displayed on the first area 2181 of the second panel 2180, as shown in FIG. A control icon 2191 capable of controlling a first application may be displayed on the first display area 2161 , and a touch pad panel 2190 may be displayed on the second display area 2163 . 21B, when the electronic device 2101 detects a drag operation on the touch pad panel 2190 displayed on the second display area 2163, the function corresponding to the drag operation, for example, the drag operation A control icon displayed on the first display area 2161 may be moved corresponding to the direction of .

As shown in FIG. 21C , when the electronic device 2101 detects a multi-touch operation on the touch pad panel 2190 displayed on the second display area 2163, the function corresponding to the multi-touch operation, for example, You can open the context menu.

As shown in FIG. 21D , when the electronic device 2101 detects a pinch zoom-in operation on the touch pad panel 2190 displayed on the second display area 2163, it provides an example of a function corresponding to the pinch-zoom-in operation. For example, the execution screen of the first application displayed on the first display area 2161 may be enlarged.

As shown in FIG. 21E , when the electronic device 2101 detects a pinch-zoom-out operation on the touch pad panel 2190 displayed on the second display area 2163, it provides an example of a function corresponding to the pinch-zoom-out operation. For example, the execution screen of the first application displayed on the first display area 2161 may be reduced.

As shown in FIG. 21F , when the electronic device 2101 detects an upward drag operation using a multi-touch on the touch pad panel 2190 displayed on the second display area 2163, the upward drag operation using the multi-touch A function corresponding to the drag operation in the direction, for example, a screen for executing the first application displayed on the first display area 2161 may be moved upward.

21G , when the electronic device 2101 detects a downward drag operation using a multi-touch on the touch pad panel 2190 displayed on the second display area 2163, the electronic device 2101 performs a downward drag operation using the multi-touch. A function corresponding to a drag operation in the direction, for example, a screen for executing a first application displayed on the first display area 2161 may be moved downward.

21H , when the electronic device 2101 detects a drag operation in the right direction using the multi-touch on the touch pad panel 2190 displayed on the second display area 2163, the right side using the multi-touch A function corresponding to a drag operation in the direction, for example, a screen for executing the first application displayed on the first display area 2161 may be moved to the right.

21I, when the electronic device 2101 detects a drag operation in the left direction using the multi-touch on the touch pad panel 2190 displayed on the second display area 2163, the leftward drag operation using the multi-touch A function corresponding to the drag operation in the direction, for example, a screen for executing the first application displayed on the first display area 2161 may be moved to the left.

22A, 22B, 22C, and 22D are diagrams 2200a to 2200d for explaining an operation of providing a panel based on selection of a panel button in a second state of the electronic device according to various embodiments of the present disclosure; am.

Referring to FIG. 22A, an electronic device 2201 (eg, the electronic device 101 of FIG. 1, the electronic device 201 of FIGS. 2A to 2C, or the electronic device 301 of FIG. 3) When the screen 2201 is folded and selection of the panel button is confirmed, an execution screen of the first application is displayed on the first display area 2261 and is commonly used by all or a plurality of applications on the second display area 2263. A control panel that displays at least one common button (e.g., screen up button (l1), notification button (l2), screen shot button (l3), and cursor button (l4)) that can be A second panel 2280 including a first area 2281 and a second area 2283 displaying at least one system button (eg, a brightness control button and a volume control button) capable of controlling the system of the electronic device can be displayed.

In FIG. 22A, the electronic device 2201, based on detection of selection of the cursor button l4 displayed on the first area 2281 of the second panel 2280, as shown in FIG. 22B, first A cursor icon 2291 capable of controlling a first application is displayed on the display area 2261, and a cursor function panel 2290 including up and down scroll buttons 2293 is displayed on the second display area 2263. can 22B, when the electronic device 2201 detects a drag operation on the cursor function panel 2290 displayed on the second display area 2263, the function corresponding to the drag operation, for example, the drag operation The cursor icon 2291 displayed on the first display area 2261 may be moved corresponding to the direction of .

As shown in FIG. 22C , the electronic device 2201 is based on detection of selection of an up and down scroll button 2293 included in a cursor function panel 2290 displayed on the second display area 2263. , the function corresponding to the selection of the upward scroll button 2293a, for example, the execution screen of the first application displayed on the first display area 2261 can be moved upward.

As shown in FIG. 22D , the electronic device 2201 detects the selection of the down scroll button from the up and down scroll button 2293 included in the cursor function panel 2290 displayed on the second display area 2263. , a function corresponding to the selection of the lower scroll button 2293ㅠ, for example, a screen for executing the first application displayed on the first display area 2261 may be moved downward. Various embodiments of the present disclosure According to, the electronic device (eg, the electronic device 301 of FIG. 3 ) includes a first housing (eg, the first housing 271 of FIG. 2A ), a second housing (eg, the second housing of FIG. 2A ( 274), a hinge that foldably connects one side of the first housing to one side of the second housing (eg, the hinge 281 of FIG. 2A), and a first display area provided in the first housing (eg, FIG. The first display area 261 of 2a, and the second display area provided to the second housing (eg, the second display area 263 of FIG. 2a) and the third display area (eg, the third display area of FIG. 2a) region 265) (e.g. display 260 of FIG. 2A) and at least one processor (e.g. processor 320 of FIG. Based on the state of the electronic device in the first state, the display is controlled to display the execution screen of the first application on the first display area and the second display area, and the display of the electronic device on the third display area. At least one default button for control is displayed, and based on a state of the electronic device that is changed from the first state to a second state in which the hinge is folded, the display is controlled in the second state to control the third state. A panel button for displaying a panel is added and displayed in the display area, and the execution screen of the first application is displayed on the first display area by controlling the display based on the selection of the panel button in the second state. and display a first panel including at least one control button for controlling the first application and at least one system button for controlling the system of the electronic device on the second display area. there is.

According to various embodiments, the processor additionally selects at least one control button for controlling the first application based on identifying the first application as an application type corresponding to the first panel; It may be configured to display the selected at least one control button for controlling the first application on the first panel by controlling the display.

According to various embodiments of the present disclosure, the processor additionally controls a plurality of applications in the second display area by controlling the display based on detection of selection of a button for displaying a next panel while displaying the first panel. It may be set to display a second panel including at least one common button for controlling the system of the electronic device and the at least one system button for controlling the system of the electronic device.

According to various embodiments of the present disclosure, the processor additionally controls the display to control a plurality of applications in the second display area based on identifying the first application as the type of application corresponding to the second panel. It may be set to display a second panel including at least one common button and the at least one system button for controlling the system of the electronic device.

According to various embodiments of the present disclosure, the processor may additionally be set to display at least one common button for controlling a plurality of applications on the first panel by controlling the display according to a display setting of the first panel. .

According to various embodiments, the processor may additionally set at least one operation button for controlling an operation related to the first application based on state information of the first application or a type of an external electronic device connected to the electronic device. and displaying the selected at least one operation button on the first panel together with the at least one system button by controlling the display.

According to various embodiments of the present disclosure, the processor may additionally determine rotation information, a location of the third display area, and the rotation information based on detecting rotation of the electronic device while displaying the first panel on the second display area. It may be set to adjust the location and size of the first panel based on information about the size of the second display area.

According to various embodiments, the processor may be configured to additionally change the position of the first panel or hide the first panel based on the type of gesture detected in the second display area.

According to various embodiments of the present disclosure, when the processor additionally confirms the execution of the second application based on selection of an application list providing button among at least one common button included in the second panel displayed on the second display area, the Control a display to display an execution screen of the first application on the first display area and display an execution screen of the second application on the second display area, and based on detection of selection of the second application, Controls the display to display an execution screen of the second application on the first display area, and controls at least one control button for controlling the second application and the system of the electronic device on the second display area. It may be set to display the first panel including the at least one system button for

According to various embodiments of the present disclosure, the processor may additionally perform the second display based on detection of selection of a button for providing a touch pad among at least one common button included in a second panel displayed on the second display area. A touch pad panel for controlling the first application is provided in an area, and based on detection of selection of a button for providing a cursor function among the at least one common button, the first application is displayed in the second display area. It can be set to provide a cursor function panel to control.

According to various embodiments, an electronic device (eg, the electronic device 301 of FIG. 3 ) includes a first housing (eg, the first housing 271 of FIG. 2A ) and a second housing (eg, the first housing 271 of FIG. 2A ). 2 housing 274, a hinge that foldably connects one side of the first housing to one side of the second housing (eg, hinge 281 of FIG. 2A), a folded state of the electronic device, and a posture of the electronic device At least one sensor (eg, sensor module 376 of FIG. 3 ) detecting , a first display area (eg, first display area 261 of FIG. 2A ) provided in the first housing, and the second housing A display (eg, the display 260 of FIG. 2A ) including a second display area (eg, the second display area 263 of FIG. 2A ) and a processor (eg, the processor 320 of FIG. 3 ) wherein the processor displays an execution screen of an application on the first display area and the second display area based on detecting that the folding state is in an unfolded state of the hinge, and receives information from the at least one sensor Based on the received sensor information, the hinge is changed from an unfolded state to a folded state, and the posture of the electronic device is based on detecting that the first display area is provided above the second display area. , Control the display to display the execution screen of the application on the first display area, and at least one control button for controlling the application and at least one control button for controlling the system of the electronic device on the second display area. It can be set to display a panel including system buttons of

23 is a flowchart 2300 illustrating an operation of providing a panel displayed on the second display area in an electronic device according to various embodiments. The providing operations of the panel may include operations 2301 to 2307. According to an embodiment, at least one of operations 2301 to 2307 may be omitted, the order of some operations may be changed, or another operation may be added. The providing operation of the panel is performed by the electronic device 101 of FIG. 1 , the processor 120 of FIG. 1 , the electronic device 201 of FIGS. 2A to 2C , the electronic device 301 of FIG. 3 , or the processor of FIG. 3 ( 320).

In operation 2301, the electronic device 301 starts the first display area (eg, the first display area 361 of FIG. 3 ) in the first state of the unfolded electronic device (eg, the first state of the electronic device of FIG. 2A ). )) and execution of the first application in the second display area (eg, the second display area 363 of FIG. 3 ).

According to an embodiment, the electronic device displays an execution screen of a first application while using the first display area and the second display area of the electronic device as one screen in an unfolded first state, and At least one default button (eg, at least one default button 265a of FIG. 2A ) for controlling the electronic device may be displayed on a third display area (eg, the third display area 365 of FIG. 3 ). , For example, a navigation bar including a recent app button, a home button, and a previous button may be displayed on the third display area.

In operation 2303, when the electronic device is folded, the electronic device 301 changes the electronic device to a second state (eg, the second state of the electronic device of FIG. 2B ), and in the second state, the first display area (eg, The first application is executed in the first display area 361 of FIG. 3 and the second display area (eg, the second display area 363 of FIG. 3 ), and the third display area (eg, the third display area 363 of FIG. A panel button (eg, the panel button 265b of FIG. 2B) may be displayed on 365).

According to an embodiment, in the electronic device, the first display area (eg, the first display area 361 of FIG. 3 ) of the electronic device is fixed according to the folding of the hinge (eg, the hinge 281 of FIG. 2A ). When the position is changed by an angle, the change to the second state may be detected using sensor information received from the sensor module of the electronic device.

According to an embodiment, in the second state, the electronic device displays an execution screen of a first application while using the first display area and the second display area of the electronic device as one screen, and the third display area is displayed. The panel button for panel display may be additionally displayed in the area along with at least one default button for controlling the electronic device.

In operation 2305, the electronic device 301 may identify the first application as the type of application for displaying the first panel based on detection of selection of the panel button.

According to an embodiment, the electronic device is based on detection of selection of a panel button displayed in the third display area in the second state of the electronic device (eg, the second state of the electronic device of FIG. 2B). Based on the type of the first application currently being executed, whether the first application is a type of application for displaying the first panel including at least one control button capable of controlling the application or all or a plurality of applications. It can be checked whether the application type for displaying the second panel including at least one common button that can be used in common for . The type of application for displaying the first panel and the type of application for displaying the second panel may be stored in the memory 330 .

In operation 2307, the electronic device 301 executes the first application on the first display area (eg, the first display area 361 of FIG. 3 ) of the electronic device and executes the first application on the second display area (eg, the second display area 361 of FIG. 3 ). A first panel may be displayed on the display area 363 .

According to an embodiment, the electronic device may display an execution screen of the first application on a first display area, and at least one control button capable of controlling the first application on a second display area, and the electronic device A first panel including at least one system button capable of controlling the system of the system may be displayed.

According to an embodiment, when displaying a floating first panel in the second display area, the electronic device divides the first panel into a first area and a second area, and displays the first panel in the first area. At least one control button capable of controlling one application may be displayed, and at least one system button capable of controlling a system of the electronic device may be displayed in the second area.

According to an embodiment, the electronic device displays the first panel in the second display area based on detection of selection of a button for displaying a next panel included in the first panel while displaying the first panel. A second panel including at least one common button commonly used in all or a plurality of applications and at least one system button capable of controlling a system of the electronic device may be displayed without displaying the panel.

24 is a flowchart 2400 illustrating an operation of providing a panel displayed on the second display area in an electronic device according to various embodiments. Operations of providing the panel may include operations 2401 to 2407. According to an embodiment, at least one of operations 2401 to 2407 may be omitted, the order of some operations may be changed, or another operation may be added. The providing operation of the panel is performed by the electronic device 101 of FIG. 1 , the processor 120 of FIG. 1 , the electronic device 201 of FIGS. 2A to 2C , the electronic device 301 of FIG. 3 , or the processor of FIG. 3 ( 320).

In operation 2401, the electronic device 301 starts the first display area (eg, the first display area 361 of FIG. 3 ) in the first state of the unfolded electronic device (eg, the first state of the electronic device of FIG. 2A ). )) and execution of the first application in the second display area (eg, the second display area 363 of FIG. 3 ).

In operation 2403, when the electronic device is folded, the electronic device 301 changes the electronic device to a second state (eg, the second state of the electronic device of FIG. 2B), and in the second state, the first display area (eg, The first application is executed in the first display area 361 of FIG. 3 and the second display area (eg, the second display area 363 of FIG. 3 ), and the third display area (eg, the third display area 363 of FIG. A panel button (eg, the panel button 265b of FIG. 2B) may be displayed on 365).

According to an embodiment, in the electronic device, the first display area (eg, the first display area 361 of FIG. 3 ) of the electronic device is fixed according to the folding of the hinge (eg, the hinge 281 of FIG. 2A ). When the position is changed by an angle, the change to the second state may be detected using sensor information received from a sensor module (eg, the sensor module 376 of FIG. 3 ) of the electronic device.

In operation 2405, the electronic device 301 may identify the first application as the type of application for displaying the second panel based on detection of selection of the panel button.

According to an embodiment, the electronic device is based on detection of selection of a panel button displayed in the third display area in the second state of the electronic device (eg, the second state of the electronic device of FIG. 2B). , whether the first application is a type of application for displaying the first panel including at least one control button capable of controlling the application based on the type of the first application currently being executed, or all or a plurality of applications. It is possible to check whether the application is a type for displaying the second panel including at least one common button that can be used in common with other users. The type of application for displaying the first panel and the type of application for displaying the second panel may be stored in the memory 330 .

In operation 2407, the electronic device 301 executes the first application on the first display area (eg, the first display area 361 of FIG. 3 ) of the electronic device and executes the first application on the second display area (eg, the second display area 361 of FIG. 3 ). A second panel may be displayed on the display area 363 .

According to an embodiment, the electronic device displays an execution screen of the first application on a first display area, and includes at least one common button commonly used for all or a plurality of applications on a second display area; and A second panel including at least one system button capable of controlling the system of the electronic device may be displayed.

According to an embodiment, the electronic device may divide the second panel into a first area and a second area in the same way as the first panel, and may commonly use the first area for all or a plurality of applications. At least one common button may be displayed, and at least one system button capable of controlling a system of the electronic device may be displayed in the second area.

According to various embodiments, a method of providing a panel for controlling an application in an electronic device may include, based on a state of the electronic device in a first state in which a hinge is unfolded, the hinge may include a first display area provided with a first hinge. configured to foldably connect one side of the housing to one side of a second housing provided with a second display area and a third display area, and display an execution screen of a first application on the first display area and the second display area; , displaying at least one default button for controlling the electronic device on the third display area, based on the state of the electronic device changed from the first state to a second state in which the hinge is folded, An operation of displaying a panel button for displaying a panel on the third display area in the second state, and displaying an execution screen of the first application on the first display area based on selection of the panel button in the second state. and displaying a first panel including at least one control button for controlling the first application and at least one system button for controlling a system of the electronic device on the second display area. there is.

According to various embodiments of the present disclosure, based on identifying the first application as an application type corresponding to the first panel, selecting at least one control button for controlling the first application, and the first application It may further include an operation of displaying the selected at least one control button for controlling the first panel.

According to various embodiments of the present disclosure, at least one common button for controlling a plurality of applications in the second display area based on detection of selection of a button for displaying the next panel while displaying the first panel and The method may further include displaying a second panel including the at least one system button capable of controlling the system of the electronic device.

According to various embodiments of the present disclosure, at least one common button for controlling a plurality of applications on the second display area and the electronic device based on identifying the type of the first application corresponding to the second panel. The method may further include displaying a second panel including the at least one system button capable of controlling the system.

According to various embodiments, an operation of displaying at least one common button for controlling a plurality of applications on the first panel according to a display setting of the first panel may be further included.

According to various embodiments, an operation of selecting at least one operation button for controlling an operation related to the first application based on state information of the first application or a type of an external electronic device connected to the electronic device; and The method may further include displaying the selected at least one operation button along with the at least one system button on the first panel.

According to various embodiments, while displaying the first panel on the second display area, based on detecting the rotation of the electronic device, rotation information, the position of the third display area, and the second display area An operation of adjusting the display position and size of the first panel based on the size information may be further included.

According to various embodiments, based on the type of gesture detected in the second display area, an operation of changing the location of the first panel or hiding the first panel may be further included.

According to various embodiments of the present disclosure, when the execution of the second application is confirmed based on the selection of the application list providing button among at least one common button included in the second panel displayed on the second display area, the second application is displayed on the first display area. Based on the operation of displaying the execution screen of the first application and displaying the execution screen of the second application on the second display area, and detection of the selection of the second application, the first application is displayed on the first display area. 2 displaying an execution screen of an application and including at least one control button for controlling the second application and at least one system button for controlling the system of the electronic device on the second display area; An operation of displaying one panel may be further included.

According to various embodiments of the present disclosure, based on detection of selection of a button for providing a touch pad among at least one common button included in a second panel displayed on the second display area, the first display area is displayed on the second display area. providing a touch pad panel for controlling an application; and

The method may further include providing a cursor function panel for controlling the first application in the second display area based on detection of selection of a button for providing a cursor function among the at least one common button.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 436 or external memory 438) readable by a machine (eg, electronic device 401). It may be implemented as software (eg, the program 440) including them. For example, a processor (eg, the processor 420) of a device (eg, the electronic device 401) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium readable by a device such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

Claims

In electronic devices,

a first housing;

a second housing;

a hinge connecting one side of the first housing to one side of the second housing in a foldable manner;

a display including a first display area provided on the first housing, and a second display area and a third display area provided on the second housing; and

including at least one processor, the processor comprising:

Based on the state of the electronic device in the first state in which the hinge is unfolded, the display is controlled to display an execution screen of a first application in the first display area and the second display area, and the third display displaying at least one default button for controlling the electronic device in an area;

Based on the state of the electronic device that is changed from the first state to the second state in which the hinge is folded, the display is controlled in the second state and a panel button for displaying a panel is added to the third display area. display,

Based on the selection of the panel button in the second state, controlling the display to display the execution screen of the first application on the first display area and controlling the first application on the second display area An electronic device configured to display a first panel including at least one control button and at least one system button for controlling a system of the electronic device.
The method of claim 1, wherein the processor additionally,

Based on identifying the first application as an application type corresponding to the first panel, at least one control button for controlling the first application is selected, and the display is controlled to control the first application. An electronic device configured to display the selected at least one control button for performing the operation on the first panel.
The method of claim 1, wherein the processor additionally,

At least one common button for controlling a plurality of applications in the second display area by controlling the display based on detection of selection of a button for displaying the next panel while displaying the first panel, and the electronic device An electronic device configured to display a second panel including the at least one system button for controlling the system of the electronic device.
The method of claim 1, wherein the processor additionally,

At least one common button for controlling a plurality of applications in the second display area by controlling the display based on identifying the first application as the type of application corresponding to the second panel and the system of the electronic device An electronic device configured to display a second panel including the at least one system button for controlling the system.
The method of claim 1, wherein the processor additionally,

An electronic device configured to display at least one common button for controlling a plurality of applications on the first panel by controlling the display according to a display setting of the first panel.
The method of claim 1, wherein the processor additionally,

At least one operation button for controlling an operation related to the first application is selected based on the state information of the first application or the type of an external electronic device connected to the electronic device, and the display is controlled to control the at least one operation button. An electronic device configured to display the selected at least one operation button along with the system buttons of the first panel.
The method of claim 1, wherein the processor additionally,

While the first panel is displayed on the second display area, based on detecting rotation of the electronic device, based on rotation information, information about the location of the third display area, and the size of the second display area. An electronic device set to adjust the position and size of the first panel by
The method of claim 1, wherein the processor additionally,

The electronic device configured to change the location of the first panel or hide the first panel based on the type of gesture detected in the second display area.
The method of claim 1, wherein the processor additionally,

When the execution of the second application is confirmed based on the selection of the application list providing button among at least one common button included in the second panel displayed on the second display area, the display is controlled to display the above information on the first display area. displaying an execution screen of a first application and displaying an execution screen of a second application in the second display area;

Based on detection of the selection of the second application, at least for controlling the display to display an execution screen of the second application on the first display area, and controlling the second application on the second display area. The electronic device configured to display the first panel including one control button and the at least one system button for controlling the system of the electronic device.
The method of claim 1, wherein the processor additionally,

A touch for controlling the first application on the second display area based on detection of selection of a button for providing a touch pad among at least one common button included in the second panel displayed on the second display area. providing a pad panel;

An electronic device configured to provide a cursor function panel for controlling the first application in the second display area based on detection of selection of a button for providing a cursor function among the at least one common button.
A method for providing a panel for controlling an application in an electronic device,

Based on the state of the electronic device in the first state in which the hinge is unfolded, the hinge connects one side of the first housing provided with the first display area to one side of the second housing provided with the second display area and the third display area. It is configured to be connected in a foldable manner, display an execution screen of a first application on the first display area and the second display area, and display at least one default button for controlling the electronic device on the third display area. action;

displaying a panel button for displaying a panel on the third display area in the second state based on a state of the electronic device changed from the first state to a second state in which the hinge is folded; and

Based on the selection of the panel button in the second state, at least one control button for displaying an execution screen of the first application on the first display area and controlling the first application on the second display area. and displaying a first panel including at least one system button for controlling a system of the electronic device.
According to claim 11,

selecting at least one control button for controlling the first application based on identifying the first application as an application type corresponding to the first panel; and

The method further comprising displaying the selected at least one control button for controlling the first application on the first panel.
According to claim 11,

Based on detection of selection of a button for displaying the next panel while displaying the first panel, at least one common button for controlling a plurality of applications in the second display area and the system of the electronic device The method further comprising displaying a second panel including the at least one controllable system button.
According to claim 11,

At least one common button for controlling a plurality of applications on the second display area and the system of the electronic device may be controlled based on identifying the type of the first application corresponding to the second panel. The method further comprising an operation of displaying a second panel including the at least one system button.
In electronic devices,

a first housing;

a second housing;

a hinge connecting one side of the first housing to one side of the second housing in a foldable manner;

at least one sensor for detecting a folding state of the electronic device and a posture of the electronic device;

a display including a first display area provided on the first housing and a second display area provided on the second housing; and

It includes a processor, the processor comprising:

displaying an execution screen of an application in the first display area and the second display area based on the detection that the folding state is in an unfolded state of the hinge;

Based on sensor information received from the at least one sensor, the hinge is changed from an unfolded state to a folded state, and the posture of the electronic device is such that the first display area is provided above the second display area. Based on the detection, at least one control button for controlling the display to display the execution screen of the application on the first display area and controlling the application on the second display area and the system of the electronic device An electronic device configured to display a panel including at least one system button for controlling a device.