KR20240050225A - Electronic device and method for controlling screen according to user interaction using the same - Google Patents

Abstract

According to various embodiments of the present disclosure, an electronic device includes a first surface, a second surface facing in an opposite direction to the first surface, and a second surface surrounding the first space between the first surface and the second surface. It may include a first housing including a side member. In one embodiment, the electronic device is foldably connected to the first housing based on a folding axis using a hinge structure, and in the unfolded state, a third side facing the same direction as the first side, the third side It may include a second housing including a fourth side facing in the opposite direction, and a second side member surrounding a second space between the third side and the fourth side. In one embodiment, the electronic device may include a first display disposed from at least part of the first side to at least part of the third side. In one embodiment, the electronic device may include a sensor circuit. In one embodiment, the electronic device may include a processor operatively connected to the first display and the sensor circuit. In one embodiment, the processor may display first information of the first application on the first display. In one embodiment, the processor may display second information of the second application and first information of the first application in a multi-window on the first display in response to an input for executing a second application. . In one embodiment, the processor may obtain sensor information through the sensor circuit. In one embodiment, when it is confirmed that user interaction is detected on the second side or the fourth side based on the obtained sensor information, the processor determines the type of user interaction and the detected user interaction. You can check location information. In one embodiment, the processor displays at least one display property of first information of the first application and second information of the second application, based on the type of the user interaction and the location information at which the user interaction was detected. can be changed. In one embodiment, the processor may display at least one of the first information and the second information on the first display based on the changed display properties.
Various other embodiments other than those disclosed in this document may be possible.

Description

Screen control method according to electronic device and user interaction using the same {ELECTRONIC DEVICE AND METHOD FOR CONTROLLING SCREEN ACCORDING TO USER INTERACTION USING THE SAME}

Embodiments of the present disclosure relate to an electronic device and a screen control method according to user interaction using the same.

Recently, electronic devices are moving away from the uniform rectangular shape and are being transformed into various shapes. For example, an electronic device may have a deformable structure that can adjust the size of the display to satisfy the portability and usability of the electronic device. An electronic device having a deformable structure may include a foldable electronic device or a slideable electronic device in which at least two housings operate in a manner in which at least two housings are folded or unfolded relative to each other.

For example, an electronic device may provide screens of a plurality of applications through a display that is adjusted as at least two housings are folded or unfolded relative to each other. In particular, an electronic device can provide a multi-window function that can simultaneously display information from a plurality of applications in one display area through a display. That is, the electronic device can divide the display into a plurality of areas and display information about multiple applications running simultaneously in the divided areas.

Electronic devices require a method for controlling information on multiple applications displayed through a display.

The electronic device according to an embodiment of the present disclosure detects user interaction on the back of the electronic device through a sensor circuit while information on a plurality of applications is displayed on the display, and detects the status of the electronic device and information on the user interaction (e.g. : You can check user interaction type information and/or location information where user interaction was detected. The electronic device changes the display attribute of at least one of the information of the plurality of applications based on the confirmed status of the electronic device and information about the user interaction, and displays the information of the at least one application on the display based on the changed display attribute. It can be displayed.

An electronic device according to an embodiment of the present disclosure includes a first side, a second side facing in a direction opposite to the first side, and a first side surrounding the first space between the first side and the second side. It may include a first housing including a member. In one embodiment, the electronic device is foldably connected to the first housing based on a folding axis using a hinge structure, and in the unfolded state, a third side facing the same direction as the first side, the third side It may include a second housing including a fourth side facing in the opposite direction, and a second side member surrounding a second space between the third side and the fourth side. In one embodiment, the electronic device may include a first display disposed from at least part of the first side to at least part of the third side. In one embodiment, the electronic device may include a sensor circuit. In one embodiment, the electronic device may include a processor operatively connected to the first display and the sensor circuit. In one embodiment, the processor may display first information of the first application on the first display. In one embodiment, the processor may display second information of the second application and first information of the first application in a multi-window on the first display in response to an input for executing the second application. . In one embodiment, the processor may obtain sensor information through the sensor circuit. In one embodiment, when it is confirmed that user interaction is detected on the second side or the fourth side based on the obtained sensor information, the processor determines the type of user interaction and the detected user interaction. You can check location information. In one embodiment, the processor displays at least one display attribute of first information of the first application and second information of the second application, based on the type of the user interaction and the location information at which the user interaction was detected. can be changed. In one embodiment, the processor may display at least one of the first information and the second information on the first display based on the changed display properties.

A screen control method according to user interaction of an electronic device according to an embodiment of the present disclosure may include displaying first information of a first application on a first display. In one embodiment, a screen control method according to user interaction of an electronic device includes displaying second information of the second application and first information of the first application in a multi-window in response to an input for executing a second application. It may include an operation of displaying information on the first display. In one embodiment, a screen control method based on user interaction of an electronic device may include acquiring sensor information through a sensor circuit. In one embodiment, the screen control method according to user interaction of the electronic device includes, when it is confirmed that user interaction on the second or fourth side of the electronic device is detected based on the obtained sensor information, the user It may include checking the type of interaction and location information where the user interaction was detected. In one embodiment, a screen control method according to user interaction of an electronic device includes first information of the first application and first information of the second application based on the type of the user interaction and location information at which the user interaction was detected. It may include an operation to change the display attribute of at least one of the two pieces of information. In one embodiment, a screen control method according to user interaction of an electronic device includes displaying at least one of the first information and the second information on the first display based on the changed display properties. can do.

According to one embodiment of the present disclosure, a non-transitory computer-readable storage medium (or computer program product) storing one or more programs may be described. One or more programs according to an embodiment may include instructions that, when executed by a processor of an electronic device, display first information of the first application on the first display. One or more programs, when executed by a processor of an electronic device, in response to an input for executing a second application, displaying second information of the second application and first information of the first application in a multi-window. It can include commands displayed in . One or more programs may include instructions for obtaining sensor information through a sensor circuit. When it is confirmed that user interaction is detected on the second or fourth side of the electronic device based on the acquired sensor information, the one or more programs provide information on the type of user interaction and the location where the user interaction was detected. It may include a command to check. The one or more programs include instructions for changing the display attribute of at least one of first information of the first application and second information of the second application based on the type of user interaction and location information where the user interaction was detected. may include. One or more programs may include instructions for displaying at least one of the first information and the second information on the first display based on the changed display properties.

An electronic device according to an embodiment of the present disclosure changes the display properties of information of an application displayed on the display based on user interaction detected on the back of the electronic device in addition to direct user input (e.g., touch input) using the display. By displaying it, convenient usability can be provided to the user.

1 is a block diagram of an electronic device in a network environment, according to an embodiment of the present disclosure.
FIGS. 2A and 2B are front and rear views of an unfolding state of an electronic device (eg, a foldable electronic device) according to an embodiment of the present disclosure.
3A and 3B are diagrams showing a folded state of an electronic device viewed from the front and rear, according to an embodiment of the present disclosure.
FIG. 4 is a diagram schematically showing an exploded perspective view of an electronic device according to an embodiment of the present disclosure.
Figure 5 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.
FIG. 6A is a flowchart illustrating a screen control method according to user interaction of an electronic device, according to an embodiment of the present disclosure.
FIG. 6B is a flowchart for explaining operation 640 of FIG. 6A described above, according to an embodiment of the present disclosure.
FIG. 7A is a diagram illustrating user interaction that can be detected when the electronic device is in an unfolded state, according to an embodiment of the present disclosure.
7B and 7C are diagrams for explaining a method for detecting user interaction according to an embodiment of the present disclosure.
FIG. 8 is a diagram illustrating a method of correcting sensor data of user interaction based on the state of an electronic device, according to an embodiment of the present disclosure.
FIGS. 9A and 9B are diagrams for explaining a method of correcting sensor data of user interaction using sensor information acquired through an inertial sensor, according to an embodiment of the present disclosure.
FIGS. 10A and 10B are diagrams for explaining the operation of the resampling unit of FIG. 7B according to an embodiment of the present disclosure.
FIG. 11 is a diagram for explaining the operation of the sloping unit of FIG. 7B according to an embodiment of the present disclosure.
FIG. 12 is a diagram for explaining the operation of the peak identification unit of FIG. 7B according to an embodiment of the present disclosure.
FIG. 13 is a diagram for explaining the operation of the cluster generator of FIG. 7B according to an embodiment of the present disclosure.
Figure 14 is a diagram for explaining the operation of an artificial intelligence model according to an embodiment of the present disclosure.
FIGS. 15A and 15B are diagrams for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.
FIG. 16 is a diagram for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.
FIG. 17 is a diagram for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.
FIG. 18 is a diagram for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.
FIG. 19 is a diagram for explaining a method of correcting sensor data of user interaction according to the grip of an electronic device, according to an embodiment of the present disclosure.
FIG. 20 is a diagram for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.
FIGS. 21A and 21B are diagrams for explaining a method of correcting sensor data of user interaction according to the grip of an electronic device, according to an embodiment of the present disclosure.
FIG. 22 is a diagram for explaining a method of correcting sensor data of user interaction according to the grip of an electronic device, according to an embodiment of the present disclosure.
FIG. 23 is a diagram illustrating a method of displaying information on a plurality of applications in an unfolded state of an electronic device, according to an embodiment of the present disclosure.
FIG. 24 is a diagram illustrating user interaction detected when the electronic device is in an unfolded state, according to an embodiment of the present disclosure.
FIG. 25 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 26 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 27 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIGS. 28A and 28B are diagrams for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIGS. 29A and 29B are diagrams for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 30 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 31 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 32 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 33 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIGS. 34A and 34B are diagrams for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 35A is a plan view showing the front of the electronic device in an unfolded state, according to an embodiment of the present disclosure.
FIG. 35B is a plan view illustrating the rear of the electronic device in an unfolded state, according to an embodiment of the present disclosure.
Figure 36A is a perspective view showing a folding state of an electronic device, according to an embodiment of the present disclosure.
Figure 36b is a perspective view showing an intermediate state of an electronic device, according to an embodiment of the present disclosure.
FIG. 37 is a diagram for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.
FIG. 38 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 39 is a diagram for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
40A and 40B are diagrams for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.
FIG. 41 is a diagram for explaining various form factors of an electronic device according to an embodiment of the present disclosure.
FIG. 42 is a diagram for explaining a method of setting a function according to user interaction, according to an embodiment of the present disclosure.

1 is a block diagram of an electronic device 101 in a network environment 100, according to an embodiment of the present disclosure.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or operations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a auxiliary processor 123, the auxiliary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, coprocessor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g. : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band), for example, to achieve a high data rate. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, printed circuit board (PCB)). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, connected to the plurality of antennas by the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 does not execute the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIGS. 2A and 2B are front and rear views of an unfolding state of an electronic device (eg, a foldable electronic device) according to an embodiment of the present disclosure. 3A and 3B are diagrams showing a folded state of an electronic device viewed from the front and rear, according to an embodiment of the present disclosure.

According to various embodiments, the embodiments disclosed in FIG. 1 may be included in the embodiments disclosed in FIGS. 2A to 3B. For example, the electronic device 200 disclosed in FIGS. 2A to 3B includes the processor 120, memory 130, input module 150, audio output module 155, display module 160, and Audio module 170, sensor module 176, interface 177, connection terminal 178, haptic module 179, camera module 180, antenna module 197, and/or subscriber identification module 196. may include. The electronic device disclosed in FIGS. 2A to 3B may include a foldable electronic device 200.

2A to 3B, electronic devices 200 (e.g., foldable electronic devices) according to various embodiments of the present disclosure include a hinge device (e.g., the hinge plate 320 of FIG. 4) so that they can be folded relative to each other. ))) (e.g., a hinge module), a pair of housings (210, 220) (e.g., a foldable housing structure), a pair of housings (210, A flexible display 230 (e.g., a first display, a foldable display, or a main display) disposed through 220), and/or a sub-display 300 disposed through the second housing 220. (e.g., a second display) may be included.

According to various embodiments, at least a portion of the hinge device (e.g., the hinge plate 320 in FIG. 4) is disposed so as not to be visible from the outside through the first housing 210 and the second housing 220, and is displayed in the unfolded state. , It can be arranged to be invisible from the outside through a hinge cover 310 (e.g., hinge housing) that covers the foldable portion. In this document, the side on which the flexible display 230 is placed may be defined as the front of the electronic device 200, and the side opposite to the front may be defined as the back of the electronic device 200. The surface surrounding the space between the front and back may be defined as the side of the electronic device 200.

According to various embodiments, a pair of housings 210 and 220 includes a first housing 210 and a second housing arranged to be foldable relative to each other through a hinge device (e.g., the hinge plate 320 of FIG. 4). 2 It may include a housing 220. The pair of housings 210 and 220 is not limited to the shape and combination shown in FIGS. 2A and 3B, and may be implemented by combining and/or combining other shapes or parts. The first housing 210 and the second housing 220 are disposed on both sides of the folding axis A, and may have an overall symmetrical shape with respect to the folding axis A. According to some embodiments, the first housing 210 and the second housing 220 may be folded asymmetrically with respect to the folding axis A. The angle or distance between the first housing 210 and the second housing 220 may be different from each other depending on whether the electronic device 200 is in an unfolded state, a folded state, or an intermediate state.

According to various embodiments, the first housing 210 is connected to a hinge device (e.g., the hinge plate 320 of FIG. 4) in the unfolded state of the electronic device 200, and covers the front of the electronic device 200. The first side 211 arranged to face, the second side 212 facing in the opposite direction of the first side 211, and/or the first space between the first side 211 and the second side 212 It may include a first side member 213 surrounding at least a portion of 2101. According to one embodiment, the first side member 213 includes a first side 213a having a first length along a first direction (e.g., x-axis direction), and a direction substantially perpendicular to the first side 213a. a second side 213c extending along (e.g. -y-axis direction) to have a second length longer than the first length, and extending substantially parallel to the first side 213a from the second side 213c; It may include a third side 213b having a first length.

According to various embodiments, the second housing 220 is connected to a hinge device (e.g., the hinge plate 320 of FIG. 4) in the unfolded state of the electronic device 200, and covers the front of the electronic device 200. A third side 221 arranged to face, a fourth side 222 facing in the opposite direction of the third side 221, and/or a second space between the third side 221 and the fourth side 222. It may include a second side member 223 surrounding at least a portion of 2201 . According to one embodiment, the second side member 223 has a fourth side 223a having a first length along a first direction (e.g., x-axis direction), and a direction substantially perpendicular to the fourth side 223a. a fifth side 223c extending along the -y axis direction to have a second length longer than the first length, and extending substantially parallel to the fourth side 223a from the fifth side 223c; It may include a sixth side 223b having a first length.

According to various embodiments, the first side 211 may face substantially the same direction as the third side 221 in the unfolded state, and may be at least partially facing the third side 221 in the folded state. there is.

According to various embodiments, the electronic device 200 may include a recess 201 formed to accommodate the flexible display 230 through structural coupling of the first housing 210 and the second housing 220. . The recess 201 may have substantially the same size as the flexible display 230.

According to various embodiments, the hinge cover 310 (eg, hinge housing) may be disposed between the first housing 210 and the second housing 220. The hinge cover 310 may be arranged to cover a portion (eg, at least one hinge module) of the hinge device (eg, the hinge plate 320 in FIG. 4). The hinge cover 310 may be covered by a portion of the first housing 210 and the second housing 220 or exposed to the outside depending on the unfolded state, the folded state, or the intermediate state of the electronic device 200. there is.

According to various embodiments, when the electronic device 200 is in an unfolded state, at least a portion of the hinge cover 310 may be covered by the first housing 210 and the second housing 220 and may not be substantially exposed. . When the electronic device 200 is in a folded state, at least a portion of the hinge cover 310 may be exposed to the outside between the first housing 210 and the second housing 220. When the first housing 210 and the second housing 220 are in an intermediate state where they are folded with a certain angle, the hinge cover 310 is folded with the first housing 210 and the second housing 220. It may be at least partially exposed to the outside of the electronic device 200. For example, the area of the hinge cover 310 exposed to the outside may be smaller than when it is fully folded. The hinge cover 310 may at least partially include a curved surface.

According to various embodiments, when the electronic device 200 is in an unfolded state (e.g., the state of FIGS. 2A and 2B), the first housing 210 and the second housing 220 form an angle of about 180 degrees, The first area 230a, the second area 230b, and the folding area 230c of the flexible display 230 form the same plane and may be arranged to face substantially the same direction (e.g., z-axis direction). .

According to various embodiments, when the electronic device 200 is in a folded state (e.g., the state of FIGS. 3A and 3B), the first side 211 of the first housing 210 and the second housing 220 The third sides 221 may be arranged to face each other. In this case, the first area 230a and the second area 230b of the flexible display 230 form a narrow angle (e.g., in the range of 0 degrees to about 10 degrees) with each other through the folding area 230c. They can also be arranged to face each other. In another embodiment, when the electronic device 200 is in a folded state, the first housing 210 rotates at an angle of about 360 degrees with respect to the second housing 220 to form the second side 212 and the fourth side 222. ) can also be folded in the opposite direction so that they face each other (e.g. out folding method).

According to various embodiments, at least a portion of the folding area 230c may be transformed into a curved shape with a predetermined curvature. When the electronic device 200 is in an intermediate state, the first housing 210 and the second housing 220 may be disposed at a certain angle to each other. In this case, the first area 230a and the second area 230b of the flexible display 230 may form an angle that is larger than that in the folded state and smaller than that in the unfolded state, and the curvature of the folding area 230c is similar to that in the folded state. It can be smaller than the case and larger than the expanded state.

According to various embodiments, the first housing 210 and the second housing 220 are folded at a specified folding angle between a folded state and an unfolded state through a hinge device (e.g., hinge plate 320 in FIG. 4). A stopping angle can be formed (e.g. free stop function). In some embodiments, the first housing 210 and the second housing 220 are unfolded or folded in an unfolding or folding direction based on a specified inflection angle through a hinge device (e.g., hinge plate 320 in FIG. 4). Therefore, it can be operated continuously while being pressurized.

According to various embodiments, the electronic device 200 includes at least one display (e.g., flexible display 230, sub-display 300) disposed in the first housing 210 and/or the second housing 220. ), input device 215, audio output device (227, 228), sensor module (217a, 217b, 226), camera module (216a, 216b, 225), key input device (219), indicator (not shown) , or it may include at least one of the connector ports 229. In some embodiments, the electronic device 200 may omit at least one of the above-described components or may additionally include at least one other component.

According to various embodiments, at least one display (e.g., flexible display 230, sub-display 300) is connected to a hinge device (e.g., of FIG. 4) from the first side 211 of the first housing 210. In the internal space of the flexible display 230 (e.g., the first display) and the second housing 220, which are disposed to be supported by the third side 221 of the second housing 220 through the hinge plate 320) It may include a sub-display 300 (eg, a second display) disposed to be at least partially visible from the outside through the fourth surface 222. In some embodiments, the sub-display 300 may be arranged to be visible from the outside through the second surface 212 in the internal space of the first housing 210. According to one embodiment, the flexible display 230 can be mainly used in the unfolded state of the electronic device 200, and the sub-display 300 can be mainly used in the folded state of the electronic device 200. According to one embodiment, in the intermediate state, the electronic device 200 displays the flexible display 230 and/or the sub-display 300 based on the folding angles of the first housing 210 and the second housing 220. You can also control its availability.

According to various embodiments, the flexible display 230 may be disposed in an accommodation space formed by a pair of housings 210 and 220. For example, the flexible display 230 may be placed in a recess 201 formed by a pair of housings 210 and 220 and, in an unfolded state, may be positioned on the front of the electronic device 200. It can be arranged to occupy practically most of the space. According to one embodiment, at least some areas of the flexible display 230 may be transformed into a flat or curved surface. The flexible display 230 includes a first area 230a facing the first housing 210, a second area 230b facing the second housing 220, and a first area 230a and a second area ( 230b) and may include a folding area 230c facing a hinge device (eg, the hinge plate 320 of FIG. 4). According to one embodiment, the area division of the flexible display 230 is only an exemplary physical division by a pair of housings 210 and 220 and a hinge device (e.g., the hinge plate 320 in FIG. 4), and is actually divided into two regions. Through a pair of housings 210 and 220 and a hinge device (eg, hinge plate 320 in FIG. 4), the flexible display 230 can be displayed as a seamless, single entire screen. The first area 230a and the second area 230b may have an overall symmetrical shape or a partially asymmetrical shape with respect to the folding area 230c.

According to various embodiments, the electronic device 200 includes a first rear cover 240 disposed on the second side 212 of the first housing 210 and a fourth side 222 of the second housing 220. It may include a second rear cover 250 disposed on. In some embodiments, at least a portion of the first rear cover 240 may be formed integrally with the first side member 213. In some embodiments, at least a portion of the second rear cover 250 may be formed integrally with the second side member 223. According to one embodiment, at least one of the first back cover 240 and the second back cover 250 is a substantially transparent plate (e.g., a glass plate including various coating layers, or a polymer plate) or an opaque plate. can be formed.

According to various embodiments, the first back cover 240 may be, for example, coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or any of the foregoing materials. It can be formed by an opaque plate, such as a combination of at least two of them. The second back cover 250 may be formed through a substantially transparent plate, for example glass or polymer. In this case, the second display 300 may be arranged in the inner space of the second housing 220 to be visible from the outside through the second rear cover 250.

According to various embodiments, the input device 215 may include a microphone. In some embodiments, input device 215 may include a plurality of microphones arranged to detect the direction of sound.

According to various embodiments, the sound output devices 227 and 228 may include speakers. According to one embodiment, the sound output devices 227 and 228 include a call receiver 227 disposed through the fourth side 222 of the second housing 220 and the second side of the second housing 220. It may include an external speaker 228 disposed through at least a portion of the member 223. In some embodiments, the input device 215, the audio output devices 227, 228, and the connector port 229 are disposed in spaces of the first housing 210 and/or the second housing 220, and It may be exposed to the external environment through at least one hole formed in the first housing 210 and/or the second housing 220. In some embodiments, the holes formed in the first housing 210 and/or the second housing 220 may be commonly used for the input device 215 and the audio output devices 227 and 228. In some embodiments, the sound output devices 227 and 228 may include speakers (e.g., piezo speakers) that operate without the holes formed in the first housing 210 and/or the second housing 220. there is.

According to various embodiments, the camera modules 216a, 216b, and 225 include a first camera module 216a disposed on the first surface 211 of the first housing 210, and a first camera module 216a disposed on the first surface 211 of the first housing 210. It may include a second camera module 216b disposed on the second side 212, and/or a third camera module 225 disposed on the fourth side 222 of the second housing 220. According to one embodiment, the electronic device 200 may include a flash 218 disposed near the second camera module 216b. Flash 218 may include, for example, a light emitting diode or a xenon lamp. According to one embodiment, the camera modules 216a, 216b, and 225 may include one or more lenses, an image sensor, and/or an image signal processor. In some embodiments, at least one of the camera modules 216a, 216b, 225 includes two or more lenses (e.g., wide-angle and telephoto lenses) and image sensors, and includes a first housing 210 and/ Alternatively, they may be placed together on one side of the second housing 220.

According to various embodiments, the sensor modules 217a, 217b, and 226 may generate electrical signals or data values corresponding to the internal operating state of the electronic device 200 or the external environmental state. According to one embodiment, the sensor modules 217a, 217b, and 226 include a first sensor module 217a disposed on the first surface 211 of the first housing 210, and a second sensor module 217a disposed on the first surface 211 of the first housing 210. It may include a second sensor module 217b disposed on the surface 212, and/or a third sensor module 226 disposed on the fourth surface 222 of the second housing 220. In some embodiments, the sensor modules 217a, 217b, and 226 may include a gesture sensor, a grip sensor, a color sensor, an infrared (IR) sensor, an illumination sensor, an ultrasonic sensor, an iris recognition sensor, or a distance detection sensor (e.g., a time-of-flight (TOF) sensor. of flight sensor or LiDAR (light detection and ranging).

According to various embodiments, the electronic device 200 may further include at least one of a sensor module not shown, for example, an air pressure sensor, a magnetic sensor, a biometric sensor, a temperature sensor, a humidity sensor, or a fingerprint recognition sensor. You can. In some embodiments, the fingerprint recognition sensor may be disposed through at least one of the first side member 213 of the first housing 210 and/or the second side member 223 of the second housing 220. It may be possible.

According to various embodiments, the key input device 219 may be arranged to be exposed to the outside through the first side member 213 of the first housing 210. In some embodiments, the key input device 219 may be disposed to be exposed to the outside through the second side member 223 of the second housing 220. In some embodiments, the electronic device 200 may not include some or all of the key input devices 219, and the key input devices 219 that are not included may be displayed on at least one display 230 or 300. It can be implemented in other forms, such as soft keys. In another embodiment, the key input device 219 may be implemented using a pressure sensor included in at least one display 230 or 300.

According to various embodiments, the connector port 229 is a connector (e.g., a USB connector) for transmitting and receiving power and/or data with an external electronic device (e.g., the external electronic devices 102, 104, and 108 of FIG. 1A). Alternatively, it may include an IF module (interface connector port module). In some embodiments, the connector port 229 performs a function for transmitting and receiving audio signals with an external electronic device, or further includes a separate connector port (e.g., an ear jack hole) for performing a function for transmitting and receiving audio signals. You may.

According to various embodiments, at least one camera module 216a, 225 among the camera modules 216a, 216b, and 225, and at least one sensor module 217a, 226 among the sensor modules 217a, 217b, and 226. , and/or the indicator may be arranged to be exposed through at least one display (230, 300). For example, at least one camera module (216a, 225), at least one sensor module (217a, 226), and/or an indicator are displayed in the inner space of at least one housing (210, 220), at least one display ( 230, 300), an opening disposed below the active area (display area) and perforated up to the cover member (e.g., the window layer (not shown) of the flexible display 230 and/or the second rear cover 250) or It can be placed so that it can come into contact with the external environment through a transparent area. According to one embodiment, the area where at least one display (230, 300) and at least one camera module (216a, 225) face each other may be formed as a transparent area with a certain transmittance as part of the area for displaying content. . According to one embodiment, the transparent area may be formed to have a transmittance ranging from about 5% to about 20%. The transmission area may include an area overlapping an effective area (eg, field of view area) of at least one camera module 216a or 225 through which light for generating an image is formed by the image sensor. For example, the transmission area of at least one of the displays 230 and 300 may include an area with a lower pixel density than the surrounding area. For example, a transparent area can replace an opening. For example, at least one camera module 216a, 225 may include an under display camera (UDC) or an under panel camera (UPC). In another embodiment, some camera modules or sensor modules 217a and 226 may be arranged to perform their function without being visually exposed through the display. For example, the area facing the camera modules 216a, 225 and/or sensor modules 217a, 226 disposed below at least one display 230, 300 (e.g., display panel) is an under display (UDC). camera structure, a perforated opening may be unnecessary.

FIG. 4 is a diagram schematically showing an exploded perspective view of an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 4, the electronic device 200 includes a flexible display 230 (e.g., a first display), a sub-display 300 (e.g., a second display), a hinge plate 320, and a pair of support members. (e.g., first support member 261, second support member 262), at least one substrate 270 (e.g., printed circuit board (PCB)), first housing 210, 2 It may include a housing 220, a first rear cover 240, and/or a second rear cover 250.

According to various embodiments, the flexible display 230 includes a display panel 430 (e.g., a flexible display panel), a support plate 450 disposed below the display panel 430 (e.g., in the -z-axis direction), And it may include a pair of metal plates 461 and 462 disposed below the support plate 450 (eg, -z-axis direction).

According to various embodiments, the display panel 430 includes a first panel area 430a corresponding to a first area of the flexible display 230 (e.g., the first area 230a in FIG. 2A), and a first panel area. A second panel area 430b extending from 430a and corresponding to the second area of the flexible display 230 (e.g., the second area 230b in FIG. 2A), and the first panel area 430a and the second panel area 430b It may connect the two panel areas 430b and include a third panel area 430c corresponding to the folding area of the flexible display 230 (e.g., the folding area 230c in FIG. 2A).

According to various embodiments, the support plate 450 is disposed between the display panel 430 and a pair of support members 261 and 262, and includes a first panel area 430a and a second panel area 430b. It may be formed to have a material and shape to provide a planar support structure for and a bendable structure to help with flexibility in the third panel area 430c. According to one embodiment, the support plate 450 may be formed of a conductive material (eg, metal) or a non-conductive material (eg, polymer or fiber reinforced plastics (FRP)). According to one embodiment, the pair of metal plates 461 and 462 is between the support plate 450 and the pair of support members 261 and 262, to form the first panel area 430a and the third panel. A first metal plate 461 disposed to correspond to at least a portion of the region 430c and a second metal plate 462 disposed to correspond to at least a portion of the second panel region 430b and the third panel region 430c. may include. According to one embodiment, the pair of metal plates 461 and 462 are made of a metal material (eg, SUS), thereby helping to strengthen the ground connection structure and rigidity of the flexible display 230.

According to various embodiments, the sub-display 300 may be disposed in the space between the second housing 220 and the second rear cover 250. According to one embodiment, the sub-display 300 is visible from the outside through substantially the entire area of the second rear cover 250 in the space between the second housing 220 and the second rear cover 250. can be placed.

According to various embodiments, at least a portion of the first support member 261 may be foldably coupled to the second support member 262 through the hinge plate 320. According to one embodiment, the electronic device 200 includes at least one wiring member disposed from at least a portion of the first support member 261 across the hinge plate 320 to a portion of the second support member 262. 263) (e.g., flexible printed circuit board (FPCB)). According to one embodiment, the first support member 261 may be arranged to extend from the first side member 213 or to be structurally coupled to the first side member 213. According to one embodiment, the electronic device 200 may include a first space (e.g., first space 2101 in FIG. 2A) provided through the first support member 261 and the first rear cover 240. there is.

According to various embodiments, the first housing 210 (e.g., a first housing structure) is formed through a combination of the first side member 213, the first support member 261, and the first rear cover 240. It can be configured. According to one embodiment, the second support member 262 may be arranged to extend from the second side member 223 or to be structurally coupled to the second side member 223. According to one embodiment, the electronic device 200 may include a second space (e.g., the second space 2201 in FIG. 2A) provided through the second support member 262 and the second rear cover 250. there is.

According to various embodiments, the second housing 220 (e.g., a second housing structure) is formed through a combination of the second side member 223, the second support member 262, and the second rear cover 250. It can be configured. According to one embodiment, at least one wiring member 263 and/or at least a portion of the hinge plate 320 may be arranged to be supported by at least a portion of a pair of support members 261 and 262. According to one embodiment, at least one wiring member 263 may be disposed in a direction (eg, x-axis direction) crossing the first support member 261 and the second support member 262. According to one embodiment, the at least one wiring member 263 may be disposed in a direction (e.g., x-axis direction) substantially perpendicular to the folding axis (e.g., y-axis or folding axis A in FIG. 2A). .

According to various embodiments, the at least one substrate 270 may include a first substrate 271 disposed in the first space 2101 and a second substrate 272 disposed in the second space 2201. You can. According to one embodiment, the first substrate 271 and the second substrate 272 may include at least one electronic component disposed to implement various functions of the electronic device 200. According to one embodiment, the first substrate 271 and the second substrate 272 may be electrically connected through at least one wiring member 263.

According to various embodiments, the electronic device 200 may include at least one battery 291 and 292. According to one embodiment, at least one battery 291, 292 is disposed in the first space 2101 of the first housing 210, and the first battery 291 is electrically connected to the first substrate 271 and It may include a second battery 292 disposed in the second space 2201 of the second housing 220 and electrically connected to the second substrate 272. According to one embodiment, the first support member 261 and the second support member 262 may further include at least one swelling hole for the first battery 291 and the second battery 292.

According to various embodiments, the first housing 210 may include a first rotation support surface 214, and the second housing 220 may include a second rotation support surface corresponding to the first rotation support surface 214. It may include cotton 224. According to one embodiment, the first rotation support surface 214 and the second rotation support surface 224 may include a curved surface corresponding to the curved outer surface of the hinge cover 310. According to one embodiment, the first rotation support surface 214 and the second rotation support surface 224 cover the hinge cover 310 when the electronic device 200 is in an unfolded state, thereby covering the hinge cover 310. It may not be exposed to the rear of the electronic device 200, or only a portion of it may be exposed. According to one embodiment, when the electronic device 200 is in a folded state, the first rotation support surface 214 and the second rotation support surface 224 rotate along the outer surface of the hinge cover 310 to form the hinge cover. At least part of 310 may be exposed to the rear of the electronic device 200.

According to various embodiments, the electronic device 200 may include at least one antenna 276 disposed in the first space 2101. According to one embodiment, at least one antenna 276 may be disposed between the first battery 291 and the first rear cover 240 in the first space 2101. According to one embodiment, the at least one antenna 276 may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. According to one embodiment, at least one antenna 276 may, for example, perform short-distance communication with an external device or wirelessly transmit and receive power required for charging. In some embodiments, the antenna is provided by at least a portion of the first side member 213 or the second side member 223 and/or a portion of the first support member 261 and the second support member 262 or a combination thereof. A structure can be formed.

According to various embodiments, the electronic device 200 includes at least one electronic component assembly 274, 275 and/or additional support members disposed in the first space 2101 and/or the second space 2201. 273, 277) may be further included. For example, at least one electronic component assembly 274 or 275 may include an interface connector port assembly 274 or a speaker assembly 275.

FIG. 5 is a block diagram 500 illustrating an electronic device 501 according to an embodiment of the present disclosure.

Referring to FIG. 5, the electronic device 501 (e.g., the electronic device 101 of FIG. 1 and the electronic device 200 of FIGS. 2A to 4) includes a wireless communication circuit 510 (e.g., the communication module of FIG. 1). (190)), memory 520 (e.g., memory 130 in FIG. 1), display 530 (e.g., display module 160 in FIG. 1, displays 230, 300 in FIGS. 2A to 4) , a sensor circuit 540 (e.g., sensor module 176 of FIG. 1), and/or a processor 550 (e.g., processor 120 of FIG. 1).

According to one embodiment of the present disclosure, the wireless communication circuit 510 (e.g., communication module 190 of FIG. 1) establishes a communication channel with an external electronic device (e.g., electronic device 102 of FIG. 1), It can support sending and receiving various data with external electronic devices.

In one embodiment, the wireless communication circuit 510, under the control of the processor 550, sends sensor data acquired through the sensor circuit 540 to a server (e.g., server 108 of FIG. 1) (e.g., an intelligent server). You can transmit it to and receive a learning model learned through machine learning using artificial intelligence from the server.

According to an embodiment of the present disclosure, the memory 520 (e.g., the memory 130 of FIG. 1) includes a program (e.g., the program of FIG. 1) for processing and control of the processor 550 of the electronic device 501. 140)), an operating system (OS) (e.g., the operating system 142 of FIG. 1), various applications, and/or performs a function of storing input/output data, and manages the overall operation of the electronic device 501. Programs that control operations can be stored. The memory 520 can store various instructions that can be performed by the processor 550.

In one embodiment, the memory 520 is stored in the electronic device 501 based on a change in the angle between the first housing 210 and the second housing 220 of the electronic device 501, under the control of the processor 550. Instructions for detecting states (e.g., unfolded or collapsed) can be stored.

In one embodiment, memory 520, under control of processor 550, via at least one sensor included in sensor circuit 540, for example, inertial sensor 541 and/or grip sensor 543. Based on the acquired (or measured) sensor information, instructions for detecting the state of the electronic device 501 may be stored.

In one embodiment, the memory 520, under the control of the processor 550, operates the electronic device 501 based on sensor information acquired (or measured) through the inertial sensor 541 and/or the grip sensor 543. The rear side (e.g., the second side (e.g., the second side 212 of FIG. 2b) of the first housing (e.g., the first housing 210 of FIG. 2a) or the second side of the second housing (e.g., the second side of FIG. 2a) Instructions for detecting user interaction on the fourth side of the housing 220 (eg, the fourth side 222 in FIG. 2B) may be stored.

In one embodiment, the memory 520, under the control of the processor 550, operates the electronic device 501 based on sensor information acquired (or measured) through the inertial sensor 541 and/or the grip sensor 543. Instructions for determining (or confirming or identifying) the type of user interaction detected on the back of the and/or location information where the user interaction was detected may be stored.

In one embodiment, the memory 520, under the control of the processor 550, sensor data acquired through the sensor circuit 540 and the type of user interaction determined (or confirmed) based on the sensor data and/or Location information where user interaction is detected can be accumulated and stored. The memory 520, under the control of the processor 550, learns the stored sensor information and the type of user interaction based on it and/or the location information where the user interaction is detected using artificial intelligence, and provides instructions for creating a learned model. You can save it. The memory 520 may store instructions for determining (or confirming or identifying) the type of user interaction and/or location information where the user interaction is detected, based on the learned model, under the control of the processor 550. .

In one embodiment, the memory 520, under the control of the processor 550, transmits sensor data acquired through the sensor circuit 540 to a server (e.g., an intelligent server) through the wireless communication circuit 510, and the server A learning model learned through machine learning learning by artificial intelligence may be received from and instructions for determining (or confirming or identifying) the type of user interaction and/or location information where the user interaction is detected may be stored.

In one embodiment, the memory 520, under the control of the processor 550, displays the display 530 ( For example, instructions for changing the display properties of information of at least one application displayed on the first display 531 or the second display 533 may be stored.

In one embodiment, the memory 520 may store instructions for displaying information about at least one application based on changed display properties under the control of the processor 550.

According to an embodiment of the present disclosure, the display 530 (e.g., the display module 160 in FIG. 1 and the displays 230 and 300 in FIGS. 2A to 4) is integrated into a unit including a touch panel (not shown). configured, an image can be displayed under the control of the processor 550.

In one embodiment, the display 530 includes a first display 531 (e.g., first display 230 in Figure 2A) and a second display 533 (e.g., second display 300 in Figure 2b). It can be included. In one embodiment, the first display 531 may be activated when the electronic device 501 is in an unfolded state and deactivated when the electronic device 501 is in a folded state, under the control of the processor 550. Under the control of the processor 550, the second display 533 may be activated when the electronic device 501 is in a folded state and may be deactivated when the electronic device 501 is in an unfolded state.

In one embodiment, the display 530 (e.g., the first display 531 or the second display 533), under the control of the processor 550, changes the type of user interaction and the location information where the user interaction was detected. Based on the display properties, information about at least one application can be displayed.

According to an embodiment of the present disclosure, the sensor circuit 540 (e.g., the sensor module 176 in FIG. 1) measures a physical quantity or detects the operating state of the electronic device 501 and generates an electrical signal or data corresponding thereto. A value can be created.

In one embodiment, the sensor circuit 540 may include an inertial sensor 541 and/or a grip sensor 543.

In one embodiment, the inertial sensor 541 may include a six-axis sensor (e.g., a geomagnetic sensor, an acceleration sensor, and/or a gyro sensor). The inertial sensor 541 acquires (or measures) sensor information (e.g., sensor information on the x-axis, y-axis, and/or z-axis (e.g., acceleration value, angular velocity value)) for determining the attitude of the electronic device 501. ) and can be transmitted to the processor 550.

In one embodiment, the inertial sensor 541 may be disposed in the internal space of the first housing 210. However, it is not limited to this. For example, the inertial sensor 541 may be placed in the inner space of the second housing 220. For another example, when the inertial sensor 541 includes two or more inertial sensors, at least one inertial sensor is disposed in the inner space of the first housing 210, and at least one other inertial sensor is located in the second housing. It may be placed in the inner space of (220).

In one embodiment, the grip sensor 543 may detect the grip state of the electronic device 501. For example, the grip sensor 543 may detect whether the electronic device 501 is gripped with one hand (eg, left or right hand) or with both hands. In one embodiment, the grip sensor 543 may be disposed on a portion of the second side 213c of the first housing 210 and/or a portion of the fifth side 223c of the second housing 220. there is. However, it is not limited to this.

According to an embodiment of the present disclosure, the processor 550 may include, for example, a micro controller unit (MCU), and runs an operating system (OS) or embedded software program to operate the processor 550. You can control multiple hardware components connected to . The processor 550 may control a plurality of hardware components according to instructions (eg, program 140 of FIG. 1) stored in the memory 520.

In one embodiment, the processor 550 may display information about a plurality of applications on the display 530 (eg, the first display 531 or the second display 533) as a multi-window. For example, when the electronic device 501 is in an unfolded or folded state, the processor 550 may divide the display area of the activated first display 531 or the second display 533 into a plurality of regions. there is. The processor 550 may control the display 530 (eg, the first display 531 or the second display 533) to display application information in each divided area.

In one embodiment, processor 550 may obtain sensor information through sensor circuit 540, for example, inertial sensor 541 and/or grip sensor 543. Additionally, the processor 550 may further obtain sensor information obtained through a touch sensor (eg, a touch sensor of the second display 533). The processor 550 may check whether user interaction is detected on the second side 212 or the fourth side 222 of the electronic device 501 based on the acquired sensor information. When it is confirmed that user interaction is detected on the second side 212 or the fourth side 222 of the electronic device 501, the processor 550 can check the type of user interaction and the location information where the user interaction was detected. there is. For example, the processor 550 corrects the sensor data of the detected user interaction based on the acquired sensor information, and determines the type of user interaction and the location information where the user interaction was detected based on the corrected sensor data. You can.

In one embodiment, the processor 550 may change the display attribute of at least one of the first information of the first application and the second information of the second application based on the type of user interaction and the location information where the user interaction was detected. there is. For example, the display property refers to the display 530 (e.g., the first display 531 or the second display 533) for displaying the first information of the first application and the second information of the second application. It may include at least one of the size of the window within the area and the arrangement within the window. The processor 550 may display at least one of the first information and the second information on the display 530 (e.g., the first display 531 or the second display 533) based on the changed display properties. there is.

The electronic device 501 according to an embodiment of the present disclosure includes a first side 211, a second side 212 facing in the opposite direction to the first side 211, and a first side 211 and a second side. It may include a first housing 210 including a first side member 213 surrounding a first space between the surfaces 212 . In one embodiment, the electronic device 501 is foldably connected to the first housing 210 based on the folding axis using a hinge structure (e.g., hinge plate 320), and in the unfolded state, the first side A third face 221 facing the same direction as 211, a fourth face 222 facing the opposite direction from the third face 221, and a third face 222 between the third face 221 and the fourth face 222. It may include a second housing 220 including a second side member 223 surrounding the second space. In one embodiment, the electronic device 501 may include a first display 531 disposed from at least a portion of the first side 211 to at least a portion of the third side 221 . In one embodiment, the electronic device 501 may include a sensor circuit 540. In one embodiment, the electronic device 501 may include a processor 550 operatively connected to the first display 531 and the sensor circuit 540. In one embodiment, the processor 550 may display first information of the first application on the first display 531. In one embodiment, the processor 550 displays the second information of the second application and the first information of the first application in multi-window on the first display 531 in response to an input for executing the second application. You can. In one embodiment, the processor 550 may obtain sensor information through the sensor circuit 540. In one embodiment, when the processor 550 determines that user interaction on the second side 212 or the fourth side 222 is detected based on sensor information obtained through the sensor circuit 540, You can check the type of user interaction and the location information where the user interaction was detected. In one embodiment, the processor 550 changes the display attribute of at least one of the first information of the first application and the second information of the second application based on the type of user interaction and the location information where the user interaction was detected. You can. In one embodiment, the processor 550 may display at least one of first information and second information on the first display 531 based on changed display properties.

In one embodiment, the processor 550 may correct sensor data of detected user interaction based on sensor information acquired through the sensor circuit 540. In one embodiment, the processor 550 may check the type of user interaction and location information where the user interaction was detected based on the corrected sensor data.

In one embodiment, the processor 550 is configured to display at least one of the first information of the first application and the second information of the second application, based on the type of user interaction and the location information at which the user interaction was detected. 1 Display properties including at least one of the size and arrangement of windows within the display area of the display 531 can be changed.

In one embodiment, the electronic device 501 may further include a second display 533 disposed to be at least partially visible from the outside through the fourth surface 222 in the inner space of the second housing 220. You can.

In one embodiment, the sensor circuit 540 may include at least one of an inertial sensor 541 and a grip sensor 543.

In one embodiment, the sensor information acquired through the sensor circuit 540 includes first sensor information obtained through the inertial sensor 541, second sensor information obtained through the grip sensor 543, and second display information. It may include at least one of third sensor information obtained through the touch circuit of 533.

In one embodiment, the first sensor information may include at least one of sensor information related to the posture of the electronic device 501 and sensor information related to the movement of the electronic device 501.

In one embodiment, the second sensor information may include at least one of the grip state and grip pattern of the electronic device 501.

In one embodiment, the third sensor information may include touch information acquired through the touch circuit of the second display 533.

In one embodiment, the processor 550 may correct sensor data of detected user interaction based on at least one of first sensor information, second sensor information, and third sensor information.

In one embodiment, the electronic device 501 may further include a memory 520.

In one embodiment, the processor 550 accumulates sensor information acquired through the sensor circuit 540, the type of user interaction identified based on the sensor information, and the location information where the user interaction is detected in the memory 520. You can save it. In one embodiment, the processor 550 may learn the stored sensor information, the type of user interaction based on the sensor information, and the location information where the user interaction is detected using artificial intelligence. In one embodiment, the processor 550 may check the type of user interaction and the location information where the user interaction was detected based on the model generated through learning.

In one embodiment, the electronic device 501 may further include a wireless communication circuit 510.

In one embodiment, the processor 550 may transmit sensor information obtained through the sensor circuit 540 to a server through the wireless communication circuit 510. In one embodiment, the processor 550 may receive a learning model learned through machine learning using artificial intelligence from a server and check the type of user interaction and location information where the user interaction is detected.

FIG. 6A is a flowchart 600 for explaining a screen control method according to user interaction of the electronic device 501, according to an embodiment of the present disclosure.

Referring to FIG. 6A, in operation 610, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) displays first information of the first application (e.g., It can be displayed on the display 530 of FIG. 5.

In one embodiment, the electronic device 501 may be in an unfolded state (e.g., the state in FIGS. 2A and 2B) or a folded state (e.g., the state in FIGS. 3A and 3B).

In one embodiment, when the electronic device 501 is in an unfolded state, first information about the first application may be displayed on the first display (eg, the first display 531 in FIG. 5). For example, when the electronic device 501 is in an unfolded state, a first display (e.g., the first display 501) disposed in the space formed by a pair of housings (e.g., the first housing 210 and the second housing 220 in FIG. 2A) 531) can be activated and displays a second display (e.g., the second display 533 in FIG. 5) disposed on the fourth side of the second housing 220 (e.g., the fourth side 222 in FIG. 2B). ) can be disabled. The first display 531 may have a first size, and the second display 533 may have a second size that is relatively smaller than the first size.

In one embodiment, when the electronic device 501 is in a folded state, first information about the first application may be displayed on the second display 533. For example, when the electronic device 501 is in a folded state, the second display 533 may be activated and the first display 531 may be deactivated.

In one embodiment, in operation 620, the processor 550 displays second information of the second application and first information of the first application in a multi-window 530 (e.g., in response to an input for executing the second application). : Can be displayed on the first display 531 or the second display 533).

For example, when the electronic device 501 is in an unfolded or folded state, the processor 550 may divide the display area of the activated first display 531 or the second display 533 into a plurality of regions. there is. The processor 550 may control the first display 531 or the second display 533 to display first information of the first application and second information of the second application in each divided area.

In one embodiment, the processor 550 may acquire sensor information through a sensor circuit (eg, the sensor circuit 540 of FIG. 5) in operation 630. In operation 640, the processor 550 detects the second side (e.g., the second side 212 in FIG. 2B) or the fourth side (e.g., the second side 212 in FIG. 2B) of the electronic device 501 based on the acquired sensor information. If it is confirmed that user interaction is detected on side 4 (222), the type of user interaction and location information where the user interaction was detected can be confirmed.

In one embodiment, sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5). The inertial sensor 541 may be disposed in the internal space of the first housing 210. However, it is not limited to this.

In one embodiment, the processor 550 may obtain sensor information related to the posture and/or sensor information related to the movement of the electronic device 501 through the inertial sensor 541. Sensor information related to the posture and/or movement of the electronic device 501 may include sensor values measured relative to a specific axis (e.g., x-axis, y-axis, and/or z-axis), such as acceleration. value and/or angular velocity value. The processor 550 operates on the second side 212 of the electronic device 501 or It is possible to check whether user interaction is detected on the fourth side 222.

It is not limited to this, and the sensor circuit 540 may include a grip sensor (eg, the grip sensor 543 in FIG. 5). The grip sensor 543 may be disposed in a partial area of the second side 213c of the first housing 210 and/or a partial area of the fifth side 223c of the second housing 220. However, it is not limited to this.

In one embodiment, the processor 550 determines the grip state (e.g., a grip state with one hand (e.g., left or right hand) or a grip state with both hands) based on sensor information acquired through the grip sensor 543. ) can be confirmed. The processor 550 may estimate (or predict) location information where user interaction is detected among the second side 212 or the fourth side 222 of the electronic device 501 based on the confirmed grip state.

It is not limited to this, and the processor 550 displays the second or fourth side 212 of the electronic device 501 based on the touch input detected on the second display 533 disposed on the fourth side 222. Location information on the surface 222 where user interaction is detected can be estimated (or predicted).

In one embodiment, in operation 650, the processor 550 displays at least one of first information of the first application and second information of the second application, based on the type of user interaction and the location information at which the user interaction was detected. Properties can be changed.

In one embodiment, the display properties may include at least one of the size of a window and an arrangement within the window in the display area of the display 530 for displaying the first information of the first application and the second information of the second application. there is.

In one embodiment, the processor 550 may display at least one of the first information and the second information on the display 530 in operation 660, based on the changed display attribute.

FIG. 6B is a flowchart for explaining operation 640 of FIG. 6A described above, according to an embodiment of the present disclosure.

Referring to FIG. 6B, the processor 550 may correct sensor data of detected user interaction based on the acquired sensor information in operation 641.

In one embodiment, the electronic device 501 may include a sensor circuit 540, for example, an inertial sensor 541 and/or a grip sensor 543. Additionally, the electronic device 501 may include a display 530 that includes a touch sensor. The processor 550 detects the user based on sensor information acquired through the inertial sensor 541, sensor information acquired through the grip sensor 543, and/or touch information obtained through the second display 533. Interaction sensor data can be corrected.

In one embodiment, the processor 550 may check the type of user interaction and location information where the user interaction was detected based on the corrected sensor data in operation 643.

In relation to the operation of correcting the sensor data of the detected user interaction described above, various embodiments will be described in FIGS. 7A to 22 described later.

FIG. 7A is a diagram 700 illustrating a user interaction that can be detected when the electronic device 501 is in an unfolded state, according to an embodiment of the present disclosure.

Referring to FIG. 7A, the electronic device (e.g., the electronic device 501 in FIG. 5) includes a first housing (e.g., the first housing 210 in FIG. 2a) and a second housing (e.g., the first and second housings in FIG. 2a). It may include a housing 220).

In one embodiment, the processor (e.g., processor 550 of FIG. 5) detects the first housing 210 based on sensor information acquired through a sensor circuit (e.g., sensor circuit 540 of FIG. 5). In at least a portion of the second side (e.g., the second side 212 in FIG. 2B) and/or in at least a portion of the fourth side of the second housing 220 (e.g., the fourth side 222 in FIG. 2B) User interaction can be detected.

In one embodiment, user interaction may include a double tap or triple tap. However, it is not limited to this.

In one embodiment, sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5). In one embodiment, the inertial sensor 541 may be disposed in the internal space of the first housing 210. However, it is not limited to this.

In one embodiment, the inertial sensor 541 may include a six-axis sensor (e.g., a geomagnetic sensor, an acceleration sensor, and/or a gyro sensor). The inertial sensor 541 acquires (or measures) sensor information related to the movement of the electronic device 501 (e.g., sensor information in the x-axis, y-axis, and/or z-axis (e.g., acceleration value, angular velocity value)), and , this can be transmitted to the processor 550. The processor 550 operates on the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 based on sensor information acquired through the inertial sensor 541. User interaction can be detected, and the type of user interaction detected and/or location information where the user interaction was detected can be confirmed.

In one embodiment, the processor 550 sets the second side 212 of the first housing 210 to at least one region and sets the fourth side 222 of the second housing 220 to at least one other region. Can be set to area. The processor 550 may detect user interaction in at least one set area (e.g., the second side 212 or the fourth side 222) based on sensor information acquired through the sensor circuit 540. .

For example, as shown in reference numerals <710> and <715>, the processor 550 divides the fourth surface 222 of the second housing 220 into two regions, for example, a first region (e.g. It can be set as an upper area of the fourth surface 222 of the second housing 220) and a second area (eg, a lower area of the fourth surface 222 of the second housing 220). The processor 550 may detect user interactions 711 and 716 on the fourth side 222 divided into a first area and a second area.

For another example, as shown in reference numerals <720> and <725>, the processor 550 divides the second surface 212 of the first housing 210 into two regions, for example, a third region (e.g. : Can be set to the upper area of the second surface 212 of the first housing 210) and the fourth area (e.g., the lower area of the second surface 212 of the first housing 210). The processor 550 may detect user interactions 721 and 726 on the second side 212 divided into the third area and the fourth area.

In various embodiments, processor 550 determines the location at which user interaction is detected (e.g., first area, second area, third area, or fourth area) and/or each location (e.g., first area, third area, or fourth area). Depending on the type of user interaction (e.g., double tap or triple tap) detected in the second area, third area, or fourth area, different functions may be performed.

In various embodiments, when user interaction is detected, the processor 550 may include sensor information acquired through the sensor circuit 540, the type of user interaction confirmed based thereon, and/or location information where the user interaction is detected. It may be accumulated and stored in memory (e.g., memory 520 in FIG. 5). The processor 550 may learn the sensor information stored in the memory 520, the type of user interaction based thereon, and/or the location information where the user interaction is detected using artificial intelligence. The processor 550 may check the type of user interaction corresponding to the sensor information obtained based on the learned learning model and/or location information where the user interaction is detected. In this regard, various embodiments will be described in FIGS. 7B to 22 described later.

FIGS. 7B and 7C are diagrams 700 for explaining a method for detecting user interaction according to an embodiment of the present disclosure.

7B and 7C, a processor (e.g., processor 550 of FIG. 5) includes a sensor information processing unit 730, a data augmentation unit 755, and/or an artificial intelligence model 775. It can be included.

According to one embodiment, the sensor information processing unit 730, data augmentation unit 755 (data augmentation), and/or artificial intelligence model 775 included in the above-described processor 550 are hardware modules (e.g., circuits ( circuitry), may be included in the processor 550, and/or may be implemented as software that includes one or more instructions that can be executed by the processor 550.

In one embodiment, the sensor information processing unit 730 may include a noise removal unit 735, a peak identification unit 740, and/or a cluster creation unit 745.

In one embodiment, the noise removal unit 735 may include a resampling unit 736, a sloping unit 737, and/or a filtering unit 738.

In one embodiment, the resampling unit 736 of the noise removal unit 735 collects sensor values (e.g., x-axis, y-axis) acquired through the sensor circuit 540, for example, the inertial sensor 541, at specific time intervals. , and z-axis sensor data (e.g., acceleration values and/or angle values)) may be uniformly corrected.

In one embodiment, the sloping unit 737 of the noise removal unit 735 calculates the slope value of the sensor values that are uniformly corrected through the resampling unit 736, and based on the calculated slope value, the sloping unit 737 of the noise removal unit 735 calculates the slope value of the sensor values that are uniformly corrected. Changes can be identified.

In one embodiment, the filtering unit 738 of the noise removal unit 735 may pass the sensor values and slope values through a low-pass filter (LPF). Sensor values and slope values passed through a low-pass filter may pass through a high-pass filter (HPF). As the sensor values pass through the high-pass filter, noise is removed from the sensor values and slope values, so that the peak value of the sensor values can be accurately obtained.

In one embodiment, the peak identification unit 740 may include a peak detection unit 741 and/or a peak filtering unit 742.

In one embodiment, the peak detection unit 741 may detect peak values based on sensor values (eg, filtered sensor values) that have passed a high-pass filter through the filtering unit 738.

In one embodiment, the peak filtering unit 742 may remove (or delete) peak values that are smaller than a specified peak value among the peak values detected through the peak detection unit 741.

In one embodiment, the cluster generator 745 generates a specified number of sensor values including the highest peak value among the peak values filtered by the peak filtering unit 742 as one cluster (750). You can.

In one embodiment, the data augmentation unit 755 (data augmentation) may augment the amount of data based on the generated cluster 750. Augmented data may be generated as one cluster 760. In one embodiment, to generate a sufficient amount of data set 765 that can be used for learning, the data augmentation unit 755 may augment the amount of data based on the generated clusters 750.

In one embodiment, a data set 765 may be created based on one cluster 760 containing augmented data. The generated data set 765 can be learned by an artificial intelligence model 775.

In one embodiment, the artificial intelligence model 775 can use the generated data set 765 to learn the type of user interaction and/or location information where the user interaction is detected and generate the learned model 780. there is. The artificial intelligence model 775 may include a neural network model 776. It is not limited to this.

In various embodiments, the processor 550 learns the type of user interaction and/or the location at which the user interaction is detected, which is determined (or confirmed) based on sensor data acquired through the sensor circuit 540, and learns Although it has been described as generating the model 780, it is not limited to this. For example, the processor 550 transmits sensor data acquired through the sensor circuit 540 to a server (e.g., an intelligent server) through a wireless communication circuit (e.g., the wireless communication circuit 510 of FIG. 5), A learning model learned through machine learning learning by artificial intelligence may be received from the server to confirm (or identify, or determine) the type of user interaction and/or the location where the user interaction is detected.

FIG. 8 is a diagram 800 for explaining a method of correcting sensor data of user interaction based on the state of the electronic device 501, according to an embodiment of the present disclosure.

Referring to FIG. 8, a processor (e.g., processor 550 in FIG. 5) processes an electronic device (e.g., processor 550 in FIG. 5) based on sensor information acquired through a sensor circuit (e.g., sensor circuit 540 in FIG. 5). state (e.g., an unfolded state (e.g., the state in FIGS. 2A and 2B), a folded state (e.g., the state in FIGS. 3A and 3B), or an intermediate state) and/or state transition ( For example, you can check the transition from the unfolded state to the collapsed state or the transition from the collapsed state to the unfolded state. For example, the sensor circuit 540 may include a Hall sensor (not shown) and/or an inertial sensor (eg, the inertial sensor 541 in FIG. 5 ).

In one embodiment, when the electronic device 501 is in an unfolded state (e.g., the state in FIGS. 2A and 2B), the first housing (e.g., the first housing 210 in FIG. 2A) and the second housing (e.g., the state in FIGS. 2A and 2B). The second housing 220 in FIG. 2A may form an angle of approximately 180 degrees.

In one embodiment, when the electronic device 501 is in a folded state (e.g., the state in FIGS. 3A and 3B), the first side of the first housing 210 (e.g., the first side 211 in FIG. 2A) and the third side of the second housing 220 (e.g., the third side 221 in FIG. 2A) forms a narrow angle (e.g., in the range of about 0 degrees to about 10 degrees) with each other and may be arranged to face each other. there is.

In one embodiment, when the electronic device 501 is in an intermediate state forming a predetermined angle, the first surface 211 of the first housing 210 and the third surface 221 of the second housing 220 are approximately An angle of 80 degrees to about 130 degrees can be achieved.

Reference numeral <810> according to various embodiments is a diagram illustrating a transition 815 of the electronic device 501 from a folded state to an unfolded state. For example, the processor 550 may operate in a folded state of the electronic device 501 (e.g., the first side 211 of the first housing 210 and the third side 221 of the second housing 220 are approximately 0). degrees to about 10 degrees) to an intermediate state (e.g., the first side 211 of the first housing 210 and the third side 221 of the second housing 220 are at an angle of about 80 degrees to about 130 degrees. A change to a state) or an unfolded state (for example, a state in which the first housing 210 and the second housing 220 form an angle of about 180 degrees) can be detected.

Reference numeral <850> according to various embodiments is a diagram illustrating a transition 855 of the electronic device 501 from an unfolded state to a folded state. For example, the processor 550 operates in an unfolded state (e.g., at about 180 degrees) of the electronic device 501, in an intermediate state (e.g., on the first side 211 and the second side of the first housing 210). The third side 221 of the housing 220 is in an angle of about 80 degrees to about 130 degrees) or in a folded state (e.g., the first side 211 of the first housing 210 and the second housing 220 are in a folded state). A transition to a state in which the third side 221 ranges from about 0 degrees to about 10 degrees can be detected.

In one embodiment, the processor 550 controls the first side 211 of the first housing 210 and the third side 221 of the second housing 220 based on the state transition of the electronic device 501. When a specific angle 820 (e.g., about 75 degrees to about 115 degrees) is achieved, sensor data acquired through the sensor circuit 540 can be corrected. By correcting sensor data according to the state of the electronic device 501 obtained through the sensor circuit 540, it is possible to accurately identify the type of user interaction and/or the location where the user interaction is detected according to the state of the electronic device 501. You can.

FIGS. 9A and 9B are diagrams 900 and 950 for explaining a method of correcting sensor data of user interaction using sensor information acquired through the inertial sensor 541 according to an embodiment of the present disclosure. .

FIG. 9A according to various embodiments is a first graph showing sensor information acquired through an inertial sensor (e.g., the inertial sensor 541 of FIG. 5), for example, acceleration values of the x-axis, y-axis, and z-axis. It is (900). FIG. 9B is a second graph 950 showing sensor information acquired through the inertial sensor 541, such as angle values of the x-axis, y-axis, and z-axis.

Referring to FIG. 9A, in the first graph 900 according to one embodiment, the x-axis may indicate time 901, and the y-axis may indicate an acceleration value (m/s2) 905.

In one embodiment, reference numerals <910>, <920>, and <930> refer to the first housing (e.g., the first housing (e.g., the electronic device 501 of FIG. 2A) according to the movement of the electronic device (e.g., the electronic device 501 of FIG. 5). 1 Acceleration values (911, 921, 931) of the x-axis (e.g., left/right movement), y-axis (e.g., forward/backward movement), and z-axis (e.g., up/down movement) of the housing 210) And the ) This is a graph showing the acceleration values (913, 923, 933).

In various embodiments, the processor 550 includes a first housing 210 and a second housing for movement of the electronic device 501, as described above with reference numerals <910>, <920>, and <930>. Based on the acceleration value of 220, the rear surface of the electronic device 501, for example, the second side (e.g., the second side 212 in FIG. 2B) or the fourth side (e.g., the fourth side in FIG. 2B) At (222)), it is possible to check (or determine) whether user interaction has been detected.

Referring to FIG. 9B, in the second graph 950, the x-axis may represent time 951, and the y-axis may represent the angular velocity value (rad/s) 953.

In one embodiment, reference numerals <960>, <970>, and <980> represent the x-axis of the first housing (e.g., the first housing 210 in FIG. 2A) according to the movement of the electronic device 501. , angular velocity values 961, 971, 981 of the y-axis, and z-axes, and angular velocity values 963, 973 of the x-axis, y-axis, and z-axis of the second housing (e.g., the second housing 220 in FIG. 2A). This is a graph showing 983).

In various embodiments, the processor 550 includes a first housing 210 and a second housing for movement of the electronic device 501, as described above with reference numerals <960>, <970>, and <980>. Based on the angular velocity value of 220, the posture of the electronic device 501, e.g., horizontality, is confirmed, and the rear, e.g., second side 212 or fourth side of the electronic device 501 It may be determined (or identified, confirmed, or estimated) whether the user interaction detected at 222 is an intended user input.

FIGS. 10A and 10B are diagrams 1000 and 1050 for explaining the operation of the resampling unit 736 of FIG. 7B according to an embodiment of the present disclosure.

Referring to FIG. 10A, a processor (e.g., processor 550 of FIG. 5) may include a sensor circuit (e.g., sensor circuit 540 of FIG. 5), e.g., an inertial sensor (e.g., inertial sensor 541 of FIG. 5). )), sensor values measured based on a specific axis (e.g., x-axis, y-axis, and/or z-axis), for example, acceleration value and/or angular velocity value, can be obtained.

In one embodiment, the processor 550 (e.g., the resampling unit 736) uniformly corrects the acceleration value and/or angular velocity value measured based on a specific axis, which is acquired through the inertial sensor 541 during a specific time. You can.

In one embodiment, the processor 550 may acquire sensor data through an inertial sensor 541, such as an acceleration sensor and/or a gyro sensor, during a specific time period (e.g., T0 (1005) to T3 (1010)). there is. For example, through an acceleration sensor, first sensor data 1015 (e.g., Ax1, Ay1, Az1), third sensor data 1025 (e.g., Ax2, Ay2, Az2), and fourth sensor data 1030 ( For example, Ax3, Ay3, Az3) is acquired, and the second sensor data 1020 (for example, Gx1, Gy1, Gz1) and the fifth sensor data 1035 (for example, Gx2, Gy2, Gz2) are obtained through the gyro sensor. It can be obtained.

In one embodiment, the processor 550 (e.g., the resampling unit 736) collects the first sensor data 1015 (e.g., Ax1, Ay1, and Az1) acquired through the inertial sensor 541 for a specific time, and the second Sensor data 1020 (e.g., Gx1, Gy1, Gz1), third sensor data 1025 (e.g., Ax2, Ay2, Az2), fourth sensor data 1030 (e.g., Ax3, Ay3, Az3), and The fifth sensor data 1035 (eg, Gx2, Gy2, Gz2) can be uniformly corrected.

For example, referring to FIG. 10B, reference numeral <1060> indicates sensor values (e.g., acceleration values measured based on the z-axis) acquired at specified time intervals through an inertial sensor 541, for example, an acceleration sensor. ) and a second graph 1073 showing sensor values (e.g., angular velocity values measured based on the x-axis) obtained at specified time intervals through a gyro sensor.

In the first graph 1071 and the second graph 1073 according to reference number <1060>, the x-axis means time 1061, and the y-axis means sensor value 1063 (e.g., acceleration value or angular velocity value). You can.

In one embodiment, reference number <1080> represents a third graph (e.g., acceleration values measured based on the z-axis) resampled sensor values obtained at specified time intervals through an acceleration sensor according to reference number <1060>. 1091) and a fourth graph 1093 that resamples sensor values (e.g., angular velocity values measured based on the x-axis) obtained at specified time intervals through a gyro sensor.

In the third graph 1091 and fourth graph 1093 according to reference number <1080>, the x-axis means time (1081), and the y-axis means sensor value (1083) (e.g., acceleration value or angular velocity value). You can.

In various embodiments, the resampling unit 736 may correct (1090) sensor values obtained through an acceleration sensor and/or a gyro sensor to have uniform sensor values.

In various embodiments, the processor 550 may perform the operation of FIG. 11, described below, using the above-described corrected uniform sensor values.

FIG. 11 is a diagram 1100 for explaining the operation of the sloping unit 737 of FIG. 7B according to an embodiment of the present disclosure.

Referring to FIG. 11 , reference number <1110> illustrates a graph 1091 showing acceleration values (e.g., acceleration values measured based on the z-axis) corrected through the resampling operation of FIG. 10b described above. Reference number <1150> illustrates a graph 1151 representing acceleration values (e.g., acceleration values measured based on the z-axis) according to the movement of the electronic device 501 through a sloping operation.

In one embodiment, a processor (e.g., processor 550 of FIG. 5) may calculate the slope value (m) of the sensor values based on Equation 1 below. For example, the processor 550 determines how much acceleration (e.g., y-axis) was accelerated during a certain period of time (e.g., x-axis) through a sloping unit (e.g., sloping unit 737 in FIG. 7B), The slope value (m) can be calculated. The processor 550 may identify sudden changes in sensor values based on the calculated slope value (m). In other words, the processor 550 can check whether the acceleration has changed rapidly with respect to time.

After calculating the above-described slope (m), the processor 550 filters the sensor values and the calculated slope value (m) through a filtering unit (e.g., the filtering unit 738 in FIG. 7B), and then filters the sensor values and the calculated slope value (m) through a filtering unit (e.g., the filtering unit 738 in FIG. 7B). 12 operations can be performed.

FIG. 12 is a diagram 1200 for explaining the operation of the peak identification unit 740 of FIG. 7B according to an embodiment of the present disclosure.

Referring to FIG. 12, reference number <1210> is a graph 1211 representing acceleration values (e.g., acceleration values measured based on the z-axis) detected through a peak detection unit (e.g., peak detection unit 741 in FIG. 7B). ) is shown. Reference number <1250> shows a graph 1211 representing acceleration values (e.g., acceleration values measured based on the z-axis) filtered through a peak filtering unit (e.g., peak filtering unit 742 in FIG. 7B). .

In reference numbers <1210> and <1250> according to one embodiment, the x-axis may represent time (1201), and the y-axis may represent the standard deviation (1203) of acceleration values.

In one embodiment, the processor 550 (e.g., peak detection unit 741) may identify peak values of acceleration values in the graph 1211 indicated by reference number <1210>. For example, the identified peak values include the first peak value (1261), the second peak value (1263), the third peak value (1265), the fourth peak value (1267), the fifth peak value (1269), It may include a sixth peak value (1271) and a seventh peak value (1273).

In one embodiment, the processor 550 (eg, peak filtering unit 742) may remove the gravitational acceleration component through a filter (eg, high-pass filter). For example, the processor 550 (e.g., peak filtering unit 742), as shown in reference numeral <1250>, selects the identified peak values, for example, the peak values are the first peak value 1261, designated among the second peak value (1263), the third peak value (1265), the fourth peak value (1267), the fifth peak value (1269), the sixth peak value (1271), and the seventh peak value (1273). Peak values that are smaller than the peak value (1251) and/or included within a specified range (e.g., +0.2) based on the specified peak value (1251) (e.g., the second peak value (1263), the third peak value (1265) ), the fourth peak value (1267), the sixth peak value (1271), and the seventh peak value (1273)) can be removed (or deleted).

FIG. 13 is a diagram 1300 for explaining the operation of the cluster generator 745 of FIG. 7B according to an embodiment of the present disclosure.

Referring to FIG. 13, the processor (e.g., processor 550 in FIG. 5) (e.g., cluster generator 745) uses the peak filtering unit (e.g., peak filtering unit 742 in FIG. 7b) in FIG. 12 described above. A specified number of sensor values including the highest peak value among the peak values filtered by can be generated as a cluster. For example, the processor 550 (e.g., the cluster generator 745) creates a first cluster 1310 that includes a specified number of sensor values including the highest peak value, for example, the first peak value 1261. ) and a specified number of sensor values including the fifth peak value 1269 may be generated.

In one embodiment, processor 550 may identify (or determine) one cluster with a single tap. For example, the processor 550 may identify the first cluster 1310 as a first tab and the second cluster 1320 as a second tab. The processor 550 may determine the type of user interaction based on the time at which the identified first tap was detected and the time at which the second tap was detected. In this regard, various embodiments will be described in FIG. 14 described later.

FIG. 14 is a diagram 1400 for explaining the operation of the artificial intelligence model 775 according to an embodiment of the present disclosure.

Referring to FIG. 14, a processor (e.g., processor 550 in FIG. 5) (e.g., artificial intelligence model 775 in FIG. 7b) operates a sensor circuit (e.g., FIG. 5) through the operations of FIGS. 7a to 13 described above. The type of user interaction determined (or confirmed) based on sensor data acquired through the sensor circuit 540 and/or the location information where the user interaction is detected can be learned, and a learned model can be generated.

In one embodiment, types of user interaction may include no tap, single tap, double tap, and triple tap. Additionally, the location where user interaction is detected may be a partial area of the rear of the electronic device (e.g., the electronic device 501 in FIG. 5). For example, some areas of the rear of the electronic device 501 may be the second side (e.g., the second side 212 of FIG. 2b) of the first housing (e.g., the first housing 210 of FIG. 2a) or It may include a fourth side (e.g., fourth side 222 of FIG. 2b) of a second housing (e.g., second housing 220 of FIG. 2a).

In one embodiment, the processor 550 determines the time (T1) at which the first tap (1410) was detected, the time (T2) at which the second tap (1420) was detected, and the time (T2) at which the third tap (1430) was detected ( T3) can be checked. For example, each of the first tab 1410, the second tab 1420, and the third tab 1430 is a cluster generated based on the peak value seen in FIG. 13 (e.g., the first cluster 1310 ) and the second cluster 1320).

In one embodiment, the difference between the time (T3) at which the third tap (1430) was detected and the time (T2) at which the second tap (1420) was detected is less than a specified time (e.g., 500 ms), and the second tap (1420) If the detected time (T2) and the detected time (T1) of the first tap 1410 are confirmed to be less than the specified time, the processor 550 can confirm (or determine) the type of user interaction as a triple tap. there is. However, it is not limited to this.

In one embodiment, the difference between the time T3 at which the third tap 1430 was detected and the time T2 at which the second tap 1420 was detected is greater than a specified time (e.g., 500 ms), and the second tap 1420 If the detected time (T2) and the detected time (T1) of the first tap 1410 are confirmed to be less than the specified time, the processor 550 can confirm (or determine) the type of user interaction with a double tap. there is. In another embodiment, the difference between the time T3 at which the third tap 1430 was detected and the time T2 at which the second tap 1420 was detected is less than a specified time (e.g., 500 ms), and the second tap 1420 If the detected time (T2) and the detected time (T1) of the first tap 1410 are confirmed to be greater than the specified time, the processor 550 can confirm (or determine) the type of user interaction with a double tap. there is. However, it is not limited to this.

In one embodiment, the difference between the time T3 at which the third tap 1430 was detected and the time T2 at which the second tap 1420 was detected is greater than a specified time (e.g., 500 ms), and the second tap 1420 If the detected time (T2) and the detected time (T1) of the first tap 1410 are confirmed to be greater than the specified time, the processor 550 confirms (or determines) the type of user interaction as a single tap, The first tap 1410, the second tap 1420, or the third tap 1430 may be treated as an invalid input. For example, in the case of a single tap, the electronic device 501 is manipulated (e.g., touch input on a display (e.g., display 530 of FIG. 5)) or an external impact (e.g., the electronic device 501 is hit on the ground). There is a possibility of detection due to a shock due to being placed down or a shock due to impact being applied to the ground on which the electronic device 501 is placed, and this may not be an intended input by the user. Considering this, when the type of user interaction by the first tab 1410, the second tab 1420, and/or the third tab 1430 is confirmed (or determined) to be a single tap, the processor 550 A single tap can be treated as invalid input. For another example, when the type of user interaction by the above-described first tap 1410, second tap 1420, and/or third tap 1430 is confirmed (or determined) as a double tap or triple tip. , the processor 550 can process a double tap or triple tap as valid input. However, it is not limited to this.

FIGS. 15A and 15B are diagrams 1500 and 1550 for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.

Referring to FIGS. 15A and 15B , a processor (eg, processor 550 of FIG. 5 ) may check the posture of an electronic device (eg, electronic device 501 of FIG. 5 ).

In one embodiment, the processor 550 may check the posture of the electronic device 501 based on sensor information acquired through an inertial sensor (eg, the inertial sensor 541 in FIG. 5).

In one embodiment, the posture of the electronic device 501 is determined by a sensor circuit (e.g., the sensor circuit 540 of FIG. 5 ), e.g., an inertial sensor, as shown by reference numerals <1510> and <1530>. A state in which the first housing 541 (e.g., the first housing 210 in FIG. 2A) is disposed facing the ground (e.g., the floor or a desk) (e.g., the first housing 210 is parallel to the ground) status) may be included.

According to one embodiment, reference number <1510> is a diagram showing the front of the electronic device 501 with the first housing 210 facing the ground, and reference number <1530> is a diagram showing the first housing 210. This diagram shows the rear of the electronic device 501 when placed facing the ground.

In one embodiment, referring to reference numerals <1510> and <1530>, in a state in which the first housing 210 is disposed facing the ground, the second housing (e.g., the second housing of FIG. 2A) of the electronic device 501 User interaction 1535 may be detected in a partial area, for example, a second area, of the fourth surface of the housing 220 (e.g., the fourth surface 222 in FIG. 2B). In one embodiment, a second display (eg, the second display 533 in FIG. 5) may be disposed on the fourth surface 222 of the second housing 220. As the second display 533 is disposed on the fourth side 222 of the second housing 220, user interaction 1535 is detected through the second display 533 disposed on the fourth side 222. It can be.

In one embodiment, when the posture of the electronic device 501 is in the states of reference numerals <1510> and <1530>, user interaction 1535 may be detected through the second display 533 disposed on the fourth side 222. The probability may be higher than the probability that user interaction is detected on the second side of the first housing 210 (eg, the second side 212 in FIG. 2B). Based on this, when the posture of the electronic device 501 is confirmed to be in the states indicated by reference numerals <1510> and <1530>, the processor 550 displays the user information through the second display 533 disposed on the fourth side 222. It is estimated (or predicted) that the interaction 1535 is detected, and the sensor data of the user interaction 1535 can be corrected.

In another embodiment, the posture of the electronic device 501 is determined by the first housing in which the sensor circuit 540, for example, the inertial sensor 541, is disposed, as shown in reference numerals <1560> and <1570>. It may include a state in which the first housing 210 is not disposed to face the ground (eg, a state in which the first housing 210 is not disposed parallel to the ground).

According to one embodiment, reference number <1560> is a diagram illustrating the front of the electronic device 501 in a state where the first housing 210 is arranged not to face the ground, and reference number <1580> is a diagram showing the front of the first housing 210. ) is a diagram showing the rear of the electronic device 501 in a state where it is arranged not to face the ground.

In one embodiment, referring to reference numerals <1560> and <1580>, the second surface of the first housing 210 of the electronic device 501 is disposed so that the first housing 210 is not facing the ground. User interaction 1535 may be detected in some areas of 212, for example, the fourth area. In one embodiment, the second display 533 may not be disposed on the second surface 212 of the first housing 210, and accordingly, user interaction 1535 is detected through the second display 533. It may not work.

In one embodiment, when the posture of the electronic device 501 is in the states of reference numerals <1560> and <1580>, the probability of detecting user interaction through the second display 533 disposed on the fourth side 222 is The probability of user interaction 1535 being detected on side 2 212 may be lower. Based on this, when the posture of the electronic device 501 is confirmed to be in the states indicated by reference numerals <1560> and <1580>, the processor 550 estimates that user interaction 1535 is detected on the second side 212 ( or prediction), and sensor data of user interaction 1535 can be corrected.

FIG. 16 is a diagram 1600 for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.

Referring to FIG. 16, a processor (e.g., processor 550 of FIG. 5) may check the posture of an electronic device (e.g., electronic device 501 of FIG. 5). For example, the processor 550 may check the posture of the electronic device 501, for example, the degree of horizontality, based on sensor information acquired through an inertial sensor (e.g., the inertial sensor 541 in FIG. 5). there is. For example, the processor 550 may detect the second surface of the first housing (e.g., the first housing 210 in FIG. 2A) of the electronic device 501 based on sensor information acquired through the inertial sensor 541. (e.g., the second side 212 in FIG. 2B) and/or the fourth side of the second housing (e.g., the second housing 220 in FIG. 2A) toward the ground (e.g., the floor or desk). It is possible to check whether it is placed and maintained level with the ground.

In one embodiment, after confirming the posture of the electronic device 501 (e.g., the horizontal degree of the electronic device 501), the processor 550 detects the electronic device 501 through a grip sensor (e.g., the grip sensor 543 in FIG. 5). The grip state of the device 501 can be checked.

In one embodiment, the grip state of the electronic device 501 is, as shown by reference numeral <1610>, when the electronic device 501 is in an unfolded state (e.g., the state of FIGS. 2A and 2B), the first housing (For example, the first housing 210 of FIG. 2A) may be gripped.

Reference number <1610> according to one embodiment refers to a state in which the second surface 212 of the first housing 210 and the fourth surface 222 of the second housing 220 are disposed to face the ground (e.g. This diagram shows the rear of the electronic device 501 when the electronic device 501 is not placed horizontally with the ground and the first housing 210 is gripped.

In one embodiment, referring to reference number <1610>, the second side 212 of the first housing 210 and the fourth side 222 of the second housing 220 are disposed so as not to face the ground ( Example: When the electronic device 501 is not placed horizontally with the ground) and the first housing 210 is gripped, the second side 212 of the first housing 210 of the electronic device 501 User interaction 1615 may be detected in some areas, for example, the third area. In one embodiment, the second display 533 may not be disposed on the second surface 212 of the first housing 210, and accordingly, when the first housing 210 is gripped, the second display ( User interaction 1615 may not be detected through 533).

In one embodiment, when the electronic device 501 is in the state of reference numeral <1610>, the probability of detecting user interaction through the second display 533 disposed on the fourth side 222 increases with the second display 533 disposed on the fourth side 222. ) may be lower than the probability that user interaction 1615 is detected. Based on this, in the state indicated by reference numeral <1610>, the processor 550 estimates (or predicts) that the user interaction 1615 is detected on the second side 212 and collects the sensor data of the user interaction 1615. It can be corrected.

In another embodiment, reference numeral <1650> indicates that when the electronic device 501 is in a folded state (e.g., the state of FIGS. 3A and 3B), the fourth side 222 of the second housing 220 faces the front. The display may be in a viewing state (e.g., the second surface 212 of the first housing 210 is disposed not to face the ground) and the electronic device 501 may be gripped. In the state indicated by reference numeral <1650>, the processor 550 may detect user interaction (not shown) in a partial area of the second surface 212 of the first housing 210 of the electronic device 501.

In one embodiment, when the electronic device 501 is in the state indicated by reference numeral <1650>, the fourth side 222 of the second housing 220 is gripped with the electronic device 501 facing the front. Therefore, there may be a high probability that user interaction (not shown) will be detected on the second side 212. Based on this, if the electronic device 501 is confirmed to be in the state indicated by reference numeral <1650>, the processor 550 estimates (or predicts) that user interaction (not shown) is detected on the second side 212, Sensor data from user interaction (not shown) can be corrected.

In various embodiments, although not shown, the processor 550 is disposed so that the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 face the ground. In a state (e.g., a state in which the electronic device 501 is placed horizontally with the ground), the gripped state of the first housing 210 and/or the second housing 220 can be detected through the grip sensor 543. You can. If user interaction is detected in this state, the processor 550 may process the user interaction as a valid input. For example, the processor 550 is disposed with the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 facing the ground (e.g., electronic Although the device 501 is placed horizontally with the ground), the first housing 210 and/or the second housing 220 are gripped, so the detected user interaction is converted into the user's intended input. can be determined and processed as valid input. However, it is not limited to this, and the processor 550 is arranged with the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 facing the ground ( Example: the electronic device 501 is placed horizontally to the ground) and user interaction is detected while gripping the first housing 210 and/or the second housing 220 through the grip sensor 543. In this case, the processor 550 may process the user interaction as an invalid input.

In various embodiments, although not shown, the processor 550 is disposed so that the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 face the ground. Detecting a state in which the first housing 210 and/or the second housing 220 are not gripped through the grip sensor 543 in a state (e.g., the electronic device 501 is placed horizontally with the ground) can do. If user interaction is detected in this state, the processor 550 may process the user interaction as an invalid input. For example, the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 are disposed so as not to face the ground and are detected through the grip sensor 543. 1 User interaction detected while not gripping the housing 210 and/or the second housing 220 includes manipulating the electronic device 501 (e.g., on a display (e.g., display 530 in FIG. 5)). by the user, which can be detected by touch input) or by an external impact (e.g., an impact resulting from placing the electronic device 501 on the ground or an impact resulting from an impact being applied to the ground on which the electronic device 501 is placed). This may not be the intended input. Based on this, the second side 212 of the first housing 210 and/or the fourth side 222 of the second housing 220 are disposed so as not to face the ground, and the grip sensor 543 detects When user interaction is detected without gripping the first housing 210 and/or the second housing 220, the processor 550 may process the detected user interaction as an invalid input.

FIG. 17 is a diagram 1700 for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.

Referring to FIG. 17, when the electronic device (e.g., the electronic device 501 of FIG. 5) is in an unfolded state (e.g., the state of FIGS. 2A and 2B), a grip sensor (e.g., the grip sensor 543 of FIG. 5) The grip state of the electronic device 501 can be confirmed through .

In one embodiment, the processor (e.g., processor 550 of FIG. 5) determines whether the electronic device 501 is gripped with one hand or with both hands based on sensor information acquired through the grip sensor 543. Based on whether the user is in a grip state, the type of user interaction detected and/or the location at which the user interaction is detected may be learned.

In one embodiment, when user interaction is detected on the back of the electronic device 501 while the electronic device 501 is gripped with one hand, sensor values for movement of the electronic device 501 (e.g., acceleration value and /or angular velocity value) is a sensor value (e.g., acceleration value) for the movement of the electronic device 501 when user interaction is detected from the rear of the electronic device 501 while the electronic device 501 is gripped with both hands. and/or angular velocity value).

In one embodiment, when the electronic device 501 is gripped with one hand, depending on whether the electronic device 501 is gripped with the left hand or the right hand, 1 It can be estimated whether user interaction is detected on the second side 212 of the housing 210 or whether user interaction is detected on the fourth side 222 of the second housing 220.

In one embodiment, the grip sensor 543 may be disposed on at least a portion of the side of the electronic device 501. For example, the grip sensor 543 is a first grip sensor 1711 and/or disposed in a partial area of the second side 213c of the first housing 210, as shown in reference number <1710>. It may include a second grip sensor 1713 disposed in a partial area of the fifth side 223c of the second housing 220.

In one embodiment, as shown in reference numeral <1710>, the processor 550 includes a first grip sensor 1711 and/or disposed in a portion of the second side 213c of the first housing 210. Through the second grip sensor 1713 disposed in a portion of the fifth side 223c of the second housing 220, it can be confirmed that the electronic device 501 is gripped with both hands 1701 and 1703. For example, when it is confirmed that the electronic device 501 is gripped with both hands 1701 and 1703 through the first grip sensor 1711 and the second grip sensor 1713, the processor 550 is stored in the first housing. It is assumed (or predicted) that user interaction 1615 is detected on the second side 212 of 210 and/or the fourth side 222 of second housing 220, and sensor data of the detected user interaction can be corrected.

In another embodiment, as shown in reference numeral <1730>, the processor 550 receives electronic information through the first grip sensor 1711 disposed in a portion of the second side 213c of the first housing 210. The device 501 can be checked by gripping it with one hand 1703. For example, when it is confirmed that the electronic device 501 is gripped with one hand 1703 through the first grip sensor 1711, the processor 550 is connected to the second side 212 of the first housing 210. It is estimated (or predicted) that user interaction 1615 is detected, and sensor data of the detected user interaction can be corrected.

FIG. 18 is a diagram 1800 for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.

Referring to FIG. 18, when the electronic device (e.g., the electronic device 501 of FIG. 5) is in a folded state (e.g., the state of FIGS. 3A and 3B), the grip sensor (e.g., the grip sensor 543 of FIG. 5) The grip state of the electronic device 501 can be confirmed through .

In one embodiment, the processor (e.g., processor 550 of FIG. 5) determines whether the electronic device 501 is gripped with one hand or with both hands based on sensor information acquired through the grip sensor 543. Based on whether the user is in a grip state, the type of user interaction to be detected and/or the location at which the user interaction is detected may be estimated.

For example, when the electronic device 501 is in a folded state, the processor 550 detects the electronic device ( 501) can be checked by gripping it with one hand (1703). For example, when the electronic device 501 is in a folded state and the electronic device 501 is confirmed to be gripped with one hand 1703 through the second grip sensor 1713, the processor 550 is stored in the first housing. It is estimated (or predicted) that user interaction is detected on the second side 212 of 210, and sensor data of the detected user interaction can be corrected.

FIG. 19 is a diagram 1900 for explaining a method of correcting sensor data of user interaction according to the grip of the electronic device 501, according to an embodiment of the present disclosure.

Referring to FIG. 19, a processor (e.g., processor 550 of FIG. 5) may check the grip state of an electronic device (e.g., electronic device 501 of FIG. 5). For example, the processor 550 determines whether the electronic device 501 is gripped with one hand (e.g., left or right hand) or with both hands through a grip sensor (e.g., grip sensor 543 in FIG. 5). You can check whether the status is correct or not.

In one embodiment, processor 550 may detect user interaction based on thumb base 1910 and/or touch information. For example, the processor 550 may detect the thumb base 1910 of the right hand 1901 through the grip sensor 543 and/or the touch sensor of the first display (e.g., the first display 531 in FIG. 5). 1 Based on confirmation that some areas of the display 531 are in contact, it can be confirmed that the electronic device 501 is operated using the right hand 1901 while gripping the electronic device 501 with the right hand 1901. You can.

In one embodiment, when the electronic device 501 is operated with one hand, the amount of change in the acceleration value and/or angular velocity value of the electronic device 501 may be greater than when the electronic device 501 is operated with both hands. Based on this, when user interaction is detected on the back of the electronic device 501 when the electronic device 501 is operated with one hand in the unfolded state, the movement of the electronic device 501 moves the electronic device 501 in both directions. The movement can be greater than when operated by hand. In consideration of the above, when the processor 550 confirms that the electronic device 501 is being operated with one hand, the processor 550 operates on the rear side (e.g., the first housing (e.g., the first housing in FIG. 2A) of the electronic device 501. The second side of the housing 210 (e.g., the second side 212 in FIG. 2b) or the fourth side of the second housing (e.g., the second housing 220 in FIG. 2a) (e.g., the second side 212 in FIG. 2b) In order to accurately recognize user interaction on the four sides 222), sensor data acquired through a sensor circuit (eg, sensor circuit 540 of FIG. 5) can be corrected.

In one embodiment, while gripping the electronic device 501 with the right hand 1901, the user moves the right hand 1901 to the first area 1920 and the second area 1930 on the back of the electronic device 501. Although it may be easy to detect interaction, it may be difficult to detect user interaction in the third area 1940. Based on this, when the electronic device 501 is in an unfolded state and the electronic device 501 is confirmed to be gripped with the right hand 1901, the processor 550 is positioned on the second side 212 of the first housing 210. It can be estimated (or predicted) that user interaction is detected, and sensor data of the detected user interaction can be corrected.

FIG. 20 is a diagram 2000 for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.

Referring to reference number <2010> in FIG. 20, the electronic device (e.g., the electronic device 501 in FIG. 5) may be gripped by one hand 2015 (e.g., the left hand) of the user in the unfolded state. there is. For example, when the electronic device 501 is in an unfolded state (e.g., the state of FIGS. 2A and 2B), the electronic device 501 is configured to include a pair of housings (e.g., the first housing 210 of FIG. 2A and the second housing 210 of FIG. 2A). 2 A first display (e.g., the first display 531 in FIG. 5) disposed in the space formed by the housing 220) and a fourth side (e.g., the fourth side in FIG. 2b) of the second housing 220. 222)) may include a second display (eg, the second display 533 in FIG. 5) disposed on the display.

In one embodiment, the processor 550 detects user interaction based on detecting a touch input on the first display 531 and/or the second display 533 while the electronic device 501 is in an unfolded state. The area can be estimated (or predicted).

For example, as shown in reference numeral <2050>, the processor 550 operates with a thumb in a fourth area among a plurality of areas (e.g., first to sixth areas) of the first display 531. A touch input 2051 is detected, and as shown by reference number <2030>, a touch input using the index finger and/or middle finger may be detected in a specific area 2035 of the second display 533.

In one embodiment, as shown in reference numerals <2050> and <2030>, a thumb is pressed in a fourth area among a plurality of areas (e.g., first to sixth areas) of the first display 531. When the touch input 2051 is detected and the touch input by detecting and/or stopping the specific area 2035 of the second display 533 is detected, the processor 550 2 It is estimated (or predicted) that user interaction is detected on the fourth surface 222 of the housing 220, and sensor data of the user interaction can be corrected.

FIGS. 21A and 21B are diagrams 2100 and 2150 for explaining a method of correcting sensor data of user interaction according to the grip of the electronic device 501, according to an embodiment of the present disclosure.

Referring to FIG. 21A , the electronic device (e.g., the electronic device 501 of FIG. 5 ) may be in an unfolded state and gripped by both hands 2110 and 2120 of the user. For example, the left hand 2110 may be gripping the side of the electronic device 501 (eg, the fifth side 223c of the second housing 220 in FIG. 2A). Additionally, the right hand 2120 grips the side of the electronic device 501 (e.g., the second side 213c of the first housing 210 in FIG. 2A) and displays the first display (e.g., the second side 213c in FIG. 5). 1 The fourth area 2137 among a plurality of areas (e.g., the first area 2131, the second area 2133, the third area 2135, and the fourth area 2137) of the display 531) A touch input by the thumb of the right hand 2120 may be detected.

In one embodiment, when a touch input is detected in the fourth area 2137 by the thumb of the right hand 2120, there is a possibility that user interaction is detected by another finger of the right hand 2120 on the back of the electronic device 501. This can be high. Considering this, when a touch input is detected in the fourth area 2137 by the thumb of the right hand 2120, the processor 550 moves the second surface of the first housing 210 corresponding to the second area 2133. It is estimated (or predicted) that user interaction is detected in the area 2140 (e.g., the second side 212 in FIG. 2B), and sensor data of the user interaction can be corrected.

It is not limited thereto, and referring to FIG. 21B, the electronic device 501 includes a second display (e.g., the fourth side 222 of FIG. 2b) disposed on the fourth side of the second housing 220. : May include the second display 533 in FIG. 5).

In one embodiment, the processor 550 detects a touch input on the first display 531 and/or the second display 533 disposed on the front when the electronic device 501 is unfolded, The area where interaction will be detected can be estimated (or predicted). For example, a touch input is detected in the fourth area 2137 by the thumb of the right hand 2120, and a touch input is detected by the user's left hand 2110 on the rear, for example, second display 533 of the electronic device 501. When interaction is detected, the processor 550 estimates (or predicts) that user interaction is detected in the area 2160 of the fourth side 222 of the second housing 220 where the second display 533 is disposed. And sensor data of user interaction can be corrected.

FIG. 22 is a diagram 2200 for explaining a method of correcting sensor data of user interaction according to the grip of the electronic device 501, according to an embodiment of the present disclosure.

Referring to FIG. 22 , the electronic device (e.g., the electronic device 501 of FIG. 5 ) may be gripped by one hand 2210 (e.g., the left hand) of the user in an unfolded state. For example, the processor (e.g., processor 550 in FIG. 5) may be configured to use a grip sensor disposed on the side of the electronic device 501 (e.g., a portion of the second side 213c of the first housing 210 in FIG. 17). The electronic device 501 is placed on both hands through the first grip sensor 1711 disposed in the region and the second grip sensor 1713 disposed in a partial region of the fifth side 223c of the second housing 220. You can check whether it is gripped by one hand or one hand.

In one embodiment, the electronic device 501 uses a grip sensor disposed on a side of the electronic device 501 (e.g., a second grip sensor 1713 disposed in a partial area of the fifth side 223c of the second housing 220). When it is confirmed that the device 501 is gripped with one hand 2210, the pattern of holding the electronic device 501 by one hand 2210 is confirmed, and the rear side of the electronic device 501 where user interaction is detected ( Example: The area of the second surface (eg, the second surface 212 in FIG. 2B) and/or the fourth surface (eg, the fourth surface 222 in FIG. 2B) can be estimated (or predicted).

For example, while gripping the electronic device 501 with one hand 2210, a second display (e.g., the second display in FIG. 5) disposed on the fourth side 222 of the electronic device 501 When a touch input by a finger is detected through 533)), the processor 550 estimates that user interaction is detected on the fourth surface 222 of the second housing 220 where the second display 533 is disposed. (or predict) and correct sensor data of user interaction.

7A to 22 according to various embodiments, the state of the electronic device 501 (e.g., the posture of the electronic device 501, the movement of the electronic device 501, and/or the electronic device 501 By correcting the sensor data of the user interaction according to the grip state), the type of user interaction and/or location information where the user interaction is detected can be accurately determined.

FIG. 23 is a diagram 2300 for explaining a method of displaying information on a plurality of applications in an unfolded state of the electronic device 501, according to an embodiment of the present disclosure.

Referring to FIG. 23, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) operates when the electronic device 501 is in an unfolded state (e.g., FIGS. 2A and 2B). In the state), information on a plurality of applications may be displayed on the first display (eg, the first display 531 in FIG. 5).

In FIG. 23 according to various embodiments, the description will be made on the assumption that the execution of a plurality of applications, for example, three applications, displays three pieces of information about them in each region of the first display 531 divided into three regions. Let's do it. It is not limited to this, and when more than three applications are executed, the processor 550 divides the first display 531 into more than three areas and displays information about each application in each area. can do.

For example, the processor 550 displays the first information 2311 of application A in the first area (e.g., left area) of the three areas of the first display 531, as shown in reference numeral <2310>. display, display the second information 2312 of application B in the second area (e.g., upper right area), and display the third information 2313 of application C in the third area (e.g., lower right area). You can.

For another example, the processor 550 displays the second information of application B in the first area (e.g., upper left area) of the three areas of the first display 531, as shown in reference numeral <2320>. (2312) is displayed, the third information 2313 of application C is displayed in the second area (e.g., lower left area), and the first information 2311 of application A is displayed in the third area (e.g., right area). can be displayed.

For another example, the processor 550 displays first information of application A in the first area (e.g., upper area) of the three areas of the first display 531, as shown in reference numeral <2330>. (2311) is displayed, the second information 2312 of application B is displayed in the second area (e.g., lower left area), and the third information 2313 of application C is displayed in the third area (e.g., lower right area). ) can be displayed.

For another example, as shown in reference numeral <2340>, the processor 550 displays the second part of application B in the first area (e.g., upper left area) of the three areas of the first display 531. Information 2312 is displayed, third information 2313 of application C is displayed in the second area (e.g., upper right area), and first information 2311 of application A is displayed in the third area (e.g., lower area). ) can be displayed.

Reference numbers <2310>, <2320>, <2330>, and <2340> in FIG. 23 according to various embodiments are one embodiment and are not limited thereto, and information on applications placed in each area may vary. You can.

In various embodiments, the processor 550 may store information (eg, arrangement information) about an area of the first display 531 where information about the executed application is displayed, based on the execution of the application.

FIG. 24 is a diagram 2400 for explaining user interaction detected when the electronic device 501 is in an unfolded state, according to an embodiment of the present disclosure.

Referring to FIG. 24, the electronic device (e.g., the electronic device 501 in FIG. 5) includes a first housing (e.g., the first housing 210 in FIG. 2a) and a second housing (e.g., the first and second housings in FIG. 2a). It may include a housing 220).

In one embodiment, a processor (e.g., processor 550 of FIG. 5) may use a sensor circuit (e.g., sensor circuit 540 of FIG. 5) and/or a touch sensor (e.g., a second display (e.g., the second display of FIG. 5). 2 Based on sensor information acquired through the touch sensor of the display 533), the second surface of the first housing 210 (e.g., the second surface 212 in FIG. 2B) and/or the second housing 220 ), the position where user interaction is detected can be confirmed on the fourth side (e.g., the fourth side 222 in FIG. 2B).

In one embodiment, user interaction may include a double tap or triple tap. However, it is not limited to this.

In one embodiment, the processor 550 sets the second side 212 of the first housing 210 as the first area and sets the fourth side 222 of the second housing 220 as the second area. You can. The processor 550 may detect user interaction in the set first area (eg, second side 212) or second area (eg, fourth side 222).

For example, as shown in reference numeral <2410>, the processor 550 may detect user interaction 2411 in the first area (e.g., the second side 212 of the first housing 210). there is. For another example, as shown in reference numeral <2420>, the processor 550 may detect user interaction 2421 in the second area (e.g., the fourth side 222 of the second housing 220). You can.

In one embodiment, the processor 550 may perform a function mapped to the detected user interaction based on the user interaction being detected in the first area or the second area.

In reference numerals <2410> and <2420> according to various embodiments, it has been described that the area where user interaction is detected is set to two areas, but it is not limited thereto. For example, the areas where user interaction is detected can be set to five areas. For example, the processor 550 sets a partial area (e.g., upper area) of the second surface 212 of the first housing 210 as the first area, and another partial area of the second surface 212 ( Example: lower area) can be set as the second area. The processor 550 sets a part of the fourth surface 222 of the second housing 220 (e.g., the upper area) as the third area, and sets another part of the fourth surface 222 (e.g., the lower area) as the third area. ) can be set as the fourth area. The processor 550 may set a partial area of the second surface 212 and a partial area of the fourth surface 222 (eg, hinge area 310) as the fifth area. The processor 550 may detect user interaction in the set first area, second area, third area, fourth area, or fifth area.

For example, as shown in reference numeral <2430>, the processor 550 may detect user interaction 2431 in the first area (eg, the upper area of the fourth side 222). For another example, as shown in reference numeral <2440>, the processor 550 may detect user interaction 2441 in the second area (eg, the lower area of the fourth surface 222). For another example, as shown in reference numeral <2450>, the processor 550 may detect user interaction 2451 in the third area (eg, the upper area of the second surface 212). For another example, as shown in reference numeral <2460>, the processor 550 may detect user interaction 2461 in the fourth area (eg, the lower area of the second surface 212). For another example, as shown in reference numeral <2470>, the processor 550 operates on a fifth region (e.g., a partial region of the second side 212 and a partial region of the fourth side 222 (e.g., User interaction 2471 can be detected in the hinge area 310).

The area (e.g., the first area, the second area, the third area, the fourth area, and/or the fifth area) according to various embodiments is the first display (e.g., the first display 531 in FIG. 5). Alternatively, it may be set based on the number of information (or number of windows) displayed on the second display 533.

FIG. 25 is a diagram 2500 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 25, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) operates when the electronic device 501 is in an unfolded state (e.g., FIGS. 2A and 2B). In the state), information on a plurality of applications may be displayed on the first display (eg, the first display 531 in FIG. 5). For example, as shown in reference numeral <2510>, the processor 550 displays the first information 2511 of application A in the first area (e.g., left area) of the three areas of the first display 531. ) is displayed, the second information 2512 of application B is displayed in the second area (e.g., upper right area), and the third information 2513 of application C is displayed in the third area (e.g., lower right area). It can be displayed.

In one embodiment, the processor 550 may obtain sensor information through a sensor circuit (eg, sensor circuit 540 of FIG. 5). For example, the sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g., grip sensor 543 in FIG. 5). It is not limited to this, and the sensor information may further include sensor information acquired through a touch sensor (eg, a touch sensor of the second display (eg, the touch sensor of the second display 533 in FIG. 5)).

In one embodiment, the processor 550 displays the second side 212 or User interaction can be detected on the fourth side 222. The processor 550 may check the type of user interaction detected and/or location information where the user interaction was detected.

In one embodiment, the processor 550 may detect user interaction 2515 in a portion of the second side 212 of the electronic device 501, as shown by reference numerals <2510> and <2520>. there is. For example, some areas of the second surface 212 shown at reference numerals <2510> and <2520> are the second area of the first display 531 (e.g., the second information 2512 of application B). It may be an area corresponding to the displayed area).

In one embodiment, the processor 550 may detect user interaction 2535 in a portion of the second side 212 of the electronic device 501, as shown by reference numerals <2530> and <2540>. there is. For example, some areas of the second surface 212 shown at reference numerals <2530> and <2540> are the third area of the first display 531 (e.g., the third information 2513 of application C). It may be an area corresponding to the displayed area).

In one embodiment, the processor 550 may detect user interaction 2555 in a partial area of the fourth side 222 of the electronic device 501, as shown by reference numerals <2550> and <2560>. there is. For example, some areas of the fourth surface 222 shown at reference numerals <2550> and <2560> display the first area of the first display 531 (e.g., the first information 2511 of application A). It may be an area corresponding to the displayed area).

In one embodiment, the processor 550 generates first information 2511 of the first application based on the type of user interaction 2515, 2535, and 2555 and the location information where the user interaction 2515, 2535, and 2555 was detected. , the display properties of at least one of the second information 2512 of the second application and the third information 2513 of the third application can be changed.

Based on the above-described type of user interaction and location information where the user interaction was detected, first information 2511 of the first application, second information 2512 of the second application, and third information 2513 of the third application ), various embodiments will be described in FIGS. 27 and 34B described later with respect to an embodiment of displaying by changing at least one display attribute.

FIG. 26 is a diagram 2600 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 26, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) operates when the electronic device 501 is in an unfolded state (e.g., FIGS. 2A and 2B). In the state), information on a plurality of applications may be displayed on the first display (eg, the first display 531 in FIG. 5). For example, as shown in reference numeral <2610>, the processor 550 displays the first information 2511 of application A in the first area (e.g., left area) of the three areas of the first display 531. ) is displayed, the second information 2512 of application B is displayed in the second area (e.g., upper right area), and the third information 2513 of application C is displayed in the third area (e.g., lower right area). It can be displayed.

In one embodiment, the processor 550 may obtain sensor information through a sensor circuit (eg, sensor circuit 540 of FIG. 5). For example, the sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g., grip sensor 543 in FIG. 5). It is not limited to this, and the sensor information may further include sensor information acquired through a touch sensor (eg, a touch sensor of the second display (eg, the touch sensor of the second display 533 in FIG. 5)).

In one embodiment, the processor 550 displays the second side 212 or User interaction can be detected on the fourth side 222. The processor 550 may check the type of user interaction detected and/or location information where the user interaction was detected.

In one embodiment, the processor 550 may detect user interaction 2615 in a portion of the second side 212 of the electronic device 501, as shown by reference numerals <2610> and <2620>. there is. For example, some areas of the second surface 212 shown at reference numerals <2610> and <2620> are the second area of the first display 531 (e.g., the second information 2512 of application B). It may be an area corresponding to the displayed area).

In one embodiment, the processor 550 generates first information 2511 of the first application and second information of the second application based on the type of user interaction 2615 and the location information where the user interaction 2615 was detected. The display attribute of at least one of (2512) and third information (2513) of the third application can be changed.

In one embodiment, the display properties may include at least one of the size of a window and an arrangement within the window in the display area of the display 530 for displaying the first information of the first application and the second information of the second application. there is.

In FIG. 26 according to various embodiments, the type of user interaction 2615 is assumed to be a double tap, and the function mapped to the double tap is set to a function to terminate the application. However, it is not limited to this, and functions mapped to double tap may include a screen rotation function, a full screen display function, or an application re-run function.

In one embodiment, the processor 550 checks the application displayed on the first display 531 corresponding to the location where the user interaction 2615 was detected, based on the location information where the user interaction 2615 was detected, and selects the application. can be terminated. For example, the processor 550 terminates application B displayed on the first display 531 corresponding to the position where the double tap 2615 was detected, and, as shown in reference numeral <2650>, the first display ( 531), the first information 2511 of application A may be displayed in the first area (e.g., left area), and the second information 2513 of application C may be displayed in the second area (e.g., right area). .

FIG. 27 is a diagram 2700 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Reference numbers <2710>, <2720>, and <2730> of FIG. 27 according to various embodiments are the same as reference numbers <2610>, <2620>, and <2650> of FIG. 26 described above, so detailed The description can be replaced with the description of FIG. 26.

Referring to FIG. 27, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) displays the first display 531, as shown by reference numeral <2710>. ), the first information 2511 of application A is displayed in the first area (e.g., left area), and the second information 2512 of application B is displayed in the second area (e.g., upper right area). is displayed, and the third information 2513 of application C is displayed in the third area (e.g., lower right area), and the first user interaction occurs in a partial area of the second side 212 of the electronic device 501. (2715) can be detected. For example, some areas of the second surface 212 shown at reference numerals <2710> and <2720> are the second area of the first display 531 (e.g., the second information 2512 of application B). It may be an area corresponding to the displayed area).

In one embodiment, the processor 550 stores the first information 2511 of the first application and the second application based on the type of the first user interaction 2715 and the location information where the first user interaction 2715 was detected. The display attribute of at least one of the second information 2512 of and the third information 2513 of the third application can be changed.

In FIG. 27 according to various embodiments, the type of the first user interaction 2715 is assumed to be a double tap, and the function mapped to the double tap is set to a function to terminate the application.

In one embodiment, the processor 550 displays application B on the first display 531 corresponding to the location where the first user interaction 2715 was detected, based on location information where the first user interaction 2715 was detected. ends, and as shown in reference number <2730>, the first information 2511 of application A is displayed in the first area (e.g., left area) of the first display 531, and the first information 2511 of application A is displayed in the second area (e.g., left area). : Right area) can display the second information 2513 of application C.

In one embodiment, the processor 550 detects a second user interaction 2735 in a portion of the second side 212 of the electronic device 501, as shown by reference numerals <2730> and <2740>. can do. For example, some areas of the second surface 212 shown at reference numerals <2730> and <2740> are the second area of the first display 531 (e.g., the second information 2512 of application B). It may be an area corresponding to the displayed area).

In FIG. 27 according to various embodiments, it is assumed that the type of the second user interaction 2735 is a triple tap, and the function mapped to the triple tap is set to a function of re-running a terminated application. However, it is not limited to this, and functions mapped to the triple tab may include a screen rotation function, a full screen display function, or an application change function.

In one embodiment, the processor 550 re-executes application B that was terminated based on the detection of the second user interaction 2735, and, as shown by reference numeral <2750>, displays the first display 531. Among the three areas, the first information 2511 of application A is displayed in the first area (e.g. the left area), and the second information 2512 of the re-executed application B is displayed in the second area (e.g. the upper right area). may be displayed, and third information 2513 of application C may be displayed in the third area (e.g., lower right area).

FIGS. 28A and 28B are diagrams 2800 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

28A and 28B, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) is a first processor, as shown by reference numeral <2810>. Among the three areas of the display 531, the first information 2511 of application A is displayed in the first area (e.g., left area), and the second information 2511 of application B is displayed in the second area (e.g., upper right area). (2512) may be displayed, and third information 2513 of application C may be displayed in the third area (e.g., lower right area).

In one embodiment, the processor 550 may obtain sensor information through a sensor circuit (eg, sensor circuit 540 of FIG. 5). For example, the sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g., grip sensor 543 in FIG. 5). It is not limited to this, and the sensor information may further include sensor information acquired through a touch sensor (eg, a touch sensor of the second display (eg, the touch sensor of the second display 533 in FIG. 5)).

In one embodiment, the processor 550 displays the second side 212 or User interaction 2821 can be detected on the fourth side 222. The processor 550 may check the type of user interaction 2821 detected and/or location information where the user interaction 2821 was detected.

In one embodiment, the processor 550 detects user interaction 2821 by the left hand 2501 in a partial area of the fourth side 222 of the electronic device 501, as shown by reference numeral <2815>. can do. For example, a partial area of the fourth side 222 shown at reference number <2815> is the second area of the first display 531 (e.g., an area where the first information 2511 of application A is displayed) It may be an area corresponding to .

In one embodiment, the processor 550 generates first information 2511 of the first application and second information of the second application based on the type of user interaction 2821 and the location information where the user interaction 2821 was detected. The display attribute of at least one of (2512) and third information (2513) of application C can be changed.

In FIGS. 28A and 28B according to various embodiments, the type of user interaction 2821 will be described assuming a triple tap. Additionally, when a triple tab 2821 is detected on the fourth surface 222 of the second housing 220, the mapped function will be described assuming that the function is set to display the window by rotating it in the first direction. In addition, when the triple tap 2821 is detected on the second surface 212 of the first housing 210, the mapped function is displayed by rotating the window in the second direction (e.g., the direction opposite to the first direction). This will be explained assuming that it is set as a function.

In one embodiment, the processor 550 rotates the window in the first direction (2823) based on the triple tap (2821) being detected on the fourth side (222) of the second housing (220), First information 2511 of the application, second information 2512 of the second application, and third information 2513 of application C can be displayed. For example, as shown in reference numeral <2820>, the processor 550 displays first information 2511 of application A in the first area (e.g., upper area) of the three areas of the first display 531. ), display the second information 2512 of application B in the second area (e.g., lower right area), and display the third information 2513 of application C in the third area (e.g., lower left area). It can be displayed.

In one embodiment, the processor 550 detects a triple tap 2831 by the left hand 2501 on the fourth side 222 of the second housing 220, as shown by reference numeral <2825>. Based on this, information about applications can be displayed by rotating the window in the first direction (2823). For example, as shown in reference numeral <2830>, the processor 550 stores the third information 2513 of application C in the first area (e.g., upper left area) of the three areas of the first display 531. Display, display the second information 2512 of application B in the second area (e.g. right area), and display the first information 2511 of application A in the third area (e.g. lower left area). You can.

In one embodiment, the processor 550 detects a triple tap 2841 by the left hand 2501 on the fourth side 222 of the second housing 220, as shown by reference numeral <2835>. Based on this, information about applications can be displayed by rotating the window in the first direction (2823). For example, as shown in reference numeral <2840>, the processor 550 displays the second information 2512 of application B in the first area (e.g., upper left area) of the three areas of the first display 531. , the third information 2513 of application C is displayed in the second area (e.g., upper right area), and the first information 2511 of application A is displayed in the third area (e.g., lower area). You can.

In one embodiment, the processor 550 detects a triple tap 2851 by the right hand 2503 on the second side 212 of the first housing 210, as shown by reference numeral <2845>. Based on this, information about applications can be displayed by rotating the window in the second direction (2853). For example, as shown in reference numeral <2850>, the processor 550 displays the third information 2513 of application C in the first area (e.g., upper left area) of the three areas of the first display 531. Display, display the second information 2512 of application B in the second area (e.g. right area), and display the first information 2511 of application A in the third area (e.g. lower left area). You can.

FIGS. 29A and 29B are diagrams 2900 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIGS. 29A and 29B, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) has a first processor, as shown in reference numeral <2910>. Among the three areas of the display 531, the first information 2511 of application A is displayed in the first area (e.g., left area), and the second information 2511 of application B is displayed in the second area (e.g., upper right area). (2512) may be displayed, and third information 2513 of application C may be displayed in the third area (e.g., lower right area).

In one embodiment, the processor 550 may obtain sensor information through a sensor circuit (eg, sensor circuit 540 of FIG. 5). For example, the sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g., grip sensor 543 in FIG. 5). It is not limited to this, and the sensor information may further include sensor information acquired through a touch sensor (eg, a touch sensor of the second display (eg, the touch sensor of the second display 533 in FIG. 5)).

In one embodiment, the processor 550 displays the second side 212 or User interaction can be detected on the fourth side 222. The processor 550 may check the type of user interaction detected and/or location information where the user interaction was detected.

In one embodiment, the processor 550 may detect user interaction 2915 in a partial area of the second side 212 of the electronic device 501, as shown by reference number <2917>.

In one embodiment, the processor 550 generates first information 2511 of the first application and second information of the second application based on the type of user interaction 2915 and the location information where the user interaction 2915 was detected. The display attribute of at least one of (2512) and third information (2513) of application C can be changed.

29A and 29B according to various embodiments, the type of user interaction 2915 is assumed to be a double tap or triple tap, and the double tap or triple tap is on the second side 212 of the first housing 210. Based on what is detected, the description will be made assuming that different functions are performed. For example, when a double tap is detected on the second surface 212 of the first housing 210, the mapped function will be described assuming that the function is set to display the window by rotating it in the first direction. In addition, when a triple tap is detected on the second surface 212 of the first housing 210, the mapped function is set to a function of rotating and displaying the window in the second direction (e.g., the direction opposite to the first direction). Let us explain by assuming that it is.

In one embodiment, the processor 550 moves in a first direction based on detection of a double tap 2915 on the second side 212 of the first housing 210, as shown in reference numeral <2917>. The window can be rotated (2921) to display first information (2511) of the first application, second information (2512) of the second application, and third information (2513) of application C. For example, as shown in reference numeral <2920>, the processor 550 displays the first information 2511 of application A in the first area (e.g., upper area) of the three areas of the first display 531. ), display the second information 2512 of application B in the second area (e.g., lower right area), and display the third information 2513 of application C in the third area (e.g., lower left area). It can be displayed.

In one embodiment, the processor 550 selects the first direction based on detection of a double tap 2925 on the second side 212 of the first housing 210, as shown by reference numeral <2927>. By rotating the window (e.g., a window displaying application information) (2931), first information (2511) of the first application, second information (2512) of the second application, and third information (2513) of application C ) can be displayed. For example, as shown in reference numeral <2930>, the processor 550 displays the third information of application C (e.g., the upper left area) of the three areas of the first display 531. 2513), the second information 2512 of application B is displayed in the second area (e.g., right area), and the first information 2511 of application A is displayed in the third area (e.g., lower left area). It can be displayed.

In one embodiment, the processor 550 selects the second direction based on the triple tap 2935 being detected on the second side 212 of the first housing 210, as shown by reference numeral <2937>. By rotating the window 2941, the first information 2511 of the first application, the second information 2512 of the second application, and the third information 2513 of application C can be displayed. For example, as shown in reference numeral <2940>, the processor 550 displays the first information 2511 of application A in the first area (e.g., upper area) of the three areas of the first display 531. ), display the second information 2512 of application B in the second area (e.g., lower right area), and display the third information 2513 of application C in the third area (e.g., lower left area). It can be displayed.

FIG. 30 is a diagram 3000 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 30, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) displays the first display 531, as shown by reference numeral <3010>. ) can display the first information 3015 of application A.

In one embodiment, the processor 550 may obtain sensor information through a sensor circuit (eg, sensor circuit 540 of FIG. 5). For example, the sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g., grip sensor 543 in FIG. 5). It is not limited to this, and the sensor information may further include sensor information acquired through a touch sensor (eg, a touch sensor of the second display (eg, the touch sensor of the second display 533 in FIG. 5)).

In one embodiment, the processor 550 determines the grip state of the electronic device 501 and the second surface ( 212) or user interaction can be detected on the fourth side 222. The processor 550 may check the grip state of the electronic device 501, the type of detected user interaction, and/or location information where the user interaction was detected.

In one embodiment, the processor 550 operates on the second side 212 of the electronic device 501, as shown in reference numeral <3025>, while the electronic device 501 is gripped with both hands 2501 and 2503. ) User interaction 3020 can be detected in some areas of ).

In one embodiment, the processor 550 displays the first information 3015 of application A on the first display 531 based on the type of user interaction 3020 and the location information where the user interaction 3020 was detected. Properties can be changed.

30 according to various embodiments, the type of user interaction 3020 is a double tap, and based on the double tap being detected on the second side 212 of the first housing 210, the first display 531 ) will be explained assuming that the display area is divided into a plurality of areas and then a plurality of information is displayed.

In one embodiment, based on detecting a double tap 3020 on the second side 212 of the first housing 210, the processor 550 displays the first display, as shown at 3030. The display area 531 can be divided into two areas. The processor 550 displays the first information 3015 of application A in the first area (e.g., left area) of the two divided areas, and the application list 3035 in the second area (e.g., right area). can be displayed. The application list 3035 may include at least one application frequently used by the user.

In one embodiment, the processor 550 creates a new area (e.g., the second area (e.g., right area)) of the first display 531 corresponding to the second side 212 where the double tap 3020 was detected. Executing information (e.g., application list 3035) can be displayed.

In another embodiment, based on detecting a double tap 3020 on the second side 212 of the first housing 210, the processor 550 displays the first display, as shown at 3050 . The display area 531 can be divided into two areas. The processor 550 displays the first information 3015 of application A in the first area (e.g., upper area) of the two divided areas, and the application list 3035 in the second area (e.g., lower area). can be displayed.

FIG. 31 is a diagram 3100 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Since the reference number <3110> of FIG. 31 according to various embodiments is the same as the reference number <3010> of FIG. 30 described above, the detailed description thereof can be replaced with the description of FIG. 30.

Referring to FIG. 31, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) displays the first display 531, as shown by reference numeral <3110>. ), with the first information 3015 of application A displayed on the sensor circuit (e.g., sensor circuit 540 in FIG. 5) (e.g., inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/ Alternatively, sensor information may be obtained through a grip sensor (e.g., grip sensor 543 in FIG. 5) and/or a touch sensor (e.g., touch sensor of a second display (e.g., touch sensor of the second display 533 in FIG. 5)) there is.

In one embodiment, the processor 550 may detect the grip state and user interaction on the second side 212 or the fourth side 222 of the electronic device 501 based on the acquired sensor information. The processor 550 may check the grip state of the electronic device 501, the type of detected user interaction, and/or location information where the user interaction was detected.

In one embodiment, the processor 550 operates on the second side 212 of the electronic device 501, as shown by reference numeral <3125>, while the electronic device 501 is gripped with both hands 2501 and 2503. ) User interaction 3120 can be detected in some areas of ).

In one embodiment, the processor 550 displays the first information 3015 of application A on the first display 531 based on the type of user interaction 3120 and the location information where the user interaction 3120 was detected. Properties can be changed.

31 according to various embodiments, the type of user interaction is a double tap, and based on the double tap being detected on the second side 212 of the first housing 210, the display on the first display 531 The explanation will be made assuming that the area is divided into a plurality of areas and then a plurality of information is displayed.

In one embodiment, based on detecting a double tap 3120 on the second side 212 of the first housing 210, the processor 550 displays the first display, as shown at 3150 . The display area 531 can be divided into two areas. The processor 550 displays the first information 3015 of application A in the first area (e.g., left area) of the two divided areas, and displays the home screen screen 3155 in the second area (e.g., right area). ) can be displayed.

In one embodiment, the processor 550 creates a new area (e.g., the second area (e.g., right area)) of the first display 531 corresponding to the second side 212 where the double tap 3020 was detected. Executable information (e.g., home screen screen 3155) can be displayed.

FIG. 32 is a diagram 3200 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Since the reference number <3210> of FIG. 32 according to various embodiments is the same as the reference number <3010> of FIG. 30 described above, the detailed description thereof can be replaced with the description of FIG. 30.

Referring to FIG. 32, the processor (e.g., processor 550 of FIG. 5) of the electronic device (e.g., electronic device 501 of FIG. 5) displays the first display 531, as shown by reference numeral <3210>. ), with the first information 3015 of application A displayed on the sensor circuit (e.g., sensor circuit 540 in FIG. 5) (e.g., inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/ Alternatively, sensor information may be obtained through a grip sensor (e.g., grip sensor 543 in FIG. 5) and/or a touch sensor (e.g., touch sensor of a second display (e.g., touch sensor of the second display 533 in FIG. 5)) there is.

In one embodiment, the processor 550 may detect the grip state and user interaction on the second side 212 or the fourth side 222 of the electronic device 501 based on the acquired sensor information. The processor 550 may check the grip state of the electronic device 501, the type of detected user interaction, and/or location information where the user interaction was detected.

In one embodiment, the processor 550 operates on the fourth side 222 of the electronic device 501, as shown by reference numeral <3230>, while the electronic device 501 is gripped with both hands 2501 and 2503. ) User interaction 3220 can be detected in some areas of ).

In one embodiment, the processor 550 displays the first information 3015 of application A on the first display 531 based on the type of user interaction 3220 and the location information where the user interaction 3220 was detected. Properties can be changed.

In FIG. 32 according to various embodiments, the type of user interaction is a double tap, and based on the double tap being detected on the fourth side 222 of the second housing 220, the display on the first display 531 The explanation will be made assuming that the area is divided into a plurality of areas and then a plurality of information is displayed.

In one embodiment, based on the double tap 3220 being detected on the fourth side 222 of the second housing 220, the processor 550 displays the first display, as shown at 3250 . The display area 531 can be divided into two areas. The processor 550 displays the application list 3255 in the first area (e.g., left area) of the two divided areas, and first information 3015 of application A in the second area (e.g., right area). can be displayed.

In one embodiment, the processor 550 creates a new area (e.g., first area (e.g., left area)) of the first display 531 corresponding to the fourth side 222 where the double tap 3020 was detected. Executed information (e.g., application list 3255) can be displayed.

FIG. 33 is a diagram 3300 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 33, a processor (e.g., processor 550 of FIG. 5) of an electronic device (e.g., electronic device 501 of FIG. 5) operates in a first area (e.g., as shown by reference numeral <3310>). : The second information 3313 of application B may be displayed in the left area), and the first information 3311 of application A may be displayed in the second area (e.g., right area).

In one embodiment, the processor 550 may include sensor circuitry (e.g., sensor circuit 540 of Figure 5), such as an inertial sensor (e.g., inertial sensor 541 of Figure 5) and/or a grip sensor (e.g., Sensor information can be obtained through the grip sensor 543 in FIG. 5. It is not limited to this, and the processor 550 may further obtain sensor information through a touch sensor (e.g., a touch sensor of the second display (e.g., the touch sensor of the second display 533 in FIG. 5). Processor 550) Based on sensor information acquired through the sensor circuit 540 and/or the touch sensor of the second display 533, the grip state and the second side 212 or the fourth side 222 of the electronic device 501 The processor 550 may check the grip state of the electronic device 501, the type of detected user interaction, and/or location information where the user interaction was detected.

In one embodiment, the processor 550 may detect user interaction 3315 in a partial area of the second side 212 of the electronic device 501, as shown by reference numeral <3320>.

In one embodiment, the processor 550 displays second information 3313 and The display properties of the first information 3311 of application A can be changed.

In FIG. 33 according to various embodiments, the type of user interaction is a double tap, and based on the double tap being detected on the second side 212 of the first housing 210, the display on the first display 531 The explanation will be made assuming that the area is divided into a plurality of areas and then a plurality of information is displayed.

In one embodiment, based on detecting a double tap 3315 on the second side 212 of the first housing 210, the processor 550 displays the first display, as shown at 3330 . The display area of 531 can be divided into three areas. The processor 550 displays the second information 3313 of application B in the first area (e.g., upper left area) of the three divided areas, and displays the second information 3313 of application A in the second area (e.g., upper right area). First information 3311 may be displayed, and an application list 3331 may be displayed in the third area (e.g., lower area).

It is not limited to this, and based on the double tap 3315 being detected on the second surface 212 of the first housing 210, the processor 550, as shown in reference numeral <3350>, The display area of the display 531 can be divided into three areas. The processor 550 displays the second information 3313 of application B in the first area (e.g., upper left area) of the three divided areas, and the second information 3313 of application A in the second area (e.g., right area). 1 information 3311 may be displayed, and an application list 3331 may be displayed in the third area (e.g., lower left area).

FIGS. 34A and 34B are diagrams 3400 and 3450 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIGS. 34A and 34B, when the electronic device (e.g., the electronic device 501 of FIG. 5) is in a folded state, the processor (e.g., the processor 550 of FIG. 5) operates as shown by reference numeral <3410>. Likewise, the first information 3311 of application A is displayed in the first area (e.g., upper area) of the second display (e.g., second display 533 in FIG. 5), and the first information 3311 of application A is displayed in the second area (e.g., right area). ) can display the second information 3313 of application B.

In one embodiment, the processor 550 may include sensor circuitry (e.g., sensor circuit 540 of Figure 5), such as an inertial sensor (e.g., inertial sensor 541 of Figure 5) and/or a grip sensor (e.g., Sensor information can be obtained through the grip sensor 543 in FIG. 5. It is not limited to this, and the processor 550 may further obtain sensor information through a touch sensor (e.g., a touch sensor of the second display (e.g., the touch sensor of the second display 533 in FIG. 5). Processor 550) Based on sensor information acquired through the sensor circuit 540 and/or the touch sensor of the second display 533, the grip state and the second side 212 or the fourth side 222 of the electronic device 501 The processor 550 may check the grip state of the electronic device 501, the type of detected user interaction, and/or location information where the user interaction was detected.

In one embodiment, the processor 550 may detect user interaction 3425 in a partial area of the second side 212 of the electronic device 501, as shown by reference numeral <3420>.

In one embodiment, the processor 550 displays first information 3311 of application A displayed on the second display 533 and /Or, the display properties of the second information 3313 of application B can be changed.

34A and 34B according to various embodiments, the type of user interaction 3425 is a double tap, and based on the double tap being detected on the second side 212 of the first housing 210, the display location The explanation will be made assuming that the application displayed on the second display 533 corresponding to the position where the double tap was detected is changed (e.g., window changed) or terminated.

In one embodiment, based on detecting a double tap 3425 on the second side 212 of the first housing 210, the processor 550 generates a second display, as shown at 3460 . The second information 3313 of application B is displayed in the first area (e.g., upper area) of the second display 533 in FIG. 5, and the second information 3313 of application A is displayed in the second area (e.g., right area). First information 3311 can be displayed.

In one embodiment, based on the double tap 3425 being detected on the second side 212 of the first housing 210, the processor 550 generates a second tap corresponding to the location where the double tap 3425 was detected. Application A displayed on the display 533 may be terminated, and second information 3313 of application B may be displayed on the second display 533, as shown in reference number <3470>.

FIG. 35A is a plan view showing the front of the electronic device 3500 when the electronic device 3500 is unfolded, according to an embodiment of the present disclosure. FIG. 35B is a plan view illustrating the rear of the electronic device 3500 when the electronic device 3500 is unfolded, according to an embodiment of the present disclosure.

FIG. 36A is a perspective view showing the folding state of the electronic device 3500 according to an embodiment of the present disclosure. FIG. 36B is a perspective view illustrating an intermediate state of the electronic device 3500 according to an embodiment of the present disclosure.

The electronic device 3500 shown in FIGS. 35A to 36B is the electronic device 101 shown in FIG. 1, the electronic device 200 shown in FIGS. 2A to 4, or the electronic device 501 shown in FIG. 5. ), or may include different embodiments.

FIG. 35A is a plan view illustrating the front of the electronic device 3500 in an unfolded state according to various embodiments. FIG. 35B is a plan view illustrating the rear of the electronic device 3500 in an unfolded state, according to various embodiments.

FIG. 36A is a perspective view of an electronic device 3500 illustrating a folding state, according to various embodiments. FIG. 36B is a perspective view of an electronic device 3500 illustrating an intermediate state, according to various embodiments.

35A to 36B, the electronic devices 3500 are folded facing each other based on a hinge structure (e.g., the hinge structure 3540 in FIG. 35a) (e.g., the hinge plate 320 in FIG. 4). It may include a pair of housings 3510 and 3520 (e.g., a foldable housing) (e.g., the first housing 210 and the second housing 220 of FIG. 2A) that are rotatably coupled to each other. In some embodiments, the hinge structure (e.g., hinge structure 3540 in Figure 35A) (e.g., hinge structure 350 in Figure 4) may be arranged in the x-axis direction or may be arranged in the y-axis direction. In some embodiments, two or more hinge structures (e.g., hinge structure 3540 in Figure 35A) may be arranged to fold in the same direction or in different directions. According to one embodiment, the electronic device 3500 includes a flexible display 3530 (e.g., a foldable display) disposed in an area formed by a pair of housings 3510 and 3520 (e.g., the first display in FIG. 2A (e.g., the first display in FIG. 2A) 230) and the first display 531 of FIG. 5). According to one embodiment, the first housing 3510 and the second housing 3520 are disposed on both sides about the folding axis (axis B) and may have a shape that is substantially symmetrical with respect to the folding axis (axis B). there is. According to one embodiment, the first housing 3510 and the second housing 3520 are configured to determine whether the electronic device 3500 is in a flat state or unfolding state, a folding state, or an intermediate state. Depending on whether they are in an intermediate state, the angle or distance between them may vary.

According to various embodiments, the pair of housings 3510 and 3520 includes a first housing 3510 (e.g., a first housing structure) coupled to a hinge structure (e.g., hinge structure 3540 in FIG. 35A) and a hinge. It may include a second housing 3520 (e.g., a second housing structure) coupled to a structure (e.g., a hinge structure 3540 in FIG. 35A). According to one embodiment, the first housing 3510, in the unfolded state, has a first surface 3511 facing a first direction (e.g., front direction) (z-axis direction) and a first surface 3511 opposite the first surface 3511. It may include a second surface 3512 facing a second direction (eg, back direction) (-z-axis direction). According to one embodiment, in the unfolded state, the second housing 3520 has a third side 3521 facing the first direction (z-axis direction) and a fourth side 3522 facing the second direction (-z-axis direction). ) may include. According to one embodiment, the electronic device 3500 is, in an unfolded state, a first surface 3511 of the first housing 3510 and a third surface 3521 of the second housing 3520 that are substantially the same. It may be operated in such a way that it faces the direction (z-axis direction) and the first side 3511 and the third side 3521 face each other in the folded state. According to one embodiment, the electronic device 3500, in the unfolded state, has a second surface 3512 of the first housing 3510 and a fourth surface 3522 of the second housing 3520 that are substantially the same. direction (-z-axis direction), and in the folded state, the second side 3512 and the fourth side 3522 may be operated to face opposite directions. For example, in the folded state, the second side 3512 may face a first direction (z-axis direction), and the fourth side 3522 may face a second direction (-z-axis direction).

According to various embodiments, the first housing 3510 is coupled to the first side member 3513 and the first side member 3513, which at least partially forms the exterior of the electronic device 3500, and the electronic device 3500 ) may include a first rear cover 3514 forming at least a portion of the second side 3512 of the device. According to one embodiment, the first side member 3513 includes a first side 3513a, a second side 3513b extending from one end of the first side 3513a, and a second side extending from the other end of the first side 3513a. It may include a third side 3513c. According to one embodiment, the first side member 3513 may be formed into a rectangular (e.g., square or rectangular) shape through the first side 3513a, the second side 3513b, and the third side 3513c. there is.

According to various embodiments, the second housing 3520 is coupled to the second side member 3523 and the second side member 3523, which at least partially forms the exterior of the electronic device 3500, and the electronic device 3500 ) may include a second rear cover 3524 that forms at least a portion of the fourth side 3522. According to one embodiment, the second side member 3523 includes a fourth side 3523a, a fifth side 3523b extending from one end of the fourth side 3523a, and a fifth side 3523b extending from the other end of the fourth side 3523a. It may include a sixth side 3523c. According to one embodiment, the second side member 3523 may be formed into a rectangular shape through the fourth side 3523a, the fifth side 3523b, and the sixth side 3523c.

According to various embodiments, the pair of housings 3510 and 3520 is not limited to the shape and combination shown, and may be implemented by combining and/or combining other shapes or parts. For example, in some embodiments, the first side member 3513 may be formed integrally with the first back cover 3514, and the second side member 3523 may be formed integrally with the second back cover 3524. can be formed.

According to various embodiments, the flexible display 3530 is connected from the first side 3511 of the first housing 3510 across a hinge structure (e.g., the hinge structure 3540 in FIG. 35A) to the second housing 3520. It may be arranged to extend to at least a portion of the third side 3521. For example, the flexible display 3530 includes a first part 3530a substantially corresponding to the first surface 3511, a second part 3530b substantially corresponding to the third surface 3521, and a first part 3530a. ) and the second part 3530b, and may include a hinge structure (eg, the hinge structure 3540 of FIG. 35A) and a corresponding third part 3530c (eg, a bendable area). According to one embodiment, the electronic device 3500 may include a first protective cover 3515 (eg, a first protective frame or a first decorative member) coupled along an edge of the first housing 3510. According to one embodiment, the electronic device 3500 may include a second protective cover 3525 (eg, a second protective frame or a second decorative member) coupled along an edge of the second housing 3520. According to one embodiment, the first protective cover 3515 and/or the second protective cover 3525 may be formed of metal or polymer material. According to one embodiment, the first protective cover 3515 and/or the second protective cover 3525 may be used as a decoration member. According to one embodiment, the flexible display 3530 may be positioned so that the edge of the first portion 3530a is interposed between the first housing 3510 and the first protective cover 3515. According to one embodiment, the flexible display 3530 may be positioned so that the edge of the second portion 3530b is interposed between the second housing 3520 and the second protective cover 3525. According to one embodiment, the flexible display 330 has a flexible display corresponding to the protective cap 3535 through a protective cap 3535 disposed in an area corresponding to the hinge structure (e.g., the hinge structure 3540 in FIG. 35A). The edge of the display 3530 may be positioned to be protected. Accordingly, the edges of the flexible display 3530 can be substantially protected from the outside. According to one embodiment, the electronic device 3500 supports a hinge structure (e.g., the hinge structure 3540 in FIG. 35A), is exposed to the outside when the electronic device 3500 is in the folded state, and is exposed to the outside when the electronic device 3500 is in the unfolded state. , a hinge housing 3541 (e.g., disposed to be invisible from the outside by being introduced into the first space (e.g., the inner space of the first housing 3510) and the second space (e.g., the inner space of the second housing 3520) : Hinge cover) may be included. In some embodiments, the flexible display 3530 may extend from at least a portion of the second side 3512 to at least a portion of the fourth side 3522. In this case, the electronic device 3500 may be folded so that the flexible display 3530 can be exposed to the outside (out-folding method).

According to various embodiments, the electronic device 3500 may include a sub-display 3531 (eg, the second display 533 in FIG. 5) that is disposed separately from the flexible display 3530. According to one embodiment, the sub-display 3531 is disposed to be at least partially exposed to the second surface 3512 of the first housing 3510, thereby replacing the display function of the flexible display 3530 when in the folded state. , status information of the electronic device 3500 can be displayed. According to one embodiment, the sub-display 3531 may be arranged to be visible from the outside through at least a partial area of the first rear cover 3514. In some embodiments, the sub-display 3531 may be disposed on the fourth side 3522 of the second housing 3520. In this case, the sub-display 3531 may be arranged to be visible from the outside through at least a portion of the second rear cover 3524.

According to various embodiments, the electronic device 3500 includes an input device 3503 (e.g., a microphone), an audio output device 3501 and 3502, a sensor module 3504, a camera device 3505 and 3508, and a key input device. It may include at least one of 3506, or connector port 3507. In the illustrated embodiment, an input device 3503 (e.g., a microphone), an audio output device 3501, 3502, a sensor module 3504, a camera device 3505, 3508, a key input device 3506, or a connector port. 3507 refers to a hole or shape formed in the first housing 3510 or the second housing 3520, but is disposed inside the electronic device 3500 and operates through the hole or shape. : can be defined to include an input device, audio output device, sensor module, or camera device).

Input device 3503 (e.g., microphone), audio output device 3501, 3502, sensor module 3504, camera device 3505, 3508, flash 3509, key input device 3506 according to various embodiments. ), or the connector port 3507 is an input device 215, an audio output device 227, 228, a sensor module 217a, 217b, 226, and a camera of the electronic device 200 of FIGS. 2A and 2B described above. Since it is the same as the modules 216a, 216b, 225, flash 218, key input device 219, or connector port 229, description thereof will be omitted.

Referring to FIG. 36B, the electronic device 3500 may be operated to maintain an intermediate state through a hinge structure (eg, the hinge structure 3540 of FIG. 35A). In this case, the electronic device 3500 may control the flexible display 3530 to display different content on the display area corresponding to the first side 3511 and the display area corresponding to the third side 3521. . According to one embodiment, the electronic device 3500 holds the first housing 3510 and the second housing ( 3520), it may be operated in a substantially unfolded state (e.g., the unfolded state in FIG. 35A) and/or in a substantially folded state (e.g., the folded state in FIG. 36A). For example, when the electronic device 3500 is unfolded at a certain inflection angle and a pressing force is provided in the unfolding direction (direction D) through a hinge structure (e.g., the hinge structure 3540 in FIG. 35A), It may be operated to transition to an unfolded state (e.g., the unfolded state of FIG. 35A). For example, when the electronic device 3500 is unfolded at a certain inflection angle and a pressing force is provided in the direction in which it is to be folded (C direction) through a hinge structure (e.g., the hinge structure 3540 in FIG. 35A) , may be operated to transition to a closed state (e.g., a folded state in FIG. 36A). In one embodiment, the electronic device 3500 may be operated to maintain the unfolded state (not shown) at various angles through a hinge structure (e.g., the hinge structure 3540 of FIG. 35A).

FIG. 37 is a diagram 3700 for explaining a method of correcting sensor data of user interaction according to an embodiment of the present disclosure.

Referring to FIG. 37, when the electronic device (e.g., the electronic device 3500 of FIG. 35A) is in an unfolded state (e.g., the state of FIGS. 35A and 35B), the sensor circuit (e.g., the sensor circuit 540 of FIG. 5) Sensor information can be obtained through . For example, the sensor circuit 540 may include an inertial sensor (e.g., inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g., grip sensor 543 in FIG. 5).

In one embodiment, the processor 550 determines the grip state of the electronic device 3500 and/or the rear (e.g., second side) of the electronic device 3500 based on sensor information acquired through the sensor circuit 540. User interaction can be detected in 3512) or the fourth side 3522). The processor 550 may check the type of user interaction detected and/or location information where the user interaction was detected.

In one embodiment, the inertial sensor 541 may be disposed in the interior space of the first housing 3510 of the electronic device 3500. A processor (e.g., processor 550 of FIG. 5 ) may obtain information related to the posture of the electronic device 3500 and/or sensor information related to the movement of the electronic device 3500 through the inertial sensor 541 .

In one embodiment, the grip sensor 543 may be disposed on at least a portion of the side of the electronic device 3500. For example, the grip sensor 543 is a first grip sensor disposed in a partial area of the third side 3513c of the first housing 3510 and a partial area of the sixth side 3523c of the second housing 3520. It may include (3711) and a second grip sensor (3751) disposed in a partial area of the fourth surface (3522) of the second housing (3520).

In one embodiment, the processor 550 operates the electronic device 3500 based on sensor information acquired through the inertial sensor 541, the first grip sensor 3711, and/or the second grip sensor 3751. The grip state, the type of detected user interaction, and/or the location information where the user interaction was detected may be estimated (or predicted), and sensor data of the detected user interaction may be corrected.

FIG. 38 is a diagram 3800 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 38, as shown by reference numeral <3810>, an electronic device (e.g., the electronic device 3500 in FIG. 35A) displays a first display (e.g., the state in FIG. 36B) in an intermediate state (e.g., the state in FIG. 36b). The screen of the camera application may be displayed on the first display 3530 of FIG. 35A.

In one embodiment, a processor (e.g., processor 550 of FIG. 5) displays a camera (e.g., FIGS. 35A and 35B) in a first area (e.g., upper area) of the first display 3530 of the electronic device 3500. A screen 3820 that displays a preview image 3815 acquired through the camera devices 3505 and 3508) and includes at least one item for controlling the camera function in a second area (e.g., lower area). It can be displayed.

In one embodiment, the processor 550 may include sensor circuitry (e.g., sensor circuit 540 of Figure 5), such as an inertial sensor (e.g., inertial sensor 541 of Figure 5) and/or a grip sensor (e.g., Sensor information can be obtained through the grip sensor 543 in FIG. 5. Based on the sensor information acquired through the sensor circuit 540, the processor 550 controls the posture of the electronic device 3500, the movement of the electronic device 3500, the grip state of the electronic device 3500, and the second surface 3512. ) or user interaction can be detected on the fourth side 3522. The processor 550 corrects sensor data of user interaction detected based on the posture of the electronic device 3500, the movement of the electronic device 3500, and/or the grip state of the electronic device 3500, and corrects the sensor data. Based on these, the type of user interaction detected and/or location information where the user interaction was detected can be confirmed.

In one embodiment, the processor 550 may detect user interaction 3835 in a partial area of the second side 3512 of the electronic device 3500, as shown by reference numeral <3830>.

In one embodiment, the processor 550 may change the display properties of the camera application screen displayed on the first display 3530 based on the type of user interaction 3835 and the location information where the user interaction 3835 was detected. .

38 according to various embodiments, it is assumed that the type of user interaction 3835 is a double tap, and based on the double tap being detected on the second side 3512 of the first housing 3510, the display area ( (Example: Windows) will be explained assuming that the window is being changed.

In one embodiment, based on detecting a double tap 3835 on the second side 3512 of the first housing 3510, the processor 550 displays the first display, as shown at 3850 . A screen 3820 including at least one item for controlling a camera function is displayed in a first area (e.g., upper area) of 3530, and a camera (e.g., A preview image 3815 acquired through the camera devices 3505 and 3508 of FIGS. 35A and 35B may be displayed.

FIG. 39 is a diagram 3900 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 39, as shown by reference number <3910>, when the electronic device (e.g., the electronic device 3500 in FIG. 35A) is in an unfolded state (e.g., the state in FIGS. 35A and 35B), the first display The first information 3815 of application A is displayed in the first area (e.g., upper area) of the first display 3530 in FIG. 35A, and the first information 3815 of application B is displayed in the second area (e.g., lower area). Second information 3820 can be displayed.

In one embodiment, the processor 550 may include sensor circuitry (e.g., sensor circuit 540 of Figure 5), such as an inertial sensor (e.g., inertial sensor 541 of Figure 5) and/or a grip sensor (e.g., Sensor information can be obtained through the grip sensor 543 in FIG. 5. Based on the sensor information acquired through the sensor circuit 540, the processor 550 controls the posture of the electronic device 3500, the movement of the electronic device 3500, the grip state of the electronic device 3500, and the second side (e.g. : User interaction can be detected on the second side 3512 in FIG. 35B) or the fourth side (e.g., the fourth side 3522 in FIG. 35B). The processor 550 corrects sensor data of user interaction detected based on the posture of the electronic device 3500, the movement of the electronic device 3500, and/or the grip state of the electronic device 3500, and corrects the sensor data. Based on these, the type of user interaction detected and/or location information where the user interaction was detected can be confirmed.

In one embodiment, the processor 550 may detect user interaction 3925 in a partial area of the second side 3512 of the electronic device 3500, as shown by reference numeral <3920>.

In one embodiment, the processor 550 may change the display properties of the application displayed on the first display 3530 based on the type of user interaction 3925 and location information where the user interaction 3925 was detected.

39 according to various embodiments, the type of user interaction 3925 is a double tap or triple tap, and based on the double tap or triple tap being detected on the second side 3512 of the first housing 3510 , This will be explained assuming that the size of the area where application information is displayed is adjusted.

In one embodiment, based on the double tap 3925 being detected on the second side 3512 of the first housing 3510, the processor 550, as shown by reference numeral <3930>, The size of the first area (e.g., upper area) displaying the first information 3815 is adjusted to a second size smaller than the first size, and the second area (e.g., upper area) displaying the second information 3820 of application B is adjusted to a second size smaller than the first size. : lower area) can be adjusted to a third size larger than the first size (3835).

In one embodiment, based on detection of a triple tap 3945 on the second side 3512 of the first housing 3510, as shown at <3940>, the processor 550 operates at <3940>. 3950>, the size of the first area (e.g., upper area) displaying the first information 3815 of application A is adjusted to a first size larger than the second size, and the second information 3815 of application B is adjusted to a first size larger than the second size. The size of the second area (e.g., lower area) displaying 3820 may be adjusted to a first size smaller than the third size (3855).

2A to 39 according to various embodiments, the electronic devices are described as foldable electronic devices 200 and 3500, but the electronic devices are not limited thereto. For example, the electronic device may include a slideable electronic device. In this regard, various embodiments will be described in FIGS. 40A and 40B described later.

FIGS. 40A and 40B are diagrams 4000 and 4050 for explaining a method of controlling a screen according to user interaction, according to an embodiment of the present disclosure.

The electronic devices shown in FIGS. 40A and 40B according to various embodiments may be slideable electronic devices.

The electronic device 4001 shown in FIGS. 40A to 40B includes the electronic device 101 shown in FIG. 1, the electronic device 200 shown in FIGS. 2A to 4, and the electronic device 501 shown in FIG. 5. , or may be at least partially similar to the electronic device 3500 shown in FIGS. 35A to 36B, or may include a different embodiment.

Referring to FIGS. 40A and 40B, the electronic device 4001 includes a first housing 4003 (e.g., a first housing structure, a moving part, or a slide housing), and a direction (e.g., ± a second housing 4005 (e.g., a second housing structure, a fixing part, or a base housing) slidably coupled in the y-axis direction, and at least a portion of the first housing 4003 and the second housing 4005. It may include a flexible display 4007 (eg, expandable display or stretchable display) arranged to be supported through the display. According to one embodiment, the electronic device 4001 has the first housing 4003 pulled out in a first direction (e.g., y-axis direction) or (slide- out), and may be configured to slide in in a second direction (e.g., -y-axis direction), which is opposite to the first direction (e.g., y-axis direction).

In one embodiment, the electronic device 4001 may be in a slide-in state, as shown by reference numeral <4010>. For example, the retracted state may mean a state in which the first housing 4003 is retracted into the internal space of the second housing 4005.

In one embodiment, with the electronic device 4001 inserted, the processor (e.g., the processor 550 of FIG. 5) uses a sensor circuit (e.g., the sensor circuit 540 of FIG. 5), for example, an inertial sensor ( Sensor information may be obtained through an inertial sensor 541 in FIG. 5) and/or a grip sensor (e.g. grip sensor 543 in FIG. 5). The processor 550 may detect the grip state and user interaction 4011 on the back 4009 of the electronic device 4001 based on sensor information acquired through the sensor circuit 540. The processor 550 determines the posture of the electronic device 4001, the movement of the electronic device 4001, the grip state of the electronic device 4001, the type of user interaction 4011 detected, and/or the user interaction 4011 is detected. You can check the location information.

In one embodiment, the processor 550 may change the state of the electronic device 4001 based on the type of user interaction 4011 and location information where the user interaction 4011 was detected.

40A and 40B according to various embodiments, the type of user interaction 4011 is a double tap or triple tap, and based on the double tap or triple tap being detected on the back 4009 of the electronic device 4001 , the description will be made assuming that the state of the electronic device 4001 is changed from the slide-out state to the slide-out state, or from the slide-out state to the slide-out state. However, it is not limited to this, and functions that can be performed depending on the type of user interaction may include an application termination function, an application relaunch function, a screen rotation function, a full screen display function, an application change function, or a pop-up window display function. there is.

In one embodiment, based on a double tap 4011 being detected on the back 4009 of the electronic device 4001, the processor 550 may change the electronic device 4001 to the drawing state. For example, based on a double tap 4011 being detected on the rear 4009 of the electronic device 4001, the processor 550 moves from the second housing 4005 along a specified direction (e.g., y-axis direction). The first housing 4003 can be moved 4013 in a sliding manner. Accordingly, as shown by reference number <4020>, the display area of the flexible display 4007 may be varied (eg, expanded).

In one embodiment, the processor 550 operates the electronic device 4001 based on detection of a double tap 4021 on the rear 4009 of the electronic device 4001, as shown by reference numeral <4020>. You can change it to withdrawal status. For example, based on a double tap 4021 being detected on the rear 4009 of the electronic device 4001, the processor 550 moves from the second housing 4005 along a specified direction (e.g., y-axis direction). The first housing 4003 can be moved 4023 in a sliding manner. Accordingly, as shown in reference numeral <4030>, the display area of the flexible display 4007 may be varied (eg, expanded).

In one embodiment, the processor 550, as shown by reference numeral <4040>, based on detecting a triple tap 4041 on the rear 4009 of the electronic device 4001, the processor 550 detects the electronic device 4001. Device 4001 can be changed to the lead-in state. For example, based on the triple tap 4041 being detected on the rear 4009 of the electronic device 4001, the processor 550 moves the second housing 4005 in a specified direction (e.g., -y-axis direction). Accordingly, the first housing 4003 can be moved 4043 in a sliding manner. Accordingly, as shown by reference number <4050>, the display area of the flexible display 4007 may be varied (eg, reduced).

In one embodiment, the processor 550 operates the electronic device 4001 based on detection of a triple tap 4051 on the rear 4009 of the electronic device 4001, as shown by reference numeral <4050>. It can be changed to the lead-in state. For example, based on the triple tap 4051 being detected on the rear 4009 of the electronic device 4001, the processor 550 moves in a specified direction (e.g., -y-axis direction) from the second housing 4005. Accordingly, the first housing 4003 can be moved 4053 in a sliding manner. Accordingly, as shown in reference numeral <4060>, the display area of the flexible display 4007 may be varied (eg, reduced).

FIG. 41 is a diagram 4100 for explaining various form factors of the electronic device 501 according to an embodiment of the present disclosure.

FIG. 41 according to various embodiments is a diagram illustrating examples of various form factors of an electronic device (eg, the electronic device 501 of FIG. 5) having various display types.

In one embodiment, the electronic device 501 may include various form factors, such as foldable (4105 to 4155).

In one embodiment, as shown in FIG. 41, the electronic device 501 may be implemented in various forms, and depending on the implementation form of the electronic device 501, a display (e.g., display 530 of FIG. 5) may be implemented in various forms. It can be provided in a variety of ways.

In one embodiment, the electronic device 501 (e.g., foldable electronic devices 4105 to 4155) has two different areas of the display (e.g., display 530 of FIG. 5) substantially facing each other or in opposite directions. It may refer to an electronic device that can be folded in a direction facing (opposite to). Generally, in a portable state, the display of the electronic device 501 (e.g., the foldable electronic device 4105 to 4155 (e.g., the display 530 in FIG. 5) has two different areas facing each other or in opposing directions. It is folded, and in actual use, the user can unfold the display so that the two different areas practically form a flat panel.

In one embodiment, the electronic device 501 (e.g., foldable devices 4105 to 4155) includes two display surfaces (e.g., a first display surface and a second display surface) based on one folding axis. A form factor (e.g., 4115) and/or a form factor that includes at least three display faces (e.g., a first display face, a second display face, and a third display face) based on at least two folding axes (e.g., 4105) , 4110, 4120, 4125, 4130, 4135, 4140, 4145, 4150, 4155).

The various embodiments are not limited to this, and the number of folding axes that the electronic device 501 can have is not limited. According to one embodiment, the electronic device 501 displays (e.g., the display 530 of FIG. 5) depending on the implementation type in various ways (e.g., in-folding, out-folding). ), or in/out folding).

FIG. 42 is a diagram 4200 for explaining a method of setting a function according to user interaction, according to an embodiment of the present disclosure.

Referring to FIG. 42, the processor (e.g., processor 550 of FIG. 5) detects an input for setting a function according to user interaction while the electronic device (e.g., electronic device 501 of FIG. 5) is in an unfolded state. can do. For example, the input for setting a function according to user interaction includes an input for selecting an item that can set a function according to user interaction and/or a designated input (e.g., to set a function according to a specified gesture or user interaction) It may include a mapped specified input module (e.g., input detected from the input module 150 of FIG. 1).

In one embodiment, based on detecting an input for setting a function according to user interaction, the processor 550 displays the first display (e.g., the first display in FIG. 5 ), as shown by reference numeral <4210>. A first screen (or first user interface) for setting functions according to user interaction may be displayed at (531)). The first screen may include a first item 4211 that can set a function according to a double tap and a second item 4213 that can set a function according to a triple tap. However, it is not limited to this. For example, the processor 550 may display additional items that can set functions according to user interactions other than double tap or triple tap.

In one embodiment, the processor 550 may detect an input for selecting the first item 4211 or the second item 4213 on the first screen. Based on detecting an input that selects either the first item 4211 or the second item 4213, the processor 550 includes a list of functions that can be set, as shown by reference numeral <4250>. A second screen (or second user interface) may be displayed. For example, the list of functions includes menu with no function set (4251), window closing function (4252), window restoration function (4253), full screen display function (4254), flashlight on function (4255), and auto rotation. It may include a turn on function 4256, a turn on all mutes function 4257, a window rotation function 4258, and/or an app launch function 4259. However, it is not limited to this.

The electronic device 501 according to various embodiments includes direct user input (e.g., touch input) using the first display 531 or the second display 533, as well as user interaction detected from the rear of the electronic device 501. Based on this, it is possible to provide convenient usability to the user by changing and displaying the display properties of the information of the application displayed on the display.

A screen control method according to user interaction of the electronic device 501 according to an embodiment of the present disclosure may include displaying first information of the first application on the first display 531. In one embodiment, the screen control method according to user interaction includes displaying the second information of the second application and the first information of the first application in a multi-window in response to an input for executing a second application. It may include actions displayed in . In one embodiment, a screen control method based on user interaction may include acquiring sensor information through the sensor circuit 540. In one embodiment, a screen control method according to user interaction is performed on the second side 212 or the fourth side 222 of the electronic device 501 based on sensor information acquired through the sensor circuit 540. If it is confirmed that user interaction is detected, the operation may include checking the type of user interaction and the location information where the user interaction was detected. In one embodiment, a screen control method according to user interaction includes displaying at least one of first information of a first application and second information of a second application, based on the type of user interaction and location information where the user interaction was detected. Can include actions that change properties. In one embodiment, a screen control method according to user interaction may include displaying at least one of first information and second information on the first display 531 based on changed display properties.

In one embodiment, the operation of confirming the type of user interaction and the location information where the user interaction was detected may include correcting sensor data of the detected user interaction based on the obtained sensor information. In one embodiment, the operation of confirming the type of user interaction and the location information where the user interaction was detected includes confirming the type of user interaction and the location information where the user interaction was detected based on the corrected sensor data. can do.

In one embodiment, the operation of changing the display attribute of at least one of the first information of the first application and the second information of the second application is based on the type of user interaction and location information at which the user interaction was detected, An operation of changing display properties including at least one of the size and arrangement of windows in the display area of the first display 531 for displaying at least one of the first information of the application and the second information of the second application. It can be included.

In one embodiment, the sensor circuit 540 may include at least one of an inertial sensor 541 and a grip sensor 543.

In one embodiment, the sensor information acquired through the sensor circuit 540 includes first sensor information obtained through the inertial sensor 541, second sensor information obtained through the grip sensor 543, and fourth surface It may include at least one of third sensor information acquired through a touch circuit of the second display 533 that is disposed to be at least partially visible from the outside through 222 .

In one embodiment, the first sensor information may include at least one of sensor information related to the posture of the electronic device 501 and sensor information related to the movement of the electronic device 501.

In one embodiment, the second sensor information may include at least one of the grip state and grip pattern of the electronic device 501.

In one embodiment, the third sensor information may include touch information acquired through the touch circuit of the second display 533.

In one embodiment, the operation of correcting the sensor data of the detected user interaction includes correcting the sensor data of the detected user interaction based on at least one of first sensor information, second sensor information, and third sensor information. Can include actions.

In one embodiment, the operation of confirming the type of user interaction and the location information where the user interaction was detected includes sensor information acquired through the sensor circuit 540 and the type of user interaction and user interaction confirmed based on the sensor information. An operation of accumulating and storing the detected location information in the memory 520 may be included. In one embodiment, the operation of checking the type of user interaction and the location information where the user interaction is detected includes learning the stored sensor information and the location information where the user interaction is detected based on the stored sensor information using an artificial intelligence method. Can include actions. In one embodiment, the operation of checking the type of user interaction and the location information where the user interaction was detected includes checking the type of user interaction and the location information where the user interaction was detected based on the model generated by learning. It can be included.

In one embodiment, the operation of confirming the type of user interaction and the location information where the user interaction was detected includes transmitting sensor information obtained through the sensor circuit 540 to a server through the wireless communication circuit 510. can do. In one embodiment, the operation of checking the type of user interaction and the location information where the user interaction was detected is performed by receiving a learning model learned through machine learning learning by artificial intelligence from a server and detecting the type of user interaction and the location information where the user interaction was detected. It may include an operation to check location information.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

210: first housing 220: second housing
320: Hinge module 501: Electronic device
510: wireless communication circuit 520: memory
530: display 531: first display
533: second display 540: sensor circuit
541: Inertial sensor 543: Grip sensor
550: processor

Claims (20)

In the electronic device 501,
surrounding a first face 211, a second face 212 facing in the opposite direction to the first face 211, and a first space between the first face 211 and the second face 212. A first housing 210 including a first side member 213;
A third surface 221 that is foldably connected to the first housing 210 using a hinge structure 320 and faces the same direction as the first surface 211 in the unfolded state, a fourth side 222 facing in the opposite direction to the third side 221, and a second side member 223 surrounding a second space between the third side 221 and the fourth side 222. A second housing 220 including;
a first display 531 disposed from at least a portion of the first side 211 to at least a portion of the third side 221;
sensor circuit 540; and
Comprising a processor 550 operatively connected to the first display 531 and the sensor circuit 540,
The processor 550,
Displaying first information of a first application on the first display 531,
In response to an input for executing a second application, displaying second information of the second application and first information of the first application in a multi-window on the first display 531,
Obtaining sensor information through the sensor circuit 540,
Based on the obtained sensor information, if it is confirmed that user interaction is detected on the second side 212 or the fourth side 222, information on the type of user interaction and the location where the user interaction was detected is provided. Check,
Based on the type of user interaction and the location information where the user interaction was detected, changing the display attribute of at least one of the first information of the first application and the second information of the second application, and
An electronic device configured to display at least one of the first information and the second information on the first display 531 based on the changed display properties. According to claim 1,
The processor 550,
Based on the obtained sensor information, correct the sensor data of the detected user interaction, and
An electronic device configured to confirm the type of user interaction and location information where the user interaction was detected, based on the corrected sensor data. The method of claim 1 or 2,
The processor 550,
The first display 531 for displaying at least one of first information of the first application and second information of the second application based on the type of user interaction and the location information at which the user interaction was detected. An electronic device configured to change the display properties including at least one of a size of a window in a display area and an arrangement of the window. The method according to any one of claims 1 to 3,
It further includes a second display 533 arranged to be at least partially visible from the outside through the fourth surface 222 in the inner space of the second housing 220,
The sensor circuit 540 is an electronic device including at least one of an inertial sensor 541 and a grip sensor 543. According to claim 4,
The sensor information includes first sensor information obtained through the inertial sensor 541, second sensor information obtained through the grip sensor 543, and a touch circuit of the second display 533. An electronic device including at least one of third sensor information. According to claim 5,
The first sensor information includes at least one of sensor information related to the posture of the electronic device 501 and sensor information related to the movement of the electronic device 501, and
The second sensor information includes at least one of a grip state and a grip pattern of the electronic device 501. The method of claim 5 or 6,
The third sensor information includes touch information obtained through a touch circuit of the second display 533. According to any one of claims 5 to 7,
The processor 550,
An electronic device configured to correct sensor data of the detected user interaction based on at least one of the first sensor information, the second sensor information, and the third sensor information. According to claim 1,
Further comprising a memory 520,
The processor 550,
Accumulating and storing sensor information acquired through the sensor circuit 540, the type of user interaction confirmed based on the sensor information, and location information where the user interaction is detected in the memory 520,
Learning the stored sensor information and the type of user interaction based on the sensor information and the location information where the user interaction is detected using artificial intelligence, and
An electronic device configured to confirm the type of user interaction and location information where the user interaction was detected, based on the model generated through the learning. According to claim 1,
Further comprising a wireless communication circuit 510,
The processor 550,
Transmitting sensor information obtained through the sensor circuit 540 to a server through the wireless communication circuit 510, and
An electronic device configured to receive a learning model learned through machine learning by artificial intelligence from the server and confirm the type of user interaction and location information where the user interaction is detected. In the screen control method according to user interaction of the electronic device 501,
An operation of displaying first information of a first application on the first display 531;
In response to an input for executing a second application, displaying second information of the second application and first information of the first application in a multi-window on the first display 531;
Obtaining sensor information through the sensor circuit 540;
Based on the acquired sensor information, if it is confirmed that user interaction is detected on the second side 212 or the fourth side 222 of the electronic device 501, the type of user interaction and the user interaction are determined. An operation to check detected location information;
changing a display attribute of at least one of first information of the first application and second information of the second application based on the type of the user interaction and the location information at which the user interaction was detected; and
A method comprising displaying at least one of the first information and the second information on the first display 531 based on the changed display properties. According to claim 11,
The operation of confirming the type of user interaction and the location information where the user interaction was detected,
An operation of correcting sensor data of the detected user interaction based on the acquired sensor information; and
Based on the corrected sensor data, the method includes confirming the type of user interaction and location information where the user interaction was detected. The method of claim 11 or 12,
The operation of changing the at least one display property includes:
The first display 531 for displaying at least one of first information of the first application and second information of the second application based on the type of user interaction and the location information at which the user interaction was detected. A method comprising changing the display properties including at least one of a size of a window in a display area and an arrangement of the window. The method according to any one of claims 11 to 13,
The sensor circuit 540 includes at least one of an inertial sensor 541 and a grip sensor 543. According to claim 14,
The sensor information includes first sensor information acquired through the inertial sensor 541, second sensor information acquired through the grip sensor 543, and at least partially from the outside through the fourth surface 222. A method including at least one of third sensor information acquired through a touch circuit of a second display 533 that is arranged to be visible. According to claim 15,
The first sensor information includes at least one of sensor information related to the posture of the electronic device 501 and sensor information related to the movement of the electronic device 501, and
The second sensor information includes at least one of a grip state and a grip pattern of the electronic device 501. The method of claim 15 or 16,
The third sensor information includes touch information obtained through a touch circuit of the second display (533). The method according to any one of claims 15 to 17,
The operation of correcting the sensor data of the detected user interaction is,
A method comprising correcting sensor data of the detected user interaction based on at least one of the first sensor information, the second sensor information, and the third sensor information. According to claim 11,
The operation of confirming the type of user interaction and the location information where the user interaction was detected,
Accumulating and storing sensor information acquired through the sensor circuit 540, the type of user interaction confirmed based on the sensor information, and location information where the user interaction is detected in the memory 520;
An operation of learning the stored sensor information, a type of user interaction based on the sensor information, and location information where user interaction is detected using an artificial intelligence method; and
A method comprising confirming the type of user interaction and location information where the user interaction was detected, based on the model generated by the learning. According to claim 11,
The operation of confirming the type of user interaction and the location information where the user interaction was detected,
An operation of transmitting sensor information obtained through the sensor circuit 540 to a server through a wireless communication circuit 510; and
A method comprising receiving a learning model learned through machine learning by artificial intelligence from the server and confirming the type of user interaction and location information where the user interaction is detected.

Images