KR20230059111A - Electronic device and method for detecting attachment of external accseeory for displaying user interface in electronic device - Google Patents

Abstract

An electronic device according to various embodiments includes a first housing, a second housing, a hinge that foldably connects one side of the first housing to one side of the second housing, a first display area disposed in the first housing, and A display including a second display area disposed on the second housing, and a processor, wherein the processor attaches an external accessory for displaying a user interface on the second display area in a state in which the hinge is folded is detected, a user interface corresponding to the type of the external accessory may be displayed on an area of the second display area to which the external accessory is attached.

Description

Electronic device and method for detecting attachment of external accessory for displaying user interface in electronic device

Various embodiments relate to a method of detecting attachment of an external accessory for displaying a user interface in an electronic device.

Various services and additional functions provided through electronic devices, for example, portable electronic devices such as smart phones, are gradually increasing. In order to increase the utility value of these electronic devices and satisfy the needs of various users, communication service providers or electronic device manufacturers are competitively developing electronic devices to provide various functions and to differentiate themselves from other companies. Accordingly, various functions provided through electronic devices are becoming increasingly sophisticated.

In addition, considering the portability of the electronic device, the display (or the electronic device equipped with the display) may be mounted on the electronic device in a foldable or bendable or rollable form.

In an electronic device including a foldable or bendable display, an input function may be performed using an on-screen keyboard provided through a certain area of the display.

In an electronic device including a foldable or bendable display, most of the front surface of the electronic device includes the display, making it difficult to accommodate a keyboard capable of physical typing.

Although an input function can be performed using an on-screen keyboard provided in a certain area of the display of the electronic device, usability may be lower than that of a physical keyboard.

According to various embodiments, a method of detecting attachment of an external accessory for displaying a user interface in an electronic device is provided.

An electronic device according to various embodiments includes a first housing, a second housing, a hinge that foldably connects one side of the first housing to one side of the second housing, a first display area disposed in the first housing, and A display including a second display area disposed on the second housing, and a processor, wherein the processor attaches an external accessory for displaying a user interface on the second display area in a state in which the hinge is folded is detected, a user interface corresponding to the type of the external accessory may be displayed on an area of the second display area to which the external accessory is attached.

According to various embodiments, a method for detecting attachment of an external accessory for displaying a user interface in an electronic device may include connecting one side of a first housing of the electronic device to one side of a second housing of the electronic device in a foldable manner. An operation of detecting attachment of an external accessory for displaying a user interface in a second display area disposed on the second housing in a state in which the hinge is folded, and the external accessory is attached to the area of the second display area An operation of displaying a user interface corresponding to the type of external accessory may be included.

According to various embodiments, according to the type of an external accessory for displaying a user interface attached to an electronic device including a foldable or bendable display, a user interface corresponding to the type of the external accessory is displayed on the electronic device. There are effects that can be provided through the display of

According to various embodiments, in an electronic device including a foldable or bendable display, a user interface displayed through the display is input according to an input of an attached external accessory, so that the same effect as that of a physical keyboard input is obtained. can provide

As the external accessory is input for user interface input, the same feeling as input of a physical keyboard may be provided.

According to various embodiments, at least one screen area in which at least one function is set is provided according to a location of an external accessory for displaying a user interface attached to an electronic device including a foldable or bendable display. can

1 is a block diagram of an electronic device in a network environment according to various embodiments.
2A to 2C are diagrams for explaining provision of a user interface using an external accessory in an electronic device according to various embodiments.
3A to 3C are views for explaining external accessories attached to a display in an electronic device according to various embodiments.
4A to 4D are views for explaining a state of a display based on a location of an external accessory attached to the display in an electronic device according to various embodiments of the present disclosure.
5 is a block diagram of an electronic device according to various embodiments.
6A is a diagram for describing an external accessory to be attached to a display of an electronic device according to various embodiments.
6B is a cross-sectional view taken along A-A′ in FIG. 6A according to various embodiments.
7A to 7C are diagrams for explaining an operation of detecting attachment of an external accessory to a display of an electronic device according to various embodiments.
8A to 8D are diagrams for explaining an operation of detecting a location of an external accessory attached to a display of an electronic device according to various embodiments of the present disclosure;
9 is a diagram for explaining an operation of detecting a location of an external accessory attached to a display of an electronic device according to various embodiments of the present disclosure.
10 is a diagram for explaining a function provided to a screen area when an external accessory is positioned on a display of an electronic device in a first state according to various embodiments.
11A to 11D are diagrams for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a second state according to various embodiments.
12A and 12B are diagrams for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a third state according to various embodiments.
13A to 13J are diagrams for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a fourth state according to various embodiments.
14 is a diagram for explaining types of external accessories on a display of an electronic device according to various embodiments.
15 is a diagram for explaining an operation of an external accessory on a display of an electronic device according to various embodiments.
16 is a diagram for explaining an operation of an external accessory on a display of an electronic device according to various embodiments.
17 is a diagram for explaining an operation of an external accessory on a display of an electronic device according to various embodiments.
18 is a flowchart illustrating an operation of detecting attachment of an external accessory in an electronic device according to various embodiments of the present disclosure.
19A and 19B are diagrams for explaining an operation of providing a screen area according to a location of an external accessory attached to a display in an electronic device according to various embodiments of the present disclosure.

1 is a block diagram 100 of an electronic device 101 within a network environment 100, in accordance with various embodiments. Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to one embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 may use less power than the main processor 121 or be set to be specialized for a designated function. can The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN). These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2A to 2C are diagrams 200a to 200c for explaining the provision of a user interface using an external accessory in an electronic device according to various embodiments.

The display 260 of the electronic device 201 shown in FIGS. 2A to 2C is a flexible display in which an area of the display is divided according to folding of a hinge 281 capable of connecting two housings on which the display is placed. (flexible display) may be included. In the flexible display, when the electronic device includes an in-foldable hinge capable of connecting two housings, the display in an unfolded state is folded inward according to the folding of the in-foldable hinge, so that the display Areas can be divided. In the case of the flexible display, when the electronic device includes an out-foldable hinge capable of connecting two housings, the display in an unfolded state is folded outward according to the folding of the out-foldable hinge. Areas of the display may be divided. The electronic device may include one hinge (eg, a hinge capable of in-folding or a hinge capable of unfolding) or a plurality of hinges (eg, a hinge capable of in-folding and a hinge capable of unfolding).

The unfolding refers to a fully unfolded state of the first housing 271 and the second housing 273, and the folding means that the first housing 271 and the second housing 273 are at a certain angle or a certain distance. can represent a folded state. The out-folding may indicate a state in which the display 260 is folded at a predetermined angle or a predetermined distance from the front of the completely unfolded display 260 outward. The in-folding may refer to a state in which the display 260 is folded at a certain angle or a certain distance inward from the front of the completely unfolded display 260. In FIGS. 2A to 2C, the in-folding Although the operation of the electronic device 201 including this possible hinge has been described as an example, the same can be applied to an electronic device including an out-foldable hinge.

According to FIG. 2A , the electronic device 201 according to various embodiments includes a sensor module (eg, at least one of an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, or a motion sensor) of the electronic device 201 A folded state of the hinge 281 of the electronic device 201 may be detected using sensor information received from a sensor of the electronic device 201 . When the electronic device 201 detects that the hinge 281 of the electronic device is folded, the first display disposed in the first housing 271 included in the display 260 of the electronic device 201 The area 261 and the second display area 263 disposed on the second housing 273 may be displayed separately.

According to FIG. 2B, the electronic device 201 according to various embodiments includes an external accessory (eg, a keyboard) for displaying a user interface on the second display area 263 of the display 260 of the electronic device 201. Attachment of the cover 310 can be detected. The electronic device 201 is based on a pattern of capacitance detected by at least one conductive object included in the external accessory (eg, the keyboard cover 310) attached to the second display area 263. , the attachment of the external accessory to the second display area 263 and the type of the external accessory may be detected. The electronic device 201 may include the external accessory (eg, a keyboard) attached to the second display area 263 contacting any one of the plurality of hall sensors disposed on the second display area 263. An attached position of the external accessory (eg, the keyboard cover 310) in the second display area 263 may be determined based on at least one magnet included in the cover 310 .

After the electronic device 201 according to various embodiments is placed on the floor in a completely folded state (folded state) in which the first housing 271 and the second housing 273 are in contact with each other, , When the first housing 271 and the second housing 273 are detected to be folded (folded state) at a predetermined angle or at a predetermined distance based on the sensor module, the display 260 is displayed in an upper area and a lower area. can be divided into regions. The electronic device 201 determines that the second housing 273 is in contact with the floor by using sensor information received from the sensor module (eg, at least one of a geomagnetic sensor, a gyro sensor, and a proximity sensor). , the upper area is set as the first display area 261, the lower area is set as the second display area 263, and the external accessory (eg, keyboard cover 310) is set in the second display area 263. ) can be determined. The electronic device 201 uses sensor information received from the sensor module (eg, a geomagnetic sensor, a gyro sensor, or a proximity sensor) to confirm that the first housing 271 is in contact with the floor, the upper area. is set as the second display area 263, the lower area is set as the first display area 261, and an external accessory (eg, keyboard cover 310) is attached in the first display area 261. can decide The electronic device 201,

Referring to FIG. 2C , the electronic device 201 according to various embodiments includes an external accessory (eg, a keyboard cover 310) for displaying a user interface on the second display area 263 of the display 260 of the electronic device. ))), an external accessory for displaying a user interface (eg, a keyboard cover 310) is attached to an area of the second display area 263 to which an external accessory (eg, the keyboard cover 310) is attached. : A user interface (eg, a keyboard) corresponding to the type of keyboard cover 310) may be displayed.

According to various embodiments, an external accessory (for example, the keyboard cover 310) for displaying a user interface is attached to the second display area 263 in a state in which the hinge of the electronic device is folded, and the second display 263 A function to display a user interface can be provided.

According to one embodiment, the external accessory may include various types according to usage. For example, the external accessory may include a keyboard cover for displaying a keyboard, a dial cover for displaying a dial, a calculator cover for displaying a calculator, and a game pad cover for displaying a game pad.

According to an embodiment, when the external accessory is attached to the second display area 263 of the electronic device 201, the electronic device 201 controls the attachment of the external accessory and the external accessory. ), at least one conductive material (e.g., metal (e.g., silver, copper, gold, aluminum, tungsten, zinc, brass , tin, lead, or stainless steel) or carbon allotropes (eg, graphite or graphene) may be disposed and included.

According to an embodiment, when the external accessory is attached to the second display area 263 of the electronic device 201, the electronic device 201 is displayed on the second display area 263. In order to determine the position of the attached external accessory, at least one magnet may be disposed and included in at least one predetermined area inside the external accessory.

According to one embodiment, the external accessory is made of a transparent material so that the user's interface (eg, keyboard) displayed on the second display area 263 can be seen, and for a touch of the user interface (eg, keyboard) It can be made of a thin, resilient material that can be restored after being pressed.

3A to 3C are diagrams 300a to 300c for describing external accessories attached to a display in an electronic device according to various embodiments.

3A illustrates a state in which a hinge (eg, the hinge 281 of FIG. 2A ) of the electronic device 201 according to various embodiments is folded (eg, the first housing 271 and the second housing 271). 2 In a state where the housing 273 is folded at a certain angle or at a certain distance), an external accessory (for example, the keyboard cover 310) for displaying a user interface is attached to the second display area 263 of the display 260. It is a perspective view showing the state.

3B shows an electronic device 201 according to various embodiments, in which an external accessory (eg, a keyboard cover 310) for displaying a user interface is attached to the second display area 263 of the electronic device 201. In the closed state, the hinge of the electronic device 201 (eg, the hinge 281 of FIG. 2A) is completely folded (eg, the first housing 271 and the second housing 273 are in contact). It is a perspective view.

3C shows an electronic device 201 according to various embodiments of the present disclosure, in which an external accessory (eg, a keyboard cover 310) for displaying a user interface is attached to the second display area 263 of the electronic device 201. This is a side view showing a state in which the hinge of the electronic device 201 is fully folded (eg, a state in which the first housing 271 and the second housing 273 are in contact with each other). The external accessory 310 is positioned in a space between the first housing 271 and the second housing 273 in a state in which the hinge of the electronic device 201 is completely folded.

4A to 4D are diagrams 400a to 400d for describing a state of a display based on a location of an external accessory attached to the display in an electronic device according to various embodiments of the present disclosure.

4A shows that in the electronic device 201 according to various embodiments, a hinge (eg, the hinge 281 of FIG. 2A ) of the electronic device 201 is folded so that the display 260 is connected to the first display 261. In a state where the second display 263 is divided, an external accessory (eg, the keyboard cover 310) for displaying the user interface is attached from the first position p1 corresponding to the upper side of the second display area 263. This is a diagram showing the first state. The electronic device 201, when an external accessory (eg, keyboard cover 310) is attached to the second display area 263 in the first state, the display area to which the external accessory 310 is attached ( 263), a keyboard for text input may be displayed, and typing may be possible using the keyboard.

The electronic device 201, in the first state, displays the remaining area of the second display area 263 except for the first area 410 to which the external accessory (eg, the keyboard cover 310) is attached. An area below the first area 410 may be determined as the first screen area 411 , and a set function may be provided to the first screen area 411 . The electronic device 201 is configured to provide a function set on the first screen area 411 located below the first area 410 to which the external accessory 312 is attached, for example, a touch pad function. touch

A pad area 411a may be displayed. The electronic device 201 adjusts the size of the touch pad area according to the size of the first screen area 411 located below the first area 410 to which the external accessory 312 is attached and displays the touch pad area. 4B shows that in the electronic device 201 according to various embodiments, the hinge of the electronic device 201 (eg, the hinge 281 of FIG. 2A ) is folded so that the display 260 is the first display. In a state where 261 and the first display 263 are divided, a second position p2 separated by a first distance d1 from the first position p1 corresponding to the upper side of the second display area 263 This is a view showing a second state in which an external accessory (for example, the keyboard cover 310) for displaying a user interface is attached. The electronic device 201, when an external accessory (eg, keyboard cover 310) is attached to the second display area 263 in the second state, the display area to which the external accessory 310 is attached ( 263), a keyboard for text input may be displayed, and typing may be possible using the keyboard.

The electronic device 201, in the second state, displays an area located above the first area 410 to which the external accessory (eg, keyboard cover 310) is attached in the second display area 263 and the second display area 263. Each of the areas located below the first area 410 is determined as a second screen area 413 and a third screen area 415, and the second screen area 413 and the third screen area 415 are respectively It can provide the functions set in . The electronic device 201 may display a function set on the second screen area 413, for example, at least one function key (eg, fn key) 413a of a keyboard. While the electronic device 201 displays at least one function key 413a of the keyboard on the second screen area 413, the up and down scrolling motion detected on the second screen area 413 or a specific key Based on the input, the type of function key displayed on the second screen area 413 may be changed and displayed. The electronic device 201 may display at least one of function keys for performing an operation related to an application displayed on the first display area 561 as a function set on the second screen area 413, for example. there is. The electronic device 201 has a function related to the application running in the first display area 26 on the second screen area 413 or not related to the application running in the first display area 26. Other features may be displayed. The electronic device 201 may display a touch pad area 415a for providing a function set on the third screen area 415, for example, a touch pad function. The electronic device 201 sets the size of the touch pad area 415a according to the size of the third screen area 415 located below the first area 410 to which the external accessory 310 is attached. It can be adjusted and displayed.

4C shows that in the electronic device 201 according to various embodiments, a hinge (eg, the hinge 281 of FIG. 2A ) of the electronic device 201 is folded so that the display 260 is connected to the first display 261. In a state where the second display 263 is divided, a second distance d1 longer than the first distance d1 of the second state of FIG. 4B at the first position p1 corresponding to the upper side of the second display area 263 It is a diagram illustrating a third state in which an external accessory (eg, a keyboard cover 310) for displaying a user interface is attached from a third position p3 separated by a distance d2. The electronic device 201, when an external accessory (eg, keyboard cover 310) is attached to the second display area 263 in the third state, the display area to which the external accessory 310 is attached ( 263), a keyboard for text input may be displayed, and typing may be possible using the keyboard.

The electronic device 201, in the third state, displays an area located above the first area 410 to which the external accessory (eg, keyboard cover 310) is attached in the second display area 263 and the second display area 263. Each of the areas located below the first area 410 is determined as a fourth screen area 417 and a fifth screen area 419, and the fourth screen area 417 and the fifth screen area 419 are respectively It can provide the functions set in . In the third state, the fourth screen area 417 includes an area larger than the second screen area 413 in the second state of FIG. 4B, and the fifth screen area 419 is In the second state of 4b, it may be set to include an area smaller than the third screen area 415. The electronic device 201 displays at least one function set in the fourth screen area 417 located above the first area to which the external accessory 310 is attached, for example, corresponding to a recently used application. A preview screen 417a may be displayed. The electronic device 201 displays at least one of, for example, displaying a function key (eg, fn key) of a keyboard or a preview screen corresponding to a frequently used application as a function set in the third screen area 417. can The electronic device 201 has a function related to an application being executed in the first display area 26 in the fourth screen area 417 larger than the second screen area 413a in the second state, or the first screen area 413a in the second state. In one display area 26, other functions not related to the application being executed may be displayed. The electronic device 201 is configured to provide a function set on the fifth screen area 419 located below the first area 410 to which the external accessory 310 is attached, for example, a touch pad function. A touch pad area 419a may be displayed. The electronic device 201 sets the size of the touch pad area 419a according to the size of the fifth screen area 419 located below the first area 410 to which the external accessory 310 is attached. It can be adjusted and displayed.

4D shows that in the electronic device 201 according to various embodiments, a hinge (eg, the hinge 281 of FIG. 2A ) of the electronic device 201 is folded so that the display 260 is connected to the first display 261. In a state where the first display 263 is divided, a third distance longer than the second distance d2 in the third state of FIG. 4C at the first position p1 corresponding to the upper side of the second display area 263 An external accessory for displaying a user interface from the fourth position p4 at a distance d3 to the fifth position p5 corresponding to the lower side of the second display area 263 (eg, keyboard cover 310) It is a diagram showing a fourth state in which is attached. The electronic device 201, when an external accessory (eg, keyboard cover 310) is attached to the second display area 263 in the fourth state, the display area to which the external accessory 310 is attached ( 263), a keyboard for text input may be displayed, and typing may be possible using the keyboard. In the fourth state, the electronic device 201 controls an area located above the first area 410 to which the external accessory (eg, keyboard cover 310) is attached in the second display area 263. 6 screen areas 421 can be set, and the functions set in the sixth screen area 421 can be provided.

The electronic device 201 is used as a function set in the sixth screen area 421 located above the first area 410 to which the external accessory 310 is attached, for example, a multi-window function 421a. can The electronic device 201 is a function set in the sixth screen area 421, for example, a preview screen corresponding to a recently used application, a preview screen corresponding to a frequently used application, or a first display area 561 At least one of function windows related to the running application being displayed may be displayed. The electronic device 201, in the fourth state, sets the sixth screen area 421 based on the user's gesture to the first area 410 to which the external accessory (eg, keyboard cover 310) is attached. ) can be extended.

According to various embodiments of the present disclosure, in the first to fourth states, the electronic device 201 displays a first area to which the external accessory (eg, keyboard cover) 310 is attached in the second display area 263. The keyboard displayed at 410 may be displayed as a type of keyboard selected by the user. The electronic device 201 determines the location (eg, first area) of the external accessory (eg, keyboard cover) 310 attached to the second display area 263 in the first to fourth states. (410)), at least one screen area (eg, a first screen area in a first state, a second screen area and a third area in a second state, and a second screen area in a third state) in the second display area 263 4 regions and a 5th region or a 6th region in a 4th state) may be set, and a UI linked in advance to the set at least one screen region may be displayed.

5 is a block diagram 500 of an electronic device according to various embodiments.

Referring to FIG. 5, an electronic device 501 (eg, the electronic device 101 of FIG. 1 or/and the electronic device 201 of FIGS. 2A to 4D) includes a processor 520 and a memory 530. , a display 560, a sensor module 576, and a communication module 590.

According to various embodiments, the processor 520 is in a folded state (eg, the hinge 281 of FIG. 2A ) of the electronic device 501 (eg, a folded state of the electronic device 201 of FIG. 2A ). , the user interface is displayed on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4C) of the display 560 (eg, the display 260 of FIGS. 2A to 4C). Attachment of an external accessory (eg, the external accessory (eg, the keyboard cover 310) of FIGS. 4A to 4D may be detected.

According to an embodiment, the processor 520 may, based on a pattern of capacitance detected by at least one conductive object included in the external accessory attached to the second display area 563, the second Attachment of the external accessory to the display area 563 and the type of the external accessory may be detected.

For example, if the processor 520 detects a first capacitance pattern through the second display 563, it may detect attachment of a keyboard cover for displaying a keyboard on the second display 563. there is. Alternatively, when the second capacitance pattern is detected through the second display 563, the processor 520 may detect attachment of a dial cover for displaying a dial on the second display 563.

According to an embodiment, the processor 520 may include a plurality of hall sensors capable of detecting at least one magnet included in the external accessory, and included in the external accessory among the plurality of hall sensors. The location of the area to which the external accessory is attached among the second display area 563 may be determined based on a location where a hall sensor for detecting a magnetic field by at least one magnet is disposed.

According to an embodiment, when the processor 520 receives detection signal information about the magnetic field from a first hall sensor among a plurality of hall sensors, the first position corresponding to the upper side of the second display area 563 It is possible to detect that the external accessory is attached to the first state (eg, the first state of FIG. 4A).

According to an embodiment, when the processor 520 receives detection signal information about the magnetic field from a second hall sensor among a plurality of hall sensors, the first position corresponding to the upper side of the second display area 563 It is possible to detect a second state (eg, the second state of FIG. 4B ) in which the external accessory is attached from a second position separated by a first distance from .

According to an embodiment, when the processor 520 receives detection signal information about the magnetic field from a third hall sensor among a plurality of hall sensors, the first position corresponding to the upper side of the second display area 563 indicates that the third state (eg, the third state of FIG. 4C) where the external accessory is attached from the third position at which the second distance is longer than the first distance of the second state (eg, the second state of FIG. 4B). can be detected.

According to an embodiment, when the processor 520 receives detection signal information about the magnetic field from a fourth hall sensor among a plurality of hall sensors, the first position corresponding to the upper side of the second display area 563 In the fourth state (eg, the fourth state of FIG. 4d) where the external accessory is attached from the fourth position at which the third distance is longer than the second distance of the third state (eg, the third state of FIG. 4c). can be detected.

According to an embodiment, the processor 520 determines that, when a first condition is satisfied based on Equation 1 below, the external accessory is attached from a first position corresponding to an upper side of the second display area 563. A first state (eg, the first state of FIG. 4A) may be detected. When the second condition is satisfied based on Equation 1 below, the processor 520 starts the external area from a second position separated by a first distance from the first position corresponding to the upper side of the second display area 563. In the second state where the accessory is attached (eg, the second state in FIG. 4B ) or in the first position corresponding to the upper side of the second display area 563 (eg, in the second state in FIG. 4B ) It is possible to detect a third state (eg, the third state of FIG. 4C ) in which the external accessory is attached from a third location at which the second distance is longer than the first distance. When the third condition is satisfied based on Equation 1 below, the processor 520 is in the third state (eg, the first position corresponding to the upper side of the second display area 563). It is possible to detect a fourth state (eg, the fourth state of FIG. 4D ) to which the external accessory is attached from a fourth position at which the third distance is longer than the second distance of the state 3).

<Equation 1>

First condition: KA(y)-SA(y) < α

Second condition: KA(y)-SA(y) < (SY - KY) -α

Third condition: KA(y)-SA(y)>(SY-KY)-α

SA(y): upper coordinate y value of the second display area

KA (y): y value of the top coordinate of the external accessory attached to the second display area

BA(y): y value of the lower coordinate of the external accessory attached to the second display area

SY: y-direction size value of the second display area

KY: y-direction size value of the external accessory

α: Threshold value for recognizing the screen area to be displayed in the second display area

According to an embodiment, the processor 520 satisfies the second condition based on the following <Equation 1>, so that the second state (eg, the second state of FIG. 4B) and the third state (eg, 4C), a Hall sensor (e.g., a second Hall sensor or a third Hall sensor that receives information about a detection signal for a magnetic field) among a plurality of Hall sensors provided in the electronic device 201. The second state or the third state may be distinguished and detected based on a position where the sensor) is disposed.

According to various embodiments, the processor 520 is in a folded state (eg, the hinge 281 of FIG. 2A ) of the electronic device 301 (eg, the folded state of the electronic device 201 of FIG. 2A ) In the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4C ), the first area (eg, the second display area 263 of FIGS. 4A to 4D ) to which an external accessory for displaying a user interface is attached is attached. A user interface corresponding to a type of an external accessory (eg, the external accessory (eg, the keyboard cover 310) of FIGS. 4A to 4D) for displaying the user interface may be displayed on the first region 410.

According to an embodiment, when the processor 520 detects the attachment and type of the external accessory attached to the second display area 563, based on the external accessory information stored in the memory 530, the Size information and/or shape information of external accessories may be checked.

According to an embodiment, the processor 520 may set the external accessory to a first area (eg, the first area 410 of FIGS. 4A to 4D ) of the second display area 563 to which the external accessory is attached. A user interface corresponding to the type and/or type of accessory may be displayed.

According to an embodiment, the processor 520 may, based on the user's selection, set the first area of the second display area 563 to which the external accessory is attached (eg, the first area of FIGS. 4A to 4D ). (410)), another user interface corresponding to the type and/or shape of the external accessory may be displayed. For example, the processor 520 may place a keyboard on a first area (eg, the first area 410 of FIGS. 4A to 4D ) to which a keyboard cover for displaying a keyboard is attached among the second display area 563 . While displaying as a user interface, the text of the keyboard may be changed based on the user's selection.

According to an embodiment, the processor 520 may set the external accessory to a first area (eg, the first area 410 of FIGS. 4A to 4D ) of the second display area 563 to which the external accessory is attached. While displaying the user interface corresponding to the type and/or shape of the accessory, when a predetermined area of the external accessory is pressed, the user interface displayed on the first area to which the external accessory is attached among the second display area 563 is pressed. A touch input on a predetermined area may be detected. The processor 520 may perform a function corresponding to a predetermined area of the user interface where the touch input is detected.

According to an embodiment, the processor 520 displays the user interface on the second display area 563 when the external accessory is removed from the second display area 563 in a state in which it is attached. mark can be removed.

According to various embodiments, the processor 520 is in a folded state (eg, the hinge 281 of FIG. 2A ) of the electronic device 301 (eg, the folded state of the electronic device 201 of FIG. 2A ) In the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4C ), the first area (eg, the second display area 263 of FIGS. 4A to 4D ) to which an external accessory is attached for displaying a user interface. According to the location of the first area 410), at least one remaining area other than the first area to which the external accessories are attached in the second display area is set as at least one screen area, and each of the at least one screen area It can provide the functions set in .

According to an embodiment, the processor 520 determines that the external accessory is attached from a first position corresponding to an upper side of the second display area 563 in a first state (eg, the first state in FIG. 4A ). If detected, the remaining area of the second display area 563 excluding the first area to which the external accessory is attached (eg, 410 in FIG. 4A ) is converted to a first screen area (eg, the first screen area 411 in FIG. 4A ). )) can be determined. The processor 520 may display a GUI for providing a set function, for example, a touch pad function, on the first screen area located below the first area to which the external accessory is attached.

According to an embodiment, the processor 520 may perform a second state in which the external accessory is attached from a second location that is a first distance away from the first location corresponding to the upper side of the second display area 563 (eg, 4B), the second screen area 563 except for the first area to which the external accessory is attached (eg, 410 in FIG. 4B) is displayed as a second screen area (eg, FIG. 4B). The second screen area 413 of FIG. 4b) and the third screen area (eg, the third screen area 415 of FIG. 4b) may be determined. The processor 520 performs a function set on the second screen area located above the first area to which the external accessories are attached, for example, a function key (eg, fn key) of a keyboard, or a first display area ( At least one of function keys for performing an operation related to an application displayed in 561) may be displayed. The processor 520 may display a GUI capable of providing a set function, for example, a touch pad function, on the third screen area located below the first area to which the external accessory is attached. In the first state, the processor 520 may display a GUI capable of providing a touch pad function on the third screen area whose size is reduced from that of the first screen area displaying a GUI capable of providing a touch pad function in the first state. there is. For example, while displaying function keys of a keyboard on the second screen area, the processor 520, based on an up-down scrolling motion detected on the second screen area or an input of a specific key, the second screen The type of function key displayed in the area can be changed and displayed.

According to an embodiment, the processor 520 may, from a first location corresponding to an upper side of the second display area 563, a third location separated by a second distance longer than the first distance in the second state to the outside of the second display area 563. When it is detected that the accessory is attached in the third state (eg, the third state in FIG. 4C ), the rest of the second display area 563 excluding the first area in which the external accessory is attached (eg, 410 in FIG. 4C ) is detected. The areas may be determined as a fourth screen area (eg, the third screen area 417 of FIG. 4C) and a fifth screen area (eg, the fifth screen area 419 of FIG. 4C). The processor 520 provides functions set in the fourth screen area located above the first area to which the external accessories are attached, such as displaying a function key (eg, fn key) of a keyboard, and a recently used application. At least one of a corresponding preview screen or a preview screen corresponding to a frequently used application may be displayed. The processor 520 may display a GUI capable of providing a set function, for example, a touch pad function, on the fifth screen area located below the first area to which the external accessory is attached. In the second state, the processor 520 may display a GUI capable of providing a touch pad function on the fifth screen area whose size is smaller than that of the third screen area displaying a GUI capable of providing a touch pad function in the second state. there is.

For example, the processor 520, while displaying a function key of a keyboard and at least one preview screen on each of the two sub areas included in the fourth screen area, scans the sub area displaying the function key. When a swipe out operation is detected, the at least one preview screen may be enlarged and displayed on the four screen areas including the two sub areas without displaying the function key on the fourth screen area. there is.

According to an embodiment, the processor 520 starts the first position from a fourth position separated by a third distance longer than the second distance in the third state from the first position corresponding to the upper side of the second display area 563. 2 When it is detected that the external accessory is attached to the fifth position corresponding to the lower side of the display area (eg, the fourth state in FIG. 4D ), the external accessory is attached in the second display area 563. An area other than the first area (eg, 410 in FIG. 4D ) may be determined as a sixth screen area (eg, the sixth screen area 421 in FIG. 4D ). The processor 520 performs functions set in the sixth screen area located above the first area to which the external accessory is attached, for example, a preview screen corresponding to a recently used application and a preview corresponding to a frequently used application. At least one of the screen or a function window related to an application being executed displayed on the first display area 561 may be displayed.

For example, while displaying a plurality of preview screens on each of a plurality of sub-regions included in the sixth screen area, the processor 520 performs an up-down scrolling operation on any one of the plurality of sub-regions. When detecting the up and down scrolling operation, other preview screens that are not displayed corresponding to the up and down scrolling operation may be sequentially displayed in the sub area where the up and down scrolling operation is detected.

According to an embodiment, when the processor 520 detects a downward drag operation at the boundary between the first display area 561 and the second display area 563 in the fourth state, the first display area The image screen displayed at 561 can be displayed by extending it to the sixth screen area of the second display area 563 . While the processor 520 displays the image screen including the sixth screen area 421 of the first display area 561 and the second display area 563, the image screen and the second display area 561 are displayed. When a long touch is detected at the boundary of the first area where the user interface is displayed in the display area 563, the image screen can be displayed on the entire first display area 561 and the second display area 563. . The processor 520 adjusts the transparency of the first area in the second display area 563 to display the user interface displayed in the first area, thereby overlapping a part of the image screen with the user interface. can be displayed

According to various embodiments, the memory 530 may be implemented substantially the same as or similar to the memory 130 of FIG. 1 .

According to an embodiment, the memory 530 may store information (eg, type information, size information, and shape information) about external accessories for displaying a user interface.

According to various embodiments, the display 560 (eg, the display 260 of FIGS. 4A to 4D ) includes a first display area 561 (eg, the first display area 261 of FIGS. 4A to 4D ). and a second display area 563 (eg, the second display area 263 of FIGS. 4A to 4D). The position of the first display area 561 may be changed at a predetermined angle according to folding of a hinge (eg, the hinge 281 of FIG. 2 ).

According to an embodiment, in the second display area 563, an external accessory for displaying a user interface (eg, the external accessory 310 of FIGS. 4A to 4D) is attached to the first area of the external accessory. A user interface corresponding to the type may be displayed.

According to an embodiment, if at least one remaining area other than the first area to which the external accessory is attached is set as at least one screen area in the second display area 563, the screen area is set for each of the at least one screen area. function can be provided.

According to an embodiment, the display 560 may be the same as the display module 160 of FIG. 1 , or may perform at least one function or operation performed by the display module 160 .

According to various embodiments, the sensor module 576 may be implemented substantially the same as or similar to the sensor module 176 of FIG. 1 .

According to an embodiment, the sensor module 576 may detect the unfolding state of the electronic device, the folding state of the electronic device, the posture state (or mounting state) of the electronic device, and the rotation state of the electronic device. May contain sensors.

According to an embodiment, the sensor module 376 may include an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, a motion sensor, a gravity sensor, and a proximity sensor. For example, the sensor module 576 uses sensor information received from at least one of an angle sensor, a tilt sensor, an acceleration sensor, a geomagnetic sensor, a gyro sensor, and a motion sensor to determine an unfolded state of the electronic device, Sensor information corresponding to the folding state of the electronic device, the posture state (or mounting state) of the electronic device, and the rotation state of the electronic device may be transmitted to the processor 520 .

According to an embodiment, the sensor module 576 includes a plurality of hall sensors, and detects a magnetic field by at least one magnet included in an external accessory for displaying a user interface among the plurality of hall sensors. The sensor information received from the hall sensor is transmitted to the processor 520, and the processor 520 transmits the sensor information to the outside of the second display area 563 based on the position where the hall sensor is disposed. You can make it possible to determine the location of the area where the accessory is attached.

According to various embodiments, the communication module 390 may be implemented substantially the same as or similar to the communication module 190 of FIG. 1 and may include a plurality of communication circuits using different communication technologies.

According to an embodiment, the communication module 390 may include at least one of a wireless LAN module (not shown) and a short-distance communication module (not shown), and the short-range communication module (not shown) is ultra wide (UWB). band) communication module, Wi-Fi communication module, NFC communication module, Bluetooth legacy communication module and / or BLE communication module.

6A is a diagram 600a for explaining an external accessory to be attached to a display of an electronic device according to various embodiments, and FIG. 6B is a cross-sectional view 600b taken along line A-A′ in FIG. 6A according to various embodiments. am. 6a to 6b, the external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIG. 6A, among external accessories for displaying a user interface, a keyboard cover (or keyboard skin) 310 for displaying a keyboard is an electronic device (eg, the electronic device of FIGS. 2A to 4D). Second display area (eg, second display area 263 in FIGS. 2A to 4D or/and second display area 563 in FIG. 5 ) of device 201 or/and electronic device 501 in FIG. 5 . ), in order for the electronic device to be able to detect the attachment of the keyboard cover (or keyboard skin) 310 and the type of the keyboard cover (or keyboard skin) 310, the keyboard cover (or keyboard skin) 310 Conductive materials 611a and 611b (eg, metal (eg, silver, copper, gold, aluminum, tungsten, zinc, brass, tin, lead, or stainless steel) or a carbon allotrope (eg, graphite or graphene) may be disposed and included in the keyboard cover (or keyboard skin) 310, so that the keyboard cover 310 is in the second display area of the electronic device. When attached, the electronic device determines the position of the keyboard cover 310 attached to the second display area and prevents separation of the keyboard cover 310 attached to the second display area, the keyboard cover Magnets 613a and 613b may be disposed at both ends of the inside of the keyboard cover 310. The magnets 613a and 613b, respectively, are disposed at both ends of the inside of the keyboard cover 310, and the keyboard cover 310 When attached to the second display area of the electronic device, it may come into contact with one of a plurality of magnets disposed on the second display area 6A, the inside of the keyboard cover 310 Although one magnet (613a, 613b) has been described as an example of arranging one magnet (613a, 613b) at both ends, a plurality of magnets may be arranged and displayed at regular intervals at both ends of the inside of the keyboard cover 310. In FIG. 6A, Although the keyboard cover (or keyboard skin) 310 is attached to the second display area of the display as an example, the keyboard cover (or keyboard skin) 310 may be attached to the first display area of the display, The first display area to which the keyboard cover (or keyboard skin) 310 is attached may operate identically to the second display area to which the keyboard cover (or keyboard skin) 310 is attached.

Referring to FIG. 6B, which is a cross-sectional view taken along A-A' in FIG. 6A, the keyboard cover 310 shows a keyboard, which is a user interface displayed in the second display area of the electronic device, It may be made of a transparent and thin material having elasticity that can be restored after being pressed for the user's touch of the keyboard. Each of the plurality of key covers included in the keyboard cover 310 can recognize the touch of the keyboard displayed on the second display area of the electronic device when the central portion 611 having a thin key material is pressed. . The inside of each of the plurality of key covers may be formed in a dome shape 613 so that the plurality of key covers included in the keyboard cover 310 can be restored after being pressed. A conductive material may be inserted into the keyboard cover 310 to enhance touch recognition of the keyboard. Alternatively, the keyboard cover 310 in which the conductive material is not inserted may recognize the keyboard cover pattern, thereby recognizing the touch of the keyboard and recognizing the position change of the keyboard.

7A to 7C are diagrams 700a to 700c for explaining an operation of detecting attachment of an external accessory to a display of an electronic device according to various embodiments. 7a to 7c, the external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIGS. 7A to 7C, as shown in FIGS. 7A to 7B, the electronic device (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) A keyboard cover for displaying a keyboard in the second display area 563 (eg, the second display area 263 in FIGS. 2A to 4D ) in a state in which the hinge (eg, the hinge 281 of FIG. 2 ) is folded ( Or, when a keyboard skin) 310 (eg, the keyboard cover 310 of FIGS. 6A and 6B) is attached, the electronic device is configured such that the conductive materials 611a and 611b included inside the keyboard cover 310 As the second display area 563 is in contact, a change in capacitance pattern may be detected. The conductive materials 611a and 611b included inside the keyboard cover 310 recognize the location of the keyboard cover (or keyboard skin) 310 and change the location of the keyboard cover (or keyboard skin) 310. can be used to recognize

According to various embodiments, the magnets 613a and 613b disposed at both ends of the inside of the keyboard cover 310, when the keyboard cover 310 is attached to the second display area of the electronic device, 2 As it comes into contact with one of the plurality of magnets disposed in the display area, the keyboard cover 310 can be attached to the second display area and prevented from leaving the keyboard cover 310. there is.

7C, when the electronic device detects the first capacitance pattern from the second display 563, an external accessory for displaying a user interface is attached to the second display area 563, and the attachment It is possible to detect that the type of the external accessory is the keyboard cover 310 for displaying the keyboard. When the electronic device detects that the keyboard cover 310 is attached to the second display area 563, the first area 410 of the second display area 563 to which the keyboard cover 310 is attached. A keyboard including a plurality of keys may be displayed as a user interface.

According to various embodiments of the present disclosure, in the electronic device, a keyboard cover in which a plurality of conductive materials (eg, conductive materials 611a and 611b) are disposed in a specific pattern is attached to the second display area to display a predetermined When multiple touches of a pattern are detected, information including relative position values based on the keyboard size and pattern stored in the electronic device is called based on the detected multiple touches, and is attached in the second display area. You can check the location of the keyboard cover.

According to various embodiments, a conductive material may be inserted into the keyboard cover 310 to enhance touch recognition of the keyboard. Alternatively, the keyboard cover 310 in which the conductive material is not inserted may recognize a touch of the keyboard and a change in the position of the keyboard by recognizing a pattern in a key cap of the keyboard cover.

8A to 8D are diagrams 800a to 800d for explaining an operation of detecting a position of an external accessory attached to a display of an electronic device according to various embodiments. 8A to 8D describe the external accessory as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

8A to 8D show a hinge (eg, the hinge 281 of FIG. 2 ) of an electronic device (eg, the electronic device 201 of FIGS. 2A to 4D , or/and the electronic device 501 of FIG. 5 ). is folded, and a keyboard cover (or keyboard skin) 310 (eg, FIGS. 6A to 4D) for displaying a keyboard on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) These are cross-sectional views of the side of the second display area 563 in a state where the keyboard cover 310 of 6b is attached. Magnets (for example, the magnets 613a and 613b of FIG. 7A ) may be disposed at both ends of the inside of the keyboard cover 310 , and at both ends of the second display area 563 , the keyboard cover 310 A plurality of magnets may be disposed at a plurality of locations that may come into contact with magnets (eg, magnets 613a and 613b of FIG. 7A ) disposed at both ends of the inside of ).

Referring to FIG. 8A , in the electronic device, when the keyboard cover 310 is attached to the second display area 563, the magnet 613b of the keyboard cover 310 is attached to the second display area ( 563), the keyboard cover 310 is attached from the first position corresponding to the upper side of the second display area 563 as it contacts the first magnet 811a among the plurality of magnets 811 disposed thereon. The first state (eg, the first state of FIG. 4A ) may be detected.

Referring to FIG. 8B , in the electronic device, when the keyboard cover 310 is attached to the second display area 563, the magnet 613b of the keyboard cover 310 is attached to the second display area ( 563), as it contacts the second magnet 811b among the plurality of magnets 811 disposed on the second display area 563, from a second position separated by a first distance from the first position corresponding to the upper side of the second display area 563. It may be detected that the keyboard cover 310 is attached to the second state (eg, the second state of FIG. 4B).

Referring to FIG. 8C , in the electronic device, when the keyboard cover 310 is attached to the second display area 563, the magnet 613b of the keyboard cover 310 is attached to the second display area ( 563) as it contacts the third magnet 811c among the plurality of magnets 811 disposed in the second state (eg, FIG. 4B ) in the first position corresponding to the upper side of the second display area 563. It is possible to detect the third state (eg, the third state of FIG. 4C ) where the keyboard cover 310 is attached from the third position at which the second distance is longer than the first distance of the second state of).

Referring to FIG. 8D , in the electronic device, when the keyboard cover 310 is attached to the second display area 563, the magnet 613b of the keyboard cover 310 moves the second display area ( 563), as it contacts the fourth magnet 811d among the plurality of magnets 811, the third state (eg, FIG. 4C ) in the first position corresponding to the upper side of the second display area 563. It may be detected that the keyboard cover 310 is attached to the fourth state (eg, the fourth state of FIG. 4D ) from the fourth position where the third distance is longer than the second distance of the third state of).

When a plurality of hall sensors are included in the second display area 563, the electronic device based on detection signal information output from a hall sensor contacting a magnet of the keyboard cover 310 among the plurality of hall sensors. As a result, an attachment state (eg, a first state, a second state, a third state or state) of the keyboard cover 310 attached to the second display area 563 can be determined.

9 is a diagram 900 for explaining an operation of detecting a location of an external accessory attached to a display of an electronic device according to various embodiments. In FIG. 9 , the external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIG. 9, an electronic device (eg, the electronic device 201 of FIGS. 2A to 4D, or/and the electronic device 501 of FIG. 5) is a hinge of the electronic device (eg, the hinge of FIG. 2 ( 281) is in a folded state, when the keyboard cover 310 for displaying a keyboard is attached to the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D ), the second display area 563 is in a folded state. Detect the attached position of the keyboard cover 310 in the area 563, and based on the information of the keyboard cover 310 stored in a memory (eg, the memory 530 of FIG. 5), the keyboard cover 310 Size information and/or shape information of may be checked.

The electronic device 201, after the electronic device 201 is placed on the floor in a completely folded state (folded state) in which the first housing 271 and the second housing 273 are in contact, the electronic device 201 When the first housing 271 and the second housing 273 are converted to a folded (folded state) at a predetermined angle or a predetermined distance based on the sensor module of 201, the display 560 is displayed in the upper area. It can be divided into upper and lower regions. When the second housing 273 is in contact with the floor, the electronic device 201 sets the upper area as the first display area 561 and the lower area as the second display area 563, When the external accessory (eg, the keyboard cover 310) is attached to the second display area 263, the top coordinate y of the second display area 563 is determined based on the size information of the second display area 563 stored in the memory. The value SA(y) and the y-direction size value SY of the second display area may be checked. The electronic device 201 may detect location information and size information of the keyboard cover 310 attached to the second display area 563 from the memory. In step 201 , when a location of an electrostatic pattern is recognized based on the conductive material disposed inside the keyboard cover 310 , coordinates of the recognized location may be determined. The electronic device 201 uses the location information of the keyboard cover 310, the size information of the keyboard cover 310, and the coordinates of the position where the electrostatic pattern is recognized, to display the information on the second display area 563. The upper coordinate y value (KA (y)) of the attached keyboard cover 310, the lower coordinate y value (BA (y)) of the keyboard cover 310 attached to the second display area 563, and the keyboard cover ( 310) can detect the y-direction size value (KY).

The electronic device 201 includes an upper coordinate y value (SA(y)) of the second display area, a size value (SY) in the y direction of the second display area, and a keyboard attached to the second display area 563. The upper coordinate y value of the cover 310 (KA(y)), the lower coordinate y value of the keyboard cover 310 attached to the second display area 563 (BA(y)), and the keyboard cover 310 Based on <Equation 1> using the y-direction size value (KY) and the threshold value (α) for recognizing the screen area to be displayed in the second display area, the first condition (KA (y) -SA (y ) < α), it can be confirmed that the keyboard cover 310 is located and attached to the second display area 563 in a first state (eg, the first state of FIG. 4A). The electronic device 201, in the first state (eg, the first state of FIG. 4A ), the remaining area other than the first area to which the keyboard cover 310 is attached in the second display area 563 An area below the first area may be determined as the first screen area, and a set function (eg, touch pad area display) may be provided to the first screen area. Based on Equation 1, the electronic device , If the second condition (KA (y) - SA (y) < (SY - KY) -α) is satisfied, the second state (eg, the second state of FIG. 4b) or the third state (eg, the second state of FIG. 4c) In the third state), it can be confirmed that the keyboard cover 310 is located and attached to the second display area 563 .

The electronic device 201 calculates the upper coordinate y value of the second display area 563 (SA(y)) and the upper coordinate y value of the keyboard cover 310 attached to the second display area 563 (KA(y) )), the second state and the third state can be distinguished based on the length between. The electronic device, if the length is equal to the vertical length of the second screen area (eg, the second screen area 413 of FIG. 4B) in the second state, determines the second state, and determines that the length is the first If the vertical length of the fourth screen area in the third state (eg, the third screen area 417 in FIG. 4C ) is the same, the third state can be identified.

In the second state, the electronic device 201 has an area located above the first area to which the keyboard cover 310 is attached and an area located below the first area in the second display area 563 in the second state. If each is determined as a second screen area and a third screen area, a function set in the second screen area (eg, displaying at least one function key of a keyboard) is provided, and a function set in the third screen area (eg, displaying at least one function key of a keyboard) is provided. : Display of touch pad area) may be provided.

In the third state, the electronic device 201 has an area located above the first area to which the keyboard cover 310 is attached and an area located below the first area in the second display area 563 in the third state. If each is determined as a fourth screen area and a fifth screen area, a function set in the fourth screen area (eg, display of at least one preview screen corresponding to a recently used application) is provided, and the fifth screen area is displayed. A set function (eg, touch pad area display) may be provided. In the third state, the fourth screen area includes an area larger than the second screen area in the second state, and the fifth screen area includes an area smaller than the third screen area in the second state. It can be set to include.

If the electronic device satisfies the third condition (KA(y)-SA(y) > (SY-KY)-α) based on Equation 1, the fourth state (eg, the first 4 state), it can be confirmed that the keyboard cover 310 is positioned and attached to the second display area 563 . In the fourth state, the electronic device 201 sets an area located above the first area to which the keyboard cover 310 is attached in the second display area 563 as a sixth screen area, and 6 Functions set in the screen area (eg, at least one of a preview screen corresponding to a recently used application, a preview screen corresponding to a frequently used application, or a function window related to an application currently being displayed on the first display area 561). display) can be provided.

FIG. 10 is a diagram 1000 for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a first state according to various embodiments. In FIG. 10, an external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIG. 10, the electronic device 1001 (eg, the electronic device 201 of FIGS. 2A to 4D, or/and the electronic device 501 of FIG. 5) is a hinge (eg, the electronic device 501 of FIG. 5). : When the hinge 281 of FIG. 2 is in a folded state, the keyboard cover 310 for displaying the keyboard is provided on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) When attached in one state (eg, the first state in FIG. 4A ), a touch pad function is provided to the first screen region 411, which is the remaining region other than the region to which the keyboard cover 310 is attached, among the second display region 563. A touch pad area 1011 for processing may be provided as a GUI. When the electronic device 1011 detects a left and right drag operation 1011a on the left or right border of the touch pad area 1011, the size of the touch pad area 1011 corresponds to the left and right drag operation 1011a. can be adjusted. In the electronic device 1001, a palm rejection function may be set so that a touch is not detected on the remaining areas of the first screen area 411 except for the touch pad area 1011.

While the electronic device 1001 displays a keyboard in the first area 410 to which the keyboard cover 310 is attached in the second display area 563 in the first state, the user's selection (eg: based on the selection of a specific key within the keyboard) to change the text of the keyboard. The electronic device 1011 may, for example, change the English text a1 on the keyboard to Korean text a2, and display the Korean text along with a designated icon or emoticon on the keyboard. The electronic device 1011 may change English text (a1) or Korean text (a2) of the keyboard into special character text (a3), and display the special character text along with designated icons or emoticons on the keyboard. can

11A to 11D are diagrams 1100a to 1100d for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a second state according to various embodiments. 11a to 11d, the external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIG. 11A, the electronic device 1101 (eg, the electronic device 201 of FIGS. 2A to 4D, or/and the electronic device 501 of FIG. 5) is a hinge (eg, the electronic device 501 of FIG. 5) : When the hinge 281 of FIG. 2 is in a folded state, the keyboard cover 310 for displaying the keyboard is provided on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) When attached in two states (eg, the second state of FIG. 4B), the first function key 413a (eg, fn key) of the keyboard is displayed on the second screen area 413, and the third screen area 415 A touch pad area 1111 for providing a touch pad function may be provided. The electronic device 1101 includes not only the first function key 413a (eg, fn key) on the second screen area 413, but also functions related to applications running on the first display area 561 or the first function key 413a. 1 Display area 561 may display other functions not related to an application being executed. The electronic device 1101 may display a keyboard in an area of the second display area 563 where the keyboard cover 310 is located. When the third screen area 415 is set as the remaining area of the second display area 563 where the keyboard cover 310 is located, the electronic device 1101 makes a touch corresponding to the third screen area. The pad area 1111 may be adjusted and displayed.

Referring to FIG. 11B, the electronic device 1101 displays the first function key 413a of the keyboard on the second screen area 413 as shown in FIG. 11A, while the second screen area 413 ) detects an up and down scroll operation 1103 or a specific key input 1105, the second screen area 413 is displayed based on the detection of the up and down scroll operation 1103 or the specific key input 1105. The type of displayed function key can be changed and displayed. For example, the electronic device 1101 displays a keyboard instead of a first function key 413a of the keyboard on the second screen area 413 based on the up/down scroll operation 1103 or a specific key input 1105. The second function key 413b of the keyboard or the third function key 413c of the keyboard may be displayed.

Referring to FIG. 11C , the electronic device 1101 displays a second display area 563 (eg, the hinge 281 of FIG. 2 ) in a folded state. The keyboard cover 310 for displaying the keyboard is attached to the second display area 263 of FIGS. 2A to 4D in a second state (eg, the second state of FIG. 4B), and the first display area 561 has a constant When an application (eg, messenger application) being executed is displayed on the area 571, an operation related to the application (eg, messenger application) displayed on the first display area 561 is performed on the second screen area 413. A function key (eg, a function key for selecting an emoticon) may be displayed, and a touch pad area 1111 may be provided to provide a touch pad function on the third screen area 415 .

Referring to FIG. 11D , the electronic device 1101 displays a second display area 563 (eg, the hinge 281 of FIG. 2 ) of the electronic device 1001 in a folded state. The keyboard cover 310 for displaying the keyboard is attached to the second display area 263 of FIGS. 2A to 4D in a second state (eg, the second state of FIG. 4B), and is attached to the first display area 561. When a video being played is displayed, a function key capable of performing an operation related to the video being displayed in the first display area 561 is displayed on the second screen area 413 (eg, a function key capable of controlling the video). A touch pad area 1111 for displaying and providing a touch pad function to the third screen area 415 may be provided.

12A to 12B are diagrams 1200a to 1200b for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a third state according to various embodiments. 12a to 12b, the external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIG. 12A, an electronic device 1201 (eg, the electronic device 201 of FIGS. 2A to 4D, or/and the electronic device 501 of FIG. 5) is a hinge (eg, the electronic device 501 of FIG. 5) : When the hinge 281 of FIG. 2 is in a folded state, the keyboard cover 310 for displaying the keyboard is provided on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) When attached in three states (eg, the third state of FIG. 4C), the fourth screen area 417 enlarged than the second screen area 413 in the second state of the keyboard cover (eg, the second state of FIG. 4B) A plurality of preview screens corresponding to recently used applications are displayed on the first sub-area 417a, a function key (eg, fn key) of the keyboard is displayed on the second sub-area 417b, and a fifth screen area A touch pad area 1211 for providing a touch pad function to 419 may be provided.

Referring to FIG. 12B, the electronic device 1201 displays a plurality of preview screens corresponding to recently used applications on the first sub-region 417a of the fourth screen area 417, as shown in FIG. 12A. And, while displaying the function key (eg, fn key) of the keyboard on the second sub area 417b, the function key of the keyboard displayed on the second sub area 147b or the second sub area 417b ( Example: When a swipe out operation 1203 is detected in a state in which the fn key) is clicked or a specific key 1205 (eg, the Fn key) is input, in the fourth screen area 417 The fourth screen area 417 in which the function keys displayed on the second sub area 417b are removed and the first sub area 417a and the second sub area 417b are integrated into one area. A plurality of preview screens corresponding to the recently used application may be enlarged and displayed.

In the electronic device 1201, a plurality of pluralities corresponding to the recently used applications are displayed on the fourth screen area 417 in which the first sub area 417a and the second sub area 417b are combined into one area. If a swipe up operation is detected at the bottom of the fourth screen area 417 or an input of a specific key (eg, Fn key) 1205 is detected while the preview screens of are enlarged and displayed, As shown in FIG. 12A, a plurality of preview screens corresponding to recently used applications are reduced and displayed on the first sub-area 417a of the fourth screen area 417, and keyboard functions are displayed on the second sub-area 417b. Keys (e.g. the fn key) can be displayed again.

13A to 13J are diagrams 1300a to 1300j for explaining functions provided to a screen area when an external accessory is positioned on a display of an electronic device in a fourth state according to various embodiments. 13a to 13j, the external accessory is described as a keyboard cover (or keyboard skin) as an example, but the same can be applied to other external accessories.

Referring to FIG. 13A, an electronic device 1301 (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) is a hinge (eg, the electronic device 501 of FIG. 5) of the electronic device 1001. When the hinge 281 of FIG. 2 is in a folded state, the keyboard cover 310 for displaying the keyboard on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) is in a fourth When attached in a state (eg, the fourth state of FIG. 4D), the second screen area 413 or the third state (eg, Fig. 4B) of the keyboard cover in the second state (eg, the second state of FIG. In the third state of 4c), a plurality of preview screens corresponding to recently used applications are displayed on each of the plurality of sub-areas 421a and 421b included in the sixth screen area 421 enlarged from the fourth screen area 417. It can be displayed enlarged. In the electronic device 1301, when the keyboard cover 310 for displaying the keyboard is attached to the second display area 563 in the fourth state (eg, the fourth state of FIG. 4D), the keyboard cover is in the second state. (eg, the second state of FIG. 4B) the third screen area 415 or the third state of the keyboard cover (eg, the third state of FIG. 4C) the touch pad area displayed on the fifth screen area 419 do not show,

While the electronic device 1301 displays a plurality of preview screens corresponding to recently used applications on each of the plurality of sub areas 421a and 421b included in the sixth screen area 421, the plurality of preview screens are displayed. When a preview screen displayed on one of the sub-regions 421a and 421b is selected, an application corresponding to the selected preview screen may be executed and displayed on the first display area 561 .

Referring to FIG. 13B, the electronic device 1301 includes a plurality of sub-areas 421a and 421b included in the sixth screen area 421, respectively, corresponding to a recently used application, as shown in FIG. 13A. While displaying the preview screens, if an up and down scroll operation 1303a or 1303b is detected in any one of the plurality of sub areas 421a or 421b, the corresponding up and down scroll operation is performed. Other preview screens that are not displayed in the sub-region 421a or 421b in which the up-down scrolling operation is detected are sequentially displayed, and any one of the plurality of sub-regions 421a or 421b is selected. Another preview screen can be displayed.

Referring to FIG. 13C , the electronic device 1301 includes a plurality of sub-regions 421a and 421b included in the sixth screen area 421 as shown in FIG. 13A, each corresponding to a recently used application. While displaying the preview screens, a left and right scrolling operation is detected at the boundary between the first sub area 421a and the second sub area 421b, and the first sub area 421a) and the second sub area 421a) and the second sub area are detected according to the left and right scrolling operation. The size of (421b) can be changed.

Referring to FIG. 13D, as shown in FIG. 13C, the electronic device 1301 detects a left scroll operation at the boundary between the first sub area 421a and the second sub area 421b, and performs the left scroll operation. Based on this, it is possible to determine the expansion of the size of the second sub-region 421b. The electronic device 1301 reduces the size of the first sub-region 421a and expands the size of the second sub-region 421b to correspond to the left scroll operation, so that the size of the first sub-region is reduced. 421a) and preview screens corresponding to each of the enlarged second sub-regions 421b may be displayed.

Referring to FIGS. 13E to 13F, as shown in FIG. 13E, the electronic device 1301 (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) When the hinge (eg, hinge 281 of FIG. 2 ) of the electronic device 1001 is in a folded state, a keyboard is displayed on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D ) When the keyboard cover 310 for is attached in a fourth state (eg, the fourth state in FIG. 4D ), a plurality of subregions corresponding to recently used applications are provided in each of the plurality of subregions included in the sixth screen area 421 . Preview screens may be displayed. 13E, the electronic device 1301 displays each of the plurality of function windows 1307a, 1307b, and 1307c displayed on a partial area of the first display area 561 as the sixth screen area 421. When detecting the drag operation (b1, b2, and b3) for moving, the sixth screen area 421 is divided into a plurality of sub-regions for displaying the plurality of function windows, and the divided plurality of sub-regions Each of them may be displayed as the plurality of function windows 1307a, 1307b, and 1307c on the sixth screen area 421 .

Referring to FIGS. 13G to 13H, as shown in FIG. 13G, the electronic device 1301 (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) When the hinge (eg, hinge 281 of FIG. 2 ) of the electronic device 1001 is in a folded state, a keyboard is displayed on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D ) When the keyboard cover 310 for is attached in a fourth state (eg, the fourth state in FIG. 4D ), a plurality of subregions corresponding to recently used applications are provided in each of the plurality of subregions included in the sixth screen area 421 . Preview screens may be displayed. The electronic device 1301 has a keyboard cover 310 for displaying a keyboard on the second display area 563 when the hinge (eg, the hinge 281 of FIG. 2 ) of the electronic device 1001 is in an unfolded state. When attached in a fourth state (eg, the fourth state in FIG. 4D ), a plurality of preview screens corresponding to a recently used application may be displayed on each of a plurality of sub-regions included in the sixth screen area 421 . While displaying the image screen 561a on the first display area 561, the electronic device performs a downward drag operation 1309 at the boundary between the first display area 561 and the second display area 563. 13H, the image screen 561a can be expanded and displayed up to the sixth screen area 421 of the second display area 563, as shown in FIG. 13H.

Referring to FIGS. 13I to 13J, as shown in FIG. 13I, in the electronic device 1301, the image screen 561a is the first display area 561 and the second display area 563. Detects a long touch 1311 at the boundary of the first area 410 of the second display area 563 where the image screen 561 a and the keyboard are displayed while displaying including the 6 screen areas 421 13J, the image screen 561a can be displayed on the entire first display area 561 and the second display area 563. The electronic device 1301 controls the transparency of the first area 410 of the second display area 563 to display the keyboard, thereby overlapping a part of the image screen 561a and the keyboard. can

14 is a diagram 1400 for explaining types of external accessories on a display of an electronic device according to various embodiments.

Referring to FIG. 14, an external accessory for displaying a user interface may include various external accessories depending on the purpose, for example, a keyboard cover (or keyboard skin) for displaying a keyboard (eg, FIGS. 11A to 13J ). In addition to the keyboard cover 310), a dial cover (or dial skin) 1401 for displaying a dial, a calculator cover (or calculator skin) 1403 for displaying a calculator, and a game pad cover (or game pad cover for displaying a game pad) pad skin) 1405.

15 is a diagram 1500 for explaining an operation of an external accessory on a display of an electronic device according to various embodiments.

Referring to FIG. 15, as shown in (a), an electronic device (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) is the electronic device 1001 External accessory for displaying a user interface on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) when the hinge (eg, hinge 281 of FIG. 2) is in a folded state Attachment of the low dial cover 1401 can be detected. The electronic device displays the dial cover 1401 on the second display area 563 based on the second capacitance pattern detected by the conductive object disposed on at least a partial area inside the dial cover 1401. adhesion can be detected. The electronic device includes at least one included in the dial cover 1401 attached to the second display area 263 that contacts any one of the plurality of hall sensors disposed on the second display area 563. Based on one magnet, the attached position of the dial cover 1401 in the second display area 563 may be determined. As shown in (b), the electronic device may display a rotation scroll function key corresponding to the dial cover 1401 in an area of the second display area to which the dial cover 1401 is attached.

16 is a diagram 1600 for explaining an operation of an external accessory on a display of an electronic device according to various embodiments.

Referring to FIG. 16, as shown in (a), an electronic device (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) is the electronic device 1001 External accessory for displaying a user interface on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) when the hinge (eg, hinge 281 of FIG. 2) is in a folded state With this, the attachment of the calculator cover 1403 can be detected. The electronic device displays the calculator cover 1403 on the second display area 563 based on the second capacitance pattern detected by the conductive object disposed on at least a partial area inside the calculator cover 1403. adhesion can be detected. The electronic device includes at least one included in the calculator cover 1403 attached to the second display area 263 that contacts any one of the plurality of Hall sensors disposed on the second display area 563. Based on one magnet, the attached position of the calculator cover 1403 in the second display area 563 may be determined. As shown in (b), the electronic device may display function keys for performing calculations corresponding to the calculator cover 1401 in an area of the second display area to which the calculator cover 1403 is attached.

17 is a diagram 1700 for explaining an operation of an external accessory on a display of an electronic device according to various embodiments.

Referring to FIG. 17, as shown in (a), an electronic device (eg, the electronic device 201 of FIGS. 2A to 4D or/and the electronic device 501 of FIG. 5) is the electronic device 1001 External accessory for displaying a user interface on the second display area 563 (eg, the second display area 263 of FIGS. 2A to 4D) when the hinge (eg, hinge 281 of FIG. 2) is in a folded state Therefore, the attachment of the game pad cover 1405 can be detected. The electronic device displays the game pad cover ( 1405) can be detected. The electronic device is included in the game pad cover 1405 attached to the second display area 263 contacting any one of the plurality of hall sensors disposed on the second display area 563. Based on at least one magnet, the attached position of the game pad cover 1405 in the second display area 563 may be determined. As shown in (b), the electronic device may display function keys for playing a game corresponding to the game pad cover 1401 in the area where the game pad cover 1405 is attached in the second display area. .

According to various embodiments, an electronic device (eg, the electronic device 501 of FIG. 3 ) includes a first housing (eg, the first housing 271 of FIG. 2A ) and a second housing (eg, the first housing 271 of FIG. 2A ). 2 housing 273, a hinge that foldably connects one side of the first housing to one side of the second housing (for example, the hinge 281 of FIG. 2A), and a first display area disposed on the first housing ( Example; A display including the first display area 261 of FIG. 2A and a second display area (eg, second display area 263 of FIG. 2A) disposed in the second housing (eg, the display of FIG. 2A) 260, and a processor (eg, the processor 520 of FIG. 5), wherein the processor includes an external accessory (eg, the processor 520 of FIG. 5) for displaying a user interface in the second display area in a state in which the hinge is folded. When the attachment of the keyboard cover 310 is detected, a user interface corresponding to the type of the external accessory may be displayed in an area of the second display area to which the external accessory is attached.

According to various embodiments of the present disclosure, the processor may display the external accessory attached to the second display area based on a pattern of capacitance detected by at least one conductive object included in the external accessory attached to the second display area. It can be set to detect the attachment of and the type of the external accessory.

According to various embodiments of the present disclosure, the processor determines a position where the external accessory is attached in the second display area based on a plurality of hall sensors disposed on the second display and at least one magnet included in the external accessory. can be set to determine

According to various embodiments of the present disclosure, when the type of the external accessory attached to the second display area is detected, the processor checks size and shape information of the accessory corresponding to the type of the accessory, and determines the type of the identified accessory. A user interface corresponding to size and shape information may be set to be displayed on an area of the second display area to which the external accessory is attached.

According to various embodiments of the present disclosure, the processor may touch a predetermined area of the user interface displayed on an area to which the external accessory is attached among the second display area by pressing the predetermined area of the external accessory attached to the second display area. When an input is detected, it may be set to perform a function corresponding to a predetermined area of the user interface.

According to various embodiments, the processor may set at least one remaining area of the second display area excluding the area to which the external accessory is attached according to the attached position of the external accessory in the second display area as at least one screen. It can be determined as an area and set to provide a function set for each of the at least one screen area.

According to various embodiments of the present disclosure, in a first state of detecting the attachment of the external accessory from a first position corresponding to an upper side of the second display area, the processor may detect the attachment of the external accessory in the second display area. An area other than area 1 may be determined as a first screen area and a function set in the first screen area may be provided.

According to various embodiments, the processor may, in a second state of detecting attachment of the external accessory from a second location separated by a first distance from the first location corresponding to the upper side of the second display area, the second display area. determining the remaining two areas other than the first area to which the external accessory is attached as a second screen area and a third screen area, and providing functions set for each of the second screen area and the third screen area; The second screen area may be set to be located above the first area to which the external accessory is attached, and the third screen area to be located below the first area to which the external accessory is attached.

According to various embodiments, the processor detects the attachment of the external accessory from a third location separated by a second distance longer than the first distance in the second state from the first location corresponding to the upper side of the second display area. In the third state, the remaining two areas of the second display area excluding the area to which the external accessory is attached are determined as a fourth screen area and a fifth screen area, respectively, in the fourth screen area and the fifth screen area. Provides a set function, the fourth screen area is located above the first area to which the external accessory is attached and includes an area larger than the second screen area in a second state, and the fifth screen area is the outer It may be set to include an area located below the first area to which accessories are attached and having a smaller size than the third screen area in the second state.

According to various embodiments of the present disclosure, the processor may cause a third distance from a first position corresponding to an upper side of the second display area to a lower side of the second display area from a fourth position separated by a third distance longer than the second distance in the third state. In the fourth state of detecting the attachment of the external accessory, an area other than the first area to which the external accessory is attached is determined as a sixth screen area in the second display area, and a function set in the sixth screen area is performed. can be set to provide

18 is a flowchart 1800 illustrating an operation of detecting attachment of an external accessory in an electronic device according to various embodiments. Operations for detecting attachment of the external accessory may include operations 1801 to 1803. According to an embodiment, at least one of operations 1801 to 1803 may be omitted, the order of some operations may be changed, or another operation may be added. The operation of detecting the attachment of the external accessory may be performed by the electronic device 101 of FIG. 1 , the processor 120 of FIG. 1 , the electronic device 501 of FIG. 5 , or the processor 520 of FIG. 5 .

In operation 1801, the electronic device 501 displays a second display area (eg, FIG. 5 ) of a display (eg, the display 560 of FIG. 5 ) in a state in which the hinge (eg, FIG. 2A of FIG. 2A is folded) of the electronic device. Attachment of an external accessory (eg, a keyboard cover) for displaying a user interface to the second display area 563 of the screen may be detected.

According to an embodiment, the electronic device 501 determines the second display area based on a pattern of capacitance detected by at least one conductive object included in the external accessory attached to the second display area. Attachment of the external accessory and the type of the external accessory may be detected.

According to an embodiment, the processor 520 is included in the external accessory attached to the second display area 563 contacting any one of the plurality of Hall sensors disposed on the second display area. Based on the at least one magnet, the location of the area to which the external accessory is attached in the second display area 563 may be determined.

According to an embodiment, the electronic device 501 includes at least one magnet included in the external accessory (eg, a keyboard cover) (eg, magnets 613a and 613b of FIG. 7A and/or FIGS. 8A to 8D ). may include a plurality of Hall sensors (eg, the plurality of Hall sensors 811 of FIGS. 8A to 8D ) capable of detecting the magnet 613b of the external accessory among the plurality of Hall sensors. A location of an area to which the external accessory is attached among the second display area may be determined based on a location where a hall sensor for sensing a magnetic field by at least one magnet included in is disposed.

According to an embodiment, the electronic device 501 may determine the position of the area to which the external accessory is attached among the second display areas based on Equation 1.

In operation 1803, the electronic device 501 displays an area to which an external accessory (eg, a keyboard cover) is attached among the second display area (eg, the second display area 563 of FIG. 5 ) corresponding to the type of the external accessory. Can display a user interface (e.g. keyboard).

According to an embodiment, when the electronic device 501 detects the attachment and type of the external accessory attached to the second display area, the external accessory stored in a memory (eg, the memory 530 of FIG. 5 ) Based on the information of , size information and/or shape information of the external accessory may be checked.

According to an embodiment, the electronic device 501 displays the external accessory in a first area (eg, the first area 410 of FIGS. 4A to 4D ) to which the external accessory is attached among the second display area. A user interface corresponding to the type and/or form may be displayed.

According to an embodiment, the processor 520 selects a first area (eg, the first area 410 of FIGS. 4A to 4D ) to which the external accessory is attached among the second display area, based on the user's selection. ), another user interface corresponding to the type and/or shape of the external accessory may be displayed. For example, the electronic device 501 includes a keyboard cover for displaying a keyboard in a first area (eg, the first area 410 of FIGS. 4A to 4D ) to which the external accessories are attached among the second display areas. While displaying, the text of the keyboard may be changed based on the user's selection.

According to an embodiment, the electronic device 501 displays the external accessory in a first area (eg, the first area 410 of FIGS. 4A to 4D ) to which the external accessory is attached among the second display area. Touching a predetermined area of the user interface displayed on the first area to which the external accessory is attached among the second display area by pressing the predetermined area of the external accessory while displaying the user interface corresponding to the type and/or shape input can be detected. The electronic device 501 may perform a function corresponding to a predetermined area of the user interface according to the touch input.

According to an embodiment, the electronic device 501 may remove the display of the user interface on the second display area when the external accessory is removed from the second display area in a state in which the external accessory is attached. there is.

19A to 19B are diagrams 1900a to 1900b for explaining an operation of providing a screen area according to a location of an external accessory attached to a display in an electronic device according to various embodiments of the present disclosure. Operations of providing a screen area according to the location of an external accessory attached to the display may include operations 1901 to 1919. According to an embodiment, at least one of operations 1901 to 1919 may be omitted, the order of some operations may be changed, or another operation may be added. The operation of providing the screen area according to the position of the external accessory attached to the display is performed by the electronic device 101 of FIG. 1 , the processor 120 of FIG. 1 , the electronic device 501 of FIG. 5 , or the processor of FIG. 5 ( 520).

In operation 1901, the electronic device 501 displays a second display area (eg, FIG. 5) of a display (eg, the display 560 of FIG. 5) in a state in which the hinge (eg, FIG. 2A of the hinge is folded) of the electronic device. Attachment of an external accessory (eg, a keyboard cover) for displaying a user interface to the second display area 563 of the screen may be detected.

According to an embodiment, the electronic device 501 determines the second display area based on a pattern of capacitance detected by at least one conductive object included in the external accessory attached to the second display area. Attachment of the external accessory and the type of the external accessory may be detected.

In operation 1903, the electronic device 501 may detect an attached position of an external accessory (eg, a keyboard cover) in the second display area (eg, the second display area 563 of FIG. 5 ).

According to an embodiment, the electronic device 501 includes at least one included in the external accessory attached to the second display area that contacts any one Hall sensor among a plurality of Hall sensors disposed on the second display area. Based on one magnet, the location of the area to which the external accessory is attached in the second display area 563 may be determined.

According to an embodiment, the electronic device 501 includes at least one magnet (eg, magnets 613a and 613b of FIG. 7A and/or magnets 613b of FIGS. 8A to 8D) included in the external accessory. may include a plurality of Hall sensors (eg, the plurality of Hall sensors 811 of FIGS. 8A to 8D) capable of detecting, and at least one of the plurality of Hall sensors included in the external accessory A location of an area to which the external accessory is attached in the second display area may be determined based on a location where a hall sensor for detecting a magnetic field by a magnet is disposed.

According to an embodiment, the electronic device 501 may determine the position of the area to which the external accessory is attached among the second display areas based on Equation 1.

In operation 1905, the electronic device 501 may determine whether an external accessory (eg, a keyboard cover) is attached in a first state in the second display area (eg, the second display area 563 of FIG. 5 ). there is.

According to an embodiment, the electronic device 501 may include a first Hall sensor (eg, the first Hall sensor of FIG. 8A ) among a plurality of Hall sensors (eg, the plurality of Hall sensors 811 of FIGS. 8A to 8D ). When receiving detection signal information on the magnetic field from the Hall sensor 811a), a first state in which the external accessory is attached from a first position corresponding to the upper side of the second display area (eg, the first state in FIG. 4A) can be detected.

According to an embodiment, if the electronic device 501 satisfies the first condition based on <Equation 1>, the external accessory is attached from the first position corresponding to the upper side of the second display area. 1 state (eg, the first state of FIG. 4A) may be detected.

In operation 1905, when the electronic device 501 determines that an external accessory (eg, a keyboard cover) is attached in the first state in the second display area (eg, the second display area 563 of FIG. 5), In operation 1907, the electronic device 501 starts the first area (eg, FIG. 4A ) to which an external accessory (eg, a keyboard cover) is attached in the second display area (eg, the second display area 563 of FIG. 5 ). A function set in the first screen area, for example, a touch pad function, is determined as the first screen area (eg, the first screen area 411 of FIG. 4A ) except for the first area 410 of FIG. A GUI can be displayed to provide

In operation 1909, the electronic device 501 may determine whether an external accessory (eg, a keyboard cover) is attached in a second state in the second display area (eg, the second display area 563 of FIG. 5 ). there is.

According to an embodiment, the electronic device 501 may include a second Hall sensor (eg, the second Hall sensor of FIG. 8B ) among a plurality of Hall sensors (eg, the plurality of Hall sensors 811 of FIGS. 8A to 8D ). When the detection signal information on the magnetic field is received from the Hall sensor 811b, the second state (e.g. : the second state of FIG. 4B).

According to an embodiment, the electronic device 501 satisfies the second condition based on <Equation 1>, and the upper coordinate y value of the second display area SA(y) and the second display area The length between the upper coordinate y values (KA(y)) of the keyboard cover 310 attached to the area 563 is the second screen area in the second state (eg, the second screen area 413 in FIG. 4B) If it is equal to the vertical length, it is detected that the external accessory is attached from a second position (eg, the second state of FIG. 4B) from a second position that is a first distance away from the first position corresponding to the upper side of the second display area. can do.

In operation 1909, when the electronic device 501 determines that an external accessory (eg, a keyboard cover) is attached in a second state in the second display area (eg, the second display area 563 of FIG. 5), In operation 1911, the electronic device 501 starts the first area (eg, FIG. 4A ) to which an external accessory (eg, a keyboard cover) is attached in the second display area (eg, the second display area 563 of FIG. 5 ). The remaining two areas except for the first area 410 of the second screen area (eg, the second screen area 413 of FIG. 4B) and the third screen area (eg, the third screen area 415 of FIG. 4B) )), and a set function may be provided to each of the second screen area and the third screen area.

According to an embodiment, the electronic device 501 has a function set in the second screen area located above the first area to which the external accessories are attached, for example, a function key (eg, fn key) of a keyboard. , or function keys for performing an operation related to an application displayed on the first display area 561 may be displayed. The electronic device 501 may display a GUI capable of providing a set function, for example, a touch pad function, on the third screen area located below the first area to which the external accessory is attached. The electronic device 501, in the first state, displays a GUI capable of providing a touch pad function on the third screen area whose size is reduced from that of the first screen area displaying a GUI capable of providing a touch pad function. can For example, the electronic device 501, while displaying function keys of a keyboard on the second screen area, based on an up-down scrolling motion or input of a specific key detected on the second screen area, the second screen area. The type of function key displayed on the screen area can be changed and displayed.

In operation 1913, the electronic device 501 may determine whether an external accessory (eg, a keyboard cover) is attached in a third state in the second display area (eg, the second display area 563 of FIG. 5 ). there is.

According to an embodiment, the electronic device 501 may include a third Hall sensor (eg, the third Hall sensor of FIG. 8C ) among a plurality of Hall sensors (eg, the plurality of Hall sensors 811 of FIGS. 8A to 8D ). When sensing signal information about the magnetic field is received from the hall sensor 811c, the outer third position is separated by a second distance longer than the first distance in the second state from the first position corresponding to the upper side of the second display area. It is possible to detect that an accessory is attached (eg, the third state of FIG. 4C ).

According to an embodiment, the electronic device 501 satisfies the second condition based on <Equation 1>, and the upper coordinate y value of the second display area SA(y) and the second display area The length between the coordinates y value (KA(y)) of the top of the keyboard cover 310 attached to 563 is the length of the fourth screen area (eg, the third screen area 417 of FIG. 4C) in the third state. If it is equal to the length, the third position is separated from the first position corresponding to the upper side of the second display area 563 by a second distance greater than the first distance of the second state (eg, the second state of FIG. 4B ). From this, it is possible to detect that the external accessory is attached to the third state (eg, the third state of FIG. 4C).

In operation 1913, when the electronic device 501 determines that an external accessory (eg, a keyboard cover) is attached in the third state in the second display area (eg, the second display area 563 of FIG. 5), In operation 1915, the electronic device 501 starts the first area (eg, FIG. 4A ) to which an external accessory (eg, a keyboard cover) is attached in the second display area (eg, the second display area 563 of FIG. 5 ). The remaining two areas excluding the first area 410 of ) are the fourth screen area (eg, the fourth screen area 417 of FIG. 4C) and the fifth screen area (eg, the fifth screen area 419 of FIG. 4C). )), and a set function may be provided to each of the fourth screen area and the fifth screen area.

According to an embodiment, a function set on the fourth screen area located above the first area to which the electronic device 501 and the external accessories are attached, for example, a function key (eg, fn key) of a keyboard is displayed. At least one of a preview screen corresponding to a recently used application or a preview screen corresponding to a frequently used application may be displayed. The electronic device 501 may display a GUI capable of providing a set function, for example, a touch pad function, on the fifth screen area located below the first area to which the external accessory is attached. In the second state, the electronic device 501 displays a GUI capable of providing a touch pad function on the fifth screen area whose size is smaller than that of the third screen area displaying a GUI capable of providing a touch pad function in the second state. can For example, the electronic device 501, while displaying a function key of the keyboard and a preview screen on each of the two sub-areas of the fourth screen area, swipe out the sub-area displaying the function key. out) operation, the preview screen may be enlarged and displayed without displaying the function key on the fourth screen area.

In operation 1917, the electronic device 501 may determine whether an external accessory (eg, a keyboard cover) is attached in a fourth state in the second display area (eg, the second display area 563 of FIG. 5 ). there is.

According to an embodiment, the electronic device 501 may include a fourth Hall sensor (eg, the fourth Hall sensor of FIG. 8D ) among a plurality of Hall sensors (eg, the plurality of Hall sensors 811 of FIGS. 8A to 8D ). When sensing signal information on the magnetic field is received from the hall sensor 811d, the fourth position is separated by a third distance longer than the second distance in the third state from the first position corresponding to the upper side of the second display area. 2 It is possible to detect that the external accessory is attached (eg, the fourth state of FIG. 4D) up to a fifth position corresponding to the lower side of the display area.

According to an embodiment, if the electronic device 501 satisfies the third condition based on Equation 1, the second distance in the third state from the first position corresponding to the upper side of the second display area. It may be detected that the external accessory is attached (eg, the fourth state of FIG. 4D ) from a fourth position at which the third distance is longer to a fifth position corresponding to the lower side of the second display area.

In operation 1917, when the electronic device 501 determines that an external accessory (eg, a keyboard cover) is attached in the fourth state in the second display area (eg, the second display area 563 of FIG. 5), In operation 1919, the electronic device 501 starts the first area (eg, FIG. 4A ) to which an external accessory (eg, a keyboard cover) is attached in the second display area (eg, the second display area 563 of FIG. 5 ). An area other than the first area 410 of ) may be set as a sixth screen area (eg, the sixth screen area 421 of FIG. 4D ), and functions set in the sixth screen area may be provided.

According to an embodiment, the electronic device 501 includes a function set in the sixth screen area located above the first area to which the external accessory is attached, for example, a preview screen corresponding to a recently used application; At least one of a preview screen corresponding to a frequently used application or a function window related to an application currently being displayed in the first display area (eg, the first display area 561 of FIG. 5 ) may be displayed.

According to an embodiment, while displaying a plurality of preview screens on each of a plurality of sub-regions included in the sixth screen area, the electronic device 501 operates in any one of the plurality of sub-regions. When an up and down scroll operation is detected, other preview screens that are not displayed in the sub area where the up and down scroll operation is detected may be sequentially displayed corresponding to the up and down scroll operation.

According to an embodiment, when the electronic device 501 detects a downward drag operation at the boundary between the first display area and the second display area in the fourth state, the image screen displayed on the first display area may be displayed by extending to the sixth screen area of the second display area. The electronic device 501, while displaying the image screen including the sixth screen area of the first display area and the second display area, displays the external accessory in the image screen and the second display area. When a long touch is detected at the boundary of the first area displaying the corresponding user interface (eg, keyboard), the image screen may be displayed on the entire first display area and the second display area. The electronic device 501 adjusts the transparency of the first area of the second display area to display a user interface (eg, keyboard) displayed on the first area, thereby displaying a part of the image screen and the user interface (eg, a keyboard). : keyboard) can be overlapped.

According to various embodiments, a method for detecting attachment of an external accessory for displaying a user interface in an electronic device may include connecting one side of a first housing of the electronic device to one side of a second housing of the electronic device in a foldable manner. An operation of detecting attachment of an external accessory for displaying a user interface in a second display area disposed on the second housing in a state in which the hinge is folded, and the external accessory is attached to the area of the second display area An operation of displaying a user interface corresponding to the type of external accessory may be included.

According to various embodiments, based on a capacitance pattern detected by at least one conductive object included in the external accessory attached to the second display area, attaching the external accessory to the second display area and the An operation of detecting the type of external accessory may be further included.

According to various embodiments, based on a plurality of hall sensors disposed on the second display and at least one magnet included in the external accessory, determining a position where the external accessory is attached in the second display area may further include.

According to various embodiments, when the type of the external accessory attached to the second display area is detected, an operation of checking size and shape information of the accessory corresponding to the type of the accessory, and the identified size and shape of the accessory The method may further include displaying a user interface corresponding to the shape information on an area of the second display area to which the external accessory is attached.

According to various embodiments, when a touch input is detected on a predetermined area of the user interface displayed on the area to which the external accessory is attached among the second display area due to pressing of the predetermined area of the external accessory attached to the second display area , It may further include an operation of performing a function corresponding to a predetermined area of the user interface.

According to various embodiments, determining at least one remaining area excluding the area to which the external accessory is attached in the second display area as at least one screen area according to the attached position of the external accessory in the second display area An operation of providing a function set to each of the at least one screen area may be further included.

According to various embodiments, in the first state of detecting the attachment of the external accessory from the first position corresponding to the upper side of the second display area, the second display area excluding the first area to which the external accessory is attached An operation of determining the remaining area as the first screen area and an operation of providing a function set in the first screen area may be further included.

According to various embodiments, in a second state of detecting the attachment of the external accessory from a second location that is a first distance away from the first location corresponding to the upper side of the second display area, the external An operation of determining the remaining two areas except for the first area to which accessories are attached as a second screen area and a third screen area, and an operation of providing a set function to each of the second screen area and the third screen area are further performed. The second screen area may be located above the first area to which the external accessory is attached, and the third screen area may be located below the first area to which the external accessory is attached.

According to various embodiments, in a third state of detecting the attachment of the external accessory from a third position separated by a second distance longer than the first distance of the second state from the first position corresponding to the upper side of the second display area. , determining the remaining two areas of the second display area, excluding the area to which the external accessories are attached, as a fourth screen area and a fifth screen area, and a function set in each of the fourth screen area and the fifth screen area. The fourth screen area is located above the first area to which the external accessories are attached and includes an area larger than the second screen area in a second state, and the fifth screen area may include an area located below the first area to which the external accessory is attached and having a smaller size than the third screen area in the second state.

According to various embodiments of the present disclosure, from a fourth position at which a third distance longer than the second distance in the third state is separated from the first position corresponding to the upper side of the second display area to the lower side of the second display area, the external accessory In a fourth state of detecting attachment, an operation of determining an area other than the first area to which the external accessory is attached as a sixth screen area in the second display area, and providing a function set in the sixth screen area More actions may be included.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 436 or external memory 438) readable by a machine (eg, electronic device 401). It may be implemented as software (eg, the program 440) including them. For example, a processor (eg, the processor 420) of a device (eg, the electronic device 401) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

Claims (20)

In electronic devices,
a first housing;
a second housing;
a hinge connecting one side of the first housing to one side of the second housing in a foldable manner;
a display including a first display area disposed in the first housing and a second display area disposed in the second housing; and
It includes a processor, the processor comprising:
When the attachment of an external accessory for displaying a user interface is detected in the second display area while the hinge is folded, a region to which the external accessory is attached corresponds to the type of the external accessory in the second display area. An electronic device set to display a user interface.
The method of claim 1, wherein the processor,
Attachment of the external accessory to the second display area and detection of the type of the external accessory based on a pattern of capacitance detected by at least one conductive object included in the external accessory attached to the second display area. An electronic device set up to do so.
The method of claim 1, wherein the processor,
An electronic device configured to determine an attached position of the external accessory in the second display area based on a plurality of hall sensors disposed on the second display and at least one magnet included in the external accessory.
The method of claim 1, wherein the processor,
When the type of the external accessory attached to the second display area is detected, size and shape information of the accessory corresponding to the type of accessory is checked, and a user interface corresponding to the identified size and shape information of the accessory is displayed. An electronic device set to be displayed on an area of the second display area to which the external accessory is attached.
The method of claim 1, wherein the processor,
When a touch input is detected on a predetermined area of the user interface displayed on the area to which the external accessory is attached among the second display area due to pressing of the predetermined area of the external accessory attached to the second display area, the predetermined area of the user interface is detected. An electronic device configured to perform a function corresponding to an area.
The method of claim 1, wherein the processor,
At least one remaining area of the second display area excluding the area to which the external accessory is attached is determined as at least one screen area according to the attached position of the external accessory in the second display area, and the at least one screen area is determined. Electronic devices set up to provide a set function for each.
The method of claim 6, wherein the processor,
In the first state of detecting the attachment of the external accessory from the first position corresponding to the upper side of the second display area, the remaining area except for the first area to which the external accessory is attached is displayed as the first screen. An electronic device determined as an area and configured to provide a function set in the first screen area.
The method of claim 6, wherein the processor,
In a second state of detecting the attachment of the external accessory from a second location that is a first distance away from the first location corresponding to the upper side of the second display area, the first location where the external accessory is attached in the second display area determining the remaining two areas excluding the area as a second screen area and a third screen area, and providing a set function to each of the second screen area and the third screen area;
The electronic device of claim 1 , wherein the second screen area is positioned above the first area to which the external accessory is attached, and the third screen area is positioned below the first area to which the external accessory is attached.
The method of claim 6, wherein the processor,
In a third state in which the attachment of the external accessory is detected from a third position separated by a second distance greater than the first distance in the second state from the first position corresponding to the upper side of the second display area, the second display area determines the remaining two areas excluding the area to which the external accessory is attached as a fourth screen area and a fifth screen area, and provides a set function to each of the fourth screen area and the fifth screen area;
The fourth screen area is located above the first area to which the external accessory is attached and includes an area larger than the second screen area in a second state, and the fifth screen area is the first area to which the external accessory is attached. An electronic device set to include an area located below the area and having a size smaller than that of the third screen area in the second state.
The method of claim 6, wherein the processor,
A fourth method for detecting the attachment of the external accessory from a fourth location at which a third distance is longer than the second distance in the third state from the first location corresponding to the upper side of the second display area to the lower side of the second display area. In the state, the electronic device configured to determine a remaining area of the second display area excluding the first area to which the external accessory is attached as a sixth screen area, and to provide a function set in the sixth screen area.

A method for detecting attachment of an external accessory for displaying a user interface in an electronic device,
Displaying a user interface in a second display area disposed on the second housing in a folded state of a hinge connecting one side of the first housing of the electronic device to one side of the second housing of the electronic device in a folded state. detecting attachment of an external accessory; and
and displaying a user interface corresponding to the type of the external accessory on an area of the second display area to which the external accessory is attached.
According to claim 11,
Attachment of the external accessory to the second display area and detection of the type of the external accessory based on a pattern of capacitance detected by at least one conductive object included in the external accessory attached to the second display area. A method that includes more actions to do.
According to claim 11,
The method further comprising determining a position where the external accessory is attached in the second display area based on a plurality of hall sensors disposed on the second display and at least one magnet included in the external accessory.
According to claim 11,
checking size and shape information of the accessory corresponding to the type of the accessory when the type of the external accessory attached to the second display area is detected; and
and displaying a user interface corresponding to the size and shape information of the identified accessory on an area of the second display area to which the external accessory is attached.
According to claim 11,
When a touch input is detected on a predetermined area of the user interface displayed on the area to which the external accessory is attached among the second display area due to pressing of the predetermined area of the external accessory attached to the second display area, the predetermined area of the user interface is detected. The method further comprising an operation of performing a function corresponding to the region.
According to claim 11,
determining at least one remaining area of the second display area excluding the area to which the external accessory is attached as at least one screen area according to the attached position of the external accessory in the second display area; and
The method further comprising an operation of providing a set function to each of the at least one screen area.
According to claim 16,
In the first state of detecting the attachment of the external accessory from the first position corresponding to the upper side of the second display area, the remaining area except for the first area to which the external accessory is attached is displayed as the first screen. an operation to determine as an area; and
The method further comprising an operation of providing a function set in the first screen area.
17. The method of claim 16,
In a second state of detecting the attachment of the external accessory from a second location that is a first distance away from the first location corresponding to the upper side of the second display area, the first location where the external accessory is attached in the second display area determining the remaining two areas excluding the area as a second screen area and a third screen area; and
An operation of providing a set function to each of the second screen area and the third screen area;
The second screen area is located above the first area to which the external accessory is attached, and the third screen area is located below the first area to which the external accessory is attached.
According to claim 16,
In a third state in which the attachment of the external accessory is detected from a third position separated by a second distance greater than the first distance in the second state from the first position corresponding to the upper side of the second display area, the second display area determining the remaining two areas except for the area to which the external accessory is attached as a fourth screen area and a fifth screen area; and
An operation of providing a set function to each of the fourth screen area and the fifth screen area;
The fourth screen area is located above the first area to which the external accessory is attached and includes an area larger than the second screen area in a second state, and the fifth screen area is the first area to which the external accessory is attached. A method of including an area located below the area and having a size smaller than that of the third screen area in the second state.
According to claim 16,
A fourth method for detecting the attachment of the external accessory from a fourth location at which a third distance is longer than the second distance in the third state from the first location corresponding to the upper side of the second display area to the lower side of the second display area. in the second display area, determining an area other than the first area to which the external accessory is attached as a sixth screen area; and
The method further comprising an operation of providing a set function to the sixth screen area.

Images