KR20220064162A - An electronic device including a stretchable display - Google Patents

Abstract

Disclosed is an electronic device comprising: a stretchable display provided over a front surface and a side surface of the electronic device; at least one actuator provided on the side surface of the electronic device; and a processor operatively connected to the stretchable display and the at least one actuator. The processor may control the at least one actuator to form a function key by protruding at least one side area provided on the side surface of the electronic device among areas of the stretchable display, and display a visual object corresponding to information related to the function key through a front area provided on the front surface of the electronic device among the areas of the stretchable display. Accordingly, the electronic device can increase an affordance of input by a user and improve usability of soft keys of the electronic device.

Description

ELECTRONIC DEVICE INCLUDING A STRETCHABLE DISPLAY

Various embodiments disclosed herein relate to an electronic device including a stretchable display, and to generation of a responsive key using an actuator.

A display is a device for displaying content, and recently, a flexible display that can be bent, foldable, bendable, rollable, or stretchable has variability and can be deformed into various shapes. is attracting attention. The electronic device may include a display, and may perform a function corresponding to the touch input in response to acquisition of a touch input for a soft key displayed through the display.

The electronic device may obtain a touch input for a soft key displayed through the display. However, it may be difficult for the electronic device to perform a corresponding function through a touch input for a soft key in a state in which the screen of the display is turned off.

The electronic device may include a hard key, and may perform a corresponding function in response to obtaining a button input for pressing the hard key. Accordingly, the user can intuitively use the corresponding function through an input of pressing a hard key included in the electronic device. However, an electronic device including a soft key may sense a user's input by using a sensor, and may lack affordance for allowing the user to touch the soft key, thereby reducing usability of the electronic device.

Various embodiments disclosed in this document may provide an apparatus and method for increasing usability of an electronic device by giving affordance to a soft key displayed through a variable display.

An electronic device according to an embodiment disclosed in this document includes a flexible display disposed across the front and side surfaces of the electronic device, at least one actuator disposed on a side surface of the electronic device, the flexible display, and the at least one It may include a processor operatively coupled to the actuator. The processor controls the at least one actuator so that at least one side area disposed on the side surface of the electronic device protrudes to form a function key among the area of the flexible display, and the front surface of the electronic device among the area of the flexible display A visual object corresponding to information related to the function key may be displayed through the front area disposed on the .

According to various embodiments disclosed in this document, the electronic device may protrude a portion of the variable display through the actuator to increase affordance for the user to input, thereby improving the usability of the soft key of the electronic device. can do.

In addition, various effects directly or indirectly identified through this document may be provided.

1 is a block diagram of an electronic device in a network environment according to an embodiment.
2 is a block diagram of an electronic device according to an embodiment.
3 is a flowchart illustrating an operation of generating a function key by an electronic device according to an exemplary embodiment.
4 illustrates a function key generated in a state in which a screen of a display of an electronic device is turned off, according to an exemplary embodiment.
5 is a flowchart illustrating an operation of generating a function key according to whether an electronic device is in a gripped state, according to an exemplary embodiment.
6A illustrates a function key generated when an electronic device executes a single application, according to an exemplary embodiment.
6B illustrates a function key generated when the electronic device executes a single application, according to an exemplary embodiment.
7 is a flowchart illustrating an operation of generating a function key according to the number of applications executed by an electronic device according to an exemplary embodiment.
8 illustrates a function key generated in a state in which an electronic device executes a plurality of applications, according to an exemplary embodiment.
9 illustrates a function key generated by mapping a function frequently used by a user, according to an exemplary embodiment.
10A illustrates an example in which an electronic device switches a function of a function key, according to an exemplary embodiment.
10B illustrates an example in which an electronic device switches a function of a function key, according to an embodiment.
11A illustrates an example of controlling a function of a function key according to a swipe input to the function key according to an exemplary embodiment.
11B illustrates an example of controlling a function of a function key according to a swipe input for the function key, according to an exemplary embodiment.
11C illustrates an example of controlling a function of a function key according to a swipe input to the function key according to an exemplary embodiment.
12 illustrates an example of controlling the size and function of a function key according to a user input to the function key, according to an embodiment.
13A illustrates an example of a function of a function key mapped according to a type of a user input to the function key according to an exemplary embodiment.
13B illustrates an example of a function of a function key mapped according to a type of a user input to the function key according to an exemplary embodiment.
14 illustrates an example of controlling the size and function of a function key according to a push input to the function key, according to an embodiment.
15 illustrates an example of controlling the position and function of a function key according to a push input to the function key according to an exemplary embodiment.
16 illustrates an example of a function key for a fingerprint recognition function of an electronic device according to an embodiment.
17 illustrates a user interface for controlling the height of a function key according to an embodiment.
18 illustrates an example of displaying a visual object corresponding to a function key according to an embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments will be described with reference to the accompanying drawings. However, this is not intended to limit the specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments are included.

1 is a block diagram of an electronic device 101 in a network environment 100 according to an embodiment.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a block diagram of an electronic device 101 according to an embodiment.

Referring to FIG. 2 , the electronic device 101 may include a processor 201 , a display 203 , an actuator 205 , and a sensor 207 . Components included in the electronic device 101 may not be limited to the components shown in FIG. 2 (eg, the processor 201 , the display 203 , the actuator 205 , and the sensor 207 ). Components of the electronic device 101 illustrated in FIG. 2 may be replaced with other components, or additional components may be added to the electronic device 101 . For example, at least a portion of the contents of the electronic device 101 of FIG. 1 may be applied to the electronic device 101 of FIG. 2 .

The processor 201 may execute instructions stored in the memory to control operations of components of the electronic device 101 (eg, the display 203 , the actuator 205 , and the sensor 207 ). The processor 201 may be electrically and/or operatively coupled to the display 203 , the actuator 205 , and the sensor 207 . The processor 201 may execute software to control at least one other component (eg, the display 203 , the actuator 205 , and the sensor 207 ) connected to the processor 201 . The processor 201 may obtain a command from components included in the electronic device 101 , interpret the obtained command, and process and/or operate various data according to the interpreted command. there is.

The display 203 may visually display (provide or output) content. For example, the display 203 may visually display the displayed video content in response to the execution of the multimedia application. The display 203 may include a variable display with flexibility that is flexible, foldable, bendable, rollable, or stretchable. For example, the display 203 may include a flexible display, a foldable display, or a stretchable display. As another example, the flexible display may include a stretchable display. The display 203 may include at least one sensor. For example, the display 203 may include a touch sensor or a pressure sensor.

The actuator 205 may be a driving device that drives the mechanism using power (eg, electricity). The actuator 205 may include a soft actuator and a hardware actuator. The soft actuator may be a driving device made of an elastic polymer material to drive the mechanism. The hardware actuator may be a driving device made of an inelastic material such as metal to drive a mechanism. The actuator 205 may be disposed below the surface of the display 203 . The electronic device 101 may protrude the surface of the display 203 through the actuator 205 .

The sensor 207 may include at least one sensor. For example, the sensor 207 may include a touch sensor or a pressure sensor. The sensor 207 may acquire at least one of a touch input using the user's body or a touch input through an electronic pen by using at least one of a touch sensor and a pressure sensor.

3 is a flowchart illustrating an operation of generating a function key by the electronic device 101 according to an exemplary embodiment.

A series of operations described below may be simultaneously performed or changed by the electronic device 101, and some operations may be omitted or added.

Referring to FIG. 3 , the electronic device 101 determines the function and location of the function key to be generated, generates the function key, and displays a visual object corresponding to information related to the generated function key on the front area of the display 203 . can be displayed through

In operation 301 , the electronic device 101 may determine a function of a function key to be generated. The electronic device 101 displays at least one of a type of an application being executed in the electronic device 101, an operation state of the electronic device 101 (eg, an application execution state, a screen on/off state), and a user's preference for a function key. Based on the , it is possible to determine the function of the function key to be generated. For example, the electronic device 101 may determine the function of the function key to be generated as the volume control function while the multimedia application is being executed. As another example, the electronic device 101 may determine the function of the function key to be generated as a volume control function or a power function when the display 203 is in a screen-off state. As another example, the electronic device 101 may determine the function of the function key to be generated based on the user's setting.

In operation 303, the electronic device 101 may determine a location of a function key to be generated. The electronic device 101 may determine a position where the function key is to be generated among the side area of the display 203 . The electronic device 101 may determine a position where the function key is formed based on at least one of a holding state and a holding state.

According to an embodiment, the electronic device 101 determines a holding state corresponding to a position where a body (eg, a finger) is in contact with at least a part of one surface of the electronic device 101 detected by the sensor 207 . can The electronic device 101 may determine a position where the function key is formed based on the determined holding state. For example, the electronic device 101 may determine, among the side surfaces of the electronic device 101 , an area touched by a finger or an area surrounding the touched area as a position where the function key is formed.

According to an embodiment, the electronic device 101 may determine a mounting state corresponding to a position in which the ground is in contact with at least a part of one surface of the electronic device 101 detected through the sensor 207 . The electronic device 101 may determine a position where the function key is formed based on the determined mounting state. For example, the electronic device 101 may determine some of the side surfaces of the electronic device 101 that are not in contact with the ground as the position where the function key is formed.

In operation 305, the electronic device 101 may generate a function key. The electronic device 101 may generate the determined function and a function key corresponding to the determined position by protruding a part of the side area of the display 203 . The electronic device 101 may control the actuator 205 so that at least one side area disposed on the side surface of the electronic device 101 among the display area 203 protrudes to form a function key.

In operation 307, the electronic device 101 may display a visual object corresponding to information related to a function key. The electronic device 101 may display a visual object corresponding to information related to the formed (or generated) function key through a front area disposed on the front area of the electronic device 101 among areas of the display 203 . . For example, the electronic device 101 may display a camera icon corresponding to a function key performing a photographing function through the front area of the display 203 . As another example, the electronic device 101 may display a volume control bar corresponding to a function key performing a volume control function through the front area of the formed function key.

In operation 309, the electronic device 101 may perform a function of the generated function key. The electronic device 101 may perform a function of the function key in response to obtaining a user input for the generated function key. The user input may include at least one of a touch input, a push input, and a swipe input. For example, in a state in which the camera application is executed, the electronic device 101 may perform a camera photographing function in response to obtaining a push input for one surface of the generated function key. As another example, the electronic device 101 may perform a volume control function in response to obtaining a swipe input for one surface of the generated function key while the multimedia application is running.

4 illustrates a function key generated when the screen of the display 203 of the electronic device 101 is turned off, according to an exemplary embodiment.

Referring to FIG. 4 , the electronic device 101 may generate a function key while the screen of the display 203 is turned off. The electronic device 101 may generate a plurality of function keys (eg, 411a, 412a, 411c, 412c). In a state in which the screen of the display 203 is turned off, the electronic device 101 may generate a function key for performing a volume function and a function key for performing a power function.

4A illustrates a state in which the electronic device 101 is gripped by the user's left hand 401 . 4B shows a visual object 412b corresponding to a function key performing a power function on the side area 203-2 of the display 203 corresponding to the side surface of the electronic device 101 and a volume function are performed. shows a visual object 411b corresponding to the function key to 4C illustrates a state in which the electronic device 101 is gripped by the user's right hand 402 .

Referring to FIG. 4A , in the electronic device 101 , in a state in which the screen of the display 203 is turned off and is gripped by the user's left hand 401 , the volume is displayed on the side area of the display 203 . A function key 411a performing a function and a function key 412a performing a power function may be generated. Although not shown in FIG. 4A , the electronic device 101 provides a visual object and a power function corresponding to the function key 411a performing a volume function through the front area 203 - 1 of the display 203 . A visual object corresponding to the performing function key 412a may be displayed.

Referring to FIG. 4B , in the electronic device 101, in a state in which the screen of the display 203 is turned off and is held by the user's hand (eg, the left hand 401 and the right hand 402), the display ( A visual object 411b corresponding to a function key performing a volume function and a visual object 412b corresponding to a function key performing a power function may be displayed on the side area 203 - 2 of 203 . The electronic device 101 may display a visual object 411b (eg, a volume button display) of a function key performing a volume function through the side area 203 - 2 of the display 203 . The electronic device 101 may display a visual object 412b (eg, a power button display) corresponding to a function key performing a power function through the side area 203 - 2 of the display 203 .

Referring to FIG. 4C , the electronic device 101 performs a volume function on the side area of the display 203 with the screen of the display 203 turned off and gripped by the user's right hand 402 . A function key 411c for performing a function key 411c and a function key 412c for performing a power function may be generated. Although not shown in FIG. 4C , the electronic device 101 provides a visual object corresponding to the function key 411c performing a volume function and a power function through the front area 203 - 1 of the display 203 . A visual object corresponding to the performing function key 412c may be displayed.

5 is a flowchart illustrating an operation of generating a function key according to whether the electronic device 101 is in a grip state, according to an exemplary embodiment.

A series of operations described below may be simultaneously performed or changed by the electronic device 101, and some operations may be omitted or added. Hereinafter, it is assumed that the electronic device 101 displays the screen of the application executed through the display 203 .

In operation 501, the electronic device 101 may execute an application and may identify the type of the executed application. For example, the electronic device 101 may execute a multimedia application or a camera application, and may identify the type of the executed application.

According to an embodiment, the electronic device 101 may classify the task of the executed application for each unit. For example, when a camera application is executed, the electronic device 101 may classify tasks before, during, and after photographing through the camera application.

In operation 503, the electronic device 101 may determine a function of a function key to be generated. Operation 503 of FIG. 5 may correspond to operation 301 of FIG. 3 . The electronic device 101 may determine the function of the function key to be generated according to the type of the executed application. For example, in a state in which the multimedia application is executed, the electronic device 101 may determine the function of the function key to be generated as the volume control function. As another example, in a state in which the camera application is executed, the electronic device 101 may determine a function of a function key to be generated as a photographing function.

According to an embodiment, the function of the function key to be generated according to the type of the application may be determined manually by a user input or automatically by a database. For example, the electronic device 101 may map the type of the manually or automatically executed application and the function of the function key to be generated. For example, the electronic device 101 may map the function of the function key to the type of the application by acquiring a user input that maps the function of the function key to the type of the application. As another example, the electronic device 101 may map the function key and the type of the application based on the type of the executed application and the number of times the function key used by the user in the executed application is used. .

In operation 505 , the electronic device 101 may determine whether the electronic device 101 is in a holding state. The electronic device 101 may determine whether the electronic device 101 is held by the user through the sensor 207 (eg, a touch sensor or a pressure sensor).

According to an embodiment, when the electronic device 101 is in the holding state, the electronic device 101 may perform operation 509 , and when the electronic device 101 is not in the holding state, the electronic device 101 operates 507 can be performed.

In operation 507 , the electronic device 101 may identify one surface of the electronic device 101 that touches the floor. For example, the electronic device 101 may identify the right side of the electronic device 101 as the surface touching the floor based on the sensor 207 when the front of the electronic device 101 is viewed from the front. can The electronic device 101 may determine a portion of the surfaces of the electronic device 101 except for the surface that touches the floor as the location of the function key to be generated.

In operation 509 , through the sensor 207 , the electronic device 101 contacts the user's body (eg, a finger) on one of the side areas corresponding to the side of the electronic device 101 among the areas of the display 203 . can detect The electronic device 101 may determine an area touched by the user's body or an area within a predetermined radius from the contacted area as the location of the function key to be generated.

In operation 511, the electronic device 101 may generate a function key corresponding to the determined function and location. The electronic device 101 may generate a function key corresponding to the determined function and location in the side area of the display 203 . The electronic device 101 may control the actuator 205 so that the side area of the display 203 protrudes to form a function key corresponding to the determined function and position.

In operation 513 , the electronic device 101 may display a visual object corresponding to information related to a function key. Operation 513 of FIG. 5 may correspond to operation 307 of FIG. 3 . The visual object may mean a user interface or an icon.

6A and 6B illustrate function keys generated when an electronic device executes a single application, according to an exemplary embodiment.

6A and 6B , in a state in which a single application is executed, the electronic device 101 may protrude a side area of the display 203 to generate a function key mapped to the executed application.

6A (a) illustrates a state in which the electronic device 101 is mounted on the ground, and a function key is generated. The electronic device 101 may detect one surface of the electronic device 101 that touches the ground through the sensor 207 . The electronic device 101 may generate a function key on some of the surfaces other than the surface in contact with the ground.

According to an embodiment, in a state in which the electronic device 101 executes an application, the electronic device 101 may detect a surface that touches the floor among one surface of the electronic device 101 through the sensor 207, A function key capable of performing a function mapped to the executed application may be generated in one area of one surface of the surfaces other than the detected surface. For example, in a state in which the electronic device 101 executes the multimedia application, the electronic device 101 may detect a surface touching the floor through the sensor 207, and one surface of the surfaces other than the detected surface A function key 611a capable of performing a volume function mapped to the executed multimedia application may be generated in an area of .

According to an embodiment, the electronic device 101 performs a function on one of the front areas 203 - 1 of the display 203 in response to the generation of the function key 611a or simultaneously with the generation of the function key 611a. A UI 611a - 1 related to the function of the key 611a may be displayed. Although not shown in (a) of FIG. 6A , the electronic device 101 may display the UI 611a - 1 through the front area of the function key 611a. The front area of the function key 611a may extend from the front area 203 - 1 of the display 203 and may mean a newly formed area according to the generation of the function key 611a.

According to an embodiment, the electronic device 101 may display the UI 611a - 1 through the front area 203 - 1 of the display 203 or the front area of the function key 611a for N seconds. When the electronic device 101 does not detect an additional user input within a predetermined time (eg, N seconds) of displaying the UI 611a - 1 , the display of the UI 611a - 1 may be removed.

6A (b) shows a state in which the electronic device 101 is gripped by the user's left hand 401 or right hand 402 and a function key 613b generated in the side area 203 - 2 of the display 203 . show The electronic device 101 may detect an area in contact with the user's body (eg, a finger) among one surface of the electronic device 101 through the sensor 207 . The electronic device 101 may generate a function key in the area touched by the body or in an area located within a predetermined distance from the body contact area. For example, the electronic device 101 may detect that a user's finger is detected in an upper portion of a left side area of the electronic device 101 or an upper portion of a right side area of the electronic device 101, and the detected You can create a function key on the part.

According to an embodiment, in a state in which the application is executed, the electronic device 101 applies a function key for performing a function mapped to the executed application at a point where the user's body is in contact with one surface of the electronic device 101 . can create For example, in a state in which the multimedia application is executed, the electronic device 101 applies a volume function mapped to the multimedia application to a point where the thumb is in contact with the user's left hand 401 among one surface of the electronic device 101 . An executable function key 611b may be generated. For another example, the electronic device 101 executes the multimedia application and has a volume function mapped to the multimedia application at a point where the thumb is in contact with the user's right hand 402 on one side of the electronic device 101 . It is possible to generate a function key 612b capable of performing .

According to an embodiment, the electronic device 101 displays a visual object 611b - 1 corresponding to the generated function key 611b in a partial area of the front area 203 - 1 of the display 203 and the function key 611b ), or on one of the areas spanning the front area 203 - 1 and the front area of the function key 611b.

According to an embodiment, the electronic device 101 displays a visual object 612b - 1 corresponding to the generated function key 612b in a partial area of the front area 203 - 1 of the display 203 and the function key 612b ), or on one of the areas spanning the front area 203 - 1 and the front area of the function key 612b.

According to an embodiment, the electronic device 101 displays the UI613b corresponding to the function key for performing the generated volume function on the side area 203-2 of the display 203 in a state in which the multimedia application is executed. can

6B (a) and (b) show that the electronic device 101 is gripped by the user's left hand 401 and right hand 402, respectively, and in a state in which an application is executed, function keys mapped to the executed application are displayed. It shows a state generated at one of the points touched by the user's finger.

Referring to (a) of FIG. 6B , the electronic device 101 is gripped by the user's left hand 401, and in a state in which the camera application is executed, a function capable of performing a photographing function mapped to the executed camera application A key may be generated on a portion of the side of the electronic device 101 in contact with the index finger. The electronic device 101 may display the visual object 621a - 1 corresponding to the function key 621a for performing a photographing function on the side area 203 - 2 of the display 203 . Although not shown in (a) of FIG. 6B , the electronic device 101 may display the visual object 621a - 1 on the front area 203 - 1 of the display 203 .

Referring to (b) of FIG. 6B , in a state in which the electronic device 101 is gripped by the user's right hand 402 , the function key 621b mapped to the camera application is pressed by the user's index finger among the side surfaces of the electronic device 101 . It may be created on a part touched by a finger, and a visual object 621b - 1 corresponding to the function key 621b may be displayed on the side area 203 - 2 of the display 203 . The electronic device 101 may display the visual object 621b - 1 in the area where the function key 621b is generated and protrudes among the side area 203 - 2 of the display 203 .

7 is a flowchart illustrating an operation of generating a function key according to the number of applications executed by the electronic device 101 according to an exemplary embodiment.

A series of operations described below may be simultaneously performed or changed by the electronic device 101, and some operations may be omitted or added.

In operation 701, the electronic device 101 may determine whether a plurality of applications are being executed. For example, the electronic device 101 may identify whether the multimedia application corresponding to the first application and the second application corresponding to the second application are being executed. According to an embodiment, when the electronic device 101 is executing a plurality of applications, the electronic device 101 may perform operation 703, and when the electronic device 101 executes a single application, the electronic device Step 101 may perform operation 501 .

In operation 703 , when executing a plurality of applications, the electronic device 101 may display a plurality of screens corresponding to the plurality of applications through the display 203 . For example, when executing two applications, the electronic device 101 may display a first screen of the first application and a second screen of the second application through the display 203 . For example, the electronic device 101 may execute a multimedia application and a camera application, and may display a screen corresponding to the multimedia application and a screen corresponding to the camera application through the display 203 . For example, referring to (a) of FIG. 8A , the electronic device 101 may divide the area of the display 203 into a first area 801 and a second area 802, and the first area ( A screen corresponding to the YouTube application may be displayed in 801 , and a screen corresponding to the camera application may be displayed in the second area 802 . For another example, referring to (b) of FIG. 8A , the electronic device 101 displays a screen corresponding to a navigation application on the first area 801 of the display 203, and displays a screen corresponding to a music application. It may be displayed on the second area 802 of the display 203 . Although the above-described examples describe an example in which a screen corresponding to two applications is displayed by dividing an area of the display 203 into two areas, the number of divided areas is not limited to the above-described examples.

In operation 705 , the electronic device 101 may determine functions of a plurality of function keys to be generated in response to a plurality of applications displayed through a plurality of areas of the display 203 . For example, the electronic device 101 corresponds to a function of a first function key to be generated in response to a first application displayed on one area of the display 203 and a second application displayed on one area of the display 203 . to determine the function of the second function key to be generated. For example, referring to (a) of FIG. 8A , the electronic device 101 adjusts the volume of the function of the function key 811 to be generated in response to the YouTube application displayed on the first area 801 of the display 203 . It may be determined as a function, and a function of the second function key 812 to be generated in response to a camera application displayed on the second area 802 of the display 203 may be determined as a photographing function. As another example, referring to (b) of FIG. 8A , the electronic device 101 determines the function of the function key 821 to be generated in response to the navigation application displayed on the first area 801 of the display 203 . It may be determined as a home button function, and a function of the function key 822 to be generated in response to a music application displayed on the second area 802 of the display 203 may be determined as a volume function.

In operation 707 , the electronic device 101 may determine whether the electronic device 101 is in a holding state. The electronic device 101 may identify whether the electronic device 101 is in a gripping state through the sensor 207 . For example, the electronic device 101 may identify whether the user's body is in contact with at least a part of one surface of the electronic device 101 through the sensor 207 . According to an embodiment, when the electronic device 101 is in the holding state, the electronic device 101 may perform operation 711 , and when the electronic device 101 is not in the holding state, the electronic device 101 operates 709 may be performed. When the electronic device 101 is not in a gripping state, it may mean a state in which the electronic device 101 is mounted on the floor (or the ground).

In operation 709 , the electronic device 101 may identify one surface of the electronic device 101 that touches the floor. The electronic device 101 may identify one surface of the electronic device 101 that touches the floor through the sensor 207 (eg, a pressure sensor). For example, the electronic device 101 may identify the side of the electronic device 101 as a surface in contact with the floor through the sensor 207 (eg, a pressure sensor).

According to an embodiment, the mounting shape of the electronic device 101 is a first shape in which the longest side of the side surfaces of the electronic device 101 is perpendicular to the ground, or the length of the side surfaces of the electronic device 101 . It can be identified whether the second shape is a shape in which the long side is parallel to the ground. The first shape may be understood as a shape in which the electronic device 101 is disposed in a portrait, and the second shape may be understood as a shape in which the electronic device 101 is disposed in a landscape.

According to an embodiment, the electronic device 101 may determine a location where the function key is to be generated, based on the mounting shape. The electronic device 101 may determine the priority of the position where the function key is to be generated according to the mounting type. For example, when the electronic device 101 is mounted on the ground in the first shape, the electronic device 101 is positioned on the right side of the display 203 when viewed from the front among the sides perpendicular to the ground. Function keys may be generated in the upper part with the first priority, and function keys may be generated with the second priority on the right side of the side that does not touch the ground among the sides parallel to the ground. For another example, when the electronic device 101 is mounted on the ground in the second shape, the electronic device 101 is located on the right side when the display 203 is viewed from the front among the sides perpendicular to the ground. The function key may be generated in the first order at the upper end of the side, and the function key may be generated in the second order in the right area of the side that does not touch the ground among the sides parallel to the ground.

In operation 711 , the electronic device 101 may identify a grip shape corresponding to a position in contact with the user's body among one surface of the electronic device 101 . The electronic device 101 corresponds to a position where the user's body (eg, a finger) is in contact with at least a part of one surface of the electronic device 101 detected by the sensor 207 (eg, a pressure sensor or a touch sensor). It is possible to identify the phage form that For example, the electronic device 101 may identify whether the user holds the electronic device 101 with one hand or the electronic device 101 with two hands through the sensor 207 . As another example, when the user grips the electronic device 101 with one hand, the electronic device 101 may identify whether the gripping shape is the first electronic shape or the second electronic shape. As another example, when the user holds the electronic device 101 with both hands, the electronic device 101 may identify whether the gripping shape is the second shape.

According to an embodiment, the electronic device 101 may determine a location where the function key is to be generated based on the grip shape. The electronic device 101 may determine the priority of the position where the function key is to be generated according to the grip shape. For example, when the user grips the electronic device 101 with one hand and the first shape, the electronic device 101 detects the position where the thumb touches or the touch among the user's fingers detected through the sensor 207 . A function key can be created with the first priority in the area surrounding the designated location. For another example, when the user grips the electronic device 101 with one hand and the second shape, the electronic device 101 detects the position where the index finger is touched among the user's fingers detected through the sensor 207 or the A function key may be generated in a first priority in a region adjacent to a touched position, and a function key may be generated in a second priority in a position where a thumb of the user's finger is touched or a region surrounding the touched position. As another example, when the user grips the electronic device 101 with both hands and the second shape, the electronic device 101 displays the right index finger and the left index finger among the user's fingers detected through the sensor 207 . , the right thumb, and the left thumb in the order of generating a function key at a position where the fingers are touched or a region surrounding the touched position.

In operation 713 , the electronic device 101 may generate a plurality of function keys corresponding to the plurality of applications based on the determined function and the determined location (or area). For example, the electronic device 101 may generate a first function key corresponding to the first application and a second function key corresponding to the second application based on the determined function and location. For example, referring to (a) of FIG. 8A , the electronic device 101 may generate a function key 811 of a volume function corresponding to the YouTube application in a side area of the first area 801, and the camera A function key 812 of a photographing function corresponding to an application may be generated in the side area of the second area 802 . As another example, referring to FIG. 8A (b) , the electronic device 101 may generate a function key 821 of a home button function corresponding to navigation in a side area of the first area 801, , a function key 822 of a volume function corresponding to the music application may be generated in the side area of the second area 802 .

In operation 715 , the electronic device 101 may display a visual object corresponding to information related to the generated plurality of function keys. The electronic device 101 displays a visual object corresponding to the information related to the plurality of generated function keys on the front area 203 - 1 of the display 203 , the front area of the generated function key, or the front area 203 . -1) and can be displayed in the area spanning the front area of the function key. For example, the electronic device 101 displays a visual object corresponding to the information related to the first function key and a visual object corresponding to the information related to the second function key on the front area 203 - 1 of the display 203 . can be displayed through For example, referring to (a) of FIG. 8A , the electronic device 101 displays a visual object ( 811-1) can be displayed. The electronic device 101 may display the visual object 812-1 corresponding to information related to the function key 812 of the photographing function through the second area 802 of the display 203 . For another example, referring to FIG. 8A (b) , the electronic device 101 may display a visual display corresponding to information related to the function key 821 of the home button function through the first area 801 of the display 203 . The object 821-1 may be displayed. The electronic device 101 may display the visual object 822-1 corresponding to information related to the function key 822 of the volume function through the second area 802 of the display 203 .

In operation 717 , the electronic device 101 may perform functions corresponding to the plurality of generated function keys. The electronic device 101 may perform a function of the function key in response to obtaining a user input for the plurality of function keys. The electronic device 101 may perform a function of the first function key in response to obtaining a user input for the first function key. For example, referring to (a) of FIG. 8A , the electronic device 101 may adjust the volume of the reproduced multimedia content in response to obtaining a push input for the function key 811 of the volume function. In response to obtaining a push input for the function key 812 of the photographing function, the electronic device 101 may perform photographing through the camera. Referring to FIG. 8A (b) , the electronic device 101 may convert the navigation screen into the home screen in response to obtaining a push input for the function key 821 of the home button function. The electronic device 101 may adjust the volume of the reproduced music in response to obtaining a push input for the function key 822 of the volume function. In the above-described examples, a push input is described as an example of a user input, but is not limited thereto, and may include a swipe input or a touch input.

8 illustrates a function key generated when the electronic device 101 executes a plurality of applications according to an embodiment.

8A (a) illustrates a state in which a plurality of function keys corresponding to a plurality of applications are generated while the user holds the electronic device 101 with one hand and a first shape.

Referring to (a) of FIG. 8A , in a state in which the electronic device 101 displays a plurality of screens corresponding to a plurality of applications through a plurality of areas of the display 203 , the electronic device 101 displays the plurality of screens. A plurality of function keys corresponding to the plurality of applications may be generated by protruding side areas of the plurality of areas. For example, the electronic device 101 may generate a function key 811 for a volume function mapped to the YouTube application by protruding a side area of the first area 801 . The electronic device 101 may generate a function key 812 of a photographing function mapped to the camera application by protruding a side area of the second area 802 .

According to an embodiment, the electronic device 101 may respectively display a plurality of function keys corresponding to information on the plurality of function keys through the front area of the display 203 . For example, the electronic device 101 may display the visual object 811-1 corresponding to the information of the function key 811 of the volume function through the front area of the display 203 . The electronic device 101 may display the visual object 812-1 corresponding to the information of the function key 812 of the photographing function through the front area of the display 203 .

8A (b) illustrates a state in which a plurality of function keys corresponding to a plurality of applications are generated while the electronic device 101 is mounted on the ground in a second shape.

Referring to FIG. 8A (b) , the electronic device 101 may generate a function key 821 having a home button function in a navigation application by protruding a side area of the first area 801 . The electronic device 101 may generate the function key 822 for the volume function of the music application by protruding the side area of the second area 802 .

According to an embodiment, the electronic device 101 may display the visual object 821-1 corresponding to the information of the function key 821 of the home button function through the front area of the display 203 . The electronic device 101 may display the visual object 822-1 corresponding to the information of the function key 822 of the volume function through the front area of the display 203 .

9 illustrates a function key generated by mapping a function frequently used by a user, according to an exemplary embodiment.

Referring to FIGS. 9A and 9B , in a state in which the electronic device 101 executes a single application, the electronic device 101 executes a function frequently used by a user in the executed application as the executed application. It can be automatically mapped to a function key to be generated in response to .

Referring to FIG. 9A , in a state in which the electronic device 101 executes a call application, the electronic device 101 may generate a direct call function for a person whom the user frequently calls in response to the call application. It can be automatically mapped to the function key 901 .

According to an embodiment, in a state in which the electronic device 101 executes a call application and is held by the user's left hand 401, a function key ( 901 may be generated by protruding a side area of the display 203 .

According to an embodiment, the electronic device 101 displays a visual object 901-1 (eg, color change) corresponding to the function key 901 of the direct call function through the front area of the function key 901 . can The electronic device 101 may display the visual object 901 - 2 corresponding to the function key 901 of the direct call function through the area in which the function key 901 is generated among the side areas of the display 203 .

Referring to FIG. 9B , in a state in which the electronic device 101 executes an Internet application, the electronic device 101 automatically assigns a function of accessing a favorite page to a function key to be generated in response to the Internet application. can be mapped to The favorite page may mean a page frequently encountered by the user.

According to an embodiment, the electronic device 101 has a function of accessing a favorite page corresponding to a function automatically mapped to the Internet application in a state in which the Internet application is executed and is held by the user's left hand 401 . The function key 902 of the display 203 may be generated by protruding the side area of the display 203 .

According to an embodiment, the electronic device 101 displays a visual object 902-1 (eg, color change) corresponding to the function key 902 for accessing a favorite page in the front area of the function key 902 . can be displayed through The electronic device 101 displays a visual object 902 - 2 corresponding to the function key 902 for accessing the favorite page through the area in which the function key 902 is generated among the side areas of the display 203 . can do.

10A illustrates an example in which the electronic device 101 switches a function of a function key, according to an exemplary embodiment.

Referring to FIG. 10A , the electronic device 101 may switch functions of a function key in response to a user input (eg, a swipe input 1001 ).

10A (a) and (b), in response to obtaining a user input for the function key 1001a, the electronic device 101 of the function key 1001a shown in (a) of FIG. 10A The function can be switched to the function of the function keys 1001b and 1002b shown in (b) of FIG. 10A. For example, while the camera application is running, the electronic device 101 may acquire the swipe input 1001 through the sensor 207 . In response to obtaining the swipe input 1001 , the electronic device 101 may switch the function key 1001a of the photographing function into the function key 1001b of the volume function and the function key 1002b of the power function. According to an embodiment, in response to obtaining a user input for the function keys 1001b and 1002b, the electronic device 101 performs the functions of the function keys 1001b and 1002b shown in (b) of FIG. 10A of FIG. 10A . It is possible to switch to the function of the function key 1001a shown in (a).

Referring to (a) of FIG. 10A , in a state in which the camera application is executed, the electronic device 101 may generate a function key 1001a of a photographing function mapped to the camera application, and the function key 1001a and The related visual object 1001a - 1 may be displayed in the area where the function key 1001a is generated among the side areas of the display 203 .

Referring to (b) of FIG. 10A , in response to the acquisition of the swipe input 1001 for converting the function of the function key while the camera application is running, the electronic device 101 displays the function key 1001b of the volume function ) related visual object 1001b-1 and visual object 1001b-2 may be displayed on the front area and side area of the display 203, respectively. In a state in which the camera application is executed, in response to obtaining the swipe input 1001 for converting the function of the function key, the electronic device 101 displays the visual object 1002b-1 associated with the function key 1002b of the power function. and the visual object 1002b - 2 may be displayed on the front area and the side area of the display 203 , respectively.

10B illustrates an example in which the electronic device 101 switches a function of a function key, according to an embodiment.

Referring to FIG. 10B , the electronic device 101 may switch functions of a function key in response to a user input (eg, a swipe input 1001 ).

10B (a) and (b), in response to obtaining the swipe input 1001 for converting the function of the function key, the electronic device 101 is the function key shown in (a) of FIG. 10B The volume function of 1003a may be switched to a toggle function (eg, a function of playing the previous or next song) of the function key 1004b shown in (b) of FIG. 10B .

According to an embodiment, in a state in which the music application is executed, the electronic device 101 may display the visual object 1003a - 1 corresponding to the function 1003a of the volume function through the side area of the display 203 . there is.

According to an embodiment, in response to the acquisition of the swipe input 1001 for converting the function of the function key while the music application is running, the electronic device 101 displays the function key shown in (b) of FIG. 10B . The function of 1004b can be switched to the function of the function key 1003a shown in (a) of FIG. 10B .

11A illustrates an example of controlling a function of a function key according to swipe inputs 1110, 1110-1, 1110-2, and 1110-3 for a function key, according to an exemplary embodiment.

Referring to FIGS. 11A and 11A , the electronic device 101 has a linear element according to swipe inputs 1110 , 1110-1 , 1110-2 , and 1110-3 for the function key 1101 . function of , and as feedback on the adjustment of the linear element, the visual objects 1102 , 1102-1 , 1102-3 , and 1102-3 may be displayed through the front area of the display 203 .

Referring to the state 1101a of FIG. 11A (a) , the electronic device 101 may obtain a swipe input 1110 for the function key 1101 of the volume control function while the multimedia application is being executed. The electronic device 101 may adjust the volume according to the swipe input 1110 , and may display the visual object 1102 through the front area of the display 203 as feedback on the volume adjustment.

Referring to (b) of FIG. 11A , as the positions at which swipe inputs 1110-1, 1110-2, and 1110-3 are sensed for the function key 1101 are continuously changed, the electronic device 101 In response to the continuous change, the display of the visual objects 1102-1, 1102-2, and 1102-3 may be changed. In the 1101b state, the electronic device 101 may obtain the swipe input 1110-1 for the function key 1101, and display the visual object 1102-1 to correspond to the swipe input 1110-1. can be displayed In the 1102b state, the electronic device 101 may obtain a swipe input 1110-2 for the function key 1101, The representation may be converted to a representation of the visual object 1102 - 2 . At 1103b , the electronic device 101 may obtain a swipe input 1110 - 3 for the function key 1101 , and display the visual object 1102 - 2 to correspond to the swipe input 1110 - 3 . can be converted to a representation of the visual object 1102 - 3 . The moving distance of the swipe input 1110 - 2 is longer than the moving distance of the swipe input 1110 - 1 , and the moving distance of the swipe input 1110 - 3 is longer than the moving distance of the swipe input 1110 - 2 . can be long

11B illustrates an example of controlling a function of a function key according to swipe inputs 1120-1 and 1120-2 for a function key, according to an embodiment.

Referring to FIG. 11B , as feedback on a change in a position at which a swipe input 1120-1 for a function key of a progress state control function is obtained in a state in which a multimedia application is executed, the electronic device 101 is in state 1103 It is possible to convert the display of the progress state 1121-1 of the multimedia content of , into the display of the progress state 1121-2 of the multimedia content of the 1104 state. As feedback on a change in a position at which a swipe input 1120 - 2 for a function key of a playback state control function is obtained in a state in which the multimedia application is executed, the electronic device 101 displays the progress state of the multimedia content in state 1104 The display of 1121-2 may be converted into the display of the progress state 1121-1 of the multimedia content in the 1103 state.

11C illustrates an example of controlling a function of a function key according to swipe inputs 1130, 1130-1, 1130-2, and 1130-3 for a function key, according to an exemplary embodiment.

Referring to (a) and (b) of FIG. 11C , the electronic device 101 performs linear elements according to swipe inputs 1130 , 1130-1 , 1130-2 , and 1130-3 for the function key 1131 . function of , and as feedback on the adjustment of the linear element, the visual objects 1132 , 1132-1 , 1132-2 , and 1132-3 may be displayed through the front area of the display 203 .

Referring to state 1105a of FIG. 11C (a) , a swipe input 1130 for a function key 1131 of a size adjustment function may be acquired while a photo application is running. The electronic device 101 may adjust the size of the photo according to the swipe input 1130 , and may display the visual object 1132 through the front area of the display 203 as feedback on the size adjustment.

Referring to (b) of FIG. 11C , as the positions at which swipe inputs 1130-1, 1130-2, and 1130-3 are sensed for the function key 1131 are continuously changed, the electronic device 101 In response to the continuous change, the display of the visual objects 1132-1, 1132-2, and 1132-3 may be changed. As the swipe input 1130-1 sequentially changes to an input corresponding to the swipe input 1130-2 and the swipe input 1130-3, the electronic device 101 displays the visual object ( 1132-1) may be sequentially converted to the display of the visual object 1132-2 in the 1106 state, and the display of the visual object 1132-3 in the 1107b state.

12 illustrates an example of controlling the size and function of a function key according to a user input to the function key, according to an embodiment.

Referring to FIG. 12 , the electronic device 101 may change the function and size of the function key in response to obtaining a user input for the function key. For example, the electronic device 101 may generate a function key 1201a for a playback function and a function key 1202a for a volume function while executing a multimedia application. In response to obtaining the user input 1210 (eg, hold and swipe input) for the function key 1201a , the electronic device 101 assigns the function (eg, play or stop) of the function key 1201a to the function key The function (eg, play or stop, previous or next) of 1201b may be expanded, and the size of the function key 1201a may be changed to the size of the function key 1201b.

13A illustrates an example of a function of a function key mapped according to a type of a user input to the function key according to an exemplary embodiment.

13A (a) shows a method for performing a function mapped to the touch input 1310 among a plurality of functions of the function key in response to the acquisition of the touch input 1310 for the function key in a state in which the music application is executed The electronic device 101 is shown.

13A (b) shows a method for performing a function mapped to the push input 1311 among a plurality of functions of the function key in response to the acquisition of the push input 1311 for the function key in a state in which the music application is executed The electronic device 101 is shown.

According to state 1302a, in a state in which the music application is executed, the electronic device 101 may generate a function key for performing a plurality of functions mapped to the music application. According to the 1301a state, the electronic device 101 may display the visual object 1320 of the generated function key through the side area of the display 203 . In response to obtaining the touch input 1310 for the generated function key, the electronic device 101 may perform a function mapped to the touch input 1310 among the plurality of functions.

According to the state 1302b, in a state in which the music application is executed, the electronic device 101 may generate a function key for performing a plurality of functions mapped to the music application. According to the 1301b state, the electronic device 101 may display the visual object 1321 of the generated function key through the side area of the display 203 . In response to obtaining the push input 1311 for the generated function key, the electronic device 101 may perform a function mapped to the push input 1311 among the plurality of functions.

13B illustrates an example of a function of a function key mapped according to a type of a user input to the function key according to an exemplary embodiment.

13B (a) shows a function mapped to the touch input 1310 among a plurality of functions of the function key in response to the acquisition of the touch input 1310 for the function key in a state in which the camera application is executed (eg: The electronic device 101 for taking a picture) is shown.

13B (b) shows a function mapped to the push input 1311 among a plurality of functions of the function key in response to the acquisition of the push input 1311 for the function key in a state in which the camera application is executed (eg: The electronic device 101 for performing video recording) is shown.

According to the state 1304a, in a state in which the camera application is executed, the electronic device 101 may generate a function key for performing a plurality of functions. According to the 1303a state, the electronic device 101 may display the visual object 1322 of the generated function key through the side area of the display 203 . In response to obtaining the touch input 1310 for the generated function key, the electronic device 101 may perform a function (eg, taking a picture) mapped to the touch input 1310 among the plurality of functions. .

According to the state 1304b, in a state in which the camera application is executed, the electronic device 101 may generate a function key for performing a plurality of functions. According to the 1303b state, the electronic device 101 may display the visual object 1323 of the generated function key through the side area of the display 203 . In response to obtaining the push input 1311 for the generated function key, the electronic device 101 may perform a function (eg, capturing a video) mapped to the push input 1311 among the plurality of functions. .

14 illustrates an example of controlling the size and function of a function key according to push inputs 1410, 1420, 1410-1, 1410-2, and 1410-3 for the function key, according to an embodiment.

The electronic device 101 in the 1401a state shown in FIG. 14A may acquire the push input 1410 in the first direction through the function key 1401, and 1402a shown in FIG. 14A . The electronic device 101 in the state may acquire the push input 1420 in the second direction through the function key 1411 . The first direction and the second direction may be opposite directions.

In the 1401a state, the electronic device 101 may acquire the push input 1410 through the function key 1401 of the volume function while the multimedia application is being executed. The electronic device 101 may display the visual object 1402 corresponding to the size (or width) of the function key 1401 through the front area of the display 203 . The electronic device 101 may change the display of the visual object 1402 in proportion to the size (or width) of the function key 1401 .

In the state 1402a, the electronic device 101 may acquire the push input 1420 through the function key 1411 of the volume function while the multimedia application is being executed. The electronic device 101 may display the visual object 1412 corresponding to the size (or width) of the function key 1411 through the front area of the display 203 . The electronic device 101 may change the display of the visual object 1412 in proportion to the size (or width) of the function key 1411 .

In the 1401b state, the electronic device 101 may obtain the push input 1410-1 for the function key 1401-1, and based on the time at which the push input 1410-1 is sensed, the function key ( 1401-1) can be changed. For example, as the time for detecting the push input 1410-1 increases, the electronic device 101 may greatly change the width of the function key 1401-1. The electronic device 101 may change the display of the visual object 1402-1 according to a change in the size of the function key 1401-1.

According to an embodiment, the electronic device 101 detects the push input 1410 - 2 shown in the 1402b state longer than the push input 1410 - 1 shown in the 1401b state. The electronic device 101 may detect the push input 1410 - 3 shown in the 1403b state longer than the push input 1410 - 2 shown in the 1402b state. In the state 1402b, the electronic device 101 may generate the function key 1401 - 2 corresponding to a size proportional to the time for detecting the push input 1410 - 2 . In the state 1403b, the electronic device 101 may generate the function key 1401-3 corresponding to a size proportional to the time for detecting the push input 1410-3. The electronic device 101 displays the visual object 1402-2 and the visual object 1402-3 of the display corresponding to the size of the function key 1401-2 and the size of the function key 1401-3 through the display 203 . ) can be displayed individually.

15 illustrates an example of controlling the position and function of a function key according to push inputs 1510, 1520, 1510-1, 1510-2, and 1510-3 for the function key, according to an embodiment.

The electronic device 101 in the state 1501a shown in FIG. 15A may acquire the push input 1510 in the first direction through the function key 1501, and 1502a shown in FIG. 15A . The electronic device 101 in the state may acquire the push input 1520 in the second direction through the function key 1520 . The first direction and the second direction may be opposite directions.

In the state 1501a, the electronic device 101 may acquire the push input 1510 through the function key 1501 of the volume function while the multimedia application is being executed. The electronic device 101 may display the visual object 1502 corresponding to the position of the function key 1501 through the front area of the display 203 . The electronic device 101 may change the display of the visual object 1502 in response to the position of the function key 1501 . For example, as the position of the function key 1501 shown in the 1501a state is changed to the position of the function key 1511 shown in the 1502a state, the electronic device 101 moves the visual object 1502 shown in the 1501a state. The display may be changed to that of the visual object 1512 shown in state 1502a to be displayed through the front area of the display 203 .

According to one embodiment, in the position of the function key 1501-1 shown in state 1501b, the position of the function key 1501-2 shown in state 1502b, and the function key 1501-3 shown in state 1503b. As the position is changed to , the electronic device 101 displays the visual object 1502-1 corresponding to the function key 1501-1, and the visual object 1502-2 corresponding to the function key 1501-2. ) and the display of the visual object 1502-3 corresponding to the function key 1501-3, respectively.

16 illustrates an example of a function key for a fingerprint recognition function of the electronic device 101 according to an embodiment.

Referring to FIG. 16 , the electronic device 101 may execute an application requiring user's fingerprint recognition. The electronic device 101 may display a screen (eg, a payment screen, a login screen) corresponding to the application through the front area 230-1 of the display 203 . The electronic device 101 may embed a fingerprint sensor in the side area 230 - 2 of the display 203 . In response to the user's execution of an application requiring fingerprint recognition, the electronic device 101 automatically projects the side area 230-2 on which the fingerprint sensor is disposed to generate a function key 1601 for a fingerprint recognition function. can The electronic device 101 may acquire a touch input lasting longer than a reference time with respect to the function key 1601 . The electronic device 101 may authenticate the user in response to the acquisition of the touch input.

According to an embodiment, the electronic device 101 displays the visual object 1601-1 related to the function key 1601 of the fingerprint recognition function on the protruding area of the side area 230-2 of the display 230. can Although not shown in FIG. 16 , the electronic device 101 may display a visual object corresponding to the function key 1601 of the fingerprint recognition function through the front area 230-1 of the display 203 .

17 illustrates a user interface for controlling the height of a function key according to an embodiment.

17A illustrates a setting UI for controlling various functions of the electronic device 101 . The electronic device 101 may obtain a user input for selecting a display 1701 of a function key in the setting UI.

17B illustrates a UI related to a key height displayed by the electronic device 101 in response to acquisition of a user input for selecting a display 1701 of a function key. The electronic device 101 may obtain a user input 1702 (eg, a drag input) for the key height, and set the height of the function key according to the user input 1702 . For example, the electronic device 101 may set the height of the function key to be larger as the drag length of the drag input with respect to the height of the key increases. The electronic device 101 may generate a function key having a set height of the function key.

According to an embodiment, the electronic device 101 may generate a function key having a set key height in real time based on the user input 1702 for the key height. For example, when obtaining a drag input of a first length with respect to a key height, the electronic device 101 may generate a function key having a key height corresponding to the first length, and may generate a drag input of the first length. When a drag input of a second length continuous to the input is obtained, a function key having a key height corresponding to the first length may be changed to a function key having a key height corresponding to the second length.

18 illustrates an example of displaying a visual object corresponding to a function key according to an embodiment.

Referring to FIG. 18A , the electronic device 101 displays a visual object (eg, an icon 1811a) or a UI (eg, a volume control UI 1812a) corresponding to a function key through the front area of the display 203 . )) can be displayed. For example, the electronic device 101 in the 1801a state may display the icon 1811a corresponding to the function key of the volume control function through the front area of the display 203 in a state in which the multimedia application is executed. In a state in which the icon 1811a is displayed through the front area of the display 203 , the electronic device 101 controls the volume associated with the function key by adjusting the icon 1811a in response to detecting a user input for the function key. It can be displayed by changing to the UI 1812a.

Referring to FIG. 18B , the electronic device 101 provides a visual effect (eg, color feedback 1811b) as feedback in response to a user input to the function key through the front area of the function key. can be displayed. For example, the electronic device 101 in the 1801b state may display the color feedback 1811b through the front area of the function key as feedback for obtaining a touch input for the function key while the multimedia application is executed. . The electronic device 101 in the 1802b state may display a visual effect (eg, a motion effect 1812b) as feedback to a directional user input for a function key. For example, in response to obtaining the swipe input for the function key, the electronic device 101 in the 1802b state applies a motion effect 1812b to indicate the direction of the swipe input through the front area of the function key. can be displayed

According to an embodiment, the electronic device 101 includes a flexible display disposed across the front and side surfaces of the electronic device 101 , at least one actuator 205 disposed on the side surface of the electronic device 101 , the flexible display and It may include a processor 201 operatively coupled to at least one actuator 205 . The processor 201 controls the at least one actuator 205 so that at least one side area disposed on the side surface of the electronic device 101 protrudes to form a function key among the area of the flexible display, and the area of the flexible display Among them, a visual object corresponding to the information related to the function key may be displayed through the front area disposed on the front side of the electronic device 101 .

According to an embodiment, the processor 201 selects at least one function to be performed in response to a user input through the function key based on an application running in the electronic device 101 or an operating state of the electronic device 101 . can decide

According to an embodiment, the processor 201 identifies the type of the application being executed in the electronic device 101, and at least one to be performed in response to a user input through the function key mapped to the identified application type. function can be determined.

According to an embodiment, the processor 201 identifies whether the screen of the flexible display is in the screen-off state, and when the screen of the flexible display is in the screen-off state, through the function key mapped to the screen-off state At least one function to be performed in response to a user input may be determined.

According to an embodiment, the electronic device 101 may further include at least one sensor. The processor 201 determines a holding state corresponding to a position where the user's body comes into contact with at least a part of one surface of the electronic device 101, sensed through the at least one sensor, and based on the holding state, At least one side area disposed on the side surface of the electronic device 101 is determined from among the areas of the flexible display, and the at least one actuator 205 is controlled such that the determined at least one side area protrudes to form the function key can do.

According to an embodiment, the electronic device 101 may further include at least one sensor. The processor 201 determines a mounting state corresponding to a surface in contact with the ground among one surface of the electronic device 101 sensed through the at least one sensor, and based on the mounted state, the area of the flexible display Among them, at least one side area disposed on the side surface of the electronic device 101 may be determined, and the at least one actuator 205 may be controlled such that the determined at least one side area protrudes to form the function key.

According to an embodiment, the processor 201 may display a visual object corresponding to information related to the function key through a display area extending from the flexible display and disposed in front of the function key.

According to an embodiment, the flexible display may include a stretchable display.

According to an embodiment, the processor 201 displays a first screen corresponding to a first application on a first area of the flexible display, and displays a second screen corresponding to a second application on a second area of the flexible display. display, at least one area of the first area disposed on the side surface of the electronic device 101 protrudes to form a first function key, and at least one area of the second area disposed on the side surface of the electronic device 101 Controls the at least one actuator 205 so that a portion protrudes to form a second function key, and responds to the first information related to the first function key through the flexible display disposed on the front surface of the electronic device 101 to display a first visual object, and display a second visual object corresponding to second information related to the second function key.

According to an embodiment, the processor 201 extends from the flexible display and through a display area disposed in front of the first function key, a first visual object corresponding to the first information related to the first function key. may be displayed, and a second visual object corresponding to the second information related to the second function key may be displayed through a display area extending from the flexible display and disposed in front of the second function key.

According to an embodiment, the processor 201 is configured to generate an electronic device ( 101), a height at which at least one side area of the flexible display disposed on the side protrudes may be determined.

According to an embodiment, the processor 201 obtains the number of inputs of the user selecting the function of the application in the electronic device 101, and determines the priority of the function of the application based on the number of inputs of the user, , based on the priority of the function, map the application and the function, and control the at least one actuator 205 to form a function key corresponding to the mapped function in response to the execution of the application .

According to an embodiment, the processor 201 obtains a swipe input for controlling a function of the function key through one surface of the function key, and in response to obtaining the swipe input, the function of the function key can be converted to

According to an embodiment, the processor 201 displays a visual object corresponding to the function of the function key through the flexible display disposed on the front surface of the electronic device 101, and through one surface of the function key, the Obtain a swipe input for controlling a function of the function key, and change the display of the visual object corresponding to the function of the function key to correspond to the movement of the swipe input.

According to an embodiment, the processor 201 obtains a touch input and a swipe input continuous to the touch input through one surface of the function key, and in response to the acquisition of the touch input and the swipe input, It is possible to add a function of the function key and control the actuator 205 to change the width of the protruding region of the flexible display disposed on the side of the electronic device 101 to correspond to the movement distance of the swipe input. .

According to an embodiment, the processor 201 obtains a push input directed in a first direction through one surface of the function key, and in response to obtaining the push input, the function key in the first direction You can change the position of the key.

According to an embodiment, the processor 201 displays an icon indicating a function of the function key through a front area disposed on the front side of the electronic device 101 among areas of the flexible display, and one surface of the function key to obtain an input for controlling the function of the function key, and in response to obtaining the input for controlling the function of the function key, convert the icon into a visual object representing the control state of the function of the function key, A visual object representing the control state may be displayed through the front area.

According to an embodiment, the electronic device 101 includes a flexible display disposed across the front and side surfaces of the electronic device 101 , at least one actuator 205 disposed on the side surface of the electronic device 101 , and at least one sensor , the flexible display, an actuator 205 , and a processor 201 operatively connected to the at least one sensor. The processor 201 determines at least one function to be performed in response to a user input through a function key, based on an application running in the electronic device 101 or an operating state of the electronic device 101 , and the at least one A gripping state corresponding to a position where the user's body is in contact with at least a portion of one surface of the electronic device 101 sensed through a sensor is determined, and based on the gripping state, the electronic device ( 101), control the at least one actuator 205 so that the determined at least one side area protrudes to form the function key, and among the areas of the flexible display A visual object corresponding to information related to the function key may be displayed through the front area disposed on the front side of the electronic device 101 .

According to an embodiment, the processor 201 identifies the type of the application being executed in the electronic device 101, and performs at least One function can be determined.

According to an embodiment, the processor 201 identifies whether the screen of the flexible display is in the screen-off state, and when the screen of the flexible display is in the screen-off state, through the function key mapped to the screen-off state At least one function to be performed in response to a user input may be determined.

In the specific embodiments of the present disclosure described above, elements included in the disclosure are expressed in the singular or plural according to the specific embodiments presented. However, the singular or plural expression is appropriately selected for the context presented for convenience of description, and the present disclosure is not limited to the singular or plural element, and even if the element is expressed in plural, it is composed of the singular or singular. Even an expressed component may be composed of a plurality of components.

Meanwhile, although specific embodiments have been described in the detailed description of the present disclosure, various modifications are possible without departing from the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments and should be defined by the claims described below as well as the claims and equivalents.

Claims (20)

In an electronic device,
a flexible display disposed over the front and side surfaces of the electronic device;
at least one actuator disposed on a side surface of the electronic device;
a processor operatively coupled to the flexible display and the at least one actuator;
The processor is:
controlling the at least one actuator so that at least one side area disposed on a side surface of the electronic device from among the area of the flexible display protrudes to form a function key;
and displaying a visual object corresponding to information related to the function key through a front area disposed on a front surface of the electronic device among areas of the flexible display.
The method according to claim 1,
The processor is:
determining at least one function to be performed in response to a user input through the function key, based on an application running in the electronic device or an operating state of the electronic device.
The method according to claim 1,
The processor is:
Identifies the type of application being executed in the electronic device,
and determining at least one function to be performed in response to a user input through the function key mapped to the type of the identified application.
The method according to claim 1,
The processor is:
Identifies whether the screen of the flexible display is in a screen-off state,
When the screen of the flexible display is in a screen-off state, the electronic device determines at least one function to be performed in response to a user input through the function key mapped to the screen-off state.
The method according to claim 1,
at least one sensor;
The processor is:
determining a holding state corresponding to a position where the user's body is in contact with at least a part of one surface of the electronic device sensed through the at least one sensor;
determining at least one side area disposed on a side surface of the electronic device from among areas of the flexible display based on the gripping state;
and controlling the at least one actuator so that the determined at least one side area protrudes to form the function key.
The method according to claim 1,
at least one sensor;
The processor is:
determining a mounting state corresponding to a surface in contact with the ground among one surface of the electronic device sensed through the at least one sensor;
determining at least one side area disposed on a side surface of the electronic device from among areas of the flexible display based on the mounting state;
and controlling the at least one actuator so that the determined at least one side area protrudes to form the function key.
The method according to claim 1,
The processor is:
An electronic device that displays a visual object corresponding to information related to the function key through a display area extending from the flexible display and disposed in front of the function key.
The method according to claim 1,
The electronic device of claim 1, wherein the flexible display includes a stretchable display.
The method according to claim 1,
The processor is:
displaying a first screen corresponding to a first application on a first area of the flexible display and displaying a second screen corresponding to a second application on a second area of the flexible display;
At least one region of the first region disposed on the side surface of the electronic device protrudes to form a first function key, and at least a portion of the second region disposed on the side surface of the electronic device protrudes to form a second function key controlling the at least one actuator to form a key;
A first visual object corresponding to the first information related to the first function key is displayed through the flexible display disposed on the front surface of the electronic device, and a second visual object corresponding to the second information related to the second function key is displayed. An electronic device that displays an object.
10. The method of claim 9,
The processor is:
Displaying a first visual object corresponding to first information related to the first function key through a display area extending from the flexible display and disposed in front of the first function key, and extending from the flexible display, and displaying a second visual object corresponding to second information related to the second function key through a display area disposed in front of the second function key.
The method according to claim 1,
The processor is:
At least one side area of the flexible display disposed on the side of the electronic device based on at least one of a setting value of the electronic device, a user input, a type of an application being executed by the electronic device, or a function of the function key An electronic device that determines the height of this protrusion.
The method according to claim 1,
The processor is:
Obtaining the number of inputs of a user selecting a function of an application running in the electronic device,
Based on the number of input of the user, determine the priority of the function of the application,
map the application and the function based on the priority of the function,
and controlling the at least one actuator to form a function key corresponding to the mapped function in response to the execution of the application.
The method according to claim 1,
The processor is:
Obtaining a swipe input for controlling the function of the function key through one surface of the function key,
in response to obtaining the swipe input, transforming the function of the function key.
The method according to claim 1,
The processor is:
displaying a visual object corresponding to the function of the function key through the flexible display disposed on the front side of the electronic device;
Obtaining a swipe input for controlling the function of the function key through one surface of the function key,
change the display of the visual object corresponding to the function of the function key to correspond to the movement of the swipe input.
The method according to claim 1,
The processor is:
Acquire a touch input and a swipe input continuous to the touch input through one surface of the function key,
in response to obtaining the touch input and the swipe input, adding a function of the function key;
and controlling the actuator to change a width of a protruding area of a flexible display disposed on a side surface of the electronic device to correspond to a movement distance of the swipe input.
The method according to claim 1,
The processor is:
Through one surface of the function key, to obtain a push input toward the first direction,
and in response to obtaining the push input, change the position of the function key in the first direction.
The method according to claim 1,
The processor is:
displaying an icon representing the function of the function key through a front area disposed on the front side of the electronic device among areas of the flexible display;
Obtaining an input for controlling the function of the function key through one side of the function key,
in response to obtaining an input to control the function of the function key, transform the icon into a visual object representing the control state of the function of the function key;
and displaying a visual object representing the control state through the front area.
In an electronic device,
a flexible display disposed over the front and side surfaces of the electronic device;
at least one actuator disposed on a side surface of the electronic device;
at least one sensor;
a processor operatively coupled to the flexible display, the actuator, and the at least one sensor;
The processor is:
determining at least one function to be performed in response to a user input through a function key based on an application running in the electronic device or an operating state of the electronic device;
determining a holding state corresponding to a position where the user's body is in contact with at least a part of one surface of the electronic device sensed through the at least one sensor;
determining at least one side area disposed on a side surface of the electronic device among areas of the flexible display based on the gripping state;
controlling the at least one actuator so that the determined at least one side area protrudes to form the function key,
and displaying a visual object corresponding to information related to the function key through a front area disposed on a front surface of the electronic device among areas of the flexible display.
19. The method of claim 18,
The processor is:
Identifies the type of the application being executed in the electronic device,
and determining at least one function to be performed in response to a user input through the function key mapped to the identified type of application.
19. The method of claim 18,
The processor is:
Identifies whether the screen of the flexible display is in a screen-off state,
When the screen of the flexible display is in a screen-off state, at least one function to be performed is determined in response to a user input through the function key mapped to the screen-off state.

Images