WO2023204571A1

WO2023204571A1 - Electronic device comprising flexible display, and automatic execution method for camera thereof

Info

Publication number: WO2023204571A1
Application number: PCT/KR2023/005228
Authority: WO
Inventors: 이화준
Original assignee: 삼성전자 주식회사
Priority date: 2022-04-18
Filing date: 2023-04-18
Publication date: 2023-10-26

Abstract

An electronic device according to an embodiment may be configured to: execute a first application in a first display region in a state in which a first housing is moved in a second direction with respect to a second housing; control, when a specific motion of maintaining, by the electronic device, a preset time within a preset inclination angle is detected through a sensor, a driving device to move the first housing in a first direction with respect to the second housing; execute, while the first application being executed in the first display region is maintained, a camera function related to the first application by calling at least one camera in a second display region exposed due to a movement of the first housing in the first direction with respect to the second housing; and change, on the basis of the execution of the camera function being completed through the second display region, the first housing again to a state of being moved in the second direction with respect to the second housing.

Description

Electronic device including flexible display and method for automatically launching camera thereof

Various embodiments relate to an electronic device including a flexible display and a method of automatically executing a camera thereof.

Electronic devices are evolving beyond uniform shapes to expand displays or improve display usability. An electronic device may have a deformable structure that can adjust the size of the display. Recently, flexible electronic devices that can expand displays using a sliding or roller method have been released.

For example, a flexible electronic device arranges a flexible display in a space formed by a first housing and a second housing, and the flexible display can be expanded or contracted by sliding movement between the first housing and the second housing. Due to this, the display area of the flexible electronic device may reduce or expand the display area (or activation area) in which visual information is displayed depending on the coupling state of the first housing and the second housing.

Electronic devices (e.g. smartphones) provide a shooting function that allows shooting a subject through a camera (or camera module).

However, when a camera is called, the electronic device switches the currently running screen to the background and provides a full screen camera user interface (UI). Even if the camera function is called while the current app is running, the electronic device provides a camera UI with a uniform design regardless of the currently running app or situation, and requires the user to make step-by-step inputs to call the camera one by one. It is causing discomfort to users.

Moreover, in the case of flexible electronic devices, the advantage of a display that can be reduced or expanded cannot be utilized when calling the camera function.

Various embodiments seek to provide improved interaction by quickly and easily calling a camera function related to a currently running app by utilizing an extended display area in a flexible electronic device.

An electronic device according to an embodiment includes a first housing, a second housing disposed to move the first housing in a first direction or a second direction opposite to the first direction, and the first housing with respect to the second housing. A driving device that controls the housing to move in the first direction or the second direction, a first display area exposed when the first housing is moved in the second direction with respect to the second housing, and the first display area A flexible display, including a second display area that extends integrally with the driving device and is exposed when the first housing moves in the first direction with respect to the second housing by the driving device, at least one camera, a sensor, and the flexible display , a processor operatively connected to the at least one camera, the sensor, and the driving device, wherein the processor controls the first housing in a state in which the first housing is moved in a second direction relative to the second housing. When a first app is executed in the display area and a specific motion that maintains a set time within a set tilt angle of the electronic device is detected through the sensor, the first housing is moved in the first direction with respect to the second housing. The second display is exposed as the first housing is moved in the first direction with respect to the second housing while controlling the driving device to move and maintaining the first app running in the first display area. A camera function related to the first app is executed by calling the at least one camera to the area, and based on the camera function execution being completed through the second display area, the first housing is connected to the second housing. It may be set to change back to the state moved in the second direction.

A method of automatically launching a camera of an electronic device including a flexible display according to an embodiment includes executing a first app in a collapsed state in which the display area in which visual information is displayed can be reduced or expanded and has a first display area. An operation of changing the display to an expanded state exposing a second display area extending from the first display area when the electronic device detects a specific motion that maintains a set time within a set tilt angle, the first display area An operation of executing a camera function related to the first app by calling at least one camera to the second display area that is exposed as the state is changed to the expanded state while maintaining the first app running in the display area; Based on completion of executing the camera function through the second display area, the operation may include changing the display back to a reduced state with the first display area.

A flexible electronic device according to various embodiments automatically changes the display to an expanded state by a specific motion while an app is running in an electronic device in a reduced display state, calls a camera function related to the currently running app in the extended area, and uses a camera. By automatically changing the display to a reduced state upon completion of the function, interaction with camera calls can be improved.

Flexible electronic devices according to various embodiments can easily provide a camera function related to the currently running app by calling a camera function to a specific area within the app execution screen by a specific motion while the app is running.

Flexible electronic devices according to various embodiments can improve user convenience by visually notifying the user (e.g., displaying an object) that a camera call is possible while using an app and providing a camera function appropriate for the running app or situation. can

1 is a block diagram of an electronic device in a network environment according to various embodiments.

FIG. 2A is a diagram illustrating the front of an electronic device in a slide-in state according to various embodiments of the present disclosure.

FIG. 2B is a diagram illustrating the rear of an electronic device in a slide-in state according to various embodiments.

FIG. 3A is a diagram illustrating the front of an electronic device in a slide-out state according to various embodiments of the present disclosure.

FIG. 3B is a diagram illustrating the rear of an electronic device in a slide-out state according to various embodiments.

4 is an exploded perspective view of an electronic device according to various embodiments.

Figure 5 is a block diagram of an electronic device including a flexible display according to various embodiments.

FIG. 6 illustrates a method of automatically launching a camera in a flexible electronic device according to an embodiment.

FIG. 7 illustrates a method of automatically launching a camera in a flexible electronic device according to an embodiment.

FIGS. 8A and 8B show examples of screens for automatically running a camera in a flexible electronic device according to an embodiment.

9A and 9B show examples of screens for automatically running a camera in a flexible electronic device according to an embodiment.

FIGS. 10A and 10B show examples of screens for automatically running a camera in a flexible electronic device according to an embodiment.

FIG. 11 illustrates a method of automatically executing a camera of a flexible electronic device according to an embodiment.

Figure 12 shows examples of screens for automatically running a camera in a flexible electronic device according to an embodiment.

1 is a block diagram of an electronic device in a network environment, according to various embodiments.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores instructions or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself, where artificial intelligence is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for the communication method used in the communication network, such as the first network 198 or the second network 199, is connected to the plurality of antennas by, for example, the communication module 190. can be selected Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external

electronic devices

102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external

electronic devices

102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2A is a diagram illustrating the front of an electronic device in a slide-in state according to various embodiments of the present disclosure. FIG. 2B is a diagram illustrating the rear of an electronic device in a slide-in state according to various embodiments. FIG. 3A is a diagram illustrating the front of an electronic device in a slide-out state according to various embodiments of the present disclosure. FIG. 3B is a diagram illustrating the rear of an electronic device in a slide-out state according to various embodiments.

2A to 3B, the electronic device 101 includes a first housing 210 (e.g., a first housing structure, a moving part, or a slide housing), the first housing 210, and a specified direction (e.g., direction ①). Or a second housing 220 (e.g., a second housing structure, a fixing part or a base housing) slidably coupled in the ② direction (e.g., ±y-axis direction) and the first housing 210 and the second housing ( It may include a flexible display 230 (eg, expandable display or stretchable display) disposed to be supported by at least a portion of 220). According to one embodiment, the electronic device 101 slides out the first housing 210 in a first direction (direction ①) based on the second housing 220 held by the user. It may be arranged to slide in in a second direction (② direction) opposite to the first direction (① direction). According to one embodiment, at least a portion of the first housing 210 including the first space 2101 is accommodated in the second space 2201 of the second housing 220, thereby maintaining the slide-in state. It can be changed to . According to one embodiment, the electronic device 101 forms, in a slide-out state, at least partially the same plane as at least a portion of the first housing 210 and in a slide-in state. A bendable member or bendable support member (e.g., bendable member 240 of FIG. 4) at least partially received in the second space 2201 of the second housing 220 (e.g., a multi-joint hinge) module or multibar assembly). According to one embodiment, at least a portion of the flexible display 230, in the retracted state, is supported by a bendable member (e.g., the bendable member 240 of FIG. 4) and moves into the inner space (or space) of the second housing 220. 2201), it can be placed invisible from the outside. According to one embodiment, at least a portion of the flexible display 230 includes a bendable member (e.g., the bendable member 240 of FIG. 4 ) that forms at least partially the same plane as the first housing 210 when the flexible display 230 is pulled out. ), it can be placed so that it is visible from the outside.

According to various embodiments, the electronic device 101 may include a first housing 210 including a first side member 211 and a second housing 220 including a second side member 221. . According to one embodiment, the first side member 211 has a first side 2111 having a first length along a first direction (e.g., y-axis direction), and a direction substantially perpendicular to the first side 2111. a second side 2112 extending to have a second length shorter than the first length along (e.g., the x-axis direction) and extending substantially parallel to the first side 2111 from the second side 2112 and It may include a third side 2113 having a length. According to one embodiment, the first side member 211 may be at least partially formed of a conductive material (eg, metal). In one embodiment, the first side member 211 may be formed by combining a conductive material and a non-conductive material (eg, polymer). According to one embodiment, the first housing 210 may include a first support member 212 extending from at least a portion of the first side member 211 to at least a portion of the first space 2101. According to one embodiment, the first support member 212 may be formed integrally with the first side member 211. In one embodiment, the first support member 212 may be configured separately from the first side member 211 and may be structurally coupled to the first side member 211.

According to various embodiments, the second side member 221 at least partially corresponds to the first side 2111, has a fourth side 2211 having a third length, and a second side from the fourth side 2211 ( 2112), a fifth side 2212 having a fourth length shorter than the third length, and a third side extending from the fifth side 2212 to correspond to the third side 2113. It may include a sixth side 2213 having a length. According to one embodiment, the second side member 221 may be at least partially formed of a conductive material (eg, metal). In one embodiment, the second side member 221 may be formed by combining a conductive material and a non-conductive material (eg, polymer). According to one embodiment, at least a portion of the second side member 221 may include a second support member 222 extending to at least a portion of the second space 2201 of the second housing 220. According to one embodiment, the second support member 222 may be formed integrally with the second side member 221. In one embodiment, the second support member 222 may be configured separately from the second side member 221 and may be structurally coupled to the second side member 221.

According to various embodiments, the first side 2111 and the fourth side 2211 may be slidably coupled to each other. According to one embodiment, the third side 2113 and the sixth side 2213 may be slidably coupled to each other. According to one embodiment, in the retracted state, the first side 2111 overlaps the fourth side 2211, so that it can be arranged to be substantially invisible from the outside. According to one embodiment, in the retracted state, the third side 2113 overlaps the sixth side 2213, so that it can be arranged to be substantially invisible from the outside. In one embodiment, at least a portion of the first side 2111 and the third side 2113 may be arranged to be at least partially visible from the outside in the retracted state. According to one embodiment, the first support member 212 may be disposed to be substantially invisible from the outside by overlapping the second support member 222 in the retracted state. In one embodiment, a portion of the first support member 212 overlaps the second support member 222 in the retracted state, so that it is disposed not to be visible from the outside, and the remaining portion of the first support member 212 is disposed from the outside. It may be placed so that it is visible from.

According to various embodiments, the electronic device 101 may include a first rear cover 213 coupled to the first housing 210 at the rear. According to one embodiment, the first rear cover 213 may be disposed through at least a portion of the first support member 212. In one embodiment, the first rear cover 213 may be formed integrally with the first side member 211. According to one embodiment, the first back cover 213 is made of polymer, coated or colored glass, ceramic, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. It can be formed by In one embodiment, the first rear cover 213 may extend to at least a portion of the first side member 211. In one embodiment, at least a portion of the first support member 212 may be replaced with the first back cover 213.

According to various embodiments, the electronic device 101 may include a second rear cover 223 coupled to the second housing 220 at the rear. According to one embodiment, the second rear cover 223 may be disposed through at least a portion of the second support member 222. In one embodiment, the second rear cover 223 may be formed integrally with the second side member 221. According to one embodiment, the second back cover 223 is made of polymer, coated or colored glass, ceramic, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. It can be formed by In one embodiment, the second rear cover 223 may extend to at least a portion of the second side member 221. In one embodiment, at least a portion of the second support member 222 may be replaced with the second rear cover 223.

According to various embodiments, the electronic device 101 may include a flexible display 230 disposed to be supported by at least a portion of the first housing 210 and the second housing 220. According to one embodiment, the flexible display 230 has a first part 230a (e.g., a flat part or a display area) always visible from the outside and extends from the first part 230a, and at least a portion of the flexible display 230 is visible from the outside in the retracted state. The first housing 210 may include a second portion 230b (eg, a bendable portion) that is at least partially accommodated in the second space 2201 of the second housing 220 so that it is not visible. According to one embodiment, the first portion 230a is disposed to be supported by the first housing 210, and the second portion 230b is at least partially formed by a bendable member (e.g., the bendable member 240 of FIG. 4 ). )) can be placed to receive support. According to one embodiment, the second part 230b of the flexible display 230 has a bendable member (e.g., in FIG. 4) in a state in which the first housing 210 is pulled out along the first direction (direction ①). It extends from the first part 230a while being supported by the bendable member 240, forms substantially the same plane as the first part 230a, and may be arranged to be visible from the outside. According to one embodiment, the second portion 230b of the flexible display 230 is formed by the second portion of the second housing 220 in a state in which the first housing 210 is retracted along the second direction (② direction). It can be accommodated in the space 2201 and placed so as not to be visible from the outside. Accordingly, the electronic device 101 changes the display area of the flexible display 230 as the first housing 210 is moved in a sliding manner along a specified direction (e.g., ±y-axis direction) from the second housing 220. It can be guided as much as possible.

According to various embodiments, the flexible display 230 moves in a first direction (① direction) (or a second direction (② direction) according to the sliding movement of the first housing 210 relative to the second housing 220. )) can be variable in length. For example, the flexible display 230 may have a first display area (eg, an area corresponding to the first portion 230a) corresponding to the first length L1 in the retracted state. According to one embodiment, the flexible display 230, in the drawn-out state, moves the first housing 210 by an additional second length L2 with respect to the second housing 220, causing the first housing 210 to slide. It corresponds to the third length L3, which is longer than the length L1, and is expanded to have a second display area (e.g., an area including the first part 230a and the second part 230b) larger than the first display area. It can be.

According to various embodiments, the electronic device 101 includes an input device (e.g., a first microphone 203-1), an audio output device (e.g., a sound output device) disposed in the first space 2101 of the first housing 210. Receiver 206 or speaker 207 for a call),

sensor modules

204, 217, camera module (e.g., first camera module 205 or second camera module 216), connector port 208, key It may include at least one of an input device 219 or an indicator (not shown). According to one embodiment, the electronic device 101 may include another input device (eg, a second microphone 203) disposed in the second housing 220. In another embodiment, the electronic device 101 may be configured so that at least one of the above-described components is omitted or other components are additionally included. In another embodiment, at least one of the above-described components may be disposed in the second space 2201 of the second housing 220.

According to various embodiments, the input device may include a first microphone 203-1 and/or a second microphone 203. In one embodiment, the input device (eg, the first microphone 203-1 and/or the second microphone 203) may include a plurality of microphones arranged to detect the direction of sound. The sound output device may include, for example, a receiver 206 and a speaker 207 for a call. According to one embodiment, the speaker 207 is at least one speaker formed in the first housing 210 at a position always exposed to the outside (e.g., the second side 2112), regardless of the insertion/extraction state. It can be connected to the outside through the hall. According to one embodiment, the connector port 208 may correspond to the outside through a connector port hole formed in the first housing 210 in the drawn-out state. In one embodiment, the connector port 208 is formed in the second housing 220 in the retracted state and may correspond to the outside through an opening formed to correspond to the connector port hole. In one embodiment, the call receiver 206 may include a speaker (eg, piezo speaker) that operates without a separate speaker hole.

According to various embodiments, the

sensor modules

204 and 217 may generate electrical signals or data values corresponding to the internal operating state of the electronic device 101 or the external environmental state.

Sensor modules

204 and 217 are, for example, a first sensor module 204 (e.g., proximity sensor or illuminance sensor) disposed on the front of the electronic device 101 and/or on the rear of the electronic device 101. It may include a second sensor module 217 (eg, heart rate monitoring (HRM) sensor) disposed. According to one embodiment, the first sensor module 204 may be disposed on the front of the electronic device 101, below the flexible display 230. According to one embodiment, the first sensor module 204 and/or the second sensor module 217 include a proximity sensor, an illumination sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, and a gyro sensor. , it may include at least one of an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, or a humidity sensor.

According to various embodiments, the

camera modules

205 and 216 include a first camera module 205 disposed on the front of the electronic device 101 and a second camera module 216 disposed on the rear of the electronic device 101. ) may include. According to one embodiment, the electronic device 101 may include a flash (not shown) located near the second camera module 216. According to one embodiment, the

camera modules

205 and 216 may include one or more lenses, an image sensor, and/or an image signal processor. According to one embodiment, the first camera module 205 is disposed below the flexible display 230 and may be configured to photograph a subject through a portion of the display area of the flexible display 230.

According to various embodiments, some of the

camera modules

205 and 216 and

sensor modules

204 and 217 may be arranged to detect the external environment through the flexible display 230. For example, the first camera module 205 or some sensor modules 204 communicate with the external environment through a transparent area or a perforated opening formed in the flexible display 230 in the first space 2201 of the first housing 210. It can be placed so that it is accessible. According to one embodiment, the area facing the first camera module 205 of the flexible display 230 is part of the display area that displays content, and may be formed as a transparent area with a specified transmittance. According to one embodiment, the transparent area may be formed to have a transmittance ranging from about 5% to about 20%. This transmission area may include an area overlapping with an effective area (eg, field of view area) of the first camera module 205 through which light for forming an image by imaging the image sensor passes. For example, the transparent area of the flexible display 230 may include an area where the pixel arrangement density and/or wiring density is lower than the surrounding area. For example, a transparent area can replace the opening described above. For example, some camera modules 205 may include an under display camera (UDC). In one embodiment, some sensor modules 204 may be arranged to perform their functions without being visually exposed through the flexible display 230 in the internal space of the electronic device 101.

According to various embodiments, the electronic device 101 may include at least one antenna electrically connected to a wireless communication circuit (e.g., the wireless communication module 192 of FIG. 1) disposed in the second housing 220. . According to one embodiment, the electronic device 101 may include a bezel antenna A disposed through the conductive second side member 221 of the second housing 220. For example, the bezel antenna (A) is disposed on at least a portion of the fifth side 2212 and the sixth side 2213 of the second side member 221 and includes at least one segment formed of a non-conductive material (e.g., polymer) It may include a conductive portion 227 that is electrically divided through the

portions

2271 and 2272. According to one embodiment, the wireless communication circuit (e.g., the wireless communication module 192 of FIG. 1) has at least one frequency band (e.g., about 800 MHz to 6000 MHz) (e.g., legacy band) designated through the conductive portion 227. It can be set to transmit or receive a wireless signal. According to one embodiment, the electronic device 101 may include a side cover 2212a disposed on the fifth side 2212 to cover at least a portion of the at least one segment 2271. In one embodiment, the bezel antenna A may be disposed on at least one of the second side 2112, the fourth side 2211, the fifth side 2212, and the sixth side 2213. In one embodiment, the electronic device 101 is disposed in an internal space (e.g., the first space 2101 or the second space 2201) and is connected to another wireless communication circuit (e.g., the wireless communication module 192 of FIG. 1). )), it may further include at least one antenna module (e.g., 5G antenna module or antenna structure) arranged to transmit or receive a wireless signal in a frequency band ranging from about 3 GHz to 100 GHz.

According to various embodiments, insertion/extraction operations of the electronic device 101 may be performed automatically. For example, the in/out operation of the electronic device 101 may be performed using a drive motor (e.g., the pinion gear 261 in FIG. 4) disposed in the first space 2101 of the first housing 210. Example: a drive motor 260 in FIG. 4) and a rack gear disposed in the second space 2201 of the second housing 220 and meshed with the pinion gear 261 (e.g., rack gear 2251 in FIG. 4) )) can be performed through the gearing operation. For example, when the processor of the electronic device 101 (e.g., processor 120 in FIG. 1) detects a triggering operation to change from the drawn-in state to the drawn-out state or to change from the drawn-out state to the drawn-in state, the electronic device 101 ) can operate the driving device (e.g., the driving motor 260 in FIG. 4) disposed inside. According to one embodiment, the triggering operation includes selecting (e.g., touching) an object displayed on the flexible display 230, manipulating a physical button (e.g., key button) included in the electronic device 101, or voice input. Or it may include at least one of receiving a wireless signal related to triggering.

The electronic device 101 according to exemplary embodiments of the present invention has an end portion (e.g., in the retraction state) in the first space 2101 of the first housing 210 in the retraction direction (② direction) of the first housing 210. A drive device (e.g., the drive motor 260 in FIG. 4) is disposed at the lower end of 210, and the pinion gear (e.g., the pinion gear 261 in FIG. 4) of the drive device (e.g., the drive motor 260) is disposed. ) is moved on a rack gear (e.g., rack gear 2251 in FIG. 4) correspondingly disposed in the second space 2201 of the second housing 220 (e.g., in the retracted state, the drive motor 260 ) is disposed at the bottom of the first housing 210, thereby providing an extended sliding distance (stroke). Additionally, the electronic device 101 includes electronic components (e.g., a board or battery) disposed together with a driving device (e.g., a driving motor 260) in the first space 2101 of the first housing 210. By doing so, it is possible to provide an efficient electrical connection structure with a driving device (eg, driving motor 260). Additionally, the electronic device 101 includes a support structure disposed in the second space 2201 of the second housing 220 to support at least a portion of the flexible display 230 in a slide-out state. It can help improve operational reliability.

4 is an exploded perspective view of an electronic device according to various embodiments. Hereinafter, in describing the electronic device 101 of FIG. 4, components that are substantially the same as those of the electronic device 101 of FIGS. 2A to 3B are assigned the same reference numerals, and detailed descriptions thereof may be omitted.

Referring to FIG. 4, the electronic device 101 includes a first housing 210 including a first space 2101, slidably coupled to the first housing 210, and a second space (e.g., the first housing of FIG. 3A). A second housing 220 including two spaces 2201, a bendable member 240 rotatably disposed at least partially in the second space 2201, at least a portion of the bendable member 240 and the first The flexible display 230 and the first housing 210, which are arranged to be supported by the housing 210, are moved from the second housing 220 in a direction to be inserted (e.g., -y axis direction) and/or to be pulled out (e.g., It may include a driving device (e.g., the driving device 540 of FIG. 5) that drives it in the y-axis direction. According to one embodiment, the drive device is disposed in the first space 2101, and the drive motor 260 including the pinion gear 261 is disposed to mesh with the pinion gear 261 in the second space 2201. It may include a rack gear 2251. According to one embodiment, the driving device may further include a deceleration module arranged to reduce the rotational speed and increase the driving force by being combined with the driving motor 260. According to one embodiment, the drive motor 260 may be arranged to be supported in the first space 2101 of the first housing 210 through at least a portion of the first support member 212. According to one embodiment, the drive motor 260 is fixed to an end (e.g., edge) of the first support member 212 in the first space 2101, in the lead-in direction (e.g., -y axis direction). You can.

According to various embodiments, the electronic device 101 may include a plurality of electronic components arranged in the first space 2101. According to one embodiment, a plurality of electronic components include a first board 251 (e.g., main board), a camera module 216 disposed around the first board 251, and a socket module 218 (e.g., SIM tray), speaker 207, connector port 208, and battery (B). According to one embodiment, a plurality of electronic components are disposed around the first substrate 251 in the first space 2101 of the first housing 210 together with the drive motor 260, so that efficient electrical connection may be possible. there is.

According to various embodiments, the electronic device 101 is disposed between the first support member 212 and the first rear cover 213 of the first housing 210 to cover at least some of the plurality of electronic components. May include a rear bracket (214). According to one embodiment, this bracket 214 may be structurally coupled to at least a portion of the first support member 212. In one embodiment, rear bracket 214 may be omitted. According to one embodiment, the rear bracket 214 may be arranged to cover a plurality of electronic components and support the first rear cover 213. According to one embodiment, the rear bracket 214 has a notch area 214a or an opening 214a formed in an area corresponding to the camera module 216 and/or the sensor module (e.g., the sensor module 217 in FIG. 3B). (e.g. through hole) may be included. According to one embodiment, the camera module 216 and/or the sensor module 217 may be arranged to detect the external environment through the notch area 214a or the opening 214a. According to one embodiment, at least an area of the first rear cover 213 corresponding to the camera module 216 and/or the sensor module 217 may be processed to be transparent. In one embodiment, the camera module 216 and/or sensor module 217 may be configured to operate only when the electronic device 101 is in a withdrawn state.

According to various embodiments, the electronic device 101 is disposed in the second space 2201 of the second housing 220 and includes a plate-type support bracket slidably coupled to at least a portion of the first support member 212. (225) (e.g. DSB, display support bar) may be included. According to one embodiment, the support bracket 225 may include an opening 225a of a specified size. According to one embodiment, the support bracket 225 may include a support portion 2252 disposed at one end and having a curved outer surface to support the rear surface of the bendable member 240 that is bent during the sliding operation. According to one embodiment, the support bracket 225 extends from at least a portion of the support portion 2252 to at least a portion of the opening 225a, such that in the pulled out state, the support plate formed to support the rear surface of the bendable member 240 ( 2253). According to one embodiment, the support bracket 225 may include a rack gear 2251 fixed to cross the opening 225a and have a length along a direction parallel to the sliding direction. In one embodiment, the rack gear 2251 may be formed integrally with the support bracket 225. According to one embodiment, the electronic device 101 is disposed on both sides of the support bracket 225 and may include a pair of guide rails 226 for guiding both ends of the bendable member 240 in the sliding direction. there is.

According to various embodiments, the second housing 220 is in the second support member 222, and when the electronic device 101 is in the retracted state, the camera module 216 and/or the camera module 216 disposed in the first housing 210 It may include an opening 222a (eg, a through hole) disposed in an area corresponding to the sensor module 217. According to one embodiment, the camera module 216 and/or the sensor module 217 detects the external environment through the opening 222a formed in the second housing 220 when the electronic device 101 is in the retracted state. can do. In this case, at least an area of the second rear cover 223 corresponding to the camera module 216 and/or the sensor module 217 may be processed to be transparent.

According to various embodiments, the electronic device 101 includes a second substrate 252 and an antenna member ( 253) may be included. According to one embodiment, the second substrate 252 and the antenna member 253 are connected to the first substrate 251 through at least one electrical connection member (e.g., FPCB, flexible printed circuit board, or FRC, flexible RF cable). Can be electrically connected. In one embodiment, the antenna member 253 may be electrically connected to the second substrate 252 and thus may be electrically connected to the first substrate 251 through the second substrate 252.

According to various embodiments, the electronic device 101 may include a flexible display 230 whose length is variable in a direction different from the first direction (e.g., y-axis direction) or the second direction (e.g., -y-axis direction). It may be possible. According to one embodiment, the flexible display 230 moves in a third direction (e.g., x-axis direction) or a fourth direction (e.g., -x) according to the sliding movement of another housing with respect to one of the plurality of housings. The length may be variable in the axial direction.

The electronic device 101 according to various embodiments may have various types of housing structures so that a flexible display can be mounted. The electronic device is a slideable (or rollable) device that allows at least a portion of the flexible display to be wound around or released from a driving device (e.g., roller unit, rotation assembly, sliding motor) formed in the internal space of the electronic device. (rollable)) may have a housing. Hereinafter, the term “state” may refer to the structural form, shape, or configuration of an electronic device (or display).

According to various embodiments referring to FIG. 5, the electronic device 101 includes a flexible display 510) (e.g., the display module 160 in FIG. 1, the flexible display 230 in FIG. 2A), and a processor 520 ( Example: processor 120 of FIG. 1), memory 530 (e.g., memory 130 of FIG. 1), driving device 540, camera 550 (e.g., camera module 150 of FIG. 1), and It may include a sensor 560 (e.g., sensor module 176 in FIG. 1). The electronic device 101 may further include at least some of the configurations and/or functions of the electronic device 101 of FIG. 1, and configurations overlapping with those of FIG. 1 may be substantially the same.

According to one embodiment, the flexible display 510 may be substantially the same as the flexible display 230 of FIGS. 2A, 2B, 3A, 3B, and 4. The flexible display 510 may have a variable display area (eg, expand or contract). As an example, the display area may indicate the size of a display area in the flexible display 510 that is exposed to the outside and displays information.

According to one embodiment, the flexible display 510 includes a first housing (e.g., the first housing 210 in FIG. 2A) and a second housing (e.g., the second housing 220 in FIG. 2A) of the electronic device 101. ) may be arranged to be supported by at least a portion of the.

The flexible display 510 extends from the first display area (e.g., the first portion 230a in FIG. 3A) and the first display area exposed to the outside, and moves into the housing according to the housing coupling state of the electronic device 101. It may include a second display area (eg, the second portion 230b in FIG. 3A) that is drawn in or drawn out. The second display area (e.g., the second portion 230b in FIG. 3A) is externally displayed when the first housing 210 is inserted into the second housing 220 along the second direction (direction ② in FIG. 2A). It may be at least partially accommodated in the second space 2201 of the second housing 220 so that at least a portion thereof is not visible.

As an example, the flexible display 510 may display a first display area (e.g., first portion 230a) corresponding to the first length L1 when the first housing 210 is inserted into the second housing 220. ) can have.

As another example, the flexible display 510 may have a second housing 220 corresponding to the second length L2 in a state in which the first housing 210 is pulled out from the second housing 220 along the first direction (direction ① in FIG. 3B). 2 The display area (eg, the second portion 230b) may be exposed to the outside. The flexible display 510 includes a first display area (e.g., first portion 230a) corresponding to the third length L3 and a It may have two display areas (eg, the second portion 230b). The display area of the flexible display 510 when the first housing 210 is pulled out from the second housing 220 is larger than the display area when the first housing 210 is retracted into the second housing 220. It can be big.

According to one embodiment, the flexible display 510 can display visual information processed by the electronic device 101. For example, visual information processed in the electronic device 101 may be displayed through a display area (eg, a first display area, a second display area) of the flexible display 510. As an example, the information processed in the electronic device 101 is at least one object related to an application program running on the electronic device 101, such as wall paper (or background screen), icon, application service screen, image, or widget. It can contain at least one. The flexible display 510 has a variable display area (e.g., first display area _ first display area) on which visual information (e.g., execution screen) will be displayed in the flexible display 510, based on the housing coupling state of the electronic device 101. display area and a second display area).

According to one embodiment, the flexible display 510 is an area (or degree of expansion) may be variable. For example, the user can apply a physical external force to expand the flexible display 510 to a desired area or shrink it again. As another example, the flexible display 510 may be implemented so that the second display area A2 is exposed in stages (eg, first-level expansion, second-level expansion) in response to the accumulated number of expansion requests.

According to one embodiment, the driving device 540 may be understood as a driving motor control module or a driving module.

According to various embodiments, the driving device 540 may change the display area of the flexible display 510. For example, the display area can be changed by sliding the first housing 210 from the second housing 220 of the electronic device 101, thereby expanding the size (or length) of the display area of the flexible display 510. Alternatively, it may include a state of being reduced. According to one embodiment, the driving device 540 moves the first housing 210 so that the first housing 210 is inserted into the second housing 220 or the first housing 210 is pulled out into the second housing 220. ) and/or the second housing 220 can be controlled. As an example, the driving device 540 may include the driving motor 260 of FIG. 4 .

According to various embodiments, the processor 520 may control the driving device 540 to change the display area of the flexible display 510. According to one embodiment, when the processor 520 detects a triggering operation for a change in the display area of the flexible display 510, the processor 520 operates the driving device 540 to expand or reduce the display area of the flexible display 510. It can be operated. For example, when the first housing 210 is inserted into the second housing 220, the driving device 540 moves the first housing from the second housing 220 based on the control of the processor 520. 210) can be operated to be withdrawn. For example, when the first housing 210 is pulled out from the second housing 220, the driving device 540 moves the first housing (210) to the second housing 220 based on the control of the processor 520. 210) can be operated to be retracted. As an example, the triggering operation may include selecting (e.g., touching) an object displayed on the flexible display 510, manipulating a physical button (e.g., key button) included in the electronic device 101, voice input, or triggering. It may include at least one of related wireless signal reception.

According to some embodiments, the electronic device 101 may control the driving device 540 by a physical external force (eg, a squeeze gesture that presses the electronic device 101). Due to the elastic structure of the driving device 540, the electronic device 101 can be switched from a closed state to an open state or from an open state to a closed state (e.g., semi-automatic slide operation) without any further external force.

According to various embodiments, the processor 520 may detect the amount of change in the display area of the flexible display 510. According to one embodiment, the processor 520 may detect the distance that the first housing 210 is moved from the second housing 220 to change the display area of the flexible display 510. For example, the distance that the first housing 210 has moved may be estimated based on magnetic force data (e.g., magnetic force strength and/or number of detected magnetic materials) detected through at least one magnetic force sensor (e.g., hall IC). You can. For example, the distance that the first housing 210 is moved may be determined by the driving state of the driving device 540 (e.g., the driving motor 261) for moving the first housing 210 (or the second housing 220). number of rotations and/or direction of rotation). For example, the distance that the first housing 210 has moved may be estimated based on a change in capacitance (eg, touch information) detected through the second part 230a of the flexible display 510. For example, the amount of change in the display area of the flexible display 510 may include the distance the first housing 210 is moved from the second housing 220.

According to one embodiment, the camera 550 can capture images. The camera 550 transmits the collected images as a preview image to the flexible display 510, and image data captured through the camera 550 may be provided to the processor 520.

The sensor 560 may acquire data used to determine expansion, contraction, and/or expansion information of the flexible display 510. The sensor 560 may detect a change in the area or size of the activation area where visual information will be displayed in response to a change in the state of the electronic device 101. The sensor 560 detects a closed state in which part of the flexible display 510 is stored inside the electronic device 101, an open state in which the entire flexible display 510 is exposed, or an intermediate state between the closed state and the open state. Data can be sensed and transmitted to the processor 520. For example, the sensor 560 is a sensor (e.g., encoder, hall sensor) that is attached to the driving device 540 and generates and outputs data corresponding to the rotation angle of the driving device 540. ) may include. For another example, the sensor 560 is disposed in a designated portion (e.g., a portion of the second display area A2) of the flexible display 510 to receive data corresponding to the curvature of the bendable section (②see Figure 2b). It may also include sensors that generate

The sensor 560 may acquire data used to recognize the electronic device posture (e.g., tilt, horizontal posture). For example, the sensor 560 may detect a specific motion (or pose) that the electronic device 101 maintains for a set time within a set tilt angle range. For example, the sensor 560 may include a geomagnetic sensor and a gyro sensor.

According to various embodiments, the memory 530 is provided by at least one component of the electronic device 101 (e.g., processor 5250, flexible display 510, driving device 540, camera 550). A variety of used data can be stored. According to one embodiment, the memory 530 may store various instructions that can be executed through the processor 520.

According to various embodiments, the processor 520 is operatively, functionally, and/or with the flexible display 510, the driving device 540, the camera 550, and/or the memory 530. Can be connected electrically.

Operations of the processor 520, which will be described later, may be performed by loading instructions stored in the memory 530.

According to one embodiment, the processor 520 operates in an auxiliary camera mode or If quick camera mode (hereinafter referred to as quick camera mode) can be called, a quick camera notification object notifying that quick camera mode can be entered can be displayed. The user can recognize that the quick camera mode is available through the quick camera notification object and make a specific motion (or pose) to invoke the quick camera mode.

According to one embodiment, the processor 520 detects a motion (or pose) for camera shooting, for example, a specific motion maintained for a set time within a set tilt angle range. In this case, the flexible display 510 is automatically changed to an extended state (or a state in which the first housing is pulled out in the second direction with respect to the second housing), and a display corresponding to the app running in the extended area (e.g., the second area) is automatically changed. You can run quick camera mode. The processor 520 ends the quick camera mode based on the camera function execution (e.g., ending shooting) based on the quick camera mode, and places the flexible display 510 in a collapsed state (or when the first housing is in the second housing). It can be controlled to automatically change in the state of being introduced in the first direction.

According to some embodiments, the processor 520 maintains a motion (or pose) for camera shooting while the electronic device 101 is executing a specific app, for example, within a set tilt angle range for a set time. When a specific motion is detected, quick camera mode can be activated in a specific area of the app launch screen, and a captured image can be inserted into the specific area based on the completion of the camera function (e.g., end of shooting).

An electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment includes a first housing (e.g., the first housing 210 of FIG. 2), and the first housing is moved in a first direction or in the first direction. A second housing (e.g., the second housing 220 in FIG. 2) is arranged to be movable in a second direction opposite to the second housing, and the first housing is moved in the first direction or the second direction with respect to the second housing. A driving device (e.g., a driving motor 260 in FIG. 4 and a driving device 540 in FIG. 5) that controls the first housing to be exposed while the first housing is moved in the second direction with respect to the second housing. A flexible display (e.g., FIG. 2, flexible display 510 in FIG. 5), at least one camera (e.g., camera module 160 in FIG. 1, camera 550 in FIG. 5), sensor (e.g., in FIG. 1) It includes a sensor module 176 (sensor 560 in FIG. 5), a processor 520 operatively connected to the flexible display, and the driving device, and the processor 520 is configured such that the first housing is connected to the second housing. When a first app is executed in the first display area while the housing is moved in a second direction, and a specific motion that maintains a set time within a set tilt angle of the electronic device is detected through the sensor, the first app is 1 Control the driving device to move the housing in the first direction with respect to the second housing, and maintain the first app running in the first display area, and move the first housing with respect to the second housing. A camera function related to the first app is executed by calling the at least one camera in the second display area that is exposed as it moves in the first direction, and based on the completion of execution of the camera function through the second display area Thus, the first housing may be set to change back to the state in which it is moved in the second direction with respect to the second housing.

According to one embodiment, when the first app is not set to display extension, the processor 520 does not expose the second display area in response to the specific motion and specifies a specific function within the execution screen of the first app. The area may be set to execute a camera function related to the first app.

According to one embodiment, the camera function executed in the second area may be executed in a mode that provides only some camera functions specified for each app characteristic or specific activity screen of the app.

According to one embodiment, the processor 520 maintains the execution screen of the first app in the first display area and displays a camera function corresponding to the camera function executed in relation to the first app in the second display area. Can be set to display the camera user interface.

According to one embodiment, while the second display area is exposed, the processor 520 displays a camera switching screen indicating that a camera is being called in the second display area, and when exposure of the second display area is completed, Based on this, the at least one camera may be activated to display an image acquired through the at least one camera as a preview screen in the second display area.

According to one embodiment, when the first app supports a camera function or auxiliary camera mode call called on the second display area, the processor 520 guides the camera call called on the second display area. It may be set to display a camera notification object and visually provide a different display state of the camera notification object after the camera function is called in the second display area.

According to one embodiment, the camera notification object may be displayed in an indicator area.

According to one embodiment, the camera notification object is configured when the second app running in the first display area does not support a function of executing a camera function related to the second app in the second display area, or the first app If a function for executing a camera function related to the first app is not supported in the second display area on a specific activity screen within an app, the camera notification object may be set not to be displayed.

According to one embodiment, the processor 520 displays the image or video captured through the second display area based on the completion of execution of the camera function through the second display area. 1 It can be further set to be inserted or attached to the app's execution screen.

According to one embodiment, after capturing an image or video through the second display area, if an additional function related to the image or video exists, the processor 520 adds an additional function user interface to the second display area. It can be set to provide.

According to one embodiment, the additional function may include at least one of a post-editing function, a text input function, and a drawing function.

According to one embodiment, the processor 520 displays a lock screen on the first display area while the first housing is coupled to the second housing in a second direction, and displays the lock screen on the electronic device through the sensor. When a specific motion is detected that maintains the set time within the set tilt angle, without calling the camera mode as full screen of the first display area, the driving device is controlled to move the first housing relative to the second housing. It may be further set to expose the second display area by moving in the first direction, and display a camera user interface by calling the camera in the second display area.

Hereinafter, operations of processor 520 are described in detail below. Additionally, additional operations of processor 520 are described below.

In the following embodiments, operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of operations may be changed, or at least two operations may be performed in parallel.

FIG. 6 illustrates a method of automatically executing a camera in a flexible electronic device according to various embodiments.

Referring to FIG. 6, the processor 520 (e.g., the processor 120 of FIG. 1) of the electronic device 101 according to an embodiment displays the first display area (e.g., the first portion of FIG. 2) in operation 610. Inserting the second housing (e.g., the second housing 220 of FIG. 2A) in the first direction with respect to the display reduced state (or the first housing (e.g., the first housing 210 of FIG. 2A) having a (230a)) It is possible to check whether the first app capable of calling the auxiliary camera mode or the quick camera mode (hereinafter referred to as quick camera mode) is running. The processor 520 may check whether the first app capable of calling the quick camera mode is running. If the app is not running, the process in Figure 6 can be terminated.

According to one embodiment, the processor 520 determines whether the first app is an app designated as a quick camera mode support app, or selects an app that supports the quick camera mode among the activity screens displayed on the display when the first app is executed. You can decide whether it is a screen or not.

According to some embodiments, when running the first app, the processor 520 allows the first app to call the quick camera mode if an image/video attachment item or a shooting-related item is included in the activity screen displayed on the display. It may be determined that a possible first app is running.

In various embodiments, the electronic device 101 may set (or designate) an app capable of calling a quick camera mode or an activity screen for each app. The electronic device 101 may set the quick camera mode differently depending on app characteristics.

The quick camera mode is a mode that calls only some camera functions (e.g., basic functions) designated by app characteristics or screen characteristics among camera functions, but is not limited to this. Quick camera mode can also call camera functions related to the currently running app.

For example, Table 1 lists examples of quick camera call settings and is not limited to the examples listed.

App type or screen typeApp type or screen type	퀵 카메라 모드 지원 기능Quick camera mode support function	촬영 후 추가 기능 제공 여부Whether additional functions are provided after shooting	카메라 렌즈 선택적 호출 (우선 순위)Camera Lens Selective Call (Priority)	적용 시나리오 예시Application scenario example
message/messenger APPmessage/messenger APP	사진 촬영 기능, 전후면 전환, 동영상 전환 및 촬영 기능 카메라 모드 변경 미지원Photo taking function, front/back switching, video switching and shooting function camera mode change not supported	XX	후면 카메라, 듀얼 카메라 또는 트리플 카메라 호출Call the rear camera, dual camera or triple camera	메시지 대화 화면을 유지한 채, 빠른 사진 첨부 가능You can quickly attach photos while maintaining the message conversation screen.
contact profile APPcontact profile APP	사진 촬영 기능, 전후면 전환, 프로필 사진 영역에 퀵 카메라 모드 호출Photo taking function, front and back switching, quick camera mode call to profile photo area	색감 필터/후보정 기능 제공 Provides color filter/post-correction function	전면 듀얼 카메라 호출 front dual camera call	프로필 등록 시 빠른 얼굴 촬영한 후 색감 보정 및 얼굴 보정 가능 When registering a profile, you can quickly take a face photo and then color correct and correct the face.
note/memo APPnote/memo APP	사진 촬영 기능, 영상 촬영 미제공Photo shooting function, video recording not provided	텍스트 입력 툴 기능/ 드로잉 입력 기능 제공 Provides text input tool function/drawing input function	후면 카메라, 듀얼 카메라 또는 트리플 카메라 호출Call the rear camera, dual camera or triple camera	메모 작성 시, 빠른 사진 첨부 가능 When writing a memo, you can quickly attach a photo
email APPemail APP	사진 촬영 기능, 영상 촬영 미제공Photo shooting function, video recording not provided	XX	후면 카메라, 듀얼 카메라 또는 트리플 카메라 호출Call the rear camera, dual camera or triple camera	이메일 작성 화면 시 메일 본문을 보며 빠른 사진 첨부 가능When composing an email, you can quickly attach a photo while viewing the email body.
calendar APPcalendar APP	사진 촬영 기능, 영상 촬영 미제공Photo shooting function, video recording not provided	XX	후면 카메라, 듀얼 카메라 또는 트리플 카메라 호출Call the rear camera, dual camera or triple camera	일정 저장 시 관련 촬영/ 사진 첨부가 용이함Easy to take related shots/attach photos when saving schedule
reminder APPreminder APP	사진 촬영 기능, 영상 촬영 미제공Photo shooting function, video recording not provided	XX	후면 카메라, 듀얼 카메라 또는 트리플 카메라 호출Call the rear camera, dual camera or triple camera	할일 목록 편집 화면 시 할일과 관련된 촬영/사진 첨부가 가능 On the to-do list editing screen, you can take pictures/attach photos related to the to-do task.
LockscreenLockscreen	풀(full) 카메라 기능 제공Provides full camera functionality	XX	카메라 앱 마지막 사용 렌즈와 동일한 설정 값 제공Camera app provides the same settings as the last used lens	락 스크린 상태에서 전체 화면이 아닌 확장 영역을 통해 빠른 카메라 호출 가능In lock screen state, quick camera call is possible through an extended area rather than the entire screen.

According to various embodiments, the electronic device 101 can be set to call the quick camera mode only on a specific activity screen within an app. For example, in the case of a contacts app, the contact list screen among the app's activity screens may be set to a screen that does not support camera calls, but the contact profile editing screen may be set to a screen that supports camera calls.

According to various embodiments, when calling the quick camera mode, the electronic device 101 may set different camera lenses to be called first for each running app among the front camera, rear camera, dual camera, or triple camera.

In operation 620, if the condition that the first app capable of calling the quick camera mode is executed in the display reduction state having the first display area is satisfied, the processor 520 creates a quick camera notification object that informs the user of the quick camera mode enabled state. It can be displayed.

The processor 520 may end the process of FIG. 6 when the first app capable of calling the quick camera mode does not satisfy the execution condition in the display reduction state having the first display area.

According to one embodiment, the processor 520 may inform that a specific app is running or that the quick camera mode can be called only on a specific screen. After displaying the quick camera notification object, the processor 520 may control the quick camera notification object not to be displayed when a specific app capable of invoking the quick camera mode is terminated or a specific screen capable of invoking the quick camera mode is left.

For example, the processor 520 may display a quick camera notification object in an indicator area, but may also notify the user through a notification bar. The electronic device 101 may guide the user to make a specific motion to invoke the quick camera mode by providing a quick camera notification object only in a specific app or on a specific screen.

According to one embodiment, operation 620 may be omitted.

In operation 630, the processor 520 may determine whether a specific motion (e.g., an action or pose for the user to lift the electronic device to take a picture) that the electronic device 101 maintains within a set tilt angle for a set time is detected. there is.

For example, the processor 520 calculates the tilt angle of the electronic device 101 through a sensor (e.g., geomagnetic sensor, gyro sensor), recognizes horizontal maintenance, and sets the tilt angle in a set range (e.g., 80 degrees to 110 degrees). ), it may be determined that the user is making a specific motion that is intended to be filmed using an electronic device.

The processor 520 is capable of calling the quick camera mode in operation 630, but may not call the quick camera mode if a specific motion is not detected.

In operation 640, processor 520 may determine whether the quick camera mode associated with the currently executing app is a display extension setting. The electronic device 101 may pre-designate (or set) an app or activity screen capable of calling the quick camera mode. The processor 520 may proceed to operation 650 if an app for which the quick camera mode is set as a display expansion setting is running, and if the app for which the quick camera mode is set as a display confirmation setting is running, the processor 520 may proceed to operation 660. In operation 650, the processor 520 may proceed to operation 650. , the processor 520 automatically expands the display by controlling the driving device in response to detecting a specific motion while the app in which the quick camera mode is set to the display expansion setting is running (or the second housing with respect to the first housing) can be changed to a state in which the app is pulled out in the second direction), and the quick camera mode corresponding to the first app can be called in the second display area (or extended area) (e.g., the second part 230b in FIG. 2A). .

For example, the processor 520 may display a camera switching screen (or camera transaction screen) on the exposed second display area while automatically changing the display to the extended state.

In operation 655, based on completion of exposure of the second display area, the processor 520 displays the first app in the expanded second display area while maintaining the display of the execution screen of the first app running in the first display area. The corresponding quick camera UI (user interface) can be displayed. For example, the quick camera user interface (UI) corresponding to the first app may be a UI designed based on the quick camera mode set according to the characteristics of the first app.

The quick camera UI (user interface) may include shooting items and camera switching items within the preview screen, but may additionally provide image editing items or image correction items depending on the specific app or screen being displayed in the first display area. .

In operation 660, the processor 520 calls the quick camera mode to a specific area of the app execution screen in response to detecting a specific motion while an app for which the quick camera mode is not specified as a display expansion setting is running, and displays the quick camera UI. can be displayed.

For example, when the processor 520 detects a specific motion that calls the quick camera mode while the profile editing screen is running among the activity screens of the contact app or the contact app, the processor 520 displays the image in the profile photo area (e.g., a specific area). You can call quick camera mode.

In operation 670, the processor 520 may perform the camera's shooting function in quick camera mode according to the user's request. For example, the processor 520 may capture and store an image obtained from a camera in response to an input for capturing a preview image output to the camera UI (eg, selecting a capture item).

In operation 675, the processor 520 may check whether additional functions are supported after shooting in the quick camera mode associated with the first app, and if the additional functions are supported, display the additional function UI in the quick camera UI in operation 680. there is. If no additional function exists, the processor 520 may skip operation 680 and proceed to operation 685.

For example, when the quick camera mode is called while the profile app or profile editing screen is displayed, the processor 520 generates a color filter UI for post-processing the taken photo after taking the photo in the area where the quick camera mode was called ( Example: It can be displayed in the area where the quick camera mode UI is displayed. Users can easily correct photos by applying a filter of a specific color to the photos taken.

In operation 685, the processor 520 may determine whether execution of the quick camera function related to the first app is complete (e.g., shooting ends).

In operation 690, the processor 520 may end the quick camera mode based on completion of execution of the quick camera function.

According to one embodiment, when the processor 520 automatically changes the display area to an expanded state when calling the quick camera mode, the processor 520 controls the driving device to set the display to a reduced state (or to move the first housing to the first housing with respect to the second housing). After automatically changing to the retracted direction, you can exit the quick camera mode. If execution of the quick camera function is not completed, the processor 520 may maintain the process of FIG. 6 until execution of the function is completed.

FIG. 7 illustrates a method of automatically executing a camera in a flexible electronic device according to various embodiments.

Referring to FIG. 7, in operation 710, the processor 520 of the electronic device 101 according to an embodiment is in a display reduction state (or The first app can be executed in the second housing (e.g., the second housing 220 in FIG. 2a being inserted in the first direction) with respect to the first housing (e.g., the first housing 210 in FIG. 2a). .

In operation 720, the processor 520 determines whether the execution screen of the first app displayed in the first display area is a screen supporting auxiliary camera mode or quick camera mode (hereinafter referred to as quick camera mode), and performs operation 730. In , if the condition of the quick camera mode support screen is satisfied, the processor 520 may display a quick camera notification object that informs the user of the quick camera mode availability status.

For example, the processor 520 may determine, through the first display area, whether the activity screen displayed on the display while the first app is running is converted to a screen that allows entry into the quick camera mode.

For another example, when running the first app, the processor 520 determines that it is a quick camera mode support screen when the screen is converted to a screen that includes image/video attachment items or shooting-related items within the activity screen displayed on the display. You can decide.

The processor 520 may end the process of FIG. 6 when the first app capable of calling the quick camera mode does not satisfy the execution conditions in the display reduction state having the first display area.

According to one embodiment, step 730 may be omitted.

According to some embodiments, as shown in FIG. 6, the processor 520 displays the first app in the first display area when the entire app is set as a quick camera call support app, regardless of the specific apptivity screen within the app. While running, it may display a quick camera notification object.

According to one embodiment, the processor 520 may display the quick camera notification object in an indicator area, but may also notify the user through a notification bar.

In operation 740, the processor 520 may determine whether a specific motion (e.g., an action or pose for taking a picture of the user by holding the electronic device) is detected, with the electronic device 101 maintaining the electronic device 101 within a set tilt angle for a set time. there is.

The processor 520 is capable of calling the quick camera mode, but may not call the quick camera mode if a specific motion is not detected.

At operation 750, processor 520, in response to detecting a particular motion, controls the drive device to automatically change the display from an extended state (or a state in which the second housing is retracted in a second direction relative to the first housing); , the quick camera mode corresponding to the first app can be called in the second display area (or extended area) (e.g., the second part 230b in FIG. 2A). For example, the processor 520 may display a camera switching screen (or camera transaction screen) on the exposed second display area while automatically changing the display to the expanded state.

According to some embodiments, if the activity screen of the running app is not specified as a display extension setting in relation to the quick camera mode, the processor 520 may omit step 750 and call the extended camera mode for a specific area within the app screen. You can.

In operation 755, the processor 520 may display a quick camera user interface (UI) corresponding to the first app while maintaining the first app execution screen being displayed in the first display area. For example, the quick camera user interface (UI) corresponding to the first app may be a UI designed based on the quick camera mode set according to the characteristics of the first app.

According to one embodiment, when the display expansion setting is specified when calling the quick camera mode related to an app, the processor 520 may display the quick camera UI on the second display area (or extended area) that expands the display. According to another embodiment, if the display expansion setting is not specified when calling the quick camera mode related to the app, the processor 520 may display the quick camera UI in a specific area within the activity screen of the app without expanding the display.

Substantially simultaneously or in parallel, at operation 760, processor 520 may change the display of the quick camera notification object state. For example, the processor 520 may display different colors of the quick camera notification object displayed in the indicator area, but may also change the display of effects and designs in addition to the color.

In operation 770, the processor 520 may perform a camera function in quick camera mode according to a user request. For example, the processor 520 may store a captured image obtained from a camera in response to an input for capturing a preview image output to the second display area (eg, selection of a captured item).

Although not shown in the drawing, operations 660 and 665 of FIG. 6 may be additionally performed after capturing an image, and will be omitted in the drawing of FIG. 7.

In operation 775, the processor 520 may attach or apply the captured image saved to the first app screen based on the image being saved through shooting.

In operation 780, the processor 520 may determine whether execution of the quick camera function related to the first app is complete (e.g., shooting is finished).

In operation 790, the processor 520 may end the quick camera mode based on completion of execution of the quick camera function.

According to one embodiment, when the processor 520 automatically changes the display area to an expanded state when calling the quick camera mode, the processor 520 controls the driving device to set the display to a reduced state (or to move the first housing to the first housing with respect to the second housing). You can automatically change to the retracted direction and then exit the quick camera mode. If execution of the quick camera function is not completed in operation 780, the processor 520 may maintain the process of FIG. 7 until execution of the function is completed.

Substantially simultaneously or in parallel, at operation 795, processor 520 may return the changed display of the quick camera notification object.

FIGS. 8A and 8B show examples of screens for automatically running a camera in a flexible electronic device according to various embodiments.

Referring to FIGS. 8A and 8B , the electronic device 101 according to various embodiments displays a quick camera notification object when running a specific app or a specific activity screen within the app that supports a quick camera call in a reduced display state. A quick camera call guide can be provided to the user.

The electronic device 101 according to various embodiments automatically expands the display when calling the auxiliary camera mode or quick camera mode (hereinafter referred to as quick camera mode), and maintains the app execution screen while expanding the display expansion area. You can call the quick camera mode related to the app running on .

According to one embodiment, the electronic device 101 can distinguish between apps that support quick camera mode calls and apps that do not. The electronic device 101 can set or designate apps that support calling the quick camera mode, and store data related to the user interface for each app or each activity screen of the app in relation to the quick camera mode.

For example, as shown in <801>, the electronic device 101 has a display 810 (e.g., the flexible display 230 in FIG. 2A and the flexible display 510 in FIG. 5) with a first display area. (e.g., the first portion 230a of FIG. 2) in a reduced state (or a second housing (e.g., the second housing of FIG. 2a) with respect to the first housing (e.g., the first housing 210 of FIG. 2a) When 220) is in the first direction, a web browser app can be executed or a web browser screen 820 can be displayed.

The processor 520 may not display the quick camera notification object if the display conditions of the quick camera notification object (e.g., display reduction state and display of an app or specific activity screen that supports quick camera calls) are not satisfied.

As an example, the processor (e.g., processor 520 in FIG. 5) determines that the web browser screen 820 or the web browser app is an activity screen that does not support quick camera calls, and displays the quick camera in the indicator area 815. The notification object may not be displayed.

For another example, as shown in <802>, the electronic device 101 has a display 810 (e.g., the flexible display 230 of FIG. 2A and the flexible display 510 of FIG. 5) having a first display area. Running the message/messenger app in a collapsed state (or a state in which the first housing is inserted into the second housing in the first direction) with (A1) (e.g., the first portion 230a in FIG. 2A), or a messenger conversation screen (830) can be displayed.

The processor (e.g., processor 520 in FIG. 5) confirms that the messenger conversation screen 830 or the message/messenger app is a quick camera call support app or activity screen, and displays a quick camera notification in the indicator area 815. An object 840 may be displayed.

The user can recognize that the quick camera mode can be called in the app or screen currently displayed in the first display area (A1) through the quick camera notification object 840 displayed in the indicator area (815). The user can recognize that a quick camera mode call is possible through the quick camera notification object 840, and can take a quick camera call motion (or pose, action).

When the electronic device 101 in the display reduction state detects a specific motion (or quick camera call action) that maintains a set time within a set tilt angle range, the processor 520, as shown in <803>, performs a first The display 810 can be automatically changed to an expanded state while maintaining the messenger conversation screen 830 displayed in the display area A1. The electronic device 101 exposes the second display area A2 extended from the first display area A1 in the display extended state (that is, the first housing is pulled out from the second housing in the second direction). , Quick camera mode can be called in the expanded second display area (A2). While the processor 520 changes from the display reduction state to the display expansion state, a camera change screen (e.g., a camera call transition screen) 850 may be displayed on the second display area A2 exposed to the outside. When calling a quick camera, the processor 520 provides a quick camera notification object 840 by changing at least one of the size, shape, color, and design of the object to be visually different from the display before calling the camera (e.g., 840 -> 840a). You can.

As shown in <804>, the processor 520 activates the camera in the second display area A2 based on the completion of exposure of the second display area A2 and switches to the quick camera UI screen 860. It can be displayed.

The quick camera UI screen 860 may include at least one of a shooting item 870, a camera switching item 875, a saving item 880, and a cancel item 890 within the preview video, but this is only an example and is limited to this. It doesn't work.

When a situation requires the camera function in a reduced display state, the user changes to the expanded display state by making a specific motion and calls the quick camera mode in the extended area (e.g., second display area (A2)) to view the currently running app or screen. Camera functions related to can be performed more easily.

Figure 9 shows examples of screens for automatic camera execution in a flexible electronic device according to various embodiments.

Referring to FIG. 9, the electronic device 101 according to various embodiments uses an auxiliary camera mode or a quick camera mode (hereinafter referred to as a quick camera mode) in a specific area within the app execution screen without expanding the display. You can call it to display the Quick Camera user interface associated with the running app. The electronic device 101 according to various embodiments may support additional functions for captured images when additional functions are supported in the quick camera mode. The additional function may include, but is not limited to, at least one of a photo correction function, a text input function, and a drawing function, and may differ depending on the characteristics of the app or the characteristics of a specific activity screen within the app.

The electronic device 101 according to various embodiments may provide quick camera UIs designed differently for each app characteristic.

For example, as shown in <901>, the electronic device 1010 has a display 810 (e.g., the flexible display 230 of FIG. 2A and the flexible display 510 of FIG. 5) having a first display area. (e.g., the first portion 230a of FIG. 2) in a reduced state (or a second housing (e.g., the second housing of FIG. 2a) with respect to the first housing (e.g., the first housing 210 of FIG. 2a) The contact profile editing screen 920 of the contact app may be displayed in the state in which (220) is inserted in the first direction. Since the profile editing screen 920 is an activity screen capable of supporting a quick camera mode call, the processor (e.g., The processor 520 of FIG. 5 may display a quick camera mode notification object.

As shown in <902>, the processor 520 displays a contact profile editing screen 920 designated as a quick camera call support app or activity screen in a reduced display state, and displays the contact profile editing screen 920 when the electronic device 101 is within the set tilt angle range. When a specific motion (or quick camera call action) that maintains the set time is detected, the quick camera mode is called to a specific area within the contact profile editing screen 920 of the first display area A1, and the contact app or contact A quick camera UI screen 930 related to the profile editing screen 920 may be displayed. For example, the contact profile editing screen 920 may include a profile image area 921. The processor 520 may display a camera change screen (e.g., camera call transition screen) 925 while calling the quick camera mode in the profile image area 921.

As shown in <903>, the processor 520 may display the quick camera UI screen 930 by calling the quick camera mode in the profile image area 921 of the contact profile editing screen 920. The quick camera UI screen 930 may include a shooting item 950, a camera switching item 940, and menu items 960 providing an image correction function.

For example, the contact profile editing screen 930 may be recognized as a situation in which a user's face is being photographed. The electronic device 101 may call the quick camera mode to capture an image while the contact profile editing screen 920 of the contact app is displayed.

According to one embodiment, the contact app or contact profile editing screen 920 may support an additional function that provides a correction filter for forest color after shooting.

The user can select the shooting item 950 to capture an image obtained from a camera.

As shown in <904>, the processor 520 may provide an additional function UI 970 to the captured image 935 captured through the quick camera mode. An additional function specified in the contact app or contact profile editing screen 920 is, for example, a color correction function for a captured image, and a plurality of color filters may be provided.

When the user selects one of the correction filters, the processor 520 may post-correct the color of the captured image 935 displayed in the second display area A2. When the user selects the save item 980, the captured image can be saved, and when the user selects the cancel item 990, the original color of the captured image can be restored.

Additionally, although not shown in the drawing, based on the user completing execution of the correction function (or selecting the save item 980), the processor 520 displays the contact profile editing screen (in other words, running on the first display area A1). , the captured image 935 can be automatically added (or inserted) into the profile image area 921 of the image addition area 920.

FIGS. 10A and 10B show examples of screens for automatically running a camera in a flexible electronic device according to various embodiments.

Referring to FIGS. 10A and 10B , the processor (e.g., processor 520 of FIG. 5 ) of the electronic device 101 according to various embodiments operates on the display 1010 (e.g., as shown in <10001>). The flexible display 230 of FIG. 2A and the flexible display 510 of FIG. 5 are in a reduced state (or a first housing (e.g., FIG. 2a) having a first display area (e.g., the first portion 230a of FIG. 2). In the second housing (e.g., with the second housing 220 in FIG. 2A inserted in the first direction) with respect to the first housing 210), auxiliary camera mode or quick camera mode (hereinafter referred to as quick camera mode) You can run a writing app that supports calls (e.g. note app, memo app, drawing app, etc.). The processor 520 may display the handwriting app screen 1020 in the first display area A1 and display the quick camera notification object 1015 in the indicator area 1017.

When the user makes a specific motion (or pose, action) that holds the electronic device within a set tilt angle for a specified period of time, the processor 520 detects the specific motion that calls the quick camera and automatically turns the display 1010 on. It can be converted to an extended state (or a state in which the first housing is pulled out from the second housing in the second direction). For example, the processor 520 may control the driving device to automatically expose the second display area A2 extending from the first display area A2 to convert the display 1010 to an expanded state.

As shown in <10002>, the processor 520 may display a camera switching screen (or camera transaction screen) 1025 on the second display area A2 while the display 1010 is switched to the extended state. . The processor 520 may change the quick camera notification object 1015 to a display state 1015a indicating that the camera is in use.

As shown in <10003>, the processor 520 displays a writing app or a quick camera corresponding to the writing app screen 1020 in the second display area A2 in response to the completion of exposure of the second display area A2. UI 1030 can be displayed. The quick camera UI 1030 may include a shooting item 1040 and a camera switching item 1045 within the preview image.

The user can take an image through the quick camera mode called in the second display area (A2) while maintaining the handwriting app running in the first display area (A1). For example, when the user selects the capture item 1040 and captures an image, the processor 520 stores the captured image 1035 along with the save item 1050 and the re-photograph item, as shown in <10004>. (1055) can be displayed in the second display area A2.

The processor 520 may provide an additional function specified in the quick camera mode of the handwriting app, for example, a drawing/text tool function item 1060, to the captured image 1035.

When the user selects the drawing/text tool function item 1060, the processor may display the drawing/text tool UI 1065 on the second display area A2, as shown in <10005>.

The user can perform additional functions using the drawing/art tool UI 1065 and then select a save item 1050.

When the save item 1050 is selected, the processor 520 determines that the camera function has been executed and displays the captured image 1035 captured through the second display area A2 in the handwriting app displayed in the first display area A1. It can be inserted (or attached) as an attached image 1075 of the screen 1020. The processor 520 may provide edit items 1070 related to the image 1075 inserted (or attached) to the first display area, but is not limited thereto.

Based on completion of execution of the camera function, the processor 520 may terminate the quick camera mode, as shown in <10006>, and automatically change the display 1010 to a reduced state so that it has the first display area A1. there is.

Referring to FIG. 11, according to various embodiments, the electronic device 101 has a display (e.g., the flexible display 230 of FIG. 2A or the flexible display 510 of FIG. 5) in a first display area (e.g., FIG. 2). A second housing (e.g., the second housing 220 in FIG. 2a) is in a reduced state (or a first housing (e.g., the first housing 210 in FIG. 2a) with a first portion 230a). When a specified specific motion is detected in the state in which the display is retracted in the direction, the display is automatically switched to the extended state (or the state in which the second housing is withdrawn in the second direction with respect to the first housing), and the expanded second display area is displayed. (A2) can support the function of calling the camera function.

In operation 1110, the processor 520 may check whether the electronic device 101 is operating in a reduced display state with the first display area. If the display is not in a reduced state, the processor 520 may end the process of FIG. 11 .

In operation 1120, the processor 520 may determine whether a specific motion is detected that causes the electronic device to remain within a set tilt angle for a camera call in a display zoomed-out state for more than a specified time. If a specific motion is not detected in the display reduction state, the processor 520 may end the process of FIG. 11 .

In operation 1130, the processor 520 is in the display reduction state, and when the condition for the electronic device 101 to maintain a specific motion is satisfied, the display is in the extended state (or the second housing is pulled out in the second direction with respect to the first housing). state), and the camera can be called in the second display area.

In operation 1140, the processor 520 may display a camera UI (or quick camera UI) in the second display area while maintaining the screen being executed in the first display area.

In this case, when calling the camera, the electronic device switches the screen being displayed in the first display area to the background, does not display the camera UI as the full screen in the foreground, and uses the camera UI (or Quick Camera UI) can be displayed.

FIG. 12 shows examples of screens for automatic camera execution in a flexible electronic device according to various embodiments.

Referring to FIG. 12, the processor (e.g., the processor 520 of FIG. 5) of the electronic device 101 according to various embodiments operates on the display 1210 (e.g., the processor 520 of FIG. 2A), as shown in <120001>. The flexible display 230 (flexible display 510 of FIG. 5) is in a reduced state (or a first housing (e.g., the first portion 230a of FIG. 2A) having a first display area (e.g., the first portion 230a of FIG. 2). With respect to the housing 210, a lock screen 1210 in which at least some functions are restricted may be displayed in the second housing (e.g., the second housing 220 of FIG. 2A being inserted in the first direction).

The lock screen 1220 may include some functions allowed in the lock screen 1220 (e.g., phone function item 1225 and camera item 1227). Although not shown in the drawing, as an example, when the user selects the camera item 1227 on the lock screen 1220, the electronic device 101 calls the camera function to display the full screen, covering the entire first display area A1. A camera UI can be provided.

As another example, when the processor 520 of the electronic device 101 detects a specific motion (or pose, action) maintained for a specified time within a set tilt angle while the display is reduced, the processor 520 ( As shown in <12002>, the display 1210 is automatically expanded (or the first housing is attached to the second housing) while maintaining the lock screen 1220 displayed on the first display area A1. It can be converted to a state where it is drawn out in the second direction.

The processor 520 may display a camera switching screen (or camera transaction screen) 1230 in the second display area A2 while the display 1010 is switched to the extended state. The processor 520 may display the quick camera notification object 1240 in the indicator area.

As shown in <12003>, the processor 520 may display the quick camera UI 1240 by calling the camera in the second display area A2 in response to completion of exposure of the second display area A2. there is. At this time, the camera mode called in the second display area may provide all camera functions, but may be provided as a UI limited to the size of the second area. For example, the quick camera UI 1240 may include a shooting item 1250, a camera switching item 1260, and a camera mode menu item 1270. For another example, the camera mode called in the second display area may be provided as a quick camera UI that provides only some camera functions depending on settings.

According to one embodiment, the operation of changing the display to an extended state exposing a second display area extending from the first display area and the operation of executing the camera function may be performed when the first app is not set to an extended display. In the case of an app, the camera function related to the first app is executed in a specific area within the execution screen of the first app without changing to an expanded state exposing the second display area, and the camera function related to the first app is executed in the second area. The camera function that is executed may be executed in a certain camera function mode designated for each app characteristic or specific activity screen of the app.

When the first app according to an embodiment supports a camera function or auxiliary camera mode call called on the second display area, an operation of displaying a camera notification object guiding the camera call called on the second display area. The operation of executing the auxiliary camera mode corresponding to the first app further includes the operation of visually changing the display state of the camera notification object to be displayed differently after calling the camera function in the second display area. can do.

The operation of displaying the camera notification object according to an embodiment includes displaying the camera notification object, and then displaying a second app that does not support the auxiliary camera mode in the first display area, or displaying the second app that does not support the auxiliary camera mode in the first display area. 1 When the auxiliary camera mode within the app is switched to a specific activity screen that is not supported, an operation of removing the display of the camera notification object may be further included.

The operation of changing the display back to a reduced state with the first display area according to an embodiment includes an image or video captured through the auxiliary camera mode based on completion of execution of the camera function based on the auxiliary camera mode. The method may further include inserting or attaching to the execution screen of the first app displayed in the first display area.

The operation of executing the auxiliary camera mode corresponding to the first app according to an embodiment includes capturing an image or video through the auxiliary camera mode running in the second display area, and then additional functions related to the image or video are present. In this case, the method may further include displaying an additional function user interface in the second display area.

The additional function according to one embodiment may include at least one of a post-editing function, a text input function, and a drawing function.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play StoreTM) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims

In electronic devices,

first housing;

a second housing disposed to move the first housing in a first direction or a second direction opposite to the first direction;

a driving device that controls the first housing to move in a first direction or the second direction relative to the second housing;

A first display area exposed when the first housing is moved in the second direction with respect to the second housing, and the second display area extends integrally with the first display area and is moved with respect to the second housing by the driving device. 1 A flexible display including a second display area exposed when the housing moves in the first direction;

At least one camera;

sensor; and

Includes a processor operatively connected to the flexible display, the at least one camera, the sensor, and the driving device,

The processor is

Executing a first app in the first display area while the first housing is moved in a second direction relative to the second housing,

When a specific motion that maintains a set time within a set tilt angle of the electronic device is detected through the sensor, the driving device is controlled to move the first housing in the first direction with respect to the second housing,

While maintaining the first app running in the first display area, call the at least one camera to the second display area that is exposed as the first housing is moved in the first direction with respect to the second housing. to execute the camera function related to the first app,

The electronic device is set to change back to a state in which the first housing is moved in the second direction with respect to the second housing, based on completion of executing the camera function through the second display area.
According to paragraph 1,

The processor,

If the first app is not set to display extension, the camera function related to the first app is executed in a specific area within the execution screen of the first app without exposing the second display area in response to the specific motion. Set electronic device.
According to paragraph 1,

The electronic device is characterized in that the camera function executed in the second area is executed in a mode that provides only some camera functions specified for each app characteristic or specific activity screen of the app.
According to paragraph 1,

The processor,

An electronic device configured to display a camera user interface corresponding to a camera function executed in relation to the first app in the second display area while maintaining the execution screen of the first app in the first display area.
According to paragraph 1,

The processor,

While the second display area is exposed, displaying a camera switching screen indicating that a camera call is in progress in the second display area,

An electronic device configured to activate the at least one camera based on completion of exposure of the second display area to display an image acquired through the at least one camera on the second display area as a preview screen.
According to clause 5,

The processor,

If the first app supports a camera function or auxiliary camera mode call called in the second display area, displays a camera notification object guiding the camera call called in the second display area,

An electronic device configured to provide visually different display states of the camera notification object in the second display area after calling the camera function.
According to clause 6,

The electronic device is characterized in that the camera notification object is displayed in an indicator area.
According to clause 6,

The camera notification object is,

The second app running in the first display area does not support the function of executing a camera function related to the second app in the second display area, or the second app is not displayed in the second display area on a specific activity screen within the first app. An electronic device configured to not display the camera notification object if it does not support the function of executing a camera function related to the first app.
According to paragraph 1,

The processor,

The electronic device is further set to insert or attach an image or video captured through the second display area to the execution screen of the first app displayed on the first display area based on completion of execution of the camera function through the second display area. Device.
According to paragraph 1,

The processor,

An electronic device configured to further provide an additional function user interface to the second display area when an additional function related to the image or video exists after capturing an image or video through the second display area.
According to clause 10,

The additional function includes at least one of a post-editing function, a text input function, and a drawing function.
According to paragraph 1,

The processor,

A lock screen is displayed in the first display area while the first housing is coupled to the second housing in a second direction, and a specific motion is performed to maintain the electronic device for a set time within a set tilt angle through the sensor. When this is detected, the camera mode is not called as the full screen of the first display area, and the driving device is controlled to move the first housing in the first direction with respect to the second housing to open the second display area. The electronic device is further configured to display a camera user interface by exposing the camera to the second display area.
In a method of automatically launching a camera of an electronic device including a flexible display,

An operation of executing a first app in a collapsed state in which a display area in which visual information is to be displayed can be reduced or expanded and has a first display area;

When the electronic device detects a specific motion that maintains a set time within a set tilt angle, changing the display to an expanded state exposing a second display area extending from the first display area;

Maintaining the first app running in the first display area and executing a camera function related to the first app by calling at least one camera in the second display area that is exposed as the state is changed to the expanded state. movement; and

A method comprising changing the display back to a reduced state with the first display area based on completion of execution of the camera function through the second display area.
According to clause 13,

The operation of changing the display to an expanded state exposing a second display area extending from the first display area and the operation of executing the camera function include:

If the first app is an app that is not set to display expansion, the camera function related to the first app is executed in a specific area within the execution screen of the first app without changing to an expanded state exposing the second display area. Characterized by,

A method wherein the camera function executed in the second area is executed in a mode in which a part of the camera function is designated for each app characteristic or specific activity screen of the app.
According to clause 13,

When the first app supports a camera function or auxiliary camera mode call called in the second display area, it further includes displaying a camera notification object to guide the camera call called in the second display area, The operation of executing the auxiliary camera mode corresponding to the first app is:

The method further includes an operation of visually changing the display state of the camera notification object to be displayed differently after calling the camera function in the second display area.